Super-resolution GANs for upscaling unplanned urban settlements from remote sensing satellite imagery - the case of Chinese urban village detection

Crivellari, Alessandro1; Wei, Hong2; Wei, Chunzhu3,4; Shi, Yuhui1

2023-12-31

10.1080/17538947.2023.2230956

INTERNATIONAL JOURNAL OF DIGITAL EARTH   影响因子和分区

1753-8947

1753-8955

The semantic segmentation of informal urban settlements represents an essential contribution towards renovation strategies and reconstruction plans. In this context, however, a big challenge remains unsolved when dealing with incomplete data acquisitions from multiple sensing devices, especially when study areas are depicted by images of different resolutions. In practice, traditional methodologies are directed to downgrade the higher-resolution data to the lowest-resolution measure, to define an overall homogeneous dataset, which is however ineffective in downstream segmentation activities of such crowded unplanned urban environments. To this purpose, we hereby tackle the problem in the opposite direction, namely upscaling the lower-resolution data to the highest-resolution measure, contributing to assess the use of cutting-edge super-resolution generative adversarial network (SR-GAN) architectures. The experimental novelty targets the particular case involving the automatic detection of 'urban villages', sign of the quick transformation of Chinese urban environments. By aligning image resolutions from two different data sources (Gaofen-2 and Sentinel-2 data), we evaluated the degree of improvement with regard to pixel-based landcover segmentation, achieving, on a 1 m resolution target, classification accuracies up to 83%, 67% and 56% for 4x, 8x, and 10x resolution upgrades respectively, disclosing the advantages of artificially-upscaled images for segmenting detailed characteristics of informal settlements.

SR-GAN resolution upscaling informal settlements urban villages cross-sensor analytics >

SCI ; EI

英语

第一 ; 通讯

Shenzhen Fundamental Research Program[JCYJ20200109141235597] ; National Science Foundation of China["61761136008","42001178"] ; Southern Marine Science and Engineering Guangdong Laboratory (Zhuhai)[311021018]

Physical Geography ; Remote Sensing

Geography, Physical ; Remote Sensing

WOS:001022638700001

TAYLOR & FRANCIS LTD

20232814394078

Generative adversarial networks ; Image enhancement ; Remote sensing ; Rural areas ; Satellite imagery ; Semantic Segmentation ; Semantics

Satellites:655.2 ; Artificial Intelligence:723.4

Web of Science

1.Southern Univ Sci & Technol, Dept Comp Sci & Engn, 1088 Xueyuan Ave, Shenzhen 518055, Peoples R China
2.Tsinghua Univ, Inst Global Change Studies, Dept EarthSystem Sci, Minist Educ,Ecol Field Stn East Asian Migratory Bi, Beijing, Peoples R China
3.Sun Yat sen Univ, Sch Geog & Planning, 132 Outer Ring Rd, Guangzhou 510006, Peoples R China
4.Southern Marine Sci & Engn Guangdong Lab Zhuhai, Zhuhai, Peoples R China

Crivellari, Alessandro,Wei, Hong,Wei, Chunzhu,et al. Super-resolution GANs for upscaling unplanned urban settlements from remote sensing satellite imagery - the case of Chinese urban village detection[J]. INTERNATIONAL JOURNAL OF DIGITAL EARTH,2023,16(1):2623-2643.

Crivellari, Alessandro,Wei, Hong,Wei, Chunzhu,&Shi, Yuhui.(2023).Super-resolution GANs for upscaling unplanned urban settlements from remote sensing satellite imagery - the case of Chinese urban village detection.INTERNATIONAL JOURNAL OF DIGITAL EARTH,16(1),2623-2643.

Crivellari, Alessandro,et al."Super-resolution GANs for upscaling unplanned urban settlements from remote sensing satellite imagery - the case of Chinese urban village detection".INTERNATIONAL JOURNAL OF DIGITAL EARTH 16.1(2023):2623-2643.