Junhao Jiang

Mapping new and old buildings are of great significance for understanding socio-economic development in rural areas. In recent years, deep neural networks have achieved remarkable building segmentation results in high-resolution remote sensing images. However, the scarce training data and the varying geographical environments have posed challenges for scalable building segmentation. This study proposes a novel framework based on Mask R-CNN, named Histogram Thresholding Mask Region-Based Convolutional Neural Network (HTMask R-CNN), to extract new and old rural buildings even when the label is scarce. The framework adopts the result of single-object instance segmentation from the orthodox Mask R-CNN. Further, it classifies the rural buildings into new and old ones based on a dynamic grayscale threshold inferred from the result of a two-object instance segmentation task where training data is scarce. We found that the framework can extract more buildings and achieve a much higher mean Average Precision (mAP) than the orthodox Mask R-CNN model. We tested the novel framework’s performance with increasing training data and found that it converged even when the training samples were limited. This framework’s main contribution is to allow scalable segmentation by using significantly fewer training samples than traditional machine learning practices. That makes mapping China’s new and old rural buildings viable.

Land cover information depicting the complex interactions between human activities and surface change is critically essential for nature conservation, social management, and sustainable development. Recent advances have shown great potentials of remote sensing data in generating high-resolution land cover maps, but it remains unclear how different models, data sources, and inclusive features affect the classification results, which hinders its applications in regional studies requiring more accurate land cover data. Informing these issues, here we developed a robust framework to improve the mapping results of 10 m resolution land cover classification in Guangdong Province, China using thousands of manually collected samples, multisource remote sensing data (Sentinel-1, Sentinel-2, and Luojia-1), machine learning algorithms, and a free cloud-based platform of Google Earth Engine. Results showed that an overall accuracy of 86.12% and a Kappa coefficient of 0.84 could be achieved for land cover classification in Guangdong for 2019. We found that random forest models achieved better performance than classification and regression trees, minimum distance, and support vector machine models. We also found that features derived from Sentinel-1 data and Sentinel-2 spectral indices greatly contributed to the classification process, while the feature of Luojia-1 data was not as much important as other configurations. A comparison between our results and several existing land cover products in terms of classification accuracy and visual interpretation further validated the effectiveness and robustness of the proposed framework. Our experiments and findings not only systematically elucidate the role of classification methods and data sources in deriving more accurate and reliable land cover maps but also provide certain guidelines for future land cover mapping from regional to global scales.

The recognition and sorting of coal and gangue are an important part of the process of reducing costs and improving production efficiency. In this paper, under the influence of long running pollution and similar background grayscale, a new method was proposed based on image process and multilayer perceptron. The robust image extraction method was used for the reverse selection edge extraction method (RS-EEM) to eliminate background interference. Moreover, a deep learning model called multilayer perceptron (MLP) was proposed to recognize coal and gangue with simple structure, which is easy to transplant with high precision and great timeliness. In order to evaluate the correctness and efficiency of the algorithm, a sorting robot of coal and gangue was built based on MLP and image processing. The experiment results showed that the images of coal and gangue can be precisely recognized based on RS-EEM under the influence of long running pollution and similar background grayscale, and the recognition accuracy can reach to 96.15% as well as grasping accuracy to 85% at 0.4 m/s conveyor belt speed.