Research progress and prospect of remote sensing-based feature extraction of opencast mining areas
ZHANG Xian1,2(), LI Wei1,2, CHEN Li1, YANG Zhaoying1,2, DOU Baocheng3, LI Yu1(), CHEN Haomin1
1. China Aero Geophysical Survey and Remote Sensing Center for Natural Resources, Beijing 100083, China 2. Key Laboratory of Airborne Geophysics and Remote Sensing Geology, Ministry of Natural Resources, Beijing 100083, China 3. Zhijiang Lab, Beijing 100086, China
The remote sensing-based feature extraction of opencast mining areas is a hot topic in research on the monitoring of mining activities. However, there is a lack of systematic reviews and summaries of relevant studies. Therefore, this study first defined the features of an opencast mining area, divided the feature extraction into single- and multi-feature extractions according to feature types, and briefly described the differences between the feature extraction of opencast mining areas and general surface feature extraction and land use classification. Then, this study briefly summarized the sources and data processing platforms of remote sensing images available in relevant studies. Subsequently, this study divided the remote sensing-based methods for the feature extraction of opencast mining areas into three categories, namely visual interpretation, traditional feature-based approach, and deep learning. Then, it summarized the research status of these methods and analyzed their advantages, disadvantages, and applicability. Finally, this study proposed the future research direction of the remote sensing-based feature extraction of opencast mining areas, holding that the future developmental trend is to further promote the intelligent, fine-scale, and robust feature extraction of mining areas by effectively utilizing multi-source and multi-temporal data, networks with a stronger feature extraction capacity, and methods for the optimization of complex scenes. The results of this study can be used as a reference for the study and application of remote sensing-based feature extraction of opencast mining areas.
Li H K, Xiong Y F, Wu L X. The object-oriented recognition method for remote sensing image with high spatial resolution for iron rare earth mining[J]. Chinese Rare Earths, 2017, 38(4):38-49.
[3]
Kopec A, Trybała P, Głabicki D, et al. Application of remote sensing,GIS and machine learning with geographically weighted regression in assessing the impact of hard coal mining on the natural environment[J]. Sustainability, 2020(12):9338.
Peng Y, He G J, Cao H. Extraction of rare earth mining areas using objects-oriented classification approach based on texture characteristics[J]. Science Technology and Engineering, 2013, 13(19):5590-5596.
Zhang F J, Wu Y L, Yao X D, et al. Opencast mining area intelligent extraction method for multi-source remote sensing image based on improved DenseNet[J]. Remote Sensing Technology and Application, 2020, 35(3):673-684.
Dai J J, Wu Y N, Wang D H, et al. object-oriented classification for the extraction of remote sensing information in rare earth mining areas[J]. Acta Geoscientica Sinica, 2018, 39(1):111-118.
[7]
刘家兴, 隋翔宇, 包妮沙, 等. Google Earth Engine平台支持下的铁矿区开采及植被变化遥感动态监测[J]. 矿山测量, 2020, 48(6):43-48.
Liu J X, Sui X Y, Bao N S, et al. Dynamic monitoring using remote sensing technology for iron mining area and vegetation change detection based on Google Earth Engine platform[J]. Mine Surveying, 2020, 48(6):43-48.
Yan K, Shen T, Chen Z C, et al. Automatic extraction of tailing pond based on SSD of deep learning[J] Journal of University of Chinese Academy of Sciences, 2020, 37(3):360-367.
doi: 10.7523/j.issn.2095-6134.2020.03.009
[9]
Ma B D, Chen Y T, Zhang S, et al. Remote sensing extraction method of tailings ponds in ultra-low-grade iron mining area based on spectral characteristics and texture entropy[J]. Entropy, 2018, 20(5):345.
doi: 10.3390/e20050345
[10]
Lyu J J, Hu Y, Ren S L, et al. Extracting the tailings ponds from high spatial resolution remote sensing images by integrating a deep learning-based model[J]. Remote Sensing, 2021, 13(4):743.
doi: 10.3390/rs13040743
Zeng F M, Yang B, Wu D W, et al. Extraction of roads in mining area based on Canny edge detection operator[J]. Remote Sensing for Land and Resources, 2013, 25(4):72 -78.doi:10.6046/gtzyyg.2013.04.12.
doi: 10.6046/gtzyyg.2013.04.12
Lin H, Zhu Q, Hu Z L. Land cover change detection based on mixed dynamic monitoring method in mining area[J]. Bulletin of Surveying and Mapping, 2014(11) :25-27.
doi: 10.13474/j.cnki.11-2246.2014.0355
Zhong J. Research on information automatically extract method of surface coal mining in Xilinhot[D]. Beijing: China University of Geosciences (Beijing), 2016.
Wang H Q, Li L, Chen L, et al. An analysis of mining intensity about metal mines based on investigation of tailing reservoirs in Tibet[J]. Remote Sensing for Land and Resources, 2019, 31(2):218-223.doi:10.6046/gtzyyg.2019.02.30.
doi: 10.6046/gtzyyg.2019.02.30
Liao Z W, Wei Y K, Chen P. Application of remote sensing technology in the investigation of mine development land occupation in South Tianshan Kunlun Mountain area[J]. Low Carbon Technology, 2019(1):66-67.
[17]
Azeez A H A, Mukhitdinov S. Land use land cover change detection in the mining areas of V.D. Yalevsky coal mine-Russia[C]// VIII International Scientific Conference “Problems of Complex Development of Georesources”.E3S Web of Conferences, 2020, 192:04021.
Fan Y L, Lou D B, Zhang C Q, et al. Information extraction technologies of iron mine tailings based on object-oriented classification:A case study of Beijing-2 remote sensing images of the Qianxi area,Hebei Province[J]. Remote Sensing for Natural Resources, 2021, 33(4):153-161.doi:10.6046/zrzyyg.2021027.
doi: 10.6046/zrzyyg.2021027
[19]
Wu B, Zhao Y D, Fang C Y. Detection of spatiotemporal changes of surface mining area in Changting Count Southeast China[C]// International Geoscience and Remote Sensing Symposium.IEEE, 2019:1606-1609.
Cai X, Li Q, Luo Y, et al. Surface features extraction of mining area image based on object-oriented and deep-learning method[J]. Remote Sensing for Land and Resources, 2021, 33(1):63-71.doi:10.6046/gtzyyg.2020111.
doi: 10.6046/gtzyyg.2020111
Zhang C Y, Xing J H, Li J, et al. Recognition of the spatial scopes of tailing ponds based on U-Net and GF-6 images[J]. Remote Sensing for Natural Resources, 2021, 33(4):252-257.doi:10.6046/zrzyyg.2021017.
doi: 10.6046/zrzyyg.2021017
Zhang K L, Chang Y G, Pan J, et al. MTBNet for tailing pond of Tangshan City[J]. Journal of Henan Polytechnic University (Natural Science), 2022, 41(4):65-71,94.
Standardization Administration of the People’s Republic of China. GB/T 21010—2017 current land use classification[S]. Beijing: China Standards Publishing House, 2017.
[24]
Gallwey J, Robiati C, Coggan J, et al. A Sentinel-2 based multispectral convolutional neural network for detecting artisanal small-scale mining in Ghana:Applying deep learning to shallow mining[J]. Remote Sensing of Environment, 2020, 248:111970.
doi: 10.1016/j.rse.2020.111970
[25]
张云英. 基于GF-1遥感影像矿区的信息提取与建模[D]. 唐山: 华北理工大学, 2016.
Zhang Y Y. Remote sensing image based on GF-1 mining area of information extraction and modeling[D]. Tangshan: North China University of Science and Technology, 2016.
Song Q F, Wang S J, Zhang Z, et al. A water information extraction method based on WorldView II remote sensing image in Tungsten ore districts:A case study of of Dayu County in Jiangxi Province[J]. Remote Sensing for Land and Resources, 2011, 23(2):33-37.doi:10.6046/gtzyyg.2011.02.06.
doi: 10.6046/gtzyyg.2011.02.06
Li P F, Guo X P, Gu Q M, et al. Vegetation coverage information extraction of mine dump slope in Wuhai City of Inner Mongolia based on visible vegetation index[J]. Journal of Beijing Forestry University, 2020, 42(6):102-112.
[29]
Xiang J, Chen J P, Sofia G, et al. Open-pit mine geomorphic changes analysis using multi-temporal UAV survey[J]. Environmental Earth Sciences, 2018, 77:220.
doi: 10.1007/s12665-018-7383-9
Lu Y, Lu X P, Gu X F, et al. Typical surface features extraction in mining area based on data of LiDAR and GeoEye[C]// 2014 Annual Academic Meeting of China Society of Surveying and Mapping Geographic Information, 2014.
Lu Y, Lu X P, Wu Y B, et al. Typical surface features extraction in mining area based on data of LiDAR and WorldView-2[J]. Bulletin of Surveying and Mapping, 2015(12):57-59.
doi: 10.13474/j.cnki.11-2246.2015.378
[32]
Nascimento F S, Gastauer M, Souza-Filhob P W M, et al. Land cover changes in open-cast mining complexes based on high-resolution remote sensing data[J]. Remote Sensing, 2020, 12(4):611.
doi: 10.3390/rs12040611
Yang X H, Wei P, Lyu J, et al. Application of mining collapse recognition technology based on multi-source remote sensing[J]. Remote Sensing for Natural Resources, 2022, 34(2):162-167.doi:10.6046/zrzyyg.2021195.
doi: 10.6046/zrzyyg.2021195
Xu K, Xie J F, Wang Y F, et al. An extraction method and system of distribution information of mining area based on DInSAR and DCNN:China, 201811528248.X[P]. 2019-04-02.
Mou X L, Li H, Huang C, et al. Application progress of Google Earth Engine in land use and land cover remote sensing information extraction[J]. Remote Sensing for Land and Resources, 2021, 33(2):1-10.doi:10.6046/gtzyyg.2020189.
doi: 10.6046/gtzyyg.2020189
[37]
Kumar L, Mutanga O. Google Earth Engine applications since inception:Usage,trends,and potential[J]. Remote Sensing, 2018, 10(10):1509.
doi: 10.3390/rs10101509
[38]
Felipe de L L, Pedro W M S, Evlyn M L de M N, et al. Mapping mining areas in the Brazilian Amazon using MSI/Sentinel-2 imagery (2017)[J]. Remote Sensing, 2018, 10:1178.
doi: 10.3390/rs10081178
Gao Y Z, Hou J G, Chu Y, et al. Remote Sensing monitoring of tailings ponds based on the latest domestic satellite data[J]. Journal of Heilongjiang Institute of Technology, 2019, 33(3):26-29.
Long Y F, Qiao W Y, Sun J. Change detection of remote sensing images in Datun mining area based on support vector machine[J]. Geomatics & Spatial Information Technology, 2020, 43(12):107-110.
[41]
Laura J S, Chris J M, Damian J B, et al. Processes of land use change in mining regions[J]. Journal of Cleaner Production, 2014(84):494-501.
Liu X L. Research on object-oriented remote sensing images industrial solid waste information extraction method[D]. Beijing: China University of Geosciences (Beijing), 2013.
Huang D, Liu Q S, Liu G H, et al. Coal gangue yards information extraction using object-oriented method based on SPOT-5 remote sensing images[J]. Journal of Geo-information Science, 2015, 17(3):369-377.
Huo G J, Hu N X, Chen T, et al. Mining land use information extraction based on combining support vector machine and object oriented method[J]. Journal of Henan Polytechnic University(Nature Science), 2021, 40(2):70-75.
Peng Y, Zhang Z M, He G J. A method of extraction of remote sensing information in rare earth mining areas driven by visual attention model:China,201910317994.2[P]. 2019-07-26
[46]
Hinton G, Osindero S, Teh Y W. A fast learning algorithm for deep belief nets[J]. Eural Computation, 2006, 18(7):1527-1554.
Zheng Y P, Li G Y, Li Y. Survey of application of deep learning in image recognition[J]. Computer Engineering and Applications, 2019, 55(12):20-36.
doi: 10.3778/j.issn.1002-8331.1903-0031
Kuang H Y, Wu J J. Survey of image semantic segmentation based on deep learning[J]. Computer Engineering and Applications, 2019, 55(19):12-21.
doi: 10.3778/j.issn.1002-8331.1905-0325
Su L, Sun Y X, Yuan S Z. A survey of instance segmentation research based on deep learning[J]. CAAI Transactions on Intelligent Systems, 2022, 17(1):16-31.
[50]
Long J, Shelhamer E, Darrell T. Fully convolutional networks for semantic segmentation[C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015:3431-3440.
[51]
Girshick R, Donahue J, Darrell T, et al. Region-based convolutional networks for accurate object detection and segmentation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2016, 38(1):142-158.
doi: 10.1109/TPAMI.2015.2437384
pmid: 26656583
Xiang Y, Zhao Y D, Dong J H. Remote sensing image mining area change detection based on improved UNet siamese network[J]. Journal of China Coal Society, 2019, 44(12):3773-3780.
Song R Z, Zheng H Y, Wang D C, et al. Classification of features in open-pit mining areas based on deep learning and high resolution remote sensing images[J]. China Mining Magazine, 2022, 31(7):102-111.
[54]
张峰极. 多源遥感影像露天开采区深度学习提取方法研究[D]. 合肥: 安徽大学, 2019.
Zhang F J. Research on deep learning extraction method in open mining area based on multi-source remote sensing image[D]. Hefei: Anhui University, 2019.
[55]
董畅. 露天煤矿区的高分遥感图像多标签分类[D]. 徐州: 中国矿业大学, 2020.
Dong C. Multi-label classification of high-resolution remote sensing image in opencast coal mines[D]. Xuzhou: China University of Mining and Technology, 2020.
Liu X B, Liu P, Cai Z H, et al. Research progress of optical remote sensing image object detection based on deep learning[J]. Acta Automatica Sinica, 2021, 47(9):2078-2089.