Please wait a minute...
 
Remote Sensing for Land & Resources    2021, Vol. 33 Issue (1) : 63-71     DOI: 10.6046/gtzyyg.2020111
|
Surface features extraction of mining area image based on object-oriented and deep-learning method
CAI Xiang1,2(), LI Qi1, LUO Yan1, QI Jiandong1
1. School of Information Science & Technology, Beijing Forestry University, Beijing 100083, China
2. Engineering Research Center for Forestry-oriented Intelligent Information Processing of National Forestry and Grassland Administration, Beijing 100083, China
Download: PDF(5420 KB)   HTML
Export: BibTeX | EndNote | Reference Manager | ProCite | RefWorks    
Abstract  

Acquisition of surface features of the mining area is greatly helpful to safe mining operation and management. In this paper, the authors propose an object-oriented combined with deep-learning classification method to extract surface features of the mining area based on unmanned aerial vehicle (UAV) images. Firstly, images are segmented by object-oriented method with manual correction to make annotation data set for deep learning models. Secondly, prepared training image data set is used to train 3 deep learning models (FCN-32s, FCN-8s and U-Net) and obtain 3 trained deep learning models respectively. Thirdly, classification accuracy is improved, and 2 integrate algorithms, which are majority voting algorithm and scoring algorithm based on these deep learning models, are proposed. The experimental results show that, compared with the single object-oriented classification method, the proposed methods have higher surface feature extraction accuracy and higher Kappa coefficient, from which the scoring integrate model has the best recognition effect. The overall accuracy of feature extraction on the testing image data set is 94.55%, which is 5.96 percentage points higher than the single object-oriented classification method, with the Kappa coefficient being 0.819 1.

Keywords UAV aerial images      object-oriented      deep learning      mining area feature extraction      semantic segmentation     
ZTFLH:  TP79  
Issue Date: 18 March 2021
Service
E-mail this article
E-mail Alert
RSS
Articles by authors
Xiang CAI
Qi LI
Yan LUO
Jiandong QI
Cite this article:   
Xiang CAI,Qi LI,Yan LUO, et al. Surface features extraction of mining area image based on object-oriented and deep-learning method[J]. Remote Sensing for Land & Resources, 2021, 33(1): 63-71.
URL:  
https://www.gtzyyg.com/EN/10.6046/gtzyyg.2020111     OR     https://www.gtzyyg.com/EN/Y2021/V33/I1/63
Fig.1  Results after stitching and correcting the UAV images
Fig.2  Image segmentation results based on object-oriented method with different parameters (scale, shape, compact)
Fig.3  Procedure of making annotated data set by object-oriented method and manual correction
Fig.4  Structure of integrate algorithms for surface feature extraction on mining area
Fig.5  Basic structure of FCN
Fig.6  Structure of U-Net
Fig.7  Experimental results of different classification models on test image data set
Fig.8  Unclassified and mis-classified part of object-oriented classification method
分类方法 准确率/%
传统面向对象分类方法 88.59
U-Net 90.21
FCN-32s 93.50
FCN-8s 94.40
多数投票法 94.55
打分法 94.55
Tab.1  Overall classification accuracy of each method
分类方法 预测地物类别 实际地物类别 Kappa系数
矿区地面 道路 车辆 建筑 总数

面向对象分类方法
矿区地面
道路
车辆
建筑
合计
786
9
44
18
857
2
35
1
0
38
14
0
14
0
28
21
6
0
50
77
823
50
59
68
1 000

0.597 8
用户精度/% 91.72 92.11 50.00 64.94

U-Net
矿区地面
道路
车辆
建筑
合计
849
2
3
3
857
5
30
0
3
38
15
0
12
1
28
46
1
0
30
77
915
33
15
37
1 000

0.626 2
用户精度/% 99.07 78.95 42.86 38.96

FCN-32s
矿区地面
道路
车辆
建筑
合计
825
10
13
9
857
1
37
0
0
38
3
0
25
0
28
16
0
0
61
77
845
47
38
70
1 000

0.805 7
用户精度/% 96.27 97.37 89.29 79.22
分类方法 预测地物类别 实际地物类别 Kappa系数
矿区地面 道路 车辆 建筑 总数

FCN-8s
矿区地面
道路
车辆
建筑
合计
833
3
13
8
857
2
36
0
0
38
8
0
19
1
28
17
0
0
60
77
860
39
32
69
1 000

0.796 3
用户精度/% 97.20 94.74 67.86 77.92

多数投票法
矿区地面
道路
车辆
建筑
合计
844
0
7
6
857
1
37
0
0
38
9
0
19
0
28
21
0
0
56
77
875
37
26
62
1 000

0.819 1
用户精度/% 98.48 97.37 67.86 72.73

打分法
矿区地面
道路
车辆
建筑
合计
845
1
6
5
857
1
37
0
0
38
10
0
18
0
28
22
0
0
55
77
877
38
24
60
1 000

0.813 8
用户精度/% 98.60 97.37 64.29 71.43
Tab.2  Confusion matrix of classification results in test region for different models
Fig.9  Accuracy comparison before and after optimization by corrosion and expansion algorithms
[1] 张勇. 矿山安全监控系统的应用发展研究[J]. 石化技术, 2019(5):265-274.
[1] Zhang Y. Research on application and development of mine safety monitoring system[J]. Petrochemical Industry Technology, 2019(5):265-274.
[2] 李娜, 李素荣, 包妮沙, 等. 基于多源遥感数据的矿区典型地物最优尺度分割研究[J]. 河北遥感, 2014(2):25-28.
[2] Li N, Li S R, Bao N S, et al. Research on optimal scale segmentation of typical land objects based on multi-source remote sensing data[J]. Hebei Remote Sensing, 2014(2):25-28.
[3] 王飞红, 任晓敏. 基于CBERS-02B的矿区地物信息的提取[J]. 电子世界, 2013(21):121-122.
[3] Wang F H, Reng X M. Features information extraction of the mining area based on CBERS-02B[J]. Electronics World, 2013(21):121-122.
[4] 贾玉娜, 高雅, 白洋. 基于GF-1影像的矿区地物提取与分析[J]. 山西建筑, 2019,45(5):202-203.
[4] Jia Y N, Gao Y, Bai Y. Extraction and analysis of mining features based on GF-1[J]. Shanxi Architecture, 2019,45(5):202-203.
[5] 朱元峰, 况润元, 张刚华. 基于资源一号02C卫星影像的稀土矿区地物提取研究[J]. 江西理工大学学报, 2018,39(3):40-47.
[5] Zhu Y F, Kuang R Y, Zhang G H. Research on the extracted information on ground objects in rare earth mining area based on ZY-1 02C image[J]. Journal of Jiangxi University of Science and Technology, 2018,39(3):40-47.
[6] 孙家波, 张晓艳, 牛鲁燕, 等. 基于高分辨率遥感影像的耕地信息快速提取方法研究[J]. 山东农业科学, 2018,50(3):132-136,141.
[6] Sun J B, Zhang X Y, Niu L Y, et al. Farmland information extraction method based on high-resolution remotely-sensed images[J]. Shandong Agricultural Sciences, 2018,50(3):132-136,141.
[7] 荆平平, 李兵, 贾宗仁, 等. 基于无人机遥感的信息提取研究[J]. 测绘与空间地理信息, 2017,40(12):77-80.
[7] Jing P P, Li B, Jia Z R, et al. Research on information extraction based on UAV remote Sensing[J]. Geomatics & Spatial Information Technology, 2017,40(12):77-80.
[8] 何少林, 徐京华, 张帅毅. 面向对象的多尺度无人机影像土地利用信息提取[J]. 国土资源遥感, 2013,25(2):107-112.doi: 10.6046/gtzyyg.2013.02.19
[8] He S L, Xu J H, Zhang S Y. Land use classification of object-oriented multi-scale by UAV image[J]. Remote Sensing for Land and Resources, 2013,25(2):107-112.doi: 10.6046/gtzyyg.2013.02.19
[9] 张建勇, 赵艳玲, 肖武, 等. 利用低空无人机摄影测量快速构建矿区线状地物信息[J]. 测绘通报, 2017(10):106-110.
[9] Zhang J Y, Zhao Y L, Xiao W, et al. Rapid construction of mine line infrastructure using low-altitude unmanned aerial vehicle photogrammetry[J]. Bulletin of Surveying and Mapping, 2017(10):106-110.
[10] 韦国钧. 基于无人机影像快速发现可疑变化地物技术研究[D]. 南京:东南大学, 2018.
[10] Wei G J. A research on the key technology of quickly detecting suspicious changed land-use based on UAV images[D]. Nanjing:Southeast University, 2018.
[11] 徐晓萍. 无人机航测技术在矿区地形测量中的应用[J]. 资源信息与工程, 2018,33(3):114-115.
[11] Xu X P. Application of UAV aerial surveying technology in landform measurement of mining area[J]. Resource Information and Engineering, 2018,33(3):114-115.
[12] 师文杰, 张文君. 解析无人机航空摄影测量技术在矿山地质环境治理中的应用[J]. 环球人文地理, 2017(9):81.
[12] Shi W J, Zhang W J. Analyze the application of drone aerial photogrammetry technology in mine geological environment management[J]. Cultural Geography, 2017(9):81.
[13] Mnih V, Hinton G E. Learning to detect roadsin high-resolution aerial images[C]// European Conference on Computer Vision.Berlin:Springer, 2010: 210-223.
[14] 郑重, 张敬东, 杜建华. 基于深度学习的遥感图像中地面塌陷识别方法研究[J]. 现代商贸工业, 2017(35):189-192.
[14] Zheng Z, Zhang J D, Du J H. Research on ground collapse recognition in remote sensing images based on deep learning[J]. Modern Business Trade Industry, 2017(35):189-192.
[15] 向阳, 赵银娣, 董霁红. 基于改进UNet孪生网络的遥感影像矿区变化检测[J]. 煤炭学报, 2019,44(12):3773-3780.
[15] Xiang Y, Zhao Y D, Dong J H. Remote sensing image mining area change detection based on improved UNet siamese network[J]. Journal of China Coal Society, 2019,44(12):3773-3780.
[16] 马浩然. 基于多层次分割的遥感影像面向对象森林分类[D]. 北京:北京林业大学, 2014.
[16] Ma H R. Object-based remote sensing image classification of forest based on multi-level segmentation[D]. Beijing:Beijing Forestry University, 2014.
[17] 周龙君, 陈晓芬, 杨利娟. 面向对象标准最邻近分类法在地理国情监测中的应用[J]. 测绘与空间地理信息, 2016,39(5):155-157.
[17] Zhou L J, Chen X F, Yang L J. Object-based standard nearest neighbor classification used in national geomatics monitoring[J]. Geomatics & Spatial Information Technology, 2016,39(5):155-157.
[18] Long J, Shelhamer E, Darrell T. Fully convolutional networks for semantic segmentation[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2014,39(4):640-651.
pmid: 27244717 url: https://www.ncbi.nlm.nih.gov/pubmed/27244717
[19] Ronneberger O, Fischer P, Brox T. U-Net:Convolutional networks for biomedical image segmentation[C]// International Conference on Medical Image Computing and Computer-Assisted Intervention.Berlin:Springer, 2015: 234-241.
[1] NIU Xianghua, HUANG Wei, HUANG Rui, JIANG Sili. A high-fidelity method for thin cloud removal from remote sensing images based on attentional feature fusion[J]. Remote Sensing for Natural Resources, 2023, 35(3): 116-123.
[2] LIN Jiahui, LIU Guang, FAN Jinghui, ZHAO Hongli, BAI Shibiao, PAN Hongyu. Extracting information about mining subsidence by combining an improved U-Net model and D-InSAR[J]. Remote Sensing for Natural Resources, 2023, 35(3): 145-152.
[3] LIU Li, DONG Xianmin, LIU Juan. A performance evaluation method for semantic segmentation models of remote sensing images considering surface features[J]. Remote Sensing for Natural Resources, 2023, 35(3): 80-87.
[4] LIANG Xiya, WANG Juanle, LI Pengfei, DAVAADORJ Davaasuren. GF-1 images-based information extraction of natural roads in arid and semi-arid regions of the Mongolian Plateau: A case study of Gurvantes Soum, Mongolia[J]. Remote Sensing for Natural Resources, 2023, 35(2): 122-131.
[5] QIU Lei, ZHANG Xuezhi, HAO Dawei. VideoSAR moving target detection and tracking algorithm based on deep learning[J]. Remote Sensing for Natural Resources, 2023, 35(2): 157-166.
[6] ZHANG Xian, LI Wei, CHEN Li, YANG Zhaoying, DOU Baocheng, LI Yu, CHEN Haomin. Research progress and prospect of remote sensing-based feature extraction of opencast mining areas[J]. Remote Sensing for Natural Resources, 2023, 35(2): 25-33.
[7] SHI Min, LI Huiying, JIA Mingming. Spatio-temporal variations in mangrove forests in the Shankou Mangrove Nature Reserve based on the GEE cloud platform and Landsat data[J]. Remote Sensing for Natural Resources, 2023, 35(2): 61-69.
[8] LI Tianchi, WANG Daoru, ZHAO Liang, FAN Renfu. Classification and change analysis of the substrate of the Yongle Atoll in the Xisha Islands based on Landsat8 remote sensing data[J]. Remote Sensing for Natural Resources, 2023, 35(2): 70-79.
[9] DIAO Mingguang, LIU Yong, GUO Ningbo, LI Wenji, JIANG Jikang, WANG Yunxiao. Mask R-CNN-based intelligent identification of sparse woods from remote sensing images[J]. Remote Sensing for Natural Resources, 2023, 35(2): 97-104.
[10] ZHANG Ke, ZHANG Gengsheng, WANG Ning, WEN Jing, LI Yu, YANG Jun. A forecasting method for water table depths in areas with power transmission lines based on remote sensing and deep learning models[J]. Remote Sensing for Natural Resources, 2023, 35(1): 213-221.
[11] LI Chenhui, HAO Lina, XU Qiang, WANG Yi, YAN Lihua. Object-oriented hierarchical identification of earthquake-induced landslides based on high-resolution remote sensing images[J]. Remote Sensing for Natural Resources, 2023, 35(1): 74-80.
[12] HU Jianwen, WANG Zeping, HU Pei. A review of pansharpening methods based on deep learning[J]. Remote Sensing for Natural Resources, 2023, 35(1): 1-14.
[13] ZHAO Linghu, YUAN Xiping, GAN Shu, HU Lin, QIU Mingyu. An information extraction model of roads from high-resolution remote sensing images based on improved Deeplabv3+[J]. Remote Sensing for Natural Resources, 2023, 35(1): 107-114.
[14] ZHANG Yu, MING Dongping, ZHAO Wenyi, XU Lu, ZHAO Zhi, LIU Ran. The extraction and analysis of Luding earthquake-induced landslide based on high-resolution optical satellite images[J]. Remote Sensing for Natural Resources, 2023, 35(1): 161-170.
[15] MENG Congtang, ZHAO Yindi, HAN Wenquan, HE Chenyang, CHEN Xiqiu. RandLA-Net-based detection of urban building change using airborne LiDAR point clouds[J]. Remote Sensing for Natural Resources, 2022, 34(4): 113-121.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
京ICP备05055290号-2
Copyright © 2017 Remote Sensing for Natural Resources
Support by Beijing Magtech