Remote sensing-based detection of dams in the Daqing River basin through optimization using hard negative samples of bridges
GUO Yong1(), ZHANG Linxiang1, XU Zeyu2, CAI Zhongxiang1
1. Geospatial Information Institute, Information Engineering University, Zhengzhou 450052,China 2. National Engineering Research Center for Geomatics, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100101, China
The dam detection is crucial for urban planning, ecological environment assessment, and other purposes. Currently, research on remote-sensing-based dam detection mainly focuses on algorithm improvements using sample sets or small-scale localized detections, with a significant gap in practical applications over large-scale geographical regions. In large-scale regions, the sparse distribution of dams, along with the presence of more surface features such as bridges, significantly interferes with dam detection. To address this issue, this study explored the Daqing River basin as a case study to investigate remote sensing methods for dam detection in large-scale regions. This study consisted of two main phases. In the first stage, bridges, which are easily confused with dams, are considered hard negative samples (i.e., samples prone to false positives) for training. The neural network structure suitable for dam detection was improved based on the DIOR open dataset. In the second phase, the detection model was developed through fine-scale tuning using the optimized network alongside multi-source sample data from the large Daqing River basin. Concurrently, dams within the Daqing River region were detected. The optimized model yielded dam detection F1 of 0.783 in the first phase of tests and identified 330 dams in the Daqing River basin during the second phase. These results align with the existing publicly available dam spatial distribution dataset GRandD, even providing more details. The results of this study indicate that the model, optimized using bridge samples, can effectively mitigate the incorrect extraction of bridges, thereby improving detection accuracy.
郭勇, 张琳翔, 许泽宇, 蔡中祥. 结合桥梁难分样本优化的大清河流域水坝遥感检测[J]. 自然资源遥感, 2024, 36(4): 201-209.
GUO Yong, ZHANG Linxiang, XU Zeyu, CAI Zhongxiang. Remote sensing-based detection of dams in the Daqing River basin through optimization using hard negative samples of bridges. Remote Sensing for Natural Resources, 2024, 36(4): 201-209.
Xu Y, Zhang Y J, Zhang Q. Rule sets building of water conservancy facilities spatial element extraction based on high resolution remote sensing image[J]. Geospatial Information, 2016, 14(5):71-74,7.
[2]
朱然. 大数据量复杂背景下桥梁水坝目标快速识别[D]. 成都: 电子科技大学, 2015.
Zhu R. Fast recognition of bridge and dam in complex background through masses of data[D]. Chengdu: University of Electronic Science and Technology of China, 2015.
Sun Y, Huang L, Zhao J S, et al. High spatial resolution automatic detection of bridges with high spatial resolu tion remote sensing images based on random erasure and YOLOv4[J]. Remote Sensing for Natural Resources, 2022, 34(2):97-104.doi:10.6046/zrzyyg.2021130.
Qiu D D, Ma H C, Yang Y, et al. A study of dam detection based on multi-source satellite images fusion[J]. National Remote Sensing Bulletin, 2006, 10(4):449-455.
[5]
Redmon J, Divvala S, Girshick R, et al. You only look once:Unified,real-time object detection[C]// 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Las Vegas,NV,USA.IEEE, 2016:779-788.
[6]
Redmon J, Farhadi A. YOLOv3:An incremental improvement[J/OL]. arXiv, 2018. http://arxiv.org/abs/1804.02767.pdf.
[7]
Liu W, Anguelov D, Erhan D, et al. SSD:Single shot MultiBox detector[C]// European Conference on Computer Vision.Cham:Springer, 2016:21-37.
[8]
Ren S, He K, Girshick R, et al. Faster R-CNN:Towards real-time object detection with region proposal networks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(6):1137-1149.
Dai W C, Jin L X, Li G N, et al. Real-time airplane detection algorithm in remote-sensing images based on improved YOLOv3[J]. Opto-Electronic Engineering, 2018, 45(12):180350.
Wang W S. Research on technology of ship and aircraft targets recognition from large-field optical remote sensing image[D]. Changchun: Changchun Institute of Optics,Fine Mechanics and Physics,Chinese Academy of Sciences, 2018.
Wang Y Q, Ma L, Tian Y. State-of-the-art of ship detection and recognition in optical remotely sensed imagery[J]. Acta Automatica Sinica, 2011, 37(9):1029-1039.
Zhong J S. A study on the algorithm of ship target detection in SAR imagery and its applications[D]. Beijing: Graduate School of Chinese Academy of Sciences(Institute of Electrics), 2002.
Sun B Y, Wen S S, Wu H, et al. Vehicle detection in high-resolution remote sensing images based on deep learning[J]. Journal of Donghua University (Natural Science), 2018, 44(4):520-525.
Feng S T, Sheng Z Y, Hou X H, et al. Vehicle target detection in YOLOV5 remote sensing image based on rotating box regression[C]// Anthology of the 15th National Academic Conference on Signal and Intelligent Information Processing and Application, Beijing: Computer Engineering and Applications, 2022:4.
Liu K. Research on building detection technology of the highresolution remote sensing images[D]. Xi’an: Xi’an Institute of Optics and Precision Mechanics,Chinese Academy of Sciences, 2021.
Wang Y L, Pu J, Zhao J H, et al. Detection of new ground buildings based on generative adversarial network[J]. Journal of Computer Applications, 2019, 39(5):1518-1522.
doi: 10.11772/j.issn.1001-9081.2018102083
[18]
Jing M, Cheng L, Ji C, et al. Detecting unknown dams from high-resolution remote sensing images:A deep learning and spatial analysis approach[J]. International Journal of Applied Earth Observation and Geoinformation, 2021, 104:102576.
Xu Z Y, Shen Z F, Li Y, et al. Detection of water conservancy facilities in large-format image combining E-YOLO algorithm and NDWI constraint[J]. National Remote Sensing Bulletin, 2022, 26(10):2083-2093.
[20]
Girshick R, Donahue J, Darrell T, et al. Rich feature hierarchies for accurate object detection and semantic segmentation[C]// Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition.ACM, 2014:580-587.
Zhang Y, Xu T, Feng D Z, et al. Research on faster RCNN object detection based on hard example mining[J]. Journal of Electronics & Information Technology, 2019, 41(6):1496-1502.
Xu Y L, Zhu M M, Ma S P, et al. Airport object detection combining transfer learning and hard example mining[J]. Journal of Xidian University, 2018, 45(5):190-196.
[23]
马广阔. 遥感图像桥梁目标检测方法研究[D]. 呼和浩特: 内蒙古工业大学, 2021.
Ma G K. Research on bridge target detection method in remote sensing image[D]. Hohhot: Inner Mongolia University of Tehchnology, 2021.
[24]
Zhou X, Wang D, Krähenbühl P. Objects as points[J/OL]. arXiv, 2019. http://arxiv.org/abs/1904.07850.pdf.
Li S, Shen Z F, Liu K J, et al. Analysis of terrain gradient effects of land use change in Daqing River basin[J]. Transactions of the Chinese Society of Agricultural Engineering, 2021, 37(5):275-284.
[26]
Li K, Wan G, Cheng G, et al. Object detection in optical remote sensing images:A survey and a new benchmark[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2020, 159:296-307.
[27]
Lehner B, Liermann C R, Revenga C, et al. High-resolution mapping of the world’s reservoirs and dams for sustainable river-flow management[J]. Frontiers in Ecology and the Environment, 2011, 9(9):494-502.
[28]
Song C, Fan C, Zhu J, et al. A comprehensive geospatial database of nearly 100 000 reservoirs in China[J]. Earth System Science Data, 2022, 14(9):4017-4034.
[29]
LeCun Y, Boser B, Denker J S, et al. Backpropagation applied to handwritten zip code recognition[J]. Neural Computation, 1989, 1(4):541-551.
[30]
Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition[J/OL]. arXiv, 2014(2014-09-04)[2023-05-23]. https://arxiv.org/abs/1409.1556.
[31]
Ronneberger O, Fischer P, Brox T. U-net:Convolutional networks for biomedical image segmentation[C]// International Conference on Medical Image Computing and Computer-Assisted Intervention.Cham:Springer, 2015:234-241.
[32]
He K, Zhang X, Ren S, et al. Deep residual learning for image recognition[C]// 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Las Vegas,NV,USA.IEEE, 2016:770-778.
[33]
Badrinarayanan V, Kendall A, Cipolla R. SegNet:A deep convolutional encoder-decoder architecture for image segmentation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(12):2481-2495.
doi: 10.1109/TPAMI.2016.2644615
pmid: 28060704
[34]
Wang C Y, Bochkovskiy A, Liao H Y M. YOLOv7:Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors[C]// 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).Vancouver,BC,Canada.IEEE, 2023:7464-7475.
[35]
Girshick R. Fast R-CNN[C]// 2015 IEEE International Conference on Computer Vision (ICCV).Santiago,Chile.IEEE, 2015:1440-1448.
Li D W. Automatic vehicle detection and tracking in aerial images by fixed-wing UAV[D]. Beijing: National Space Science Center,Chinese Academy of Sciences, 2017.
Wang J C, Tan X C, Wang Z H, et al. Faster R-CNN deep learning network based object recognition of remote sensing image[J]. Journal of Geo-Information Science, 2018, 20(10):1500-1508.
2024, Vol. 36 
), 张琳翔1, 许泽宇2, 蔡中祥1
