A review of target motion information extraction from high-resolution optical satellite images
Xiang LI1,2,3, Cankun YANG1,2,3(), Chunping ZHOU1, Xiaojuan LI1,2,3, Ke ZHANG1,2,3
1. Beijing Advanced Innovation Center for Imaging Technology, Capital Normal University, Beijing 100048, China 2. College of Resources Environment and Tourism, Capital Normal University, Beijing 100048, China 3. Key Lab of 3D Information Acquisition and Application, Ministry of Education,Capital Normal University, Beijing 100048, China
The target motion information extraction technology described in this paper uses satellite remote sensing to detect ground moving targets and estimate its motion parameters. It is one of the important application directions of remote sensing images and has been widely used in traffic monitoring and military remote sensing. As an excellent tool for the study of large-scale target motion characteristics, the high-resolution optical satellite image has more obvious texture features and richer information. After summarizing the research progress of moving targets in optical satellite imagery, this paper describes the methods of moving target detection and motion parameter estimation according to the process of target motion information extraction from high-resolution optical satellite image. Meanwhile, the principle and ideas of a novel method which is based on sequence panchromatic satellite images to detect moving target are introduced. In the end, based on analyzing the weaknesses of existing target motion information extraction research in data source and algorithm, it is pointed out that the target motion information extraction is developing towards automation, intellectualization and real-time.
Gong P, Li X, Xu B . Interpretation theory and application method development for information extraction from high resolution remotely sensed data[J]. Journal of Remote Sensing, 2006,10(1):1-5.
Ming D P, Luo J C, Shen Z F , et al. Research on information extraction and target recognition from high resolution remote sensing image[J]. Science of Surveying and Mapping, 2005,30(3):18-20.
[4]
Sharma G, Merry C J, Goel P , et al. Vehicle detection in 1-m resolution satellite and airborne imagery[J]. International Journal of Remote Sensing, 2006,27(4):779-797.
Yu Y, Zheng H . Vehicle detection from high resolution satellite imagery based on the morphological neural network[J]. Journal of Harbin Engineering University, 2006,27(z1):189-193.
[6]
Etaya M, Sakata T, Shimoda H , et al. An experiment on detecting moving objects using a single scene of QuickBird data[J]. Journal of the Remote Sensing Society of Japan, 2004,24(4):357-366.
[7]
陶建伟 . 最新光学高分辨率卫星遥感技术及其应用研究[D]. 上海:上海交通大学, 2011.
Tao J W . A Study on State-of-Art Optical High Resolution Remote Sensing Satellite Technology and Its Application[D]. Shanghai:Shanghai Jiao Tong University, 2011.
Liu Z M, Liu Y L, Tan Q L , et al. Progress in vehicle detection from high resolution satellite imagery[J]. Remote Sensing Technology and Application, 2012,27(1):8-14.
[9]
Takasaki K, Sugimura T, Tanaka S . Speed vector measurement of moving objects using JERS-1/OPS data [C]//Proceedings of IGARSS '93-IEEE International Geoscience and Remote Sensing Symposium.Tokyo:IEEE, 1993: 476-478.
[10]
Yamazaki F, Liu W, Vu T T . Speed detection for moving objects from digital aerial camera and QuickBird sensors [C]//Proceedings of 5th International Workshop on Remote Sensing Applications to Natural Hazards. 2007: 1-6.
[11]
Liu W, Yamazaki F, Vu T T , et al. Speed detection of vehicles from aerial photographs [C]//Proceedings of Asian Conference on Remote Sensing.ACRS, 2007: 1-6.
[12]
Liu W, Yamazaki F, Vu T T . Automated vehicle extraction and speed determination from QuickBird satellite images[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2011,4(1):75-82.
[13]
Leitloff J, Hinz S, Stilla U .Vehicle queue detection in satellite images of urban areas[J].International Archives of Photogrammetry and Remote Sensing, 2005, 36(8/w27)(on CD).
[14]
Hinz S, Bamler R, Stilla U . Theme issue:“Airborne and spaceborne traffic monitoring”[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2006,61(3-4):135-136.
Liang Y P, Suo M L . Recent advances and perspective on studies of moving vehicles detection[J]. Journal of Wuhan University of Technology (Transportation Science and Engineering), 2011,35(4):675-678.
[16]
Chen Z, Wang C, Luo H , et al. Vehicle detection in high-resolution aerial images based on fast sparse representation classification and multiorder feature[J]. IEEE Transactions on Intelligent Transportation Systems, 2016,17(8):2296-2309.
[17]
Chen Z, Wang C, Wen C , et al. Vehicle detection in high-resolution aerial images via sparse representation and superpixels[J]. IEEE Transactions on Geoscience and Remote Sensing, 2016,54(1):103-116.
[18]
Cao L, Wang C, Li J . Vehicle detection from highway satellite images via transfer learning[J]. Information Sciences, 2016,366:177-187.
Zhang B Y, Li G Z, Wu X X . Speed estimation and automatic detection of moving vehicle from QuickBird satellite images[J]. Chinese Journal of Liquid Crystals and Displays, 2015,30(4):687-694.
Li J X , L Z Q,Li S,et al.The method for semi-automatic extraction of residential area from high resolution remote sensing images[J]. Remote Sensing for Land and Resources, 2017,29(3):17-24.doi: 10.6046/gtzyyg.2017.03.03.
Zhou C P, Gong H L, Li X J, et al. Multi-mode CMOS image sensor and control method thereof:China,CN201610822278.6[P] 2017 -01-11.
[24]
Leitloff J, Hinz S, Stilla U . Automatic vehicle detection in satellite images[J]. International Archives of the Photogrammetry,Remote Sensing and Spatial Information Sciences, 2006,36(3):221-227.
[25]
Leitloff J, Hinz S, Stilla U . Automatic vehicle detection in space images supported by digital map data[J]. International Archives of Photogrammetry,Remote Sensing and Spatial Information Sciences, 2005,36(3w/24):75-80.
[26]
Leitloff J, Hinz S, Stilla U . Vehicle detection in very high resolution satellite images of city areas[J]. IEEE Transactions on Geoscience and Remote Sensing, 2010,48(7):2795-2806.
Hu X M, Zheng H, Si X S . A novel high resolution satellite imagery object detection based on derivative of double exponential[J]. Geomatics and Information Science of Wuhan University, 2010,35(11):1265-1270.
[28]
Shi C Y, Ma L, Zhou C P , et al. Remote sensing image target detection method based on corner probability model [C]//Selected Papers of the Chinese Society for Optical Engineering Conferences.SPIE, 2017: 1025553.
[29]
刘建鑫 . 基于高分辨率卫星影像的车辆检测算法研究[D]. 大连:大连海事大学, 2008.
Liu J X . The Study of Algorithm About Vehicle Detection Based on High Resolution Satellite Image[D]. Dalian:Dalian Maritime University, 2008.
Zheng H, Hu X M . An antibody networks approach for vehicle detection from high resolution satellite imagery[J]. Journal of Remote Sensing, 2009,13(5):913-927.
[31]
Gerhardinger A, Ehrlich D, Pesaresi M . Vehicles detection from very high resolution satellite imagery[J]. International Archives of Photogrammetry and Remote Sensing, 2005,36(3/w24):83-88.
[32]
Eikvil L, Aurdal L, Koren H . Classification-based vehicle detection in high-resolution satellite images[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2009,64(1):65-72.
[33]
Xiong Z, Zhang Y . An initial study of moving target detection based on a single set of high spatial resolution satellite imagery [C]//Proceedings of ASPRS 2006 Annual Conference.Bethesda:ASPRS, 2006: 1640-1648.
[34]
Zhang Y, Xiong Z . Moving vehicle detection using a single set of QuickBird imagery:An initial study[J]. Journal of Magnetic Resonance Imaging Jmri, 2012,33(6):1312-20.
[35]
Xiong Z, Zhang Y . An initial study on vehicle information extraction from single pass QuickBird satellite imagery[J]. Photogrammetric Engineering and Remote Sensing, 2008,74(11):1401-1411.
[36]
Pesaresi M, Gutjahr K H, Pagot E . Estimating the velocity and direction of moving targets using a single optical VHR satellite sensor image[J]. International Journal of Remote Sensing, 2008,29(4):1221-1228.
Zhao S H, Yin D, Dou X H , et al. Moving target information extraction based on single satellite image[J]. Acta Geodaetica et Cartographica Sinica, 2015,44(3):316-322.
[38]
索明亮 . 卫星图像中运动车辆探测和速度提取研究[D]. 北京:北京交通大学, 2011.
Suo M L . Research on Moving Vehicle Detection and Velocity Extraction from Satellite Image[D]. Beijing:Beijing Jiaotong University, 2011.
[39]
Salehi B, Zhang Y, Zhong M . Automatic moving vehicles information extraction from single-pass Worldview-2 imagery[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2012,5(1):135-145.
[40]
刘超超 . 基于光学卫星影像的车辆识别和速度估算研究[D]. 北京:北京交通大学, 2015.
Liu C C . Research on Vehicle Identification and Velocity Estimation Based on Optical Satellite Imagery[D]. Beijing:Beijing Jiaotong University, 2015.
[41]
张博研 . 遥感图像的车辆目标检测与运动参数估计[D]. 西安:西安电子科技大学, 2013.
Zhang B Y . Detection and Speed Estimation of Moving Vehicle From Remote Sensing Images[D]. Xi’an:Xidian University, 2013.
[42]
Leitloff J, Hinz S, Stilla U , et al. Inferring traffic activity from optical satellite images[J]. International Archives of the Photogrammetry,Remote Sensing and Spatial Information Sciences, 2007,36(3/w49b):89-93.
[43]
Kopsiaftis G, Karantzalos K . Vehicle detection and traffic density monitoring from very high resolution satellite video data [C]//Proceedings of 2015 IEEE International Geoscience and Remote Sensing Symposium.IEEE, 2015: 1881-1884.
Yu Y B . Multiple Objects Real-Time Tracking and Detection Technology in Satellite Video Based on Multi-Core DSP[D].Changchun:Changchun Institute of Optics,Fine Mechanics and Physics, Chinese Academy of Sciences, 2016.
Luo Y L, Liang Y P, Wang Y . Traffic flow parameter estimation from satellite video data based on optical flow[J]. Computer Engineering and Applications, 2018,54(10):204-207,255.
[47]
Zhao Z X, Wen G J, Hui B W , et al. Velocity estimation of an airplane through a single satellite image[J]. Chinese Optics Letters, 2012,10(3):31-34.
[48]
Kulchandani J S, Dangarwala K J . Moving object detection:Review of recent research trends [C]//Proceedings of 2015 International Conference on Pervasive Computing.IEEE, 2015: 1-5.
Dai K X, Li G H, Tu D , et al. Prospects and current studies on background subtraction techniques for moving objects detection from surveillance video[J]. Journal of Image and Graphics, 2006,11(7):919-927.
[50]
阳树洪 . 灰度图像阈值分割的自适应和快速算法研究[D]. 重庆:重庆大学, 2014.
Yang S H . Study on the Adaptive and Fast Algorithm of Gray Scale Image Thresholding[D]. Chongqing:Chongqing University, 2014.
[51]
Wu Y, Lim J, Yang M H . Online object tracking:A benchmark [C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.IEEE, 2013: 2411-2418.
2019, Vol. 31 
), 周春平1, 李小娟1,2,3, 张可1,2,3
