Please wait a minute...
 
Remote Sensing for Land & Resources    2019, Vol. 31 Issue (3) : 1-9     DOI: 10.6046/gtzyyg.2019.03.01
|
A review of target motion information extraction from high-resolution optical satellite images
Xiang LI1,2,3, Cankun YANG1,2,3(), Chunping ZHOU1, Xiaojuan LI1,2,3, Ke ZHANG1,2,3
1. Beijing Advanced Innovation Center for Imaging Technology, Capital Normal University, Beijing 100048, China
2. College of Resources Environment and Tourism, Capital Normal University, Beijing 100048, China
3. Key Lab of 3D Information Acquisition and Application, Ministry of Education,Capital Normal University, Beijing 100048, China
Download: PDF(1000 KB)   HTML
Export: BibTeX | EndNote | Reference Manager | ProCite | RefWorks    
Abstract  

The target motion information extraction technology described in this paper uses satellite remote sensing to detect ground moving targets and estimate its motion parameters. It is one of the important application directions of remote sensing images and has been widely used in traffic monitoring and military remote sensing. As an excellent tool for the study of large-scale target motion characteristics, the high-resolution optical satellite image has more obvious texture features and richer information. After summarizing the research progress of moving targets in optical satellite imagery, this paper describes the methods of moving target detection and motion parameter estimation according to the process of target motion information extraction from high-resolution optical satellite image. Meanwhile, the principle and ideas of a novel method which is based on sequence panchromatic satellite images to detect moving target are introduced. In the end, based on analyzing the weaknesses of existing target motion information extraction research in data source and algorithm, it is pointed out that the target motion information extraction is developing towards automation, intellectualization and real-time.
Keywords high-resolution remote sensing      optical satellite images      multi-modality sensor      panchromatic band      moving target detection      motion parameter estimation     
:  TP79  
Corresponding Authors: Cankun YANG     E-mail: yangck@cnu.edu.cn
Issue Date: 30 August 2019
Service
E-mail this article
E-mail Alert
RSS
Articles by authors
Xiang LI
Cankun YANG
Chunping ZHOU
Xiaojuan LI
Ke ZHANG
Cite this article:   
Xiang LI,Cankun YANG,Chunping ZHOU, et al. A review of target motion information extraction from high-resolution optical satellite images[J]. Remote Sensing for Land & Resources, 2019, 31(3): 1-9.
URL:  
https://www.gtzyyg.com/EN/10.6046/gtzyyg.2019.03.01     OR     https://www.gtzyyg.com/EN/Y2019/V31/I3/1
Fig.1  Main methods of moving target detection from high-resolution optical satellite images
算法名称 算法描述 参考文献
队列分离法 针对可成队列的动目标,先提取线特征队列,再根据目标特点分割队列 [24-26]
梯度阈值法 使用一阶梯度表示局部变化,为梯度图像自动选择阈值进行图像分割 [4]
贝叶斯背景变换法 背景变换使其亮度特性与当前图像匹配,基于当前图像与变换后背景图像差异,采用贝叶斯法则计算每一像素运动的概率,选择合适的概率阈值将车辆目标分割 [4]
模板匹配法 提前根据动目标实际形状特征建立模型,自动匹配寻找动目标 [27-28]
机器学习法 从同类图像中目视提取动目标训练样本,根据样本特征寻找动目标 [5,29-31]
Tab.1  Methods of moving target detection from panchromatic images
算法名称 算法描述 优点 缺点 参考文献
目视解译法 使用传统的目视解译方法,根据地物形状、纹理等特征检测动目标 准确 非自动检测,工作量大 [6,33-37]
面向对象法 对象分割软件凭经验选择合适的分割尺度,分割出图像中的动目标,并进一步区分 快速 分割会出现不准确状况,需要人工参与 [10-11,38-40]
减背景法 背景重建采用原始图像开运算腐蚀动目标的方法,背景与图像做差求取动目标 快速,全自动检测 背景重建不准确,易漏检 [20,41]
梯度图像匹配法 在全色图像中手动标定动目标的中心,采用依赖梯度匹配方法在多光谱图像中寻找对应的动目标 准确,不会漏检 半自动检测,需要人工参与 [42]
Tab.2  Methods of moving target detection from multi-spectral images
算法名称 算法描述 优点 缺点 参考文献
减背景法 多帧图像背景建模,当前帧与背景图做差提取动目标 准确,高效,自动化程度高 背景建模复杂,不易计算 [19,43-45]
帧差法 相邻两帧或三帧差分求取动目标 快速,自动化程度高 当目标运动速度过慢时,会出现目标空洞 [19,44]
光流法 采用光流法计算角点的光流矢量确定动目标的运动状况 准确,全自动检测 运算复杂 [46]
Tab.3  Methods of moving target detection from satellite video
[1] 郑丹, 徐佩霞, 何佳 . 视频监控中运动物体的检测与跟踪[J]. 计算机工程与应用, 2010,46(31):192-195.
doi: 10.3778/j.issn.1002-8331.2010.31.053
[1] Zheng D, Xu P X, He J . Moving object detection and tracking in video surveillance[J]. Computer Engineering and Applications, 2010,46(31):192-195.
[2] 宫鹏, 黎夏, 徐冰 . 高分辨率影像解译理论与应用方法中的一些研究问题[J]. 遥感学报, 2006,10(1):1-5.
doi: 10.11834/jrs.20060101
[2] Gong P, Li X, Xu B . Interpretation theory and application method development for information extraction from high resolution remotely sensed data[J]. Journal of Remote Sensing, 2006,10(1):1-5.
[3] 明冬萍, 骆剑承, 沈占锋 , 等. 高分辨率遥感影像信息提取与目标识别技术研究[J]. 测绘科学, 2005,30(3):18-20.
[3] Ming D P, Luo J C, Shen Z F , et al. Research on information extraction and target recognition from high resolution remote sensing image[J]. Science of Surveying and Mapping, 2005,30(3):18-20.
[4] Sharma G, Merry C J, Goel P , et al. Vehicle detection in 1-m resolution satellite and airborne imagery[J]. International Journal of Remote Sensing, 2006,27(4):779-797.
[5] 余勇, 郑宏 . 基于形态神经网络的高分辨率卫星影像车辆检测[J]. 哈尔滨工程大学学报, 2006,27(z1):189-193.
[5] Yu Y, Zheng H . Vehicle detection from high resolution satellite imagery based on the morphological neural network[J]. Journal of Harbin Engineering University, 2006,27(z1):189-193.
[6] Etaya M, Sakata T, Shimoda H , et al. An experiment on detecting moving objects using a single scene of QuickBird data[J]. Journal of the Remote Sensing Society of Japan, 2004,24(4):357-366.
[7] 陶建伟 . 最新光学高分辨率卫星遥感技术及其应用研究[D]. 上海:上海交通大学, 2011.
[7] Tao J W . A Study on State-of-Art Optical High Resolution Remote Sensing Satellite Technology and Its Application[D]. Shanghai:Shanghai Jiao Tong University, 2011.
[8] 刘珠妹, 刘亚岚, 谭衢霖 , 等. 高分辨率卫星影像车辆检测研究进展[J]. 遥感技术与应用, 2012,27(1):8-14.
[8] Liu Z M, Liu Y L, Tan Q L , et al. Progress in vehicle detection from high resolution satellite imagery[J]. Remote Sensing Technology and Application, 2012,27(1):8-14.
[9] Takasaki K, Sugimura T, Tanaka S . Speed vector measurement of moving objects using JERS-1/OPS data [C]//Proceedings of IGARSS '93-IEEE International Geoscience and Remote Sensing Symposium.Tokyo:IEEE, 1993: 476-478.
[10] Yamazaki F, Liu W, Vu T T . Speed detection for moving objects from digital aerial camera and QuickBird sensors [C]//Proceedings of 5th International Workshop on Remote Sensing Applications to Natural Hazards. 2007: 1-6.
[11] Liu W, Yamazaki F, Vu T T , et al. Speed detection of vehicles from aerial photographs [C]//Proceedings of Asian Conference on Remote Sensing.ACRS, 2007: 1-6.
[12] Liu W, Yamazaki F, Vu T T . Automated vehicle extraction and speed determination from QuickBird satellite images[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2011,4(1):75-82.
[13] Leitloff J, Hinz S, Stilla U .Vehicle queue detection in satellite images of urban areas[J].International Archives of Photogrammetry and Remote Sensing, 2005, 36(8/w27)(on CD).
[14] Hinz S, Bamler R, Stilla U . Theme issue:“Airborne and spaceborne traffic monitoring”[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2006,61(3-4):135-136.
[15] 梁艳平, 索明亮 . 运动车辆探测研究的新方向与进展[J]. 武汉理工大学学报(交通科学与工程版), 2011,35(4):675-678.
[15] Liang Y P, Suo M L . Recent advances and perspective on studies of moving vehicles detection[J]. Journal of Wuhan University of Technology (Transportation Science and Engineering), 2011,35(4):675-678.
[16] Chen Z, Wang C, Luo H , et al. Vehicle detection in high-resolution aerial images based on fast sparse representation classification and multiorder feature[J]. IEEE Transactions on Intelligent Transportation Systems, 2016,17(8):2296-2309.
[17] Chen Z, Wang C, Wen C , et al. Vehicle detection in high-resolution aerial images via sparse representation and superpixels[J]. IEEE Transactions on Geoscience and Remote Sensing, 2016,54(1):103-116.
[18] Cao L, Wang C, Li J . Vehicle detection from highway satellite images via transfer learning[J]. Information Sciences, 2016,366:177-187.
[19] 于渊博, 张涛, 郭立红 , 等. 卫星视频运动目标检测算法[J]. 液晶与显示, 2017,32(2):138-143.
url: http://www.opticsjournal.net/Articles/Abstract?aid=OJ170209000267jPlSoV
[19] Yu Y B, Zhang T, Guo L H , et al. Moving objects detection on satellite video[J]. Chinese Journal of Liquid Crystals and Displays, 2017,32(2):138-143.
[20] 张博研, 李广泽, 武星星 . QuickBird遥感影像的车辆自动检测与运动参数估计[J]. 液晶与显示, 2015,30(4):687-694.
url: http://www.opticsjournal.net/Articles/Abstract?aid=OJ1602020001142x5A8D
[20] Zhang B Y, Li G Z, Wu X X . Speed estimation and automatic detection of moving vehicle from QuickBird satellite images[J]. Chinese Journal of Liquid Crystals and Displays, 2015,30(4):687-694.
[21] 张过 . 卫星视频处理与应用进展[J]. 应用科学学报, 2016,34(4):361-370.
doi: 10.3969/j.issn.0255-8297.2016.04.001
[21] Zhang G . Satellite video processing and applications[J]. Journal of Applied Sciences, 2016,34(4):361-370.
[22] 李金香, 李志强, 李帅 , 等. 高分辨率遥感影像居民地半自动提取方法研究[J]. 国土资源遥感, 2017,29(3):17-24.doi: 10.6046/gtzyyg.2017.03.03.
[22] Li J X , L Z Q,Li S,et al.The method for semi-automatic extraction of residential area from high resolution remote sensing images[J]. Remote Sensing for Land and Resources, 2017,29(3):17-24.doi: 10.6046/gtzyyg.2017.03.03.
[23] 周春平, 宫辉力, 李小娟 , 等. 一种多模式COMS图像传感器及其控制方法:中国, CN201610822278.6[P]. 2017 -01-11.
[23] Zhou C P, Gong H L, Li X J, et al. Multi-mode CMOS image sensor and control method thereof:China,CN201610822278.6[P] 2017 -01-11.
[24] Leitloff J, Hinz S, Stilla U . Automatic vehicle detection in satellite images[J]. International Archives of the Photogrammetry,Remote Sensing and Spatial Information Sciences, 2006,36(3):221-227.
[25] Leitloff J, Hinz S, Stilla U . Automatic vehicle detection in space images supported by digital map data[J]. International Archives of Photogrammetry,Remote Sensing and Spatial Information Sciences, 2005,36(3w/24):75-80.
[26] Leitloff J, Hinz S, Stilla U . Vehicle detection in very high resolution satellite images of city areas[J]. IEEE Transactions on Geoscience and Remote Sensing, 2010,48(7):2795-2806.
[27] 胡学敏, 郑宏, 司小书 . 利用双指数函数导数模型进行高分辨率卫星影像目标检测[J]. 武汉大学学报(信息科学版), 2010,35(11):1265-1270.
[27] Hu X M, Zheng H, Si X S . A novel high resolution satellite imagery object detection based on derivative of double exponential[J]. Geomatics and Information Science of Wuhan University, 2010,35(11):1265-1270.
[28] Shi C Y, Ma L, Zhou C P , et al. Remote sensing image target detection method based on corner probability model [C]//Selected Papers of the Chinese Society for Optical Engineering Conferences.SPIE, 2017: 1025553.
[29] 刘建鑫 . 基于高分辨率卫星影像的车辆检测算法研究[D]. 大连:大连海事大学, 2008.
[29] Liu J X . The Study of Algorithm About Vehicle Detection Based on High Resolution Satellite Image[D]. Dalian:Dalian Maritime University, 2008.
[30] 郑宏, 胡学敏 . 高分辨率卫星影像车辆检测的抗体网络[J]. 遥感学报, 2009,13(5):913-927.
[30] Zheng H, Hu X M . An antibody networks approach for vehicle detection from high resolution satellite imagery[J]. Journal of Remote Sensing, 2009,13(5):913-927.
[31] Gerhardinger A, Ehrlich D, Pesaresi M . Vehicles detection from very high resolution satellite imagery[J]. International Archives of Photogrammetry and Remote Sensing, 2005,36(3/w24):83-88.
[32] Eikvil L, Aurdal L, Koren H . Classification-based vehicle detection in high-resolution satellite images[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2009,64(1):65-72.
[33] Xiong Z, Zhang Y . An initial study of moving target detection based on a single set of high spatial resolution satellite imagery [C]//Proceedings of ASPRS 2006 Annual Conference.Bethesda:ASPRS, 2006: 1640-1648.
[34] Zhang Y, Xiong Z . Moving vehicle detection using a single set of QuickBird imagery:An initial study[J]. Journal of Magnetic Resonance Imaging Jmri, 2012,33(6):1312-20.
[35] Xiong Z, Zhang Y . An initial study on vehicle information extraction from single pass QuickBird satellite imagery[J]. Photogrammetric Engineering and Remote Sensing, 2008,74(11):1401-1411.
[36] Pesaresi M, Gutjahr K H, Pagot E . Estimating the velocity and direction of moving targets using a single optical VHR satellite sensor image[J]. International Journal of Remote Sensing, 2008,29(4):1221-1228.
[37] 赵世湖, 尹丹, 窦显辉 , 等. 单景卫星遥感影像目标运动信息提取技术[J]. 测绘学报, 2015,44(3):316-322.
doi: 10.11947/j.AGCS.2015.20120720
[37] Zhao S H, Yin D, Dou X H , et al. Moving target information extraction based on single satellite image[J]. Acta Geodaetica et Cartographica Sinica, 2015,44(3):316-322.
[38] 索明亮 . 卫星图像中运动车辆探测和速度提取研究[D]. 北京:北京交通大学, 2011.
[38] Suo M L . Research on Moving Vehicle Detection and Velocity Extraction from Satellite Image[D]. Beijing:Beijing Jiaotong University, 2011.
[39] Salehi B, Zhang Y, Zhong M . Automatic moving vehicles information extraction from single-pass Worldview-2 imagery[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2012,5(1):135-145.
[40] 刘超超 . 基于光学卫星影像的车辆识别和速度估算研究[D]. 北京:北京交通大学, 2015.
[40] Liu C C . Research on Vehicle Identification and Velocity Estimation Based on Optical Satellite Imagery[D]. Beijing:Beijing Jiaotong University, 2015.
[41] 张博研 . 遥感图像的车辆目标检测与运动参数估计[D]. 西安:西安电子科技大学, 2013.
[41] Zhang B Y . Detection and Speed Estimation of Moving Vehicle From Remote Sensing Images[D]. Xi’an:Xidian University, 2013.
[42] Leitloff J, Hinz S, Stilla U , et al. Inferring traffic activity from optical satellite images[J]. International Archives of the Photogrammetry,Remote Sensing and Spatial Information Sciences, 2007,36(3/w49b):89-93.
[43] Kopsiaftis G, Karantzalos K . Vehicle detection and traffic density monitoring from very high resolution satellite video data [C]//Proceedings of 2015 IEEE International Geoscience and Remote Sensing Symposium.IEEE, 2015: 1881-1884.
[44] 于渊博 . 基于多核DSP卫星视频多目标实时动态检测跟踪技术[D]. 长春:中国科学院长春光学精密机械与物理研究所, 2016.
[44] Yu Y B . Multiple Objects Real-Time Tracking and Detection Technology in Satellite Video Based on Multi-Core DSP[D].Changchun:Changchun Institute of Optics,Fine Mechanics and Physics, Chinese Academy of Sciences, 2016.
[45] 卜丽静, 孟进军, 张正鹏 . 吉林一号视频星数据在车辆检测中的可行性[J]. 遥感信息, 2017,32(3):98-103.
[45] Bu L J, Meng J J, Zhang Z P . Feasibility of Jilin-1 video star data in vehicle detection[J]. Remote Sensing Information, 2017,32(3):98-103.
[46] 罗亦乐, 梁艳平, 王妍 . 基于光流法的卫星视频交通流参数提取研究[J]. 计算机工程与应用, 2018,54(10):204-207,255.
[46] Luo Y L, Liang Y P, Wang Y . Traffic flow parameter estimation from satellite video data based on optical flow[J]. Computer Engineering and Applications, 2018,54(10):204-207,255.
[47] Zhao Z X, Wen G J, Hui B W , et al. Velocity estimation of an airplane through a single satellite image[J]. Chinese Optics Letters, 2012,10(3):31-34.
[48] Kulchandani J S, Dangarwala K J . Moving object detection:Review of recent research trends [C]//Proceedings of 2015 International Conference on Pervasive Computing.IEEE, 2015: 1-5.
[49] 代科学, 李国辉, 涂丹 , 等. 监控视频运动目标检测减背景技术的研究现状和展望[J]. 中国图象图形学报, 2006,11(7):919-927.
doi: 10.11834/jig.200607158
[49] Dai K X, Li G H, Tu D , et al. Prospects and current studies on background subtraction techniques for moving objects detection from surveillance video[J]. Journal of Image and Graphics, 2006,11(7):919-927.
[50] 阳树洪 . 灰度图像阈值分割的自适应和快速算法研究[D]. 重庆:重庆大学, 2014.
[50] Yang S H . Study on the Adaptive and Fast Algorithm of Gray Scale Image Thresholding[D]. Chongqing:Chongqing University, 2014.
[51] Wu Y, Lim J, Yang M H . Online object tracking:A benchmark [C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.IEEE, 2013: 2411-2418.
[52] 邵承 . 基于视频的车辆检测与跟踪算法综述[J]. 现代计算机(专业版), 2014,( 35):56-60.
[52] Shao C Y . Survey of video-based vehicle detection and tracking algorithm[J]. Modern Computer, 2014,( 35):56-60.
[53] 周春平, 宫辉力, 李小娟 , 等 .一种基于相机传感器的动目标检测的系统及方法:中国, CN201710780857.3[P]. 2018 -01-09.
[53] Zhou C P, Gong H L, Li X J , et al. A system and method for moving target detection based on camera sensor:China, CN201710780857.3[P]. 2018 -01-09.
[1] XUE Bai, WANG Yizhe, LIU Shuhan, YUE Mingyu, WANG Yiying, ZHAO Shihu. Change detection of high-resolution remote sensing images based on Siamese network[J]. Remote Sensing for Natural Resources, 2022, 34(1): 61-66.
[2] TAN Xiong, WANG Jinglei, SUN Yifan. A fast detection method for moving targets in UAV video based on the feature extraction[J]. Remote Sensing for Land & Resources, 2021, 33(2): 27-32.
[3] LIU Zhao, ZHAO Tong, LIAO Feifan, LI Shuai, LI Haiyang. Research and comparative analysis on urban built-up area extraction methods from high-resolution remote sensing image based on semantic segmentation network[J]. Remote Sensing for Land & Resources, 2021, 33(1): 45-53.
[4] WEI Hongyu, ZHAO Yindi, DONG Jihong. Cooling tower detection based on the improved RetinaNet[J]. Remote Sensing for Land & Resources, 2020, 32(4): 68-73.
[5] Jinjie KANG, Haoping QI, Qinghua YANG, Hua CHEN. Study of remote sensing detection method for road obstacle and accessibility evaluation[J]. Remote Sensing for Land & Resources, 2020, 32(2): 94-102.
[6] Yang ZHOU, Yunsheng ZHANG, Siyang CHEN, Zhengrong ZOU, Yaochen ZHU, Ruixue ZHAO. Disaster damage detection in building areas based on DCNN features[J]. Remote Sensing for Land & Resources, 2019, 31(2): 44-50.
[7] Yuhai FAN, Hui WANG, Xingke YANG, Qiming PENG, Xuwen QIN, Jinzhong YANG, Shaopeng ZHANG, Furong TAN. Application of high-resolution remote sensing technology to the prospecting for rare metal mineralization belt[J]. Remote Sensing for Land & Resources, 2018, 30(1): 128-134.
[8] SU Tengfei, ZHANG Shengwei, LI Hongyu. Segmentation algorithm based on texture feature and region growing for high-resolution remote sensing image[J]. REMOTE SENSING FOR LAND & RESOURCES, 2017, 29(2): 72-81.
[9] WEN Li, WU Haiping, JIANG Fangfang, SU Wei, ZHU Dehai, ZHANG Chao. Establishment of remote sensing monitoring classification system and interpretation criteria for the reclamation area based on the high-resolution remote sensing image[J]. REMOTE SENSING FOR LAND & RESOURCES, 2016, 28(1): 172-177.
[10] YANG Xingwang, YANG Shuwen, ZHANG Liming, YAO Huaqin, LI Yikun. Design and development of the shadow detection and compensation system for high-resolution remote sensing images[J]. REMOTE SENSING FOR LAND & RESOURCES, 2015, 27(3): 177-181.
[11] SU Tengfei, LI Hongyu, QU Zhongyi. A study of road segmentation from the high resolution remote sensing image[J]. REMOTE SENSING FOR LAND & RESOURCES, 2015, 27(3): 1-6.
[12] CHEN Ling, LIANG Shuneng, ZHOU Yan, GAN Fuping, WEI Hongyan. Potential of applying domestic high-resolution remote sensing data to geological survey in high altitudes[J]. REMOTE SENSING FOR LAND & RESOURCES, 2015, 27(1): 140-145.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
京ICP备05055290号-2
Copyright © 2017 Remote Sensing for Natural Resources
Support by Beijing Magtech