摘要针对吉林一号(Jilin-1)卫星视频影像的超分辨率重建问题,在分析卫星视频与普通视频及遥感影像不同特性的基础上,研究了在成像场景内含有运动物体情况下,Vandewalle方法和金字塔LK(Lucas-Kanade)光流法运动估计方法的适用性。同时,针对目前中值平移并添加(median shift and add, MSA)方法在视频卫星影像重建中因帧间缺少互补信息而引起的边缘信息不清晰问题,提出了新的中值平移并添加(new median shift and add,NMSA)方法。首先,根据重建的倍数建立重建前、后的空间分辨率格网,并将2个格网统一到1个空间内; 然后,以待确定的重建后影像格网像元为中心,确定参与估计的低空间分辨率像元值,利用容许误差确定重建后的像元值。通过利用吉林一号(Jilin-1)卫星数据进行实验,验证了NMSA方法的有效性。
Abstract:According to the super-resolution reconstruction of Jilin-1 satellite and on the basis of an analysis of different characteristics of satellite video and common video as well as remote sensing image,the authors studied the motion estimation applicability of the Vandewalle method and the method of LK(Lucas-Kanade)optical flow in pyramid under the situation of imaging scene containing moving objects. At the same time, according to the median shift and add(MSA)method, the new median shift and add(NMSA)method was proposed to tackle the problem that the edge information is not clear because of the lack of complementary information between the frames in the video satellite image reconstruction. First, a resolution grid is established based on the multiple of reconstruction, and the two grids are unified into a unified space. Then, the low-resolution pixel values that participate in estimation are determined. With the pixel of the image reconstruction grid to be determined as the center, the allowed error is used to determine the reconstruction pixel values. The experiments using the data of Jilin-1 satellite prove the effectiveness of the method proposed in this paper.
卜丽静, 郑新杰, 肖一鸣, 张正鹏. 吉林一号卫星视频影像超分辨率重建[J]. 国土资源遥感, 2017, 29(4): 64-72.
BU Lijing, ZHENG Xinjie, XIAO Yiming, ZHANG Zhengpeng. Research on super-resolution reconstruction for video image of Jilin-1 satellite. REMOTE SENSING FOR LAND & RESOURCES, 2017, 29(4): 64-72.
[1] Murthy K,Shearn M,Smiley B D,et al.SkySat-1:Very high-resolution imagery from a small satellite[C]//Proceedings of SPIE 9241,Sensors,Systems,and Next-Generation Satellites XVIII.Amsterdam, Netherlands:SPIE,2014:92411E. [2] Nasrollahi K,Moeslund T B.Super-resolution:A comprehensive survey[J].Machine Vision and Applications,2014,25(6):1423-1468. [3] 袁小华,欧阳晓丽,夏德深.超分辨率图像恢复研究综述[J].地理与地理信息科学,2006,22(3):43-47. Yuan X H,Ouyang X L,Xia D S.An overview on super resolution image restoration[J].Geography and Geo-information Science,2006,22(3):43-47. [4] Park S C,Park M K,Kang M G.Super-resolution image reconstruction:A technical overview[J].IEEE Signal Processing Magazine,2003,20(3):21-36. [5] Irani M,Peleg S.Improving resolution by image registration[J].CVGIP:Graphical Models and Image Processing,1991,53(3):231-239. [6] Stark H,Oskoui P.High-resolution image recovery from image-plane arrays, using convex projections[J].Journal of the Optical Society of America A,1989,6(11):1715-1726. [7] Schultz R R,Stevenson R L.Extraction of high-resolution frames from video sequences[J].IEEE Transactions on Image Processing,1996,5(6):996-1011. [8] Elad M,Hel-Or Y.A fast super-resolution reconstruction algorithm for pure translational motion and common space-invariant blur[J].IEEE Transactions on Image Processing,2001,10(8):1187-1193. [9] Farsiu S,Robinson M D,Elad M,et al.Fast and robust multiframe super resolution[J].IEEE Transactions on Image Processing,2004,13(10):1327-1344. [10] Farsiu S.A Fast and Robust Framework for Image Fusion and Enhancement[D].Santa Cruz:University of California Santa Cruz,2005.