|
Abstract To address the issue of spatial and spectral information fusion during pansharpening, this study proposed a sharpening model for panchromatic and multispectral images based on the multiscale weighted pulse-coupled neural network (PCNN) and low-rank and sparse decomposition in the non-subsampled shearlet transform (NSST) domain. The sharpening model consists of low- and high-frequency processing modules. For high-frequency subbands, a method for weighting high-frequency subbands in various scales and directions was proposed, accompanied by an adaptive PCNN model tailored to their characteristics in different directions. In contrast, low-frequency subbands were decomposed into low-rank and sparse parts, with corresponding fusion rules created according to their characteristics. The fused image was then obtained through inverse NSST. The experiments on the sharpening model were conducted using GeoEye,QuickBird, and Pléiades datasets. Moreover, an ablation experiment was designed for the multiscale weighting module for high-frequency information. Compared to suboptimal models, the sharpening model in this study increased the peak signal-to-noise ratio (PSNR) value by approximately 1 dB, 1.6 dB, and 2.2 dB, respectively. The experimental results demonstrate that the sharpening model outperformed other algorithms in index assessment, effectively resolving the challenge of extracting high-frequency information.
|
Keywords
pansharpening
non-subsampled shearlet transform
multiscale weighting
pulse-coupled neural network
low-rank and sparse decomposition
|
|
Issue Date: 01 July 2025
|
|
|
[1] |
刘万军, 高健康, 曲海成, 等. 多尺度特征增强的遥感图像舰船目标检测[J]. 自然资源遥感, 2021, 33(3):97-106.doi:10.6046/zrzyyg.2020372.
|
[1] |
Liu W J, Gao J K, Qu H C, et al. Ship detection based on multiscale feature enhancement of remote sensing images[J]. Remote Sensing for Natural Resources, 2021, 33(3):97-106.doi:10.6046/zrzyyg2020372.
|
[2] |
Zhong S, Zhang Y, Chen Y, et al. Combining component substitution and multiresolution analysis:A novel generalized BDSD pansharpening algorithm[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2017, 10(6):2867-2875.
|
[3] |
Ghassemian H. A review of remote sensing image fusion methods[J]. Information Fusion, 2016,32:75-89.
|
[4] |
Meng X, Shen H, Li H, et al. Review of the pansharpening methods for remote sensing images based on the idea of meta-analysis:Practical discussion and challenges[J]. Information Fusion, 2019,46:102-113.
|
[5] |
Zhang K, Zhang F, Wan W, et al. Panchromatic and multispectral image fusion for remote sensing and earth observation:Concepts,taxonomy,literaturereview,evaluation methodologies and challenges ahead[J]. Information Fusion, 2023,93:227-242.
|
[6] |
Yuan Q, Wei Y, Meng X, et al. A multiscale and multidepth convolutional neural network for remote sensing imagery pan-sharpening[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2018, 11(3):978-989.
|
[7] |
Masi G, Cozzolino D, Verdoliva L, et al. Pansharpening by convolutional neural networks[J]. Remote Sensing, 2016, 8(7):594.
|
[8] |
Scarpa G, Vitale S, Cozzolino D. Target-adaptive CNN-based pansharpening[J]. IEEE Transactions on Geoscience and Remote Sensing, 2018, 56(9):5443-5457.
|
[9] |
Jin C, Deng L J, Huang T Z, et al. Laplacian pyramid networks:A new approach for multispectral pansharpening[J]. Information Fusion, 2022,78:158-170.
|
[10] |
Lei D, Chen P, Zhang L, et al. MCANet:A multidimensional channel attention residual neural network for pansharpening[J]. IEEE Transactions on Geoscience and Remote Sensing, 2022,60:1-16.
|
[11] |
Su X, Li J, Hua Z. Attention-based and staged iterative networks for pansharpening of remote sensing images[J]. IEEE Transactions on Geoscience and Remote Sensing, 2022,60:1-21.
|
[12] |
张杰, 王恒友, 霍连志, 等. 基于特征增强和Three-stream Transformer的高光谱遥感图像全色锐化[J/OL]. 自然资源遥感, 2024, (2024-12-11). https://link.cnki.net/urlid/10.1759.P.20241211.0942.012.
url: https://link.cnki.net/urlid/10.1759.P.20241211.0942.012
|
[12] |
Zhang J, Wang H Y, Huo L Z, et al. Pansharpening of hyperspectral remote sensing images based on feature enhancement and three-stream transformer[J/OL]. Remote Sensing for Natural Resources, 2024, (2024-12-11). https://link.cnki.net/urlid/10.1759.P.20241211.0942.012.
url: https://link.cnki.net/urlid/10.1759.P.20241211.0942.012
|
[13] |
Yin M, Liu W, Zhao X, et al. A novel image fusion algorithm based on nonsubsampledshearlet transform[J]. Optik, 2014, 125(10):2274-2282.
|
[14] |
徐欣钰, 李小军, 赵鹤婷, 等. NSCT和PCNN 相结合的遥感图像全色锐化算法[J]. 自然资源遥感, 2023, 35(3):64-70.doi:10.6046/zrzyyg.2022159.
|
[14] |
Xu X Y, Li X J, Zhao H T, et al. Pansharpening algorithm of remote sensing images based on NSCT and PCNN[J]. Remote Sen-sing for Natural Resources, 2023, 35 (3):64-70.doi:10.6046/zrzyyg.2022159.
|
[15] |
Johnson J L. Pulse-coupled neural nets:Translation,rotation,scale,distortion,and intensity signal invariance for images[J]. Applied Optics, 1994, 33(26):6239-6253.
doi: 10.1364/AO.33.006239
pmid: 20936043
|
[16] |
Wang X, Bai S, Li Z, et al. The PAN and MS image pansharpening algorithm based on adaptive neural network and sparse representation in the NSST domain[J]. IEEE Access, 2019,7:52508-52521.
|
[17] |
成丽波, 陈鹏宇, 李喆, 等. 基于剪切波变换和拟合优度检验的遥感图像去噪[J]. 吉林大学学报(理学版), 2023, 61(5):1187-1194.
|
[17] |
Cheng L B, Chen P Y, Li Z, et al. Remote sensing image denoising based on shearlet transform and goodness of fit test[J]. Journal of Jilin University (Science Edition), 2023, 61(5):1187-1194.
|
[18] |
Chen Y, Park S K, Ma Y, et al. A new automatic parameter setting method of a simplified PCNN for image segmentation[J]. IEEE Transactions on Neural Networks, 2011, 22(6):880-892.
doi: 10.1109/TNN.2011.2128880
pmid: 21550882
|
[19] |
Gao Q, Zhang P, Xia W, et al. Enhanced tensor RPCA and its application[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2020, 43(6):2133-2140.
|
[20] |
Garzelli A, Capobianco L, Alparone L, et al. Hyperspectralpansharpening based on modulation of pixel spectra[C]// 2010 2nd Workshop on Hyperspectral Image and Signal Processing:Evolution in Remote Sensing.IEEE 2nd Workshop on Hyperspectral Image and Signal Processing:Evolution in Remote Sensing. 2010:1-4.
|
[21] |
Jian L, Yang X, Wu W, et al. Pansharpening using a guided image filter based on dual-scale detail extraction[J]. Journal of Ambient Intelligence and Humanized Computing, 2018,1-15.
|
[22] |
Li Q, Yang X, Wu W, et al. Pansharpening multispectral remote-sensing images with guided filter for monitoring impact of human behavior on environment[J]. Concurrency and Computation:Practice and Experience, 2021, 33(4):e5074.
|
[23] |
Tao J, Song C, Song D, et al. Pan-sharpening framework based on multiscale entropy level matching and its application[J]. IEEE Transactions on Geoscience and Remote Sensing. 2022,60:1-21.
|
|
Viewed |
|
|
|
Full text
|
|
|
|
|
Abstract
|
|
|
|
|
Cited |
|
|
|
|
|
Shared |
|
|
|
|
|
Discussed |
|
|
|
|