高级检索

    基于变换域多尺度加权神经网络的全色锐化

    Pansharpening based on the multiscale weighted neural network in the transform domain

    • 摘要: 为了解决全色锐化过程中存在的空间与光谱信息融合问题,该文提出了一种在非下采样剪切波变换(non-subsampled shearlet transform, NSST)域下,基于多尺度加权的脉冲耦合神经网络(pulse-coupled neural network, PCNN)和低秩稀疏分解的全色图像和多光谱图像的锐化模型。该模型分为低频和高频处理模块,对于高频子带,提出了一种适用于不同尺度不同方向高频子带的加权方式,并针对其不同方向上的特性,采用一种自适应PCNN模型;对于低频子带,首先将其分解为低秩与稀疏2部分,并根据低秩部分与稀疏部分特点设计相应的融合规则,再采取逆NSST变换得到融合图像。实验在GeoEye,QuickBird与Pléiades数据集上进行,并针对高频信息多尺度加权模块设计了消融实验,相比于次优模型,峰值信噪比(peak signal-to-noise ratio,PSNR)值分别提高了约1 dB,1.6 dB和2.2 dB。实验结果表明,该模型在指标评估中优于其他算法,并有效解决高频信息提取困难问题。

       

      Abstract: To address the issue of spatial and spectral information fusion during pansharpening, this study proposed a sharpening model for panchromatic and multispectral images based on the multiscale weighted pulse-coupled neural network (PCNN) and low-rank and sparse decomposition in the non-subsampled shearlet transform (NSST) domain. The sharpening model consists of low- and high-frequency processing modules. For high-frequency subbands, a method for weighting high-frequency subbands in various scales and directions was proposed, accompanied by an adaptive PCNN model tailored to their characteristics in different directions. In contrast, low-frequency subbands were decomposed into low-rank and sparse parts, with corresponding fusion rules created according to their characteristics. The fused image was then obtained through inverse NSST. The experiments on the sharpening model were conducted using GeoEye,QuickBird, and Pléiades datasets. Moreover, an ablation experiment was designed for the multiscale weighting module for high-frequency information. Compared to suboptimal models, the sharpening model in this study increased the peak signal-to-noise ratio (PSNR) value by approximately 1 dB, 1.6 dB, and 2.2 dB, respectively. The experimental results demonstrate that the sharpening model outperformed other algorithms in index assessment, effectively resolving the challenge of extracting high-frequency information.

       

    /

    返回文章
    返回