高级检索

    融合FFT和EMHSA的双时相光学遥感影像变化检测网络

    Change detection network for dual-temporal optical remote sensing images integrating fast Fourier transform and efficient multi-head self-attention

    • 摘要: 近年来,基于深度学习的遥感变化检测取得了飞速发展,但对于复杂场景的变化检测仍然存在识别不完整、误检率高的问题。该文在SNUnet的基础上,通过融合快速傅里叶变换(fast Fourier transform,FFT)和高效多头自注意力机制(efficient multi-head self attention,EMHSA),提出了FTUNet网络。网络中的FFT模块实现对两时相图像的风格统一,降低由于光照变化等外界因素产生的“伪变化”所引起的错误检测;而在网络的特征提取阶段,引入EMHSA,充分提取特征图的上下文信息,以提高变化目标分割结果的完整性。在LEVIR-CD和SYSU-CD这2个公开数据集上的实验结果表明,FTUNet的F1得分比SNUNet分别提升1.42和1.53百分点,交并比分别提升2.31和2.07百分点。

       

      Abstract: The deep learning-based change detection of remote sensing images has seen rapid advances in the past few years. However,it still faces challenges for change detection in complex scenes,such as incomplete recognition and high false detection rates. In response to these challenges,this paper proposed the FTUNet,a network based on SNUnet that integrates the fast Fourier transform (FFT) and efficient multi-head self-attention (EMHSA). Specifically,the FFT module in the network enabled style unification of dual-temporal images,reducing false detection caused by “pseudo changes” due to external factors such as light variations. Additionally,the EMHSA was introduced in the feature extraction stage to fully extract the contextual information from the feature maps,thereby enhancing the segmentation integrity of target changes. Experiments on the LEVIR-CD and SYSU-CD public datasets showed that the FTUNet exhibited increases of 1.42 and 1.53 percentage points in F1 score,as well as increases of 2.31 and 2.07 percentage points in intersection over union (IoU),compared to the SNUNet.

       

    /

    返回文章
    返回