高级检索

    融合Transformer与注意力蒸馏的农村地区道路提取

    Information extraction of rural roads by integrating Transformer with attention-based knowledge distillation

    • 摘要: 针对农村地区道路遥感提取中“复杂场景适配难、高精度与轻量化协同难”的核心问题,提出一种基于双分支融合与注意力蒸馏的轻量化提取方法,以实现农村地区道路“细节-拓扑”精准建模与高效部署的双重目标。首先,针对单结构模型“局部优全局弱”或“全局优局部弱”的固有缺陷, 构建ResNet与vision Transformer(ViT)双分支融合教师模型,通过双向融合模块(BiFusion)动态融合卷积神经网络(convolutional neural network, CNN)的局部细节特征与Transformer的全局拓扑特征; 其次,为了实现精度与轻量化的平衡,设计KD注意力蒸馏策略,在轻量化学生模型中引入知识蒸馏注意力(KDAttention)模块,引导模型聚焦关键农村地区道路区域并继承教师模型的结构化特征。在DeepGlobe数据集与WHU-RuR农村地区道路数据集上开展消融实验与对比实验,结果表明Teachers-Unet在DeepGlobe数据集上交并比(intersection over union, IoU)达75.23%, F1值达85.86%,较最优单分支模型分别提升13.59和9.59个百分点; 经KD注意力蒸馏的学生模型参数量仅8.3×106(不足教师模型25%),在WHU-RuR数据集上IoU达67.14%, F1值达80.34%,与教师模型精度差距不足1个百分点; 所提方法较传统U-Net和D-LinkNet等模型,在农村地区道路数据集上IoU提升12个百分点以上,可有效应对农村地区道路背景干扰强、窄路占比高、遮挡严重等问题。该方法兼顾高精度与轻量化优势,为农村地区道路遥感提取提供技术支撑。

       

      Abstract: Information extraction of rural roads from remote sensing images faces significant challenges associated with adaptation to complex scenarios and the balance between high accuracy and lightweight deployment. To address these issues, this study proposes a lightweight information extraction method that integrates dual-branch feature fusion with attention-based knowledge distillation, aiming to achieve precise detail-topology modeling of rural roads and efficient deployment. First, to overcome the inherent limitations of single-structure models that highlight either local details or global context, a teacher model characterized by the dual-branch fusion integrating ResNet with Vision Transformer (ViT) was established, termed Teachers-Unet. In this model, a bidirectional fusion module (BiFusion) was employed to dynamically fuse the local detail features captured by the convolutional neural network (CNN) model with the global topological features captured by the Transformer. Second, an attention-based knowledge distillation strategy was designed for a balance between high accuracy and lightweight deployment. Specifically, a KDAttention module was introduced into a lightweight student model, enabling the model to focus on key rural roads and inherit structured representations from the teacher model. Finally, ablation and comparative experiments were conducted on the DeepGlobe and WHU-RuR rural road datasets. The results demonstrate that the Teachers-Unet model yielded an intersection-over-union (IoU) value of 75.23% and an F1 score of 85.86% on the DeepGlobe dataset, increasing by 13.59% and 9.59%, respectively, compared to the optimal single-branch model. The attention-based knowledge-distilled student model involved only 8.3×106 parameters, less than 25% of those contained in the teacher model. The student model yielded an IoU value of 67.14% and an F1 score of 80.34% on the WHU-RuR dataset, with an accuracy gap of less than 1% compared to the teacher model. Compared to conventional models such as U-Net and D-LinkNet, the proposed method increased the IoU by more than 12% on the rural road dataset. This method can effectively overcome multiple issues induced by strong background interference, a high proportion of narrow roads, and severe occlusions in rural road information extraction. Overall, the method developed in this study achieves a balance between accuracy and lightweight deployment, providing effective technical support for information extraction of rural roads from remote sensing images.

       

    /

    返回文章
    返回