高级检索

    基于传统深度模型识别与SAM精确分割的河流智能提取方法

    An intelligent river information extraction method integrating conventional deep learning model-based detection with Segment Anything Model-based precise segmentation

    • 摘要: 为满足自然资源监测、水资源管理等对河流日益增长的高精度、高频次监测需求,针对传统深度学习语义分割模型样本要求高、模型泛化能力不足,同时分割一切模型(segment anything model,SAM)虽泛化能力强且能零样本学习,但存在无法自动识别地类等问题,该文将经典深度学习模型与SAM模型结合,提出了一种面向遥感影像的由粗到精的河流智能提取方法。首先,基于融合空洞空间金字塔池化和卷积注意力机制模块的经典语义分割模型获取河流的粗略提取结果,进而提出基于Canny边缘约束、漫水填充等传统图像处理的SAM正负样本点自动获取方法,全自动获取高精度的稀疏提示(sparse prompts, SP)点, 并将该方法获取的SP点精度与其他经典语义分割模型进行对比,结果表明: 该方法相比经典语义分割模型, 平均交并比(mean intersection over union,mIoU)提升了7.4%; 在相同的SAM基础框架下,相比随机获取的SP点,该文的全自动获取方法在河流提取中mIoU提升了5.7%。该方法可充分发挥传统模型和大模型的各自优势,实现少样本、低成本、高精度、全自动的河流智能提取,为将河流智能提取的结果应用到工程实践中提供技术支撑。

       

      Abstract: Natural resource monitoring and water resource management boost the demand for high-precision and high-frequency river monitoring. However, conventional semantic segmentation models based on deep learning are constrained by high requirements for samples and limited generalization capabilities. Meanwhile, the Segment Anything Model (SAM), despite strong generalization and zero-shot learning (ZSL) capability, faces challenges in automatically identifying land cover types. To address these issues, this study proposes a coarse-to-fine intelligent river information extraction framework oriented to remote sensing images by integrating classical deep learning models with SAM. First, coarse river information extraction is conducted by employing a classical semantic segmentation model that integrates atrous spatial pyramid pooling (ASPP) and convolutional block attention module (CBAM). Then, a method is proposed to automatically acquire positive and negative sample points of SAM based on conventional image processing algorithms, such as Canny edge detection and flood fill. This method enables the fully automatic acquisition of high-precision sparse prompt points. The results indicate that compared to classical semantic segmentation models, the coarse-to-fine river extraction framework proposed in this study achieved an increase of 7.4% in the mean Intersection over Union (mIoU). Under the same basic SAM framework, the proposed method for automatically acquiring positive and negative sample points increased the mIoU of river information extraction by 5.7% compared to the random extraction of prompt points. This method can fully leverage the advantages of conventional and large models, enabling high-precision, fully automatic, and intelligent river information extraction with few samples and low costs. This study will provide technical support for applying the results of intelligent 0river information extraction to engineering practices.

       

    /

    返回文章
    返回