高级检索

    改进PointNet++语义分割与三维重建融合的绿篱修剪智能决策框架

    A framework integrating improved PointNet++ segmentation and 3D reconstruction towards intelligent hedge trimming decisions

    • 摘要:
      目的 针对现有绿篱自动修剪方法中目标修剪轮廓依赖人工预设轮廓、无法根据生长状态自主决策的根本性局限,本研究旨在提出一种可自主完成“感知—理解—决策”的智能化修剪点生成框架,以推动修剪作业从程序化自动向智能自主跨越。
      方法 本研究提出“智能分割—几何拟合—任务生成”三层级技术框架。首先,通过神经辐射场(NeRF)从环绕拍摄视频重建高保真度的绿篱点云。进而,改进PointNet++,构建Hedge-PointNet,引入Softmax点级概率建模与多轮推理融合策略,实现绿篱与背景的精准语义分割。随后,依据语义类别自适应选择随机抽样一致性算法(RANSAC)等鲁棒的几何拟合方法,三维重建目标修剪曲面。最后,通过曲面网格化与投影策略,智能化提取实际修剪点。
      结果 在复杂真实场景下的实验结果表明:(1)所提Hedge-PointNet的语义分割平均交并比(mIoU)达0.971,显著优于基线模型;(2)在球面拟合任务中,RANSAC算法的均方根误差为0.005 1 m,较传统最小二乘法降低了96.7%,对离群点表现出优异鲁棒性;(3)该方法生成的修剪点集仅需覆盖目标曲面36.1%的潜在点位,即可实现同等修剪效果,无效修剪动作减少63.9%,在精度与效率间取得最佳平衡。
      结论 本研究不仅实现了绿篱修剪轮廓的自主判断与作业指令的智能生成,还可作为自动化修剪装备中的感知与决策模块,为后续路径规划与机械执行提供目标参数与作业点位输入。该框架具有良好的通用性,可为园林养护、农作物整形修剪及相关机器人三维作业任务中的目标识别与作业决策提供参考。

       

      Abstract:
      Objective Existing automatic hedge-trimming methods fundamentally rely on manually predefined target contours and are unable to make autonomous decisions according to actual growth conditions. To address this limitation, this study aims to propose an intelligent trimming-point generation framework capable of autonomously completing the processes of “perception-understanding-decision-making”, thereby promoting hedge trimming from programmed automation to intelligent autonomy.
      Method A three-level technical framework of “intelligent segmentation-geometric fitting-task generation” was proposed. First, high-fidelity hedge point clouds were reconstructed from surround-view videos using neural radiance fields (NeRF). Then, PointNet++ was innovatively improved to build Hedge-PointNet, in which point-wise Softmax probability modeling and multi-round inference fusion strategies were introduced to achieve accurate semantic segmentation of hedges and background. Subsequently, robust geometric fitting methods, including random sample consensus (RANSAC), were adaptively selected according to semantic categories to reconstruct the target trimming surface. Finally, actual trimming points were intelligently extracted through surface meshing and point-cloud projection strategies.
      Result Experimental results in complex real-world scenes showed that: (1) the proposed Hedge-PointNet achieved a mean intersection over union (mIoU) of 0.971 in semantic segmentation, significantly outperforming the baseline model; (2) in the spherical fitting task, the root mean square error of the RANSAC algorithm was 0.005 1 m, which was 96.7% lower than that of the conventional least-squares method, demonstrating strong robustness to outliers; and (3) the generated trimming-point set only needed to cover 36.1% of the potential points on the target surface to achieve the same trimming effect, reducing ineffective trimming actions by 63.9% and achieving a favorable balance between accuracy and efficiency.
      Conclusion This study not only realized autonomous determination of hedge trimming contours and intelligent generation of operation instructions but also can serve as a perception and decision-making module in automated trimming equipment, providing target parameters and operation-point inputs for subsequent path planning and mechanical execution. The proposed framework shows good generality and can provide a reference for target recognition and operation decision-making in garden maintenance, crop training and pruning, and related robotic 3D operation tasks.

       

    /

    返回文章
    返回