基于Swin-TDL算法的果园环境下葡萄病害检测方法

doi:10.13733/j.jcam.issn.2095‑5553.2024.08.034

摘要/Abstract

摘要： 为在果园复杂环境因素下准确检测葡萄病害，提出一种基于Swin Transformer的葡萄病害检测模型Swin-TDL。采用Kmeans++聚类算法计算模型输入图像的锚框以提高检测精度；以Swin Transformer网络作为Swin-TDL的骨干网络更准确地获取目标特征信息；特征金字塔网络和路径聚合网络用于融合骨干网络中不同深度的特征层信息以增强检测目标的语义信息和定位信息；使用SIoU损失函数作为边界回归预测损失函数用于提高训练的速度和模型推理的准确性；使用Soft-NMS对目标边界框后处理以提高遮挡及重叠目标的检出率。在田间葡萄病害数据集中进行模型训练和性能测试，结果表明，Swin-TDL模型的平均精度均值为92.7%，平均检测时间为15.3 ms，综合性能优于对比检测算法，可以为葡萄植保装备研究提供参考。

关键词: 葡萄病害检测, 果园复杂环境, 图像增强, 深度学习, Swin Transformer

Abstract: In order to accurately detect grape diseases under complex environmental factors in orchards, a grape disease detection model Swin-TDL based on Swin Transformer is proposed. Kmeans++ clustering algorithm is used to calculate the anchor frames of the model input images to improve the detection accuracy. The Swin Transformer network is used as the backbone network of Swin-TDL for more accurate acquisition of target feature information. Feature pyramid networks and path aggregation networks are used to fuse information from feature layers of different depths in the backbone network to enhance the semantic and localization information of detection targets. The SIoU loss function is used as a boundary regression prediction loss function for improving the speed of training and the accuracy of model inference. Soft-NMS is used to post‑process the target bounding boxes to improve the detection rate of occluded and overlapped targets. Finally, model training and performance testing were carried out in the field grape disease dataset. The experimental results showed that the average accuracy of the Swin-TDL model was 92.7% and the average detection time was 15.3 ms. The comprehensive performance of Swin-TDL was better than the comparative detection algorithm, which could provide a reference for the research of grape plant protection equipment.

Key words: grape disease detection, orchard complex environment, image enhancement, deep learning, Swin Transformer

中图分类号:

胡国玉, 刘广, 周星光, 董娅兰, 周建平, . 基于Swin-TDL算法的果园环境下葡萄病害检测方法[J]. 中国农机化学报, 2024, 45(8): 234-239.

Hu Guoyu, , Liu Guang, Zhou Xingguang, Dong Yalan, Zhou Jianping, . Detection method of grape disease in orchard environment based on Swin-TDL algorithm [J]. Journal of Chinese Agricultural Mechanization, 2024, 45(8): 234-239.

参考文献

[ 1 ] Jaisakthi S M， Mirunalini P， Thenmozhi D. Grape leaf disease identification using machine learning techniques [C]. 2019 International Conference on Computational Intelligence in Data Science （ICCIDS）. IEEE， 2019: 1-6.
[ 2 ] Ge L， Zou K， Zhou H， et al. Three dimensional apple tree organs classification and yield estimation algorithm based on multi‑features fusion and support vector machine [J]. Information Processing in Agriculture， 2022， 9（3）: 431-442.
[ 3 ] Zhu J， Wu A， Wang X， et al. Identification of grape diseases using image analysis and BP neural networks [J]. Multimedia Tools and Applications， 2020， 79（21）: 14539-14551.
[ 4 ] Tian Y， Yang G， Wang Z， et al. Apple detection during different growth stages in orchards using the improved YOLO-V3 model [J]. Computers and Electronics in Agriculture， 2019， 157: 417-426.
[ 5 ] Kerkech M， Hafiane A， Canals R. Deep leaning approach with colorimetric spaces and vegetation indices for vine diseases detection in UAV images [J]. Computers and Electronics in Agriculture， 2018， 155: 237-243.
[ 6 ] 何欣，李书琴，刘斌. 基于多尺度残差神经网络的葡萄叶片病害识别[J]. 计算机工程， 2021， 47（5）: 285-291， 300.
He Xin， Li Shuqin， Liu Bin. Identification of grape leaf diseases based on multi‑scale residual neural network [J]. Computer Engineering， 2021， 47（5）: 285-291， 300.
[ 7 ] Li H， Li C， Li G， et al. A real‑time table grape detection method based on improved YOLOv4-tiny network in complex background [J]. Biosystems Engineering， 2021， 212: 347-359.
[ 8 ] Han K， Wang Y， Chen H， et al. A survey on vision transformer [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence， 2022， 45（1）: 87-110.
[ 9 ] Liu Z， Lin Y， Cao Y， et al. Swin transformer: Hierarchical vision transformer using shifted windows [C]. Proceedings of the IEEE/CVF International Conference on Computer Vision， 2021: 10012-10022.
[10] Li X， Li S. Transformer help CNN see better: A lightweight hybrid apple disease identification model based on transformers [J]. Agriculture， 2022， 12（6）: 884.
[11] Wang J， Zhang Z， Luo L， et al. SwinGD: A robust grape bunch detection model based on Swin transformer in complex vineyard environment [J]. Horticulturae， 2021， 7（11）: 492.
[12] Zaidi S S A， Ansari M S， Aslam A， et al. A survey of modern deep learning based object detection models [J]. Digital Signal Processing， 2022， 126: 103514.
[13] Zhao Z Q， Zheng P， Xu S， et al. Object detection with deep learning: A review [J]. IEEE Transactions on Neural Networks and Learning Systems， 2019， 30（11）: 3212-3232.
[14] Xue J， Cheng F， Li Y， et al. Detection of farmland obstacles based on an improved YOLOv5s algorithm by using CIoU and anchor box scale clustering [J]. Sensors， 2022， 22（5）: 1790.
[15] Ren Z， Lam E Y， Zhao J. Real‑time target detection in visual sensing environments using deep transfer learning and improved anchor box generation [J]. IEEE Access， 2020， 8: 193512-193522.
[16] Fu L， Duan J， Zou X， et al. Fast and accurate detection of banana fruits in complex background orchards [J]. IEEE Access， 2020， 8: 196835-196846.
[17] Li H， Li C， Li G， et al. A real‑time table grape detection method based on improved YOLOv4-tiny network in complex background [J]. Biosystems Engineering， 2021， 212: 347-359.
[18] Gevorgyan Z. SIoU loss: More powerful learning for bounding box regression [J]. arxiv preprint arxiv: 2205.12740， 2022.

[1]	许贞辉, 李晓娟. 果园树干检测与导航线拟合算法研究[J]. 中国农机化学报, 2024, 45(8): 217-222.
[2]	吴利刚, 吕媛媛, 周倩, 陈乐, 张梁, 史建华. 基于改进YOLOv5的轻量级黄花成熟检测方法[J]. 中国农机化学报, 2024, 45(7): 235-242.
[3]	张继成, 黄向党. 基于改进YOLOv3的玉米病害识别方法[J]. 中国农机化学报, 2024, 45(7): 269-275.
[4]	雷浩, 苑迎春, 何振学. 基于多尺度卷积和注意力机制的枣品种识别[J]. 中国农机化学报, 2024, 45(6): 135-141.
[5]	崔海朋, 秦朝旭, 马志宇. 基于深度学习的鱼类特征点检测与体征识别方法[J]. 中国农机化学报, 2024, 45(6): 201-207.
[6]	黄尧, 何敬, 付饶, 刘刚, , 林远杨. YOLOv5s-CBAM算法在福寿螺虫卵识别中的应用分析[J]. 中国农机化学报, 2024, 45(6): 223-228.
[7]	陶旭, , 余富强, , 蔡金金, 么炜, , 刘博, . 面向激光雷达点云数据的多结构树种识别[J]. 中国农机化学报, 2024, 45(5): 168-175.
[8]	漆海霞, , , 李承杰, 黄桂珍. 基于轻量化YOLOv4的死淘鸡目标检测算法[J]. 中国农机化学报, 2024, 45(5): 195-201.
[9]	罗鑫, 李加强, 何超. 基于改进YOLOv4的澳洲坚果视觉监测方法[J]. 中国农机化学报, 2024, 45(5): 217-222.
[10]	廖舒怀, , 王凯, 宋健, 解福祥, 王名声, , 龚中良. 基于移动机器人的树木识别与冠层信息测量[J]. 中国农机化学报, 2024, 45(5): 232-238.
[11]	王化佳, 顾寄南, 王梦妮, 夏子林. 基于深度学习的茶嫩芽分割与采摘点定位方法研究[J]. 中国农机化学报, 2024, 45(5): 246-252.
[12]	陈鲁威, , 曾锦, , 袁全春, , 夏烨, , 潘健, 吕晓兰, , . 基于改进DeepLabV3+的梨树冠层分割方法[J]. 中国农机化学报, 2024, 45(4): 155-161.
[13]	张慧蒙, 何超, 徐嘉雯, 罗鑫, 荣剑, 刘学渊. 基于SCGYOLOv5n的收获期澳洲坚果检测算法[J]. 中国农机化学报, 2024, 45(4): 214-221.
[14]	邱金凯, 许秀英, 康烨, 臧浩, 马锴, 郭志鹏. 基于语义分割的无人机图像西瓜果实提取研究[J]. 中国农机化学报, 2024, 45(3): 182-188.
[15]	邱畅, 田光兆, 赵嘉威, 谢尚杰, 郑奎. 基于改进YOLOv5的草莓病害识别[J]. 中国农机化学报, 2024, 45(3): 198-204.