Leaf disease segmentation model of greenhouse tomatoes based on ResUnet with attention mechanism

doi:10.13733/j.jcam.issn.2095‑5553.2024.08.033

Abstract

Abstract: In view of the difficulty in accurately identifying tomato early blight spot in the complex greenhouse environment, a ResUnet model of integrated channel attention mechanism was proposed. The data set of tomato early blight under complex greenhouse environment was constructed. Lesions were segmented by ResUnet model integrating channel attention mechanism, in which ResUnet network could learn the importance of different depth features, and embedding channel attention mechanism made the improved model pay more attention to the location features of lesions. The accuracy of this model was 97%, 1.99% and 2.97% higher than that of Unet and Resnet101 models, respectively. The parameters and weights of backbone network layer obtained from tomato early blight spot segmentation model were transferred to the single background spot segmentation model of pepper scab, apple gray spot, grape black rot, etc., and improved and the parameters were fine‑tuned to achieve accurate spot segmentation. On the basis of the research algorithm, the intelligent diagnosis system is designed, which can quickly and accurately diagnose the studied crop diseases and provide basis for timely prevention and control.

Key words: , leaf disease, tomato early blight disease, ResUnet, attention mechanism, transfer learning, intelligent diagnose

摘要： 针对温室环境复杂背景下番茄早疫病病斑难以准确识别的问题，提出一种融合通道注意力机制的ResUnet模型。构建温室环境复杂背景下的番茄早疫病数据集；通过融合通道注意力机制的ResUnet模型进行病斑分割，其中ResUnet网络能够学习不同深度特征的重要性，嵌入通道注意力机制使改进的模型更加关注病斑的位置特征。该模型对番茄叶部早疫病病斑分割的准确率为97%，比Unet和Resnet101模型分别提高1.99%和2.97%。将番茄早疫病病斑分割模型得到的骨干网络层参数和权重迁移到单一背景的辣椒结痂、苹果灰斑病、葡萄黑腐病等病斑分割模型，进行改进及参数的微调处理，均能实现病斑的准确分割。在研究算法基础上，设计智能诊断系统，可对作物病害进行快速准确诊断，为及时防控提供依据。

关键词: 作物病斑, 番茄早疫病, ResUnet, 注意力机制, 迁移学习, 智能诊断

CLC Number:

S225.92

Su Fei, , Wang Guanghui, Shi Yanxia, Jia Ran, Yan Yinfa, , Zu Linlu, . Leaf disease segmentation model of greenhouse tomatoes based on ResUnet with attention mechanism[J]. Journal of Chinese Agricultural Mechanization, 2024, 45(8): 228-233.

苏斐, 王光辉, 史艳霞, 贾然, 闫银发, 祖林禄, . 融合通道注意力机制的ResUnet作物病斑分割模型[J]. 中国农机化学报, 2024, 45(8): 228-233.

References

[ 1 ] Goyal L， Sharma C M， Singh A， et al. Leaf and spike wheat disease detection & classification using an improved deep convolutional architecture [J]. Informatics in Medicine Unlocked， 2021， 25: 100642.
[ 2 ] 李冠林，马占鸿，黄冲，等. 基于K_means硬聚类算法的葡萄病害彩色图像分割方法[J]. 农业工程学报， 2010， 26（S2）: 32-37.
Li Guanlin， Ma Zhanhong， Huang Chong， et al. Segmentation of color images of grape diseases using K_means clustering algorithm [J]. Transactions of the Chinese Society of Agricultural Engineering， 2010， 26（1）: 32-37.
[ 3 ] 王振，张善文，赵保平. 基于级联卷积神经网络的作物病害叶片分割[J]. 计算机工程与应用， 2020， 56（15）: 242-250.
Wang Zhen， Zhang Shanwen， Zhao Baoping. Crop diseases leaf segmentation method based on cascade convolutional neural network [J]. Computer Engineering and Applications， 2020， 56（15）: 242-250.
[ 4 ] 赵兵，冯全. 基于全卷积网络的葡萄病害叶片分割[J]. 南京农业大学学报， 2018， 41（4）: 752-759.
Zhao Bing， Feng Quan. Segmentation of grape diseases leaf based on full convolution network [J]. Journal of Nanjing Agricultural University， 2018， 41（4）: 752-759.
[ 5 ] Wang C， Du P， Wu H， et al. A cucumber leaf disease severity classification method based on the fusion of DeepLabV3+ and U-Net [J]. Computers and Electronics in Agriculture， 2021， 106373: 0168-1699.
[ 6 ] 赵小虎，李晓，叶圣，等. 基于改进U-Net网络的多尺度番茄病害分割算法[J]. 计算机工程与应用， 2022， 58（10）: 216-223.
Zhao Xiaohu， Li Xiao， Ye Sheng， et al. Multi‑scale tomato disease segmentation algorithm based on improved U-Net network [J]. Computer Engineering and Applications， 2022， 58（10）: 216-223.
[ 7 ] 任守纲，贾馥玮，顾兴健，等. 反卷积引导的番茄叶部病害识别及病斑分割模型[J]. 农业工程学报， 2020， 36（12）: 186-195.
Ren Shougang， Jia Fuwei， Gu Xingjian， et al. Recognition and segmentation model of tomato leaf diseases based on deconvolution‑guiding [J]. Transactions of the Chinese Society of Agricultural Engineering， 2020， 36（12）: 186-195.
[ 8 ] Chen J， Zhang D， Zeb A， et al. Identification of rice plant diseases using lightweight attention networks [J]. Expert Systems with Applications， 2021， 169: 114514.
[ 9 ] Jie H， Li S， Sun G. Squeeze-and-excitation networks [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence， 2018: 7132-7141.
[10] 苏宝峰，沈磊，陈山. 基于注意力机制的葡萄品种多特征分类方法[J]. 农业机械学报， 2021， 52（11）: 226-233， 252.
Su Baofeng， Shen Lei， Chen Shan， et al. Multi‑features identification of grape cultivars based on attention mechanism [J]. Transactions of the Chinese Society for Agricultural Machinery， 2021， 52（11）: 226-233， 252.
[11] 赵晋陵，詹媛媛，王娟，等. 基于SE-UNet的冬小麦种植区域提取方法[J]. 农业机械学报， 2022， 53（9）: 189-196.
Zhang Jinling， Zhan Yuanyuan， Wang Juan， et al. SE-UNet-based extraction of winter wheat planting areas [J]. Transactions of the Chinese Society for Agricultural Machinery， 2022， 53（9）: 189-196.
[12] Zeng W， Li M. Crop leaf disease recognition based on Self‑Attention convolutional neural network [J]. Computers and Electronics in Agriculture， 2020， 172: 10534.

[1]	Li Bin, Yang Xingyu, Liu Xiangxin, Gao Xiaolong. Research status and prospect of mechanized harvesting device for walnut [J]. Journal of Chinese Agricultural Mechanization, 2024, 45(8): 1-7.
[2]	Han Zhongdong, Liu Jiangtao, Yang Zhijie, Li Shanshan, Li Tao. Design and experiment of compound operation machine for precision sowing of maize [J]. Journal of Chinese Agricultural Mechanization, 2024, 45(8): 20-26.
[3]	Wang Xiang, Wang Junyue, , Bao Zhiliang, Meng Yugang, Gao Lei, Bao Wuyunbilige. Design and test of feeding roller of round baler based on SolidWorks Simulation [J]. Journal of Chinese Agricultural Mechanization, 2024, 45(8): 43-48.
[4]	Tian Huijuan, Huang Lüwen, , Tian Xu, Ren Liehong. Design of cattle collar based on multi‑sensor fusion [J]. Journal of Chinese Agricultural Mechanization, 2024, 45(8): 77-85.
[5]	Fan Yuhang, Song Weidong, Wang Jiaoling, Wang Mingyou, Ding Tianhang, Zhou Dehuan. Application progress of artificial neural network in the field of fruit and vegetable drying [J]. Journal of Chinese Agricultural Mechanization, 2024, 45(8): 112-119.
[6]	Yang Junru, , Yu Xiaodong, Li Ruichuan, , Xu Jikang, , Han Zongran, Li Yanchao, . Research and experiment on dynamic characteristics of tractor multi‑way valve throttling groove [J]. Journal of Chinese Agricultural Mechanization, 2024, 45(8): 126-131.
[7]	Ma Zhiyan, , Wan Haidi, Chen Xuehai, , Shen Yang, , Zhou Minggang, . Research on the reconstruction method of maize three‑dimensional model in seeding stage based on RGB-D binocular vision [J]. Journal of Chinese Agricultural Mechanization, 2024, 45(8): 148-153.
[8]	Li Jie, , Gao Shangbing, Yu Jiyuan, , Chen Xin, Li Shicong, Yuan Xingxing. Identification method of resistance to mung bean leaf spot disease based on PMMS-Net and chlorophyll fluorescence imaging [J]. Journal of Chinese Agricultural Mechanization, 2024, 45(8): 210-216.
[9]	LiuXing, Gu Jinan, Huang Zedong, Zhang Wenhao, Zhang Wei. Research on apple point cloud semantic segmentation based on deep learning [J]. Journal of Chinese Agricultural Mechanization, 2024, 45(8): 223-227.
[10]	Feng Xiao, , Zhang Hui, , Liu Yunchao, Zhang Wei, , Li Xiaohong, , Ma Zhongjie, . Detection of grape cluster in stone hardening stage based on improved YOLOv5s [J]. Journal of Chinese Agricultural Mechanization, 2024, 45(8): 240-245.
[11]	Zhou Sijie, Liu Tianqi, Chen Tianhua. Research on rice disease recognition based on improved YOLOv5 algorithm [J]. Journal of Chinese Agricultural Mechanization, 2024, 45(8): 246-253.
[12]	Yuan Yingchun, Zhang Ao, He Zhenxue, Zhang Ruochen, Lei Hao. Peach fruit real⁃time recognition in complex orchard environment based on improved YOLOv4-tiny [J]. Journal of Chinese Agricultural Mechanization, 2024, 45(8): 254-261.
[13]	Wang Ketao, Chen Shifeng, Chen Gui, Wei Jin, Meng Liwen, Chen Quancheng. Detection method of garden spherical hedge based on YOLOv5s [J]. Journal of Chinese Agricultural Mechanization, 2024, 45(8): 262-269.
[14]	Liang Yuan, , Bi Wentai, Zhang Yuejie, . Review and prospect of agricultural industry organization model research [J]. Journal of Chinese Agricultural Mechanization, 2024, 45(8): 317-324.
[15]	Lou Xiuhua, Li Maofeng, Du Yuefeng, Mao Enrong, Fu Lei. Design and experiment of cleaning control system for corn combined harvester [J]. Journal of Chinese Agricultural Mechanization, 2024, 45(7): 1-8.