Abstract
Tea leaf blight (TLB) is a common tea disease seriously affecting the quality and yield of tea. An accurate estimation of TLB severity can be used to guide tea farmers to reasonably spray pesticides. This study proposes an estimation method for TLB severity in natural scene images and consists of four main steps: segmentation of the diseased leaves, area fitting of the diseased leaves, segmentation of the disease spots, and estimation of disease severity. Target leaves with TLB in the tea images are segmented by combining the U-Net network and fully connected conditional random field to reduce the influence of complex background. An ellipse restoration method is proposed to generate an elliptic mask to fit the full size of the occluded or damaged TLB leaves. The disease spot regions are segmented from the TLB leaves by a support vector machine classifier to calculate the Initial Disease Severity (IDS) index. The IDS index, color features, and texture features of the TLB leaves are inputted into the metric learning model to finally estimated disease severity. Experimental results show that the proposed method has higher estimation accuracy and stronger robustness against occluded and damaged TLB leaves compared with conventional convolution neural network methods and classical machine learning techniques.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Ashourloo, D., Aghighi, H., Matkan, A. A., Mobasheri, M. R., & Rad, A. M. (2016a). An investigation into machine learning regression techniques for the leaf rust disease detection using hyperspectral measurement. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 9(9), 4344–4351. https://doi.org/10.1109/JSTARS.2016.2575360.
Ashourloo, D., Matkan, A. A., Huete, A., Aghighi, H., & Mobasheri, M. R. (2016b). Developing an index for detection and identification of disease stages. IEEE Geoscience and Remote Sensing Letters, 13(6), 851–855. https://doi.org/10.1109/LGRS.2016.2550529.
Bai, G., Jenkins, S., Yuan, W., Graef, G. L., & Ge, Y. (2018). Field-based scoring of soybean iron deficiency chlorosis using RGB imaging and statistical learning. Frontiers in Plant Science, 9(July), 1–12. https://doi.org/10.3389/fpls.2018.01002.
Barbedo, J. G. A., Koenigkan, L. V., & Santos, T. T. (2016). Identifying multiple plant diseases using digital image processing. Biosystems Engineering, 147, 104–116. https://doi.org/10.1016/j.biosystemseng.2016.03.012.
Behera, S. K., Jena, L., Rath, A. K., & Sethy, P. K. (2018). Disease classification and grading of orange using machine learning and fuzzy logic. In Proceedings of the 2018 IEEE international conference on communication and signal processing, ICCSP 2018, pp. 678–682. https://doi.org/10.1109/ICCSP.2018.8524415.
Can, G., Gao, X., He, L., Zhang, Q., Meng, Z., Lyu, Z., & Chen, J. (2014). Application research progress of biological control of tea diseases and pests. Guangdong Agricultural Sciences, 6, 105–109. https://doi.org/10.16768/j.issn.1004-874x.2014.06.016.
Cortes, C., & Vapnik, V. (1995). Support-vector networks. Machine Learning, 20, 273–297. https://doi.org/10.1023/A:1022627411411.
Davis, J., & Goadrich, M. (2006). The relationship between precision-recall and ROC curves. ACM International Conference Proceeding Series, 148, 233–240. https://doi.org/10.1145/1143844.1143874.
Fischler, M. A., & Bolles, R. C. (1981). Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM, 24, 381–395. https://doi.org/10.1145/358669.358692.
Fitzgibbon, A.W., & Fisher, R. B. (1995). A Buyer's Guide to Conic Fitting. Proceedings of the 6th British conference on Machine vision, 2, 513–522. https://doi.org/10.5244/C.9.51.
Fitzgibbon, A., Pilu, M., & Fisher, R. B. (1999). Direct least square fitting of ellipses. IEEE Transactions on Pattern Analysis and Machine Intelligence, 21(5), 476–480. https://doi.org/10.1109/34.765658.
Gao, L., & Lin, X. (2019). Fully automatic segmentation method for medicinal plant leaf images in complex background. Computers and Electronics in Agriculture, 164, 104924. https://doi.org/10.1016/j.compag.2019.104924.
Garcia-Garcia, A., Orts, S., Oprea, S., Villena-Martinez, V., & Rodriguez, J.A. (2017). A review on deep learning techniques applied to semantic segmentation. ArXiv, 1–23. http://arxiv.org/abs/1704.06857.
Ghosal, S., Blystone, D., Singh, A. K., Ganapathysubramanian, B., Singh, A., & Sarkar, S. (2018). An explainable deep machine vision framework for plant stress phenotyping. Proceedings of the National Academy of Sciences of the United States of America, 115(18), 4613–4618. https://doi.org/10.1073/pnas.1716999115.
Grand-Brochier, M., Vacavant, A., Cerutti, G., Kurtz, C., Weber, J., & Tougne, L. (2015). Tree leaves extraction in natural images: Comparative study of preprocessing tools and segmentation methods. IEEE Transactions on Image Processing, 24(5), 1549–1560. https://doi.org/10.1109/TIP.2015.2400214.
Hu, G., Wu, H., Zhang, Y., & Wan, M. (2019a). A low shot learning method for tea leaf’s disease identification. Computers and Electronics in Agriculture., 163(104852), 1–6. https://doi.org/10.1016/j.compag.2019.104852.
Hu, G., Yang, X., Zhang, Y., & Wan, M. (2019b). Identification of tea leaf diseases by using an improved deep convolutional neural network. Sustainable Computing: Informatics and Systems, 24(100353), 1. https://doi.org/10.1016/j.suscom.2019.100353.
Jadhav, S. B., & Patil, S. B. (2016). Grading of soybean leaf disease based on segmented image using K-means clustering. IAES International Journal of Artificial Intelligence (IJ-AI), 5, 1. https://doi.org/10.11591/ijai.v5.i1.pp13-21.
Koen, B. V. (1988). Toward a definition of the engineering method. European Journal of Engineering Education. https://doi.org/10.1080/03043798808939429.
Krähenbühl, P., & Koltun, V. (2011). Efficient inference in fully connected crfs with Gaussian edge potentials. In Advances in neural information processing systems 24: 25th annual conference on neural information processing systems 2011, NIPS 2011, 1–9. https://arxiv.org/abs/1210.5644.
Kruse, O. M. O., Prats-Montalbán, J. M., Indahl, U. G., Kvaal, K., Ferrer, A., & Futsaether, C. M. (2014). Pixel classification methods for identifying and quantifying leaf surface injury from digital images. Computers and Electronics in Agriculture, 108, 155–165. https://doi.org/10.1016/j.compag.2014.07.010.
Kwatra, V., Schödl, A., Essa, I., Turk, G., & Bobick, A. (2003). Graphcut textures: Image and video synthesis using graph cuts. ACM Transactions on Graphics, 22(3), 277–286. https://doi.org/10.1145/882262.882264.
Liang, Q., Xiang, S., Hu, Y., Coppola, G., Zhang, D., & Sun, W. (2019). PD 2 SE-Net: Computer-assisted plant disease diagnosis and severity estimation network. Computers and Electronics in Agriculture, 157, 518–529. https://doi.org/10.1016/j.compag.2019.01.034.
Ma, J., Du, K., Zhang, L., Zheng, F., Chu, J., & Sun, Z. (2017). A segmentation method for greenhouse vegetable foliar disease spots images using color information and region growing. Computers and Electronics in Agriculture, 142, 110–117. https://doi.org/10.1016/j.compag.2017.08.023.
Meyer, F. (1994). Topographic distance and watershed lines. Signal Processing, 38, 113–125. https://doi.org/10.1016/0165-1684(94)90060-4.
Mondal, D., Kole, D. K., & Roy, K. (2017). Gradation of yellow mosaic virus disease of okra and bitter gourd based on entropy based binning and Naive Bayes classifier after identification of leaves. Computers and Electronics in Agriculture, 142, 485–493. https://doi.org/10.1016/j.compag.2017.11.024.
Ozguven, M. M., & Adem, K. (2019). Automatic detection and classification of leaf spot disease in sugar beet using deep learning algorithms. Physica A: Statistical Mechanics and its Applications, 535, 122537. https://doi.org/10.1016/j.physa.2019.122537.
Parikh, A., Raval, M. S., Parmar, C., & Chaudhary, S. (2016). Disease detection and severity estimation in cotton plant from unconstrained images. In Proceedings—3rd IEEE international conference on data science and advanced analytics, DSAA 2016, 594–601. https://doi.org/10.1109/DSAA.2016.81.
Rajendran, D. K., Park, E., Nagendran, R., Hung, N. B., Cho, B. K., Kim, K. H., & Lee, Y. H. (2016). Visual analysis for detection and quantification of Pseudomonas cichorii disease severity in tomato plants. Plant Pathology Journal, 32(4), 300–310. https://doi.org/10.5423/PPJ.OA.01.2016.0032.
Ratnasari, E. K., Mentari, M., Dewi, R. K., & Ginardi, R. V. H. (2014). Sugarcane leaf disease detection and severity estimation based on segmented spots image. In Proceedings of 2014 international conference on information, communication technology and system, ICTS 2014, 93–98. https://doi.org/10.1109/ICTS.2014.7010564.
Ronneberger, O., Fischer, P., & Brox, T. (2015). U-net: Convolutional networks for biomedical image segmentation. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 9351, 234–241. https://doi.org/10.1007/978-3-319-24574-4_28.
Rother, C., Kolmogorov, V., & Blake, A. (2004). GrabCut. ACM Transactions on Graphics, 23(3), 309–314. https://doi.org/10.1145/1015706.1015720.
Rother, H. A. (2018). Pesticide labels: Protecting liability or health?—Unpacking “misuse” of pesticides. Current Opinion in Environmental Science & Health, 4, 10–15. https://doi.org/10.1016/j.coesh.2018.02.004.
Sharif, M., Khan, M. A., Iqbal, Z., Azam, M. F., Lali, M. I. U., & Javed, M. Y. (2018). Detection and classification of citrus diseases in agriculture based on optimized weighted segmentation and feature selection. Computers and Electronics in Agriculture, 150, 220–234. https://doi.org/10.1016/j.compag.2018.04.023.
Singh, A. K., Ganapathysubramanian, B., Sarkar, S., & Singh, A. (2018). Deep learning for plant stress phenotyping: Trends and future perspectives. Trends in Plant Science, 23(10), 883–898. https://doi.org/10.1016/j.tplants.2018.07.004.
Taubin, G. (1991). Estimation of planar curves, surfaces, and nonplanar space curves defined by implicit equations with applications to edge and range image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 13(11), 1115–1138. https://doi.org/10.1109/34.103273.
Vazelhes, W.D., Carey, C., Tang, Y., Vauquier, N., & Bellet, A. (2019). metric-learn: Metric Learning Algorithms in Python. http://arxiv.org/abs/1908.04710.
Wang, G., Sun, Y., & Wang, J. (2017). Automatic image-based plant disease severity estimation using deep learning. Computational Intelligence and Neuroscience, 2017, 2917536. https://doi.org/10.1155/2017/2917536.
Wang, Y., Liu, S., Lu, Q., Xiong, F., Yang, Y., & Wang, X. (2019). Research progress and prospects of Colletotrichum species causing tea plant diseases in China. Journal of Plant Protection, 46(5), 954–963. https://doi.org/10.13802/j.cnki.zwbhxb.2019.2018165.
Weinberger, K. Q., & Saul, L. K. (2009). Distance metric learning for large margin nearest neighbor classification. Journal of Machine Learning Research, 10, 207–244. https://doi.org/10.1145/1577069.1577078.
Zuiderveld, K. (1994). Contrast limited adaptive histogram equalization. Graphics Gems. https://doi.org/10.1016/b978-0-12-336156-1.50061-6.
Funding
This work was supported in part by Major Natural Science Research Projects in Colleges and Universities of Anhui Province under Grant No. KJ2020ZD03, the National Natural Science Foundation of China under Grant Nos. 61672032, 31971789, and the Open Research Fund of National Engineering Research Center for Agro-Ecological Big Data Analysis & Application of Anhui University under Grant AE201902.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Hu, G., Wei, K., Zhang, Y. et al. Estimation of tea leaf blight severity in natural scene images. Precision Agric 22, 1239–1262 (2021). https://doi.org/10.1007/s11119-020-09782-8
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11119-020-09782-8