Elsevier

Neurocomputing

Volume 267, 6 December 2017, Pages 378-384
Neurocomputing

Identification of rice diseases using deep convolutional neural networks

https://doi.org/10.1016/j.neucom.2017.06.023Get rights and content

Abstract

The automatic identification and diagnosis of rice diseases are highly desired in the field of agricultural information. Deep learning is a hot research topic in pattern recognition and machine learning at present, it can effectively solve these problems in vegetable pathology. In this study, we propose a novel rice diseases identification method based on deep convolutional neural networks (CNNs) techniques. Using a dataset of 500 natural images of diseased and healthy rice leaves and stems captured from rice experimental field, CNNs are trained to identify 10 common rice diseases. Under the 10-fold cross-validation strategy, the proposed CNNs-based model achieves an accuracy of 95.48%. This accuracy is much higher than conventional machine learning model. The simulation results for the identification of rice diseases show the feasibility and effectiveness of the proposed method.

Introduction

Rice is one of the most important food crops in China and even in the world. Rice diseases have a devastating effect on rice production. Also, it is a major threat to food security. Thus, the diagnosis and identification of rice diseases play a very important role in ensuring the high yield, high quality and high efficiency of rice. The traditional method of detecting rice diseases requires lots of experts’ experience and knowledge. With the development of computer and internet technology, farmers can search the rice diseases images database or consult the plant pathologists to judge rice diseases remotely. The disadvantage is that not only the judgement is easy to be wrong, but also the efficiency is low.

In order to improve the accuracy and rapidity of the diagnosis results, many researchers have studied the automated rice diseases diagnosis based on pattern recognition and machine learning. Such as, using pattern recognition techniques [25], support vector machine [16], digital image processing techniques [2] and computer vision[1]. Meanwhile, these advanced techniques are not only applied to the diagnosis of rice diseases, but also to other crops, such as wheat [20], maize [34], cotton [29], tomato [5], etc.

The past 10 years have witnessed successful applications of deep convolutional neural networks (CNNs) in diverse fields including image classification [6], [21], video classification [18], traffic sign recognition [17] and human action recognition [15], etc. The study of CNNs and related research have therefore gained persistent research interest since the early 1990s, see [10], [12] and the references therein. During this period, Hinton and co-workers have done widely meaningful and fundamental research on deep neural network to improve algorithm performance and optimize architecture, see e.g. [3], [23], [24], [27], and the references cited. A number of research have been made for CNNs to improve the original architecture of Krizhevsky et al. [21]. For example, Zeiler and Fergus [33] used stochastic pooling for regulation of CNNs and Simonyan and Zisserman [31] proposed very deep CNNs to 16–19 layers, which achieved the state-of-art accuracy on ImageNet Large-Scale Visual Recognition Challenge (ILSVRC) [26]. Especially, in March 2016, AlphaGo beat Lee Sedol in a five-game match, the first time a computer Go program has beaten a 9-dan professional, and it was a major milestone in artificial intelligence research [30], [32]. LeCun et al. pointed out that deep convolutional neural networks have brought about breakthroughs in processing images, video, speech and audio in a survey paper published in Nature in 2015 [22].

Recently, several studies on automated plant disease diagnosis have been conducted using deep learning techniques [19], [35]. Kawasaki et al. proposed a system based on CNNs to recognize cucumber leaf disease; it achieves an accuracy of 94.9% in distinguishing among melon yellow spot virus, zucchini yellow mosaic virus and a non-diseased class. Sanyal et al. have identified rice disease of brown spot and blast diseases by using color texture of rice leaf images [28].

As we all know that the machine learning technology is essential in the intelligent diagnosis of crop diseases. However, there exist some defects and difficulties in the above research, involving the recognition rate is higher for specific samples under certain circumstances. In the diagnosis model, some parameters are not optimal, the convergence speed of training algorithm is slow, and it is easy to fall into local minima, and so on.

So far, no research has been published which explores deep convolutional neural networks for rice diseases identification. The goal of this research is to construct deep convolutional networks model to achieve fast and accurate automated recognition by using rice diseases images. The 10 common rice diseases include rice blast (RB), rice false smut (RFS), rice brown spot (RBS), rice bakanae disease (RBD), rice sheath blight (RSHB), rice sheath rot (RSR), rice bacterial leaf blight (RBLB), rice bacterial sheath rot (RBSR), rice seeding blight (RSEB) and rice bacterial wilt (RBW).

The key motivation for developing the deep convolutional networks model for rice disease is to provide the farmers an easy-to-use system to detect early-stage infections by using common digital camera. Second, extracting effective features for identifying rice diseases is a critical but challenging task, and CNNs are highly expected to be automated feature learning from the raw inputs in a systematic way. Through the deep architecture, the learned features are deemed as the higher level abstract representation of low level raw rice disease images. In addition, to improve diagnostic results, the CNNs is regarded as one of the best classifications in pattern recognition tasks. So we develop the deep convolutional neural networks model for rice diseases identification in this paper.

In this paper, we present a novel rice diseases identification method based on deep convolutional neural networks. The proposed CNNs-based model can get higher classification ratio. On the basis of an analysis of structure and parameters in CNNs, the gradient-descent algorithm can be applied to train CNNs. A total of 500 rice leaves and stem images are pre-processed first, then the processed images are used to train CNNs. This CNNs model can improve the convergence speed while training the parameters in CNNs, and obtain a higher recognition accuracy than the conventional model. The main contribution of this paper is mainly twofold. (1) Convolutional neural network is first applied to the issue of the identification of rice diseases. Note that the proposed method can correctly and effectively recognize the 10 common rice diseases. (2) Experiment results show that the CNNs method can not only improve the convergence speed, but also obtain a higher recognition accuracy than other models: (1) standard BP algorithm; (2) support vector machine (SVM); (3) particle swarm optimization (PSO).

The advantages of the proposed CNNs are that images can be input directly to the model. First, sparse-auto encoding is used to learn the features from images. Second, we can classify images from a reduced data set applying convolution and pooling. The stochastic pooling method is applied in the proposed CNNs model. For it is simple enough to randomly select elements in feature map according to their probability values, that is, the elements with large probability are easy to be chosen. Unlike max-pooling, the maximum element always chosen, and mean-pooling, the average value of the elements is chosen. Also, it strengthened generalization ability of the proposed CNNs model. Third, softmax regression learning algorithm can solve multi-classification problem. Finally, we can distinguish between 10 common different rice diseases.

The remainder of this paper is organized as follows. In Section 2, we describe the architecture and learning algorithm of CNNs. Section 3 introduces the rice disease identification method. The application of the developed CNNs to the problem of rice diseases recognition is presented in Section 4. Conclusions are given in Section 5.

Section snippets

Architecture of deep convolutional neural networks model

Inspired by classical and successful LeNet-5, AlexNet CNNs architecture and its performance improved by Ciresan et al. [6], Krizhevsky et al. [21] and LeCun et al. [23], we describe a kind of our multi-stage-CNNs configuration. The CNNs-based model includes convolution layer, stochastic pooling layer, and softmax layer. An illustration and related parameters are shown in Fig. 1 and Table 1.

The size of the input image is set to be 224 × 224 × 3 according to the experience, which can be divided

Rice diseases images data acquisition and processing software

Rice diseases images database is created, which consists of a total of 500 rice diseases images. Some images of rice diseases are captured from Heilongjiang Academy of Land Reclamation Sciences, China. The dataset consists of 500 common rice disease images. The 10 common rice diseases include rice blast (RB), rice false smut (RFS), rice brown spot (RBS), rice bakanae disease (RBD), rice sheath blight (RSHB), rice sheath rot (RSR), rice bacterial leaf blight (RBLB), rice bacterial sheath rot

Rice disease recognition simulation examples

The proposed CNNs model is applied to rice disease recognition problem. We use database of 500 images labeled of 10 kinds of rice diseases. One of the rice disease images is shown in Fig. 3.

Randomly select 10,000 12 × 12 patches from the 500 natural images, according to the pre-processing procedure introduced in Section 3.2, we get one of the rice disease image patches as shown in Fig. 4 and the corresponding feature map is shown in Fig. 5.

Before training, we need to normalize the brightness

Conclusions

CNNs is a valuable pattern-recognition method both in theory and in application. In this paper, we proposed an innovative technique to enhance the deep learning ability of CNNs. The proposed CNNs-based model can effectively classify 10 common rice diseases through images recognition. The application to the rice disease identification shows that the proposed CNNs model can correctly and effectively recognize rice diseases through image recognition. Compared with the other model, the proposed

Yang Lu received his M.S. and Ph.D. degrees from Northeast Petroleum University in Computer Application in 2005 and Oil and Gas Engineering in 2013, respectively. Now he is an associate professor at Heilongjiang Bayi Agricultural University. His research interests include machine learning and pattern recognition, computer vision and neural network.

References (36)

  • H. Dong et al.

    Event-triggered robust distributed state estimation for sensor networks with state-dependent noises

    Int. J. Gen. Syst.

    (2015)
  • H. Dong et al.

    Event-based h filter design for a class of nonlinear time-varying systems with fading channels and multiplicative noises

    IEEE Trans. Signal Process.

    (2015)
  • H. Dong et al.

    On h estimation of randomly occurring faults for a class of nonlinear time-varying systems with fading channels

    IEEE Trans. Autom. Control

    (2016)
  • G.E. Hinton

    A practical guide to training restricted Boltzmann machines

    Momentum

    (2012)
  • S. Ji et al.

    3D convolutional neural networks for human action recognition

    IEEE Trans. Pattern Anal. Mach. Intell.

    (2013)
  • Z. Jian et al.

    Support vector machine for recognition of cucumber leaf diseases

    Proceedings of the International Conference on Advanced Computer Control (ICACC), Patiala, India

    (2010)
  • J. Jin et al.

    Traffic sign recognition with hinge loss trained convolutional neural networks

    IEEE Trans. Intell. Transp. Syst.

    (2014)
  • A. Karpathy et al.

    Large-scale video classification with convolutional neural networks

    Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, USA

    (2014)
  • Cited by (0)

    Yang Lu received his M.S. and Ph.D. degrees from Northeast Petroleum University in Computer Application in 2005 and Oil and Gas Engineering in 2013, respectively. Now he is an associate professor at Heilongjiang Bayi Agricultural University. His research interests include machine learning and pattern recognition, computer vision and neural network.

    Shujuan Yi received her M.S. degree in Heilongjiang Bayi Agricultural University in 1990 and the Ph.D. degree in Agricultural Mechanization and Automation in Northeast Agricultural University in 2008. Now she is a professor at Heilongjiang Bayi Agricultural University. Her research interests include control of complex systems, automation and agricultural mechanization.

    Nianyin Zeng was born in Fujian Province, China, in 1986. He received the B.Eng. degree in electrical engineering and automation in 2008 and the Ph.D. degree in electrical engineering in 2013, both from Fuzhou University, Fuzhou, China. From October 2012 to March 2013, he was a research assistant in the Department of Electrical and Electronic Engineering, the University of Hong Kong, Hong Kong. Dr. Zeng is currently an assistant professor in the Department of Instrumental and Electrical Engineering at Xiamen University, China. He is the author or coauthor of several technical papers and also a very active reviewer for many international journals. His current research interests include nonlinear filtering, time-series modeling, and bioinformatics.

    Yurong Liu received his B.Sc. degree in Mathematics from Suzhou University, Suzhou, China, in 1986, the M.Sc. degree in Applied Mathematics from Nanjing University of Science and Technology, Nanjing, China, in 1989, and the Ph.D. degree in Applied Mathematics from Suzhou University, Suzhou, China, in 2000. Dr. Liu is currently a professor in the Department of Mathematics at Yangzhou University, China. He has published more than 50 papers in refereed international journals. His current interests include neural networks, complex networks, nonlinear dynamics, time-delay systems, multiagent systems, and chaotic dynamics.

    Yong Zhang received his M.S. degree in Signal and System Processing from Harbin Engineering University in 2011. Now he is an associate professor at Northeast Petroleum University and he is currently pursuing the Ph.D. degree in Chemical Engineering and Technology in Northeast Petroleum University. His research interests include deep learning, neural networks and intelligent instrument.

    This work was supported in part by the National Natural Science Foundation of China under grants 61374127 and 61422301, the Outstanding Youth Science Foundation of Heilongjiang Province under grant JC2015016, the Natural Science Foundation of Heilongjiang Province under grant F201428, the Science and Technology Research of Agricultural Bureau in Heilongjiang Province under grant HNK125B-04-03, China Postdoctoral Science Foundation under grant 2016M591560, Heilongjiang Postdoctoral Financial Assistance under grant LBH-Z15185, Heilongjiang Bayi Agricultural University Foundation under grant XA2016-05 and Fujian Provincial Key Laboratory of Information Processing and Intelligent Control (Minjiang University) Opening Fund under grant MJUKF201729.

    View full text