A Review on Agricultural Advancement Based on Computer Vision and Machine Learning
01 Jan 2020-pp 567-581
TL;DR: This review paper gives an overview of machine learning and computer vision techniques which are inherently associated with this domain and tries to give an analysis, which can help researchers to look at some relevant problems in the context of India.
Abstract: The importance of agriculture in modern society need not be overstated. In order to meet the huge requirements of food and to mitigate, the conventional problems of cropping smart and sustainable agriculture have emerged over the conventional agriculture. From computational perspective, computer vision and machine learning techniques have been applied in many aspects of human and social life, and agriculture is not also an exception. This review paper gives an overview of machine learning and computer vision techniques which are inherently associated with this domain. A summary of the works highlighting different seeds, crops, fruits with the country is also enclosed. The paper also tries to give an analysis, which can help researchers to look at some relevant problems in the context of India.
Citations
More filters
TL;DR: The purpose of this review is to summarize the progress made on automatic traps with a particular focus on camera-equipped traps to support the use of software and image recognition algorithms to identify and/or count insect species from pictures.
Abstract: Integrated pest management relies on insect pest monitoring to support the decision of counteracting a given level of infestation and to select the adequate control method. The classic monitoring approach of insect pests is based on placing in single infested areas a series of traps that are checked by human operators on a temporal basis. This strategy requires high labor cost and provides poor spatial and temporal resolution achievable by single operators. The adoption of image sensors to monitor insect pests can result in several practical advantages. The purpose of this review is to summarize the progress made on automatic traps with a particular focus on camera-equipped traps. The use of software and image recognition algorithms can support automatic trap usage to identify and/or count insect species from pictures. Considering the high image resolution achievable and the opportunity to exploit data transfer systems through wireless technology, it is possible to have remote control of insect captures, limiting field visits. The availability of real-time and on-line pest monitoring systems from a distant location opens the opportunity for measuring insect population dynamics constantly and simultaneously in a large number of traps with a limited human labor requirement. The actual limitations are the high cost, the low power autonomy and the low picture quality of some prototypes together with the need for further improvements in fully automated pest detection. Limits and benefits resulting from several case studies are examined with a perspective for the future development of technology-driven insect pest monitoring and management.
71 citations
TL;DR: A robust plant disease classification system is introduced by introducing a Custom CenterNet framework with DenseNet-77 as a base network and is more proficient and reliable to identify and classify plant diseases than other latest approaches.
Abstract: The agricultural production rate plays a pivotal role in the economic development of a country. However, plant diseases are the most significant impediment to the production and quality of food. The identification of plant diseases at an early stage is crucial for global health and wellbeing. The traditional diagnosis process involves visual assessment of an individual plant by a pathologist through on-site visits. However, manual examination for crop diseases is restricted because of less accuracy and the small accessibility of human resources. To tackle such issues, there is a demand to design automated approaches capable of efficiently detecting and categorizing numerous plant diseases. Precise identification and classification of plant diseases is a tedious job due because of the occurrence of low-intensity information in the image background and foreground, the huge color resemblance in the healthy and diseased plant areas, the occurrence of noise in the samples, and changes in the position, chrominance, structure, and size of plant leaves. To tackle the above-mentioned problems, we have introduced a robust plant disease classification system by introducing a Custom CenterNet framework with DenseNet-77 as a base network. The presented method follows three steps. In the first step, annotations are developed to get the region of interest. Secondly, an improved CenterNet is introduced in which DenseNet-77 is proposed for deep keypoints extraction. Finally, the one-stage detector CenterNet is used to detect and categorize several plant diseases. To conduct the performance analysis, we have used the PlantVillage Kaggle database, which is the standard dataset for plant diseases and challenges in terms of intensity variations, color changes, and differences found in the shapes and sizes of leaves. Both the qualitative and quantitative analysis confirms that the presented method is more proficient and reliable to identify and classify plant diseases than other latest approaches.
59 citations
10 Sep 2019
TL;DR: The present article deals with the above-mentioned method of deep learning, and especially with its application when recognizing certain objects and elements during the visual product inspection.
Abstract: Nowadays, when high industrial productivity is connected with high quality and low product faults, it is common practice to use 100% product quality control. Since the quantities of products are high in mass production and inspection time must be as low as possible, the solution may be to use visual inspection of finished parts via camera systems and subsequent image processing using artificial intelligence. Recently, deep learning has shown itself to be the most appropriate and effective method for this purpose. The present article deals with the above-mentioned method of deep learning, and especially with its application when recognizing certain objects and elements during the visual product inspection.
19 citations
TL;DR: In this article, a review summarizes the recent application of rapid and nondestructive optical imaging and spectroscopic techniques, including digital color imaging, X-ray imaging, near-infrared spectroscopy, fluorescent, multispectral, and hyperspectral imaging.
Abstract: Cereal grains and nuts are represented as the economic backbone of many developed and developing countries. Kernels of cereal grains and nuts are prone to mold infection under high relative humidity and suitable temperature conditions in the field as well as storage conditions. Health risks caused by molds and their molecular metabolite mycotoxins are, therefore, important topics to investigate. Strict regulations have been developed by international trade regulatory bodies for the detection of mold growth and mycotoxin contamination across the food chain starting from the harvest to storage and consumption. Molds and aflatoxins are not evenly distributed over the bulk of grains, thus appropriate sampling for detection and quantification is crucial. Existing reference methods for mold and mycotoxin detection are destructive in nature as well as involve skilled labor and hazardous chemicals. Also, these methods cannot be used for inline sorting of the infected kernels. Thus, analytical methods have been extensively researched to develop the one that is more practical to be used in commercial detection and sorting processes. Among various analytical techniques, optical imaging and spectroscopic techniques are attracting growers' attention for their potential of nondestructive and rapid inline identification and quantification of molds and mycotoxins in various food products. This review summarizes the recent application of rapid and nondestructive optical imaging and spectroscopic techniques, including digital color imaging, X-ray imaging, near-infrared spectroscopy, fluorescent, multispectral, and hyperspectral imaging. Advance chemometric techniques to identify very low-level mold growth and mycotoxin contamination are also discussed. Benefits, limitations, and challenges of deploying these techniques in practice are also presented in this paper.
17 citations
TL;DR: A new method to rapidly assess the severity of FHB and evaluate the efficacy of fungicide application programs and the results show that the segmentation algorithm could segment wheat ears from a complex field background and the counting algorithm could effectively solve the problem of wheat ear adhesion and occlusion.
Abstract: Fusarium head blight (FHB) is one of the most important diseases in wheat worldwide. Evaluation and identification of effective fungicides are essential for control of FHB. However, traditional methods based on the manual disease severity assessment to evaluate the efficacy of fungicides are time-consuming and laborsome. In this study, we developed a new method to rapidly assess the severity of FHB and evaluate the efficacy of fungicide application programs. Enhanced red-green-green (RGG) images were processed from acquired raw red-green-blue (RGB) images of wheat ear samples; the images were transformed in color spaces through K-means clustering for rough segmentation of wheat ears; a random forest classifier was used with features of color, texture, geometry and vegetation index for fine segmentation of disease spots in wheat ears; a newly proposed width mutation counting algorithm was used to count wheat ears; and the disease severity of the wheat ears groups was graded and the efficacy of six fungicides was evaluated. The results show that the segmentation algorithm could segment wheat ears from a complex field background. And the counting algorithm could effectively solve the problem of wheat ear adhesion and occlusion. The average counting accuracy of all and diseased wheat ears were 93.00% and 92.64%, respectively, with the coefficients of determination (R
2
) of 0.90 and 0.98, and the root mean square error (RMSE) of 10.56 and 7.52, respectively. The new method could accurately assess the diseased levels of wheat eat groups infected by FHB and determine the efficacy of the six fungicides evaluated. The results demonstrate a potential of using digital imaging technology to evaluate and identify effective fungicides for control of the FHB disease in wheat and other crop diseases.
16 citations
Additional excerpts
...Through literature research it was found that image processing alone and its integration with machine learning are commonly used to achieve the two steps [12]–[14]....
[...]
References
More filters
06 Jun 2011
TL;DR: This contribution evaluates supervised methods to predict the plant's nutrition state by classification and whether they are robust towards dominant sources of data variation like leaf age or intra-leaf pixel position which are irrelevant for the task at hand.
Abstract: Hyperspectral imaging of crop plants offers the means for a non-invasive, precise and high-throughput plant-phenotyping in plant research and precision agriculture. We already reported the successful separation of spectral signatures by means of unsupervised learning (e.g. clustering) of tobacco leaves grown from different genetic background and under different nutritional conditions [1,2]. In this contribution we evaluate supervised methods to predict the plant's nutrition state by classification and whether they are robust towards dominant sources of data variation like leaf age or intra-leaf pixel position which are irrelevant for the task at hand. Support Vector Machine (SVM)[3], Supervised Relevance Neural Gas (SRNG) [4], Generalized Relevance Learning Vector Quantization (GRLVQ) [5] and a Radial Basis Function (RBF) Network [6] adopted to perform relevance learning as well were tested. Leaf age snowed the largest impact on classification performance, where SVM and RBF produced robust results while SRNG and GRLVQ methods were reduced to near guessing level. Three cameras covering the VIS/SWIR range were tested and relevance of spectral bands towards nutrition prediction were calculated.
28 citations
TL;DR: In this paper, a technique using computer vision to detect disease stress in wheat was presented, where images of differentially stressed wheat were segmented into soil and vegetation pixels using expectation maximization (EM).
Abstract: Knowledge of crop abiotic and biotic stress is important for optimal irrigation management. While spectral reflectance and infrared thermometry provide a means to quantify crop stress remotely, these measurements can be cumbersome. Computer vision offers an inexpensive way to remotely detect crop stress independent of vegetation cover. This paper presents a technique using computer vision to detect disease stress in wheat. Digital images of differentially stressed wheat were segmented into soil and vegetation pixels using expectation maximization (EM). In the first season, the algorithm to segment vegetation from soil and distinguish between healthy and stressed wheat was developed and tested using digital images taken in the field and later processed on a desktop computer. In the second season, a wireless camera with near real-time computer vision capabilities was tested in conjunction with the conventional camera and desktop computer. For wheat irrigated at different levels and inoculated with wheat streak mosaic virus (WSMV), vegetation hue determined by the EM algorithm showed significant effects from irrigation level and infection. Unstressed wheat had a higher hue (118.32) than stressed wheat (111.34). In the second season, the hue and cover measured by the wireless computer vision sensor showed significant effects from infection (p = 0.0014), as did the conventional camera (p < 0.0001). Vegetation hue obtained through a wireless computer vision system in this study is a viable option for determining biotic crop stress in irrigation scheduling. Such a low-cost system could be suitable for use in the field in automated irrigation scheduling applications.
24 citations
TL;DR: This paper exploits the power of deep CNNs for joint feature and classifier learning, within an automatic phenotyping scheme for genotype classification, and demonstrates that temporal information further improves the performance of the phenotype classification system.
Abstract: High resolution and high throughput, genotype to phenotype studies in plants are underway to accelerate breeding of climate ready crops. Complex developmental phenotypes are observed by imaging a variety of accessions in different environment conditions, however extracting the genetically heritable traits is challenging. In the recent years, deep learning techniques and in particular Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs) and Long-Short Term Memories (LSTMs), have shown great success in visual data recognition, classification, and sequence learning tasks. In this paper, we proposed a CNN-LSTM framework for plant classification of various genotypes. Here, we exploit the power of deep CNNs for joint feature and classifier learning, within an automatic phenotyping scheme for genotype classification. Further, plant growth variation over time is also important in phenotyping their dynamic behavior. This was fed into the deep learning framework using LSTMs to model these temporal cues for different plant accessions. We generated a replicated dataset of four accessions of Arabidopsis and carried out automated phenotyping experiments. The results provide evidence of the benefits of our approach over using traditional hand-crafted image analysis features and other genotype classification frameworks. We also demonstrate that temporal information further improves the performance of the phenotype classification system.
21 citations
19 citations
01 Jan 2015
TL;DR: In this article, a survey of application of image processing in agriculture field such as imaging techniques for Crop Management, nutrient deficiencies detection, weed detection and fruit grading is presented. And the analysis of the parameters has proved to be accurate and less time consuming as compared to traditional methods.
Abstract: Image processing has been proved to be effective tool for analysis in various fields and applications of an agriculture sector. Types of imaging techniques such as thermal imaging, fluorescence imaging, hyper spectral imaging, and photometric (RGB) feature-based imaging have contributed significantly. Image processing along with availability of communication network can change the situation of getting the expert advice well within time and at affordable cost since image processing was the effective tool for analysis of parameters. This paper intends to focus on the survey of application of image processing in agriculture field such as imaging techniques for Crop Management, nutrient deficiencies detection, weed detection and fruit grading. The analysis of the parameters has proved to be accurate and less time consuming as compared to traditional methods.
14 citations