Computer vision technology in agricultural automation —A review
TL;DR: It is found that the existing technology can help the development of agricultural automation for small field farming to achieve the advantages of low cost, high efficiency and high precision, but there are still major challenges.
About: This article is published in Information Processing in Agriculture.The article was published on 2020-03-01 and is currently open access. It has received 228 citations till now.
Citations
More filters
TL;DR: In this paper, the authors present a systematic review of ML applications in the field of agriculture, focusing on prediction of soil parameters such as organic carbon and moisture content, crop yield prediction, disease and weed detection in crops and species detection.
Abstract: Agriculture plays a vital role in the economic growth of any country. With the increase of population, frequent changes in climatic conditions and limited resources, it becomes a challenging task to fulfil the food requirement of the present population. Precision agriculture also known as smart farming have emerged as an innovative tool to address current challenges in agricultural sustainability. The mechanism that drives this cutting edge technology is machine learning (ML). It gives the machine ability to learn without being explicitly programmed. ML together with IoT (Internet of Things) enabled farm machinery are key components of the next agriculture revolution. In this article, authors present a systematic review of ML applications in the field of agriculture. The areas that are focused are prediction of soil parameters such as organic carbon and moisture content, crop yield prediction, disease and weed detection in crops and species detection. ML with computer vision are reviewed for the classification of a different set of crop images in order to monitor the crop quality and yield assessment. This approach can be integrated for enhanced livestock production by predicting fertility patterns, diagnosing eating disorders, cattle behaviour based on ML models using data collected by collar sensors, etc. Intelligent irrigation which includes drip irrigation and intelligent harvesting techniques are also reviewed that reduces human labour to a great extent. This article demonstrates how knowledge-based agriculture can improve the sustainable productivity and quality of the product.
214 citations
TL;DR: The previous research and application of visual perception in different industrial fields such as product surface defect detection, intelligent agricultural production, intelligent driving, image synthesis, and event reconstruction are reviewed.
Abstract: Visual perception refers to the process of organizing, identifying, and interpreting visual information in environmental awareness and understanding. With the rapid progress of multimedia acquisition technology, research on visual perception has been a hot topic in the academical field and industrial applications. Especially after the introduction of artificial intelligence theory, intelligent visual perception has been widely used to promote the development of industrial production towards intelligence. In this article, we review the previous research and application of visual perception in different industrial fields such as product surface defect detection, intelligent agricultural production, intelligent driving, image synthesis, and event reconstruction. The applications basically cover most of the intelligent visual perception processing technologies. Through this survey, it will provide a comprehensive reference for research on this direction. Finally, this article also summarizes the current challenges of visual perception and predicts its future development trends.
127 citations
Cites background from "Computer vision technology in agric..."
...The agricultural production system faces many challenges [46], so we must seek to some efficient intelligent and information agricultural technologies, which save...
[...]
...crop disease and pest diagnosis and weed identification faster, cheaper, and nondestructive [46]....
[...]
TL;DR: In this paper, a study aimed at identifying industry 4.0 neologisms and illustrating the convergence of 12 disruptive technologies including 3D printing, artificial intelligence, augmented reality, big data, blockchain, cloud computing, drones, Internet of Things, nanotechnology, robotics, simulation, and synthetic biology in agriculture, healthcare, and logistics industries was illustrated.
Abstract: Very well into the dawn of the fourth industrial revolution (industry 4.0), humankind can hardly distinguish between what is artificial and what is natural (e.g., man-made virus and natural virus). Thus, the level of discombobulation among people, companies, or countries is indeed unprecedented. The fact that industry 4.0 is explosively disrupting or retrofitting each and every industrial sector makes industry 4.0 the famous buzzword amongst researchers today. However, the insight of industry 4.0 disruption into the industrial sectors remains ill-defined in both academic and nonacademic literature. The present study aimed at identifying industry 4.0 neologisms, understanding the industry 4.0 disruption and illustrating the disruptive technology convergence in the major industrial sectors. A total of 99 neologisms of industry 4.0 were identified. Industry 4.0 disruption in the education industry (education 4.0), energy industry (energy 4.0), agriculture industry (agriculture 4.0), healthcare industry (healthcare 4.0), and logistics industry (logistics 4.0) was described. The convergence of 12 disruptive technologies including 3D printing, artificial intelligence, augmented reality, big data, blockchain, cloud computing, drones, Internet of Things, nanotechnology, robotics, simulation, and synthetic biology in agriculture, healthcare, and logistics industries was illustrated. The study divulged the need for extensive research to expand the application areas of the disruptive technologies in the industrial sectors.
77 citations
TL;DR: In this article, the role of information and communication technology (ICT) in agri-food supply chain and determines the impact of supply chain management (SCM) practices on firm performance.
Abstract: This paper presents the concerns in agri-food supply chain. Further the research investigates the role of information and communication technology (ICT) in agri-food supply chain and determines the impact of supply chain management (SCM) practices on firm performance.,The theoretical framework was proposed for the study on the basis of existing literature. Data for the study was collected with the help of structured questionnaire from 121 executives and officers of the public food distribution agency. Partial least square (PLS)–structured equation modeling was employed to test the framework and hypotheses.,The results indicate that ICT and SCM practices (logistics integration and supplier relationships) have a significant relationship. Furthermore, SCM practices (information sharing, supplier relationship and logistics integration) have a significant and positive impact on performance of the organization.,Further research could be carried out to test the moderation effect of SCM practices between ICT and organizational performance (OP). Extending the research study to the companies operating in other sectors can enhance the external validity of the study and improve the accuracy of parameters examined.,This study can be of interest to the agri-food industry as well as other industry practitioners interested in improving the performance of the organization from the view of supply chain.,The outcomes of this study have important implications that translate into a series of recommendations for the management of public food distribution as well as other agri-food-based supply chains.
70 citations
TL;DR: A dual-arm aubergine harvesting robot consisting of two robotic arms configured in an anthropomorphic manner to optimize the dual workspace is presented, which enables the simultaneous harvesting of two aubergines and a collaborative behavior between the arms to solve occlusions.
Abstract: Interest in agricultural automation has increased considerably in recent decades due to benefits such as improving productivity or reducing the labor force. However, there are some current problems associated with unstructured environments make developing a robotic harvester a challenge. This article presents a dual-arm aubergine harvesting robot consisting of two robotic arms configured in an anthropomorphic manner to optimize the dual workspace. To detect and locate the aubergines automatically, we implemented an algorithm based on a support vector machine (SVM) classifier and designed a planning algorithm for scheduling efficient fruit harvesting that coordinates the two arms throughout the harvesting process. Finally, we propose a novel algorithm for dealing with occlusions using the capabilities of the dual-arm robot for coordinate work. Therefore, the main contribution of this study is the implementation and validation of a dual-arm harvesting robot with planning and control algorithms, which, depending on the locations of the fruits and the configuration of the arms, enables the following: (i) the simultaneous harvesting of two aubergines; (ii) the harvesting of a single aubergine with a single arm; or (iii) a collaborative behavior between the arms to solve occlusions. This cooperative operation mimics complex human harvesting motions such as using one arm to push leaves aside while the other arm picks the fruit. The performance of the proposed harvester is evaluated through laboratory tests that simulate the most common real-world scenarios. The results show that the robotic harvester has a success rate of 91.67% and an average cycle time of 26 s/fruit.
68 citations
Cites background from "Computer vision technology in agric..."
...A broad overview of the development of vision technology applied in precision agriculture applications was compiled by [2]–[5]....
[...]
References
More filters
TL;DR: A comprehensive review of research dedicated to applications of machine learning in agricultural production systems is presented, demonstrating how agriculture will benefit from machine learning technologies.
Abstract: Machine learning has emerged with big data technologies and high-performance computing to create new opportunities for data intensive science in the multi-disciplinary agri-technologies domain. In this paper, we present a comprehensive review of research dedicated to applications of machine learning in agricultural production systems. The works analyzed were categorized in (a) crop management, including applications on yield prediction, disease detection, weed detection crop quality, and species recognition; (b) livestock management, including applications on animal welfare and livestock production; (c) water management; and (d) soil management. The filtering and classification of the presented articles demonstrate how agriculture will benefit from machine learning technologies. By applying machine learning to sensor data, farm management systems are evolving into real time artificial intelligence enabled programs that provide rich recommendations and insights for farmer decision support and action.
1,262 citations
TL;DR: A survey including hyperspectral sensors, inherent data processing and applications focusing both on agriculture and forestry—wherein the combination of UAV and hyperspectrals plays a center role—is presented in this paper.
Abstract: Traditional imagery—provided, for example, by RGB and/or NIR sensors—has proven to be useful in many agroforestry applications. However, it lacks the spectral range and precision to profile materials and organisms that only hyperspectral sensors can provide. This kind of high-resolution spectroscopy was firstly used in satellites and later in manned aircraft, which are significantly expensive platforms and extremely restrictive due to availability limitations and/or complex logistics. More recently, UAS have emerged as a very popular and cost-effective remote sensing technology, composed of aerial platforms capable of carrying small-sized and lightweight sensors. Meanwhile, hyperspectral technology developments have been consistently resulting in smaller and lighter sensors that can currently be integrated in UAS for either scientific or commercial purposes. The hyperspectral sensors’ ability for measuring hundreds of bands raises complexity when considering the sheer quantity of acquired data, whose usefulness depends on both calibration and corrective tasks occurring in pre- and post-flight stages. Further steps regarding hyperspectral data processing must be performed towards the retrieval of relevant information, which provides the true benefits for assertive interventions in agricultural crops and forested areas. Considering the aforementioned topics and the goal of providing a global view focused on hyperspectral-based remote sensing supported by UAV platforms, a survey including hyperspectral sensors, inherent data processing and applications focusing both on agriculture and forestry—wherein the combination of UAV and hyperspectral sensors plays a center role—is presented in this paper. Firstly, the advantages of hyperspectral data over RGB imagery and multispectral data are highlighted. Then, hyperspectral acquisition devices are addressed, including sensor types, acquisition modes and UAV-compatible sensors that can be used for both research and commercial purposes. Pre-flight operations and post-flight pre-processing are pointed out as necessary to ensure the usefulness of hyperspectral data for further processing towards the retrieval of conclusive information. With the goal of simplifying hyperspectral data processing—by isolating the common user from the processes’ mathematical complexity—several available toolboxes that allow a direct access to level-one hyperspectral data are presented. Moreover, research works focusing the symbiosis between UAV-hyperspectral for agriculture and forestry applications are reviewed, just before the paper’s conclusions.
736 citations
TL;DR: This work presents a systematic review that aims to identify the applicability of computer vision in precision agriculture for the production of the five most produced grains in the world: maize, rice, wheat, soybean, and barley.
481 citations
TL;DR: This review focuses on the fundamentals of hyperspectral image analysis and its modern applications such as food quality and safety assessment, medical diagnosis and image guided surgery, forensic document examination, defense and homeland security, remote sensing applicationssuch as precision agriculture and water resource management and material identification and mapping of artworks.
Abstract: Over the past three decades, significant developments have been made in hyperspectral imaging due to which it has emerged as an effective tool in numerous civil, environmental, and military applications. Modern sensor technologies are capable of covering large surfaces of earth with exceptional spatial, spectral, and temporal resolutions. Due to these features, hyperspectral imaging has been effectively used in numerous remote sensing applications requiring estimation of physical parameters of many complex surfaces and identification of visually similar materials having fine spectral signatures. In the recent years, ground based hyperspectral imaging has gained immense interest in the research on electronic imaging for food inspection, forensic science, medical surgery and diagnosis, and military applications. This review focuses on the fundamentals of hyperspectral image analysis and its modern applications such as food quality and safety assessment, medical diagnosis and image guided surgery, forensic document examination, defense and homeland security, remote sensing applications such as precision agriculture and water resource management and material identification and mapping of artworks. Moreover, recent research on the use of hyperspectral imaging for examination of forgery detection in questioned documents, aided by deep learning, is also presented. This review can be a useful baseline for future research in hyperspectral image analysis.
440 citations
TL;DR: The best model is the deep VGG16 model trained with transfer learning, which yields an overall accuracy of 90.4% on the hold-out test set.
Abstract: Automatic and accurate estimation of disease severity is essential for food security, disease management, and yield loss prediction. Deep learning, the latest breakthrough in computer vision, is promising for fine-grained disease severity classification, as the method avoids the labor-intensive feature engineering and threshold-based segmentation. Using the apple black rot images in the PlantVillage dataset, which are further annotated by botanists with four severity stages as ground truth, a series of deep convolutional neural networks are trained to diagnose the severity of the disease. The performances of shallow networks trained from scratch and deep models fine-tuned by transfer learning are evaluated systemically in this paper. The best model is the deep VGG16 model trained with transfer learning, which yields an overall accuracy of 90.4% on the hold-out test set. The proposed deep learning model may have great potential in disease control for modern agriculture.
412 citations