Mapping Crop Types in Southeast India with Smartphone Crowdsourcing and Deep Learning
Sherrie Wang,Stefania Di Tommaso,Joey Faulkner,Thomas Friedel,Alexander Kennepohl,Rob Strey,David B. Lobell +6 more
TLDR
This work explores the use of crowdsourced data, Sentinel-2 and DigitalGlobe imagery, and convolutional neural networks (CNNs) for crop type mapping in India, and illustrates the potential of non-traditional, high-volume/high-noise datasets forcrop type mapping, some improvements that neural networks can achieve over random forests, and the robustness of such methods against moderate levels of training set noise.Abstract:
High resolution satellite imagery and modern machine learning methods hold the potential to fill existing data gaps in where crops are grown around the world at a sub-field level. However, high resolution crop type maps have remained challenging to create in developing regions due to a lack of ground truth labels for model development. In this work, we explore the use of crowdsourced data, Sentinel-2 and DigitalGlobe imagery, and convolutional neural networks (CNNs) for crop type mapping in India. Plantix, a free app that uses image recognition to help farmers diagnose crop diseases, logged 9 million geolocated photos from 2017–2019 in India, 2 million of which are in the states of Andhra Pradesh and Telangana in India. Crop type labels based on farmer-submitted images were added by domain experts and deep CNNs. The resulting dataset of crop type at coordinates is high in volume, but also high in noise due to location inaccuracies, submissions from out-of-field, and labeling errors. We employed a number of steps to clean the dataset, which included training a CNN on very high resolution DigitalGlobe imagery to filter for points that are within a crop field. With this cleaned dataset, we extracted Sentinel time series at each point and trained another CNN to predict the crop type at each pixel. When evaluated on the highest quality subset of crowdsourced data, the CNN distinguishes rice, cotton, and “other” crops with 74% accuracy in a 3-way classification and outperforms a random forest trained on harmonic regression features. Furthermore, model performance remains stable when low quality points are introduced into the training set. Our results illustrate the potential of non-traditional, high-volume/high-noise datasets for crop type mapping, some improvements that neural networks can achieve over random forests, and the robustness of such methods against moderate levels of training set noise. Lastly, we caution that obstacles like the lack of good Sentinel-2 cloud mask, imperfect mobile device location accuracy, and preservation of privacy while improving data access will need to be addressed before crowdsourcing can widely and reliably be used to map crops in smallholder systems.read more
Citations
More filters
Journal ArticleDOI
Using satellite imagery to understand and promote sustainable development
TL;DR: In this paper, the authors synthesize the growing literature that uses satellite imagery to understand sustainable development outcomes, with a focus on approaches that combine imagery with machine learning, highlighting how this noise often leads to incorrect assessment of model performance.
Posted Content
Using satellite imagery to understand and promote sustainable development
TL;DR: In this paper, the authors synthesize the growing literature that uses satellite imagery to understand sustainable development outcomes, with a focus on approaches that combine imagery with machine learning, and quantify the paucity of ground data on key human-related outcomes and the growing abundance and resolution (spatial, temporal and spectral) of satellite imagery.
Journal ArticleDOI
Crop Type and Land Cover Mapping in Northern Malawi Using the Integration of Sentinel-1, Sentinel-2, and PlanetScope Satellite Data
Daniel Kpienbaareh,Xiaoxuan Sun,Jinfei Wang,Isaac Luginaah,Rachel Bezner Kerr,Esther Lupafya,Laifolo Dakishoni +6 more
TL;DR: In this article, the authors used the random forest algorithm to classify crop types and land cover in agricultural landscapes using the Sentinel-1 (S-1) radar data, Sentinel-2 optical data, S-2 and PlanetScope data fusion, and S-1 C2 matrix and H/α polarimetric decomposition (an entropy-based decomposition method) fusion.
Journal ArticleDOI
Mapping Paddy Rice with Satellite Remote Sensing: A Review
TL;DR: It is found that the optical remote sensing data sources are mainly MODIS, Landsat, and Sentinel-2, and the emergence of Sentinel-1 data has promoted research on radar mapping methods for paddy rice.
Journal ArticleDOI
Exploring Google Street View with deep learning for crop type mapping
Yulin Yan,Youngryel Ryu +1 more
TL;DR: The results indicate that GSV images used with a deep learning model offer an efficient and cost-effective alternative method for ground referencing, in many regions of the world.
References
More filters
Proceedings ArticleDOI
Deep Residual Learning for Image Recognition
TL;DR: In this article, the authors proposed a residual learning framework to ease the training of networks that are substantially deeper than those used previously, which won the 1st place on the ILSVRC 2015 classification task.
Proceedings Article
Very Deep Convolutional Networks for Large-Scale Image Recognition
Karen Simonyan,Andrew Zisserman +1 more
TL;DR: In this paper, the authors investigated the effect of the convolutional network depth on its accuracy in the large-scale image recognition setting and showed that a significant improvement on the prior-art configurations can be achieved by pushing the depth to 16-19 layers.
Book
Deep Learning
TL;DR: Deep learning as mentioned in this paper is a form of machine learning that enables computers to learn from experience and understand the world in terms of a hierarchy of concepts, and it is used in many applications such as natural language processing, speech recognition, computer vision, online recommendation systems, bioinformatics, and videogames.
Posted Content
Scikit-learn: Machine Learning in Python
Fabian Pedregosa,Gaël Varoquaux,Alexandre Gramfort,Vincent Michel,Bertrand Thirion,Olivier Grisel,Mathieu Blondel,Andreas Müller,Joel Nothman,Gilles Louppe,Peter Prettenhofer,Ron Weiss,Vincent Dubourg,Jake Vanderplas,Alexandre Passos,David Cournapeau,Matthieu Brucher,Matthieu Perrot,Edouard Duchesnay +18 more
TL;DR: Scikit-learn as mentioned in this paper is a Python module integrating a wide range of state-of-the-art machine learning algorithms for medium-scale supervised and unsupervised problems.
Posted Content
U-Net: Convolutional Networks for Biomedical Image Segmentation
TL;DR: It is shown that such a network can be trained end-to-end from very few images and outperforms the prior best method (a sliding-window convolutional network) on the ISBI challenge for segmentation of neuronal structures in electron microscopic stacks.