A Cost-Effective Automatic 3D Reconstruction Pipeline for Plants Using Multi-view Images

TLDR: It is concluded that the proposed 3D reconstruction is a promising generalized technique for the non-destructive phenotyping of various plants during their whole growth cycles.

Abstract: Plant phenotyping involves the measurement, ideally objectively, of characteristics or traits. Traditionally, this is either limited to tedious and sparse manual measurements, often acquired destructively, or coarse image-based 2D measurements. 3D sensing technologies (3D laser scanning, structured light and digital photography) are increasingly incorporated into mass produced consumer goods and have the potential to automate the process, providing a cost-effective alternative to current commercial phenotyping platforms. We evaluate the performance, cost and practicability for plant phenotyping and present a 3D reconstruction method from multi-view images acquired with a domestic quality camera. This method consists of the following steps: (i) image acquisition using a digital camera and turntable; (ii) extraction of local invariant features and matching from overlapping image pairs; (iii) estimation of camera parameters and pose based on Structure from Motion(SFM); and (iv) employment of a patch based multi-view stereo technique to implement a dense 3D point cloud. We conclude that the proposed 3D reconstruction is a promising generalized technique for the non-destructive phenotyping of various plants during their whole growth cycles.