Silhouette-based 3-D model reconstruction from multiple images
01 Aug 2003-Vol. 33, Iss: 4, pp 582-591
TL;DR: An algorithm to extract the rotation axis of a turn-table has been developed based on a multi-image calibration method and it can be extended to estimate robustly the initial bounding volume of the object to be modeled.
Abstract: The goal of this study is to investigate the reconstruction of three-dimensional (3-D) graphical models of real objects in a controlled imaging environment and present the work done in our group based on silhouette-based reconstruction. Although many parts of the whole system have been well-known in the literature and in practice, the main contribution of the paper is that it describes a complete, end-to-end system explained in detail. Based on a multi-image calibration method, an algorithm to extract the rotation axis of a turn-table has been developed. Furthermore, this can be extended to estimate robustly the initial bounding volume of the object to be modeled. The disadvantages of the silhouette-based reconstruction can be removed by an algorithm using photoconsistency. This algorithm has a simpler visibility check, and it eliminates the selection of threshold existing in similar algorithms. Besides, in order to construct the appearance, we use the concept of particles. The reconstruction results are shown both on real world and synthetic objects.
Citations
More filters
TL;DR: A novel imaging and software platform was developed for the high-throughput phenotyping of three-dimensional root traits during seedling development and will facilitate novel investigations into the development of entire root systems or selected components of root systems.
Abstract: A novel imaging and software platform was developed for the high-throughput phenotyping of three-dimensional root traits during seedling development. To demonstrate the platform’s capacity, plants of two rice ( Oryza sativa ) genotypes, Azucena and IR64, were grown in a transparent gellan gum system and imaged daily for 10 d. Rotational image sequences consisting of 40 two-dimensional images were captured using an optically corrected digital imaging system. Three-dimensional root reconstructions were generated and analyzed using a custom-designed software, RootReader3D. Using the automated and interactive capabilities of RootReader3D, five rice root types were classified and 27 phenotypic root traits were measured to characterize these two genotypes. Where possible, measurements from the three-dimensional platform were validated and were highly correlated with conventional two-dimensional measurements. When comparing gellan gum-grown plants with those grown under hydroponic and sand culture, significant differences were detected in morphological root traits ( P
369 citations
Cites methods from "Silhouette-based 3-D model reconstr..."
...This software, RootReader3D, utilizes a silhouette-based back-projection algorithm (Mulayim et al., 2003; Zhu et al., 2006) combined with crosssectional volume segmentation to generate 3D root models (Supplemental Fig....
[...]
01 Jan 2011
TL;DR: In this paper, a novel imaging and software platform was developed for the high-throughput phenotyping of three-dimensional root traits during seedling development, which can facilitate novel investigations into the development of entire root systems or selected components of root systems.
Abstract: A novel imaging and software platform was developed for the high-throughput phenotyping of three-dimensional root traits during seedling development. To demonstrate the platform’s capacity, plants of two rice (Oryza sativa) genotypes, Azucena and IR64, were grown in a transparent gellan gum system and imaged daily for 10 d. Rotational image sequences consisting of 40 two-dimensional images were captured using an optically corrected digital imaging system. Three-dimensional root reconstructions were generated and analyzed using a custom-designed software, RootReader3D. Using the automated and interactive capabilities of RootReader3D, five rice root types were classified and 27 phenotypic root traits were measured to characterize these two genotypes. Where possible, measurements from the three-dimensional platform were validated and were highly correlated with conventional two-dimensional measurements. When comparing gellan gum-grown plants with those grown under hydroponic and sand culture, significant differences were detected in morphological root traits (P , 0.05). This highly flexible platform provides the capacity to measure root traits with a high degree of spatial and temporal resolution and will facilitate novel investigations into the development of entire root systems or selected components of root systems. In combination with the extensive genetic resources that are now available, this platform will be a powerful resource to further explore the molecular and genetic determinants of root system architecture.
332 citations
01 Feb 2008
TL;DR: Two novel image enhancement algorithms are introduced: edge-preserving contrast enhancement, which is able to better preserve edge details while enhancing contrast in images with varying illumination, and a novel multihistogram equalization method which utilizes the human visual system to segment the image, allowing a fast and efficient correction of nonuniform illumination.
Abstract: Varying scene illumination poses many challenging problems for machine vision systems. One such issue is developing global enhancement methods that work effectively across the varying illumination. In this paper, we introduce two novel image enhancement algorithms: edge-preserving contrast enhancement, which is able to better preserve edge details while enhancing contrast in images with varying illumination, and a novel multihistogram equalization method which utilizes the human visual system (HVS) to segment the image, allowing a fast and efficient correction of nonuniform illumination. We then extend this HVS-based multihistogram equalization approach to create a general enhancement method that can utilize any combination of enhancement algorithms for an improved performance. Additionally, we propose new quantitative measures of image enhancement, called the logarithmic Michelson contrast measure (AME) and the logarithmic AME by entropy. Many image enhancement methods require selection of operating parameters, which are typically chosen using subjective methods, but these new measures allow for automated selection. We present experimental results for these methods and make a comparison against other leading algorithms.
270 citations
Patent•
11 Apr 2014
TL;DR: In this paper, the authors describe a range of object registration and registration arrangements that enable users and other entities to register or enroll physical objects into one or more object registries on which an object recognition process can be performed.
Abstract: Methods and arrangements involving portable user devices such smartphones and wearable electronic devices are disclosed, as well as other devices and sensors distributed within an ambient environment. Some arrangements enable a user to perform an object recognition process in a computationally- and time-efficient manner. Other arrangements enable users and other entities to, either individually or cooperatively, register or enroll physical objects into one or more object registries on which an object recognition process can be performed. Still other arrangements enable users and other entities to, either individually or cooperatively, associate registered or enrolled objects with one or more items of metadata. A great variety of other features and arrangements are also detailed.
192 citations
Book•
01 Jan 1996
192 citations
References
More filters
Book•
01 Jan 2000TL;DR: In this article, the authors provide comprehensive background material and explain how to apply the methods and implement the algorithms directly in a unified framework, including geometric principles and how to represent objects algebraically so they can be computed and applied.
Abstract: From the Publisher:
A basic problem in computer vision is to understand the structure of a real world scene given several images of it. Recent major developments in the theory and practice of scene reconstruction are described in detail in a unified framework. The book covers the geometric principles and how to represent objects algebraically so they can be computed and applied. The authors provide comprehensive background material and explain how to apply the methods and implement the algorithms directly.
15,558 citations
01 Aug 1987
TL;DR: In this paper, a divide-and-conquer approach is used to generate inter-slice connectivity, and then a case table is created to define triangle topology using linear interpolation.
Abstract: We present a new algorithm, called marching cubes, that creates triangle models of constant density surfaces from 3D medical data. Using a divide-and-conquer approach to generate inter-slice connectivity, we create a case table that defines triangle topology. The algorithm processes the 3D medical data in scan-line order and calculates triangle vertices using linear interpolation. We find the gradient of the original data, normalize it, and use it as a basis for shading the models. The detail in images produced from the generated surface models is the result of maintaining the inter-slice connectivity, surface data, and gradient information present in the original 3D data. Results from computed tomography (CT), magnetic resonance (MR), and single-photon emission computed tomography (SPECT) illustrate the quality and functionality of marching cubes. We also discuss improvements that decrease processing time and add solid modeling capabilities.
13,231 citations
01 Aug 1996
TL;DR: This work presents a new approach for modeling and rendering existing architectural scenes from a sparse set of still photographs, which combines both geometry-based and imagebased techniques, and presents view-dependent texture mapping, a method of compositing multiple views of a scene that better simulates geometric detail on basic models.
Abstract: We present a new approach for modeling and rendering existing architectural scenes from a sparse set of still photographs. Our modeling approach, which combines both geometry-based and imagebased techniques, has two components. The first component is a photogrammetricmodeling method which facilitates the recovery of the basic geometry of the photographed scene. Our photogrammetric modeling approach is effective, convenient, and robust because it exploits the constraints that are characteristic of architectural scenes. The second component is a model-based stereo algorithm, which recovers how the real scene deviates from the basic model. By making use of the model, our stereo technique robustly recovers accurate depth from widely-spaced image pairs. Consequently, our approach can model large architectural environments with far fewer photographs than current image-based modeling approaches. For producing renderings, we present view-dependent texture mapping, a method of compositing multiple views of a scene that better simulates geometric detail on basic models. Our approach can be used to recover models for use in either geometry-based or image-based rendering systems. We present results that demonstrate our approach’s ability to create realistic renderings of architectural scenes from viewpoints far from the original photographs. CR Descriptors: I.2.10 [Artificial Intelligence]: Vision and Scene Understanding Modeling and recovery of physical attributes; I.3.7 [Computer Graphics]: Three-Dimensional Graphics and Realism Color, shading, shadowing, and texture I.4.8 [Image Processing]: Scene Analysis Stereo; J.6 [Computer-Aided Engineering]: Computer-aided design (CAD).
2,159 citations
"Silhouette-based 3-D model reconstr..." refers methods in this paper
...In order to avoid multi-view stereo drawbacks, modelbased multi-view stereo approaches are proposed [27]....
[...]
TL;DR: A robust approach to image matching by exploiting the only available geometric constraint, namely, the epipolar constraint, is proposed and a new strategy for updating matches is developed, which only selects those matches having both high matching support and low matching ambiguity.
1,574 citations
"Silhouette-based 3-D model reconstr..." refers methods in this paper
...These auto-calibration techniques have been the object of a tremendous amount of work [37], [38], [39], [40], [41] and effective methods to derive the epipolar geometry and the trifocal tensor from point correspondences have been devised [6], [42]....
[...]
TL;DR: A provably-correct algorithm is given, called Space Carving, for computing the 3D shape of an unknown, arbitrarily-shaped scene from multiple photographs taken at known but arbitrarily-distributed viewpoints to capture photorealistic shapes that accurately model scene appearance from a wide range of viewpoints.
Abstract: In this paper we consider the problem of computing the 3D shape of an unknown, arbitrarily-shaped scene from multiple photographs taken at known but arbitrarily-distributed viewpoints. By studying the equivalence class of all 3D shapes that reproduce the input photographs, we prove the existence of a special member of this class, the photo hull, that (1) can be computed directly from photographs of the scene, and (2) subsumes all other members of this class. We then give a provably-correct algorithm, called Space Carving, for computing this shape and present experimental results on complex real-world scenes. The approach is designed to (1) capture photorealistic shapes that accurately model scene appearance from a wide range of viewpoints, and (2) account for the complex interactions between occlusion, parallax, shading, and their view-dependent effects on scene-appearance.
1,487 citations
"Silhouette-based 3-D model reconstr..." refers background or methods in this paper
...troduced by [28] and have recently been improved by several researchers [14], [28], [29], [30], [50]....
[...]
...Rather than using binary silhouette images, shape from photoconsistency techniques employ the additional photometric information (color) [28], [29]....
[...]
...Solutions for arbitrary camera placement have been proposed by using multiple plane sweeps along the positive and negative directions of each coordinate axes [29], and by using special data structures named as item buffers and layered depth images [30]....
[...]
...However, there are several extensions to the initial voxel coloring algorithm for the visibility problem [29], [30], [31], [32], [33]....
[...]
...In order to avoid the disadvantages of multi-view stereo and model-based stereo, 3D scene space solutions are recently proposed [28], [29], [30]....
[...]