Journal ArticleDOI
Extracting View-Dependent Depth Maps from a Collection of Images
Sing Bing Kang,Richard Szeliski +1 more
TLDR
A new representation is proposed that overcomes the appearance variation problem associated with an image sequence and simultaneously optimizes a set of self-consistent depth maps at multiple key-frames.Abstract:
Stereo correspondence algorithms typically produce a single depth map. In addition to the usual problems of occlusions and textureless regions, such algorithms cannot model the variation in scene or object appearance with respect to the viewing position. In this paper, we propose a new representation that overcomes the appearance variation problem associated with an image sequence. Rather than estimating a single depth map, we associate a depth map with each input image (or a subset of them). Our representation is motivated by applications such as view interpolation and depth-based segmentation for model-building or layer extraction. We describe two approaches to extract such a representation from a sequence of images.
The first approach, which is more classical, computes the local depth map associated with each chosen reference frame independently. The novelty of this approach lies in its combination of shiftable windows, temporal selection, and graph cut optimization. The second approach simultaneously optimizes a set of self-consistent depth maps at multiple key-frames. Since multiple depth maps are estimated simultaneously, visibility can be modeled explicitly and disparity consistency imposed across the different depth maps. Results, which include a difficult specular scene example, show the effectiveness of our approach.read more
Citations
More filters
Book
Computer Vision: Algorithms and Applications
TL;DR: Computer Vision: Algorithms and Applications explores the variety of techniques commonly used to analyze and interpret images and takes a scientific approach to basic vision problems, formulating physical models of the imaging process before inverting them to produce descriptions of a scene.
Journal ArticleDOI
Scene reconstruction from high spatio-angular resolution light fields
TL;DR: This paper proposes an algorithm that leverages coherence in massive light fields by breaking with a number of established practices in image-based reconstruction, and introduces a sparse representation and a propagation scheme for reliable depth estimates which make the algorithm particularly effective for 3D input.
Journal ArticleDOI
Programmable aperture photography: multiplexed light field acquisition
TL;DR: A system including a novel component called programmable aperture and two associated post-processing algorithms for high-quality light field acquisition and the effectiveness of the system and the quality of the captured light field is presented.
Journal ArticleDOI
Consistent Depth Maps Recovery from a Video Sequence
TL;DR: This paper presents a novel method for recovering consistent depth maps from a video sequence that not only imposes the photo-consistency constraint, but also explicitly associates the geometric coherence with multiple frames in a statistical way and can naturally maintain the temporal coherence of the recovered dense depth maps without over-smoothing.
Book
Image-based rendering
TL;DR: This article surveys the techniques used in IBR and shows that representations and rendering techniques can differ radically, depending on design decisions related to ease of capture, use of geometry, accuracy of geometry (if used), number and distribution of source images, degrees of freedom for virtual navigation, and expected scene complexity.
References
More filters
Journal ArticleDOI
Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images
Stuart Geman,Donald Geman +1 more
TL;DR: The analogy between images and statistical mechanics systems is made and the analogous operation under the posterior distribution yields the maximum a posteriori (MAP) estimate of the image given the degraded observations, creating a highly parallel ``relaxation'' algorithm for MAP estimation.
Proceedings Article
An iterative image registration technique with an application to stereo vision
Bruce D. Lucas,Takeo Kanade +1 more
TL;DR: In this paper, the spatial intensity gradient of the images is used to find a good match using a type of Newton-Raphson iteration, which can be generalized to handle rotation, scaling and shearing.
Proceedings ArticleDOI
Good features to track
Jianbo Shi,Tomasi +1 more
TL;DR: A feature selection criterion that is optimal by construction because it is based on how the tracker works, and a feature monitoring method that can detect occlusions, disocclusions, and features that do not correspond to points in the world are proposed.
Journal ArticleDOI
A taxonomy and evaluation of dense two-frame stereo correspondence algorithms
TL;DR: This paper has designed a stand-alone, flexible C++ implementation that enables the evaluation of individual components and that can easily be extended to include new algorithms.
Journal ArticleDOI
Fast approximate energy minimization via graph cuts
TL;DR: This work presents two algorithms based on graph cuts that efficiently find a local minimum with respect to two types of large moves, namely expansion moves and swap moves that allow important cases of discontinuity preserving energies.