Proceedings ArticleDOI
Reconstructing Occluded Surfaces Using Synthetic Apertures: Stereo, Focus and Robust Measures
Vaibhav Vaish,Marc Levoy,Richard Szeliski,C.L. Zitnick,Sing Bing Kang +4 more
- Vol. 2, pp 2331-2338
TLDR
This paper compares classical shape from stereo with shape from synthetic aperture focus, and describes two variants of multi-view stereo based on color medians and entropy that increase robustness to occlusions.Abstract:
Most algorithms for 3D reconstruction from images use cost functions based on SSD, which assume that the surfaces being reconstructed are visible to all cameras. This makes it difficult to reconstruct objects which are partially occluded. Recently, researchers working with large camera arrays have shown it is possible to "see through" occlusions using a technique called synthetic aperture focusing. This suggests that we can design alternative cost functions that are robust to occlusions using synthetic apertures. Our paper explores this design space. We compare classical shape from stereo with shape from synthetic aperture focus. We also describe two variants of multi-view stereo based on color medians and entropy that increase robustness to occlusions. We present an experimental comparison of these cost functions on complex light fields, measuring their accuracy against the amount of occlusion.read more
Citations
More filters
Journal ArticleDOI
Light Fields and Computational Imaging
TL;DR: A survey of the theory and practice of light field imaging emphasizes the devices researchers in computer graphics and computer vision have built to capture light fields photographically and the techniques they have developed to compute novel images from them.
Patent
Capturing and processing of images using monolithic camera array with heterogeneous imagers
TL;DR: In this paper, the system and methods for implementing array cameras configured to perform super-resolution processing to generate higher resolution super-resolved images using a plurality of captured images and lens stack arrays that can be utilized in array cameras are disclosed.
Proceedings ArticleDOI
Depth from Combining Defocus and Correspondence Using Light-Field Cameras
TL;DR: A novel simple and principled algorithm is presented that computes dense depth estimation by combining both defocus and correspondence depth cues, and shows how to combine the two cues into a high quality depth map, suitable for computer vision applications such as matting, full control of depth-of-field, and surface reconstruction.
Proceedings ArticleDOI
Decoding, Calibration and Rectification for Lenselet-Based Plenoptic Cameras
TL;DR: This work derives a novel physically based 4D intrinsic matrix relating each recorded pixel to its corresponding ray in 3D space as part of a decoding, calibration and rectification procedure for lenselet-based plenoptic cameras appropriate for a range of computer vision applications.
Proceedings ArticleDOI
Robust video denoising using low rank matrix completion
TL;DR: The robustness and effectiveness of the proposed Denoising algorithm on removing mixed noise, e.g. heavy Gaussian noise mixed with impulsive noise, is validated in the experiments and the proposed approach compares favorably against some existing video denoising algorithms.
References
More filters
Journal ArticleDOI
High-quality video view interpolation using a layered representation
TL;DR: This paper shows how high-quality video-based rendering of dynamic scenes can be accomplished using multiple synchronized video streams combined with novel image-based modeling and rendering algorithms, and develops a novel temporal two-layer compressed representation that handles matting.
Journal ArticleDOI
High performance imaging using large camera arrays
Bennett Wilburn,Neel Joshi,Vaibhav Vaish,Eino-Ville Talvala,Emilio Antúnez,Adam Barth,Andrew Adams,Mark Horowitz,Marc Levoy +8 more
TL;DR: A unique array of 100 custom video cameras that are built are described, and their experiences using this array in a range of imaging applications are summarized.
Journal ArticleDOI
A multiple-baseline stereo
Masatoshi Okutomi,Takeo Kanade +1 more
TL;DR: It is shown that the SSSD-in-inverse-distance function exhibits a unique and clear minimum at the correct matching position, even when the underlying intensity patterns of the scene include ambiguities or repetitive patterns.
Journal ArticleDOI
Photorealistic Scene Reconstruction by Voxel Coloring
Steven M. Seitz,Charles R. Dyer +1 more
TL;DR: A novel scene reconstruction technique is presented, different from previous approaches in its ability to cope with large changes in visibility and its modeling of intrinsic scene color and texture information.
Book ChapterDOI
Multi-camera Scene Reconstruction via Graph Cuts
Vladimir Kolmogorov,Ramin Zabih +1 more
TL;DR: This paper addresses the problem of computing the 3-dimensional shape of an arbitrary scene from a set of images taken at known viewpoints by giving an energy minimization formulation of the multi-camera scene reconstruction problem.