Journal ArticleDOI
A unified approach to real-time, multi-resolution, multi-baseline 2d view synthesis and 3d depth estimation using commodity graphics hardware
Reads0
Chats0
TLDR
This work presents a new method for using commodity graphics hardware to achieve real-time, on-line, 2D view synthesis or 3D depth estimation from two or more calibrated cameras that combines a 3D plane-sweeping approach with 2D multi-resolution color consistency tests.Abstract:
We present a new method for using commodity graphics hardware to achieve real-time, on-line, 2D view synthesis or 3D depth estimation from two or more calibrated cameras. Our method combines a 3D plane-sweeping approach with 2D multi-resolution color consistency tests. We project camera imagery onto each plane, compute measures of color consistency throughout the plane at multiple resolutions, and then choose the color or depth (corresponding plane) that is most consistent. The key to achieving real-time performance is our use of the advanced features included with recent commodity computer graphics hardware to implement the computations simultaneously (in parallel) across all reference image pixels on a plane. Our method is relatively simple to implement, and flexible in term of the number and placement of cameras. With two cameras andread more
Citations
More filters
Book
Multi-View Stereo: A Tutorial
TL;DR: This tutorial presents a hands-on view of the field of multi-view stereo with a focus on practical algorithms, describing in detail its main two ingredients: robust implementations of photometric consistency measures, and efficient optimization algorithms.
Patent
Movable audio/video communication interface system
TL;DR: In this paper, a system that includes a desk top assembly of a display and sensors mounted on a robotic arm is presented, where the arm moves the assembly so that it remains within position and orientation tolerances relative to the user's head as the user looks around.
Proceedings ArticleDOI
Using graphics devices in reverse: GPU-based Image Processing and Computer Vision
J. Fung,Steve Mann +1 more
TL;DR: This paper discusses how this processing power is being harnessed for image processing and computer vision, thereby providing dramatic speedups on commodity, readily available graphics hardware.
Journal ArticleDOI
Toward Dynamic Image Mosaic Generation With Robustness to Parallax
Qi Zhi,Jeremy R. Cooperstock +1 more
TL;DR: Although further additions are required to cope with unconstrained object motion, the algorithm can synthesize a perceptually convincing output, conveying the same appearance of motion as seen in the input sequences.
Journal ArticleDOI
Interactive Pixel‐Accurate Free Viewpoint Rendering from Images with Silhouette Aware Sampling
Alexander Hornung,Leif Kobbelt +1 more
TL;DR: An integrated, fully GPU‐based processing pipeline to interactively render new views of arbitrary scenes from calibrated but otherwise unstructured input views by proposing a particle optimization routine combined with a special parameterization of the view space that enables an efficient proxy generation.
References
More filters
Journal ArticleDOI
A taxonomy and evaluation of dense two-frame stereo correspondence algorithms
TL;DR: This paper has designed a stand-alone, flexible C++ implementation that enables the evaluation of individual components and that can easily be extended to include new algorithms.
Proceedings ArticleDOI
Light field rendering
Marc Levoy,Pat Hanrahan +1 more
TL;DR: This paper describes a sampled representation for light fields that allows for both efficient creation and display of inward and outward looking views, and describes a compression system that is able to compress the light fields generated by more than a factor of 100:1 with very little loss of fidelity.
Proceedings ArticleDOI
The lumigraph
TL;DR: A new method for capturing the complete appearance of both synthetic and real world objects and scenes, representing this information, and then using this representation to render images of the object from new camera positions.
Proceedings Article
Three-dimensional computer vision: a geometric viewpoint
TL;DR: Results from constrained optimization some results from algebraic geometry differential geometry are shown.
Journal ArticleDOI
The visual hull concept for silhouette-based image understanding
TL;DR: This paper addresses the problem of finding which parts of a nonconvex object are relevant for silhouette-based image understanding and introduces the geometric concept of visual hull of a 3-D object, which is the maximal object silhouette-equivalent to S.