scispace - formally typeset
Search or ask a question
Journal ArticleDOI

Uncalibrated view synthesis using planar segmentation of images

TL;DR: Experimental comparisons with the images synthesized using the actual three -dimensional scene structure and camera poses show that the proposed method effectively describes scene changes by viewpoint movements without estimation of 3 -D and camera information.
Abstract: This paper presents an uncalibrated v iew synthesis method using piecewise planar regions that are extracted from a given set of image pairsthrough planar segmentation. Our work concentrates on a view synthesis method that does not needestimation of camera parameters and scene structure. Forour goal, we simply assume that images of real world are composed of piecewise planar regions. Then, we perform view synthesis simply with planar regions and homographiesbetween them. Here, for accurate extraction of planar homographies and piecewise pla nar regions in images, the proposed method employs iterative homography estimation and color segmentation -based planar region extraction. The proposed method synthesizes the virtual view image using a set of planar regions as well as a set of corresponding homographies. Experimental comparisons with the images synthesized using the actual three -dimensional (3-D) scene structure and camera poses show that the proposed method effectively describes scene changes by viewpoint movements without estimation of 3 -D and camera information.
References
More filters
Journal ArticleDOI
TL;DR: This paper provides a review on techniques for computing a three-dimensional model of a scene from a single moving camera, with unconstrained motion and unknown parameters, by exploiting all the available constraints.

122 citations


"Uncalibrated view synthesis using p..." refers methods in this paper

  • ...With an unrectified input image pair, various methods, which employ additional procedures such as self-calibration [16], image rectification [24], or motion parallax [5,8], have been developed for view synthesis....

    [...]

  • ...26 self-calibration method or by utilizing the relation matrix that specifies the relationship of image correspondences from an image pair, such as a homography or fundamental matrix [7,16]....

    [...]

Proceedings ArticleDOI
04 Dec 2000
TL;DR: A practical algorithm that integrates all aspects of depth and visibility based rendering within a global matching criterion to compute depth in contrast with approaches that rely on local matching measures and relaxation is presented.
Abstract: In this paper, we present a new analysis by synthesis computational framework for stereo vision. It is designed to achieve the following goals: (1) enforcing global visibility constraints, (2) obtaining reliable depth for depth boundaries and thin structures, (3) obtaining correct depth for textureless regions, and (4) hypothesizing correct depth for unmatched regions. The framework employs depth and visibility based rendering within a global matching criterion to compute depth in contrast with approaches that rely on local matching measures and relaxation. A color segmentation based depth representation guarantees smoothness in textureless regions. Hypothesizing depth from neighboring segments enables propagation of correct depth and produces reasonable depth values for unmatched region. A practical algorithm that integrates all these aspects is presented in this paper. Comparative experimental results are shown for real images. Results on new view rendering based on a single stereo pair are also demonstrated.

120 citations

Journal ArticleDOI
TL;DR: A novel approach is proposed to uniquely optimise each transform in order to minimise perspective distortions, which ensures the rectified images resemble the original images as closely as possible.

111 citations


"Uncalibrated view synthesis using p..." refers methods in this paper

  • ...Another approach to virtual view synthesis is an uncalibrated view synthesis method with image rectification [24]....

    [...]

  • ...With an unrectified input image pair, various methods, which employ additional procedures such as self-calibration [16], image rectification [24], or motion parallax [5,8], have been developed for view synthesis....

    [...]

Proceedings ArticleDOI
18 Jun 1996
TL;DR: The method does not explicitly model scene geometry, and enables fast and exact generation of synthetic views, and it is demonstrated that it is possible to efficiently synthesize realistic new views even from inaccurate and incomplete depth information.
Abstract: We propose a new method for view synthesis from real images using stereo vision. The method does not explicitly model scene geometry, and enables fast and exact generation of synthetic views. We also reevaluate the requirements on stereo algorithms for the application of view synthesis and discuss ways of dealing with partially occluded regions of unknown depth and with completely occluded regions of unknown texture. Our experiments demonstrate that it is possible to efficiently synthesize realistic new views even from inaccurate and incomplete depth information.

91 citations


"Uncalibrated view synthesis using p..." refers background or methods in this paper

  • ...Generally, view synthesis methods are divided into two categories depending on whether or not camera calibration is used: calibrated [2–4] and uncalibrated [5–8]....

    [...]

  • ...The goal of view synthesis is generating a virtual image at an arbitrary viewpoint using multiple images taken from a camera [1–8]....

    [...]

  • ...Although 3-D reconstruction with multiple images [1–8] could automatically synthesize images, essentially it requires to perform additional stereo matching or camera calibration....

    [...]

Journal ArticleDOI
TL;DR: A novel method able to recover scene planes of arbitrary position and orientation from oriented images using homographies is presented and it is demonstrated that the reconstruction method can cope with large baseline changes.

61 citations