scispace - formally typeset
Proceedings ArticleDOI

A Novel Algebaric Variety Based Model for High Quality Free-Viewpoint View Synthesis on a Krylov Subspace

Reads0
Chats0
TLDR
A new depth-image-based rendering algorithm for free-viewpoint 3DTV applications that effectively handles artifacts appear in wide-baseline spatial view interpolation and arbitrary camera movements and results excel with state-of-the-art methods in quantitative and qualitative evaluation.
Abstract
This paper presents a new depth-image-based rendering algorithm for free-viewpoint 3DTV applications. The cracks, holes, ghost countors caused by visibility, disocclusion, resampling problems associated with 3D warping lead to serious rendering artifacts in synthesized virtual views. This challenging problem of hole filling is formulated as an algebraic matrix completion problem on a higher dimensional space of monomial features described by a novel variety model. The high-level idea of this work is to exploit the linear or nonlinear structures of the data and interpolate missing values by solving algebraic varieties associated with Hankel matrices as a member of Krylov subspace. The proposed model effectively handles artifacts appear in wide-baseline spatial view interpolation and arbitrary camera movements. Our model has a low runtime and results excel with state-of-the-art methods in quantitative and qualitative evaluation.

read more

Citations
More filters
Book

图像处理和分析的图模型:理论与应用 (Image Processing and Analysis with Graphs: Theory and Practice)

TL;DR: This book discusses Graph Theory concepts and definitions used in Image Processing and Analysis, and the role of Graphs in Matching Shapes and in Categorization in GED Computation Applications of GED.
Journal ArticleDOI

2T-UNET: A Two-Tower UNet with Depth Clues for Robust Stereo Depth Estimation

TL;DR: The depth estimation problem is revisits, avoiding the explicit stereo matching step using a simple two-tower convolutional neural network, and the proposed algorithm is entitled 2T-UNet, which surpasses state-of-the-art monocular and stereo depth estimation methods on the challenging Scene dataset.
References
More filters
Proceedings ArticleDOI

View synthesis with hierarchical clustering based occlusion filling

TL;DR: This paper presents a depth image based rendering algorithm for view synthesis task that addresses the challenging occlusion filling problem with a hierarchical clustering approach.

3-D video coding system with enhanced rendered view quality

Woo-Shik Kim
TL;DR: This chapter discusses the synthesis process using depth maps, the construction of graph based transform for depth map coding, and rate and distortion analysis of depth transition data.
Journal ArticleDOI

View synthesis with 3D object segmentation-based asynchronous blending and boundary misalignment rectification

TL;DR: A trilateral depth filter with local texture information, spatial proximity, and color similarity is incorporated to remove the ghost contours by rectifying the misalignment between the depth map and its associated color image.
Dissertation

Uncalibrated camera based content generation for 3D multi-view displays

Mansi Sharma
TL;DR: For creating a truly immersive experience, it is essential to support advanced functionalities like free-viewpoint viewing of natural video, and multi-media features which increase user interactivity with television content, like editing or mixing of scene components, virtual panning, tilting or zoom-in.
Proceedings ArticleDOI

3DTV view generation with virtual pan/tilt/zoom functionality

TL;DR: A novel rendering algorithm based on depth image warping to support virtual pan-tilt-zoom (PTZ) functionalities during 3D view generation and a novel selective warping scheme is presented to reduce the computational cost by as much as 40% while maintaining an acceptable quality of rendering results.
Related Papers (5)