A novel variety-based 3DTV content generation scheme for casually captured sparse photo collections
TL;DR: A novel parameterized variety-based 3D exploration model is presented to comprehend the sparse unstructured collection of photographs, and automatically plan virtual 3D tours of the world's landmarks through interesting viewpoints without explicit 3D reconstruction.
Abstract: This paper presents a novel parameterized variety-based 3D exploration model to comprehend the sparse unstructured collection of photographs, and automatically plan virtual 3D tours of the world's landmarks through interesting viewpoints without explicit 3D reconstruction. The proposed system analyzes the collection of unstructured but related image data containing the same location or environment to create a parameterized scene graph: a data structure that conveys spatial relations and enable smooth virtual navigation between photos. A novel statistical-heuristic criteria is evolved exploiting the scene spatial layout and appearance to automatically identify best available portals between photographs. Once well connected, the graph is parameterized and consistently rendered choosing visually compelling 3D transition paths, maintaining a pleasing essence of parallax. The system's ability is demonstrated on several casually captured personal photo collections of heritage sites and imagery gathered from “Flickr” data.
...read more
Citations
3,492 citations
References
42,225 citations
14,701 citations
"A novel variety-based 3DTV content ..." refers methods in this paper
...The system first detects SIFT [6] features in each of the input photos, matches extracted features between all pairs of images, and discard the ones with too few matches....
[...]
...A match score is assigned to each edge of the graph as described in [7]: S(Ii, Ij) = 2MS(Ii, Ij) |F (Ii)|+ |F (Ij)| (1) where, F (I) is the set of SIFT features for a frame I ,MS(Ii, Ij) is the matched features between Ii and Ij ....
[...]
3,492 citations
3,193 citations
"A novel variety-based 3DTV content ..." refers background or methods in this paper
...However, unlike the prior IBR approaches [5] that sought to build an interactive system, our objective is to design an automatic 3D content generation system which uses the most interesting regions or viewpoints of a scene and create compelling 3D transitions that best convey the spatial-appearance relations between photographs....
[...]
...For remaining candidate pairs, further refinement is performed using RANSAC [2, 5]....
[...]
...The IBR systems like Photosynth, Photo Tourism [5] presented good work in this direction....
[...]
2,892 citations