Journal ArticleDOI
Systems and Experiment Paper: Construction of Panoramic Image Mosaics with Global and Local Alignment
Reads0
Chats0
TLDR
This paper presents a complete system for constructing panoramic image mosaics from sequences of images, and introduces a rotational mosaic representation that associates a rotation matrix with each input image and a patch-based alignment algorithm to quickly align two images given motion models.Abstract:
This paper presents a complete system for constructing panoramic image mosaics from sequences of images. Our mosaic representation associates a transformation matrix with each input image, rather than explicitly projecting all of the images onto a common surface (e.g., a cylinder). In particular, to construct a full view panorama, we introduce a rotational mosaic representation that associates a rotation matrix (and optionally a focal length) with each input image. A patch-based alignment algorithm is developed to quickly align two images given motion models. Techniques for estimating and refining camera focal lengths are also presented.
In order to reduce accumulated registration errors, we apply global alignment (block adjustment) to the whole sequence of images, which results in an optimally registered image mosaic. To compensate for small amounts of motion parallax introduced by translations of the camera and other unmodeled distortions, we use a local alignment (deghosting) technique which warps each image based on the results of pairwise local image registrations. By combining both global and local alignment, we significantly improve the quality of our image mosaics, thereby enabling the creation of full view panoramic mosaics with hand-held cameras.
We also present an inverse texture mapping algorithm for efficiently extracting environment maps from our panoramic image mosaics. By mapping the mosaic onto an arbitrary texture-mapped polyhedron surrounding the origin, we can explore the virtual environment using standard 3D graphics viewers and hardware without requiring special-purpose players.read more
Citations
More filters
Journal ArticleDOI
Lucas-Kanade 20 Years On: A Unifying Framework
Simon Baker,Iain Matthews +1 more
TL;DR: In this paper, a wide variety of extensions have been made to the original formulation of the Lucas-Kanade algorithm and their extensions can be used with the inverse compositional algorithm without any significant loss of efficiency.
Journal ArticleDOI
Automatic Panoramic Image Stitching using Invariant Features
Matthew Brown,David G. Lowe +1 more
TL;DR: This work forms stitching as a multi-image matching problem, and uses invariant local features to find matches between all of the images, and is insensitive to the ordering, orientation, scale and illumination of the input images.
Journal ArticleDOI
Active Appearance Models Revisited
Iain Matthews,Simon Baker +1 more
TL;DR: This work proposes an efficient fitting algorithm for AAMs based on the inverse compositional image alignment algorithm and shows that the effects of appearance variation during fitting can be precomputed (“projected out”) using this algorithm and how it can be extended to include a global shape normalising warp.
Book
Image Alignment and Stitching: A Tutorial
TL;DR: In this article, the basic motion models underlying alignment and stitching algorithms are described, and effective direct (pixel-based) and feature-based alignment algorithms, and blending algorithms used to produce seamless mosaics.
Proceedings Article
Recognising Panoramas
Matthew Brown,David G. Lowe +1 more
TL;DR: Object recognition techniques based on invariant local features to select matching images, and a probabilistic model for verification are used, which is insensitive to the ordering, orientation, scale and illumination of the images.
References
More filters
Proceedings Article
An iterative image registration technique with an application to stereo vision
Bruce D. Lucas,Takeo Kanade +1 more
TL;DR: In this paper, the spatial intensity gradient of the images is used to find a good match using a type of Newton-Raphson iteration, which can be generalized to handle rotation, scaling and shearing.
Journal ArticleDOI
Numerical Recipes in C: The Art of Scientific Computing
Mary C. Seiler,Fritz A. Seiler +1 more
Proceedings ArticleDOI
Good features to track
Jianbo Shi,Tomasi +1 more
TL;DR: A feature selection criterion that is optimal by construction because it is based on how the tracker works, and a feature monitoring method that can detect occlusions, disocclusions, and features that do not correspond to points in the world are proposed.
Related Papers (5)
An iterative image registration technique with an application to stereo vision
Bruce D. Lucas,Takeo Kanade +1 more