Journal ArticleDOI
Augmented reality with automatic illumination control incorporating ellipsoidal models
TLDR
Experimental results with a moving virtual object mixed into real video telephone sequences show that the virtual object appears naturally having the same shading and shadows as the real objects.Abstract:Â
In applications of augmented reality like virtual studio TV production, multisite video conference applications using a virtual meeting room and synthetic/natural hybrid coding according to the new ISO/MPEG-4 standard, a synthetic scene is mixed into a natural scene to generate a synthetic/natural hybrid image sequence. For realism, the illumination in both scenes should be identical. In this paper, the illumination of the natural scene is estimated automatically and applied to the synthetic scene. The natural scenes are restricted to scenes with nonoccluding, simple, moving, mainly rigid objects. For illumination estimation, these natural objects are automatically segmented in the natural image sequence and three-dimensionally (3-D) modeled using ellipsoid-like models. The 3-D shape, 3-D motion, and the displaced frame difference between two succeeding images are evaluated to estimate three illumination parameters. The parameters describe a distant point light source and ambient light. Using the estimated illumination parameters, the synthetic scene is rendered and mixed to the natural image sequence. Experimental results with a moving virtual object mixed into real video telephone sequences show that the virtual object appears naturally having the same shading and shadows as the real objects. Further, shading and shadow allows the viewer to understand the motion trajectory of the objects much better.read more
Citations
More filters
Journal ArticleDOI
Recent advances in augmented reality
TL;DR: This work refers one to the original survey for descriptions of potential applications, summaries of AR system characteristics, and an introduction to the crucial problem of registration, including sources of registration error and error-reduction strategies.
Proceedings ArticleDOI
Perceptual issues in augmented reality revisited
TL;DR: This paper provides a classification of perceptual issues in augmented reality into ones related to the environment, capturing, augmentation, display, and individual user differences, and describes current approaches to addressing these problems.
Journal Article
A physical approach to color image understanding
TL;DR: An algorithm of color image understanding which segments the image after analyzing sur-faces with color variations due to lighting condition and object colors and gives forth a physical des-cription of imaging process, including intrinsic images, segmented image, the color of light and objects.
Proceedings ArticleDOI
Photorealistic rendering for augmented reality using environment illumination
TL;DR: This work uses a recent technique of image-based lighting, environment illumination maps, and a simple yet practical multi-pass rendering framework for augmented reality to improve photorealism for rendering synthetic objects in augmented reality.
References
More filters
Book
Robot Vision
TL;DR: Robot Vision as discussed by the authors is a broad overview of the field of computer vision, using a consistent notation based on a detailed understanding of the image formation process, which can provide a useful and current reference for professionals working in the fields of machine vision, image processing, and pattern recognition.
Journal ArticleDOI
Illumination for computer generated pictures
TL;DR: Human visual perception and the fundamental laws of optics are considered in the development of a shading rule that provides better quality and increased realism in generated images.
Book
Lessons in Estimation Theory for Signal Processing, Communications, and Control
TL;DR: In this paper, the authors present an overview of the state-of-the-art algorithms for least-squares estimators and their applications in higher-order statistics, including iterated least squares and extended Kalman-Bucy filtering.
Book
3D Computer Graphics
TL;DR: The third edition of Alan Watt's 3D Computer Graphics, a bible of computer graphics, includes a CD-ROM full of examples and updated information on graphics and rendering algorithms, including methods for linked structures, collision detection, and particle animation.