Open Access
Light field photography with a hand-held plenoptic camera
TLDR
The plenoptic camera as mentioned in this paper uses a microlens array between the sensor and the main lens to measure the total amount of light deposited at that location, but how much light arrives along each ray.Abstract:
This paper presents a camera that samples the 4D light field on its sensor in a single photographic exposure. This is achieved by inserting a microlens array between the sensor and main lens, creating a plenoptic camera. Each microlens measures not just the total amount of light deposited at that location, but how much light arrives along each ray. By re-sorting the measured rays of light to where they would have terminated in slightly different, synthetic cameras, we can compute sharp photographs focused at different depths. We show that a linear increase in the resolution of images under each microlens results in a linear increase in the sharpness of the refocused photographs. This property allows us to extend the depth of field of the camera without reducing the aperture, enabling shorter exposures and lower image noise. Especially in the macrophotography regime, we demonstrate that we can also compute synthetic photographs from a range of different viewpoints. These capabilities argue for a different strategy in designing photographic imaging systems. To the photographer, the plenoptic camera operates exactly like an ordinary hand-held camera. We have used our prototype to take hundreds of light field photographs, and we present examples of portraits, high-speed action and macro close-ups.read more
Citations
More filters
Book
Computer Vision: Algorithms and Applications
TL;DR: Computer Vision: Algorithms and Applications explores the variety of techniques commonly used to analyze and interpret images and takes a scientific approach to basic vision problems, formulating physical models of the imaging process before inverting them to produce descriptions of a scene.
Journal ArticleDOI
Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age
Cesar Cadena,Luca Carlone,Henry Carrillo,Yasir Latif,Davide Scaramuzza,José Neira,Ian Reid,John J. Leonard +7 more
TL;DR: Simultaneous localization and mapping (SLAM) as mentioned in this paper consists in the concurrent construction of a model of the environment (the map), and the estimation of the state of the robot moving within it.
Journal ArticleDOI
Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Age
Cesar Cadena,Luca Carlone,Henry Carrillo,Yasir Latif,Davide Scaramuzza,José L. Neira,Ian Reid,John J. Leonard +7 more
TL;DR: What is now the de-facto standard formulation for SLAM is presented, covering a broad set of topics including robustness and scalability in long-term mapping, metric and semantic representations for mapping, theoretical performance guarantees, active SLAM and exploration, and other new frontiers.
Journal ArticleDOI
The status, challenges, and future of additive manufacturing in engineering
Wei Gao,Yunbo Zhang,Devarajan Ramanujan,Karthik Ramani,Yong Chen,Christopher B. Williams,Charlie C. L. Wang,Yung C. Shin,Song Zhang,Pablo D. Zavattieri +9 more
TL;DR: Future directions such as the "print-it-all" paradigm, that have the potential to re-imagine current research and spawn completely new avenues for exploration are pointed out.
Journal ArticleDOI
A broadband achromatic metalens in the visible
Shuming Wang,Pin Chieh Wu,Vin Cent Su,Yi Chieh Lai,Mu Ku Chen,Hsin Yu Kuo,Bo Han Chen,Yu Han Chen,Tzu-Ting Huang,Jung Hsi Wang,Ray-Ming Lin,Chieh-Hsiung Kuan,Tao Li,Zhenlin Wang,Shining Zhu,Din Ping Tsai,Din Ping Tsai,Din Ping Tsai +17 more
TL;DR: Integrating the Pancharatnam–Berry phase with integrated resonant nanoantennas in a metalens design produces an achromatic device capable of full-colour imaging in the visible range in transmission mode.
References
More filters
Proceedings ArticleDOI
Light field rendering
Marc Levoy,Pat Hanrahan +1 more
TL;DR: This paper describes a sampled representation for light fields that allows for both efficient creation and display of inward and outward looking views, and describes a compression system that is able to compress the light fields generated by more than a factor of 100:1 with very little loss of fidelity.
Proceedings ArticleDOI
The lumigraph
TL;DR: A new method for capturing the complete appearance of both synthetic and real world objects and scenes, representing this information, and then using this representation to render images of the object from new camera positions.
Book
Physically Based Rendering: From Theory to Implementation
Matt Pharr,Greg Humphreys +1 more
TL;DR: Physically Based Rendering: From Theory to Implementation, Third Edition, describes both the mathematical theory behind a modern photorealistic rendering system and its practical implementation through a method known as 'literate programming', which serves as an essential resource on physically-based rendering.
Journal ArticleDOI
High performance imaging using large camera arrays
Bennett Wilburn,Neel Joshi,Vaibhav Vaish,Eino-Ville Talvala,Emilio Antúnez,Adam Barth,Andrew Adams,Mark Horowitz,Marc Levoy +8 more
TL;DR: A unique array of 100 custom video cameras that are built are described, and their experiences using this array in a range of imaging applications are summarized.
Journal ArticleDOI
Single lens stereo with a plenoptic camera
Edward H. Adelson,J.Y.A. Wang +1 more
TL;DR: The authors describe a camera for performing single lens stereo analysis, which incorporates a single main lens along with a lenticular array placed at the sensor plane and extracts information about both horizontal and vertical parallax, which improves the reliability of the depth estimates.