There has been great interest in researching and implementing effective technologies for the capture, processing, and display of 3D images. This broad interest is evidenced by widespread international research and activities on 3D technologies. There is a large number of journal and conference papers on 3D systems, as well as research and development efforts in government, industry, and academia on this topic for broad applications including entertainment, manufacturing, security and defense, and biomedical applications. Among these technologies, integral imaging is a promising approach for its ability to work with polychromatic scenes and under incoherent or ambient light for scenarios from macroscales to microscales. Integral imaging systems and their variations, also known as plenoptics or light-field systems, are applicable in many fields, and they have been reported in many applications, such as entertainment (TV, video, movies), industrial inspection, security and defense, and biomedical imaging and displays. This tutorial is addressed to the students and researchers in different disciplines who are interested to learn about integral imaging and light-field systems and who may or may not have a strong background in optics. Our aim is to provide the readers with a tutorial that teaches fundamental principles as well as more advanced concepts to understand, analyze, and implement integral imaging and light-field-type capture and display systems. The tutorial is organized to begin with reviewing the fundamentals of imaging, and then it progresses to more advanced topics in 3D imaging and displays. More specifically, this tutorial begins by covering the fundamentals of geometrical optics and wave optics tools for understanding and analyzing optical imaging systems. Then, we proceed to use these tools to describe integral imaging, light-field, or plenoptics systems, the methods for implementing the 3D capture procedures and monitors, their properties, resolution, field of view, performance, and metrics to assess them. We have illustrated with simple laboratory setups and experiments the principles of integral imaging capture and display systems. Also, we have discussed 3D biomedical applications, such as integral microscopy.

/pdf/fundamentals-of-3d-imaging-and-displays-a-tutorial-on-4xjz6ahphh.pdf

Fundamentals of 3D imaging and displays: a tutorial on integral imaging, light-field, and plenoptic systems

Holography is considered to be the ultimate display technology since it can account for all human visual cues such as stereopsis and eye focusing. Aside from hardware constraints for building holographic displays, there are still many research challenges regarding holographic signal processing that need to be tackled. In this overview, we delineate the steps needed to realize an end-to-end chain from digital content acquisition to display, involving the efficient generation, representation, coding and quality assessment of digital holograms. We discuss the current state-of-the-art and what hurdles remain to be taken to pave the way towards realistic visualization of dynamic holographic content.

https://biblio.vub.ac.be/vubirfiles/40443189/Blinder_SPIC_2019.pdf

Signal processing challenges for digital holographic video display systems

Digital micromirror devices (DMDs) have become ubiquitous as spatial light modulators in the optics community, but ambiguity remains on how best to implement them in a laboratory environment. Here, we explicitly tackle the problem of generating high fidelity modes of structured light while maintaining optical efficiency. We present a theoretical characterization of the diffractive properties of the DMD, allowing us to motivate an alignment procedure that improves optical efficiency. We also present a set of best practice recommendations that cover aspects of DMD operation that are not immediately intuitive, these best practice recommendations ensure structured light is generated with the correct spatial profile and wavefront. We present experimental results that show efficiency improvements of up to 20%. Further, we demonstrate the creation of modes of structured light with fidelities in excess of 96%. The best practices presented here provide a pragmatic set of procedures for ensuring DMDs are used to their fullest potential.

Structured light with digital micromirror devices: a guide to best practice

A speckle-reduction method with random locations of sparse object points is proposed for image quality improvement based on a time-multiplexing approach in holographic reconstruction. The object points of a reconstructed image are divided into groups of sparse object points. Pixel separation of the periodic location, in general, is used for the sparse object points. However, an unwanted periodic fringe pattern is caused, and it dominantly degrades the reconstructed image quality. The proposed random pixel separation enables the reconstructed image quality to improve more effectively. The numerical simulation and the optical experiment are presented to confirm the performance of the proposed method.

Speckle reduction in holographic projection by random pixel separation with time multiplexing.

We have developed a three-dimensional (3D) dynamic integral-imaging (InIm)-system-based optical see-through augmented reality display with enhanced depth range of a 3D augmented image A focus-tunable lens is adopted in the 3D display unit to relay the elemental images with various positions to the micro lens array Based on resolution priority integral imaging, multiple lenslet image planes are generated to enhance the depth range of the 3D image The depth range is further increased by utilizing both the real and virtual 3D imaging fields The 3D reconstructed image and the real-world scene are overlaid using an optical see-through display for augmented reality The proposed system can significantly enhance the depth range of a 3D reconstructed image with high image quality in the micro InIm unit This approach provides enhanced functionality for augmented information and adjusts the vergence-accommodation conflict of a traditional augmented reality display

Large depth of focus dynamic micro integral imaging for optical see-through augmented reality display using a focus-tunable lens.

The image space of the reconstructed image from the hologram displayed on a digital micromirror device (DMD) is defined by the diffraction pattern induced by the 2D pixel pattern of the DMD, which works as a 2D blazed grating. Within this space, a reconstructed image of 100 mm × 20 mm is spatially multiplexed by a 2 × 5 DMD array that is aligned on a board, without using any extra optics. Each DMD chip reconstructs an image piece of the size 20 mm (width) × 10 mm (height). The reconstructed image looks somewhat noisy but regenerates the original object image faithfully.

Holographic display based on a spatial DMD array.

Light-field imaging and holographic imaging are currently the two mostly investigated 3-D imaging technologies because of their potentials to create the viewing environment conforming to a natural viewing condition. The basic optical geometries for image display in these imaging are not different from that of integral photography. The images in the two type of imaging are a set of different view images. These images are arranged as a 2-D point image array, and each point image is expanded with a certain angle to form a viewing zone. The differences between the two types of imaging are the number of point images in the array and the physical entities forming the images. Holographic imaging has many more point images than light-field imaging, and each image in the array consists of coherent right rays from different positions of an object. In light-field imaging, an array of pixels represents a direction view of the object. Despite these differences, they share the same goal of providing a continuous parallax to viewers and require display panels of almost the same characteristics. It is expected that in the future these two imaging techniques will be integrated into the same flat panel along with the plane image.

Holographic and Light-Field Imaging as Future 3-D Displays

Digital micromirror device’s (DMD) properties as being a display device for holographic displays are investigated. High speed, a large separation between reconstructed image and reconstruction beam, two symmetric diffraction patterns, and low intensity (0,0)th-order beam at a blazed grating condition are the desired properties for the displays. The blazed grating condition of a DMD can reconstruct images with higher diffraction efficiency than the line grating condition. DMD’s high speed enables to present colors and gray levels to the reconstructed image. However, reconstructed images from a gray-level computer-generated hologram (CGH) and its binary form hologram reveal no noticeable difference between them, except the background noise in the image from the CGH.

Properties of DMDs for holographic displays

A floating image type holographic display which projects an electronically generated holographic image together with a background image displayed on a monitor/TV to enhance the visual effects of the former image is introduced. This display can display a holographic image with a spatial volume floating in the front space of the display with use of PDLC sheets as the focused plane of the image. This display can preserve and enhance the main property of holographic image from a display chip, i.e., a spatial image with a volume. This property had not been appealed by the previous holographic displays due to the much brighter active surface image accompanied with the reconstructed image and the diffuser used for viewing the image.

A floating type holographic display

The compositions of images projected to a viewer’s eyes from the various viewing regions of the viewing zone formed in one-dimensional integral photography (IP) and multiview imaging (MV) are identified. These compositions indicate that they are made up of pieces from different view images. Comparisons of the composite images with images composited at various regions of imaging space formed by camera arrays for multiview image acquisition reveal that the composite images do not involve any scene folding in the central viewing zone for either MV or IP. However, in the IP case, compositions from neighboring viewing regions aligned in the horizontal direction have reversed disparities, but in the viewing regions between the central and side viewing zones, no reversed disparities are expected. However, MV does exhibit them.

Beom-Ryeol Lee

Papers

Holographic display based on a spatial DMD array.

Holographic and Light-Field Imaging as Future 3-D Displays

Properties of DMDs for holographic displays

A floating type holographic display

Characteristics of composite images in multiview imaging and integral photography.