This paper presents a camera that samples the 4D light field on its sensor in a single photographic exposure. This is achieved by inserting a microlens array between the sensor and main lens, creating a plenoptic camera. Each microlens measures not just the total amount of light deposited at that location, but how much light arrives along each ray. By re-sorting the measured rays of light to where they would have terminated in slightly different, synthetic cameras, we can compute sharp photographs focused at different depths. We show that a linear increase in the resolution of images under each microlens results in a linear increase in the sharpness of the refocused photographs. This property allows us to extend the depth of field of the camera without reducing the aperture, enabling shorter exposures and lower image noise. Especially in the macrophotography regime, we demonstrate that we can also compute synthetic photographs from a range of different viewpoints. These capabilities argue for a different strategy in designing photographic imaging systems. To the photographer, the plenoptic camera operates exactly like an ordinary hand-held camera. We have used our prototype to take hundreds of light field photographs, and we present examples of portraits, high-speed action and macro close-ups.

/pdf/light-field-photography-with-a-hand-held-plenoptic-camera-2b78mve9lr.pdf

Light field photography with a hand-held plenoptic camera

Today cross-cutting approaches, where molecular engineering and clever processing are synergistically coupled, allow the chemist to tailor complex hybrid systems of various shapes with perfect mastery at different size scales, composition, functionality, and morphology. Hybrid materials with organic–inorganic or bio–inorganic character represent not only a new field of basic research but also, via their remarkable new properties and multifunctional nature, hybrids offer prospects for many new applications in extremely diverse fields. The description and discussion of the major applications of hybrid inorganic–organic (or biologic) materials are the major topic of this critical review. Indeed, today the very large set of accessible hybrid materials span a wide spectrum of properties which yield the emergence of innovative industrial applications in various domains such as optics, micro-electronics, transportation, health, energy, housing, and the environment among others (526 references).

Applications of advanced hybrid organic–inorganic nanomaterials: from laboratory to market

In arthropods, evolution has created a remarkably sophisticated class of imaging systems, with a wide-angle field of view, low aberrations, high acuity to motion and an infinite depth of field. A challenge in building digital cameras with the hemispherical, compound apposition layouts of arthropod eyes is that essential design requirements cannot be met with existing planar sensor technologies or conventional optics. Here we present materials, mechanics and integration schemes that afford scalable pathways to working, arthropod-inspired cameras with nearly full hemispherical shapes (about 160 degrees). Their surfaces are densely populated by imaging elements (artificial ommatidia), which are comparable in number (180) to those of the eyes of fire ants (Solenopsis fugax) and bark beetles (Hylastes nigrinus). The devices combine elastomeric compound optical elements with deformable arrays of thin silicon photodetectors into integrated sheets that can be elastically transformed from the planar geometries in which they are fabricated to hemispherical shapes for integration into apposition cameras. Our imaging results and quantitative ray-tracing-based simulations illustrate key features of operation. These general strategies seem to be applicable to other compound eye devices, such as those inspired by moths and lacewings (refracting superposition eyes), lobster and shrimp (reflecting superposition eyes), and houseflies (neural superposition eyes).

Digital cameras with designs inspired by the arthropod eye

Manufacturing and measurement of freeform optics

This work presents the fabrication of biologically inspired artificial compound eyes The artificial ommatidium, like that of an insect's compound eyes, consists of a refractive polymer microlens, a light-guiding polymer cone, and a self-aligned waveguide to collect light with a small angular acceptance The ommatidia are omnidirectionally arranged along a hemispherical polymer dome such that they provide a wide field of view similar to that of a natural compound eye The spherical configuration of the microlenses is accomplished by reconfigurable microtemplating, that is, polymer replication using the deformed elastomer membrane with microlens patterns The formation of polymer waveguides self-aligned with microlenses is also realized by a self-writing process in a photosensitive polymer resin The angular acceptance is directly measured by three-dimensional optical sectioning with a confocal microscope, and the detailed optical characteristics are studied in comparison with a natural compound eye

http://science.sciencemag.org/content/sci/312/5773/557.full.pdf

Biologically inspired artificial compound eyes.

Natural compound eyes combine small eye volumes with a large field of view at the cost of comparatively low spatial resolution. For small invertebrates such as flies or moths, compound eyes are the perfectly adapted solution to obtaining sufficient visual information about their environment without overloading their brains with the necessary image processing. However, to date little effort has been made to adopt this principle in optics. Classical imaging always had its archetype in natural single aperture eyes which, for example, human vision is based on. But a high-resolution image is not always required. Often the focus is on very compact, robust and cheap vision systems. The main question is consequently: what is the better approach for extremely miniaturized imaging systems—just scaling of classical lens designs or being inspired by alternative imaging principles evolved by nature in the case of small insects? In this paper, it is shown that such optical systems can be achieved using state-of-the-art micro-optics technology. This enables the generation of highly precise and uniform microlens arrays and their accurate alignment to the subsequent optics-, spacing- and optoelectronics structures. The results are thin, simple and monolithic imaging devices with a high accuracy of photolithography. Two different artificial compound eye concepts for compact vision systems have been investigated in detail: the artificial apposition compound eye and the cluster eye. Novel optical design methods and characterization tools were developed to allow the layout and experimental testing of the planar micro-optical imaging systems, which were fabricated for the first time by micro-optics technology. The artificial apposition compound eye can be considered as a simple imaging optical sensor while the cluster eye is capable of becoming a valid alternative to classical bulk objectives but is much more complex than the first system.

/pdf/micro-optical-artificial-compound-eyes-1qxmy3at03.pdf

Micro-optical artificial compound eyes.

An artificial compound-eye objective fabricated by micro-optics technology is adapted and attached to a CMOS sensor array. The novel optical sensor system with an optics thickness of only 0.2 mm is examined with respect to resolution and sensitivity. An optical resolution of 60 × 60 pixels is determined from captured images. The scaling behavior of artificial compound-eye imaging systems is analyzed. Cross talk between channels fabricated by different technologies is evaluated, and the influence on an extension of the field of view by addition of a (Fresnel) diverging lens is discussed. The lithographic generation of opaque walls between channels for optical isolation is experimentally demonstrated.

Thin compound-eye camera

By exploring micro-optical design principles and technology, we have developed an artificial apposition compound eye. The overall thickness of the imaging system is only 320 microm, the diagonal field of view is 21 degrees, and the f-number is 2.6. The monolithic device consists of an UV-replicated microlens array upon a thin silica substrate with a pinhole array in a metal layer on the back side. The pitch of the pinholes differs from that of the lens array to provide individual viewing angle for each channel. Theoretical limitations of resolution and sensitivity are discussed as well as fabrication issues and compared with experimental results. A method to generate nontransparent walls between optical channels to prevent cross talk is proposed.

/pdf/artificial-apposition-compound-eye-fabricated-by-micro-vhm5eqrpd0.pdf

Artificial apposition compound eye fabricated by micro-optics technology

We propose a microoptical approach to ultra-compact optics for real-time vision systems that are inspired by the compound eyes of insects. The demonstrated module achieves approx. VGA resolution with a total track length of 1.4 mm which is about two times shorter than comparable single-aperture optics on images sensors of the same pixel pitch. The partial images that are separately recorded in different optical channels are stitched together to form a final image of the whole field of view by means of image processing. A software correction is applied to each partial image so that the final image is made free of distortion. The microlens arrays are realized by state of the art microoptical fabrication techniques on wafer-level which are suitable for a potential application in high volume e.g. for consumer electronic products.

Thin wafer-level camera lenses inspired by insect compound eyes

A new optical concept for compact digital image acquisition devices with large field of view is developed and proofed experimentally. Archetypes for the imaging system are compound eyes of small insects and the Gabor-Superlens. A paraxial 3x3 matrix formalism is used to describe the telescope arrangement of three microlens arrays with different pitch to find first order parameters of the imaging system. A 2mm thin imaging system with 21x3 channels, 70 masculinex10 masculine field of view and 4.5mm x 0.5mm image size is optimized and analyzed using sequential and non-sequential raytracing and fabricated by microoptics technology. Anamorphic lenses, where the parameters are a function of the considered optical channel, are used to achieve a homogeneous optical performance over the whole field of view. Captured images are presented and compared to simulation results.

Jacques Duparré

Papers

Micro-optical artificial compound eyes.

Thin compound-eye camera

Artificial apposition compound eye fabricated by micro-optics technology

Thin wafer-level camera lenses inspired by insect compound eyes

Microoptical telescope compound eye