Modern cameras typically use an array of millions of detector pixels to capture images. By contrast, single-pixel cameras use a sequence of mask patterns to filter the scene along with the corresponding measurements of the transmitted intensity which is recorded using a single-pixel detector. This review considers the development of single-pixel cameras from the seminal work of Duarte et al. up to the present state of the art. We cover the variety of hardware configurations, design of mask patterns and the associated reconstruction algorithms, many of which relate to the field of compressed sensing and, more recently, machine learning. Overall, single-pixel cameras lend themselves to imaging at non-visible wavelengths and with precise timing or depth resolution. We discuss the suitability of single-pixel cameras for different application areas, including infrared imaging and 3D situation awareness for autonomous vehicles.

Single-pixel imaging 12 years on: a review

https://simidat.ujaen.es/sites/default/files/biblio/2018-CAEPIA-TutorialAEs.pdf

A practical tutorial on autoencoders for nonlinear feature fusion: taxonomy, models, software and guidelines

Single-pixel imaging which employs active illumination to acquire spatial information is an innovative imaging scheme and has received increasing attentions in recent years. It is applicable to imaging at non-visible wavelengths and imaging under low light conditions. However, single-pixel imaging has once encountered problems of low reconstruction quality and long data-acquisition time. Hadamard single-pixel imaging (HSI) and Fourier single-pixel imaging (FSI) are two representative deterministic model based techniques. Both techniques are able to achieve high-quality and efficient imaging, remarkably improving the applicability of single-pixel imaging scheme. In this paper, we compare the performances of HSI and FSI with theoretical analysis and experiments. The results show that FSI is more efficient than HSI while HSI is more noise-robust than FSI. Our work may provide a guideline for researchers to choose suitable single-pixel imaging technique for their applications.

Hadamard single-pixel imaging versus Fourier single-pixel imaging.

Single-pixel cameras provide a means to perform imaging at wavelengths where pixelated detector arrays are expensive or limited. The image is reconstructed from measurements of the correlation between the scene and a series of masks. Although there has been much research in the field in recent years, the fact that the signal-to-noise ratio (SNR) scales poorly with increasing resolution has been one of the main limitations prohibiting the uptake of such systems. Microscanning is a technique that provides a final higher resolution image by combining multiple images of a lower resolution. Each of these low resolution images is subject to a sub-pixel sized lateral displacement. In this work we apply a digital microscanning approach to an infrared single-pixel camera. Our approach requires no additional hardware, but is achieved simply by using a modified set of masks. Compared to the conventional Hadamard based single-pixel imaging scheme, our proposed framework improves the SNR of reconstructed images by ∼ 50 % for the same acquisition time. In addition, this strategy also provides access to a stream of low-resolution ‘preview’ images throughout each high-resolution acquisition.

Improving the signal-to-noise ratio of single-pixel imaging using digital microscanning

Information security is a critical issue in modern society and image watermarking can effectively prevent unauthorized information access. Optical image watermarking techniques generally have advantages of parallel high-speed processing and multi-dimensional capabilities compared to digital approaches. This paper provides a comprehensive review of the research works related to optical image hiding and watermarking techniques conducted in the past decade. The past research works have focused on two major aspects: various optical systems for image hiding, and the methods for embedding the optical system output into a host image. A summary of the state-of-the-art works is made from these two perspectives.

Review on optical image hiding and watermarking techniques

Computational ghost imaging using deep learning

We propose a random phase-free kinoform for large objects. When not using the random phase in kinoform calculation, the reconstructed images from the kinoform are heavy degraded, like edge-only preserved images. In addition, the kinoform cannot record an entire object that exceeds the kinoform size because the object light does not widely spread. In order to avoid this degradation and to widely spread the object light, the random phase is applied to the kinoform calculation; however, the reconstructed image is contaminated by speckle noise. In this paper, we overcome this problem by using our random phase-free method and error diffusion method.

Random phase-free kinoform for large objects.

We propose a deep-learning-based classification of data pages used in holographic memory. We numerically investigated the classification performance of a conventional multilayer perceptron (MLP) and a deep neural network, under the condition that reconstructed page data are contaminated by some noise and are randomly laterally shifted. When data pages are randomly laterally shifted, the MLP was found to have a classification accuracy of 93.02%, whereas the deep neural network was able to classify data pages at an accuracy of 99.98%. The accuracy of the deep neural network is 2 orders of magnitude better than the MLP.

Yuki Nagahama

Papers

Computational ghost imaging using deep learning

Random phase-free kinoform for large objects.

Convolutional neural network-based data page classification for holographic memory

Random phase-free kinoform for large objects

Improvement of the image quality of random phase-free holography using an iterative method