We describe methods for learning dictionaries that are appropriate for the representation of given classes of signals and multisensor data. We further show that dimensionality reduction based on dictionary representation can be extended to address specific tasks such as data analy sis or classification when the learning includes a class separability criteria in the objective function. The benefits of dictionary learning clearly show that a proper understanding of causes underlying the sensed world is key to task-specific representation of relevant information in high-dimensional data sets.

Dictionary Learning

Within the field of spectral imaging, the vast majority of instruments used are scanning devices. Recently, several snapshot spectral imaging systems have become commercially available, providing new functionality for users and opening up the field to a wide array of new applications. A comprehensive survey of the available snapshot technologies is provided, and an attempt has been made to show how the new capabilities of snapshot approaches can be fully utilized.

https://www.spiedigitallibrary.org/journals/optical-engineering/volume-52/issue-9/090901/Review-of-snapshot-spectral-imaging-technologies/10.1117/1.OE.52.9.090901.pdf

Review of snapshot spectral imaging technologies

By leveraging metamaterials and compressive imaging, a low-profile aperture capable of microwave imaging without lenses, moving parts, or phase shifters is demonstrated. This designer aperture allows image compression to be performed on the physical hardware layer rather than in the postprocessing stage, thus averting the detector, storage, and transmission costs associated with full diffraction-limited sampling of a scene. A guided-wave metamaterial aperture is used to perform compressive image reconstruction at 10 frames per second of two-dimensional (range and angle) sparse still and video scenes at K-band (18 to 26 gigahertz) frequencies, using frequency diversity to avoid mechanical scanning. Image acquisition is accomplished with a 40:1 compression ratio.

http://science.sciencemag.org/content/sci/339/6117/310.full.pdf

Metamaterial Apertures for Computational Imaging

Compressive holography estimates images from incomplete data by using sparsity priors. Compressive holography combines digital holography and compressive sensing. Digital holography consists of computational image estimation from data captured by an electronic focal plane array. Compressive sensing enables accurate data reconstruction by prior knowledge on desired signal. Computational and optical co-design optimally supports compressive holography in the joint computational and optical domain. This dissertation explores two examples of compressive holography: estimation of 3D tomographic images from 2D data and estimation of images from under sampled apertures. 
Compressive holography achieves single shot holographic tomography using decompressive inference. In general, 3D image reconstruction suffers from underdetermined measurements with a 2D detector. Specifically, single shot holographic tomography shows the uniqueness problem in the axial direction because the inversion is ill-posed. Compressive sensing alleviates the ill-posed problem by enforcing some sparsity constraints. Holographic tomography is applied for video-rate microscopic imaging and diffuse object imaging. In diffuse object imaging, sparsity priors are not valid in coherent image basis due to speckle. So incoherent image estimation is designed to hold the sparsity in incoherent image basis by support of multiple speckle realizations. 
High pixel count holography achieves high resolution and wide field-of-view imaging. Coherent aperture synthesis can be one method to increase the aperture size of a detector. Scanning-based synthetic aperture confronts a multivariable global optimization problem due to time-space measurement errors. A hierarchical estimation strategy divides the global problem into multiple local problems with support of computational and optical co-design. Compressive sparse aperture holography can be another method. Compressive sparse sampling collects most of significant field information with a small fill factor because object scattered fields are locally redundant. Incoherent image estimation is adopted for the expanded modulation transfer function and compressive reconstruction.

Compressive holography

A coded aperture snapshot spectral imager (CASSI) estimates the three-dimensional spatiospectral data cube from a snapshot two-dimensional coded projection, assuming that the scene is spatially and spectrally sparse. For less spectrally sparse scenes, we show that the use of multiple nondegenerate snapshots can make data cube recovery less ill-posed, yielding improved spatial and spectral reconstruction fidelity. Additionally, data acquisition can be easily scaled to meet the time/resolution requirements of the scene with little modification or extension of the original CASSI hardware. A multiframe reconstruction of a 640 × 480 × 53 voxel datacube with 450-650 nm white-light illumination of a scene reveals substantial improvement in the reconstruction fidelity, with limited increase in acquisition and reconstruction time.

Multiframe image estimation for coded aperture snapshot spectral imagers

We describe an active millimeter-wave holographic imaging system that uses compressive measurements for three-dimensional (3D) tomographic object estimation. Our system records a two-dimensional (2D) digitized Gabor hologram by translating a single pixel incoherent receiver. Two approaches for compressive measurement are undertaken: nonlinear inversion of a 2D Gabor hologram for 3D object estimation and nonlinear inversion of a randomly subsampled Gabor hologram for 3D object estimation. The object estimation algorithm minimizes a convex quadratic problem using total variation (TV) regularization for 3D object estimation. We compare object reconstructions using linear backpropagation and TV minimization, and we present simulated and experimental reconstructions from both compressive measurement strategies. In contrast with backpropagation, which estimates the 3D electromagnetic field, TV minimization estimates the 3D object that produces the field. Despite undersampling, range resolution is consistent with the extent of the 3D object band volume.

/pdf/millimeter-wave-compressive-holography-2495vvhy1m.pdf

Millimeter-wave compressive holography.

We apply a coded aperture snapshot spectral imager (CASSI) to fluorescence microscopy. CASSI records a two-dimensional (2D) spectrally filtered projection of a three-dimensional (3D) spectral data cube. We minimize a convex quadratic function with total variation (TV) constraints for data cube estimation from the 2D snapshot. We adapt the TV minimization algorithm for direct fluorescent bead identification from CASSI measurements by combining a priori knowledge of the spectra associated with each bead type. Our proposed method creates a 2D bead identity image. Simulated fluorescence CASSI measurements are used to evaluate the behavior of the algorithm. We also record real CASSI measurements of a ten bead type fluorescence scene and create a 2D bead identity map. A baseline image from filtered-array imaging system verifies CASSI's 2D bead identity map.

/pdf/identification-of-fluorescent-beads-using-a-coded-aperture-k6lxdb62y8.pdf

Christy Fernandez Cull

Papers

Millimeter-wave compressive holography.

Identification of fluorescent beads using a coded aperture snapshot spectral imager.