From the Publisher: 
The accessible presentation of this book gives both a general view of the entire computer vision enterprise and also offers sufficient detail to be able to build useful applications. Users learn techniques that have proven to be useful by first-hand experience and a wide range of mathematical methods. A CD-ROM with every copy of the text contains source code for programming practice, color images, and illustrative movies. Comprehensive and up-to-date, this book includes essential topics that either reflect practical significance or are of theoretical importance. Topics are discussed in substantial and increasing depth. Application surveys describe numerous important application areas such as image based rendering and digital libraries. Many important algorithms broken down and illustrated in pseudo code. Appropriate for use by engineers as a comprehensive reference to the computer vision enterprise.

Computer vision : a modern approach = 计算机视觉 : 一种现代的方法

Introduction to linear and nonlinear programming

50 Years of Image Analysis

The diffraction tomography theorem is adapted to one-dimensional length measurement. The resulting spectral interferometry technique is described and the first length measurements using this technique on a model eye and on a human eye in vivo are presented.

Measurement of intraocular distances by backscattering spectral interferometry

If I provide you a face image of mine (without telling you the actual age when I took the picture) and a large amount of face images that I crawled (containing labeled faces of different ages but not necessarily paired), can you show me what I would look like when I am 80 or what I was like when I was 5? The answer is probably a No. Most existing face aging works attempt to learn the transformation between age groups and thus would require the paired samples as well as the labeled query image. In this paper, we look at the problem from a generative modeling perspective such that no paired samples is required. In addition, given an unlabeled image, the generative model can directly produce the image with desired age attribute. We propose a conditional adversarial autoencoder (CAAE) that learns a face manifold, traversing on which smooth age progression and regression can be realized simultaneously. In CAAE, the face is first mapped to a latent vector through a convolutional encoder, and then the vector is projected to the face manifold conditional on age through a deconvolutional generator. The latent vector preserves personalized face features (i.e., personality) and the age condition controls progression vs. regression. Two adversarial networks are imposed on the encoder and generator, respectively, forcing to generate more photo-realistic faces. Experimental results demonstrate the appealing performance and flexibility of the proposed framework by comparing with the state-of-the-art and ground truth.

/pdf/age-progression-regression-by-conditional-adversarial-4o0qnp7kc0.pdf

Age Progression/Regression by Conditional Adversarial Autoencoder

Removing non-uniform blurring caused by camera shake has been troublesome for its high computational cost. To accelerate the non-uniform deblurring process, this paper analyzes the efficiency bottleneck of the non-uniform deblurring algorithms and proposes to implement the time-consuming and repeatedly required module, i.e. non-uniform convolution, by optical computing. Specifically, the non-uniform convolution is simulated by an off-the-shelf projector together with a camera mounted on a programmable motion platform. Benefiting from the high speed and parallelism of optical computation, our system is able to accelerate most existing non-uniform camera shake removing algorithms extensively. We develop a prototype system which can fast compute non-uniform convolution for the blurring image of planar scene caused by 3D rotation. By incorporating it into an iterative deblurring framework, the effectiveness of proposed system is verified.

/pdf/optical-computing-system-for-fast-non-uniform-image-2m5m07hurq.pdf

Optical Computing System for Fast Non-uniform Image Deblurring

Special Section on Advanced Displays: Non-uniform image deblurring using an optical computing system

Specular reflection exists widely in photography and causes the recorded color deviating from its true value, so fast and high quality highlight removal from a single nature image is of great importance. In spite of the progress in the past decades in highlight removal, achieving wide applicability to the large diversity of nature scenes is quite challenging. To handle this problem, we propose an analytic solution to highlight removal based on an L2 chromaticity definition and corresponding dichromatic model. Specifically, this paper derives a normalized dichromatic model for the pixels with identical diffuse color: a unit circle equation of projection coefficients in two subspaces that are orthogonal to and parallel with the illumination, respectively. In the former illumination orthogonal subspace, which is specular-free, we can conduct robust clustering with an explicit criterion to determine the cluster number adaptively. In the latter illumination parallel subspace, a property called pure diffuse pixels distribution rule (PDDR) helps map each specular-influenced pixel to its diffuse component. In terms of efficiency, the proposed approach involves few complex calculation, and thus can remove highlight from high resolution images fast. Experiments show that this method is of superior performance in various challenging cases.

/pdf/fast-and-high-quality-highlight-removal-from-a-single-image-5fpzdyl1hq.pdf

Fast and High Quality Highlight Removal from A Single Image

High quality imaging usually requires bulky and expensive lenses to compensate geometric and chromatic aberrations. This poses high constraints on the optical hash or low cost applications. Although one can utilize algorithmic reconstruction to remove the artifacts of low-end lenses, the degeneration from optical aberrations is spatially varying and the computation has to trade off efficiency for performance. For example, we need to conduct patch-wise optimization or train a large set of local deep neural networks to achieve high reconstruction performance across the whole image. In this paper, we propose a PSF aware plug-and-play deep network, which takes the aberrant image and PSF map as input and produces the latent high quality version via incorporating lens-specific deep priors, thus leading to a universal and flexible optical aberration correction method. Specifically, we pre-train a base model from a set of diverse lenses and then adapt it to a given lens by quickly refining the parameters, which largely alleviates the time and memory consumption of model learning. The approach is of high efficiency in both training and testing stages. Extensive results verify the promising applications of our proposed approach for compact low-end cameras.

/pdf/universal-and-flexible-optical-aberration-correction-using-2kag5gcnpp.pdf

Universal and Flexible Optical Aberration Correction Using Deep-Prior Based Deconvolution

Snapshot compressive imaging (SCI) aims to capture the high-dimensional (usually 3D) images using a 2D sensor (detector) in a single snapshot. Though enjoying the advantages of low-bandwidth, low-power and low-cost, applying SCI to large-scale problems (HD or UHD videos) in our daily life is still challenging. The bottleneck lies in the reconstruction algorithms; they are either too slow (iterative optimization algorithms) or not flexible to the encoding process (deep learning based end-to-end networks). In this paper, we develop fast and flexible algorithms for SCI based on the plug-and-play (PnP) framework. In addition to the widely used PnP-ADMM method, we further propose the PnP-GAP (generalized alternating projection) algorithm with a lower computational workload and prove the convergence of PnP-GAP under the SCI hardware constraints. By employing deep denoising priors, we first time show that PnP can recover a UHD color video ($3840\times 1644\times 48$ with PNSR above 30dB) from a snapshot 2D measurement. Extensive results on both simulation and real datasets verify the superiority of our proposed algorithm. The code is available at this https URL.

Jinli Suo

Papers

Optical Computing System for Fast Non-uniform Image Deblurring

Special Section on Advanced Displays: Non-uniform image deblurring using an optical computing system

Fast and High Quality Highlight Removal from A Single Image

Universal and Flexible Optical Aberration Correction Using Deep-Prior Based Deconvolution

Plug-and-Play Algorithms for Large-scale Snapshot Compressive Imaging