Objective methods for assessing perceptual image quality traditionally attempted to quantify the visibility of errors (differences) between a distorted image and a reference image using a variety of known properties of the human visual system. Under the assumption that human visual perception is highly adapted for extracting structural information from a scene, we introduce an alternative complementary framework for quality assessment based on the degradation of structural information. As a specific example of this concept, we develop a structural similarity index and demonstrate its promise through a set of intuitive examples, as well as comparison to both subjective ratings and state-of-the-art objective methods on a database of images compressed with JPEG and JPEG2000. A MATLAB implementation of the proposed algorithm is available online at http://www.cns.nyu.edu//spl sim/lcv/ssim/.

/pdf/image-quality-assessment-from-error-visibility-to-structural-1rlwcqe34t.pdf

Image quality assessment: from error visibility to structural similarity

A visual attention system, inspired by the behavior and the neuronal architecture of the early primate visual system, is presented. Multiscale image features are combined into a single topographical saliency map. A dynamical neural network then selects attended locations in order of decreasing saliency. The system breaks down the complex problem of scene understanding by rapidly selecting, in a computationally efficient manner, conspicuous locations to be analyzed in detail.

/pdf/a-model-of-saliency-based-visual-attention-for-rapid-scene-wv0n3yqxix.pdf

A model of saliency-based visual attention for rapid scene analysis

https://surfer.nmr.mgh.harvard.edu/ftp/articles/dale99-recon1.pdf

Cortical surface-based analysis. I. Segmentation and surface reconstruction

Co-Planar Stereotaxic Atlas of the Human Brain—3-Dimensional Proportional System: An Approach to Cerebral Imaging, J. Talairach, P. Tournoux. Georg Thieme Verlag, New York (1988), 122 pp., 130 figs. DM 268

Passband balanced-steady-state free precession (b-SSFP) fMRI is a recently developed method that utilizes the passband (flat portion) of the b-SSFP off-resonance response to measure MR signal changes elicited by changes in tissue oxygenation following increases in neuronal activity. Rapid refocusing and short readout durations of b-SSFP, combined with the relatively large flat portion of the b-SSFP off-resonance spectrum allows distortion-free full-brain coverage with only two acquisitions. This allows for high-resolution functional imaging, without the spatial distortion frequently encountered in conventional high-resolution functional images. Finally, the 3D imaging compatibility of the b-SSFP acquisitions permits isotropic-voxel-size high-resolution acquisitions. In this study we address some of the major technical issues involved in obtaining passband b-SSFP-based functional brain images with practical imaging parameters and demonstrate the advantages through breath-holding and visual field mapping experiments. Magn Reson Med, 2008. © 2008 Wiley-Liss, Inc.

Full-brain coverage and high-resolution imaging capabilities of passband b-SSFP fMRI at 3T

A field-additive pathway detects brief-duration, long-wavelength incremental flashes

Previous 'mind-reading' studies have differentiated patterns of brain activity without understanding the underlying processes. A new study in Nature uses a model of neural encoding mechanisms to identify brain activity patterns.

What's in your mind?

The steady increase in CMOS imager pixel count is built on the technology advances summarized as Moore's law. Because imagers must interact with light, Moore's Law impact differs from its impact on other integrated circuit applications. In this paper, we investigate how the trend towards smaller pixels interacts with two fundamental properties of light: photon noise and diffraction. Using simulations, we investigate three consequences of decreasing pixel size on image quality. First, we quantify the likelihood that photon noise will become visible and derive a noise-visibility contour map based on photometric exposure and pixel size. Second, we illustrate the consequence of diffraction and optical imperfections on image quality and analyze the implications of decreasing pixel size for aliasing in monochrome and color sensors. Third, we calculate how decreasing pixel size impacts the effective use of microlens arrays and derive curves for the concentration and redirection of light within the pixel.

/pdf/roadmap-for-cmos-image-sensors-moore-meets-planck-and-3b3l62wpqh.pdf

Roadmap for CMOS image sensors: Moore meets Planck and Sommerfeld

Theories of color measurement attempt to provide a quantative means for predicting whether two lights will be discriminable to an average observer. All color measurement theories can be characterized as follows: suppose lights a and b evoke responses from three color channels characterized as vectors, v(a) and v(b); the vector difference v(a) - v(b) corresponds to a set of channel responses that would be generated by some real light, call it *. According to theory a and b will be discriminable when * is detectable. A detailed development and test of the classic color measurement approach are reported. In the absence of a luminance component in the test stimuli, a and b, the theory holds well. In the presence of a luminance component, the theory is clearly false. When a luminance component is present discrimination judgements depend largely on whether the lights being discriminated fall in separate, categorical regions of color space. The results suggest that sensory estimation of surface color uses different methods, and the choice of method depends upon properties of the image. When there is significant luminance variation a categorical method is used, while in the absence of significant luminance variation judgments are continuous and consistant with the measurement approach.

/pdf/color-measurement-and-discrimination-56q6irbf65.pdf

Brian A. Wandell

Papers

Full-brain coverage and high-resolution imaging capabilities of passband b-SSFP fMRI at 3T

A field-additive pathway detects brief-duration, long-wavelength incremental flashes

What's in your mind?

Roadmap for CMOS image sensors: Moore meets Planck and Sommerfeld

Color measurement and discrimination