Registration is a fundamental task in image processing used to match two or more pictures taken, for example, at different times, from different sensors, or from different viewpoints. Virtually all large systems which evaluate images require the registration of images, or a closely related operation, as an intermediate step. Specific examples of systems where image registration is a significant component include matching a target with a real-time image of a scene for target recognition, monitoring global land usage using satellite images, matching stereo images to recover shape for autonomous navigation, and aligning images from different medical modalities for diagnosis.Over the years, a broad range of techniques has been developed for various types of data and problems. These techniques have been independently studied for several different applications, resulting in a large body of research. This paper organizes this material by establishing the relationship between the variations in the images and the type of registration techniques which can most appropriately be applied. Three major types of variations are distinguished. The first type are the variations due to the differences in acquisition which cause the images to be misaligned. To register images, a spatial transformation is found which will remove these variations. The class of transformations which must be searched to find the optimal transformation is determined by knowledge about the variations of this type. The transformation class in turn influences the general technique that should be taken. The second type of variations are those which are also due to differences in acquisition, but cannot be modeled easily such as lighting and atmospheric conditions. This type usually effects intensity values, but they may also be spatial, such as perspective distortions. The third type of variations are differences in the images that are of interest such as object movements, growths, or other scene changes. Variations of the second and third type are not directly removed by registration, but they make registration more difficult since an exact match is no longer possible. In particular, it is critical that variations of the third type are not removed. Knowledge about the characteristics of each type of variation effect the choice of feature space, similarity measure, search space, and search strategy which will make up the final technique. All registration techniques can be viewed as different combinations of these choices. This framework is useful for understanding the merits and relationships between the wide variety of existing techniques and for assisting in the selection of the most suitable technique for a specific problem.

A survey of image registration techniques

Let's read! We will often find out this sentence everywhere. When still being a kid, mom used to order us to always read, so did the teacher. Some books are fully read in a week and we need the obligation to support reading. What about now? Do you still love reading? Is reading only for you who have obligation? Absolutely not! We here offer you a new book enPDFd the perception of the visual world to read.

The Perception of the Visual World. By James J. Gibson. U.S.A.: Houghton Mifflin Company, 1950 (George Allen & Unwin, Ltd., London). Price 35s.

There are declines with age in speed of processing, working memory, inhibitory function, and long-term memory, as well as decreases in brain structure size and white matter integrity. In the face of these decreases, functional imaging studies have demonstrated, somewhat surprisingly, reliable increases in prefrontal activation. To account for these joint phenomena, we propose the scaffolding theory of aging and cognition (STAC). STAC provides an integrative view of the aging mind, suggesting that pervasive increased frontal activation with age is a marker of an adaptive brain that engages in compensatory scaffolding in response to the challenges posed by declining neural structures and function. Scaffolding is a normal process present across the lifespan that involves use and development of complementary, alternative neural circuits to achieve a particular cognitive goal. Scaffolding is protective of cognitive function in the aging brain, and available evidence suggests that the ability to use this mechanism is strengthened by cognitive engagement, exercise, and low levels of default network engagement.

/pdf/the-adaptive-brain-aging-and-neurocognitive-scaffolding-3igyn72710.pdf

The Adaptive Brain: Aging and Neurocognitive Scaffolding

A classic photographic task is the mapping of the potentially high dynamic range of real world luminances to the low dynamic range of the photographic print. This tone reproduction problem is also faced by computer graphics practitioners who map digital images to a low dynamic range print or screen. The work presented in this paper leverages the time-tested techniques of photographic practice to develop a new tone reproduction operator. In particular, we use and extend the techniques developed by Ansel Adams to deal with digital images. The resulting algorithm is simple and produces good results for a wide variety of images.

/pdf/photographic-tone-reproduction-for-digital-images-k89wmpv97f.pdf

Photographic tone reproduction for digital images

Blood vessels usually have poor local contrast, and the application of existing edge detection algorithms yield results which are not satisfactory. An operator for feature extraction based on the optical and spatial properties of objects to be recognized is introduced. The gray-level profile of the cross section of a blood vessel is approximated by a Gaussian-shaped curve. The concept of matched filter detection of signals is used to detect piecewise linear segments of blood vessels in these images. Twelve different templates that are used to search for vessel segments along all possible directions are constructed. Various issues related to the implementation of these matched filters are discussed. The results are compared to those obtained with other methods. >

/pdf/detection-of-blood-vessels-in-retinal-images-using-two-2lxvrugvz5.pdf

Detection of blood vessels in retinal images using two-dimensional matched filters

RESULTS. Directness of the search path was greatly and significantly improved when the contour or auditory cues were provided in the larger and the smaller area searches. When using the device, a significant reduction in search time (28%74%) was demonstrated by all three subjects in the larger area search and by subjects with VFs wider than 10° in the smaller area search (average, 22%). Directness and gaze speed accounted for 90% of the variability of search time. CONCLUSIONS. Although performance improvement with the device for the larger search area was obvious, whether it was helpful for the smaller search area depended on VF and gaze speed. Because improvement in directness was demonstrated, increased gaze speed, which could result from further training and adaptation to the device, might enable patients with small VFs to benefit from the device for visual search tasks. (Invest Ophthalmol Vis Sci. 2006;47:4152‐4159) DOI:10.1167/iovs.05-1672

Use of an Augmented-Vision Device for Visual Search by Patients with Tunnel Vision

The appearance of objects generally does not change with changes in the size of their retinal image that occur as the distance from the observer increases or decreases. Contrast constancy ensures this invariance for suprathreshold image features, but fully robust size invariance also requires invariance at threshold, so that near-threshold image features do not appear or disappear with distance changes. Since the angular size and the eccentricity of image features covary with distance changes, the threshold requirement for invariance could be satisfied approximately if contrast thresholds were to vary as the product of the spatial frequency and the eccentricity from the fovea. This model fits contrast thresholds for orientation identification over spatial frequencies of 1-16 cycles/deg and for retinal eccentricities of as much as 23 deg. Contrast detection thresholds from six different studies conform to this model over an even wider range of spatial frequencies and retinal eccentricities. The fitting variable, the fundamental eccentricity constant, was similar for all three studies that measured detection along the horizontal meridian and was higher for the orientation identification contrast thresholds along the same meridian. The eccentricity constant from studies that measured detection along the vertical meridian was higher than the constant calculated for the horizontal meridian and lower than the eccentricity constant for chromatic isoluminance gratings. Our model and these results provide new tools for analyzing the visibility of displays and for designing equal-visibility or variable-visibility displays.

Image invariance with changes in size: the role of peripheral contrast thresholds.

Registration of retinal images taken at different times frequently is required to measure changes caused by disease or to document retinal location of visual stimuli. Cross-correlation has been used previously for such registration, but it is computationally intensive. We have modified a faster algorithm, sequential similarity detection (SSD), to use only the portion of the template that contains retinal vessels. When compared to standard SSD and cross-correlation, this modification improves the reliability of detection for a variety of retinal imaging modalities. The improved reliability enables implementation of a two-stage registration strategy that further decreases the amount of computation and increases the speed of registration.

Feature-Based Registration of Retinal Images

PURPOSE To determine how severe peripheral field loss (PFL) affects the dispersion of eye movements relative to the head in patients walking in real environments. This information should help to define the visual field and clearance requirements for head-mounted mobility visual aids. METHODS Eye positions relative to the head were recorded in five patients with retinitis pigmentosa who had less than 15 degrees of visual field and in three normally sighted people, each walking in varied environments for more than 30 minutes. The eye-position recorder was made portable by modifying a head-mounted system (ISCAN, Burlington, MA). Custom data processing was implemented, to reject unreliable data. Sample standard deviations of eye position (dispersion) were compared across subject groups and environments. RESULTS The patients with PFL exhibited narrower horizontal eye-position dispersions than did the normally sighted subjects (9.4 degrees vs. 14.2 degrees , P < 0.0001), and the vertical dispersions of patients with PFL were smaller when they were walking indoors than when walking outdoors (8.2 degrees vs. 10.3 degrees ; P = 0.048). CONCLUSIONS When walking, the patients with PFL did not increase their scanning eye movements to compensate for missing peripheral vision information. Their horizontal scanning was actually reduced, possibly because of lack of peripheral stimulation. The results suggest that a field of view as wide as 40 degrees may be needed for closed (immersive) head-mounted mobility aids, whereas a much narrower display, perhaps as narrow as 20 degrees , may be sufficient with an open design.

/pdf/eye-movements-of-patients-with-tunnel-vision-while-walking-3eboo8i1ql.pdf

Eye Movements of Patients with Tunnel Vision While Walking

A previous study tested the validity of simulations of the appearance of a natural image (from different observation distances) generated by using a visual model and contrast sensitivity functions of the individual observers [J. Opt. Soc. Am. A 13, 1131 (1996)]. Deleting image spatial-frequency components that should be undetectable made the simulations indistinguishable from the original images at distances larger than the simulated distance. The simulated observation distance accurately predicted the distance at which the simulated image could be discriminated from the original image. Owing to the 1/f characteristic of natural images' spatial spectra, the individual contrast sensitivity functions (CSF's) used in the simulations of the previous study were actually tested only over a narrow range of retinal spatial frequencies. To test the CSF's over a wide range of frequencies, the same simulations and testing procedure were applied to five contrast versions of the images (10-300%). This provides a stronger test of the model, of the simulations, and specifically of the CSF's used. The relevant CSF for a discrimination task was found to be obtained by using 1-octave Gabor stimuli measured in a contrast detection task. The relevant CSF data had to be measured over a range of observation distances, owing to limitations of the displays.

Eli Peli

Papers

Use of an Augmented-Vision Device for Visual Search by Patients with Tunnel Vision

Image invariance with changes in size: the role of peripheral contrast thresholds.

Feature-Based Registration of Retinal Images

Eye Movements of Patients with Tunnel Vision While Walking

Contrast sensitivity function and image discrimination.