Registration is a fundamental task in image processing used to match two or more pictures taken, for example, at different times, from different sensors, or from different viewpoints. Virtually all large systems which evaluate images require the registration of images, or a closely related operation, as an intermediate step. Specific examples of systems where image registration is a significant component include matching a target with a real-time image of a scene for target recognition, monitoring global land usage using satellite images, matching stereo images to recover shape for autonomous navigation, and aligning images from different medical modalities for diagnosis.Over the years, a broad range of techniques has been developed for various types of data and problems. These techniques have been independently studied for several different applications, resulting in a large body of research. This paper organizes this material by establishing the relationship between the variations in the images and the type of registration techniques which can most appropriately be applied. Three major types of variations are distinguished. The first type are the variations due to the differences in acquisition which cause the images to be misaligned. To register images, a spatial transformation is found which will remove these variations. The class of transformations which must be searched to find the optimal transformation is determined by knowledge about the variations of this type. The transformation class in turn influences the general technique that should be taken. The second type of variations are those which are also due to differences in acquisition, but cannot be modeled easily such as lighting and atmospheric conditions. This type usually effects intensity values, but they may also be spatial, such as perspective distortions. The third type of variations are differences in the images that are of interest such as object movements, growths, or other scene changes. Variations of the second and third type are not directly removed by registration, but they make registration more difficult since an exact match is no longer possible. In particular, it is critical that variations of the third type are not removed. Knowledge about the characteristics of each type of variation effect the choice of feature space, similarity measure, search space, and search strategy which will make up the final technique. All registration techniques can be viewed as different combinations of these choices. This framework is useful for understanding the merits and relationships between the wide variety of existing techniques and for assisting in the selection of the most suitable technique for a specific problem.

A survey of image registration techniques

Let's read! We will often find out this sentence everywhere. When still being a kid, mom used to order us to always read, so did the teacher. Some books are fully read in a week and we need the obligation to support reading. What about now? Do you still love reading? Is reading only for you who have obligation? Absolutely not! We here offer you a new book enPDFd the perception of the visual world to read.

The Perception of the Visual World. By James J. Gibson. U.S.A.: Houghton Mifflin Company, 1950 (George Allen & Unwin, Ltd., London). Price 35s.

There are declines with age in speed of processing, working memory, inhibitory function, and long-term memory, as well as decreases in brain structure size and white matter integrity. In the face of these decreases, functional imaging studies have demonstrated, somewhat surprisingly, reliable increases in prefrontal activation. To account for these joint phenomena, we propose the scaffolding theory of aging and cognition (STAC). STAC provides an integrative view of the aging mind, suggesting that pervasive increased frontal activation with age is a marker of an adaptive brain that engages in compensatory scaffolding in response to the challenges posed by declining neural structures and function. Scaffolding is a normal process present across the lifespan that involves use and development of complementary, alternative neural circuits to achieve a particular cognitive goal. Scaffolding is protective of cognitive function in the aging brain, and available evidence suggests that the ability to use this mechanism is strengthened by cognitive engagement, exercise, and low levels of default network engagement.

/pdf/the-adaptive-brain-aging-and-neurocognitive-scaffolding-3igyn72710.pdf

The Adaptive Brain: Aging and Neurocognitive Scaffolding

A classic photographic task is the mapping of the potentially high dynamic range of real world luminances to the low dynamic range of the photographic print. This tone reproduction problem is also faced by computer graphics practitioners who map digital images to a low dynamic range print or screen. The work presented in this paper leverages the time-tested techniques of photographic practice to develop a new tone reproduction operator. In particular, we use and extend the techniques developed by Ansel Adams to deal with digital images. The resulting algorithm is simple and produces good results for a wide variety of images.

/pdf/photographic-tone-reproduction-for-digital-images-k89wmpv97f.pdf

Photographic tone reproduction for digital images

Blood vessels usually have poor local contrast, and the application of existing edge detection algorithms yield results which are not satisfactory. An operator for feature extraction based on the optical and spatial properties of objects to be recognized is introduced. The gray-level profile of the cross section of a blood vessel is approximated by a Gaussian-shaped curve. The concept of matched filter detection of signals is used to detect piecewise linear segments of blood vessels in these images. Twelve different templates that are used to search for vessel segments along all possible directions are constructed. Various issues related to the implementation of these matched filters are discussed. The results are compared to those obtained with other methods. >

/pdf/detection-of-blood-vessels-in-retinal-images-using-two-2lxvrugvz5.pdf

Detection of blood vessels in retinal images using two-dimensional matched filters

If homonymous hemianopia develops in childhood it is frequently accompanied by strabismus. In some of these cases the strabismus increases the size of the binocular visual field. We determined how prevalent visual-field-expanding strabismus is in children who have homonymous hemianopia. Medical records were examined from 103 hemianopic patients with exotropia (XT) or esotropia (ET). For each participant, we determined whether their strabismus was in a direction that resulted in visual field expansion (i.e. left exotropia with left homonymous hemianopia). Ages at which hemianopia and strabismus were first noted were compared to determine which developed first. The prevalence of XT (24%) and ET (9%) with homonymous hemianopia were both much higher than in the general population (1.5% and 5%, respectively). More strabismic eyes pointed to the blind than seeing side (62 vs 41, 60% vs. 40%, p = 0.02). Exotropic eyes were five times more likely to point to the blind side than esotropic eyes (85% vs 15%). Strabismus, especially exotropia, is much more common in pediatric homonymous hemianopia than in the general population. The strabismus is significantly more often in a visual field-expanding direction. These results support an adaptive role for the strabismus. Patients with HH and exotropia or esotropia should be aware that their visual field could be reduced by strabismus surgery.

High prevalence of strabismic visual field expansion in pediatric homonymous hemianopia.

Purpose Peripheral prisms (p-prisms) shift peripheral portions of the visual field of one eye, providing visual field expansion for patients with hemianopia. However, patients rarely show adaption to the shift, incorrectly localizing objects viewed within the p-prisms. A pilot evaluation of a novel computerized perceptual-motor training program aiming to promote p-prism adaption was conducted. Methods Thirteen patients with hemianopia fitted with 57Δ oblique p-prisms completed the training protocol. They attended six 1-hour visits reaching and touching peripheral checkerboard stimuli presented over videos of driving scenes while fixating a central target. Performance was measured at each visit and after 3 months. Results There was a significant reduction in touch error (P = 0.01) for p-prism zone stimuli from pretraining median of 16.6° (IQR 12.1°-19.6°) to 2.7° ( IQR 1.0°-8.5°) at the end of training. P-prism zone reaction times did not change significantly with training (P > 0.05). P-prism zone detection improved significantly (P = 0.01) from a pretraining median 70% (IQR 50%-88%) to 95% at the end of training (IQR 73%-98%). Three months after training improvements had regressed but performance was still better than pretraining. Conclusions Improved pointing accuracy for stimuli detected in prism-expanded vision of patients with hemianopia wearing 57Δ oblique p-prisms is possible and training appears to further improve detection. Translational relevance This is the first use of this novel software to train adaptation of visual direction in patients with hemianopia wearing peripheral prisms.

/pdf/a-pilot-study-of-perceptual-motor-training-for-peripheral-1hootorv1m.pdf

A Pilot Study of Perceptual-Motor Training for Peripheral Prisms

Blind people face difficulties with independent mobility, impacting employment prospects, social inclusion, and quality of life. Given the advancements in computer vision, with more efficient and effective automated information extraction from visual scenes, it is important to determine what information is worth conveying to blind travelers, especially since people have a limited capacity to receive and process sensory information. We aimed to investigate which objects in a street scene are useful to describe and how those objects should be described. Thirteen cane-using participants, five of whom were early blind, took part in two urban walking experiments. In the first experiment, participants were asked to voice their information needs in the form of questions to the experimenter. In the second experiment, participants were asked to score scene descriptions and navigation instructions, provided by the experimenter, in terms of their usefulness. The descriptions included a variety of objects with various annotations per object. Additionally, we asked participants to rank order the objects and the different descriptions per object in terms of priority and explain why the provided information is or is not useful to them. The results reveal differences between early and late blind participants. Late blind participants requested information more frequently and prioritized information about objects’ locations. Our results illustrate how different factors, such as the level of detail, relative position, and what type of information is provided when describing an object, affected the usefulness of scene descriptions. Participants explained how they (indirectly) used information, but they were frequently unable to explain their ratings. The results distinguish between various types of travel information, underscore the importance of featuring these types at multiple levels of abstraction, and highlight gaps in current understanding of travel information needs. Elucidating the information needs of blind travelers is critical for the development of more useful assistive technologies.

Beyond the Cane: Describing Urban Scenes to Blind People for Mobility Tasks

Foveated imaging systems applicable in various single-user displays mimic the visual system's image structure, where resolution de- creases gradually away from the fovea. The main benefit is the low av- erage image resolution while maintaining high resolution at the center of the gaze. When the end user is a human observer, it is advantageous for the foveation process to closely match the visual system parameters. This work directly applies a multichannel model of the visual system to form foveated images. A systems-engineering approach applied to the vision model produces quantitative image spectral content across the visual channels. Foveated images are constructed according to the con- trast threshold and image content calculated at different eccentricities. Also, variable-resolution feature detection edge and bar that corre- sponds to early visual processing is produced, based on the available image content across the channels. Motion between shifted foveated images required in applications such as image compression and motion compensation is estimated using either the foveated images or the de- tected feature images. Results using several similarity metrics and im- aging conditions show that reliable motion estimation can be achieved, while features with nonsimilar resolutions different scales are matched. © 2005 Society of Photo-Optical Instrumentation Engineers.

Eli Peli

Papers

High prevalence of strabismic visual field expansion in pediatric homonymous hemianopia.

A Pilot Study of Perceptual-Motor Training for Peripheral Prisms

Beyond the Cane: Describing Urban Scenes to Blind People for Mobility Tasks

Vision-model-based image foveation and motion estimation

Monocular fixation with the optic nerve head: a case report