Co-Planar Stereotaxic Atlas of the Human Brain—3-Dimensional Proportional System: An Approach to Cerebral Imaging, J. Talairach, P. Tournoux. Georg Thieme Verlag, New York (1988), 122 pp., 130 figs. DM 268

We summarize the various strands of research on peripheral vision and relate them to theories of form perception. After a historical overview, we describe quantifications of the cortical magnification hypothesis, including an extension of Schwartz's cortical mapping function. The merits of this concept are considered across a wide range of psychophysical tasks, followed by a discussion of its limitations and the need for non-spatial scaling. We also review the eccentricity dependence of other low-level functions including reaction time, temporal resolution, and spatial summation, as well as perimetric methods. A central topic is then the recognition of characters in peripheral vision, both at low and high levels of contrast, and the impact of surrounding contours known as crowding. We demonstrate how Bouma's law, specifying the critical distance for the onset of crowding, can be stated in terms of the retinocortical mapping. The recognition of more complex stimuli, like textures, faces, and scenes, reveals a substantial impact of mid-level vision and cognitive factors. We further consider eccentricity-dependent limitations of learning, both at the level of perceptual learning and pattern category learning. Generic limitations of extrafoveal vision are observed for the latter in categorization tasks involving multiple stimulus classes. Finally, models of peripheral form vision are discussed. We report that peripheral vision is limited with regard to pattern categorization by a distinctly lower representational complexity and processing speed. Taken together, the limitations of cognitive processing in peripheral vision appear to be as significant as those imposed on low-level functions and by way of crowding.

Peripheral vision and pattern recognition: a review.

Eccentricity bias as an organizing principle for human high-order object areas

Amblyopia and binocular vision.

Foveated rendering synthesizes images with progressively less detail outside the eye fixation region, potentially unlocking significant speedups for wide field-of-view displays, such as head mounted displays, where target framerate and resolution is increasing faster than the performance of traditional real-time renderers. To study and improve potential gains, we designed a foveated rendering user study to evaluate the perceptual abilities of human peripheral vision when viewing today's displays. We determined that filtering peripheral regions reduces contrast, inducing a sense of tunnel vision. When applying a postprocess contrast enhancement, subjects tolerated up to 2× larger blur radius before detecting differences from a non-foveated ground truth. After verifying these insights on both desktop and head mounted displays augmented with high-speed gaze-tracking, we designed a perceptual target image to strive for when engineering a production foveated renderer. Given our perceptual target, we designed a practical foveated rendering system that reduces number of shades by up to 70% and allows coarsened shading up to 30° closer to the fovea than Guenter et al. [2012] without introducing perceivable aliasing or blur. We filter both pre- and post-shading to address aliasing from undersampling in the periphery, introduce a novel multiresolution- and saccade-aware temporal antialising algorithm, and use contrast enhancement to help recover peripheral details that are resolvable by our eye but degraded by filtering. We validate our system by performing another user study. Frequency analysis shows our system closely matches our perceptual target. Measurements of temporal stability show we obtain quality similar to temporally filtered non-foveated renderings.

Towards foveated rendering for gaze-tracked virtual reality

Theoretical considerations suggest that binocular information should provide advantages, compared to monocular viewing, for the planning and execution of natural reaching and grasping actions, but empirical support for this is quite equivocal. We have examined these predictions on a simple prehension task in which normal subjects reached, grasped and lifted isolated cylindrical household objects (two sizes, four locations) in a well-lit environment, using binocular vision or with one eye occluded. Various kinematic measures reflecting the programming and on-line control of the movements were quantified, in combination with analyses of different types of error occurring in the velocity, spatial path and grip aperture profiles of each trial. There was little consistent effect of viewing condition on the early phase of the reach, up to and including the peak deceleration, but all other aspects of performance were superior under binocular control. Subjects adopted a cautious approach when binocular information was unavailable: they extended the end phase of the reach and pre-shaped their hand with a wider grip aperture further away from the object. Despite these precautions, initial grip application was poorly coordinated with target contact and was inaccurately scaled to the objects’ dimensions, with the subsequent post-contact phase of the grasp significantly more prolonged, error-prone and variable compared to binocular performance. These effects were obtained in two separate experiments in which the participants’ performed the task under randomized or more predictable (blocked) viewing conditions. Our data suggest that binocular vision offers particular advantages for controlling the terminal reach and the grasp. We argue that these benefits derive from binocular disparity processing linked to changes in relative hand–target distance, and that this depth information is independently used to regulate the progress of the approaching hand and to guide the digits to the (pre-selected) contact points on the object, thereby ensuring that the grip is securely applied.

Advantages of binocular vision for the control of reaching and grasping.

PURPOSE. Visual defects associated with amblyopia have been extensively studied, but their impact on the performance of everyday visuomotor tasks is unclear. This study evaluates eye- hand coordination (prehension) skills in adult amblyopes compared with normal subjects. METHODS. Twenty amblyopes (10 strabismic, 10 nonstrabismic) with different degrees of visual acuity loss (mild, moderate, or severe) and stereodeficiency (reduced or undetectable) participated, along with 20 matched control subjects. Subjects reached, precision grasped, and lifted cylindrical household objects (two sizes, four locations) using binocular vision or just the dominant or amblyopic (nondominant) eye, while the actions of the preferred hand were recorded. Various indices of prehension planning and online control were quantified for all trials (n = 48) performed under each viewing condition. RESULTS. Initial reaching behavior and grip shaping before object contact, which result from movement programming, were relatively normal in the amblyopic subjects, despite their vision losses. By contrast, they exhibited a range of deficits under both binocular and nondominant eye conditions in their final approach to the object (terminal reach) and when closing and applying a grasp. These impairments included prolonged execution times and more errors compared with control subjects, the extents of which covaried with the existing depth of amblyopia, although not with its underlying cause. CONCLUSIONS. Visuomotor adaptations in amblyopes are relatively minor and limited to aspects of movement planning. Their deficits in movement execution should benefit, however, from treatments that restore spatial acuity and binocularity to progressively normal levels and so deserve more explicit consideration when assessing therapeutic outcomes.

/pdf/prehension-deficits-in-amblyopia-vie7sy761b.pdf

Prehension deficits in amblyopia.

Purpose. To investigate whether binocular information provides benefits for programming and guidance of reach-to-grasp movements in normal children and whether these eye–hand coordination skills are impaired in children with amblyopia and abnormal binocularity.

Methods. Reach-to-grasp performance of the preferred hand in binocular versus monocular (dominant or nondominant eye occluded) conditions to different objects (two sizes, three locations, and two to three repetitions) was quantified by using a 3D motion-capture system. The participants were 36 children (age, 5–11 years) and 11 adults who were normally sighted and 21 children (age, 4–8 years) who had strabismus and/or anisometropia. Movement kinematics and error rates were compared for each viewing condition within and between subject groups.

Results. The youngest control subjects used a mainly programmed (ballistic) strategy and collided with the objects more often when viewing with only one eye, while older children progressively incorporated visual feedback to guide their reach and, eventually, their grasp, resulting in binocular advantages for both movement components resembling those of adult performance. Amblyopic children were the worst performers under all viewing conditions, even when using the dominant eye. They spent almost twice as long in the final approach to the objects and made many (1.5–3 times) more errors in reach direction and grip positioning than their normal counterparts, these impairments being most marked in those with the poorest binocularity, regardless of the severity or cause of their amblyopia.

Conclusions. The importance of binocular vision for eye–hand coordination normally increases with age and use of online movement guidance. Restoring binocularity in children with amblyopia may improve their poor hand action control.

/pdf/eye-hand-coordination-skills-in-children-with-and-without-4x2mk0qlp0.pdf

Eye–Hand Coordination Skills in Children with and without Amblyopia

PURPOSE. To examine whether patients with glaucoma exhibit differences in visually guided reaching-and-grasping (prehension) behavior compared with normally sighted control subjects.

METHODS. Sixteen patients with glaucoma and 16 control subjects with no ocular disease participated. Participants were required to reach out and precision grasp one of two cylindrical objects placed on a table top in front of them in laboratory conditions in three viewing conditions (binocular, right eye alone, left eye alone). Lightweight reflective markers were placed on the subject’s preferred hand for recording its movement in three-dimensional space. Three motion capture units recorded the motion of these markers as the subjects reached out and precision grasped household objects. Various indices of prehension planning, execution, and control were quantified. Visual fields (VF) were measured using standard automated perimetry generating monocular mean deviation (MD) scores. Binocular VF sensitivity was estimated by using the integrated visual field (IVF). Stereoacuity was measured with the Frisby stereoacuity test. Significant differences in prehension movement between patients and control subjects in each viewing condition were investigated, and associations between prehension kinematics and VF sensitivity were examined.

RESULTS. The patients and control subjects were of a similar age (median [range]: patient group, 72.2 years [62.5–86.9]; control group, 69.0 years [64.3–78.3]). The patient group had asymmetrical disease and relatively minor binocular overlapping defects (better eye MD, −5.7 dB [−16.7 to +0.45 dB]; worse eye MD, −11.8 dB [−29.3 to −1.5 dB]; IVF score, 3 [0–36]). They exhibited slightly poorer stereoacuity levels than did the control subjects (patient group, 55 sec arc [40–110]; control group, 40 sec arc [20–80; Mann-Whitney U test, P < 0.05]). They also showed statistically significant delays in average movement onset (MO: ∼100 ms delay, Mann-Whitney U test P < 0.0001) and overall movement time (OMD: ∼140 ms delay; Mann-Whitney U test P < 0.05), suggesting impairments in initial movement planning and control. Deficits were exhibited in the reaching component, with data suggesting that glaucomatous patients made more tentative movements when reaching for the object. These deficits correlated with both increasing severity of VF defect and impaired stereoacuity. There were no differences in grasping characteristics between patients and control subjects in this sample.

CONCLUSIONS. This study provides evidence that patients with glaucoma exhibit deficits in eye–hand coordination compared with the age-matched normally sighted control. Further study is needed to assess the specific effect of field loss location on prehension kinematics.

/pdf/the-functional-consequences-of-glaucoma-for-eye-hand-j0hwdzgjrt.pdf

The Functional Consequences of Glaucoma for Eye-Hand Coordination

PURPOSE. To examine the effects of permanent versus brief reductions in binocular stereo vision on reaching and grasping (prehension) skills.

METHODS. The first experiment compared prehension proficiency in 20 normal and 20 adults with long-term stereo-deficiency (10 with coarse and 10 with undetectable disparity sensitivities) when using binocular vision or just the dominant or nondominant eye. The second experiment examined effects of temporarily mimicking similar stereoacuity losses in normal adults, by placing defocusing low- or high-plus lenses over one eye, compared with their control (neutral lens) binocular performance. Kinematic and error measures of prehension planning and execution were quantified from movements of the subjects’ preferred hand recorded while they reached, precision-grasped, and lifted cylindrical objects (two sizes, four locations) on 40 to 48 trials under each viewing condition.

RESULTS. Performance was faster and more accurate with normal compared with reduced binocular vision and least accomplished under monocular conditions. Movement durations were extended (up to ∼100 ms) whenever normal stereo vision was permanently (ANOVA P < 0.05) or briefly (ANOVA P < 0.001) reduced, with a doubling of error rates in executing the grasp (ANOVA P < 0.001). Binocular deficits in reaching occurred during its end phase (prolonged final approach, more velocity corrections, poorer coordination with object contact) and generally increased with the existing loss of disparity sensitivity. Binocular grasping was more uniformly impaired by stereoacuity loss and influenced by its duration. Adults with long-term stereo-deficiency showed increased variability in digit placement at initial object contact, and they adapted by prolonging (by ∼25%) the time spent subsequently applying their grasp (ANOVA P < 0.001). Brief stereoreductions caused systematic shifts in initial digit placement and two to three times more postcontact adjustments in grip position (ANOVA P < 0.01).

CONCLUSIONS. High-grade binocular stereo vision is essential for skilled precision grasping. Reduced disparity sensitivity results in inaccurate grasp-point selection and greater reliance on nonvisual (somesthetic) information from object contact to control grip stability.

/pdf/grasping-deficits-and-adaptations-in-adults-with-stereo-qdvkghga3f.pdf

Dean R. Melmoth

Papers

Advantages of binocular vision for the control of reaching and grasping.

Prehension deficits in amblyopia.

Eye–Hand Coordination Skills in Children with and without Amblyopia

The Functional Consequences of Glaucoma for Eye-Hand Coordination

Grasping Deficits and Adaptations in Adults with Stereo Vision Losses