This paper surveys the field of augmented reality AR, in which 3D virtual objects are integrated into a 3D real environment in real time. It describes the medical, manufacturing, visualization, path planning, entertainment, and military applications that have been explored. This paper describes the characteristics of augmented reality systems, including a detailed discussion of the tradeoffs between optical and video blending approaches. Registration and sensing errors are two of the biggest problems in building effective augmented reality systems, so this paper summarizes current efforts to overcome these problems. Future directions and areas requiring further research are discussed. This survey provides a starting point for anyone interested in researching or using augmented reality.

/pdf/a-survey-of-augmented-reality-17irtaxt7z.pdf

A survey of augmented reality

We will review some of the major results in random graphs and some of the more challenging open problems. We will cover algorithmic and structural questions. We will touch on newer models, including those related to the WWW.

Random graphs

http://library.utia.cas.cz/prace/20030125.pdf

Image registration methods: a survey

Recent studies of eye movements in reading and other information processing tasks, such as music reading, typing, visual search, and scene perception, are reviewed. The major emphasis of the review is on reading as a specific example of cognitive processing. Basic topics discussed with respect to reading are (a) the characteristics of eye movements, (b) the perceptual span, (c) integration of information across saccades, (d) eye movement control, and (e) individual differences (including dyslexia). Similar topics are discussed with respect to the other tasks examined. The basic theme of the review is that eye movement data reflect moment-to-moment cognitive processes in the various tasks examined. Theoretical and practical considerations concerning the use of eye movement data are also discussed.

/pdf/eye-movements-in-reading-and-information-processing-20-years-3z5ay8hdwc.pdf

Eye movements in reading and information processing: 20 years of research.

Humans perceive the three-dimensional structure of the world with apparent ease. However, despite all of the recent advances in computer vision research, the dream of having a computer interpret an image at the same level as a two-year old remains elusive. Why is computer vision such a challenging problem and what is the current state of the art? Computer Vision: Algorithms and Applications explores the variety of techniques commonly used to analyze and interpret images. It also describes challenging real-world applications where vision is being successfully used, both for specialized applications such as medical imaging, and for fun, consumer-level tasks such as image editing and stitching, which students can apply to their own personal photos and videos. More than just a source of recipes, this exceptionally authoritative and comprehensive textbook/reference also takes a scientific approach to basic vision problems, formulating physical models of the imaging process before inverting them to produce descriptions of a scene. These problems are also analyzed using statistical models and solved using rigorous engineering techniques Topics and features: structured to support active curricula and project-oriented courses, with tips in the Introduction for using the book in a variety of customized courses; presents exercises at the end of each chapter with a heavy emphasis on testing algorithms and containing numerous suggestions for small mid-term projects; provides additional material and more detailed mathematical topics in the Appendices, which cover linear algebra, numerical techniques, and Bayesian estimation theory; suggests additional reading at the end of each chapter, including the latest research in each sub-field, in addition to a full Bibliography at the end of the book; supplies supplementary course material for students at the associated website, http://szeliski.org/Book/. Suitable for an upper-level undergraduate or graduate-level course in computer science or engineering, this textbook focuses on basic techniques that work under real-world conditions and encourages students to push their creative boundaries. Its design and exposition also make it eminently suitable as a unique reference to the fundamental techniques and current research literature in computer vision.

/pdf/computer-vision-algorithms-and-applications-25dn6wu83j.pdf

Computer Vision: Algorithms and Applications

Individuals with strabismus frequently exhibit large fixational saccadic pairs (saccadic intrusions) during monocular fixation with the amblyopic eye in the light. We found two conditions in which the saccadic intrusion frequency could be markedly reduced. When instructed to ‘hold the eye steady’ in the presence of a visible target in the light, saccadic intrusions were suppressed and eye position maintained within a few degrees of the target. These results suggest that corrective drift was used by the amblyopic eye to aid in position maintenance. When instructed to ‘fixate’ in complete darkness, the intrusive pattern was replaced by a jerk nystagmus-like pattern. These results clearly demonstrate that saccadic intrusions in amblyopic eyes require the presence of a visible target for their generation, and additionally, that ‘extraretinal signals’ were involved in maintenance of eye position under this condition. Saccades could also be suppressed during the ‘hold’ command in the light by patients having amblyopia without strabismus or constant strabismus amblyopia with intermittent jerk nystagmus.

Suppression of Fixational Saccades in Strabismic and Anisometropic Amblyopia

Accommodation has been suspected as a contributor to size illusions in virtual environments (VE) due to the lack of appropriate accommodative stimuli in a VE for the objects displayed. Previous experiments examining size-constancy in VE have shown that monocular cues to depth that accompany the object are a major contributor to correct size perception. When these accompanying cues are removed perceived size varied with the object’s distance from the subject, i.e., visual angle. If accommodation were the dominant mechanism contributing to a visual angle response [due to its action to keep physical objects clear] in this condition, an open-loop accommodation viewing condition might restore size-constancy to this condition. Pinhole apertures were used to open-loop accommodation and examine if size-constancy might be restored when few accompanying monocular cues to depth were present. Visual angle performance when viewing a low cue environment was found with and without the use of the pinhole apertures. Thus, these results signify that accommodation does not play a dominate role in the loss of size-constancy in sparse visual environments often used in VE. These results suggest that size-constancy is driven by the inclusion of the remaining monocular cues to depth in VE as it is in the physical world.

/pdf/accommodation-and-size-constancy-of-virtual-objects-4dpezqzawf.pdf

Accommodation and Size-Constancy of Virtual Objects

Postural responses following exposure to weightlessness

Dynamic network visualization has been a challenging topic for dynamic networks analysis, especially for spatially embedded networks like brain networks. In this paper, we present an animated interactive visualization design that combines enhanced node-link diagrams and distance matrix layouts to assist neuroscientists in their exploration of dynamic brain networks and that enables them to understand how functional connections relate to the spatial structure of the brain. Our visualization also provides the ability to observe the evolution of a network, the change in the community identities, and node behavior over time.

Visualizing Dynamic Brain Networks Using an Animated Dual-Representation

Although it is common clinical knowledge that oculomotor control appears to normalize during the course of successful orthoptics therapy for amblyopia, reports providing a quantitative analysis of eye movements during extended periods of treatment are lacking. We provide for the first time such a report in an adult amblyope. Aspects of eye movement control that tended to normalize with therapy include drift amplitude and velocity, duration and frequency of steady fixation, and pursuit gain. These results suggest that smooth pursuit control can be modified, even in an adult amblyope. Aspects of eye movement control that remained abnormal throughout therapy, in spite of normalization of visual acuity and centralization of fixation, include increased saccadic latencies, use of large saccades during small-amplitude pursuit tracking, and static overshooting. These results suggest that certain aspects of saccadic and pursuit control could either no longer be modified or would require longer periods for this to occur.

Robert V. Kenyon

Papers

Suppression of Fixational Saccades in Strabismic and Anisometropic Amblyopia

Accommodation and Size-Constancy of Virtual Objects

Postural responses following exposure to weightlessness

Visualizing Dynamic Brain Networks Using an Animated Dual-Representation

Different rates of functional recovery of eye movements during orthoptics treatment in an adult amblyope.