This paper surveys the field of augmented reality AR, in which 3D virtual objects are integrated into a 3D real environment in real time. It describes the medical, manufacturing, visualization, path planning, entertainment, and military applications that have been explored. This paper describes the characteristics of augmented reality systems, including a detailed discussion of the tradeoffs between optical and video blending approaches. Registration and sensing errors are two of the biggest problems in building effective augmented reality systems, so this paper summarizes current efforts to overcome these problems. Future directions and areas requiring further research are discussed. This survey provides a starting point for anyone interested in researching or using augmented reality.

/pdf/a-survey-of-augmented-reality-17irtaxt7z.pdf

A survey of augmented reality

We will review some of the major results in random graphs and some of the more challenging open problems. We will cover algorithmic and structural questions. We will touch on newer models, including those related to the WWW.

Random graphs

http://library.utia.cas.cz/prace/20030125.pdf

Image registration methods: a survey

Recent studies of eye movements in reading and other information processing tasks, such as music reading, typing, visual search, and scene perception, are reviewed. The major emphasis of the review is on reading as a specific example of cognitive processing. Basic topics discussed with respect to reading are (a) the characteristics of eye movements, (b) the perceptual span, (c) integration of information across saccades, (d) eye movement control, and (e) individual differences (including dyslexia). Similar topics are discussed with respect to the other tasks examined. The basic theme of the review is that eye movement data reflect moment-to-moment cognitive processes in the various tasks examined. Theoretical and practical considerations concerning the use of eye movement data are also discussed.

/pdf/eye-movements-in-reading-and-information-processing-20-years-3z5ay8hdwc.pdf

Eye movements in reading and information processing: 20 years of research.

Humans perceive the three-dimensional structure of the world with apparent ease. However, despite all of the recent advances in computer vision research, the dream of having a computer interpret an image at the same level as a two-year old remains elusive. Why is computer vision such a challenging problem and what is the current state of the art? Computer Vision: Algorithms and Applications explores the variety of techniques commonly used to analyze and interpret images. It also describes challenging real-world applications where vision is being successfully used, both for specialized applications such as medical imaging, and for fun, consumer-level tasks such as image editing and stitching, which students can apply to their own personal photos and videos. More than just a source of recipes, this exceptionally authoritative and comprehensive textbook/reference also takes a scientific approach to basic vision problems, formulating physical models of the imaging process before inverting them to produce descriptions of a scene. These problems are also analyzed using statistical models and solved using rigorous engineering techniques Topics and features: structured to support active curricula and project-oriented courses, with tips in the Introduction for using the book in a variety of customized courses; presents exercises at the end of each chapter with a heavy emphasis on testing algorithms and containing numerous suggestions for small mid-term projects; provides additional material and more detailed mathematical topics in the Appendices, which cover linear algebra, numerical techniques, and Bayesian estimation theory; suggests additional reading at the end of each chapter, including the latest research in each sub-field, in addition to a full Bibliography at the end of the book; supplies supplementary course material for students at the associated website, http://szeliski.org/Book/. Suitable for an upper-level undergraduate or graduate-level course in computer science or engineering, this textbook focuses on basic techniques that work under real-world conditions and encourages students to push their creative boundaries. Its design and exposition also make it eminently suitable as a unique reference to the fundamental techniques and current research literature in computer vision.

/pdf/computer-vision-algorithms-and-applications-25dn6wu83j.pdf

Computer Vision: Algorithms and Applications

The cave : audio visual experience automatic virtual environment : Siggraph'92 Showcase

The CAVE: audio visual experience automatic virtual environment

When resampling an image to a new set of coordinates (for example, when rotating an image), there is often a noticeable loss in image quality. To preserve image quality, the interpolating function used for the resampling should be an ideal low-pass filter. To determine which limited extent convolving functions would provide the best interpolation, five functions were compared: A) nearest neighbor, B) linear, C) cubic B-spline, D) high-resolution cubic spline with edge enhancement (a = -1), and E) high-resolution cubic spline (a = -0.5). The functions which extend over four picture elements (C, D, E) were shown to have a better frequency response than those which extend over one (A) or two (B) pixels. The nearest neighbor function shifted the image up to one-half a pixel. Linear and cubic B-spline interpolation tended to smooth the image. The best response was obtained with the high-resolution cubic spline functions. The location of the resampled points with respect to the initial coordinate system has a dramatic effect on the response of the sampled interpolating function?the data are exactly reproduced when the points are aligned, and the response has the most smoothing when the resampled points are equidistant from the original coordinate points. Thus, at the expense of some increase in computing time, image quality can be improved by resampled using the high-resolution cubic spline function as compared to the nearest neighbor, linear, or cubic B-spline functions.

Comparison of Interpolating Methods for Image Resampling

We assessed the effects of network latency and jitter on a cooperative teleoperation task in a collaborative virtual environment. Two remote partners worked together to manipulate shared virtual objects over a network. The task was to minimize the time to transfer a ring through one of four paths with the least number of collisions. The performance of human subjects was measured and analyzed quantitatively as a function of network latency: 10 and 200 msec delays with and without jitter. Jitter had the greatest impact on coordination performance when the latency was high and the task was difficult. These results are discussed in light of current and future CVE tasks.

Effects of network characteristics on human performance in a collaborative virtual environment

While a number of devices have recently been developed to facilitate hand rehabilitation after stroke, most place some restrictions on movement of the digits or arm. Thus, a novel glove was developed which can provide independent extension assistance to each digit while still allowing full arm movement. This pneumatic glove, the PneuGlove, can be used for training grasp-and-release movements either with real objects or with virtual objects in a virtual reality environment. Two groups of stroke survivors, with seven subjects in each group, completed a six-week rehabilitation training protocol, consisting of three 1-h sessions held each week. One group wore the PneuGlove during training, performed both within a novel virtual reality environment and outside of it with physical objects, while the other group completed the same training without the device. Across subjects, significant improvements were observed in the Fugl-Meyer Assessment for the upper extremity ( p<;;0.001), the hand/wrist portion of the Fugl-Meyer Assessment ( p<;;0.001), the Box and Blocks test ( p<;;0.05), and palmar pinch strength ( p<;;0.05). While changes in the two groups were not statistically different, the group using the PneuGlove did show greater mean improvement on each of these measures, such as gains of 3.7 versus 2.4 points on the hand/wrist portion of the Fugl-Meyer Assessment and 14 N versus 5 N in palmar pinch.

Robert V. Kenyon

Papers

The cave : audio visual experience automatic virtual environment : Siggraph'92 Showcase

The CAVE: audio visual experience automatic virtual environment

Comparison of Interpolating Methods for Image Resampling

Effects of network characteristics on human performance in a collaborative virtual environment

A Pneumatic Glove and Immersive Virtual Reality Environment for Hand Rehabilitative Training After Stroke