We are on the verge of ubiquitously adopting Augmented Reality (AR) technologies to enhance our percep- tion and help us see, hear, and feel our environments in new and enriched ways. AR will support us in fields such as education, maintenance, design and reconnaissance, to name but a few. This paper describes the field of AR, including a brief definition and development history, the enabling technologies and their characteristics. It surveys the state of the art by reviewing some recent applications of AR technology as well as some known limitations regarding human factors in the use of AR systems that developers will need to overcome.

/pdf/a-survey-of-augmented-reality-technologies-applications-and-3d9hf1tnc4.pdf

A Survey of Augmented Reality Technologies, Applications and Limitations

This paper surveys the current state-of-the-art of technology, systems and applications in Augmented Reality. It describes work performed by many different research groups, the purpose behind each new Augmented Reality system, and the difficulties and problems encountered when building some Augmented Reality applications. It surveys mobile augmented reality systems challenges and requirements for successful mobile systems. This paper summarizes the current applications of Augmented Reality and speculates on future applications and where current research will lead Augmented Reality's development. Challenges augmented reality is facing in each of these applications to go from the laboratories to the industry, as well as the future challenges we can forecast are also discussed in this paper. Section 1 gives an introduction to what Augmented Reality is and the motivations for developing this technology. Section 2 discusses Augmented Reality Technologies with computer vision methods, AR devices, interfaces and systems, and visualization tools. The mobile and wireless systems for Augmented Reality are discussed in Section 3. Four classes of current applications that have been explored are described in Section 4. These applications were chosen as they are the most famous type of applications encountered when researching AR apps. The future of augmented reality and the challenges they will be facing are discussed in Section 5.

Augmented reality technologies, systems and applications

In this paper, the authors show that augmented reality technology has a positive impact on the motivation of middle-school students. The Instructional Materials Motivation Survey (IMMS) (Keller, 2010) based on the ARCS motivation model (Keller, 1987a) was used to gather information; it considers four motivational factors: attention, relevance, confidence, and satisfaction. Motivational factors of attention and satisfaction in an augmented-reality-based learning environment were better rated than those obtained in a slides-based learning environment. When the impact of the augmented reality system was analyzed in isolation, the attention and confidence factors were the best rated. The usability study showed that although this technology is not mature enough to be used massively in education, enthusiasm of middle-school students diminished most of the barriers found.

/pdf/impact-of-an-augmented-reality-system-on-students-motivation-2gi4c7c60z.pdf

Impact of an augmented reality system on students' motivation for a visual art course

Augmented reality applications in design and manufacturing

Head-mounted display systems and methods of operation that allow users to couple and decouple a portable electronic device such as a handheld portable electronic device with a separate head-mounted device (e.g., temporarily integrates the separate devices into a single unit) are disclosed. The portable electronic may be physically coupled to the head-mounted device such that the portable electronic device can be worn on the user's head. The portable electronic device may be operatively coupled to the head-mounted device such that the portable electronic device and head mounted device can communicate and operate with one another. Each device may be allowed to extend its features and/or services to the other device for the purpose of enhancing, increasing and/or eliminating redundant functions between the head-mounted device and the portable electronic device.

Head-Mounted Display Apparatus for Retaining a Portable Electronic Device with Display

Recent years have seen advances in many enabling augmented reality technologies. Furthermore, much research has been carried out on how augmented reality can be used to enhance existing applications. This paper describes our experiences with an AR-museum guide that combines some of the latest technologies. Amongst other technologies, markerless tracking, hybrid tracking, and an ultra-mobile-PC were used. Like existing audio guides, the AR-guide can be used by any museum visitor, during a six-month exhibition on Islamic art. We provide a detailed description of the museumpsilas motivation for using AR, of our experiences in developing the system, and the initial results of user surveys. Taking this information into account, we can derive possible system improvements.

An Augmented Reality museum guide

The invention relates to a method for representing a virtual object in a real environment, having the following steps: generating a two-dimensional image of a real environment by means of a recording device, ascertaining a position of the recording device relative to at least one component of the real environment, segmenting at least one area of the real environment unmarked in reality in the two-dimensional image for identifying at least one segment of the real environment in distinction to a remaining part of the real environment while supplying corresponding segmentation data, and merging the virtual object with the two-dimensional image of the real environment with consideration of the segmentation data such that at least one part of the segment of the real environment is removed from the image of the real environment. The invention permits any collisions of virtual objects with real objects that occur upon merging with a real environment to be represented in a way largely close to reality.

Method and device for illustrating a virtual object in a real environment

We present a solution for AR based repair guidance. This solution covers software as well as hardware related issues. In particular we developed a markerless CAD based tracking system which can deal with different illumination conditions during the tracking stage, partial occlusions and rapid motion. The system is also able to automatically recover from occasional tracking failures. On the hardware side the system is based on an off the shelf notebook, a wireless mobile setup consisting of a wide-angle video camera and an analog video transmission system. This setup has been tested with a monocular full-color video-see-through HMD and additionally with a monochrome optical-see-through HMD. Our system underwent several extensive test series under real industrial conditions and proved to be useful for different maintenance and repair scenarios.

A mobile markerless AR system for maintenance and repair

A method for representing virtual information in a view of a real environment, comprises the following steps: providing a system setup comprising at least one display device, wherein the system setup is adapted for blending in virtual information on the display device, determining a position of a viewing point relative to at least one component of the real environment, providing a geometry model of the real environment, the geometry model comprising multiple representations of respective built-in real objects of the real environment, each representation comprising at least one 2D or 3D geometrical shape having at least one boundary delimiting the respective object, wherein one side of the boundary is delimiting the object toward its inner side and the other side of the boundary is delimiting the object toward its outer side, providing at least one item of virtual information and a position of the at least one item of virtual information, determining a visualization mode of blending in the at least one item of virtual information on the display device according to the position of the viewing point and the geometry model, calculating a ray between the viewing point and the item of virtual information, determining a number of boundary intersections by the ray, wherein if the number of boundary intersections is less than 2, the item of virtual information is blended in in a non-occlusion mode, otherwise in an occlusion mode, and/or the position of the item of virtual information is moved to the front of the intersected boundary with respect to the viewing point.

Method for representing virtual information in a real environment

A method of matching image features with reference features comprises the steps of providing a current image captured by a capturing device, providing a set of reference features, wherein each of the reference features comprises at least one first parameter which is at least partially indicative of a position and/or orientation of the reference feature with respect to a global coordinate system, wherein the global coordinate system is an earth coordinate system or an object coordinate system, or which is at least partially indicative of a position of the reference feature with respect to an altitude, detecting at least one feature in the current image in a feature detection process, associating with the detected feature at least one second parameter which is at least partially indicative of a position and/or orientation of the detected feature with respect to the global coordinate system, or which is at least partially indicative of a position of the detected feature with respect to an altitude, and matching the detected feature with at least one of the reference features of the set of reference features by determining a similarity measure between the at least one first parameter and the at least one second parameter.

Peter Meier

Papers

An Augmented Reality museum guide

Method and device for illustrating a virtual object in a real environment

A mobile markerless AR system for maintenance and repair

Method for representing virtual information in a real environment

Method of matching image features with reference features