Although augmented reality (AR) has gained much research attention in recent years, the term AR was given different meanings by varying researchers. In this article, we first provide an overview of definitions, taxonomies, and technologies of AR. We argue that viewing AR as a concept rather than a type of technology would be more productive for educators, researchers, and designers. Then we identify certain features and affordances of AR systems and applications. Yet, these compelling features may not be unique to AR applications and can be found in other technological systems or learning environments (e.g., ubiquitous and mobile learning environments). The instructional approach adopted by an AR system and the alignment among technology design, instructional approach, and learning experiences may be more important. Thus, we classify three categories of instructional approaches that emphasize the ''roles,'' ''tasks,'' and ''locations,'' and discuss what and how different categories of AR approaches may help students learn. While AR offers new learning opportunities, it also creates new challenges for educators. We outline technological, pedagogical, learning issues related to the implementation of AR in education. For example, students in AR environments may be cognitively overloaded by the large amount of information they encounter, the multiple technological devices they are required to use, and the complex tasks they have to complete. This article provides possible solutions for some of the challenges and suggests topics and issues for future research.

Current status, opportunities and challenges of augmented reality in education

We present steps toward a conceptual framework for tangible user interfaces. We introduce the MCRpd interaction model for tangible interfaces, which relates the role of physical and digital representations, physical control, and underlying digital models. This model serves as a foundation for identifying and discussing several key characteristics of tangible user interfaces. We identify a number of systems exhibiting these characteristics, and situate these within 12 application domains. Finally, we discuss tangible interfaces in the context of related research themes, both within and outside of the human-computer interaction domain.

/pdf/emerging-frameworks-for-tangible-user-interfaces-254dznxose.pdf

Emerging frameworks for tangible user interfaces

Mathematica--A System for Doing Mathematics by Computer.

We are living in a world which faces a rapidly increasing amount of data to be dealt with on a daily basis. In the last decade, the steady improvement of data storage devices and means to create and collect data along the way influenced our way of dealing with information: Most of the time, data is stored without filtering and refinement for later use. Virtually every branch of industry or business, and any political or personal activity nowadays generate vast amounts of data. Making matters worse, the possibilities to collect and store data increase at a faster rate than our ability to use it for making decisions. However, in most applications, raw data has no value in itself; instead we want to extract the information contained in it.

/pdf/visual-analytics-definition-process-and-challenges-3mll5saq86.pdf

Visual Analytics: Definition, Process, and Challenges

Even though interaction is an important part of information visualization (Infovis), it has garnered a relatively low level of attention from the Infovis community. A few frameworks and taxonomies of Infovis interaction techniques exist, but they typically focus on low-level operations and do not address the variety of benefits interaction provides. After conducting an extensive review of Infovis systems and their interactive capabilities, we propose seven general categories of interaction techniques widely used in Infovis: 1) Select, 2) Explore, 3) Reconfigure, 4) Encode, 5) Abstract/Elaborate, 6) Filter, and 7) Connect. These categories are organized around a user's intent while interacting with a system rather than the low-level interaction techniques provided by a system. The categories can act as a framework to help discuss and evaluate interaction techniques and hopefully lay an initial foundation toward a deeper understanding and a science of interaction.

https://www.cc.gatech.edu/~john.stasko/papers/infovis07-interaction.pdf

Toward a Deeper Understanding of the Role of Interaction in Information Visualization

This chapter presents an overview of the Mixed Reality (MR) paradigm, which proposes to overlay our real-world environment with digital, computer-generated objects. It presents example applications and outlines limitations and solutions for their technical implementation. In MR systems, users perceive both the physical environment around them and digital elements presented through, for example, the use of semitransparent displays. By its very nature, MR is a highly interdisciplinary field engaging signal processing, computer vision, computer graphics, user interfaces, human factors, wearable computing, mobile computing, information visualization, and the design of displays and sensors. This chapter presents potential MR applications, technical challenges in realizing MR systems, as well as issues related to usability and collaboration in MR. It separately presents a section offering a selection of MR projects which have either been partly or fully undertaken at Swiss universities and rounds off with a section on current challenges and trends.

Mixed Reality: Survey

Natural interaction, in the context of this paper, means human action in a world of tangible objects and live subjects. We introduce the concept of action regulation and relate it to observable human behaviour. A tool bringing together motor and cognitive action is a promising way to assure complete task regulation. Aiming for such tools, we propose a set of guidelines for the next generation of user interfaces, the Natural User Interface (NUI). We present a NUI instantiation called BUILD-IT, featuring video-mediated interaction in a task specific context. This multi-brick interaction tool renders virtual objects tangible and allows multiple user simultaneous interaction in one common space. A few user experiences are briefly described

/pdf/build-it-an-intuitive-design-tool-based-on-direct-object-krlth96346.pdf

BUILD-IT: an intuitive design tool based on direct object manipulation

/pdf/mixed-reality-a-survey-1wwd0psbrq.pdf

Mixed Reality: A Survey

Gestural interaction with flying drones is now on the rise; however, little work has been done to reveal the gestural preferences from users directly. In this paper, we present an elicitation study to help in realizing user-defined gestures for drone navigation. We apply a user-centered approach in which we collected data from 25 participants performing gestural interactions for twelve drone actions of which ten are navigational actions. The analyses of 300 gesture data collected from our participants reveal a user-defined gestural set of possible suitable gestures to control a drone. We report results that can be used by software developers, engineers or designers; and included a taxonomy for the set of user-defined gestures, gestural agreement scores, time performances and subjective ratings for each action. Finally, we discuss the gestural set with implementation insights and conclude with future directions.

How would you gesture navigate a drone?: a user-centered approach to control a drone

This paper explores remote cheering during amateur races through a formative design inquiry. Friends and family of advanced amateur runners are part of their running experience. Runners rely on support during the race day and it is usually provided in the form of co-located cheers. RUFUS -- a prototype remote ambient runner support system -- was developed. The system enables supporters to send three types of signals to runners during a race and runners can send signals back to supporters. Input from supporters is sent through a webpage and received by runners through a device designed to lower distraction. An in situ study was conducted to evaluate the prototype during an organized race. Results show that two-way communication between runners and supporters was achieved. We also found that our system reflected varying user needs correctly. Runners and supporters reported increased motivation and enhanced race experience through feeling connected.

Morten Fjeld

Papers

Mixed Reality: Survey

BUILD-IT: an intuitive design tool based on direct object manipulation

Mixed Reality: A Survey

How would you gesture navigate a drone?: a user-centered approach to control a drone

RUFUS: Remote Supporter Feedback for Long-Distance Runners