Although augmented reality (AR) has gained much research attention in recent years, the term AR was given different meanings by varying researchers. In this article, we first provide an overview of definitions, taxonomies, and technologies of AR. We argue that viewing AR as a concept rather than a type of technology would be more productive for educators, researchers, and designers. Then we identify certain features and affordances of AR systems and applications. Yet, these compelling features may not be unique to AR applications and can be found in other technological systems or learning environments (e.g., ubiquitous and mobile learning environments). The instructional approach adopted by an AR system and the alignment among technology design, instructional approach, and learning experiences may be more important. Thus, we classify three categories of instructional approaches that emphasize the ''roles,'' ''tasks,'' and ''locations,'' and discuss what and how different categories of AR approaches may help students learn. While AR offers new learning opportunities, it also creates new challenges for educators. We outline technological, pedagogical, learning issues related to the implementation of AR in education. For example, students in AR environments may be cognitively overloaded by the large amount of information they encounter, the multiple technological devices they are required to use, and the complex tasks they have to complete. This article provides possible solutions for some of the challenges and suggests topics and issues for future research.

Current status, opportunities and challenges of augmented reality in education

We present steps toward a conceptual framework for tangible user interfaces. We introduce the MCRpd interaction model for tangible interfaces, which relates the role of physical and digital representations, physical control, and underlying digital models. This model serves as a foundation for identifying and discussing several key characteristics of tangible user interfaces. We identify a number of systems exhibiting these characteristics, and situate these within 12 application domains. Finally, we discuss tangible interfaces in the context of related research themes, both within and outside of the human-computer interaction domain.

/pdf/emerging-frameworks-for-tangible-user-interfaces-254dznxose.pdf

Emerging frameworks for tangible user interfaces

Mathematica--A System for Doing Mathematics by Computer.

We are living in a world which faces a rapidly increasing amount of data to be dealt with on a daily basis. In the last decade, the steady improvement of data storage devices and means to create and collect data along the way influenced our way of dealing with information: Most of the time, data is stored without filtering and refinement for later use. Virtually every branch of industry or business, and any political or personal activity nowadays generate vast amounts of data. Making matters worse, the possibilities to collect and store data increase at a faster rate than our ability to use it for making decisions. However, in most applications, raw data has no value in itself; instead we want to extract the information contained in it.

/pdf/visual-analytics-definition-process-and-challenges-3mll5saq86.pdf

Visual Analytics: Definition, Process, and Challenges

Even though interaction is an important part of information visualization (Infovis), it has garnered a relatively low level of attention from the Infovis community. A few frameworks and taxonomies of Infovis interaction techniques exist, but they typically focus on low-level operations and do not address the variety of benefits interaction provides. After conducting an extensive review of Infovis systems and their interactive capabilities, we propose seven general categories of interaction techniques widely used in Infovis: 1) Select, 2) Explore, 3) Reconfigure, 4) Encode, 5) Abstract/Elaborate, 6) Filter, and 7) Connect. These categories are organized around a user's intent while interacting with a system rather than the low-level interaction techniques provided by a system. The categories can act as a framework to help discuss and evaluate interaction techniques and hopefully lay an initial foundation toward a deeper understanding and a science of interaction.

https://www.cc.gatech.edu/~john.stasko/papers/infovis07-interaction.pdf

Toward a Deeper Understanding of the Role of Interaction in Information Visualization

Task solving processes produced by computer users (observed process) contain much information about their mental task models, individual problem solving strategy and underlying decision structure for a given task. Our tool AMME analyses observed processes and automatically extracts a Petri net description of the task dependent decision structure (logical task structure, device model, resp.). This net was extended by goal setting structures (modeling) and can be executed (simulated process). The aim of simulation is functional equivalence between observed and simulated processes. Three modeling strategies, eventdriven, parallel goal setting, and regulation-driven goal setting are presented and discussed. Regulation driven goal setting leads to full functional equivalence.

Task analysis in human-computer interaction - supporting action regulation theory by simulation

Effective handling of location-based data is important to emergency response management (ERM). Expert team members co-located around maps typically discuss events while drawing freeform areas or while using physical placeholders representing incidents. Key ERM functions are filtering data, selecting information recipients, searching datasets, drawing time-dependent freeform areas, and zooming in on one region while leaving others unchanged. Under time pressure the mouse and keyboard could be insufficient; intuitive graspable solutions, such as tangible user interfaces (TUIs), may be better suited for ERM. We present CoTracker, a tangible tabletop system with expected potential for ERM teamwork. On an interactive map expert team members can discuss an operational picture using TUIs like bricks, frames, and pens. With the participation of domain experts for cognitive walk-through studies, we examined how generic and specialized TUIs can support ERM-related functions. We present some insights into the design of ERM-focused tangible tabletops.

/pdf/tangible-tabletops-for-emergency-response-an-exploratory-4uxp25dd7l.pdf

Tangible tabletops for emergency response: an exploratory study

Digital pathology is an emerging healthcare field taking advantage of technology that allows digitization of microscopy images. Such digitization enables the use of automated digital image analysis techniques, which could be beneficial for the diagnostic review and prognosis of a variety of conditions. As yet, human-computer interaction (HCI) issues in this field, which is mostly based on visual analysis, have not been systematically explored. Based on reflecting on the process of designing and deploying systems for digital pathology, we propose a new understanding to design automated tools for such environments. We used meeting minutes, design briefs, interviews, personal notes and other artifacts to conduct a thematic analysis. This enabled us to establish four design considerations for introducing digital image analysis to routine pathology that concern level of detail, verification, communication and transparency.

Understanding Design for Automated Image Analysis in Digital Pathology

While videoconferencing has been available for years, tools for distributed creative collaboration such as brainstorming have not yet reached professional use. Unlike regular conferencing, brainstorming relies on information exchange across multiple channels in shared task and communication spaces. If a participant joins a facilitated brainstorming session remotely through his/her mobile device, perceiving these spaces is challenging. By proposing an immersive environment for the remote participant, this tech note addresses how to provide him/her a stronger engagement. Offered as a client application for the remote participant's tablet device, it enables him/her to see all channels and select which one to interact with. Our proof-of-concept client allows us to examine how this immersive environment for distributed creative collaboration can provide the remote participant with an increased engagement.

Immersive environment for distributed creative collaboration

The ForceFeedback Slider (FFS) is a one-dimensional actuated slider using a motor to produce tangible interaction with position and force as input and output parameters. To create a new concept, we have built a mixing desk, placed six FFSs (two implemented here) into a partially realized SliderBox, and added a LED and two toggle buttons to each slider for additional interactivity. We have developed a tool called BounceSlider for improvising music. This application for real time music performance and composition uses a slider handle that can act as a ball. Users can lift and release the handle to set the ball in motion and produce a particular sound each time it bounces against the baseline. Based on physical characteristics, the user can create different sounds and loops by changing two settings: gravity (speed) and bounce type (ball physical characteristics). BounceSlider allows the user to create and save loops of Musical Instrument Digital Interface (Midi) with up to five sounds at a time.

Morten Fjeld

Papers

Task analysis in human-computer interaction - supporting action regulation theory by simulation

Tangible tabletops for emergency response: an exploratory study

Understanding Design for Automated Image Analysis in Digital Pathology

Immersive environment for distributed creative collaboration

BounceSlider: actuated sliders for music performance and composition