The theory of affordances

Virtual and augmented reality (VR/AR) are expected to revolutionise entertainment, healthcare, communication and the manufacturing industries among many others. Near-eye displays are an enabling vessel for VR/AR applications, which have to tackle many challenges related to ergonomics, comfort, visual quality and natural interaction. These challenges are related to the core elements of these near-eye display hardware and tracking technologies. In this state-of-the-art report, we investigate the background theory of perception and vision as well as the latest advancements in display engineering and tracking technologies. We begin our discussion by describing the basics of light and image formation. Later, we recount principles of visual perception by relating to the human visual system. We provide two structured overviews on state-of-the-art near-eye display and tracking technologies involved in such near-eye displays. We conclude by outlining unresolved research questions to inspire the next
generation of researchers.

/pdf/near-eye-display-and-tracking-technologies-for-virtual-and-3lyzyt3bl8.pdf

Near-Eye Display and Tracking Technologies for Virtual and Augmented Reality

Shape-changing interfaces have emerged as a new method for interacting with computers, using dynamic changes in a device's physical shape for input and output. With the advances of research into shape-changing interfaces, we see a need to synthesize the main, open research questions. The purpose of this synthesis is to formulate common challenges across the diverse fields engaged in shape-change research, to facilitate progression from single prototypes and individual design explorations to grander scientific goals, and to draw attention to challenges that come with maturity, including those concerning ethics, theory-building, and societal impact. In this article we therefore present 12 grand challenges for research on shape-changing interfaces, derived from a three-day workshop with 25 shape-changing interface experts with backgrounds in design, computer science, human-computer interaction, engineering, robotics, and material science.

/pdf/grand-challenges-in-shape-changing-interface-research-3p7vbl6ubc.pdf

Grand Challenges in Shape-Changing Interface Research

Using feedback through digital technology to disrupt and change habitual behavior

A set of prominent designers embarked on a research journey to explore aesthetics in movement-based design Here we unpack one of the design sensitivities unique to our practice: a strong first per 

/pdf/embracing-first-person-perspectives-in-soma-based-design-it2ezlpgn7.pdf

Embracing First-Person Perspectives in Soma-Based Design

This paper presents a design approach tackling the transformation of behavior through 'interactive materiality' from a phenomenological perspective. It builds upon the Interaction Frogger framework that couples action to reaction for intuitive mapping in intelligent product interaction. Through the discussion of two research-through-design cases, the augmented speed-skate experience and affective pen, it highlights the opportunities for design of an action-perception loop. Consequently, an approach is suggested that defines three steps to be incorporated in the design process: affirming and appreciating current behavior; designing continuous mapping for transformation; and fine-tuning sensitivities in the interactive materiality. Thereby, it discusses how behavior transformation through interactive materiality derived from a theoretical level, can contribute to design knowledge on the implementation level. The aim of this paper is to inspire design-thinking to shift from the cognitive approach of persuasion, to a meaningful and embodied mechanism respecting all human skills, by providing practical insights for designers.

How to design for transformation of behavior through interactive materiality

Despite an increasing number of examples of shape-changing interfaces, the relation between users' actions and product movements has not gained a great deal of attention, nor been very well articulated. This paper presents a framework articulating the level of control offered to the user over the shape change. The framework considers whether the shape change is: 1) directly controlled by the user's explicit interactions; 2) negotiated with the user; 3) indirectly controlled by the users actions; 4) fully controlled by the system. The four types are described through design examples using ReFlex, a shape-changing interface in the form of a smartphone. The paper concludes that shape-changing interfaces tend to assign the control to either the user or the underlying system, while few (e.g. [16,28]) consider sharing the control between the user and the system.

Balancing User and System Control in Shape-Changing Interfaces: a Designerly Exploration

Force feedback and shape change are modalities with a growing application potential beyond the more traditional GUIs. We present two studies that explored the effect of these modalities on the emotional experience when interacting with an intelligent thermostat. The first study compared visual feedback, force feedback, and a combination of force feedback and shape change. Results indicate that force feedback correlates to experienced dominance during interaction, while shape change mainly affects experienced arousal. The second study explored how force feedback and shape change could communicate affective meaning during interaction with the thermostat through a co-design study. Participants designed the thermostat behavior for three scenarios supporting energy savings. Results suggest that despite their abstractness, force feedback and shape change convey affective meaning during the user-system dialogue. The findings contribute to the design of intelligible and intuitive feedback.

Ripple Thermostat: Affecting the Emotional Experience through Interactive Force Feedback and Shape Change

Technologies for shape-changing user interfaces are rapidly evolving, but our understanding of the design space of such interfaces is still limited. We report a repertory grid study that aims to describe the design space from the users' point of view by eliciting personal constructs about shape-change. The study is based on six similar-sized, shape-changing artifacts that combine simple sensing of users with actuation that change volume, texture, and orientation. Our results show that the 18 respondents distinguish artifacts on dimensions that differ from those of most models of shape change. For instance, they characterize shape-change in terms of personality, territoriality, and state of mind, in addition to more common categories such as appearance and product properties. We discuss how the dimensions derived from users might be used to design shape-changing interfaces.

/pdf/the-design-space-of-shape-changing-interfaces-a-repertory-2vl1xi0rfo.pdf

Miguel Bruns Alonso

Papers

Grand Challenges in Shape-Changing Interface Research

How to design for transformation of behavior through interactive materiality

Balancing User and System Control in Shape-Changing Interfaces: a Designerly Exploration

Ripple Thermostat: Affecting the Emotional Experience through Interactive Force Feedback and Shape Change

The design space of shape-changing interfaces: a repertory grid study