Past research on shape displays has primarily focused on rendering content and user interface elements through shape output, with less emphasis on dynamically changing UIs. We propose utilizing shape displays in three different ways to mediate interaction: to facilitate by providing dynamic physical affordances through shape change, to restrict by guiding users with dynamic physical constraints, and to manipulate by actuating physical objects. We outline potential interaction techniques and introduce Dynamic Physical Affordances and Constraints with our inFORM system, built on top of a state-of-the-art shape display, which provides for variable stiffness rendering and real-time user input through direct touch and tangible interaction. A set of motivating examples demonstrates how dynamic affordances, constraints and object actuation can create novel interaction possibilities.

https://static.ideaconnection.com/docs/12432/uist335-follmer.pdf

inFORM: dynamic physical affordances and constraints through shape and object actuation

We present an approach to 3D printing custom optical elements for interactive devices labelled Printed Optics. Printed Optics enable sensing, display, and illumination elements to be directly embedded in the casing or mechanical structure of an interactive device. Using these elements, unique display surfaces, novel illumination techniques, custom optical sensors, and embedded optoelectronic components can be digitally fabricated for rapid, high fidelity, highly customized interactive devices. Printed Optics is part of our long term vision for interactive devices that are 3D printed in their entirety. In this paper we explore the possibilities for this vision afforded by fabrication of custom optical elements using today's 3D printing technology.

/pdf/printed-optics-3d-printing-of-embedded-optical-elements-for-2n266chgou.pdf

Printed optics: 3D printing of embedded optical elements for interactive devices

Recent research proposes augmenting capacitive touch pads with tangible objects, enabling a new generation of mobile applications enhanced with tangible objects, such as game pieces and tangible controllers. In this paper, we extend the concept to capacitive tangibles consisting of multiple parts, such as stackable gaming pieces and tangible widgets with moving parts. We achieve this using a system of wires and connectors inside each block that causes the capacitance of the bottom-most block to reflect the entire assembly. We demonstrate three types of tangibles, called CapStones, Zebra Dials and Zebra Sliders that work with current consumer hardware and investigate what designs may become possible as touchscreen hardware evolves.

CapStones and ZebraWidgets: sensing stacks of building blocks, dials and sliders on capacitive touch screens

Touch screen surfaces large enough for ten-finger input have become increasingly popular, yet typing on touch screens pales in comparison to physical keyboards. We examine typing patterns that emerge when expert users of physical keyboards touch-type on a flat surface. Our aim is to inform future designs of touch screen keyboards, with the ultimate goal of supporting touch-typing with limited tactile feedback. To study the issues inherent to flat-glass typing, we asked 20 expert typists to enter text under three conditions: (1) with no visual keyboard and no feedback on input errors, then (2) with and (3) without a visual keyboard, but with some feedback. We analyzed touch contact points and hand contours, looking at attributes such as natural finger positioning, the spread of hits among individual keys, and the pattern of non-finger touches. We also show that expert typists exhibit spatially consistent key press distributions within an individual, which provides evidence that eyes-free touch-typing may be possible on touch surfaces and points to the role of personalization in such a solution. We conclude with implications for design.

Typing on flat glass: examining ten-finger expert typing patterns on touch surfaces

The potential of tabletops to enable groups of people to simultaneously touch and manipulate a shared tabletop interface provides new possibilities for supporting collaborative learning. However, findings from the few studies carried out to date have tended to show small or insignificant effects compared with other technologies. We present the Collaborative Learning Mechanisms framework used to examine the coupling of verbal interactions and physical actions in collaboration around the tabletop and reveal subtle mechanisms at play. Analysis in this way revealed that what might be considered undesirable or harmful interactions and intrusions in general collaborative settings, might be beneficial for collaborative learning. We discuss the implications of these findings for how tabletops may be used to support children's collaboration, and the value of considering verbal and physical aspects of interaction together in this way.

/pdf/actions-speak-loudly-with-words-unpacking-collaboration-170eigqtfm.pdf

Actions speak loudly with words: unpacking collaboration around the table

We present Silicone iLluminated Active Peripherals (SLAP), a system of tangible, translucent widgets for use on multitouch tabletops. SLAP Widgets are cast from silicone or made of acrylic, and include sliders, knobs, keyboards, and buttons. They add tactile feedback to multi-touch tables, improving input accuracy. Using rear projection, SLAP Widgets can be relabeled dynamically, providing inexpensive, battery-free, and untethered augmentations. Furthermore, SLAP combines the flexibility of virtual objects with physical affordances. We evaluate how SLAP Widgets influence the user experience on tabletops compared to virtual controls. Empirical studies show that SLAPWidgets are easy to use and outperform virtual controls significantly in terms of accuracy and overall interaction time.

/pdf/slap-widgets-bridging-the-gap-between-virtual-and-physical-4jfxqo37wn.pdf

SLAP widgets: bridging the gap between virtual and physical controls on tabletops

We present SLAPbook, an application using SLAP, translucent and tangible widgets for use on vision-based multi-touch tabletops in Single Display Groupware (SDG) environments. SLAP stands for Silicone ILluminated Active Peripherals and includes widgets such as sliders, knobs, keyboards, and buttons. The widgets and tactile feedback to multi-touch tables while simultaneously providing dynamic relabeling to tangible objects using the table's rear projection. SLAPbook provides multiple users the ability to add and edit content to a guestbook, browse other peoples' entries, and access personal data using a token-based personalization system. Interaction with the table takes place in the personal and public space so that users can make use of personal and shared controls to perform separate and coordinative actions.

/pdf/slapbook-tangible-widgets-on-multi-touch-tables-in-groupware-16bqtq0nii.pdf

Roger Jennings

Papers

SLAP widgets: bridging the gap between virtual and physical controls on tabletops

SLAPbook: tangible widgets on multi-touch tables in groupware environments