This review comprises a detailed survey of ongoing methodologies for soft actuators, highlighting approaches suitable for nanometer- to centimeter-scale robotic applications. Soft robots present a special design challenge in that their actuation and sensing mechanisms are often highly integrated with the robot body and overall functionality. When less than a centimeter, they belong to an even more special subcategory of robots or devices, in that they often lack on-board power, sensing, computation, and control. Soft, active materials are particularly well suited for this task, with a wide range of stimulants and a number of impressive examples, demonstrating large deformations, high motion complexities, and varied multifunctionality. Recent research includes both the development of new materials and composites, as well as novel implementations leveraging the unique properties of soft materials.

Soft Actuators for Small-Scale Robotics.

Past research on shape displays has primarily focused on rendering content and user interface elements through shape output, with less emphasis on dynamically changing UIs. We propose utilizing shape displays in three different ways to mediate interaction: to facilitate by providing dynamic physical affordances through shape change, to restrict by guiding users with dynamic physical constraints, and to manipulate by actuating physical objects. We outline potential interaction techniques and introduce Dynamic Physical Affordances and Constraints with our inFORM system, built on top of a state-of-the-art shape display, which provides for variable stiffness rendering and real-time user input through direct touch and tangible interaction. A set of motivating examples demonstrates how dynamic affordances, constraints and object actuation can create novel interaction possibilities.

https://static.ideaconnection.com/docs/12432/uist335-follmer.pdf

inFORM: dynamic physical affordances and constraints through shape and object actuation

BACKGROUND The tight integration of sensing, actuation, and computation that biological systems exhibit to achieve shape and appearance changes (like the cuttlefish and birds in flight), adaptive load support (like the banyan tree), or tactile sensing at very high dynamic range (such as the human skin) has long served as inspiration for engineered systems. Artificial materials with such capabilities could enable airplane wings and vehicles with the ability to adapt their aerodynamic profile or camouflage in the environment, bridges and other civil structures that could detect and repair damages, or robotic skin and prosthetics with the ability to sense touch and subtle textures. The vision for such materials has been articulated repeatedly in science and fiction (“programmable matter”) and periodically has undergone a renaissance with the advent of new enabling technology such as fast digital electronics in the 1970s and microelectromechanical systems in the 1990s. ADVANCES Recent advances in manufacturing, combined with the miniaturization of electronics that has culminated in providing the power of a desktop computer of the 1990s on the head of a pin, is enabling a new class of “robotic” materials that transcend classical composite materials in functionality. Whereas state-of-the-art composites are increasingly integrating sensors and actuators at high densities, the availability of cheap and small microprocessors will allow these materials to function autonomously. Yet, this vision requires the tight integration of material science, computer science, and other related disciplines to make fundamental advances in distributed algorithms and manufacturing processes. Advances are currently being made in individual disciplines rather than system integration, which has become increasingly possible in recent years. For example, the composite materials community has made tremendous advances in composites that integrate sensing for nondestructive evaluation, and actuation (for example, for shape-changing airfoils), as well as their manufacturing. At the same time, computer science has created an entire field concerned with distributed algorithms to collect, process, and act upon vast collections of information in the field of sensor networks. Similarly, manufacturing has been revolutionized by advances in three-dimensional (3D) printing, as well as entirely new methods for creating complex structures from unfolding or stretching of patterned 2D composites. Finally, robotics and controls have made advances in controlling robots with multiple actuators, continuum dynamics, and large numbers of distributed sensors. Only a few systems have taken advantage of these advances, however, to create materials that tightly integrate sensing, actuation, computation, and communication in a way that allows them to be mass-produced cheaply and easily. OUTLOOK Robotic materials can enable smart composites that autonomously change their shape, stiffness, or physical appearance in a fully programmable way, extending the functionality of classical “smart materials.” If mass-produced economically and available as a commodity, robotic materials have the potential to add unprecedented functionality to everyday objects and surfaces, enabling a vast array of applications ranging from more efficient aircraft and vehicles, to sensorial robotics and prosthetics, to everyday objects like clothing and furniture. Realizing this vision requires not only a new level of interdisciplinary collaboration between the engineering disciplines and the sciences, but also a new model of interdisciplinary education that captures both the disciplinary breadth of robotic materials and the depth of individual disciplines.

Materials that couple sensing, actuation, computation, and communication

A self-contained interactive video display system. A projector projects a visual image onto a screen for displaying the visual image, wherein the projector projects the visual image onto a back side of the screen for presentation to a user on a front side of the screen. An illuminator illuminates an object near the front side of the screen. A camera detects interaction of an illuminated object with the visual image, wherein the screen is at least partially transparent to light detectable to the camera, allowing the camera to detect the illuminated object through the screen. A computer system directs the projector to change the visual image in response to the interaction.

Self-contained interactive video display system

技術解説 IEEE Computer

Malleable and organic user interfaces have the potential to enable radically new forms of interactions and expressiveness through flexible, free-form and computationally controlled shapes and displays. This work, specifically focuses on particle jamming as a simple, effective method for flexible, shape-changing user interfaces where programmatic control of material stiffness enables haptic feedback, deformation, tunable affordances and control gain. We introduce a compact, low-power pneumatic jamming system suitable for mobile devices, and a new hydraulic-based technique with fast, silent actuation and optical shape sensing. We enable jamming structures to sense input and function as interaction devices through two contributed methods for high-resolution shape sensing using: 1) index-matched particles and fluids, and 2) capacitive and electric field sensing. We explore the design space of malleable and organic user interfaces enabled by jamming through four motivational prototypes that highlight jamming's potential in HCI, including applications for tabletops, tablets and for portable shape-changing mobile devices.

/pdf/jamming-user-interfaces-programmable-particle-stiffness-and-a2djnmtx6i.pdf

Jamming user interfaces: programmable particle stiffness and sensing for malleable and shape-changing devices

Relief is an actuated tabletop display, which is able to render and animate three-dimensional shapes with a malleable surface. It allows users to experience and form digital models like geographical terrain in an intuitive manner. The tabletop surface is actuated by an array of 120 motorized pins, which are controlled with a low-cost, scalable platform built upon open-source hardware and software tools. Each pin can be addressed individually and senses user input like pulling and pushing.

/pdf/relief-a-scalable-actuated-shape-display-2g87c8gy6j.pdf

Relief: a scalable actuated shape display

We propose a new approach to Physical Telepresence, based on shared workspaces with the ability to capture and remotely render the shapes of people and objects. In this paper, we describe the concept of shape transmission, and propose interaction techniques to manipulate remote physical objects and physical renderings of shared digital content. We investigate how the representation of user's body parts can be altered to amplify their capabilities for teleoperation. We also describe the details of building and testing prototype Physical Telepresence workspaces based on shape displays. A preliminary evaluation shows how users are able to manipulate remote objects, and we report on our observations of several different manipulation techniques that highlight the expressive nature of our system.

/pdf/physical-telepresence-shape-capture-and-display-for-embodied-3lseyej43y.pdf

Physical telepresence: shape capture and display for embodied, computer-mediated remote collaboration

Actuated shape output provides novel opportunities for experiencing, creating and manipulating 3D content in the physical world. While various shape displays have been proposed, a common approach utilizes an array of linear actuators to form 2.5D surfaces. Through identifying a set of common interactions for viewing and manipulating content on shape displays, we argue why input modalities beyond direct touch are required. The combination of freehand gestures and direct touch provides additional degrees of freedom and resolves input ambiguities, while keeping the locus of interaction on the shape output. To demonstrate the proposed combination of input modalities and explore applications for 2.5D shape displays, two example scenarios are implemented on a prototype system.

/pdf/direct-and-gestural-interaction-with-relief-a-2-5d-shape-53glnybbze.pdf

Daniel Leithinger

Papers

inFORM: dynamic physical affordances and constraints through shape and object actuation

Jamming user interfaces: programmable particle stiffness and sensing for malleable and shape-changing devices

Relief: a scalable actuated shape display

Physical telepresence: shape capture and display for embodied, computer-mediated remote collaboration

Direct and gestural interaction with relief: a 2.5D shape display