Balancing physical and digital properties in mixed objects
Summary (3 min read)
1. INTRODUCTION
- Mixed interactive systems seek to smoothly merge physical and digital worlds.
- The design of such mixed systems gives rise to further design challenges due to the new roles that physical objects can play in an interactive system.
- Addressing this challenge, in [7], the authors introduced the Mixed Interaction Model:.
- The authors first present the main features of ORBIS, a mixed system that they designed and developed.
- The authors then recall the key elements of their model before presenting the intrinsic characterization scheme of a mixed object.
2. ILLUSTRATIVE EXAMPLE: ORBIS
- ORBIS is a system providing new ways to enjoy personal pictures, music and videos in a family house.
- Pictures are embedded in a silicone object , displayed as a slideshow through a mini screen and are always correctly displayed according to the orientation of the silicone shape , thanks to embedded accelerometers.
- ORBIS then allows the user to perform tasks including play/pause the presentation, shuffle or navigate the list of pictures (Table 1) by interacting with the mixed object.
- To play/pause Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page.
- Nevertheless in the rest of the paper, the authors focus on the mixed object “List of pictures” from an intrinsic point of view without considering its context of use.
3. MODELING OF A MIXED OBJECT
- The key concept of the Mixed Interaction Model is a mixed object.
- The Mixed Interaction Model enables us to model both mixed objects and interaction with them.
- The authors recall here the main principles of the model for defining a mixed object only, since they focus on intrinsic characteristics of an object without considering the interaction with it.
3.1 Definition
- Objects existing in both the physical and digital worlds are depicted in the literature as mixed objects [4], augmented objects or physical-digital objects, but there is no precise definition of such objects.
- The link between the physical and the digital parts of an object is defined by linking modalities.
- The authors reuse these two levels of abstraction, device and language.
- Two accelerometers each acquire 1D acceleration from physical properties.
- The output linking language translates the digital properties of the object in order to present the list of pictures as a slideshow.
3.2.1 Sensed/Generated Physical Properties
- The authors consider physical properties independently of the linking modalities.
- In order to take into account the user in the design process, the authors relate the perceived affordance [12] of physical properties, cultural constraints and predictability [1] to the sensed physical properties.
- Biologists explore (move, turn, resize) molecules shown as a graph projected on the table.
- Physical properties taken into account in the NAVRNA tool, i.e. blue token, include the physical position and the color of the tokens.
- The physical property of a token, its position, which was Sensed/Non Generated, is now Sensed/Generated, as in [14][15].
3.2.2 Acquired/Materialized Digital Properties
- In order to take into account the user in the design process at the digital properties level, the authors may relate the materialized characteristic to the observability property [1].
- By considering the same example, NAVRNA, designers may have a top-down approach, starting from the digital side.
4. INTRINSIC DESIGN OF A MIXED OBJECT: ORBIS EXAMPLE
- Physical and digital properties of a mixed object are characterized by two orthogonal design axes, respectively Sensed/Generated and Acquired/Materialized as schematized in Figure 3.
- On the one hand, the design approach can be bottom-up, starting from a physical object with a set of physical properties and then defining its generated physical properties as well as its sensed physical properties, before deciding the linking modalities.
- The first obvious digital property is the digital list of pictures (Image 0, …, Image n).
- Thus the authors need to define an input linking modality, linking the physical to the digital top of pictures.
- The non-generated physical property i.e. the top of the silicone shape is sensed by an input linking modality, such as (accelerometers, orientation).
6. CONCLUSION
- Based on their Mixed Interaction Model, the authors introduce a new characterization space of the physical and digital properties of a mixed object from an intrinsic viewpoint.
- According to [13], it proves the usefulness of their model that facilitates interconnection between existing approaches.
- The authors currently do not find examples of design solutions in the literature that their model left out.
- Applying their model and its intrinsic characteristics, the authors were able to make a fine distinction between these interfaces, where other taxonomies only partially capture these differences.
- Going further than describing and classifying existing mixed systems, in order to assess if the model is useful for design, the authors use another form of empirical evaluation: they applied the model in real design situations.
Did you find this useful? Give us your feedback
Citations
74 citations
55 citations
28 citations
13 citations
9 citations
Cites background or methods from "Balancing physical and digital prop..."
...identified that high level mixed interaction models such as ASUR [9] or MIM [6] constitutes appropriate candidates to be used in a MACS....
[...]
...As already mentioned, two different models were used by each session: ASUR [9] and MIM [6]....
[...]
...Some of them support interaction design [6,9], others propose abstract conceptual frameworks [10,11,13,20] which provide a better understanding of the MIS field....
[...]
...We led two sessions with two different interaction models: ASUR [9] and MIM [6] in order to test the generic aspect of the MACS....
[...]
References
1,673 citations
"Balancing physical and digital prop..." refers background or methods in this paper
...Affordance [12] is defined as the physical properties the user can act on....
[...]
...In order to take into account the user in the design process, we relate the perceived affordance [12] of physical properties, cultural constraints and predictability [1] to the sensed physical properties....
[...]
1,085 citations
"Balancing physical and digital prop..." refers background or methods in this paper
...¥ First, the Input & Output axis [9] characterizes the system inputs and outputs without considering the two levels of a linking modality, device and language, as well as the two types of properties physical and digital....
[...]
...For example, we refine “Light (photoelectric cell)” from [9] into: the sensed physical luminosity, the input linking modality (photoelectric cell, language-filter), and resulting digital properties....
[...]
...The Sensed/Generated and Acquired/Materialized characteristics of the physical and digital properties generalize the Input & Output axis presented in [9], the characterization of physical properties in MCRit [16] and the sensed movements in [3]....
[...]
259 citations
"Balancing physical and digital prop..." refers background in this paper
...abstraction are also presented in [5] and [10]....
[...]
248 citations
"Balancing physical and digital prop..." refers background in this paper
...Second, MCRit [16] splits the output of the system between tangible and intangible representation....
[...]
...• Second, MCRit [16] splits the output of the system between tangible and intangible representation....
[...]
...RELATED WORK The Sensed/Generated and Acquired/Materialized characteristics of the physical and digital properties generalize the Input & Output axis presented in [9], the characterization of physical properties in MCRit [16] and the sensed movements in [3]....
[...]
...The Sensed/Generated and Acquired/Materialized characteristics of the physical and digital properties generalize the Input & Output axis presented in [9], the characterization of physical properties in MCRit [16] and the sensed movements in [3]....
[...]
226 citations
Related Papers (5)
Frequently Asked Questions (2)
Q2. What future works have the authors mentioned in the paper "Balancing physical and digital properties in mixed objects" ?
As on-going work, the authors are currently further evaluating the model by considering three groups of designers in the context of a mixed system for museum exhibits: one group working with this model, another with the ASUR model [ 8 ], and a third group without any model.