Data Mining Practical Machine Learning Tools and Techniques

User Centered Design

Although rapid advances in machine learning have made it increasingly applicable to expert decision-making, the delivery of accurate algorithmic predictions alone is insufficient for effective human-AI collaboration. In this work, we investigate the key types of information medical experts desire when they are first introduced to a diagnostic AI assistant. In a qualitative lab study, we interviewed 21 pathologists before, during, and after being presented deep neural network (DNN) predictions for prostate cancer diagnosis, to learn the types of information that they desired about the AI assistant. Our findings reveal that, far beyond understanding the local, case-specific reasoning behind any model decision, clinicians desired upfront information about basic, global properties of the model, such as its known strengths and limitations, its subjective point-of-view, and its overall design objective--what it's designed to be optimized for. Participants compared these information needs to the collaborative mental models they develop of their medical colleagues when seeking a second opinion: the medical perspectives and standards that those colleagues embody, and the compatibility of those perspectives with their own diagnostic patterns. These findings broaden and enrich discussions surrounding AI transparency for collaborative decision-making, providing a richer understanding of what experts find important in their introduction to AI assistants before integrating them into routine practice.

https://dl.acm.org/doi/pdf/10.1145/3359206

"Hello AI": Uncovering the Onboarding Needs of Medical Practitioners for Human-AI Collaborative Decision-Making

Data-driven decision-making consequential to individuals raises important questions of accountability and justice. Indeed, European law provides individuals limited rights to 'meaningful information about the logic' behind significant, autonomous decisions such as loan approvals, insurance quotes, and CV filtering. We undertake three experimental studies examining people's perceptions of justice in algorithmic decision-making under different scenarios and explanation styles. Dimensions of justice previously observed in response to human decision-making appear similarly engaged in response to algorithmic decisions. Qualitative analysis identified several concerns and heuristics involved in justice perceptions including arbitrariness, generalisation, and (in)dignity. Quantitative analysis indicates that explanation styles primarily matter to justice perceptions only when subjects are exposed to multiple different styles --- under repeated exposure of one style, scenario effects obscure any explanation effects. Our results suggests there may be no 'best' approach to explaining algorithmic decisions, and that reflection on their automated nature both implicates and mitigates justice dimensions.

'It's Reducing a Human Being to a Percentage': Perceptions of Justice in Algorithmic Decisions

Designing interfaces or applications that move beyond the bounds of a single device screen enables new ways to engage with digital content. Research addressing the opportunities and challenges of interactions with multiple devices in concert is of continued focus in HCI research. To inform the future research agenda of this field, we contribute an analysis and taxonomy of a corpus of 510 papers in the cross-device computing domain. For both new and experienced researchers in the field we provide: an overview, historic trends and unified terminology of cross-device research; discussion of major and under-explored application areas; mapping of enabling technologies; synthesis of key interaction techniques spanning across multiple devices; and review of common evaluation strategies. We close with a discussion of open issues. Our taxonomy aims to create a unified terminology and common understanding for researchers in order to facilitate and stimulate future cross-device research.

/pdf/cross-device-taxonomy-survey-opportunities-and-challenges-of-2rubom7yex.pdf

Cross-Device Taxonomy: Survey, Opportunities and Challenges of Interactions Spanning Across Multiple Devices

Avatars in virtual reality (VR) enable embodied experiences and induce the Proteus effect—a shift in behavior and attitude to mimic one’s digital representation. Previous work found that avatars associated with physical strength can decrease users’ perceived exertion when performing physical tasks. However, it is unknown if an avatar’s appearance can also influence the user’s physiological response to exercises. Therefore, we conducted an experiment with 24 participants to investigate the effect of avatars’ athleticism on heart rate and perceived exertion while cycling in VR following a standardized protocol. We found that the avatars’ athleticism has a significant and systematic effect on users’ heart rate and perceived exertion. We discuss potential moderators such as body ownership and users’ level of fitness. Our work contributes to the emerging area of VR exercise systems.

Physiological and Perceptual Responses to Athletic Avatars while Cycling in Virtual Reality

This paper introduces Thaddeus---a mobile phone-tablet system for mobile interaction with information visualisations. Our work is motivated by the roles smartphones and tablets play in everyday interactive spaces as well as anticipated developments in mobile sensing technology. We also aim to meet the social challenges of a data-driven society. We designed and implemented a system that uses mutual spatial awareness as an input mode, producing new interaction patterns for mobile settings. We gathered extensive user insight from two design studies and evaluated the system in a controlled experiment. We used qualitative and quantitative measures in the final evaluation. The results show that the system does not have a significant impact on performance, but users perceive it as pleasurable and easy to use. Thaddeus offers an enhanced user experience when exploring information on the go, and provides insights for future designs of mobile multi-device systems.

Thaddeus: a dual device interaction space for exploring information visualisation

In this paper, we address shoes as a platform for wearable displays. To open research on the area, we present a functional prototype of a display integrated to a sports shoe. The prototype utilizes three different areas of LEDs attached to the shoe as a display mechanism, and indicates the wearer's running pace relative to a preset target pace. To explore perceptions of the concept, and ideate further on the topic, we conducted semi-structured interviews with a group of regular runners. Initial findings suggest that the ambient, peripheral visibility of the sports shoe display is appreciated as fitting well to the running activity. To provide a structure for future work in the area we present a design space for shoe displays, identifying aspects such as scope of visibility, content, visualization style, and usage context.

Shoe integrated displays: a prototype sports shoe display and design space

As architects usually decide on the shape and look of windows during the design of buildings, opportunities for interactive windows have not been systematically explored yet. In this work, we extend the vision of sustainable and comfortable adaptive buildings using interactive smart windows. We systematically explore the design space of interactive windows to chart requirements, constraints, and challenges. To that end, we built proof-of-concept prototypes of smart windows with fine-grained control of transparency. In two studies, we explored user attitudes towards interactive windows and elicited control methods. We found that users understand and see potential for interactive windows at home. We provide specific usage contexts and specify interactions that may facilitate domestic applications. Our work illustrates the concept of interactive smart windows and provides insights regarding their design, development, and user controls for adaptive walls. We identify design dimensions and challenges to stimulate further development in the domain of adaptive buildings.

WindowWall: Towards Adaptive Buildings with Interactive Windows as Ubiquitous Displays

Interactive technologies are getting closer to our bodies and permeate the infrastructure of our homes. While such technologies offer many benefits, they can also cause an initial feeling of unease in users. It is important for Human-Computer Interaction to manage first impressions and avoid designing technologies that appear creepy. To that end, we developed the Perceived Creepiness of Technology Scale (PCTS), which measures how creepy a technology appears to a user in an initial encounter with a new artefact. The scale was developed based on past work on creepiness and a set of ten focus groups conducted with users from diverse backgrounds. We followed a structured process of analytically developing and validating the scale. The PCTS is designed to enable designers and researchers to quickly compare interactive technologies and ensure that they do not design technologies that produce initial feelings of creepiness in users.

Paweł W. Woźniak

Papers

Physiological and Perceptual Responses to Athletic Avatars while Cycling in Virtual Reality

Thaddeus: a dual device interaction space for exploring information visualisation

Shoe integrated displays: a prototype sports shoe display and design space

WindowWall: Towards Adaptive Buildings with Interactive Windows as Ubiquitous Displays

Creepy Technology: What Is It and How Do You Measure It?