Experimental Psychology Its Scope and Method. IV. Learning and Memory. By Jean-Francois Le Ny, G. De Montpellier, G. Oleron and Cesar Flores. Translated by Louise Elkington. Edited by P. Fraisse and Jean Piaget. Pp. viii + 376. (Routledge and Kegan Paul: London, April 1970.) 80s.

Learning and Memory

As driving functions become increasingly automated, motorists run the risk of becoming cognitively removed from the driving process. Psychophysiological measures may provide added value not captured through behavioral or self-report measures alone. This paper provides a selective review of the psychophysiological measures that can be utilized to assess cognitive states in real-world driving environments. First, the importance of psychophysiological measures within the context of traffic safety is discussed. Next, the most commonly used physiology-based indices of cognitive states are considered as potential candidates relevant for driving research. These include: electroencephalography and event-related potentials, optical imaging, heart rate and heart rate variability, blood pressure, skin conductance, electromyography, thermal imaging, and pupillometry. For each of these measures, an overview is provided, followed by a discussion of the methods for measuring it in a driving context. Drawing from recent empirical driving and psychophysiology research, the relative strengths and limitations of each measure are discussed to highlight each measures' unique value. Challenges and recommendations for valid and reliable quantification from lab to (less predictable) real-world driving settings are considered. Finally, we discuss measures that may be better candidates for a near real-time assessment of motorists' cognitive states that can be utilized in applied settings outside the lab. This review synthesizes the literature on in-vehicle psychophysiological measures to advance the development of effective human-machine driving interfaces and driver support systems.

/pdf/a-review-of-psychophysiological-measures-to-assess-cognitive-4bkk7ryov7.pdf

A Review of Psychophysiological Measures to Assess Cognitive States in Real-World Driving

Current digital systems are largely blind to users’ cognitive states. Systems that adapt to users’ states show great potential for augmenting cognition and for creating novel user experiences. However, most approaches for sensing cognitive states, and cognitive load specifically, involve obtrusive technologies, such as physiological sensors attached to users’ bodies. This paper present an unobtrusive indicator of the users’ cognitive load based on thermal imaging that is applicable in real-world. We use a commercial thermal camera to monitor a person’s forehead and nose temperature changes to estimate their cognitive load. To assess the effect of different levels of cognitive load on facial temperature we conducted a user study with 12 participants. The study showed that different levels of the Stroop test and the complexity of reading texts affect facial temperature patterns, thereby giving a measure of cognitive load. To validate the feasibility for real-time assessments of cognitive load, we conducted a second study with 24 participants, we analyzed the temporal latency of temperature changes. Our system detected temperature changes with an average latency of 0.7 seconds after users were exposed to a stimulus, outperforming latency in related work that used other thermal imaging techniques. We provide empirical evidence showing how to unobtrusively detect changes in cognitive load in real-time. Our exploration of exposing users to different content types gives rise to thermal-based activity tracking, which facilitates new applications in the field of cognition-aware computing.

/pdf/cognitive-heat-exploring-the-usage-of-thermal-imaging-to-1y7pip8aty.pdf

Cognitive Heat: Exploring the Usage of Thermal Imaging to Unobtrusively Estimate Cognitive Load

Welcome to the CHI 2007 proceedings. We believe the technical papers and notes herein present some of the best current work in the diverse and dynamic field of human-computer interaction (HCI).

CHI is the leading HCI conference. Creating the technical program requires a huge investment of time and effort from members of the research community. 840 submissions were processed (571 papers, 269 notes), requiring over 3000 reviews. We thank all the reviewers for the dedication with which they undertook this task. We are particularly indebted to the papers and notes program committee members, also known as the Associate Chairs (ACs). Balancing areas of expertise, ACs were selected from the field's leading researchers. The AC role included recruiting all reviewers, moderating and supervising the review process to ensure a high-quality set of reviews was obtained, initiating and organizing author rebuttal and reviewer discussions and approving final submissions. The estimated time expenditure to serve as an AC was 11 days of full-time work; many committee members spent more time than that. Papers ACs came to San Jose in December 2006 from around the world for two intense days of review, debates, and deliberation; Notes ACs who could not attend the parallel notes meeting in San Jose engaged in a virtual conference. The committee was extremely serious and careful in making CHI paper and note decisions, with many submissions receiving multiple discussions, before and during the program committee meetings. No review process can guarantee perfect decisions, but we are confident that every possible effort was made to ensure fair process and high quality decision-making. This year's program committee certainly has our respect and gratitude, and deserves the sincere appreciation of the entire HCI community. We would also like to thank the ACs and their organizations for underwriting the travel expenses for meeting.

CHI is both a journal-quality archival forum and a community-building conference. To encourage quality in the written presentation of accepted work, all of the 142 full paper and 40 note acceptances were provisional. As a result, authors actively responded and incorporated feedback from the reviews into the final versions of the papers that appear here.

Twenty-eight accepted papers and four accepted notes (5% of submissions) deemed to make an especially noteworthy contribution to human-computer interaction research were nominated by the program committee for Best Paper and Best Note Awards; these nominated papers and notes are identified in the Final Program. At the conference, up to six of these will be announced as winners of a CHI Best Paper Award (1% of submissions), and one note will be selected as an exemplary note. While all papers accepted into the CHI technical papers program have passed a rigorous examination of their quality, the Best Paper and Best Notes Awards signal and reward particularly outstanding contributions in each year.

CHI '07 Extended Abstracts on Human Factors in Computing Systems

https://people.eng.unimelb.edu.au/vkostakos/files/papers/ijim19.pdf

Multimodal Data as a means to understand the Learning Experience

PINs and patterns remain among the most widely used knowledge-based authentication schemes. As thermal cameras become ubiquitous and affordable, we foresee a new form of threat to user privacy on mobile devices. Thermal cameras allow performing thermal attacks, where heat traces, resulting from authentication, can be used to reconstruct passwords. In this work we investigate in details the viability of exploiting thermal imaging to infer PINs and patterns on mobile devices. We present a study (N=18) where we evaluated how properties of PINs and patterns influence their thermal attacks resistance. We found that thermal attacks are indeed viable on mobile devices; overlapping patterns significantly decrease successful thermal attack rate from 100% to 16.67%, while PINs remain vulnerable (>72% success rate) even with duplicate digits. We conclude by recommendations for users and designers of authentication schemes on how to resist thermal attacks.

/pdf/stay-cool-understanding-thermal-attacks-on-mobile-based-user-3u5wol3m3g.pdf

Stay Cool! Understanding Thermal Attacks on Mobile-based User Authentication

In this paper, we investigate nine different visual representations of gaze in a competitive digital game setting. We evaluate the ability of spectators to infer a player's intentions in the game for each visual representation. Our results show that spectators have a remarkable ability to infer intent accurately using all nine visualizations, but that visualizations with certain characteristics were more comprehensible and more readily revealed the player's intent. The real-time Heatmap visualization was the most highly preferred by participants and the most effective in revealing intent, due to its ability to balance real-time gaze information with a persistent summary of recent gaze behaviour. Our findings show that eye-tracking visualization can enable playful interactions in competitive games based on players' ability to interpret opponents' attention and intention through gaze information.

/pdf/evaluating-real-time-gaze-representations-to-infer-4i3qrgppfj.pdf

Evaluating Real-Time Gaze Representations to Infer Intentions in Competitive Turn-Based Strategy Games

Thermal cameras have recently drawn the attention of HCI researchers as a new sensory system enabling novel interactive systems. They are robust to illumination changes and make it easy to separate human bodies from the image background. Far-infrared radiation, however, has another characteristic that distinguishes thermal cameras from their RGB or depth counterparts, namely thermal reflection. Common surfaces reflect thermal radiation differently than visual light and can be perfect thermal mirrors. In this paper, we show that through thermal reflection, thermal cameras can sense the space beyond their direct field-of-view. A thermal camera can sense areas besides and even behind its field-of-view through thermal reflection. We investigate how thermal reflection can increase the interaction space of projected surfaces using camera-projection systems. We moreover discuss the reflection characteristics of common surfaces in our vicinity in both the visual and thermal radiation bands. Using a proof-of-concept prototype, we demonstrate the increased interaction space for hand-held camera-projection system. Furthermore, we depict a number of promising application examples that can benefit from the thermal reflection characteristics of surfaces.

/pdf/exploiting-thermal-reflection-for-interactive-systems-3bu0qi9icy.pdf

Exploiting thermal reflection for interactive systems

Recent work demonstrated the exciting opportunities that thermal imaging offers for the development of interactive systems. It was shown that a thermal camera can sense when a user touches a surface, performs gestures in the camera's direct field of view and, in addition, performs gestures outside the camera's direct field of view through thermal reflection. In this paper, we investigate the material properties that should be considered for detecting interaction using thermal imaging considering both in- and outdoor settings. We conducted a study to analyze the recognition performance for different gestures and different surfaces. Using the results, we derive guidelines on material properties of surfaces for detecting on-surface as well as mid-air interaction using a thermal camera. We discuss the constrains that should be taken into account using thermal imaging as the sensing technology. Finally, we present a material space based on our findings. The space depicts surfaces and the required properties that enable the different interaction techniques.

/pdf/investigation-of-material-properties-for-thermal-imaging-13bxmihm20.pdf

Yomna Abdelrahman

Papers

Cognitive Heat: Exploring the Usage of Thermal Imaging to Unobtrusively Estimate Cognitive Load

Stay Cool! Understanding Thermal Attacks on Mobile-based User Authentication

Evaluating Real-Time Gaze Representations to Infer Intentions in Competitive Turn-Based Strategy Games

Exploiting thermal reflection for interactive systems

Investigation of Material Properties for Thermal Imaging-Based Interaction