Toward a decision-theoretic framework for affect recognition and user assistance
Reads0
Chats0
TLDR
A general unified decision-theoretic framework based on influence diagrams for simultaneously modeling user affect recognition and assistance is presented and a non-invasive real-time prototype system to recognize different user affective states from four-modality user measurements is built.Abstract:
There is an increasing interest in developing intelligent human-computer interaction systems that can fulfill two functions-recognizing user affective states and providing the user with timely and appropriate assistance. In this paper, we present a general unified decision-theoretic framework based on influence diagrams for simultaneously modeling user affect recognition and assistance. Affective state recognition is achieved through active probabilistic inference from the available multi modality sensory data. User assistance is automatically accomplished through a decision-making process that balances the benefits of keeping the user in productive affective states and the costs of performing user assistance. We discuss three theoretical issues within the framework, namely, user affect recognition, active sensory action selection, and user assistance. Validation of the proposed framework via a simulation study demonstrates its capability in efficient user affect recognition as well as timely and appropriate user assistance. Besides the theoretical contributions, we build a non-invasive real-time prototype system to recognize different user affective states (stress and fatigue) from four-modality user measurements, namely physical appearance features, physiological measures, user performance, and behavioral data. The affect recognition component of the prototype system is subsequently validated through a real-world study involving human subjects.read more
Citations
More filters
Journal ArticleDOI
Analytical mapping of opinion mining and sentiment analysis research during 2000–2015
TL;DR: A detailed analytical mapping of OMSA research work is presented and the progress of discipline on various useful parameters are charted.
Journal ArticleDOI
Multimodal behavioral analysis for non-invasive stress detection
TL;DR: This study presents and approach to measure the levels of acute stress in humans by analysing their behavioral patterns when interacting with technological devices, and constitutes the foundation of a context layer for a virtual environment for conflict resolution.
Journal ArticleDOI
Affectively intelligent and adaptive car interfaces
TL;DR: Adaptation of the interface was designed to provide multi-modal feedback to the users about their current affective state and to respond to users' negative emotional states in order to decrease the possible negative impacts of those emotions.
BookDOI
Affective Information Processing
Jianhua Tao,Tieniu Tan +1 more
TL;DR: This ground-breaking book provides a comprehensive overview and significant insight into the field of affective information processing, and will prove a valuable reference tool and resource.
Proceedings ArticleDOI
Understanding physiological responses to stressors during physical activity
TL;DR: By modularizing stress models with respect to physical activity, this work can recognize stress with accuracies of 82% (objective stress) and 87% (subjective stress), achieving more than a 5-10% improvement from approaches that do not take physical activity into account.
References
More filters
Book
Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference
TL;DR: Probabilistic Reasoning in Intelligent Systems as mentioned in this paper is a complete and accessible account of the theoretical foundations and computational methods that underlie plausible reasoning under uncertainty, and provides a coherent explication of probability as a language for reasoning with partial belief.
Journal ArticleDOI
Job Demands, Job Decision Latitude, and Mental Strain: Implications for Job Redesign
Book
Affective Computing
TL;DR: Key issues in affective computing, " computing that relates to, arises from, or influences emotions", are presented and new applications are presented for computer-assisted learning, perceptual information retrieval, arts and entertainment, and human health and interaction.
Book
The Cognitive Structure of Emotions
TL;DR: In this paper, a cognitive theory of emotion is proposed, which describes the organization of emotion types and the implications of the emotions-as-valenced-reactions claim, and the boundaries of the theory Emotion words and cross-cultural issues.