Showing papers by "Thierry Pun published in 2017"

Toolbox for Emotional feAture extraction from Physiological signals (TEAP)

Abstract: Physiological response is an important component of an emotional episode. In this paper, we introduce a Toolbox for Emotional feAture Extraction from Physiological signals (TEAP). This open source toolbox can preprocess and calculate emotionally relevant features from multiple physiological signals, namely, electroencephalogram (EEG), galvanic skin response (GSR), electromyogram (EMG), skin temperature, respiration pattern and blood volume pulse. The features from this toolbox are tested on two publicly available databases, i.e., MAHNOB-HCI and DEAP. We demonstrated that we achieve similar performance to the original work with the features from this toolbox. The toolbox is implemented in MATLAB and is also compatible with Octave. We hope this toolbox to be further developed and accelerate research in affective physiological signal analysis.

Recognizing induced emotions of movie audiences: Are induced and perceived emotions the same?

Abstract: Predicting the emotional response of movie audiences to affective movie content is a challenging task in affective computing. Previous work has focused on using audiovisual movie content to predict movie induced emotions. However, the relationship between the audience's perceptions of the affective movie content (perceived emotions) and the emotions evoked in the audience (induced emotions) remains unexplored. In this work, we address the relationship between perceived and induced emotions in movies, and identify features and modelling approaches effective for predicting movie induced emotions. First, we extend the LIRIS-ACCEDE database by annotating perceived emotions in a crowd-sourced manner, and find that perceived and induced emotions are not always consistent. Second, we show that dialogue events and aesthetic highlights are effective predictors of movie induced emotions. In addition to movie based features, we also study physiological and behavioural measurements of audiences. Our experiments show that induced emotion recognition can benefit from including temporal context and from including multimodal information. Our study bridges the gap between affective content analysis and induced emotion prediction.

Films, Affective Computing and Aesthetic Experience: Identifying Emotional and Aesthetic Highlights from Multimodal Signals in a Social Setting.

Abstract: Over the last years affective computing has been strengthening its ties with the humanities, exploring and building understanding of people's responses to specific artistic multimedia stimuli. 'Aesthetic experience' is acknowledged to be the subjective part of some artistic exposure, namely, the inner affective state of a person exposed to some artistic object. In this work we describe ongoing research activities for studying the aesthetic experience of people when exposed to movie artistic stimuli. To do so, this work is focused on the definition of emotional and aesthetic highlights in movies and studies the people responses to them using physiological and behavioural signals, in a social setting. In order to examine the suitability of multimodal signals for detecting highlights we initially evaluate a supervised highlight detection system. Further, in order to provide an insight on the reactions of people, in a social setting, during emotional and aesthetic highlights, we study two unsupervised systems. Those systems are able to (a) measure the distance among the captured signals of multiple people using the dynamic time warping algorithm and (b) create a reaction profile for a group of people that would be indicative of whether that group reacts or not at a given time. The results indicate that the proposed systems are suitable for detecting highlights in movies and capturing some form of social interactions across different movie genres. Moreover, similar social interactions during exposure to emotional and some types of aesthetic highlights, such as those corresponding to technical or lightening choices of the director, can be observed. The utilisation of electrodermal activity measurements yields in better performances than those achieved when using acceleration measurements, whereas fusion of the modalities does not appear to be beneficial for the majority of the cases.

Multiple users' emotion recognition: Improving performance by joint modeling of affective reactions

Abstract: This paper studies emotion recognition in the context of collaboration When people are interacting with each other they tend to reach a similar emotional state through mechanisms like empathy and emotion contagion We thus investigated if participants' emotions could be determined from the affective reactions and behaviors of their partner Two types of emotional expressions were studied: physiological reactions and speech Results show that emotions could be recognized with similar performance when employing affective features from the self or the partner In addition, performance was improved when combining self and partner information The results demonstrate that in social situations an emotion recognition model should include information about partners

Feedbacks de contrôle et de valeur dans un jeu vidéo de résolution collaborative de problèmes : effets sur les émotions et la qualité perçue de la collaboration

Abstract: Cet article porte sur l’effet des emotions sur la resolution collaborative de problemes dans un jeu video de plates-formes. Nous avons etudie la facon dont les antecedents emotionnels de controle et de valeur impactent les emotions d’accomplissement des collaborateurs. Nous avons egalement examine la relation entre ces emotions, les processus socio-cognitifs percus et la performance de groupe. Les participants jouaient en dyades au jeu Portal 2 ® et recevaient des feedbacks biaises de controle (niveau de maitrise) et de valeur (remuneration). Les resultats montrent que ces feedbacks ont influence certaines emotions d’accomplissement ressenties. Ces emotions sont de plus correlees a des processus socio-cognitifs importants pour la resolution de problemes collaboratifs, ainsi qu’a la performance du groupe. Ces resultats mettent au jour des pistes d’integration des aspects emotionnels dans la conception d’environnements informatiques dedies a la regulation de l’apprentissage collaboratif.

An Emotion Awareness Tool for the Sharing of Emotions: What Impact on Computer-Supported Collaborative Processes?

Abstract: There is a large consensus on a significant role of emotions in individual and collaborative settings. In this context, emotion awareness tools (EAT) have been developed to promote the sharing of emotions during computer-mediated collaboration. In this study, we explore whether and how an EAT impacts collaborative processes, and whether there is a gender effect. Results showed that the EAT was beneficial to mutual modeling processes but we found also that men exchanged more verbal acts aiming at improving the relational climate but expressed less divergent opinions with the EAT, which is not the case in women.