Emotions have an important role in daily life, not only in human interaction, but also in decision-making processes, and in the perception of the world around us. Due to the recent interest shown by the research community in establishing emotional interactions between humans and computers, the identification of the emotional state of the former became a need. This can be achieved through multiple measures, such as subjective self-reports, autonomic and neurophysiological measurements. In the last years, Electroencephalography (EEG) received considerable attention from researchers, since it can provide a simple, cheap, portable, and ease-to-use solution for identifying emotions. In this paper, we present a survey of the neurophysiological research performed from 2009 to 2016, providing a comprehensive overview of the existing works in emotion recognition using EEG signals. We focus our analysis in the main aspects involved in the recognition process (e.g., subjects, features extracted, classifiers), and compare the works per them. From this analysis, we propose a set of good practice recommendations that researchers must follow to achieve reproducible, replicable, well-validated and high-quality results. We intend this survey to be useful for the research community working on emotion recognition through EEG signals, and in particular for those entering this field of research, since it offers a structured starting point.

Emotions Recognition Using EEG Signals: A Survey

EEG-based automatic emotion recognition can help brain-inspired robots in improving their interactions with humans. This paper presents a novel framework for emotion recognition using multi-channel electroencephalogram (EEG). The framework consists of a linear EEG mixing model and an emotion timing model. Our proposed framework considerably decomposes the EEG source signals from the collected EEG signals and improves classification accuracy by using the context correlations of the EEG feature sequences. Specially, Stack AutoEncoder (SAE) is used to build and solve the linear EEG mixing model and the emotion timing model is based on the Long Short-Term Memory Recurrent Neural Network (LSTM-RNN). The framework was implemented on the DEAP dataset for an emotion recognition experiment, where the mean accuracy of emotion recognition achieved 81.10% in valence and 74.38% in arousal, and the effectiveness of our framework was verified. Our framework exhibited a better performance in emotion recognition using multi-channel EEG than the compared conventional approaches in the experiments.

/pdf/sae-lstm-a-new-framework-for-emotion-recognition-from-multi-3592astui7.pdf

SAE+LSTM: A New Framework for Emotion Recognition From Multi-Channel EEG.

In order to improve the accuracy of emotional recognition by end-to-end automatic learning of emotional features in spatial and temporal dimensions of electroencephalogram (EEG), an EEG emotional feature learning and classification method using deep convolution neural network (CNN) was proposed based on temporal features, frequential features, and their combinations of EEG signals in DEAP dataset. The shallow machine learning models including bagging tree (BT), support vector machine (SVM), linear discriminant analysis (LDA), and Bayesian linear discriminant analysis (BLDA) models and deep CNN models were used to make emotional binary classification experiments on DEAP datasets in valence and arousal dimensions. The experimental results showed that the deep CNN models which require no feature engineering achieved the best recognition performance on temporal and frequency combined features in both valence and arousal dimensions, which is 3.58% higher than the performance of the best traditional BT classifier in valence dimension and 3.29% higher than that of BT classifier in arousal dimension.

/pdf/accurate-eeg-based-emotion-recognition-on-combined-features-wsow7br91e.pdf

Accurate EEG-Based Emotion Recognition on Combined Features Using Deep Convolutional Neural Networks

A novel multi-modal machine learning based approach for automatic classification of EEG recordings in dementia.

Background Many studies have been done on the emotion recognition based on multi-channel electroencephalogram (EEG) signals. Objective This paper explores the influence of the emotion recognition accuracy of EEG signals in different frequency bands and different number of channels. Methods We classified the emotional states in the valence and arousal dimensions using different combinations of EEG channels. Firstly, DEAP default preprocessed data were normalized. Next, EEG signals were divided into four frequency bands using discrete wavelet transform, and entropy and energy were calculated as features of K-nearest neighbor Classifier. Results The classification accuracies of the 10, 14, 18 and 32 EEG channels based on the Gamma frequency band were 89.54%, 92.28%, 93.72% and 95.70% in the valence dimension and 89.81%, 92.24%, 93.69% and 95.69% in the arousal dimension. As the number of channels increases, the classification accuracy of emotional states also increases, the classification accuracy of the gamma frequency band is greater than that of the beta frequency band followed by the alpha and theta frequency bands. Conclusions This paper provided better frequency bands and channels reference for emotion recognition based on EEG.

/pdf/emotion-recognition-from-multichannel-eeg-signals-using-k-4778cutwlz.pdf

Emotion recognition from multichannel EEG signals using K-nearest neighbor classification.

Emotion recognition from electroencephalogram (EEG) signals is one of the most challenging tasks. Bispectral analysis offers a way of gaining phase information by detecting phase relationships between frequency components and characterizing the non- Gaussian information contained in the EEG signals. In this paper, we explore derived features of bispectrum for quantification of emotions using a Valence-Arousal emotion model; and arrive at a feature vector through backward sequential search. Cross- validated accuracies of 64.84% for Low/High Arousal classification and 61.17% for Low/High Valence were obtained on the DEAP data set based on the proposed features; comparable to classification accuracies reported in the literature.

Nitin Kumar

Papers

Bispectral Analysis of EEG for Emotion Recognition