In this study, we explored the relationship between objective and subjective measures for usability evaluation in in-vehicle infotainment systems (IVISs). As a case study, four displays were evaluated based on cluster location and display orientation (that is, front–horizontal, front–vertical, right–horizontal, and right–vertical). Thirty-six participants performed tasks to manipulate the functions of the IVISs and data were collected through an electroencephalogram (EEG) sensor and questionnaire items. We analysed a model that estimated EEG-based objective indicators from subjective indicators. As a result, the objective indicators reflected the subjective indicators and were considered to explain the driver’s cognitive state. Although EEG data were collected from only four participants, this study proposed an experimental design that could be applied to the analysis of the relationship between the subject’s evaluation and EEG signals, as a preliminary study. We expect the experimental design and results of this study to be useful in analysing objective and subjective measures of usability evaluation.

Analysis of Relationship between Electroencephalograms and Subjective Measurements for In-Vehicle Information System: A Preliminary Study.

Nowadays, there is a growing interest in User Experience (UX) evaluation in Human-Computer Interaction (HCI) field to evaluate information systems. Meanwhile, the application of neuroscientific measurement tools in user experience studies is constantly increasing. Within the scope of this study, a systematic mapping is conducted on the use of electroencephalography (EEG), one of the neuroscientific measurement tools, in UX evaluation studies published between 2010-2020. 89 studies are gathered from Web of Science (WoS) database, Science Direct (Elsevier), IEEE Xplore Library, ACM Digital Library, according to the scope of the study, are examined. The aim of this study is to reveal the trends and the use of EEG with the other UX evaluation methods in UX evaluation research. According to the results of the study, the types of data collected by EEG for UX evaluation are emotion and attention, data is generally collected as single episodic experience. In addition, the support vector machine is used for the classification and event-related potential is used for the feature extraction of the EEG data. 

/pdf/review-of-the-use-of-electroencephalography-in-user-1ukkzxg6.pdf

Review of the Use of Electroencephalography in User Experience Evaluation Research

Changes in the contemporary business environment are shifting the focus of designers and developers of Information Systems (IS) from a narrow focus on system usability to an overall user experience (UX). The subjective nature of UX meant that the majority of UX evaluation methods are subjective. However, advancements in new technologies now make it possible to evaluate UX objectively by collecting physiological data unobtrusively. In this study we explored the use of the Emotiv EPOC+ headset to collect electro-encephalography (EEG) patterns to 'examine' brain activities to determine the presence or absence of the emotion of anger, as well as 'performance metrics' on engagement, excitement, interest, focus, relaxation, and stress, in order to evaluate UX. The results showed that the Emotiv EPOC+ headset provides a low-cost means of evaluating UX objectively.

Manon Holman

Papers

Taking the Subjectivity out of UX Evaluation with Emotiv EPOC