https://www.mdpi.com/2218-6581/8/4/88/pdf

Questionnaires to Measure Acceptability of Social Robots: A Critical Review

We present a comprehensive framework and test methodology for the evaluation of human-machine interfaces (HMI) and human-robot interactions (HRI) in collaborative manufacturing applications. An overview of the challenges that face current- and next-generation collaborative robot systems is presented, specifically focused on the interactions between man and machine, and a series of objectively quantitative and subjectively qualitative metrics are given to guide the development and assessment of interfaces and interactions. A generalized set of guidelines for the design of HMI is also proposed to address these challenges and thereby enable effective and intuitive diagnostics and error corrections when process failures occur. These guidelines are aimed at aiding researchers in developing effective interface and interaction technologies, maximizing operator situation awareness in human-robot collaborative manufacturing teams, promoting effective process and system diagnostics reporting, and enabling faster responses to equipment or application errors.

https://dl.acm.org/doi/pdf/10.1145/3385009

Towards Effective Interface Designs for Collaborative HRI in Manufacturing: Metrics and Measures

Evaluating quality in human-robot interaction: A systematic search and classification of performance and human-centered factors, measures and metrics towards an industry 5.0

The purpose of this study is to investigate the factors that contribute to cognitive and affective trust of social robots. Also investigated were the changes within two different types of trust over time and variables that influence trust. Elements of trust extracted from literature were used to evaluate people’s trust of social robot in an experiment. As a result of a factor analysis, ten factors that construct trust were extracted. These factors were further analyzed in relations with both cognitive and affective trust. Factors such as Security, Teammate, and Performance were found to relate with cognitive trust, while factors such as Teammate, Performance, Autonomy, and Friendliness appeared to relate with affective trust. Furthermore, changes in cognitive and affective trust over the time phases of the interaction were investigated. Affective trust appeared to develop in the earlier phase, while cognitive trust appeared to develop over the whole period of the interaction. Conversation topics had influence on affective trust, while robot’s mistakes had influence on the cognitive trust. On the other hand, prior experiences with social robots did now show any significant relations with neither cognitive nor affective trust. Finally, Familiarity attitude appeared to relate with both cognitive and affective trust, while other sub-dimensions of robot attitudes such as Interest, Negative attitude, and Utility appeared to relate with affective trust.

Factors and Development of Cognitive and Affective Trust on Social Robots

This methodological article discusses the influence of individuals’ beliefs about their abilities to use and control robotic technologies on their evaluation of human-robot-interaction (HRI). We conducted three surveys to develop and validate a new measure of Self-Efficacy in HRI. Exploratory factor analysis revealed a two-factorial (factors perceived self-efficacy and loss of control) solution with good reliability (Study 1, n = 201). Confirmatory factor analysis did not confirm the two-factorial structure. Instead, it revealed a better model fit for a one-factorial solution for a German (Study 2, n = 450) and an English version (Study 3, n = 209) of the scale with good indices for convergent and divergent validity. The final questionnaire with 18 items was used in two experimental studies (Study 4, n = 120). We found that interacting with a robot increased self-efficacy and that individual changes in self-efficacy predict more positive evaluations within a student sample, but not a sample of seniors. Interviews with seniors from this study suggested shortening the scale, and revising the instructions and answering scheme. The revised scale was again subject to confirmatory factor analysis (Study 5, n = 198), confirming the one-factorial solution for the German and the English version of the scale. We discuss potential use cases for the scale in HRI research.

https://dl.acm.org/doi/pdf/10.1145/3139352

Development and Validation of the Self-Efficacy in Human-Robot-Interaction Scale (SE-HRI)

This study investigated dimensions that construct people’s attitudes toward domestic robots, and developed a comprehensive measurement by which to assess such dimensions. Potential elements of attitudes were extracted from participants’ free descriptions and interviews, as well as a literature review. A questionnaire-based investigation was conducted using these elements, and a 12-factor structure was extracted employing factor analysis. A measurement called the Multi-dimensional Robot Attitude Scale was proposed to assess attitudes towards robots based on 12 dimensions. The internal reliability and representativeness of the proposed scale were verified. The Multi-dimensional Robot Attitude Scale proposed in this study is designed to comprehensively assess attitudes towards domestic robots, allowing for a multifaceted understanding of people’s attitudes.

Takumi Ninomiya

Papers

Development of the Multi-dimensional Robot Attitude Scale: Constructs of People’s Attitudes Towards Domestic Robots