https://www.cs.cmu.edu/~illah/PAPERS/socialroboticssurvey.pdf

A survey of socially interactive robots

Human-Robot Interaction (HRI) has recently received considerable attention in the academic community, in labs, in technology companies, and through the media. Because of this attention, it is desirable to present a survey of HRI to serve as a tutorial to people outside the field and to promote discussion of a unified vision of HRI within the field. The goal of this review is to present a unified treatment of HRI-related problems, to identify key themes, and discuss challenge problems that are likely to shape the field in the near future. Although the review follows a survey structure, the goal of presenting a coherent "story" of HRI means that there are necessarily some well-written, intriguing, and influential papers that are not referenced. Instead of trying to survey every paper, we describe the HRI story from multiple perspectives with an eye toward identifying themes that cross applications. The survey attempts to include papers that represent a fair cross section of the universities, government efforts, industry labs, and countries that contribute to HRI, and a cross section of the disciplines that contribute to the field, such as human, factors, robotics, cognitive psychology, and design.

/pdf/human-robot-interaction-a-survey-4q8yi606a9.pdf

Human-Robot Interaction: A Survey

An intelligent automated assistant system engages with the user in an integrated, conversational manner using natural language dialog, and invokes external services when appropriate to obtain information or perform various actions. The system can be implemented using any of a number of different platforms, such as the web, email, smartphone, and the like, or any combination thereof. In one embodiment, the system is based on sets of interrelated domains and tasks, and employs additional functionally powered by external services with which the system can interact.

Intelligent Automated Assistant

As computers become more pervasive in society, facilitating natural human---computer interaction (HCI) will have a positive impact on their use. Hence, there has been growing interest in the development of new approaches and technologies for bridging the human---computer barrier. The ultimate aim is to bring HCI to a regime where interactions with computers will be as natural as an interaction between humans, and to this end, incorporating gestures in HCI is an important research area. Gestures have long been considered as an interaction technique that can potentially deliver more natural, creative and intuitive methods for communicating with our computers. This paper provides an analysis of comparative surveys done in this area. The use of hand gestures as a natural interface serves as a motivating force for research in gesture taxonomies, its representations and recognition techniques, software platforms and frameworks which is discussed briefly in this paper. It focuses on the three main phases of hand gesture recognition i.e. detection, tracking and recognition. Different application which employs hand gestures for efficient interaction has been discussed under core and advanced application domains. This paper also provides an analysis of existing literature related to gesture recognition systems for human computer interaction by categorizing it under different key parameters. It further discusses the advances that are needed to further improvise the present hand gesture recognition systems for future perspective that can be widely used for efficient human computer interaction. The main goal of this survey is to provide researchers in the field of gesture based HCI with a summary of progress achieved to date and to help identify areas where further research is needed.

/pdf/vision-based-hand-gesture-recognition-for-human-computer-3dczparvi2.pdf

Vision based hand gesture recognition for human computer interaction: a survey

The various methods and devices described herein relate to devices which, in at least certain embodiments, may include one or more sensors for providing data relating to user activity and at least one processor for causing the device to respond based on the user activity which was determined, at least in part, through the sensors. The response by the device may include a change of state of the device, and the response may be automatically performed after the user activity is determined.

Automated Response to and Sensing of User Activity in Portable Devices

Teleoperation can be improved if humans and robots work as partners, exchanging information and assisting one another to achieve common goals. In this paper, we discuss the importance of collaboration and dialogue in human-robot systems. We then present collaborative control, a system model in which human and robot collaborate, and describe its use in vehicle teleoperation.

/pdf/collaboration-dialogue-human-robot-interaction-2gww5r55vp.pdf

Collaboration, Dialogue, Human-Robot Interaction

Multi-robot remote driving has traditionally been a difficult problem. Whenever an operator is forced to divide his limited resources (attention, cognition, etc.) among multiple robots, control becomes complicated and performance deteriorates as a result. Thus, we need to find ways to make command generation and coordination efficient, so that human-robot interaction becomes transparent and tasks are easy to perform. In this paper, we discuss how human-robot collaboration and dialogue provide an effective framework for achieving this.

/pdf/multi-robot-remote-driving-with-collaborative-control-19ktkfszqn.pdf

Multi-robot remote driving with collaborative control

Computer systems keep growing in complexity, processing power and web connectivity. To leverage this rich environment and to better assist users, a new type of intelligent assistant software is required. Building intelligent assistants is a difficult task that requires expertise in many AI and engineering related fields. We believe that providing a unified tool and a set of associated methodologies to create end-to-end intelligent software will bring many benefits to this area of research. Our solution, the Active framework, introduces the original concept of Active Ontologies to model and implement intelligent applications in a single and coherent software environment. As an example, this paper illustrates how Active has been used to create an intelligent assistant to help mobile users retrieve online information using a multimodal dialog approach.

/pdf/active-a-unified-platform-for-building-intelligent-web-18isbekazt.pdf

Active: A Unified Platform for Building Intelligent Web Interaction Assistants

Computers have become affordable, small, omnipresent and are often connected to the Internet. However, despite the availability of such rich environment, user interfaces have not been adapted to fully leverage its potential. To help with complex tasks, a new type of software is needed to provide more user-centric systems that act as "intelligent assistants", able to interact naturally with human users and with the information environment. Building an intelligent assistant is a difficult task that requires expertise in many fields ranging from artificial intelligence to core software and hardware engineering. We believe that providing a unified tool and methodology to create intelligent software will bring many benefits to this area of research. Our solution, the Active framework, combines an innovative production rule engine with communities of services to model and implement intelligent assistants. In the medical field, our approach is used to build an operating room assistant. Using natural modalities such as speech recognition and hand gestures, it enables surgeons to interact with computer based equipments of the operating room as if they were active members of the team. In a broader context, Active aims to ease the development of intelligent software by making required technologies more accessible.

/pdf/active-a-tool-for-building-intelligent-user-interfaces-2dgfl3tvso.pdf

Active, a tool for building intelligent user interfaces

https://www.ri.cmu.edu/pub_files/pub3/fong_terrence_w_2003_5/fong_terrence_w_2003_5.pdf

Charles Baur

Papers

Collaboration, Dialogue, Human-Robot Interaction

Multi-robot remote driving with collaborative control

Active: A Unified Platform for Building Intelligent Web Interaction Assistants

Active, a tool for building intelligent user interfaces

Robot, asker of questions