As computers become more pervasive in society, facilitating natural human---computer interaction (HCI) will have a positive impact on their use. Hence, there has been growing interest in the development of new approaches and technologies for bridging the human---computer barrier. The ultimate aim is to bring HCI to a regime where interactions with computers will be as natural as an interaction between humans, and to this end, incorporating gestures in HCI is an important research area. Gestures have long been considered as an interaction technique that can potentially deliver more natural, creative and intuitive methods for communicating with our computers. This paper provides an analysis of comparative surveys done in this area. The use of hand gestures as a natural interface serves as a motivating force for research in gesture taxonomies, its representations and recognition techniques, software platforms and frameworks which is discussed briefly in this paper. It focuses on the three main phases of hand gesture recognition i.e. detection, tracking and recognition. Different application which employs hand gestures for efficient interaction has been discussed under core and advanced application domains. This paper also provides an analysis of existing literature related to gesture recognition systems for human computer interaction by categorizing it under different key parameters. It further discusses the advances that are needed to further improvise the present hand gesture recognition systems for future perspective that can be widely used for efficient human computer interaction. The main goal of this survey is to provide researchers in the field of gesture based HCI with a summary of progress achieved to date and to help identify areas where further research is needed.

/pdf/vision-based-hand-gesture-recognition-for-human-computer-3dczparvi2.pdf

Vision based hand gesture recognition for human computer interaction: a survey

This paper provides a broad overview of medical robot systems used in surgery. After introducing basic concepts of computer-integrated surgery, surgical CAD/CAM, and surgical assistants, it discusses some of the major design issues particular to medical robots. It then illustrates these issues and the broader themes introduced earlier with examples of current surgical CAD/CAM and surgical assistant systems. Finally, it provides a brief synopsis of current research challenges and closes with a few thoughts on the research/industry/clinician teamwork that is essential for progress in the field.

/pdf/medical-robotics-in-computer-integrated-surgery-551rsaf1dd.pdf

Medical robotics in computer-integrated surgery

Body posture and finger pointing are a natural modality for human-machine interaction, but first the system must know what it's seeing.

Vision-based hand-gesture applications

https://web.ics.purdue.edu/~jpwachs/papers/321.pdf

A Gesture-based Tool for Sterile Browsing of Radiology Images

Conventional endoscopic surgery has some drawbacks that can be addressed by using robots. The robotic systems used for surgery are still in their infancy. A major deficiency is the lack of haptic feedback to the surgeon. In this paper, the benefits of haptic feedback in robot-assisted surgery are discussed. A novel robotic end-effector is then described that meets the requirements of endoscopic surgery and is sensorized for force/ torque feedback. The endoscopic end-effector is capable of non-invasively measuring its interaction with tissue in all the degrees of freedom available during endoscopic manipulation. It is also capable of remotely actuating a tip and measuring its interaction with the environment without using any sensors on the jaws. The sensorized end-effector can be used as the last arm of a surgical robot to incorporate haptic feedback and/or to evaluate skills and learning curves of residents and surgeons in endoscopic surgery.

Haptic interaction in robot-assisted endoscopic surgery: a sensorized end-effector.

Robotic laparoscope positioners are now expected as assisting devices for solo surgery among endoscopic surgeons. In such robotic systems, the human-machine (surgeon-robot) interface is of paramount importance because it is the means by which the surgeon communicates with and controls the robotic camera assistant. We have designed a novel human-machine interface, called "FAce MOUSe", for controlling the position of a laparoscope. The proposed human interface is an image-based system which tracks the surgeon's facial motions robustly in real time and does not require the use of any body-contact devices, such as head-mounted sensing devices. The surgeon can easily and precisely control the motion of the laparoscope by simply making the appropriate face gesture, without hand or foot switches or voice input. Based on the FAce MOUSe interface, we have developed a new robotic laparoscope positioning system for solo surgery. Our system allows nonintrusive, nonverbal, hands off and feet off laparoscope operations, which seem more convenient for the surgeon. To evaluate the performance of the proposed system and its applicability in clinical use, we set up an in vivo experiment, in which the surgeon used the system to perform a laparoscopic cholecystectomy on a pig.

FAce MOUSe: A novel human-machine interface for controlling the position of a laparoscope

We have developed an image-based human-machine interface that tracks the surgeon's face robustly in real-time(30Hz) and does not require to use any body-contacted sensing devices Based on this face tracker we have developed a new robotic laparoscope positioning system for solo surgery Our system completely frees the surgeon's hands and feet from the laparoscope guiding task To evaluate the performance of the proposed system and its applicability to clinical use, an in vivo experiment was carried out in which a surgeon used the system to perform a laparoscopic cholecystectomy on a pig

/pdf/real-time-visual-tracking-of-the-surgeon-s-face-for-1idt4w5dxi.pdf

Real-Time Visual Tracking of the Surgeon's Face for Laparoscopic Surgery

We have designed a novel human–machine interface (called FAce MOUSe) for controlling a laparoscope based on the surgeon's face image processing, and developed a robotic laparoscope positioning system with the FAce MOUSe interface. To evaluate the performance of the proposed system and its applicability to clinical use, an experiment was at first conducted under laboratory conditions, then an in vivo experiment was carried out in which a surgeon used the system to perform a laparoscopic cholecystectomy on a pig. A brief outline of the FAce MOUSe system and the experimental results are presented.

Ayae Hikita

Papers

FAce MOUSe: A novel human-machine interface for controlling the position of a laparoscope

Real-Time Visual Tracking of the Surgeon's Face for Laparoscopic Surgery

A laparoscope positioning system with the surgeon's face image-based human–machine interface