Novel virtual reality based training system for fine motor skills: Towards developing a robotic surgery training system.
25 Sep 2020-International Journal of Medical Robotics and Computer Assisted Surgery (John Wiley & Sons, Ltd)-Vol. 16, Iss: 6, pp 1-14
TL;DR: A novel method of training fine‐motor skills such as Microscopic Selection Task (MST) for robot‐assisted surgery using virtual reality (VR) with objective quantification of performance is proposed.
Abstract: BACKGROUND Training surgeons to use surgical robots are becoming part of surgical training curricula. We propose a novel method of training fine-motor skills such as Microscopic Selection Task (MST) for robot-assisted surgery using virtual reality (VR) with objective quantification of performance. We also introduce vibrotactile feedback (VTFB) to study its impact on training performance. METHODS We use a VR-based environment to perform MST with varying degrees of difficulties. Using a well-known human-computer interaction paradigm and incorporating VTFB, we quantify the performance: speed, precision and accuracy. RESULTS MST with VTFB showed statistically significant improvement in performance metrics leading to faster completion of MST with higher precision and accuracy compared to that without VTFB. DISCUSSION The addition of VTFB to VR-based training for robot-assisted surgeries may improve performance outcomes in real robotic surgery. VTFB, along with proposed performance metrics, can be used in training curricula for robot-assisted surgeries.
Citations
More filters
TL;DR: A systematic review of research related to human-computer interaction techniques supporting training and learning in various domains including medicine, healthcare, and engineering is provided in this paper , where the focus is on HCI techniques involving Extended Reality (XR) technology which encompasses virtual reality, augmented reality, and mixed reality.
Abstract: This article provides a systematic review of research related to Human–Computer Interaction techniques supporting training and learning in various domains including medicine, healthcare, and engineering. The focus is on HCI techniques involving Extended Reality (XR) technology which encompasses Virtual Reality, Augmented Reality, and Mixed Reality. HCI-based research is assuming more importance with the rapid adoption of XR tools and techniques in various training and learning contexts including education. There are many challenges in the adoption of HCI approaches, which results in a need to have a comprehensive and systematic review of such HCI methods in various domains. This article addresses this need by providing a systematic literature review of a cross-section of HCI approaches involving proposed so far. The PRISMA-guided search strategy identified 1156 articles for abstract review. Irrelevant abstracts were discarded. The whole body of each article was reviewed for the remaining articles, and those that were not linked to the scope of our specific issue were also eliminated. Following the application of inclusion/exclusion criteria, 69 publications were chosen for review. This article has been divided into the following sections: Introduction; Research methodology; Literature review; Threats of validity; Future research and Conclusion. Detailed classifications (pertaining to HCI criteria and concepts, such as affordance; training, and learning techniques) have also been included based on different parameters based on the analysis of research techniques adopted by various investigators. The article concludes with a discussion of the key challenges for this HCI area along with future research directions. A review of the research outcomes from these publications underscores the potential for greater success when such HCI-based approaches are adopted during such 3D-based training interactions. Such a higher degree of success may be due to the emphasis on the design of user-friendly (and user-centric) training environments, interactions, and processes that positively impact the cognitive abilities of users and their respective learning/training experiences. We discovered data validating XR-HCI as an ascending method that brings a new paradigm by enhancing skills and safety while reducing costs and learning time through replies to three exploratory study questions. We believe that the findings of this study will aid academics in developing new research avenues that will assist XR-HCI applications to mature and become more widely adopted.
2 citations
TL;DR: In this article , the authors present an individual perspective of what work may come and why that positive narrative is unlikely to represent the actuality of coming events, at least within the foreseeable future.
Abstract: Ergonomics is identified as that discipline which is most particularly focused upon the “laws of work’. Indeed, this is the etymological origins from which the name of the science is derived. In consequence, any future consideration of such an area of research endeavor must constantly re-examine and re-evaluate what is meant by the term ‘work’. The present article, that features an individual perspective, attacks this challenge through a prospective vision of what work may come. This vision of ‘futurework’ proves to be a rather bleak one. For, as is explained, the driving economic forces emphasize and embrace the greater utility of automated, and now growing autonomous systems, to accomplish the tasks which connote work. Often cast in opposition to the efficiency/profit imperative are those social forces for which human-centered endeavors, such as Ergonomics, advocate. Optimistic perspectives seek to harmonize these conflicting forces and envisage a form of harmonious cooperation between humans and machines of increasing ‘intelligence’ and capability. The current work explores and evaluates why that positive narrative is unlikely to represent the actuality of coming events, at least within the foreseeable future.
1 citations
DOI•
TL;DR: In this article, the authors present an individual perspective of what work may come and why that positive narrative is unlikely to represent the actuality of coming events, at least within the foreseeable future.
Abstract: Abstract Ergonomics is identified as that discipline which is most particularly focused upon the “laws of work’. Indeed, this is the etymological origins from which the name of the science is derived. In consequence, any future consideration of such an area of research endeavor must constantly re-examine and re-evaluate what is meant by the term ‘work’. The present article, that features an individual perspective, attacks this challenge through a prospective vision of what work may come. This vision of ‘futurework’ proves to be a rather bleak one. For, as is explained, the driving economic forces emphasize and embrace the greater utility of automated, and now growing autonomous systems, to accomplish the tasks which connote work. Often cast in opposition to the efficiency/profit imperative are those social forces for which human-centered endeavors, such as Ergonomics, advocate. Optimistic perspectives seek to harmonize these conflicting forces and envisage a form of harmonious cooperation between humans and machines of increasing ‘intelligence’ and capability. The current work explores and evaluates why that positive narrative is unlikely to represent the actuality of coming events, at least within the foreseeable future.
1 citations
TL;DR: In this paper , the authors demonstrate the possibilities of extended reality (XR) for communication and sharing of 3D geoinformation in the field of geosciences and highlight the educational possibilities of MR technology.
Abstract: In the last two decades, both the amount and quality of geoinformation in the geosciences field have improved substantially due to the increasingly more widespread use of techniques such as Laser Scanning (LiDAR), digital photogrammetry, unmanned aerial vehicles, geophysical reconnaissance (seismic, electrical, geomagnetic), and ground-penetrating radar (GPR), among others. Furthermore, the advances in computing, storage and visualization resources allow the acquisition of 3D terrain models (surface and underground) with unprecedented ease and versatility. However, despite these scientific and technical developments, it is still a common practice to simplify the 3D data in 2D static images, losing part of its communicative potential. The objective of this paper is to demonstrate the possibilities of extended reality (XR) for communication and sharing of 3D geoinformation in the field of geosciences. A brief review of the different variants within XR is followed by the presentation of the design and functionalities of headset-type mixed-reality (MR) devices, which allow the 3D models to be investigated collaboratively by several users in the office environment. The specific focus is on the functionalities of Microsoft’s HoloLens 2 untethered holographic head mounted display (HMD), and the ADA Platform App by Clirio, which is used to manage model viewing with the HMD. We demonstrate the capabilities of MR for the visualization and dissemination of complex 3D information in geosciences in data rich and self-directed immersive environment, through selected 3D models (most of them of the Montserrat massif). Finally, we highlight the educational possibilities of MR technology. Today MR has an incipient and reduced use; we hope that it will gain popularity as the barriers of entry become lower.
1 citations
TL;DR: In this paper , the authors presented a study in which VR is used to create a simulator designed for robotically assisted single-uniport surgery using voice commands for laparoscopic camera positioning and via a user interface developed using the Visual Studio program that connects a wristband equipped with sensors attached to the user's hand for the manipulation of active instruments.
Abstract: In recent years, there has been an expansion in the development of simulators that use virtual reality (VR) as a learning tool. In surgery where robots are used, VR serves as a revolutionary technology to help medical doctors train in using these robotic systems and accumulate knowledge without risk. This article presents a study in which VR is used to create a simulator designed for robotically assisted single-uniport surgery. The control of the surgical robotic system is achieved using voice commands for laparoscopic camera positioning and via a user interface developed using the Visual Studio program that connects a wristband equipped with sensors attached to the user’s hand for the manipulation of the active instruments. The software consists of the user interface and the VR application via the TCP/IP communication protocol. To study the evolution of the performance of this virtual system, 15 people were involved in the experimental evaluation of the VR simulator built for the robotic surgical system, having to complete a medically relevant task. The experimental data validated the initial solution, which will be further developed.
References
More filters
TL;DR: The motor system in the present case is defined as including the visual and proprioceptive feedback loops that permit S to monitor his own activity, and the information capacity of the motor system is specified by its ability to produce consistently one class of movement from among several alternative movement classes.
Abstract: Information theory has recently been employed to specify more precisely than has hitherto been possible man's capacity in certain sensory, perceptual, and perceptual-motor functions (5, 10, 13, 15, 17, 18). The experiments reported in the present paper extend the theory to the human motor system. The applicability of only the basic concepts, amount of information, noise, channel capacity, and rate of information transmission, will be examined at this time. General familiarity with these concepts as formulated by recent writers (4, 11,20, 22) is assumed. Strictly speaking, we cannot study man's motor system at the behavioral level in isolation from its associated sensory mechanisms. We can only analyze the behavior of the entire receptor-neural-effector system. However, by asking 51 to make rapid and uniform responses that have been highly overlearned, and by holding all relevant stimulus conditions constant with the exception of those resulting from 5"s own movements, we can create an experimental situation in which it is reasonable to assume that performance is limited primarily by the capacity of the motor system. The motor system in the present case is defined as including the visual and proprioceptive feedback loops that permit S to monitor his own activity. The information capacity of the motor system is specified by its ability to produce consistently one class of movement from among several alternative movement classes. The greater the number of alternative classes, the greater is the information capacity of a particular type of response. Since measurable aspects of motor responses, such as their force, direction, and amplitude, are continuous variables, their information capacity is limited only by the amount of statistical variability, or noise, that is characteristic of repeated efforts to produce the same response. The information capacity of the motor Editor's Note. This article is a reprint of an original work published in 1954 in the Journal of Experimental Psychology, 47, 381391.
7,599 citations
Posted Content•
TL;DR: E elegant connections between the concepts of Informedness, Markedness, Correlation and Significance as well as their intuitive relationships with Recall and Precision are demonstrated.
Abstract: Commonly used evaluation measures including Recall, Precision, F-Measure and Rand Accuracy are biased and should not be used without clear understanding of the biases, and corresponding identification of chance or base case levels of the statistic. Using these measures a system that performs worse in the objective sense of Informedness, can appear to perform better under any of these commonly used measures. We discuss several concepts and measures that reflect the probability that prediction is informed versus chance. Informedness and introduce Markedness as a dual measure for the probability that prediction is marked versus chance. Finally we demonstrate elegant connections between the concepts of Informedness, Markedness, Correlation and Significance as well as their intuitive relationships with Recall and Precision, and outline the extension from the dichotomous case to the general multi-class case.
5,092 citations
Book•
01 Jan 2016
TL;DR: The principles of surgery are applied to the treatment of central giant cell prolapse prolapse in women.
Abstract: Schwartz's principles of surgery , Schwartz's principles of surgery , کتابخانه مرکزی دانشگاه علوم پزشکی ایران
1,127 citations
"Novel virtual reality based trainin..." refers background in this paper
...Intraoperative bleeding during surgeries is a critical complication that is dealt with by accurately and precisely identifying the source of the bleed and gently stopping the bleed.(28) Studies by Ebrahimi(29) and Kontarinis(30) reported that vibrotactile feedback (VTFB) enhances the performance of manipulation tasks in virtual environments by reducing reaction times....
[...]
01 Dec 2004-International Journal of Human-computer Studies \/ International Journal of Man-machine Studies
TL;DR: This paper makes seven recommendations to HCI researchers wishing to construct Fitts' law models for either movement time prediction, or for the comparison of conditions in an experiment that support the methods described in the recent ISO 9241-9 standard on the evaluation of pointing devices.
Abstract: This paper makes seven recommendations to HCI researchers wishing to construct Fitts' law models for either movement time prediction, or for the comparison of conditions in an experiment. These seven recommendations support (and in some cases supplement) the methods described in the recent ISO 9241-9 standard on the evaluation of pointing devices. In addition to improving the robustness of Fitts' law models, these recommendations (if widely employed) will improve the comparability and consistency of forthcoming publications. Arguments to support these recommendations are presented, as are concise reviews of 24 published Fitts' law models of the mouse, and 9 studies that used the new ISO standard.
893 citations
"Novel virtual reality based trainin..." refers methods in this paper
...Hence, we define the index of difficulty according to Equation (2) below given by Soukoreff and MacKenzie.41 ID¼ log2 � D W þ 1 � ð2Þ A measure of performance of a user in carrying out the selection of targets is termed as Throughput.40 It refers to the number of targets selected per unit time....
[...]
...Hence, we define the index of difficulty according to Equation (2) below given by Soukoreff and MacKenzie.(41)...
[...]
PARC1
TL;DR: In this article, the Fitts's Law slope constant was used to evaluate the performance of the mouse and the joystick for selecting text on a CRT display and the mouse was found to be fastest on all counts and also to have the lowest error rates.
Abstract: Four devices are evaluated with respect to how rapidly they can be used to select text on a CRT display. The mouse is found to be fastest on all counts and also to have the lowest error rates. It is shown that variations in positioning time with the mouse and joystick are accounted for by Fitts' Law. In the case of the mouse, the measured Fitts's Law slope constant is close to that found in other eye-hand tasks leading to the conclusion that positioning time with this device is almost the minimal achievable. Positioning time for key devices is shown to be proportional to the number of keystrokes which must be typed.
782 citations