The Effect of Audio and Visual Modality Based CPR Skill Training with Haptics Feedback in VR
23 Mar 2019-pp 910-911
TL;DR: The results show that the group who trained with the three sensory modalities have better performance than that of the other two groups, and rescue breathing is incorporated in the CPR training simulator for better skill training.
Abstract: The hypothesis of this study is to verify the sensory dominance with the combinations of three sensory modalities (Audio-Haptics (AH), Visual-Haptics (VH), Audio-Visual-Haptics (AVH)) using Virtual Reality (VR) based Cardiopulmonary Resuscitation (CPR) simulator. To test this hypothesis three experiments with three different groups of participants were conducted with the above three modes of combinations. Finally, three groups were tested for their CPR performance on an unknown linear chest stiffness of mannequin-based CPR simulator and their performance score was compared. The % mean and standard deviation of the performance score (p-value: 0.00006) in the testing phase for group A-AH, B-VH, and C-AVH is $77.95\%\pm 8.27\%, 89.47\%\pm 6.19\%, \ \text{and} \ 91.73\%\pm 3.14\%$ respectively. The results show that the group who trained with the three sensory modalities have better performance than that of the other two groups. Our future work is to incorporate rescue breathing in the CPR training simulator for better skill training.
Citations
More filters
TL;DR: In this article, the authors propose a virtual reality (VR) training approach for industrial workers to acquire skills and address complex tasks by immersing them in a safe and controlled virtual environment.
Abstract: Virtual reality (VR) training offers the capability to industrial workers to acquire skills and address complex tasks by immersing them in a safe and controlled virtual environment. Immersive VR (I...
28 citations
TL;DR: VirtualCPR as mentioned in this paper is a mobile virtual reality application to support learning and practicing of basic techniques of cardiopulmonary resuscitation (CPR) for experts or non-experts in CPR.
Abstract: Deaths due to heart diseases are a leading cause of death in Mexico Cardiovascular diseases are considered a public health problem because they produce cardiorespiratory arrests During an arrest, cardiac and/or respiratory activity stops A cardiorespiratory arrest is rapidly fatal without a quick and efficient intervention As a response to this problem, the VirtualCPR system was designed in the present work VirtualCPR is a mobile virtual reality application to support learning and practicing of basic techniques of cardiopulmonary resuscitation (CPR) for experts or non-experts in CPR VirtualCPR implements an interactive virtual scenario with the user, which is visible by means of employment of virtual reality lenses User's interactions, with our proposal, are by a portable force sensor for integration with training mannequins, whose development is based on an application for the Android platform Furthermore, this proposal integrates medical knowledge in first aid, related to the basic CPR for adults using only the hands, as well as technological knowledge, related to development of simulations on a mobile virtual reality platform by three main processes: (i) force measurement and conversion, (ii) data transmission and (iii) simulation of a virtual scenario An experiment by means of a multifactorial analysis of variance was designed considering four factors for a CPR session: (i) previous training in CPR, (ii) frequency of compressions, (iii) presence of auditory suggestions and (iv) presence of color indicator Our findings point out that the more previous training in CPR a user of the VirtualCPR system has, the greater the percentage of correct compressions obtained from a virtual CPR session Setting the rate to 100 or 150 compressions per minute, turning on or off the auditory suggestions and turning the color indicator on or off during the session have no significant effect on the results obtained by the user
3 citations
TL;DR: This work proposes a timestamp-independent synchronization for haptic–visual signal transmission, and develops a key sample extraction of haptic signalsbased on the force feedback characteristics and a key frame extraction of visual signals based on deep-object detection.
Abstract: The booming haptic data significantly improve the users’ immersion during multimedia interaction. As a result, the study of a Haptic-based Interaction System has attracted the attention of the multimedia community. To construct such a system, a challenging task is the synchronization of multiple sensorial signals that is critical to the user experience. Despite audio-visual synchronization efforts, there is still a lack of a haptic-aware multimedia synchronization model. In this work, we propose a timestamp-independent synchronization for haptic–visual signal transmission. First, we exploit the sequential correlations during delivery and playback of a haptic–visual communication system. Second, we develop a key sample extraction of haptic signals based on the force feedback characteristics and a key frame extraction of visual signals based on deep-object detection. Third, we combine the key samples and frames to synchronize the corresponding haptic–visual signals. Without timestamps in the signal flow, the proposed method is still effective and more robust in complicated network conditions. Subjective evaluation also shows a significant improvement of user experience with the proposed method.
1 citations
TL;DR: This work proposes a timestamp-independent synchronization for haptic-visual signal transmission, and develops a key sample extraction of haptic signals based on the force feedback characteristics, and a key frame extraction of visual signalsbased on deep object detection.
Abstract: The booming haptic data significantly improves the users’ immersion during multimedia interaction. As a result, the study of Haptic, Audio-Visual Environment (HAVE) has attracted attentions of multimedia community. To realize such a system, a challenging task is the synchronization of multiple sensorial signals that is critical to user experience. Despite of audio-visual synchronization efforts, there is still a lack of haptic-aware multimedia synchronization model. In this work, we propose a timestamp-independent synchronization for haptic-visual signal transmission. First, we exploit the sequential correlations during delivery and playback of a haptic-visual communication system. Second, we develop a key sample extraction of haptic signals based on the force feedback characteristics, and a key frame extraction of visual signals based on deep object detection. Third, we combine the key samples and frames to synchronize the corresponding haptic-visual signals. Without timestamps in signal flow, the proposed method is still effective and more robust to complicated network conditions. Subjective evaluation also shows a significant improvement of user experience with the proposed method.
Abstract: Cardiopulmonary resuscitation (CPR) is an emergency procedure performed on a person experiencing cardiac arrest to manually preserve brain function until spontaneous breathing and blood circulation can be restored. If performed timely and properly, it can improve the survival rate of a person experiencing cardiac arrest. The promotion of CPR has always been an important task for countries around the world. Countries around the world often hold relevant study camps and seminars to improve the public’s awareness of CPR. On the basis of this rationale, this paper proposes an interactive teaching aid kit for CPR that uses a CPR manikin and tutoring software to facilitate CPR learning among trainees. The CPR manikin is equipped with sensors that determine whether the CPR steps are performed correctly. Data from the sensors are sent to the tutoring software through wireless transmission. The software provides video demonstrations and textual instructions concerning the standard CPR procedure. In this software, the interactive interface displays real-time information about the trainee’s CPR process, such as information on the CPR step being performed and the number of chest compression and breaths given. Thus, this teaching aid kit allows trainees to learn CPR without an instructor. This system may enable CPR to become a readily learnable skill for the general population.
References
More filters
TL;DR: Several virtual reality applications in which pseudo-haptic feedback has been successfully implemented are described, such as a virtual environment for vocational training of milling machine operations, or a medical simulator for training in regional anesthesia procedures.
Abstract: This paper presents a survey of the main results obtained in the field of “pseudo-haptic feedback”: a technique meant to simulate haptic sensations in virtual environments using visual feedback and properties of human visuo-haptic perception. Pseudo-haptic feedback uses vision to distort haptic perception and verges on haptic illusions. Pseudo-haptic feedback has been used to simulate various haptic properties such as the stiffness of a virtual spring, the texture of an image, or the mass of a virtual object. This paper describes the several experiments in which these haptic properties were simulated. It assesses the definition and the properties of pseudo-haptic feedback. It also describes several virtual reality applications in which pseudo-haptic feedback has been successfully implemented, such as a virtual environment for vocational training of milling machine operations, or a medical simulator for training in regional anesthesia procedures.
278 citations
"The Effect of Audio and Visual Moda..." refers background in this paper
...There are various studies including the combination of different modalities in the literature such as Audio-Haptics Modality [4], Visual-Haptics Modality [6] and Audio-Visual-Haptics Modality [2]....
[...]
TL;DR: The techniques, formalisms, and key results pertinent to this medium of haptic-audiovisual (HAV) content are presented and the pressing necessity for evaluation techniques in this context is highlighted.
Abstract: Haptic technology has been widely employed in applications ranging from teleoperation and medical simulation to art and design, including entertainment, flight simulation, and virtual reality. Today there is a growing interest among researchers in integrating haptic feedback into audiovisual systems. A new medium emerges from this effort: haptic-audiovisual (HAV) content. This paper presents the techniques, formalisms, and key results pertinent to this medium. We first review the three main stages of the HAV workflow: the production, distribution, and rendering of haptic effects. We then highlight the pressing necessity for evaluation techniques in this context and discuss the key challenges in the field. By building on existing technologies and tackling the specific challenges of the enhancement of audiovisual experience with haptics, we believe the field presents exciting research perspectives whose financial and societal stakes are significant.
74 citations
"The Effect of Audio and Visual Moda..." refers background in this paper
...There are various studies including the combination of different modalities in the literature such as Audio-Haptics Modality [4], Visual-Haptics Modality [6] and Audio-Visual-Haptics Modality [2]....
[...]
TL;DR: Medical providers trained to use a novel musical memory aid effectively maintained AHA guideline CPR compression rates initially and in long-term follow-up and subjects felt that the aid improved their technical abilities and confidence in providing CPR.
Abstract: NOTICE: this is the author’s version of a work that was accepted for publication in Journal of Emergency Medicine . Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in Journal of Emergency Medicine ,2012 DOI: 10.1016/j.jemermed.2012.01.026
25 citations
"The Effect of Audio and Visual Moda..." refers background in this paper
...There are various studies including the combination of different modalities in the literature such as Audio-Haptics Modality [4], Visual-Haptics Modality [6] and Audio-Visual-Haptics Modality [2]....
[...]
01 Oct 2017
TL;DR: An immersive Virtual Reality based CPR simulator in which force feedback is provided using a dummy chest with a linear spring mounted on a force plate demonstrates that visual feedback could influence haptics perception of chest compliance and the VR-CPR system could simulate various linear and non-linear chest compliance controlling visual feedback alone.
Abstract: Haptic skills are essential for effective Cardiopulmonary Resuscitation (CPR). Existing CPR training simulators provide unrealistic chest conditions. It is assumed that the CPR performance on a real human chest is the same even when the trainees have learnt on unrealistic dummy chests. To test this assumption we have developed an immersive Virtual Reality based CPR simulator in which force feedback is provided using a dummy chest with a linear spring mounted on a force plate. The user applied force is mapped to visual chest compressions modeling various springs, either linear or non-linear. Two groups of subjects were trained either with linear or non-linear chests. Both the groups were tested for their CPR performance on an unknown non-linear chest and their performance score was compared. The % of mean and standard deviation of the score (p value: 0.001) for the group with the non-linear chest is 91.66% and 1.70% and that with linear chest is 86.39% and 3.44% respectively. This suggests that the group that were trained on non-linear chest performed better. The experiments clearly demonstrates that visual feedback could influence haptics perception of chest compliance and the VR-CPR system could simulate various linear and non-linear chest compliance controlling visual feedback alone.
8 citations
"The Effect of Audio and Visual Moda..." refers methods or result in this paper
...Six different linear chest compliance for both audio or/and visual feedback have been achieved by the force values [3], here the force values were increased to simulate changing the depth of compression in the audio or/and visual feedback for corresponding force values from the force plate as shown in Fig....
[...]
...The performance score was evaluated similar to our previous paper [3]....
[...]
01 Jan 2013
TL;DR: This work proposes a CPR mannequin which exhibits a chest with increasing stiffness as the depth of compression is increased, which should improve CPR training efficacy and compares the measured values against acceptance criteria that can be tuned to different standards.
Abstract: Cardio Pulmonary Resuscitation (CPR), especially chest compression, should be performed promptly on victims of cardiac arrest for improved morbidity. CPR is performed in 2 steps, chest compression and chest ventilation. But, commercially available CPR mannequins do not accurately mimic the viscoelastic properties of the human chest, resulting in poor CPR performance. We propose a CPR mannequin which exhibits a chest with increasing stiffness as the depth of compression is increased; the increased bio-fidelity of this mannequin should improve CPR training efficacy. This mannequin also measures depth and rate of compression, the air volume during chest ventilation, and compares the measured values against acceptance criteria that can be tuned to different standards.
2 citations
"The Effect of Audio and Visual Moda..." refers methods in this paper
...Participants were trained for three days in the VR-based simulation with six different linear chest compliance and then tested for their CPR performance on an unknown linear chest stiffness of a mannequin based CPR simulator [5] as shown in Fig....
[...]