A new low-cost system for rehabilitation of the impaired upper limb for stroke survivors is presented. A computer game was developed specifically for this purpose and the user's impaired upper extremity is tracked using a downward-pointed Kinect, an inexpensive motion capture system commercially available from Microsoft. A Kalman filter was implemented to reduce data jittering. Patients are required to move their impaired arm, sliding it on top of a transparent support, in order to play the game. The game is personalized to the patient through specific settings that adapt to the patient's range of motion and motor control at the start of the game as well as performance during the game. The final score is proportional to the arm's movement speed. A feasibility study was carried out with one stroke survivor. The game was played for ten days and usability surveys were answered before and after the study. The patient was engaged with the game, found it easy to understand and reported willingness to use it in the home environment and enjoyment of the use in the clinic.

A feasibility study of an upper limb rehabilitation system using kinect and computer games

Purpose – The purpose of this research is to investigate a new approach with its supporting building information modelling (BIM) + augmented reality (AR) tool to enhance architectural visualisation in building life cycle. Traditional approaches to visualise architectural design concentrate on static pictures or three-dimensional (3D) scale models which cause problems, such as expensive design evolution, lack of stakeholders’ communication and limited reusability. The 3D animated fly-throughs still occur on a computer screen in two-dimensions and seem cold and mechanical, unless done with advanced production software. Design/methodology/approach – The method of this research included case study and interview. It was, first, stated, from the building process perspective, how the BIM + AR for Architectural Visualisation System (BAAVS) was realised by integrating two types of visualisation techniques: BIM and AR, and four stages of building life cycle. Then the paper demonstrated four case studies to validate...

Integrating BIM and augmented reality for interactive architectural visualisation

The use of Virtual and Augmented Reality systems for motor rehabilitation is increasing mainly due to the new interaction tools which enable interaction through body movements. To improve these systems it is important to provide movement guidance and correction according to the therapeutic description of it. The use of natural interaction can help due the understanding of user's intentions, e.g. analyzing their body movements allows the application to provide information and encouragement to them in real time, improving the interaction and the treatment process as a whole. Thus, the aim of this research is to provide guidance and correction to performed movements based on the therapeutic definition of them. This is applied on motor rehabilitation through the use of the Kinect sensor as interaction support tool for rehabilitation systems. The Kinect sensor gives three-dimensional information about the user body, recognizing skeleton and joint positions, however, it does not provide detection of body specific movements. This way, the correct description of therapeutic movement (upper limbs, for instance) was implemented in a prototype. A scoring mechanism was also developed in order to measure the patient performance, as well as to encourage him/her to improve it by displaying a positive feedback whenever he does a correct movement.

Guidance and Movement Correction Based on Therapeutics Movements for Motor Rehabilitation Support Systems

Development of a system based on 3D vision, interactive virtual environments, ergonometric signals and a humanoid for stroke rehabilitation

There has been an increase in the use of immersive 3D virtual environments and serious games, that is, video games that are used for educational purposes, and only recently serious games have been considered for healthcare training. For example, there are a number of commercial surgical simulators which offer great potential for the training of basic skills and techniques, if the tedium of repeated rehearsal can be overcome. It is generally recognized that more abstract problem-solving and knowledge level training needs to be incorporated into simulated scenarios. This chapter explores some examples of what has been developed in terms of teaching models and evaluative methodologies, then discusses the educational theories explaining why virtual simulations and serious games are an important teaching tool, and finally suggests how to assess their value within an educational context. The tasks being trained span several levels of abstraction, from kinematic and dynamic aspects to domain knowledge training. The evaluation of the trainee at each level of this hierarchy necessitates objective metrics. We will describe a unifying framework for evaluation of speed and accuracy of these multi-level tasks needed for validating their effectiveness before inclusion in medical training curricula. In addition, specific case studies will be presented and research results brought forward regarding the development of virtual simulations, including those for neurosurgical procedures, EMS training, and patient teaching modules.

https://www.springer.com/cda/content/document/cda_downloaddocument/9783642548154-c2.pdf?SGWID=0-0-45-1455820-p176665266

Healthcare Training Enhancement Through Virtual Reality and Serious Games

Stroke is the number one cause of severe physical disability in the UK. Recent studies have shown that technologies such as virtual reality and imaging can provide an engaging and motivating tool for physical rehabilitation. In this paper we summarize previous work in our group using virtual reality technology and webcam-based games. We then present early work we are conducting in experimenting with desktop augmented reality (AR) for rehabilitation. AR allows the user to use real objects to interact with computer-generated environments. Markers attached to the real objects enable the system (via a webcam) to track the position and orientation of each object as it is moved. The system can then augment the captured image of the real environment with computer-generated graphics to present a variety of game or task-driven scenarios to the user. We discuss the development of rehabilitation prototypes using available AR libraries and express our thoughts on the potential of AR technology.

J.H. Crosbie

Papers

Augmented Reality Games for Upper-Limb Stroke Rehabilitation