A smart mobility solution for physically challenged
01 Nov 2009-pp 168-173
TL;DR: A hand gesture and a vision driven wheelchair system for physically handicapped people that provides for a natural and an intuitive user interface which can comprehend and react to in compliance with the users' instinctive volition which eases the mobility of the physically challenged people.
Abstract: This paper presents a hand gesture and a vision driven wheelchair system for physically handicapped people. The system is contrived to have a utilitarian design that caters to most of the disabilities rather than just one. In order to minimize system-human interaction, we have endeavored to present two distinct but closely related concepts viz. the hand gesture and vision based control system in conjunction for the wheelchair control. The wheelchair system is designed such that it provides for a natural and an intuitive user interface which can comprehend and react to in compliance with the users' instinctive volition which eases the mobility of the physically challenged people. All image processing was performed using NI Vision Assistant. NI LabVIEW was used to train and implement Neural Networks for Hand Gesture Classification and also to enable motion control. A prototype was developed on which all our experiments were successfully carried out. The system has been tested for users with varied hand shapes and proved to be extremely reliable.
Citations
More filters
TL;DR: With the average success rate of gesture recognition above 99.25% and response time as comparable with that of commercially available joystick controlled wheelchair, HanGes could be a possible alternative to the existing ones.
Abstract: This paper presents a novel and simple hand gesture recognition method to be used in rehabilitation of people who have mobility issues particularly stroke patients and patients with spinal cord injury (SCI). Keeping in mind the reach of such a system for a wider community of people with mobility issues, the proposed low-cost control device called gpaD—gesture pad provides an alternative solution to the joystick-based powered wheelchair control through hand gestures. In this method, IR sensors are used for identifying the simple gestures to control the powered wheelchair to move in any direction. In the proposed prototype system HanGes, a gesture pad that includes IR sensors, MCU and power management circuit is designed for gesture recognition and identification and a controller for driving motors is implemented. HanGes’s design, implementation, the response time calculations of the system, testing, performance evaluation with stroke and SCI patients are discussed in detail. With the average success rate of gesture recognition above 99.25% and response time as comparable with that of commercially available joystick controlled wheelchair, HanGes could be a possible alternative to the existing ones. With extensive experiments that demonstrate the accuracy of the system, the user experience, testing with patients, and the implementation cost indicate the superiority of our system.
18 citations
21 Oct 2012
TL;DR: This work uses a small camera mounted very close to the user's hand, which tracks the small movements of their fingers to understand the direction of movement of the wheelchair, and develops a gesture recognition system which identifies the gesture and is interfaced to the wheelchair control system in order to move the wheelchair to the desired location.
Abstract: Various research studies conducted all around the world reveal that 75% of people with debilitating physical disabilities and elderly people experience significant difficulties for their day to day locomotion. Although there are existing solutions to overcome this problem, none of them served to be customizable, economical and user friendly all at the same time. Therefore, one of the best options that could be useful for these affected class of people is a gesture-based interaction with their environment, in particular their wheelchairs. The proposed system named as 'Gest-BOT', uses a small camera mounted very close to the user's hand, which tracks the small movements of their fingers to understand the direction of movement of the wheelchair. A gesture recognition system which identifies the gesture is then interfaced to the wheelchair control system in order move it to the desired location. Gest-BOT is effortless to use, customizable, economical, highly convenient and non-intrusive. The hardware implementation of Gest-BOT consists of a wheelchair, an Arduino board based ATmega microcontroller and an Intel Atom EBC-352 processor, which uses MATLAB® executables for gesture image processing. We have also calculated the response of the system under various conditions which is detailed in the paper.
10 citations
Cites background from "A smart mobility solution for physi..."
...[9] discusses about a gesture based and vision driven wheelchair for the physically challenged....
[...]
TL;DR: The use of natural biological signals and non-biological signal to do the hands-free control of powered wheelchair is presented and it is shown that normal people are capable of manipulating multiple tasks at the same time.
Abstract: A vital perception in designing human-machine interfaces for people with disabilities is hands-free control. It is important in setting up communication among a machine and the part of human body. Nowadays, hands-free control is extensively used to help disabled people to control the wheelchair. The hands-free control functions are not only helpful to elderly and disabled, but also useful for normal people who might require using their hands for other tasks at the same time. As a result, normal people are capable of manipulating multiple tasks at the same time. The wheelchair is manoeuvred using brainwaves, eyes and facial muscles movements, voice, tongue, gesture. The mobility using a powered wheelchair improves the quality of life of the aged people and the people with mobility impairments significantly. These powered wheelchairs can be actuated using various high-level control interfaces. In this review, the use of natural biological signals and non-biological signal to do the hands-free control of powered wheelchair is presented in this article.
10 citations
Cites background from "A smart mobility solution for physi..."
...[23] presented a hand gesture and a vision-driven wheelchair system for physically handicapped people....
[...]
...[23] Hand gesture and vision Sensors, Microphone, IEEE-1394Monochrome, CMOS cameras, Compact Vision System [NI CVS 1454] and Compact RIO [NI cRIO 9074], CVS-1454, NI cRIO Digital I/O Module- 9472, NI cRIO analogue input module 9201 Straight, Left, Right...
[...]
Proceedings Article•
21 Nov 2011TL;DR: A focus group that has dyslexia and other specific learning difficulties is used for designing the user-defined gesture sets and it is suggested that this result would help people with communication impairments conveniently interact with others in an intuitive and socially acceptable manner.
Abstract: Present smart phones contain high-tech sensors to monitor three-dimensional movements of the device and users' behaviours. These sensors allow mobile devices to recognize motion gestures. However, only a few gesture sets have been created, and little is known about best practices in motion-gesture design. Also, the created gesture sets were generated from people who do not have to use their motion gestures very much in their daily lives, not from people with communication difficulties. To address this issue, we use a focus group that has dyslexia and other specific learning difficulties for designing the user-defined gesture sets. This paper presents the results of our study that elicits the focus group's gestures to invoke commands on a smart-phone device. It demonstrates how the gesture sets have been designed and finalised throughout other research activities, such as observation and interviews. Finally, we suggest that our result would help people with communication impairments conveniently interact with others in an intuitive and socially acceptable manner.
2 citations
Cites background from "A smart mobility solution for physi..."
...Specifically, the largest group with communication disabilities in the UK is students in the 12 - 20 age range [9]....
[...]
...Recently, various types of gesturerecognition products, such as Microsoft’s Surface, a table with a touch-sensitive top responding to hand gestures and real-world objects, g-speak, special sensor gloves for detecting spatial hand gestures, and Ubiq’window, which enables gestural interaction with a screen behind glass through optical motion detection, have been released in the market place [3, 7, 9]....
[...]
References
More filters
TL;DR: Consider writing, perhaps the first information technology: The ability to capture a symbolic representation of spoken language for long-term storage freed information from the limits of individual memory.
Abstract: Specialized elements of hardware and software, connected by wires, radio waves and infrared, will soon be so ubiquitous that no-one will notice their presence.
9,073 citations
TL;DR: It is shown that recognition of geometrical patterns and alphabetical characters independently of position, size and orientation can be accomplished and it is indicated that generalization is possible to include invariance with parallel projection.
Abstract: In this paper a theory of two-dimensional moment invariants for planar geometric figures is presented. A fundamental theorem is established to relate such moment invariants to the well-known algebraic invariants. Complete systems of moment invariants under translation, similitude and orthogonal transformations are derived. Some moment invariants under general two-dimensional linear transformations are also included. Both theoretical formulation and practical models of visual pattern recognition based upon these moment invariants are discussed. A simple simulation program together with its performance are also presented. It is shown that recognition of geometrical patterns and alphabetical characters independently of position, size and orientation can be accomplished. It is also indicated that generalization is possible to include invariance with parallel projection.
7,963 citations
"A smart mobility solution for physi..." refers methods in this paper
...Calculation of Moment Invariants ([7]): For feature extraction we use image moments....
[...]
...5) Gesture Classification: Calculation of Moment Invariants [7]: For feature extraction we use image moments....
[...]
Book•
01 Dec 2003
TL;DR: 1. Fundamentals of Image Processing, 2. Intensity Transformations and Spatial Filtering, and 3. Frequency Domain Processing.
Abstract: 1. Introduction. 2. Fundamentals. 3. Intensity Transformations and Spatial Filtering. 4. Frequency Domain Processing. 5. Image Restoration. 6. Color Image Processing. 7. Wavelets. 8. Image Compression. 9. Morphological Image Processing. 10. Image Segmentation. 11. Representation and Description. 12. Object Recognition.
6,306 citations
"A smart mobility solution for physi..." refers background in this paper
...If more than one neuron fires at the same time or if none fires then the gesture is considered unrecognized ([9])....
[...]
Journal Article•
TL;DR: In this article, the authors propose that specialized elements of hardware and software, connected by wires, radio waves and infrared, will soon be so ubiquitous that no-one will notice their presence.
Abstract: Specialized elements of hardware and software, connected by wires, radio waves and infrared, will soon be so ubiquitous that no-one will notice their presence
5,041 citations
Journal Article•
2,465 citations
"A smart mobility solution for physi..." refers background in this paper
...This situation is more tragic in the case of the paralyzed and the quadriplegic ([1])....
[...]