Probability Distributions.- Linear Models for Regression.- Linear Models for Classification.- Neural Networks.- Kernel Methods.- Sparse Kernel Machines.- Graphical Models.- Mixture Models and EM.- Approximate Inference.- Sampling Methods.- Continuous Latent Variables.- Sequential Data.- Combining Models.

Pattern Recognition and Machine Learning

Using electromyogram (EMG) signals to control upper-limb prostheses is an important clinical option, offering a person with amputation autonomy of control by contracting residual muscles. The dexterity with which one may control a prosthesis has progressed very little, especially when control- ling multiple degrees of freedom. Using pattern recognition to discriminate multiple degrees of freedom has shown great promise in the research literature, but it has yet to transition to a clinically viable option. This article describes the pertinent issues and best practices in EMG pattern recognition, identifies the major challenges in deploying robust control, and advocates research directions that may have an effect in the near future.

Electromyogram pattern recognition for control of powered upper-limb prostheses: state of the art and challenges for clinical use.

With the continual miniaturisation of sensors and processing nodes, Pedestrian Dead Reckoning (PDR) systems are becoming feasible options for indoor tracking. These use inertial and other sensors, often combined with domain-specific knowledge about walking, to track user movements. There is currently a wealth of relevant literature spread across different research communities. In this survey, a taxonomy of modern PDRs is developed and used to contextualise the contributions from different areas. Techniques for step detection, characterisation, inertial navigation and step-and-heading-based dead-reckoning are reviewed and compared. Techniques that incorporate building maps through particle filters are analysed, along with hybrid systems that use absolute position fixes to correct dead-reckoning output. In addition, consideration is given to the possibility of using smartphones as PDR sensing devices. The survey concludes that PDR techniques alone can offer good short- to medium- term tracking under certain circumstances, but that regular absolute position fixes from partner systems will be needed to ensure long-term operation and to cope with unexpected behaviours. It concludes by identifying a detailed list of challenges for PDR researchers.

A Survey of Indoor Inertial Positioning Systems for Pedestrians

https://digitalcommons.uri.edu/cgi/viewcontent.cgi?article=1069&context=ele_facpubs

Towards fog-driven IoT eHealth: Promises and challenges of IoT in medicine and healthcare

This paper presents a framework for hand gesture recognition based on the information fusion of a three-axis accelerometer (ACC) and multichannel electromyography (EMG) sensors. In our framework, the start and end points of meaningful gesture segments are detected automatically by the intensity of the EMG signals. A decision tree and multistream hidden Markov models are utilized as decision-level fusion to get the final results. For sign language recognition (SLR), experimental results on the classification of 72 Chinese Sign Language (CSL) words demonstrate the complementary functionality of the ACC and EMG sensors and the effectiveness of our framework. Additionally, the recognition of 40 CSL sentences is implemented to evaluate our framework for continuous SLR. For gesture-based control, a real-time interactive system is built as a virtual Rubik's cube game using 18 kinds of hand gestures as control commands. While ten subjects play the game, the performance is also examined in user-specific and user-independent classification. Our proposed framework facilitates intelligent and natural control in gesture-based interaction.

/pdf/a-framework-for-hand-gesture-recognition-based-on-20j82luzwp.pdf

A Framework for Hand Gesture Recognition Based on Accelerometer and EMG Sensors

This paper describes a novel hand gesture recognition system that utilizes both multi-channel surface electromyogram (EMG) sensors and 3D accelerometer (ACC) to realize user-friendly interaction between human and computers. Signal segments of meaningful gestures are determined from the continuous EMG signal inputs. Multi-stream Hidden Markov Models consisting of EMG and ACC streams are utilized as decision fusion method to recognize hand gestures. This paper also presents a virtual Rubik's Cube game that is controlled by the hand gestures and is used for evaluating the performance of our hand gesture recognition system. For a set of 18 kinds of gestures, each trained with 10 repetitions, the average recognition accuracy was about 91.7% in real application. The proposed method facilitates intelligent and natural control based on gesture interaction.

/pdf/hand-gesture-recognition-and-virtual-game-control-based-on-528bdfd9w0.pdf

Hand gesture recognition and virtual game control based on 3D accelerometer and EMG sensors

An algorithmic framework is proposed to process acceleration and surface electromyographic (SEMG) signals for gesture recognition. It includes a novel segmentation scheme, a score-based sensor fusion scheme, and two new features. A Bayes linear classifier and an improved dynamic time-warping algorithm are utilized in the framework. In addition, a prototype system, including a wearable gesture sensing device (embedded with a three-axis accelerometer and four SEMG sensors) and an application program with the proposed algorithmic framework for a mobile phone, is developed to realize gesture-based real-time interaction. With the device worn on the forearm, the user is able to manipulate a mobile phone using 19 predefined gestures or even personalized ones. Results suggest that the developed prototype responded to each gesture instruction within 300 ms on the mobile phone, with the average accuracy of 95.0% in user-dependent testing and 89.6% in user-independent testing. Such performance during the interaction testing, along with positive user experience questionnaire feedback, demonstrates the utility of the framework.

A Hand Gesture Recognition Framework and Wearable Gesture-Based Interaction Prototype for Mobile Devices

As an essential branch of context awareness, activity awareness, especially daily activity monitoring and fall detection, is important to healthcare for the elderly and patients with chronic diseases. In this paper, a framework for activity awareness using surface electromyography and accelerometer (ACC) signals is proposed. First, histogram negative entropy was employed to determine the start- and end-points of static and dynamic active segments. Then, the angle of each ACC axis was calculated to indicate body postures, which assisted with sorting dynamic activities into two categories: dynamic gait activities and dynamic transition ones, by judging whether the pre- and post-postures are both standing. Next, the dynamic gait activities were identified by the double-stream hidden Markov models. Besides, the dynamic transition activities were distinguished into normal transition activities and falls by resultant ACC amplitude. Finally, a continuous daily activity monitoring and fall detection scheme was performed with the recognition accuracy over 98%, demonstrating the excellent fall detection performance and the great feasibility of the proposed method in daily activities awareness.

A Framework for Daily Activity Monitoring and Fall Detection Based on Surface Electromyography and Accelerometer Signals

For realizing multi-DOF interfaces in wearable computer system, accelerometers and surface EMG sensors are used synchronously to detect hand movement information for multiple hand gesture recognition. Experiments were designed to collect gesture data with both sensing techniques to compare their performance in the recognition of various wrist and finger gestures. Recognition tests were run using different subsets of information: accelerometer and sEMG data separately and combined sensor data. Experimental results show that the combination of sEMG sensors and accelerometers achieved 5-10% improvement in the recognition accuracies for hand gestures when compared to that obtained using sEMG sensors solely.

Xiang Chen

Papers

A Framework for Hand Gesture Recognition Based on Accelerometer and EMG Sensors

Hand gesture recognition and virtual game control based on 3D accelerometer and EMG sensors

A Hand Gesture Recognition Framework and Wearable Gesture-Based Interaction Prototype for Mobile Devices

A Framework for Daily Activity Monitoring and Fall Detection Based on Surface Electromyography and Accelerometer Signals

Hand Gesture Recognition Research Based on Surface EMG Sensors and 2D-accelerometers