Loss of the ability to speak or hear exerts psychological and social impacts on the affected persons due to the lack of proper communication. Multiple and systematic scholarly interventions that vary according to context have been implemented to overcome disability-related difficulties. Sign language recognition (SLR) systems based on sensory gloves are significant innovations that aim to procure data on the shape or movement of the human hand. Innovative technology for this matter is mainly restricted and dispersed. The available trends and gaps should be explored in this research approach to provide valuable insights into technological environments. Thus, a review is conducted to create a coherent taxonomy to describe the latest research divided into four main categories: development, framework, other hand gesture recognition, and reviews and surveys. Then, we conduct analyses of the glove systems for SLR device characteristics, develop a roadmap for technology evolution, discuss its limitations, and provide valuable insights into technological environments. This will help researchers to understand the current options and gaps in this area, thus contributing to this line of research.

A Review on Systems-Based Sensory Gloves for Sign Language Recognition State of the Art between 2007 and 2017.

Over the last decade, passive brain-computer interface (BCI) algorithms and biosignal acquisition technologies have experienced a significant growth that has allowed the real-time analysis of biosignals, with the aim to quantify relevant insights, such as mental and emotional states, of the users Several passive BCI-based applications have been tested in laboratory settings, and just a few of them in real or, at least, simulated but highly realistic settings Nevertheless, works performed in laboratory settings are not able to take into account all those factors (artefacts, non-brain influences, other mental states) that could impair the usability of passive BCIs during real applications, naturally characterized by higher complexity The present review takes into account the most recent trends in using advanced passive BCI technologies in real settings, especially for real-time mental state evaluations in operational environments, evaluation of team resources, training and expertise assessment, gaming and neuromarketing applications The objective of the work is to draw a mark on where we are to date and the future challenges, in order to make passive BCIs closer to being integrated into daily life applications

https://iopscience.iop.org/article/10.1088/1361-6579/aad57e/pdf

Passive BCI beyond the lab: current trends and future directions

Marketing and promotions of various consumer products through advertisement campaign is a well known practice to increase the sales and awareness amongst the consumers. This essentially leads to increase in profit to a manufacturing unit. Re-production of products usually depends on the various facts including consumption in the market, reviewer's comments, ratings, etc. However, knowing consumer preference for decision making and behavior prediction for effective utilization of a product using unconscious processes is called "Neuromarketing". This field is emerging fast due to its inherent potential. Therefore, research work in this direction is highly demanded, yet not reached a satisfactory level. In this paper, we propose a predictive modeling framework to understand consumer choice towards E-commerce products in terms of "likes" and "dislikes" by analyzing EEG signals. The EEG signals of volunteers with varying age and gender were recorded while they browsed through various consumer products. The experiments were performed on the dataset comprised of various consumer products. The accuracy of choice prediction was recorded using a user-independent testing approach with the help of Hidden Markov Model (HMM) classifier. We have observed that the prediction results are promising and the framework can be used for better business model.

Analysis of EEG signals and its application to neuromarketing

Sign language facilitates communication between hearing impaired peoples and the rest of the society. A number of sign language recognition (SLR) systems have been developed by researchers, but they are limited to isolated sign gestures only. In this paper, we propose a modified long short-term memory (LSTM) model for continuous sequences of gestures or continuous SLR that recognizes a sequence of connected gestures. It is based on splitting of continuous signs into sub-units and modeling them with neural networks. Thus, the consideration of a different combination of sub-units is not required during training. The proposed system has been tested with 942 signed sentences of Indian Sign Language (ISL). These sign sentences are recognized using 35 different sign words. The average accuracy of 72.3% and 89.5% has been recorded on signed sentences and isolated sign words, respectively.

A Modified LSTM Model for Continuous Sign Language Recognition Using Leap Motion

Modern hardware and software development has led to an evolution of user interfaces from command-line to natural user interfaces for virtual immersive environments. Gestures imitating real-world interaction tasks increasingly replace classical two-dimensional interfaces based on Windows/Icons/Menus/Pointers (WIMP) or touch metaphors. Thus, the purpose of this paper is to survey the state-of-the-art Human-Computer Interaction (HCI) techniques with a focus on the special field of three-dimensional interaction. This includes an overview of currently available interaction devices, their applications of usage and underlying methods for gesture design and recognition. Focus is on interfaces based on the Leap Motion Controller (LMC) and corresponding methods of gesture design and recognition. Further, a review of evaluation methods for the proposed natural user interfaces is given.

Himaanshu Gauba

Papers

Coupled HMM-based multi-sensor data fusion for sign language recognition

A multimodal framework for sensor based sign language recognition

Prediction of advertisement preference by fusing EEG response and sentiment analysis.