Book ChapterDOI
Sign language recognition using sub-units
Reads0
Chats0
TLDR
This paper discusses sign language recognition using linguistic sub-units, presenting three types of sub- units for consideration; those learnt from appearance data as well as those inferred from both 2D or 3D tracking data.Abstract:
This paper discusses sign language recognition using linguistic sub-units. It presents three types of sub-units for consideration; those learnt from appearance data as well as those inferred from both 2D or 3D tracking data. These sub-units are then combined using a sign level classifier; here, two options are presented. The first uses Markov Models to encode the temporal changes between sub-units. The second makes use of Sequential Pattern Boosting to apply discriminative feature selection at the same time as encoding temporal information. This approach is more robust to noise and performs well in signer independent tests, improving results from the 54% achieved by the Markov Chains to 76%.read more
Citations
More filters
Posted Content
Progressive Transformers for End-to-End Sign Language Production
TL;DR: A back translation evaluation mechanism for SLP is proposed, presenting benchmark quantitative results on the challenging RWTH-PHoENIX-Weather-2014T(PHOENIX14T) dataset and setting baselines for future research.
Posted Content
TSPNet: Hierarchical Feature Learning via Temporal Semantic Pyramid for Sign Language Translation
TL;DR: In this paper, a hierarchical sign video feature learning method via a temporal semantic pyramid network is proposed, which takes into account multiple temporal granularities, thus alleviating the need for accurate video segmentation.
Journal ArticleDOI
Robust sign language recognition by combining manual and non-manual features based on conditional random field and support vector machine
Hee-Deok Yang,Seong-Whan Lee +1 more
TL;DR: A new method for recognizing manual signals and facial expressions as non-manual signals and can accurately recognize the sign language at an 84% rate based on utterance data is proposed.
Journal ArticleDOI
Accessible Options for Deaf People in e-Learning Platforms: Technology Solutions for Sign Language Translation
TL;DR: This paper presents a list of potential technology options for the recognition, translation and presentation of SL (and potential problems) through the analysis of assistive technologies, methods and techniques to contribute for the development of the state of the art and ensure digital inclusion of the deaf people in e-learning platforms.
Posted Content
Transferring Cross-domain Knowledge for Video Sign Language Recognition
TL;DR: A novel method is proposed that learns domain-invariant visual concepts and fertilizes WSLR models by transferring knowledge of subtitled news sign to them, and outperforms previous state-of-the-art methods significantly.
References
More filters
Journal ArticleDOI
Random Forests
TL;DR: Internal estimates monitor error, strength, and correlation and these are used to show the response to increasing the number of features used in the forest, and are also applicable to regression.
Proceedings ArticleDOI
Rapid object detection using a boosted cascade of simple features
Paul A. Viola,Michael Jones +1 more
TL;DR: A machine learning approach for visual object detection which is capable of processing images extremely rapidly and achieving high detection rates and the introduction of a new image representation called the "integral image" which allows the features used by the detector to be computed very quickly.
Journal ArticleDOI
A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting
Yoav Freund,Robert E. Schapire +1 more
TL;DR: The model studied can be interpreted as a broad, abstract extension of the well-studied on-line prediction model to a general decision-theoretic setting, and it is shown that the multiplicative weight-update Littlestone?Warmuth rule can be adapted to this model, yielding bounds that are slightly weaker in some cases, but applicable to a considerably more general class of learning problems.
Journal ArticleDOI
Visual pattern recognition by moment invariants
TL;DR: It is shown that recognition of geometrical patterns and alphabetical characters independently of position, size and orientation can be accomplished and it is indicated that generalization is possible to include invariance with parallel projection.
Journal ArticleDOI
Shape quantization and recognition with randomized trees
Yali Amit,Donald Geman +1 more
TL;DR: A new approach to shape recognition based on a virtually infinite family of binary features (queries) of the image data, designed to accommodate prior information about shape invariance and regularity, and a comparison with artificial neural networks methods is presented.