Microexpression Identification and Categorization Using a Facial Dynamics Map
TLDR
A novel method called the Facial Dynamics Map is proposed to characterize the movements of a microexpression in different granularity, and a classifier is developed to identify the presence of microexpressions and to categorize different types.Abstract:
Unlike conventional facial expressions, microexpressions are instantaneous and involuntary reflections of human emotion. Because microexpressions are fleeting, lasting only a few frames within a video sequence, they are difficult to perceive and interpret correctly, and they are highly challenging to identify and categorize automatically. Existing recognition methods are often ineffective at handling subtle face displacements, which can be prevalent in typical microexpression applications due to the constant movements of the individuals being observed. To address this problem, a novel method called the Facial Dynamics Map is proposed to characterize the movements of a microexpression in different granularity. Specifically, an algorithm based on optical flow estimation is used to perform pixel-level alignment for microexpression sequences. Each expression sequence is then divided into spatiotemporal cuboids in the chosen granularity. We also present an iterative optimal strategy to calculate the principal optical flow direction of each cuboid for better representation of the local facial dynamics. With these principal directions, the resulting Facial Dynamics Map can characterize a microexpression sequence. Finally, a classifier is developed to identify the presence of microexpressions and to categorize different types. Experimental results on four benchmark datasets demonstrate higher recognition performance and improved interpretability.read more
Citations
More filters
Telling Lies Clues To Deceit In The Marketplace Politics And Marriage
TL;DR: In this paper, the authors present a telling lies clues to deceit in the marketplace politics and marriage, but end up in harmful downloads, where instead of reading a good book with a cup of coffee in the afternoon, instead they are facing with some malicious bugs inside their laptop.
Journal ArticleDOI
Less is more: Micro-expression recognition from video using apex frame
TL;DR: A new feature extractor, Bi-Weighted Oriented Optical Flow (Bi-WOOF) is proposed to encode essential expressiveness of the apex frame of a video, with a proposed technique achieving a state-of-the-art F1-score recognition performance.
Journal ArticleDOI
CAS(ME) $^2$ : A Database for Spontaneous Macro-Expression and Micro-Expression Spotting and Recognition
TL;DR: A new database, CAS(ME), which provides both long videos and cropped expression samples, which may aid researchers in developing efficient algorithms for the spotting and recognition of macro-expressions and micro- expressions.
Journal ArticleDOI
Spatiotemporal Recurrent Convolutional Networks for Recognizing Spontaneous Micro-Expressions
TL;DR: A novel deep recurrent convolutional networks based micro-expression recognition approach, capturing the spatiotemporal deformations of micro- expression sequence and optimized by an end-to-end manner and obviates manual feature design is proposed.
Proceedings ArticleDOI
Enriched Long-Term Recurrent Convolutional Network for Facial Micro-Expression Recognition
TL;DR: An Enriched Long-term Recurrent Convolutional Network (ELRCN) that first encodes each micro- expression frame into a feature vector through CNN module(s), then predicts the micro-expression by passing the feature vectorthrough a Long Short-term Memory (LSTM) module.
References
More filters
Journal ArticleDOI
Multiresolution gray-scale and rotation invariant texture classification with local binary patterns
TL;DR: A generalized gray-scale and rotation invariant operator presentation that allows for detecting the "uniform" patterns for any quantization of the angular space and for any spatial resolution and presents a method for combining multiple operators for multiresolution analysis.
Journal ArticleDOI
Active shape models—their training and application
TL;DR: This work describes a method for building models by learning patterns of variability from a training set of correctly annotated images that can be used for image search in an iterative refinement algorithm analogous to that employed by Active Contour Models (Snakes).
A Practical Guide to Support Vector Classication
TL;DR: A simple procedure is proposed, which usually gives reasonable results and is suitable for beginners who are not familiar with SVM.
Journal ArticleDOI
Extreme Learning Machine for Regression and Multiclass Classification
TL;DR: ELM provides a unified learning platform with a widespread type of feature mappings and can be applied in regression and multiclass classification applications directly and in theory, ELM can approximate any target continuous function and classify any disjoint regions.