Proceedings ArticleDOI
Disentangled Representation Learning GAN for Pose-Invariant Face Recognition
Luan Tran,Xi Yin,Xiaoming Liu +2 more
- pp 1283-1292
TLDR
Quantitative and qualitative evaluation on both controlled and in-the-wild databases demonstrate the superiority of DR-GAN over the state of the art.Abstract:
The large pose discrepancy between two face images is one of the key challenges in face recognition. Conventional approaches for pose-invariant face recognition either perform face frontalization on, or learn a pose-invariant representation from, a non-frontal face image. We argue that it is more desirable to perform both tasks jointly to allow them to leverage each other. To this end, this paper proposes Disentangled Representation learning-Generative Adversarial Network (DR-GAN) with three distinct novelties. First, the encoder-decoder structure of the generator allows DR-GAN to learn a generative and discriminative representation, in addition to image synthesis. Second, this representation is explicitly disentangled from other face variations such as pose, through the pose code provided to the decoder and pose estimation in the discriminator. Third, DR-GAN can take one or multiple images as the input, and generate one unified representation along with an arbitrary number of synthetic images. Quantitative and qualitative evaluation on both controlled and in-the-wild databases demonstrate the superiority of DR-GAN over the state of the art.read more
Citations
More filters
Journal ArticleDOI
Deep Facial Expression Recognition: A Survey
Shan Li,Weihong Deng +1 more
TL;DR: A comprehensive survey on deep facial expression recognition (FER) can be found in this article, including datasets and algorithms that provide insights into the intrinsic problems of deep FER, including overfitting caused by lack of sufficient training data and expression-unrelated variations, such as illumination, head pose and identity bias.
Proceedings ArticleDOI
Interpreting the Latent Space of GANs for Semantic Face Editing
TL;DR: This work proposes a novel framework, called InterFaceGAN, for semantic face editing by interpreting the latent semantics learned by GANs, and finds that the latent code of well-trained generative models actually learns a disentangled representation after linear transformations.
Journal ArticleDOI
Deep learning on image denoising: An overview.
TL;DR: A comparative study of deep techniques in image denoising by classifying the deep convolutional neural networks for additive white noisy images, the deep CNNs for real noisy images; the deepCNNs for blind Denoising and the deep network for hybrid noisy images.
Proceedings ArticleDOI
Beyond Face Rotation: Global and Local Perception GAN for Photorealistic and Identity Preserving Frontal View Synthesis
TL;DR: Tang et al. as discussed by the authors proposed a Two-Pathway Generative Adversarial Network (TP-GAN) for photorealistic frontal view synthesis by simultaneously perceiving global structures and local details.
Proceedings ArticleDOI
Learning Deep Models for Face Anti-Spoofing: Binary or Auxiliary Supervision
TL;DR: This paper argues the importance of auxiliary supervision to guide the learning toward discriminative and generalizable cues, and introduces a new face anti-spoofing database that covers a large range of illumination, subject, and pose variations.
References
More filters
Proceedings ArticleDOI
Frontal to profile face verification in the wild
Soumyadip Sengupta,Jun-Cheng Chen,Carlos D. Castillo,Vishal M. Patel,Rama Chellappa,David W. Jacobs +5 more
TL;DR: The aim of this data set is to isolate the factor of pose variation in terms of extreme poses like profile, where many features are occluded, along with other `in the wild' variations to suggest that there is a gap between human performance and automatic face recognition methods for large pose variations in unconstrained images.
Proceedings ArticleDOI
Effective face frontalization in unconstrained images
TL;DR: This work explores the simpler approach of using a single, unmodified, 3D surface as an approximation to the shape of all input faces, and shows that this leads to a straightforward, efficient and easy to implement method for frontalization.
Proceedings ArticleDOI
High-fidelity Pose and Expression Normalization for face recognition in the wild
TL;DR: A High-fidelity Pose and Expression Normalization (HPEN) method with 3D Morphable Model (3DMM) which can automatically generate a natural face image in frontal pose and neutral expression and an inpainting method based on Possion Editing to fill the invisible region caused by self occlusion is proposed.
Posted Content
Effective Face Frontalization in Unconstrained Images
TL;DR: In this article, the authors explore the simpler approach of using a single, unmodified, 3D surface as an approximation to the shape of all input faces and show that this leads to a straightforward, efficient and easy to implement method for frontalization.
Proceedings Article
Unsupervised and Semi-supervised Learning with Categorical Generative Adversarial Networks
TL;DR: CatGAN as discussed by the authors is based on an objective function that trades-off mutual information between observed examples and their predicted categorical class distribution, against robustness of the classifier to an adversarial generative model.