ArcFace: Additive Angular Margin Loss for Deep Face Recognition
Jiankang Deng,Jia Guo,Niannan Xue,Stefanos Zafeiriou +3 more
- pp 4690-4699
TLDR
This paper presents arguably the most extensive experimental evaluation against all recent state-of-the-art face recognition methods on ten face recognition benchmarks, and shows that ArcFace consistently outperforms the state of the art and can be easily implemented with negligible computational overhead.Abstract:
One of the main challenges in feature learning using Deep Convolutional Neural Networks (DCNNs) for large-scale face recognition is the design of appropriate loss functions that can enhance the discriminative power. Centre loss penalises the distance between deep features and their corresponding class centres in the Euclidean space to achieve intra-class compactness. SphereFace assumes that the linear transformation matrix in the last fully connected layer can be used as a representation of the class centres in the angular space and therefore penalises the angles between deep features and their corresponding weights in a multiplicative way. Recently, a popular line of research is to incorporate margins in well-established loss functions in order to maximise face class separability. In this paper, we propose an Additive Angular Margin Loss (ArcFace) to obtain highly discriminative features for face recognition. The proposed ArcFace has a clear geometric interpretation due to its exact correspondence to geodesic distance on a hypersphere. We present arguably the most extensive experimental evaluation against all recent state-of-the-art face recognition methods on ten face recognition benchmarks which includes a new large-scale image database with trillions of pairs and a large-scale video dataset. We show that ArcFace consistently outperforms the state of the art and can be easily implemented with negligible computational overhead. To facilitate future research, the code has been made available.read more
Citations
More filters
Posted Content
Generalizing Face Representation with Unlabeled Data
Yichun Shi,Anil K. Jain +1 more
TL;DR: Experimental results on unconstrained datasets show that a small amount of unlabeled data with sufficient diversity can lead to an appreciable gain in recognition performance and outperform the supervised baseline when combined with less than half of the labeled data.
Proceedings ArticleDOI
Face Attributes as Cues for Deep Face Recognition Understanding.
TL;DR: In this paper, the outputs of hidden layers are used to predict face attributes, and the obtained performance is an indicator of how well the attribute is implicitly learned in that layer of the network.
Book ChapterDOI
Score Normalization of X-Vector Speaker Verification System for Short-Duration Speaker Verification Challenge
Ivan Rakhmanenko,Evgeny Kostyuchenko,Evgeny L. Choynzonov,Lidiya N. Balatskaya,Alexander Alexandrovich Shelupanov +4 more
TL;DR: This paper presents their contribution to the task 2 of the short-duration speaker verification (SdSV) challenge, to find new technologies for text-dependent and text-independent speaker verification in short duration scenario.
Journal ArticleDOI
VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolution
TL;DR: An automatic and scalable pipeline to collect a high-quality video face dataset (VFHQ), which contains over 16, 000 high-fidelity clips of diverse interview scenarios, and shows that the temporal information plays a pivotal role in eliminating video consistency issues as well as further improving visual performance.
Proceedings ArticleDOI
Speaker Representation Learning via Contrastive Loss with Maximal Speaker Separability
Zhe Li,Man-Wai Mak +1 more
TL;DR: The authors proposed a supervised contrastive learning objective to learn a speaker embedding space by effectively leveraging the label information in the training data, which can enhance the discrimination of unseen speakers under unseen domains.
References
More filters
Proceedings ArticleDOI
Deep Residual Learning for Image Recognition
TL;DR: In this article, the authors proposed a residual learning framework to ease the training of networks that are substantially deeper than those used previously, which won the 1st place on the ILSVRC 2015 classification task.
Journal Article
Dropout: a simple way to prevent neural networks from overfitting
TL;DR: It is shown that dropout improves the performance of neural networks on supervised learning tasks in vision, speech recognition, document classification and computational biology, obtaining state-of-the-art results on many benchmark data sets.
Proceedings Article
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Sergey Ioffe,Christian Szegedy +1 more
TL;DR: Applied to a state-of-the-art image classification model, Batch Normalization achieves the same accuracy with 14 times fewer training steps, and beats the original model by a significant margin.
Automatic differentiation in PyTorch
Adam Paszke,Sam Gross,Soumith Chintala,Gregory Chanan,Edward Z. Yang,Zachary DeVito,Zeming Lin,Alban Desmaison,Luca Antiga,Adam Lerer +9 more
TL;DR: An automatic differentiation module of PyTorch is described — a library designed to enable rapid research on machine learning models that focuses on differentiation of purely imperative programs, with a focus on extensibility and low overhead.
Posted Content
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Martín Abadi,Ashish Agarwal,Paul Barham,Eugene Brevdo,Zhifeng Chen,Craig Citro,Greg S. Corrado,Andy Davis,Jeffrey Dean,Matthieu Devin,Sanjay Ghemawat,Ian Goodfellow,Andrew Harp,Geoffrey Irving,Michael Isard,Yangqing Jia,Rafal Jozefowicz,Lukasz Kaiser,Manjunath Kudlur,Josh Levenberg,Dan Mané,Rajat Monga,Sherry Moore,Derek G. Murray,Chris Olah,Mike Schuster,Jonathon Shlens,Benoit Steiner,Ilya Sutskever,Kunal Talwar,Paul A. Tucker,Vincent Vanhoucke,Vijay K. Vasudevan,Fernanda B. Viégas,Oriol Vinyals,Pete Warden,Martin Wattenberg,Martin Wicke,Yuan Yu,Xiaoqiang Zheng +39 more
TL;DR: The TensorFlow interface and an implementation of that interface that is built at Google are described, which has been used for conducting research and for deploying machine learning systems into production across more than a dozen areas of computer science and other fields.