Compared to a leading commercial face recognition system, LFDA offers substantial improvements in matching forensic sketches to the corresponding face images and leads to state-of-the-art accuracys when matching viewed sketches.
Abstract:
The problem of matching a forensic sketch to a gallery of mug shot images is addressed in this paper. Previous research in sketch matching only offered solutions to matching highly accurate sketches that were drawn while looking at the subject (viewed sketches). Forensic sketches differ from viewed sketches in that they are drawn by a police sketch artist using the description of the subject provided by an eyewitness. To identify forensic sketches, we present a framework called local feature-based discriminant analysis (LFDA). In LFDA, we individually represent both sketches and photos using SIFT feature descriptors and multiscale local binary patterns (MLBP). Multiple discriminant projections are then used on partitioned vectors of the feature-based representation for minimum distance matching. We apply this method to match a data set of 159 forensic sketches against a mug shot gallery containing 10,159 images. Compared to a leading commercial face recognition system, LFDA offers substantial improvements in matching forensic sketches to the corresponding face images. We were able to further improve the matching performance using race and gender information to reduce the target gallery size. Additional experiments demonstrate that the proposed framework leads to state-of-the-art accuracys when matching viewed sketches.
TL;DR: This paper describes the approach for the Disguised Faces in the Wild (DFW) 2018 challenge, based on VGG-face architecture paired with Contrastive loss based on cosine distance metric, and achieves 27.13% absolute increase in accuracy over the DFW baseline.
TL;DR: This work presents a work that explores the feasibility of automated face recognition technologies for analyzing identities in works of portraiture, and in the process provides additional evidence to settle some long-standing questions in art history.
TL;DR: As a supplement to mugshot detection, a new approach is proposed to capture the eyewitness’s visual perception in the form of symbolic representation which reveals physiological and facial characteristics of criminal which help in their identification.
TL;DR: This paper proposes sufficient CCA (S-CCA) to relieve CCA's overfitting problem, which is inspired by the theory of sufficient dimension reduction, and demonstrates that the effectiveness of S- CCA is verified both theoretically and experimentally.
TL;DR: A comparative study of two well-known face recognition algorithms revealed that given one gallery of face image and four different pose images as a probe, PCA based system is more accurate in recognizing pose, while AdaBoost was more robust on recognizing low resolution images.
TL;DR: This paper presents a method for extracting distinctive invariant features from images that can be used to perform reliable matching between different views of an object or scene and can robustly identify objects among clutter and occlusion while achieving near real-time performance.
TL;DR: A generalized gray-scale and rotation invariant operator presentation that allows for detecting the "uniform" patterns for any quantization of the angular space and for any spatial resolution and presents a method for combining multiple operators for multiresolution analysis.
TL;DR: It is observed that the ranking of the descriptors is mostly independent of the interest region detector and that the SIFT-based descriptors perform best and Moments and steerable filters show the best performance among the low dimensional descriptors.
TL;DR: This paper presents a novel and efficient facial image representation based on local binary pattern (LBP) texture features that is assessed in the face recognition problem under different challenges.
Q1. What contributions have the authors mentioned in the paper "Matching forensic sketches to mug shot photos" ?
The problem of matching a forensic sketch to a gallery of mug shot images is addressed in this paper. Forensic sketches differ from viewed sketches in that they are drawn by a police sketch artist using the description of the subject provided by an eyewitness. To identify forensic sketches, the authors present a framework called local feature-based discriminant analysis ( LFDA ). In LFDA, the authors individually represent both sketches and photos using SIFT feature descriptors and multiscale local binary patterns ( MLBP ). The authors were able to further improve the matching performance using race and gender information to reduce the target gallery size.
Q2. What is the proposed method for combining large feature size and small sample size?
In order to handle the combination of a large feature size and small sample size, an ensemble of linear discriminant classifiers called LFDA is proposed.
Q3. What other methods have been proposed to handle the SSS problem?
Other discriminant analysis methods have been proposed to handle the SSS problem, such as random sampling LDA [23], regularized LDA [24], and direct LDA [25].
Q4. Why are image descriptors not sufficiently verbose to describe a face?
Because most image descriptors are not sufficientlyverbose to fully describe a face image, the descriptors are computedover a set of uniformly distributed subregions of the face.
Q5. What is the main reason why the authors have not found a large number of forensic sketches?
the authors believe that with a larger number of forensic sketches, the authors could more properly train their discriminant and further improve the matching performance.
Q6. Why is the culprit being depicted in a forensic sketch considered a suspect?
This is because the culprit being depicted in a forensic sketch typically has committed a heinous crime (e.g., murder, rape, and armed robbery) that will receive a large amount of attention from investigators.
Q7. What is the approach to extract discriminant features?
A straightforward approach would be to apply classical subspace analysis (such as LDA) directly on , and to extract discriminant features for classification.
Q8. What are the key difficulties in matching forensic sketches?
The authors highlight two key difficulties in matching forensic sketches: 1) matching across image modalities and 2) performing face recognition despite possibly inaccurate depictions of the face.