Integrated multilevel image fusion and match score fusion of visible and infrared face images for robust face recognition
TL;DR: An integrated image fusion and match score fusion of multispectral face images using [email protected] SVM and Dezert Smarandache theory of fusion which is based on plausible and paradoxical reasoning is presented.
About: This article is published in Pattern Recognition.The article was published on 2008-03-01 and is currently open access. It has received 176 citations till now. The article focuses on the topics: Image fusion & Image processing.
Citations
More filters
01 Nov 2011
TL;DR: As a typical application of the LBP approach, LBP-based facial image analysis is extensively reviewed, while its successful extensions, which deal with various tasks of facial imageAnalysis, are also highlighted.
Abstract: Local binary pattern (LBP) is a nonparametric descriptor, which efficiently summarizes the local structures of images. In recent years, it has aroused increasing interest in many areas of image processing and computer vision and has shown its effectiveness in a number of applications, in particular for facial image analysis, including tasks as diverse as face detection, face recognition, facial expression analysis, and demographic classification. This paper presents a comprehensive survey of LBP methodology, including several more recent variations. As a typical application of the LBP approach, LBP-based facial image analysis is extensively reviewed, while its successful extensions, which deal with various tasks of facial image analysis, are also highlighted.
895 citations
Cites background or methods from "Integrated multilevel image fusion ..."
...2005 [67, 70], 2006 [68] 2007 [64, 65], 2008 [66, 71]...
[...]
...A simple fusion strategy is to first extract Gabor and LBP features in the parallel way, and then fuse two kinds of features on feature level, matching score level, or decision level [65]-[66]....
[...]
...It was concluded in [64]-[66] that Gabor wavelet and LBP based features are mutually complementary, because LBP captures the local appearance detail; while Gabor-wavelets extract shape information over a broader range of scales....
[...]
TL;DR: This survey comprehensively survey the existing methods and applications for the fusion of infrared and visible images, which can serve as a reference for researchers inrared and visible image fusion and related fields.
849 citations
TL;DR: A discussion outlining the incentive for using face recognition, the applications of this technology, and some of the difficulties plaguing current systems with regard to this task has been provided.
Abstract: Face recognition presents a challenging problem in the field of image analysis and computer vision, and as such has received a great deal of attention over the last few years because of its many applications in various domains. Face recognition techniques can be broadly divided into three categories based on the face data acquisition methodology: methods that operate on intensity images; those that deal with video sequences; and those that require other sensory data such as 3D information or infra-red imagery. In this paper, an overview of some of the well-known methods in each of these categories is provided and some of the benefits and drawbacks of the schemes mentioned therein are examined. Furthermore, a discussion outlining the incentive for using face recognition, the applications of this technology, and some of the difficulties plaguing current systems with regard to this task has also been provided. This paper also mentions some of the most recent algorithms developed for this purpose and attempts to give an idea of the state of the art of face recognition technology.
751 citations
Cites background from "Integrated multilevel image fusion ..."
...Other approaches have also been proposed recently which explore the fusion of face images captured under visible and infrared light spectrum to improve the performance of face recognition [255, 265-267]....
[...]
TL;DR: This paper proposes an infrared fusion image that combines infrared and visible images of the same scene to generate a composite image which can provide a more comprehensive description of the scene.
Abstract: The fusion of infrared and visible images of the same scene aims to generate a composite image which can provide a more comprehensive description of the scene. In this paper, we propose an infrared...
245 citations
TL;DR: It is concluded that although various IR and VI image fusion methods have been proposed, there still exist further improvements or potential research directions in different applications of IR andVI image fusion.
187 citations
References
More filters
Book•
01 Jan 1995TL;DR: Setting of the learning problem consistency of learning processes bounds on the rate of convergence ofLearning processes controlling the generalization ability of learning process constructing learning algorithms what is important in learning theory?
Abstract: Setting of the learning problem consistency of learning processes bounds on the rate of convergence of learning processes controlling the generalization ability of learning processes constructing learning algorithms what is important in learning theory?.
40,147 citations
"Integrated multilevel image fusion ..." refers methods in this paper
...SVM is widely used in classification problems because it is designed to circumvent the overfitting problem [20–22] and is generalized to optimally perform classification on new training data....
[...]
Book•
01 Jan 1976
TL;DR: This book develops an alternative to the additive set functions and the rule of conditioning of the Bayesian theory: set functions that need only be what Choquet called "monotone of order of infinity." and Dempster's rule for combining such set functions.
Abstract: Both in science and in practical affairs we reason by combining facts only inconclusively supported by evidence. Building on an abstract understanding of this process of combination, this book constructs a new theory of epistemic probability. The theory draws on the work of A. P. Dempster but diverges from Depster's viewpoint by identifying his "lower probabilities" as epistemic probabilities and taking his rule for combining "upper and lower probabilities" as fundamental. The book opens with a critique of the well-known Bayesian theory of epistemic probability. It then proceeds to develop an alternative to the additive set functions and the rule of conditioning of the Bayesian theory: set functions that need only be what Choquet called "monotone of order of infinity." and Dempster's rule for combining such set functions. This rule, together with the idea of "weights of evidence," leads to both an extensive new theory and a better understanding of the Bayesian theory. The book concludes with a brief treatment of statistical inference and a discussion of the limitations of epistemic probability. Appendices contain mathematical proofs, which are relatively elementary and seldom depend on mathematics more advanced that the binomial theorem.
14,565 citations
Additional excerpts
...Product rule fusion [36] Sum rule fusion [36] SVM fusion [37] DST fusion [39] Proposed DSm fusion Notre Dame 95.07 97.12 97.46 97.58 98.82 Equinox 93.20 94.33 95.05 96.51 98.08 images are not fused....
[...]
...To compare the performance of the proposed DSm based match score fusion algorithm, we chose four existing fusion algorithms, Product rule [36], Sum rule [36], SVM fusion [37], and DST fusion [39]....
[...]
...Product rule and Sum rule are based on statistical rules, SVM fusion algorithm is a learning based algorithm, and DST fusion algorithm is based on evidence theory....
[...]
...Dempster Shafer theory (DST) [38] based fusion algorithm is one example of this paradigm in which uncertain and fuzzy information are efficiently fused....
[...]
...Existing statistical and learning based fusion algorithms including DST fusion algorithm do not account for the conflicting region....
[...]
TL;DR: In this paper, the authors provide an up-to-date critical survey of still-and video-based face recognition research, and provide some insights into the studies of machine recognition of faces.
Abstract: As one of the most successful applications of image analysis and understanding, face recognition has recently received significant attention, especially during the past several years. At least two reasons account for this trend: the first is the wide range of commercial and law enforcement applications, and the second is the availability of feasible technologies after 30 years of research. Even though current machine recognition systems have reached a certain level of maturity, their success is limited by the conditions imposed by many real applications. For example, recognition of face images acquired in an outdoor environment with changes in illumination and/or pose remains a largely unsolved problem. In other words, current systems are still far away from the capability of the human perception system.This paper provides an up-to-date critical survey of still- and video-based face recognition research. There are two underlying motivations for us to write this survey paper: the first is to provide an up-to-date review of the existing literature, and the second is to offer some insights into the studies of machine recognition of faces. To provide a comprehensive survey, we not only categorize existing recognition techniques but also present detailed descriptions of representative methods within each category. In addition, relevant topics such as psychophysical studies, system evaluation, and issues of illumination and pose variation are covered.
6,384 citations
TL;DR: This paper presents a novel and efficient facial image representation based on local binary pattern (LBP) texture features that is assessed in the face recognition problem under different challenges.
Abstract: This paper presents a novel and efficient facial image representation based on local binary pattern (LBP) texture features. The face image is divided into several regions from which the LBP feature distributions are extracted and concatenated into an enhanced feature vector to be used as a face descriptor. The performance of the proposed method is assessed in the face recognition problem under different challenges. Other applications and several extensions are also discussed
5,563 citations
"Integrated multilevel image fusion ..." refers background in this paper
...For example, changes in lighting affect the representation of visible spectrum images and can influence feature extraction....
[...]
TL;DR: The results demonstrate that subvoxel accuracy with respect to the stereotactic reference solution can be achieved completely automatically and without any prior segmentation, feature extraction, or other preprocessing steps which makes this method very well suited for clinical applications.
Abstract: A new approach to the problem of multimodality medical image registration is proposed, using a basic concept from information theory, mutual information (MI), or relative entropy, as a new matching criterion. The method presented in this paper applies MI to measure the statistical dependence or information redundancy between the image intensities of corresponding voxels in both images, which is assumed to be maximal if the images are geometrically aligned. Maximization of MI is a very general and powerful criterion, because no assumptions are made regarding the nature of this dependence and no limiting constraints are imposed on the image content of the modalities involved. The accuracy of the MI criterion is validated for rigid body registration of computed tomography (CT), magnetic resonance (MR), and photon emission tomography (PET) images by comparison with the stereotactic registration solution, while robustness is evaluated with respect to implementation issues, such as interpolation and optimization, and image content, including partial overlap and image degradation. Our results demonstrate that subvoxel accuracy with respect to the stereotactic reference solution can be achieved completely automatically and without any prior segmentation, feature extraction, or other preprocessing steps which makes this method very well suited for clinical applications.
4,773 citations
Additional excerpts
...Researchers in medical imaging have used mutual information based registration algorithms to effectively fuse images from different modalities such as CT and MRI [32,33]....
[...]