scispace - formally typeset
Proceedings ArticleDOI

Content based indexing of images and video using face detection and recognition methods

TLDR
An image and video indexing approach that combines face detection and face recognition methods that is able to discriminate between three different newscasters and an interviewed person is presented.
Abstract
This paper presents an image and video indexing approach that combines face detection and face recognition methods. Images of a database or frames of a video sequence are scanned for faces by a neural network-based face detector. The extracted faces are then grouped into clusters by a combination of a face recognition method using pseudo two-dimensional hidden Markov models and a k-means clustering algorithm. Each resulting main cluster consists of the face images of one person. In a subsequent step, the detected faces are labeled as one of the different people in the video sequence or the image database and the occurrence of the people can be evaluated. The results of the proposed approach on a TV broadcast news sequence are presented. It is demonstrated that the system is able to discriminate between three different newscasters and an interviewed person.

read more

Citations
More filters
Book ChapterDOI

Person spotting: video shot retrieval for face sets

TL;DR: Progress is described in harnessing multiple exemplars of each person in a form that can easily be associated automatically using straightforward visual tracking in order to retrieve humans automatically in videos, given a query face in a shot.
Proceedings ArticleDOI

Video data mining using configurations of viewpoint invariant regions

TL;DR: A method for obtaining the principal objects, characters and scenes in a video by measuring the reoccurrence of spatial configurations of viewpoint invariant features, and that efficient methods from the text analysis literature are employed to reduce the matching complexity.
Journal ArticleDOI

Face recognition from video: a review

TL;DR: A broad and deep review of recently proposed methods for overcoming the difficulties encountered in unconstrained settings is presented and connections between the ways in which humans and current algorithms recognize faces are drawn.
Journal ArticleDOI

A separable low complexity 2D HMM with application to face recognition

TL;DR: A novel low-complexity separable but true 2D Hidden Markov Model (HMM) and its application to the problem of Face Recognition (FR) and the impact of key model parameters is studied.
Patent

Occlusion/disocclusion detection using K-means clustering near object boundary with comparison of average motion of clusters to object and background motions

TL;DR: In this paper, an object in a video sequence is tracked by object masks generated for frames in the sequence, and the motion vectors in the object are clustered using a K-means algorithm.
References
More filters
Journal ArticleDOI

A tutorial on hidden Markov models and selected applications in speech recognition

TL;DR: In this paper, the authors provide an overview of the basic theory of hidden Markov models (HMMs) as originated by L.E. Baum and T. Petrie (1966) and give practical details on methods of implementation of the theory along with a description of selected applications of HMMs to distinct problems in speech recognition.
Journal ArticleDOI

Neural network-based face detection

TL;DR: A neural network-based upright frontal face detection system that arbitrates between multiple networks to improve performance over a single network, and a straightforward procedure for aligning positive face examples for training.
Journal ArticleDOI

Name-It: naming and detecting faces in news videos

TL;DR: Name-It, a system that associates faces and names in news videos, takes a multimodal video analysis approach: face sequence extraction and similarity evaluation from videos, name extraction from transcripts, and video-caption recognition.
Proceedings ArticleDOI

Content-based video indexing of TV broadcast news using hidden Markov models

TL;DR: A new approach to content-based video indexing using hidden Markov models (HMMs), in which one feature vector is calculated for each image of the video sequence, that allows the classification of complex video sequences.
Journal ArticleDOI

Recognition of JPEG compressed face images based on statistical methods

TL;DR: An extension of the face recognition system based on 2D DCT features and pseudo 2D Hidden Markov Models is capable of recognizing faces by using JPEG compressed image data, and these are the best recognition results ever reported on this database.