scispace - formally typeset
Book ChapterDOI

A Probabilistic Framework for Spatio-Temporal Video Representation & Indexing

TLDR
A key feature of the system is the analysis of video input as a single entity as opposed to a sequence of separate frames, allowing for the detection and recognition of video events.
Abstract
In this work we describe a novel statistical video representation and modeling scheme. Video representation schemes are needed to enable segmenting a video stream into meaningful video-objects, useful for later indexing and retrieval applications. In the proposed methodology, unsupervised clustering via Guassian mixture modeling extracts coherent space-time regions in feature space, and corresponding coherent segments (video-regions) in the video content. A key feature of the system is the analysis of video input as a single entity as opposed to a sequence of separate frames. Space and time are treated uniformly. The extracted space-time regions allow for the detection and recognition of video events. Results of segmenting video content into static vs. dynamic video regions and video content editing are presented.

read more

Content maybe subject to copyright    Report

Citations
More filters
Journal ArticleDOI

Efficient video similarity measurement with video signature

TL;DR: A class of randomized algorithms to estimate Voronoi video similarity (VVS) by first summarizing each video with a small set of its sampled frames, called the video signature (ViSig), and then calculating the distances between corresponding frames from the two ViSigs are proposed.
Proceedings ArticleDOI

Video object segmentation by tracking regions

TL;DR: A new circular dynamic-time warping (CDTW) algorithm is formulated that generalizes DTW to match closed boundaries of two regions, without compromising DTW's guarantees of achieving the optimal solution with linear complexity.
Proceedings ArticleDOI

A Unified Video Segmentation Benchmark: Annotation, Metrics and Analysis

TL;DR: This work introduces a new volume-based metric that includes the important aspect of temporal consistency, that can deal with segmentation hierarchies, and that reflects the tradeoff between over-segmentation and segmentation accuracy.
Proceedings ArticleDOI

Efficient video similarity measurement with video signature

TL;DR: The video signature method is developed as a technique to summarize video efficiently for visual similarity measurements and it is demonstrated that this measure is well approximated by the volume of the intersection between Voronoi cells of similar clusters.
Journal ArticleDOI

Probabilistic space-time video modeling via piecewise GMM

TL;DR: A statistical video representation and modeling scheme that allows for the analysis of video input as a single entity as opposed to a sequence of separate frames and results of segmenting video content into static versus dynamic video regions and video content editing are presented.
References
More filters
Book

Elements of information theory

TL;DR: The author examines the role of entropy, inequality, and randomness in the design of codes and the construction of codes in the rapidly changing environment.
Book

Pattern classification and scene analysis

TL;DR: In this article, a unified, comprehensive and up-to-date treatment of both statistical and descriptive methods for pattern recognition is provided, including Bayesian decision theory, supervised and unsupervised learning, nonparametric techniques, discriminant analysis, clustering, preprosessing of pictorial data, spatial filtering, shape description techniques, perspective transformations, projective invariants, linguistic procedures, and artificial intelligence techniques for scene analysis.
Proceedings ArticleDOI

Determining Optical Flow

TL;DR: In this article, a method for finding the optical flow pattern is presented which assumes that the apparent velocity of the brightness pattern varies smoothly almost everywhere in the image, and an iterative implementation is shown which successfully computes the Optical Flow for a number of synthetic image sequences.
Book

Color Science. Concepts and Methods, Quantitative Data and Formulas

TL;DR: An encyclopedic survey of color science can be found in this article, which includes details of light sources, color filters, physical detectors of radiant energy, and the working concepts in color matching, discrimination, and adaptation.
Related Papers (5)