Book ChapterDOI
Video scene interpretation using perceptual prominence and mise-en-scène features
Gaurav Harit,Santanu Chaudhury +1 more
- pp 571-580
Reads0
Chats0
TLDR
In this article, the authors propose a perceptual prominence-based approach to the spatio-temporal domain of video, which is applied on blob tracks and makes use of a specified spatiotemporal coherence model.Abstract:
We propose an empirical computational model for generating an interpretation of a video shot based on our proposed principle of perceptual prominence. The principle of perceptual prominence captures the key aspects of mise-en-scene required for interpreting a video scene. We present a novel approach for applying perceptual grouping principles to the spatio-temporal domain of video. Our spatio-temporal perceptual grouping scheme, applied on blob tracks, makes use of a specified spatio-temporal coherence model. A high level semantic interpretation of scenes is done using the mise-en-scene features and the perceptual prominence computed for the perceptual clusters.read more
Citations
More filters
Proceedings ArticleDOI
Using Multimedia Ontology for Generating Conceptual Annotations and Hyperlinks in Video Collections
TL;DR: This work presents a novel approach for defining video domain concepts in an ontology using properties that can be observed from the media and proposes the use of Bayesian network as the reasoning mechanism for doing inferencing tasks in the presence of uncertainty.
Journal ArticleDOI
Using ontology for building distributed digital libraries with multimedia contents
TL;DR: A new scheme for media feature based concept modelling is proposed to address the limitation of traditional ontology based multimedia retrieval systems and supports probabilistic evidential reasoning for robust concept recognition in multimedia documents.
Proceedings ArticleDOI
Using Object Models as Domain Knowledge in Perceptual Organization: An Approach for Object Category Identification in Video Sequences
TL;DR: A framework which integrates object-model knowledge with the perceptual organization process and demonstrates the advantages of the add-on grouping evidences as contributed by the object models for a more robust perceptual organization in the spatio-temporal domain is presented.
References
More filters
Book ChapterDOI
Laws of organization in perceptual forms.
TL;DR: Theoretically I might say there were 327 brightnesses and nuances of colour, and do I have "327"? No. It is impossible to achieve "327 " as such.
Book
Perceptual Organization and Visual Recognition
TL;DR: Spatial organization and recognition are shown to be a practical basis for current systems and to provide a promising path for further development of improved visual capabilities.
Proceedings ArticleDOI
Structural Saliency: The Detection Of Globally Salient Structures using A Locally Connected Network
A. Sha'asua,Shimon Ullman +1 more
TL;DR: A method for computing saliency by a simple iterative scheme, using a uniform network of locally connected processing elements, to produce a ``saliency map,'''' a representation of the image emphasizing salient locations.
DissertationDOI
Models of bottom-up and top-down visual attention
Christof Koch,Laurent Itti +1 more
TL;DR: A detailed computational model of basic pattern vision in humans and its modulation by top-down attention is presented, able to quantitatively account for all observations by assuming that attention strengthens the non-linear cortical interactions among visual neurons.
Journal ArticleDOI
Perceptual organization approach based on Dempster–Shafer theory
TL;DR: This paper shows that without any prior knowledge and any threshold, the bottom-up algorithm detects efficiently the different objects even in cluttered environment and demonstrates its robustness and flexibility on indoor and outdoor scenes without any modification of parameters.