Specifying spatio temporal relations for multimedia ontologies
20 Dec 2005-pp 527-532
TL;DR: A novel framework for formal specification of spatio-temporal relations between media objects using fuzzy membership and its use in multimedia ontologies and a reasoning framework for creating media based descriptions of concepts are presented.
Abstract: This paper present a novel framework for formal specification of spatio-temporal relations between media objects using fuzzy membership. We have illustrated its use in multimedia ontologies and have described a reasoning framework for creating media based descriptions of concepts.
Citations
More filters
30 Oct 2008
TL;DR: This work uses MOWL, a multimedia extension of Web Ontology Language (OWL) which is capable of describing domain concepts in terms of their media properties and of capturing the inherent uncertainties involved.
Abstract: In this work, we offer an approach to combine standard multimedia analysis techniques with knowledge drawn from conceptual metadata provided by domain experts of a specialized scholarly domain, to learn a domain-specific multimedia ontology from a set of annotated examples. A standard Bayesian network learning algorithm that learns structure and parameters of a Bayesian network is extended to include media observables in the learning. An expert group provides domain knowledge to construct a basic ontology of the domain as well as to annotate a set of training videos. These annotations help derive the associations between high-level semantic concepts of the domain and low-level MPEG-7 based features representing audio-visual content of the videos. We construct a more robust and refined version of this ontology by learning from this set of conceptually annotated videos. To encode this knowledge, we use MOWL, a multimedia extension of Web Ontology Language (OWL) which is capable of describing domain concepts in terms of their media properties and of capturing the inherent uncertainties involved. We use the ontology specified knowledge for recognizing concepts relevant to a video to annotate fresh addition to the video database with relevant concepts in the ontology. These conceptual annotations are used to create hyperlinks in the video collection, to provide an effective video browsing interface to the user.
20 citations
31 Oct 2008
TL;DR: A method for formally defining 3D spatio-temporal relations between elementary media objects using a set of fuzzy membership functions to support soft decision making for multimedia data interpretation and to provide graded ranking.
Abstract: Complex media events are often characterized by spatio-temporal relations between its constituent media objects. A multimedia query language should support specification of such relations for semantic retrieval. We propose a method for formally defining 3D spatio-temporal relations between elementary media objects in this paper. To support soft decision making for multimedia data interpretation and to provide graded ranking, we define these relations using a set of fuzzy membership functions. It is possible to define fuzzy 3D extensions of Allen's relations as well as arbitrary new relations using our method. This method can be incorporated with upcoming multimedia query languages, such as MP7QF.
20 citations
Cites background or methods from "Specifying spatio temporal relation..."
...As in [7], we model the variables t, u, v, w, and x as the real numbers to denote the degree of intersection of a secondary interval with the regions of interests (-∞, a), [a, a], (a, b), [b, b], and (b, +∞) respectively of the primary interval [a, b]....
[...]
...We extend the work presented in [7] to define the semantics of the fuzzy interval membership functions and to define spatio-temporal relations on top of these functions....
[...]
...[7] proposed an extension for this binary value encoding to fuzzy interval membership functions....
[...]
...[7] have proposed use of fuzzy membership values in place of the binary intersection values to achieve graded ranking....
[...]
01 Feb 2019
TL;DR: A formal approach for constructing fuzzy spatio‐temporal ontologies from fuzzy Petri nets is investigated and it is proved the correctness of the transformation and a detailed transformation example is provided.
Abstract: Fuzzy spatio‐temporal knowledge is required in a wide range of application fields, including GIS, spatio‐temporal database, and artificial intelligence. Ontology, as a formal method of knowledge representation, plays a key role in the Semantic Web. Therefore, how to extend ontologies to represent fuzzy spatio‐temporal knowledge needs to be solved. In this paper, we propose an approach for representing fuzzy spatio‐temporal knowledge with ontologies and investigate a formal construction of fuzzy spatio‐temporal ontologies based on fuzzy Petri nets. First, we propose a formal definition of fuzzy spatio‐temporal ontologies. In addition, based on fuzzy description logic, a description logic named the fuzzy spatio‐temporal description logic, which provides a logical basis for the fuzzy spatio‐temporal ontologies, is presented. Furthermore, a fuzzy spatio‐temporal web ontology language, which is fuzzy and spatio‐temporal extension of standard ontology language OWL, is proposed to make the fuzzy spatio‐temporal ontologies easy to use and support efficient reasoning. On the basis of fuzzy spatio‐temporal ontologies, we investigate a formal approach for constructing fuzzy spatio‐temporal ontologies from fuzzy spatio‐temporal Petri nets, ie, transforming fuzzy spatio‐temporal Petri nets (including Petri net model and Petri net instance) into fuzzy spatio‐temporal ontologies at both structure and instance levels. Finally, we prove the correctness of the transformation and provide a detailed transformation example.
13 citations
28 Sep 2007
TL;DR: A reinforcement learning algorithm is proposed for the parameters of the Bayesian Network with the implicit feedback obtained from the clickthrough data to provide personalized ranking of results in a video retrieval system.
Abstract: This paper proposes a new method for using implicit user feedback from clickthrough data to provide personalized ranking of results in a video retrieval system. The annotation based search is complemented with a feature based ranking in our approach. The ranking algorithm uses belief revision in a Bayesian Network, which is derived from a multimedia ontology that captures the probabilistic association of a concept with expected video features. We have developed a content model for videos using discrete feature states to enable Bayesian reasoning and to alleviate on-line feature processing overheads. We propose a reinforcement learning algorithm for the parameters of the Bayesian Network with the implicit feedback obtained from the clickthrough data.
11 citations
17 Nov 2013
TL;DR: This paper proposes a new specification for representing Events using MOWL (E-MOWL), which would enhance event detection and facilitate complete semantics, besides providing scope for personalized multimedia information retrieval.
Abstract: Events in multimedia objects represent landmarks of a story encoded in the media. This paper proposes a new specification for representing Events using MOWL (E-MOWL). Using this approach, higher-level complex events are detected based on the hierarchy of events present in the Event Ontology created using MOWL. The MOWL definition of Spatio-Temporal relations is extended to represent the Context of an event. The Context is any kind of information which gets defined with respect to an event instance wherein Context has its own structure and involves parameters like Time, Geographical location, and Actors/ Entities involved in the event. Such an extension would enhance event detection and facilitate complete semantics, besides providing scope for personalized multimedia information retrieval.
6 citations
Cites background from "Specifying spatio temporal relation..."
...A complex media object is often composed of several simpler media objects, interconnected with Spatio-Temporal and/or temporal relations [6]....
[...]
References
More filters
TL;DR: This paper surveys the work of the qualitative spatial reasoning group at the University of Leeds and motivates the use of regions as the primary spatial entity and shows how a rich language can be built up from surprisingly few primitives.
Abstract: This paper surveys the work of the qualitative spatial reasoning group at the University of Leeds. The group has developed a number of logical calculi for representing and reasoning with qualitative spatial relations over regions. We motivate the use of regions as the primary spatial entity and show how a rich language can be built up from surprisingly few primitives. This language can distinguish between convex and a variety of concave shapes and there is also an extension which handles regions with uncertain boundaries. We also present a variety of reasoning techniques, both for static and dynamic situations. A number of possible application areas are briefly mentioned.
578 citations
"Specifying spatio temporal relation..." refers methods in this paper
...We have extended this scheme with fuzzy membership functions and additional relations based on RCC model [ 3 ] to overcome these limitations....
[...]
...Motivated by RCC [ 3 ], we have introduced one more string C s, which specifies the overlap or disconnectedness between the regions to solve this problem....
[...]
TL;DR: This paper proposes a framework for the handling of spatio-temporal queries with inexact matches, using the concept of relation similarity, and describes a binary string encoding for 1D relations that permits the automatic derivation of similarity measures.
Abstract: This paper proposes a framework for the handling of spatio-temporal queries with inexact matches, using the concept of relation similarity. We initially describe a binary string encoding for 1D relations that permits the automatic derivation of similarity measures. We then extend this model to various granularity levels and many dimensions, and show that reasoning on spatio-temporal structure is significantly facilitated in the new framework. Finally, we provide algorithms and optimization methods for four types of queries: (i) object retrieval based on some spatio-temporal relations with respect to a reference object, (ii) spatial joins, i.e., retrieval of object pairs that satisfy some input relation, (iii) structural queries, which retrieve configurations matching a particular spatio-temporal structure, and (iv) special cases of motion queries. Considering the current large availability of multidimensional data and the increasing need for flexible query-answering mechanisms, our techniques can be used as the core of spatio-temporal query processors.
22 citations
"Specifying spatio temporal relation..." refers background in this paper
...Padadias et al [ 2 ] proposes formal encoding of relation between two events in space-time encoded as a set of binary strings....
[...]
...The scheme of Papadias [ 2 ] is a special case of our scheme....
[...]
...Papadias et al [ 2 ] have proposed a scheme for formal specification of spatial and temporal relations....
[...]
TL;DR: A prototype implementation of a cooperative agent-based multimedia retrieval architecture that integrates a set of dissimilar collections of multimedia data on Indian cultural heritage and a comparison of the retrieval results with some existing Internet search tools proves the effectiveness of the architecture.
Abstract: We present the planning scheme for a cooperative agent-based multimedia retrieval architecture that integrates a heterogeneous set of repositories into a coherent information system. The agents in the system collaborate in context of a conceptual query to formulate unique retrieval strategies for the different collections. The retrieval plan makes need-based use of independent content analysis tools available on the network. The retrieval strategies for the repositories so formulated satisfy the specified constraints on quality of results and the response time requirements. The retrieval plan is reactively updated based on the retrieval performance at the individual repositories. We present some experimental results to show the effectiveness of the planning scheme for repositories with different characteristics and the scalability of the architecture. We present a prototype implementation of this architecture that integrates a set of dissimilar collections of multimedia data on Indian cultural heritage. A comparison of the retrieval results with some existing Internet search tools proves the effectiveness of the architecture.
15 citations