Synchronization models for multimedia presentation with user participation
TL;DR: This paper addresses the key issue of providingflexible multimedia presentation with user participation and suggests synchronization models that can specify the user participation during the presentation and suggests adynamic timed Petri nets structure that can model pre-emptions and modifications to the temporal characteristics of the net.
Abstract: This paper addresses the key issue of providingflexible multimedia presentation with user participation and suggests synchronization models that can specify the user participation during the presentation. We study models like the Petrinet-based hypertext model and the object composition Petri nets (OCPN). We suggest adynamic timed Petri nets structure that can model pre-emptions and modifications to the temporal characteristics of the net. This structure can be adopted by the OCPN to facilitate modeling of multimedia synchronization characteristics with dynamic user participation. We show that the suggested enhancements for the dynamic timed Petri nets satisfy all the properties of the Petri net theory. We use the suggested enhancements to model typical scenarios in a multimedia presentation with user inputs.
Citations
More filters
Patent•
07 Feb 2002
TL;DR: In this paper, a concatenation of binary hash words, one for each frame, is used to identify a possibly compressed audio signal, a block of hash words derived therefrom is matched by a computer with a large database.
Abstract: Hashes are short summaries or signatures of data files which can be used to identify the file. The disclosed method generates robust hashes for multimedia content, for example, audio clips. The audio clip is divided into successive (preferably overlapping) frames. For each frame, the frequency spectrum is divided into bands. A robust property of each band (e.g. energy) is computed and represented by a respective hash bit. An audio clip is thus represented by a concatenation of binary hash words, one for each frame. To identify a possibly compressed audio signal, a block of hash words derived therefrom is matched by a computer with a large database. Such matching strategies are also disclosed. In an advantageous embodiment, the extraction process also provides information as to which of the hash bits are the least reliable. Flipping these bits considerably improves the speed and performance of the matching process.
351 citations
Patent•
13 Aug 2001TL;DR: In this paper, a client system (200, 220) receives a content item and the user can mark the received content item as being of interest. In response to said marking, tracking means automatically provide identifying data for the marked content item to a remote server system (250).
Abstract: A client system (200, 220) receives a content item. The user can mark the received content item as being of interest. In response to said marking, tracking means (204, 224) automatically provide identifying data for the marked content item to a remote server system (250). The server receives a portion of the content item from a client system (200, 220), processes the received portion to obtain an identifier for the content item, obtains further information on the content item using the identifier, and transmits the further information back to the client system (200, 220). The tracking means (204, 224) subsequently receive further information on the content item from the remote server system (250). An identifier for the content item can be used in an e-commerce system (160), for example by putting it on a shopping list (161) or to obtain a list of related items.
107 citations
01 Feb 1997
TL;DR: This paper proposes a framework for distributed multimedia document authoring and presentation, and proposes shortestpath based algorithms for solving difference constraints, and shows how the proposed algorithms can handle local editing and access filtering of multimedia documents.
Abstract: A multimedia document consists of different media objects that are to be sequenced and presented according to temporal and spatial specifications. Collaborative authoring helps in simultaneous editing and viewing of a multimedia document by multiple authors. However, it may cause the objects composing a multimedia document to be distributed over a computer network. In this paper, we propose a framework for distributed multimedia document authoring and presentation. The salient features of this framework are: flexible temporal specification based on difference constraints, system and user defined access filters, local editing, format conversions of media objects, and flexible object retrieval schedules for handling variations in system parameters such as network throughput and buffer resources. We propose shortestpath based algorithms for solving difference constraints. We show how the proposed algorithms can handle local editing and access filtering of multimedia documents. We also describe how the difference constraints based temporal specifications can help in deriving a flexible object retrieval schedule.
90 citations
01 Sep 1993
TL;DR: This paper addresses the key issue of providingflexible multimedia presentation with user participation and suggests synchronization models that can specify the user participation during the presentation and suggests adynamic timed Petri nets structure that can model pre-emptions and modifications to the temporal characteristics of the net.
Abstract: This paper addresses the key issue of providingflexible multimedia presentation with user participation and suggests synchronization models that can specify the user participation during the presentation. We study models like the Petrinet-based hypertext model and the object composition Petri nets (OCPN). We suggest adynamic timed Petri nets structure that can model pre-emptions and modifications to the temporal characteristics of the net. This structure can be adopted by the OCPN to facilitate modeling of multimedia synchronization characteristics with dynamic user participation. We show that the suggested enhancements for the dynamic timed Petri nets satisfy all the properties of the Petri net theory. We use the suggested enhancements to model typical scenarios in a multimedia presentation with user inputs.
62 citations
Book•
01 May 2010TL;DR: This textbook on multimedia data management techniques offers a unified perspective on retrieval efficiency and effectiveness and presents data structures and algorithms that help store, index, cluster, classify, and access common data representations.
Abstract: Multimedia data require specialized management techniques because the representations of color, time, semantic concepts, and other underlying information can be drastically different from one another. The user's subjective judgment can also have significant impact on what data or features are relevant in a given context. These factors affect both the performance of the retrieval algorithms and their effectiveness. This textbook on multimedia data management techniques offers a unified perspective on retrieval efficiency and effectiveness. It provides a comprehensive treatment, from basic to advanced concepts, that will be useful to readers of different levels, from advanced undergraduate and graduate students to researchers and to professionals. After introducing models for multimedia data (images, video, audio, text, and web) and for their features, such as color, texture, shape, and time, the book presents data structures and algorithms that help store, index, cluster, classify, and access common data representations. The authors also introduce techniques, such as relevance feedback and collaborative filtering, for bridging the "semantic gap" and present the applications of these to emerging topics, including web and social networking.
48 citations
References
More filters
1,252 citations
"Synchronization models for multimed..." refers background in this paper
...1, consider the skip operation on the text component T1 when the event x1 is being presented and other events a1, i1, y1 are being presented in parallel....
[...]
TL;DR: A technique is presented for the formal specification and modeling of multimedia composition with respect to intermedia timing and the synchronization requirements of complex structures of temporally related objects can be easily specified.
Abstract: A technique is presented for the formal specification and modeling of multimedia composition with respect to intermedia timing. The proposed model is based on the logic of temporal intervals and timed Petri nets. A strategy is evinced for constructing a database schema to facilitate data storage and retrieval of media elements based on the temporal relationship established by the proposed modeling tool. An algorithm which allows the retrieval of media elements from the constructed database in a manner which preserves the temporal requirements of the initial specification is presented. Using the proposed model, the synchronization requirements of complex structures of temporally related objects can be easily specified. >
616 citations
IBM1
TL;DR: The concept of multimedia objects as components of an object-based model for a multimedia system is introduced and the essential new synchronization requirement is restricted blocking together with synchronization features covering real-time aspects.
Abstract: Multimedia is defined as the integrated generation, representation, processing, storage, and dissemination of independent machine-processable information expressed in multiple time-dependent and time-independent media such as data, graphics, drawings, voice, audio, and video. The characteristics of synchronization mechanisms desirable for central and distributed multimedia systems are addressed. The concept of multimedia objects as components of an object-based model for a multimedia system is introduced. The essential new synchronization requirement is restricted blocking together with synchronization features covering real-time aspects. Existing synchronization mechanisms can be altered or new ones defined to meet these requirements. >
413 citations
TL;DR: A formal definition of the Trellis model of hypertext is presented and an authoring and browsing prototype called αTrellis that is based on the model is described, which is a generalization of existing directed graph-based forms ofhypertext.
Abstract: We present a formal definition of the Trellis model of hypertext and describe an authoring and browsing prototype called aTrellis that is based on the model. The Trellis model not only represents the relationships that tie individual pieces of information together into a document (i.e., the adjacencies), but specifies the browsing semantics to be associated with the hypertext as well (i.e., the manner in which the information is to be visited and presented). The model is based on Petri nets, and is a generalization of existing directed graph-based forms of hypertext. The Petri net basis permits more powerful specification of what is to be displayed when a hypertext is browsed and permits application of previously developed Petri net analysis techniques to verify properties of the hypertext. A number of useful hypertext constructs, easily described in the Trellis model, are presented. These include the synchronization of simultaneous traversals of separate paths through a hypertext, the incorporation of access controls into a hypertext (i.e., specifying nodes that can be proven to be accessible only to certain classes of browsers), and construction of multiple specialized (tailored) versions from a single hypertext.
325 citations
"Synchronization models for multimed..." refers background in this paper
...1, consider a user request for reverse presentation on the text component T1 when the event x2 is being presented and other events a5, i5 and y1 are being presented in parallel....
[...]
...For instance, the user should at any point of time be able to freeze the presentation or have a reverse presentation by going through previous frames or skip a few frames and go forward....
[...]