Multimedia constitutes an interesting field of application for Semantic Web and Semantic Web reasoning, as the access and management of multimedia content and context depends strongly on the semantic descriptions of both. At the same time, multimedia resources constitute complex objects, the descriptions of which are involved and require the foundation on sound modeling practice in order to represent findings of low- and high level multimedia analysis and to make them accessible via Semantic Web querying of resources. This tutorial aims to provide a red thread through these different issues and to give an outline of where Semantic Web modeling and reasoning needs to further contribute to the area of semantic multimedia for the fruitful interaction between these two fields of computer science.

Semantic Multimedia

Authoring of multimedia content can be considered as composing media assets such as images, videos, text, and audio in time, space, and interaction into a coherent multimedia presentation. Personalization of such content means that it reflects the users' or user groups' profile information and context information. Enriching the multimedia content with semantically rich metadata allows for a better search and retrieval of the content. To actually create personalized semantically-rich multimedia content, a manual authoring of the many different documents for all the different users' and user groups' needs is not feasible. Rather a (semi-)automatic authoring of the content seems reasonable. We have analyzed in detail today's approaches and systems for authoring, personalizing, and semantically enriching multimedia presentations. Based on this analysis, we derived a general creation chain for the (semi-)automatic generation of such content. In this paper, we introduce this creation chain. We present our software engineering support for the chain, the component framework SemanticMM4U. The canonical processes supported by the creation chain and SemanticMM4U framework are described in detail. We also provide an explicit mapping of SemanticMM4U framework components to the processes and argue for the benefits of defining canonical processes for creating personalized semantically rich multimedia presentations.

/pdf/canonical-processes-for-creating-personalized-semantically-3chzfd4y03.pdf

Canonical processes for creating personalized semantically rich multimedia presentations

This paper presents an approach to assist authors during the authoring of multimedia presentations. We extend the existing authoring support by integrating processes of topic identification, content collection and discourse structure building in a single environment. This integration allows identification of the context of the authoring process. Our approach combines this process context awareness with explicit domain and discourse knowledge to steer system suggestions. We evaluate our approach with an experimental system prototype.

/pdf/context-aware-guidance-for-multimedia-authoring-harmonizing-3p9zrbltqz.pdf

Context aware guidance for multimedia authoring: harmonizing domain and discourse knowledge

This paper presents an approach to assist authors during the authoring of multimedia presentations. We extend existing authoring support by integrating processes of topic identification, content collection and discourse structure building in a single environment. This integration allows identification of the context of the authoring process. Our approach combines this process context awareness with explicit domain and discourse knowledge to steer system suggestions. We evaluate our approach with an experimental system prototype

Support for personalized multimedia content has become a crucial aspect of today's multimedia applications. We find many different systems and approaches that provide multimedia content tailored to the specific needs and requirements of the users. These systems and approaches exploit semantically-rich information for the multimedia content creation task. However, once the content is created, this very valuable source of information is thrown away. Thus, it is lost for any further processing of the created multimedia presentations. Systems that analyze such presentations can only revive a very limited amount of the semantic information that was initially available and used. Consequently, we present with the SemanticMM4U framework an approach that enhances the state-of-the-art by providing support for deriving semantics at any point in time during the assemble process and integrating it into the syntax of the final presentation formats. By this, the semantics is made machine-readable and machine-processable. It allows for a better indexing, retrieval, and processing of the multimedia presentations.

/pdf/semantics-support-for-personalized-multimedia-content-lz8r3h54un.pdf

Semantics support for personalized multimedia content

Multimedia authoring is a complex, resource demanding, knowledge-intensive, and multilayered process. While a large part of presentation creation cases involve manual production of presentations, such as performed in daily work of students and teachers, most applications for manual production (e.g. PowerPoint, Director) are only working environments with no help on the conceptual level. We propose a framework for the authoring system called SampLe (semiautomatic presentation generation environment), where the system support is provided at any stage of the presentation building process. The support is managed by incorporating explicit knowledge about the domain, narrative structures, media modalities, and tasks involved into the process of multimedia presentation creation.

/pdf/sample-towards-a-framework-for-system-supported-multimedia-5eytcum1a1.pdf

J. van Ossenbruggen

Papers

SampLe: towards a framework for system-supported multimedia authoring