SampLe: towards a framework for system-supported multimedia authoring

TL;DR: A framework for the authoring system called SampLe (semiautomatic presentation generation environment), where the system support is provided at any stage of the presentation building process by incorporating explicit knowledge about the domain, narrative structures, media modalities, and tasks involved into the process of multimedia presentation creation.

Abstract: Multimedia authoring is a complex, resource demanding, knowledge-intensive, and multilayered process. While a large part of presentation creation cases involve manual production of presentations, such as performed in daily work of students and teachers, most applications for manual production (e.g. PowerPoint, Director) are only working environments with no help on the conceptual level. We propose a framework for the authoring system called SampLe (semiautomatic presentation generation environment), where the system support is provided at any stage of the presentation building process. The support is managed by incorporating explicit knowledge about the domain, narrative structures, media modalities, and tasks involved into the process of multimedia presentation creation.

Summary

Summary

• 1977; Kratochwil and Kohl 1988) and because colonies are relatively longlived, which increases the spectrum of plant species used for resource allocation.
• Monitoring resource intake at the colony level of species found in the same habitat may still provide the most complete picture of—as well as of species-specific differences in—the floral and hence nutritive spectrum used by foraging social bees (Kratochwil and Kohl 1988).
• The supernatant was transferred into a fresh microcentrifuge tube and boiled for 2 min at 100°C.
• Pollen sources and loads Overall, the authors characterized 43 different pollen morphospecies.
• Honeybees were more flower-constant with regard to pollen morphospecies than were bumblebees (Table I) and had purer pollen loads: 100% of honeybee foragers collected pollen with one pollen mor- phospecies representing ≥95% of pollen grains, whereas only 54% of B. pascuorum and 76% of B. terrestris foragers had comparably pure pollen loads.

Figures

Figure 1. Selection of the material

Full text

Centrum voor Wiskunde en Informatica
INformation Systems
SampLe: Towards a Framework for System-supported
Multimedia Authoring
Kateryna Falkovych, Frank Nack,
Jacco van Ossenbruggen, Lloyd Rutledge
REPORT INS-E0302 AUGUST 31, 2003
INS
Information Systems

CWI is the National Research Institute for Mathematics and Computer Science. It is sponsored by the
Netherlands Organization for Scientific Research (NWO).
CWI is a founding member of ERCIM, the European Research Consortium for Informatics and Mathematics.
CWI's research has a theme-oriented structure and is grouped into four clusters. Listed below are the names
of the clusters and in parentheses their acronyms.
Probability, Networks and Algorithms (PNA)
Software Engineering (SEN)
Modelling, Analysis and Simulation (MAS)
Information Systems (INS)
Copyright © 2003, Stichting Centrum voor Wiskunde en Informatica
P.O. Box 94079, 1090 GB Amsterdam (NL)
Kruislaan 413, 1098 SJ Amsterdam (NL)
Telephone +31 20 592 9333
Telefax +31 20 592 4199
ISSN 1386-3681

SampLe: Towards a Framework for System-
supported Multimedia Authoring
ABSTRACT
Much current research on hypermedia generation accepts user input only at the start of an
otherwise fully-automated process. However, since multimedia presentation creation is often a
complex and creative process, it has multiple phases which would each benefit from human
intervention. This paper presents a hypermedia generation model that lets the user influence all
phases of this computer-assisted human-guided process. The main focus is on providing extra
support for helping the user find relevant media items and combine them meaningfully into a
rich and coherent multimedia presentation. Like fully-automated systems, our approach uses
explicit knowledge about the presentation's topic domain, narrative structures, hypermedia
presentation and distinctions between media modalities. This paper presents a motivating
scenario that is used to derive a number of system requirements and to discuss the pros and
cons of the presented approach.
Keywords and Phrases: Multimedia authoring, semantics, narrative structure, intelligent support

Samp
L
e: Towards a Framework for System-supported Multimedia Authoring
Kateryna Falkovych, Frank Nack, Jacco van Ossenbruggen, Lloyd Rutledge
CWI, Amsterdam
Firstname.Lastname@cwi.nl
Abstract
Much current research on hypermedia generation
accepts user input only at the start of an otherwise fully-
automated process. However, since multimedia
presentation creation is often a complex and creative
process, it has multiple phases which would each benefit
from human intervention. This paper presents a
hypermedia generation model that lets the user influence
all phases of this computer-assisted human-guided
process. The main focus is on providing extra support for
helping the user find relevant media items and combine
them meaningfully into a rich and coherent multimedia
presentation. Like fully-automated systems, our approach
uses explicit knowledge about the presentation's topic
domain, narrative structures, hypermedia presentation
and distinctions between media modalities. This paper
presents a motivating scenario that is used to derive a
number of system requirements and to discusses the pros
and cons of the presented approach.
1. Introduction
The production of multimedia presentations is a
complex, resource demanding, distributed, and creative
process. The aim of the process is to provide engaging
and relevant information by composing a multi-
dimensional network of relationships between different
kinds of audio-visual information units.
We divided this process into five stages: theme
identification, specification of presentation structure,
collection of material, arrangement of material, and
presentation creation. At the first stage, a topic of the
presentation is chosen within a domain of interest. The
scope of the presentation is outlined at this stage by
defining the genre of the presentation as well as main and
secondary characters. This information allows
specification of the logical structure of the presentation
at the second stage. At the third stage appropriate
material is selected and placed within each part of the
logical structure. The particular ordering of the selected
material is done at the fourth stage. At the fifth stage the
final presentation is created by determining spatial-
temporal relationships between selected items and
defining stylistic aspects.
Even though we presented the stages above in a
sequential manner, we find that the various stages are
typically iterative and mutually interrelating. While this
increases the complexity of the process it also leads to
semantically rich and engaging presentations.
Many multimedia presentations, such as those made
by pupils, students, researchers or managers, are
manually crafted presentations. The support in manual
production comes mainly in form of production
environments such as Director, Premiere, Photoshop,
Flash, FrontPage, PowerPoint and others. These tools
are, however, not equipped to support the complex
processes of content and design development, as they
assume that the user has a sufficient level of expertise [4].
In this paper, we present a framework that supports
the five steps of the presentation generation process. Our
approach combines the creative strength of humans with
the analytical and procedural power of machines. It
allows a way of presentation generation in which the user
has full control over the presentation creation process,
but at the same time is facilitated with ontology-based

and context-oriented information at those stages where
she lacks knowledge or skills.
Our system, called SampLe (Semi-Automatic
Multimedia Presentation generation Environment), is
connected to a large multimedia database. In order to
create a presentation, the material from the database is
used.
Since different users have different levels of expertise
in the domain as well as various experiences with
presentation building process, the system should be able
to support any type of a user by providing support at
each stage of presentation creation process. Depending
on the user's level of expertise, created presentations can
be included into the system repository, enriching it with
new points of view on the material and new interrelation
structures between media items. In such a way, stored
presentations might help novice users (such as students
having an assignment to build a presentation) get an
insight into the domain and get an idea about possible
topics and designs for their own presentations.
Additionally, the system is also in the position to offer
assistance on the presentational level by providing
various ways of structuring a presentation.
The paper is structured as follows. Section 2
discusses related work in which we show connections
between our approach and existing presentation
generation techniques. Further discussion follows the
five stage process described in the Introduction. Section
3 presents the theme identification stage. Section 4
discusses presentation structure specification. Section 5
describes the elaboration on the created structure by
facilitating content selection. Arrangement of selected
media items is presented in Section 6. Section 7 discusses
the last stage of the process where the presentation is
created according to the proper style and duration.
Finally Section 8 outlines conclusions and future work.
2. Related work
The development of the SampLe framework took
account of existing work in two related research domains,
namely authoring environments for the fully manual
generation of presentations and techniques from the field
of automatic presentation generation.
The usual computer support for manually crafted
presentations is manifested in form of production
environments, such as image editing tools (Photoshop,
Illustrator, GIMP, or Maya), new media authoring tools,
such as Director/Shockwave, Flash, Dreamweaver,
Frontpage, PowerPoint, GRiNS, Authorware, HyperCard,
or WWW presentation technology, such as HTML and
SMIL. Although these tools provide the user with much
freedom during the development process, they are not
equipped to support the complex process of content
development, because they assume that the user has a
sufficient level of expertise.
Systems that facilitate automated presentation
generation, on the other hand, are typically applied for
dynamic, interactive environments that do not allow the
intervention of a human during presentation generation at
any time after the initial request, such as web sites of
museums [8], real time instruction generation [1],
discourse driven hypermedia presentations [9] or user
tailored biographies of artists [6]. These systems provide
ontology-based description layers for content and
presentation aspects that permit reliable control
mechanisms to establish presentations that are flexible
enough to respond to changing individual user needs and
user groups. The complexity of logical structure
developments and the complex choice of stylistic aspects
regarding conveying certain information typically result,
however, in quite simple structures and styles and hence
unexciting presentations.
The blend of these two methodologies for multimedia
presentation generation can lead to an improvement of
mainly human generated presentations.
First attempts to make use of description structures and
mechanisms taken from automatic processes as the basis
for support in manual authoring environments are
described on the content level, such as for the authoring
of motion pictures [2], or on a task-oriented level, such as
in supporting the early exploration of design ideas [3]. The
advantage of this system-guided approach is that it
facilitates the creation of attractive presentations by

Frequently asked questions

Q1. What contributions have the authors mentioned in the paper "Sample" ?

This paper presents a hypermedia generation model that lets the user influence all phases of this computer-assisted human-guided process. Like fully-automated systems, their approach uses explicit knowledge about the presentation 's topic domain, narrative structures, hypermedia presentation and distinctions between media modalities. This paper presents a motivating scenario that is used to derive a number of system requirements and to discuss the pros and cons of the presented approach. 

Q2. What are the future works in "Sample" ?

Future work will concentrate on the realization of internal processes for the specified framework. The possibility to enrich the system repository by storing successful presentations has to be integrated into the system. The proposed meta-data requirements will be verified according to their completeness. By doing that new relations between items can be discovered ( e. g. a subsection of the selected textual item describes a part of the image ). 

Q3. What is the main principle for all of SampLe’s stages?

A main principle for all of SampLe’s stages is the ability of the user to directly modify the output from one stage before it is input for transformationto the next. 

Q4. How can the user cancel the pre-selection of information objects?

The preselection of information objects based on their narrativestructure can be cancelled by switching off the option “Context search” on the top panel. 

Q5. What are the main tools used in the production of multimedia presentations?

The support in manual production comes mainly in form of productionenvironments such as Director, Premiere, Photoshop, Flash, FrontPage, PowerPoint and others. 

Q6. What is the purpose of the process?

The aim of the process is to provide engagingand relevant information by composing a multidimensional network of relationships between differentkinds of audio-visual information units. 

Q7. What is the advantage of this approach?

The advantage of this approach is that restrictions of the search include not only searching for media itemsaccording to their content but also implicit elimination of them with regard to their narrative structure (for example, due to the fact that Prologue usually contains abridged narrative structures, the choice should be for media items which contain summarized or short description about thesubject of interest). 

Q8. What is the structure of the media ontology?

In addition, since the system providesthe option of choosing between preferred media types of the objects to be retrieved, the authors require items to beannotated with concepts from the media ontology, which specifies external (e.g. painting) and internal (e.g. image)representations of objects and their format (e.g. jpg) 

Q9. What is the definition of a presentation structure?

A presentation structure consists of conceptual parts arranged within a top-level structure, such as Prologue, Elaboration, and Epilog. 

Q10. What is the common way of developing the narrative of essay?

The common way of developing the narrative of essay is to start with introducing the main character and related secondary characters (Prologue), then to elaborate on the main character’s major achievements including the rolesof the secondary characters (Elaboration), and conclude with outlining the significance of the main character’s achievements and their influences on futuredevelopments (Epilog). 

Q11. What is the system's requirement for putting the overview before the text?

The system needs rules that cansuggest a coherent ordering of material based on the media items' meta-data and the presentation structure.