Journal ArticleDOI
JVoiceXML as a modality component in the W3C multimodal architecture
TLDR
This article describes the experiences integrating JVoiceXML into the W3C MMI architecture and identifies general limitations with regard to the available design space.Abstract:
Research regarding multimodal interaction led to a multitude of proposals for suitable software architectures. With all architectures describing multimodal systems differently, interoperability is severely hindered. The W3C MMI architecture is a proposed recommendation for a common architecture. In this article, we describe our experiences integrating JVoiceXML into the W3C MMI architecture and identify general limitations with regard to the available design space.read more
Citations
More filters
Workflow Management Coalition.
TL;DR: A process for expressing extracellular β-glucosidase in a filamentous fungus by expressing a fungal DNA sequence encoding enhanced, deleted or altered beta -glucose in a recombinant host microorganism is disclosed in this article.
Book
Readings in Intelligent User Interfaces
TL;DR: Introduction I: Multimedia Input Analysis II:Multimedia Presentation Design III: Automated Graphic Design IV): Automated Layout V: User and Discourse Modeling VI: Model Based Interfaces VII: Agent Interfaces VIII: Evaluation
Book
The Paradigm Shift to Multimodality in Contemporary Computer Interfaces
Sharon Oviatt,Philip R. Cohen +1 more
TL;DR: This book explains the foundation of human-centered multimodal interaction and interface design, based on the cognitive and neurosciences, as well as the major benefits of multi-modal interfaces for human cognition and performance.
Book ChapterDOI
Assembling the Jigsaw: How Multiple Open Standards Are Synergistically Combined in the HALEF Multimodal Dialog System
Vikram Ramanarayanan,David Suendermann-Oeft,Patrick Lange,Robert Mundkowsky,Alexei V. Ivanov,Zhou Yu,Yao Qian,Keelan Evanini +7 more
TL;DR: This chapter examines how an open-source, modular, multimodal dialog system—HALEF—can be seamlessly assembled, much like a jigsaw puzzle, by putting together multiple distributed components that are compliant with the W3C recommendations or other open industry standards.
Journal ArticleDOI
Extending multimedia languages to support multimodal user interactions
TL;DR: This paper proposes the integration of concepts from those two communities in a unique high-level programming framework that integrates user modalities —both user-generated and user-consumed — in declarative programming languages for the specification of interactive multimedia applications.
References
More filters
Proceedings ArticleDOI
“Put-that-there”: Voice and gesture at the graphics interface
TL;DR: The work described herein involves the user commanding simple shapes about a large-screen graphics display surface, and because voice can be augmented with simultaneous pointing, the free usage of pronouns becomes possible, with a corresponding gain in naturalness and economy of expression.
Journal ArticleDOI
Put-that-there
TL;DR: This research presents a probabilistic architecture that combines attention to the geometry of the input device and the response of the user to solve the challenge of speech-to-text translation.
Journal ArticleDOI
The open agent architecture: A framework for building distributed software systems
TL;DR: The Open Agent Architecture is structured so as to minimize the effort involved in creating new agents and "wrapping" legacy applications; to encourage the reuse of existing agents; and to allow for dynamism and flexibility in the makeup of agent communities.
Synchronized Multimedia Integration Language (SMIL) 2.0
TL;DR: The Synchronized Multimedia Integration Language (SMIL) 2.0 as discussed by the authors is the second version of SMIL, which allows authors to describe the temporal behavior of a multimedia presentation, associate hyperlinks with media objects and describe the layout of the presentation on a screen.
Book
Modeling Reactive Systems With Statecharts : The Statemate Approach
David Harel,M. Politi +1 more
TL;DR: This guide shows how to use these two synergistic languages of Statecharts to develop a conceptual model of the system, which can then be combined with a physical or structural model using the third language of Module-charts.