Laurence Nigay

Bio: Laurence Nigay is an academic researcher from University of Grenoble. The author has contributed to research in topics: Multimodal interaction & Augmented reality. The author has an hindex of 32, co-authored 184 publications receiving 3899 citations. Previous affiliations of Laurence Nigay include University of Glasgow & Joseph Fourier University.

A design space for multimodal systems: concurrent processing and data fusion

Abstract: Multimodal interaction enables the user to employ different modalities such as voice, gesture and typing for communicating with a computer. This paper presents an analysis of the integration of multiple communication modalities within an interactive system. To do so, a software engineering perspective is adopted. First, the notion of “multimodal system” is clarified. We aim at proving that two main features of a multimodal system are the concurrency of processing and the fusion of input/output data. On the basis of these two features, we then propose a design space and a method for classifying multimodal systems. In the last section, we present a software architecture model of multimodal systems which supports these two salient properties: concurrency of processing and data fusion. Two multimodal systems developed in our team, VoicePaint and NoteBook, are used to illustrate the discussion.

Four Easy Pieces for Assessing the Usability of Multimodal Interaction: The Care Properties

Abstract: We propose the CARE properties as a simple way of characterising and assessing aspects of multimodal interaction: the Complementarity, Assignment, Redundancy, and Equivalence that may occur between the interaction techniques available in a multimodal user interface. We provide a formal definition of these properties and use the notion of compatibility to show how the system CARE properties interact with user CARE-like properties in the design of a system. The discussion is illustrated with MATIS, a Multimodal Air Travel Information System.

A generic platform for addressing the multimodal challenge

Abstract: Multimodal interactive systems support multiple interaction techniques such as the synergistic use of speech and direct manipulation. The flexibility they offer results in an increased complexity that current software tools do not address appropriately. One of the emerging technical problems in multimodal interaction is concerned with the fusion of information produced through distinct interaction techniques. In this article, we present a generic fusion engine that can be embedded in a multi-agent architecture modelling technique. We demonstrate the fruitful symbiosis of our fusion mechanism with PAC-Amodeus, our agentbased conceptual model, and illustrate the applicability of the approach with the implementation of an effective interactive system: MATIS, a Multimodal Airline Travel Information System.

From single-user architectural design to PAC*: a generic software architecture model for CSCW

Abstract: This article nqmts our tiection on softsvam amhiteetm modelling for multi-user systems (or groupware).Fi~ w introduce t.k notion of software architecture and make explieit the design steps that most sofl-wam designm in HCI tend to blend in a fizzy way. Building on general concepts and pmetiee fmm main stream soikm engineering, we then present a comparative analysis of the most signifhnt architecture models developed for singleand multi-user systems. We close with the pmentation d PAC*, a new arehitectuml fmmwodc for modelling and designing the sdsvare amhitectm of multi-user systems. PAC* is a motivated combination of existing anAiteetuml models seleeted for the complementarily of their “good properties”. These include operational heuristics such as rules for deriving agents in accordance to the task model or criteria for reasoning about replication as well as properties such as support for style heterogeneity, portability, and reusability.

Clover architecture for groupware

Abstract: In this paper we present the Clover architectural model, a new conceptual architectural model for groupware. Our model results from the combination of the layer approach of Dewan's generic architecture with the functional decomposition of the Clover design model. The Clover design model defines three classes of services that a groupware application may support, namely, production, communication and coordination services. The three classes of services can be found in each functional layer of our model. Our model is illustrated with a working system, the CoVitesse system, its software being organized according to our Clover architectural model.

Graph visualization and navigation in information visualization: A survey

Abstract: This is a survey on graph visualization and navigation techniques, as used in information visualization. Graphs appear in numerous applications such as Web browsing, state-transition diagrams, and data structures. The ability to visualize and to navigate in these potentially large, abstract graphs is often a crucial part of an application. Information visualization has specific requirements, which means that this survey approaches the results of traditional graph drawing from a different perspective.

Intuitive computing methods and systems

Abstract: A smart phone senses audio, imagery, and/or other stimulus from a user's environment, and acts autonomously to fulfill inferred or anticipated user desires. In one aspect, the detailed technology concerns phone-based cognition of a scene viewed by the phone's camera. The image processing tasks applied to the scene can be selected from among various alternatives by reference to resource costs, resource constraints, other stimulus information (e.g., audio), task substitutability, etc. The phone can apply more or less resources to an image processing task depending on how successfully the task is proceeding, or based on the user's apparent interest in the task. In some arrangements, data may be referred to the cloud for analysis, or for gleaning. Cognition, and identification of appropriate device response(s), can be aided by collateral information, such as context. A great number of other features and arrangements are also detailed.