1. Spoken language input Ronald Cole, Victor Zue, Wayne Ward, Melvyn J. Hunt, Richard M. Stern, Renato De Mori, Fabio Brugnara, Salim Roukos, Sadaoki Furui and Patti Price 2. Written language input Joseph Mariani, Sargur N. Srihari, Rohini K. Srihari, Richard G. Casey, Abdel Belaid, Claudie Faure, Eric Lecolinet, Isabelle Guyo, Colin Warwick and Rejean Plamondon 3. Language analysis and understanding Annie Zaenen, Hans Uszkoreit, Fred Karlsson, Lauri Karttunen, Antonio Sanfilippo, Stephen F. Pulman, Fernando Pereira and Ted Briscoe 4. Language generation Hans Uszkoreit, Eduard Hovy, Gertjan van Noord, Gunter Neumann and John Bateman 5. Spoken output technologies Ronald Cole, Yoshinori Sagisaka, Christophe d'Alessandro, Jean-Sylvain Lienard, Richard Sproat, Kathleen R. McKeown and Johanna D. Moore 6. Discourse and dialogue Hans Uszkoreit, Barbara Grosz, Donia Scott, Hans Kamp, Phil Cohe and Egidio Giachin 7. Document processing Annie Zaenen, Per-Kristian Halvorsen, Donna Harman, Peter Schauble, Alan Smeaton, Paul Jacobs, Karen Sparck Jones, Robert Dale, Richard H. Wojcik and James E. Hoard 8. Multilinguality Annie Zaenen, Martin Kay, Christian Boitet, Christian Fluhr, Alexander Waibel, Yeshwant K. Muthusamy and A. Lawrence Spitz 9. Multimodality Joseph Mariani, James L. Flanagan, Gerard Ligozat, Wolfgang Wahlster, Yacine Bellik, Alan J. Goldschen, Christian Benoit, Dominic W. Massaro and Michael M. Cohen 10. Transmission and storage Victor Zue, Isabel Trancoso, Bishnu S. Atal, Nikil S. Jayant and Dirk Van Compernolle 11. Mathematical methods Ronald Cole, Hans Uszkoreit, Steve Levinson, John Makhoul, Aravind Joshi, Herve Bourlard, Nelson Morgan, Ronald M. Kaplan and John Bridle 12. Language resources Ronald Cole, Antonio Zampolli, Eva Ejerhed, Ken Church, Lori Lamel, Ralph Grishman, Nicoletta Calzolari, Christian Galinski and Gerhard Budin 13. Evaluation Joseph Mariani, Lynette Hirschman, Henry S. Thompson, Beth Sundheim, John Hutchins, Ezra Black, Margaret King, David S. Pallett, Adrian Fourcin, Louis C. W. Pols, Sharon Oviatt, Herman J. M. Steeneken and Junichi Kanai Glossary Citation index Index.

Survey of the State of the Art in Human Language Technology

After describing the importance of visual information in speech perception and sketching the history of visual speech synthesis, we consider a number of theories of coarticulation in human speech. An implementation of Lofqvist’s (1990) gestural theory of speech production is described for visual speech synthesis along with a description of the graphically controlled development system. We conclude with some plans for future work.

/pdf/modeling-coarticulation-in-synthetic-visual-speech-1w9dxjg5or.pdf

Modeling Coarticulation in Synthetic Visual Speech

Algorithms and methods are presented for animating the hands of a synthetic actor. The algorithms allow the land to move and grasp objects; they also compute deformations of the hand as it moves. The mapping of surfaces onto the skeleton is based on the concept of joint-dependent local deformation (JLD) operators, which are specific local deformation operators depending on the nature of the joints. The major problem in the hand covering process is the calculation of the coordinate bases. The key to the method was to find a model for calculating the bases which was sophisticated enough for the simulation of complex motions. Several examples are shown and the user interface introduced into the human factory system is also described

Joint-dependent local deformations for hand animation and object grasping

This paper describes interactive facilities for simulating abstract muscle actions using rational free form deformations (RFFD). The particular muscle action is simulated as the displacement of the control points of the control-unit for an RFFD defined on a region of interest. One or several simulated muscle actions constitute a minimum perceptible action (MPA), which is defined as the atomic action unit, similar to action unit (AU) of the facial action coding system (FACS), to build an expression

Simulation of Facial Muscle Actions Based on Rational Free Form Deformations

Artists study anatomy to understand the relationship between exterior form and the structures responsible for creating it. In this paper we follow a similar approach in developing anatomy-based models of muscles. We consider the influence of the musculature on surface form and develop muscle models which react automatically to changes in the posture of an underlying articulated skeleton. The models are implemented in a procedural language that provides convenient facilities for defining and manipulating articulated models. To illustrate their operation, the models are applied to the torso and arm of a human figure. However, they are sufficiently general to be applied in other contexts where articulated skeletons provide the basis of modeling. CR

/pdf/anatomy-based-modeling-of-the-human-musculature-53c16bz49w.pdf

Anatomy-based modeling of the human musculature

In this paper we describe how the use of B-Spline surfaces allows lissom movements of body and face. Our method is empirical, based on a parametrical animation. It can be combined with a muscles model for facial animation as we illustrated for the speech.

Michel Saintourens

Papers

Animation of a B-Spline figure

Creation of a synthetic face speaking in real time with a synthetic voice.