Showing papers by "Jean-Claude Martin published in 2002"

Annotating and Measuring Multimodal Behaviour – Tycoon Metrics in the Anvil Tool

Abstract: We demonstrate how the Tycoon framework can be put to practice with the Anvil tool in a concrete case study. Tycoon offers a coding scheme and analysis metrics for multimodal communication scenarios. Anvil is a generic, extensible and ergonomically designed annotation tool for videos. In this paper, we describe the Anvil tool, the Tycoon scheme/metrics, and their implementation in Anvil for a video sample. A new Anvil feature, motivated by the Tycoon scheme, is presented: non-temporal annotation objects – an important concept, we argue, of general interest. We also outline future plans for automatizing Tycoon metrics computation using Anvil plug-ins.

On the use of the multimodal clues in human behaviour for the modelling of agent co-operative behaviour

Abstract: Although there are different definitions of autonomous agents, one of their features should probably be the flexibility of choice an autonomous agent should have on how and with which other agents it should co-operate. The TYCOON framework is introduced for studying co-operation between agents. The framework includes on one hand a typology including six types of co-operation between agents (transfer, equivalence, specialization, redundancy, 'complementarity' and concurrency), and on the other hand the associate algorithms for computing metrics of co-operative behaviour. It is described how the framework can be applied to two different problem-solving tasks: a simple variable binding task and a more complex multimodal collective presentation task. I believe that these TYCOON low-level specifications of co-operation between agents might be useful as building blocks for bridging the gap between experimental human behaviour analysis and the modelling of higher-level co-operation-related attitudes related to a...

Multimodal and Adaptative Pedagogical Resources

Abstract: When interacting with students, teachers usually combine several communication modalities (speech, hand gestures, gaze, posture, facial expression, graphics on a blackboard, slides...) and have to adapt their communication to the lecture settings (computer knowledge of the students, duration of the lecture...). Although educational resources and intelligent tutoring systems are developing, they are seldom being used as language resources per se, nor based on real-world pedagogical recording. Even in the field of pedagogical agents where a graphical persona is used as a complementary means of communication, the multimodal and adaptative behaviour of the graphical agent is often based on general knowledge about communication studies rather than on the annotation of pedagogical behaviour observed in video corpora. In this paper, we describe how an educational video corpus is being collected and how it is planned to be used for improving the existing on-line tutorial with multimodal and adaptative hypermedia features. Yet, students come from very heterogeneous places regarding technological, but also cultural and linguistic level.