Viseme

About: Viseme is a research topic. Over the lifetime, 865 publications have been published within this topic receiving 17889 citations.

Speech recognition method and speech recognition device

Abstract: A speech recognition device controls one or a plurality of pieces of equipment by speech recognition and is characterized by being provided with: a speech acquisition unit that acquires speech information showing speech uttered by a user; a speech recognition processing unit that recognizes, as character information, speech information acquired by the speech acquisition unit; and a recognition result determination unit that determines whether or not an utterance is to the equipment on the basis of the character information recognized by the speech recognition processing unit.

An Approach to Speech Driven Animation

Abstract: In the manufacture of Japanese style anime the movement of lip with speech is usually shortened to the more convenient 'open' and 'close' of mouth because of the expensive production cost. In this paper we provide an approach to deal with speech driven lip animation for Japanese style anime. First we discuss the previous work of digital speech signal processing and show how to apply the existing speech processing techniques into our work. Then we propose our algorithms of speech driven lip motion animation. Finally the experiment results will be provided.

SIVHA, visual speech synthesis system.

Abstract: This paper presents SIVHA, a high quality Spanish speech synthesis system for severe disabled persons controlled by their eye movements. The system follows the eye-gaze of the patients along the screen and constructs the text with the selected words. When the user considers that the construction of the message has been finished, the synthesis of the message can be ordered. The system is divided in three modules. The first one determines the point of the screen the user is looking at, the second one is an interface to construct the sentences and the third one is the synthesis itself.

Medical electronics III: Rhythmic cues aid lip readers: Through knowledge of the frequency and intensity characteristics of syllables, the deaf can learn to relate speech with text

Abstract: Describes a speech text synchroniser that is intended to teach the deaf a knowledge of the frequency and intensity characteristics of syllables so that they can relate speech to text thus allowing them to make sense of an otherwise confusing lip reading.

3D realistic talking face co-driven by text and speech

Abstract: To create 3D realistic talking face has been a challenge for a long time. Previous works emphasize text or speech driven talking face respectively while the animation result is not very realistic or natural-looking. In the proposed approach, text and speech are considered to drive the 3D talkingface coordinately. The text is translated into a sequence of visemes' transcription. And time vector of the sequence is extracted from the speech corresponding to the text after it is segmented into phonetic sequence. A muscle based viseme vector is defined for static viseme. And then, with the time vector and the static visemes's sequence, dynamic visemes are generated through time-related dominance function. Finally, according to the frame rate to be rendered, intermediate frames are interpolated between key frames to make the animation result looks more natural and realistic than those obtained based on the text or speech-driven only.