Journal ArticleDOI
Real-time language independent lip synchronization method using a genetic algorithm
Goranka Zoric,Igor S. Pandžić +1 more
Reads0
Chats0
TLDR
This work presents an implementation of real time, language independent lip synchronization based on the classification of the speech signal into visemes using neural networks (NNs), and improves real time lip synchronization by using a genetic algorithm for obtaining a near optimal NN topology.About:
This article is published in Signal Processing.The article was published on 2006-12-01. It has received 17 citations till now. The article focuses on the topics: Viseme & Synchronization.read more
Citations
More filters
Journal ArticleDOI
Genetic Algorithm-Neural Network (GANN): a study of neural network activation functions and depth of genetic algorithm search applied to feature selection
Dong Ling Tong,Robert Mintram +1 more
TL;DR: Results suggest that the hyperbolic tangent (tanh) activation function outperforms other common activation functions by extracting a smaller, but more significant feature set in the ANN architecture by extracting optimum feature selection capability.
Proceedings ArticleDOI
A comprehensive audio-visual corpus for teaching sound Persian phoneme articulation
TL;DR: This paper gives an indication of the collected Persian audio-visual data corpus (AVA), a comprehensive, systematic collection of both continuous speech and isolated spoken utterances in Persian language.
Journal ArticleDOI
Toward a multi-culture adaptive virtual tour guide agent with a modular approach
TL;DR: Preliminary results from the development of a culture-adaptive virtual tour guide agent for serving Japanese, Croatian, and general Western users by displaying appropriate verbal and non-verbal behaviors are presented.
Journal ArticleDOI
Real-Time Continuous Phoneme Recognition System Using Class-Dependent Tied-Mixture HMM With HBT Structure for Speech-Driven Lip-Sync
Junho Park,Hanseok Ko +1 more
TL;DR: The proposed method leads to a lip-sync system that performs at a level that is similar to previous designs based on HBT and continuous hidden Markov models (CHMMs), however, the method reduces the number of model parameters by one-third and enables real-time operation.
Proceedings Article
Architecture of an animation system for human characters
Tomislav Pejsa,Igor S. Pandzic +1 more
TL;DR: In this paper, the authors present visage|SDK, a framework for real-time character animation based on MPEG-4 FBA standard that offers a wide spectrum of features that includes animation playback, lip synchronization and facial motion tracking.
References
More filters
Book
Neural Networks: A Systematic Introduction
TL;DR: The authors may not be able to make you love reading, but neural networks a systematic introduction will lead you to love reading starting from now.
Proceedings ArticleDOI
Voice puppetry
TL;DR: A method for predicting a control signal from another related signal is introduced, and applied to voice puppetry: Generating full facial animation from expressive information in an audio track, suitable for driving many different kinds of animation ranging from video-realistic image warps to 3D cartoon characters.
Book
MPEG-4 Facial Animation: The Standard,Implementation and Applications
TL;DR: The Editors put the MPEG-4 FA standard against the historical background of research on facial animation and model-based coding, and provide a brief history of the development of the standard itself.
Journal ArticleDOI
Audio-visual integration in multimodal communication
Tsuhan Chen,R.R. Rao +1 more
TL;DR: This work reviews recent research that examines audio-visual integration in multimodal communication, including bimodality in human speech, human and automated lip reading, facial animation, lip synchronization, joint audio-video coding, andbimodal speaker verification.
Journal ArticleDOI
Automated lip-sync: Background and techniques
TL;DR: It is indicated that the automatic derivation of mouth movement from a speech soundtrack is a tractable problem and a common speech synthesis method, linear prediction, is adapted to provide simple and accurate phoneme recognition.