liu.seSearch for publications in DiVA
Change search
ReferencesLink to record
Permanent link

Direct link
Real Time Speech Driven Face Animation
Linköping University, Department of Electrical Engineering.
Linköping University, Department of Electrical Engineering.
2003 (English)Independent thesis Basic level (professional degree)Student thesisAlternative title
Talstyrd Ansiktsanimering i Realtid (Swedish)
Abstract [en]

The goal of this project is to implement a system to analyse an audio signal containing speech, and produce a classifcation of lip shape categories (visemes) in order to synchronize the lips of a computer generated face with the speech.

The thesis describes the work to derive a method that maps speech to lip move- ments, on an animated face model, in real time. The method is implemented in C++ on the PC/Windows platform. The program reads speech from pre-recorded audio files and continuously performs spectral analysis of the speech. Neural networks are used to classify the speech into a sequence of phonemes, and the corresponding visemes are shown on the screen.

Some time delay between input speech and the visualization could not be avoided, but the overall visual impression is that sound and animation are synchronized.

Place, publisher, year, edition, pages
Institutionen för systemteknik , 2003. , 50 p.
LiTH-ISY-Ex, 3389
Keyword [en]
Technology, phonemes, visemes, real-time, neural networks
Keyword [sv]
National Category
Engineering and Technology
URN: urn:nbn:se:liu:diva-2015OAI: diva2:19343
Available from: 2003-10-24 Created: 2003-10-24

Open Access in DiVA

fulltext(1388 kB)3653 downloads
File information
File name FULLTEXT01.pdfFile size 1388 kBChecksum SHA-1
Type fulltextMimetype application/pdf

By organisation
Department of Electrical Engineering
Engineering and Technology

Search outside of DiVA

GoogleGoogle Scholar
Total: 3653 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 1030 hits
ReferencesLink to record
Permanent link

Direct link