liu.seSearch for publications in DiVA
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
A "happy" approach to speechreading: the effects of facial expression, emotional content, and script information on speechreading performance
Linköping University, Department of Education and Psychology. Linköping University, Faculty of Educational Sciences. Univ.,.
1998 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

The aim of the present thesis was to study if and how emotions in facial expressions affect speechreading performance. Speechreading is the understanding of spoken messages by watching the speaker's lips, taking facial expressions and situational cues into account. The content of the spoken message and knowledge about the situation where these messages belong (i.e., the script) were also studied. It was shown, in four studies, that congruence between the script and the content of the sentence, and congruence between the content of the sentence and the facial expression, enhanced speechreading performance. It was also shown that a happy facial expression improved speechreading performance. This was found in a happy script but also when the script was neutral and when no script information was presented. The implications from the studies were discussed in relation to current speech perception models. A framework for visual speechreading of emotional sentences was presented. The framework consists of three parallel streams of information processing, a script stream, an emotional content stream and a facial expression stream. Two processes, a perceptual analysis of the lip movements and an on-going checking process of the script and the facial expression are also part of the framework. If the perceptual analysis fits with the facial expression, the emotional signal, and the knowledge activated from the script, comprehension is optimized and the speechreading is successful.

Place, publisher, year, edition, pages
Linköping: Linköpings universitet , 1998. , p. 83
Series
Linköping Studies in Education and Psychology, ISSN 1102-7517 ; 57
National Category
Educational Sciences Pedagogy
Identifiers
URN: urn:nbn:se:liu:diva-143151Local ID: LIU-IPP-STU--57--SEISBN: 9172192283 (print)OAI: oai:DiVA.org:liu-143151DiVA, id: diva2:1159260
Public defence
1998-06-12, Eklundska salen (I:101), Campus Valla, Linköping, 10:00 (Swedish)
Available from: 2017-11-22 Created: 2017-11-22 Last updated: 2025-02-18Bibliographically approved

Open Access in DiVA

No full text in DiVA

By organisation
Department of Education and PsychologyFaculty of Educational Sciences
Educational SciencesPedagogy

Search outside of DiVA

GoogleGoogle Scholar

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 204 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf