liu.seSearch for publications in DiVA
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Facial expressions and speechreading performance
Linköping University, Department of Behavioural Sciences and Learning. Linköping University, Faculty of Arts and Sciences. Östergötlands Läns Landsting, Reconstruction Centre, Department of ENT - Head and Neck Surgery UHL.
Linköping University, The Tema Institute.
Linköping University, Department of Behavioural Sciences. Linköping University, Faculty of Arts and Sciences.
Linköping University, The Swedish Institute for Disability Research. Linköping University, Department of Behavioural Sciences and Learning, Disability Research. Linköping University, Faculty of Arts and Sciences.
1996 (English)In: Scandinavian Audiology, ISSN 0105-0397, Vol. 25, no 2, 97-102 p.Article in journal (Refereed) Published
Abstract [en]

In the present study, the role of facial expressions in visual speechreading (lipreading) was examined. Speechreading was assessed by three different tests: sentence-based speechreading, word-decoding, and word discrimination. Twenty-seven individuals participated as subjects in the study. The results revealed that no general improvement as a function of expression was obtained across all tests. Nevertheless, skilled speechreaders could significantly improve their performance as a function of emotional expression in the word-decoding and word-discrimination conditions. Furthermore, a correlational analysis indicated that there was a significant relationship between the subjects' rating of confidence regarding their responses to each test-item and performance on speechreading tests where lexical analysis is a necessary task-demand. The results are discussed with respect to how information from facial expressions is integrated with the information given by the lip movements in visual speechreading, and also with respect to general models of face-processing (i.e., Bruce ↦ Young. 1986; Young ↦ Bruce. 1991).

Place, publisher, year, edition, pages
1996. Vol. 25, no 2, 97-102 p.
Keyword [en]
Facial expressions, skill, speechreading
National Category
Social Sciences
Identifiers
URN: urn:nbn:se:liu:diva-13824DOI: 10.3109/01050399609047990OAI: oai:DiVA.org:liu-13824DiVA: diva2:21772
Available from: 2006-05-03 Created: 2006-05-03 Last updated: 2009-08-19
In thesis
1. Semantic Framing of Speech: Emotional and Topical Cues in Perception of Poorly Specified Speech
Open this publication in new window or tab >>Semantic Framing of Speech: Emotional and Topical Cues in Perception of Poorly Specified Speech
2003 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

The general aim of this thesis was to test the effects of paralinguistic (emotional) and prior contextual (topical) cues on perception of poorly specified visual, auditory, and audiovisual speech. The specific purposes were to (1) examine if facially displayed emotions can facilitate speechreading performance; (2) to study the mechanism for such facilitation; (3) to map information-processing factors that are involved in processing of poorly specified speech; and (4) to present a comprehensive conceptual framework for speech perception, with specification of the signal being considered. Experi¬mental and correlational designs were used, and 399 normal-hearing adults participated in seven experiments. The main conclusions are summarised as follows. (a) Speechreading can be facilitated by paralinguistic information as constituted by facial displayed emotions. (b) The facilitatory effect of emitted emotional cues is mediated by their degree of specification in transmission and ambiguity as percepts; and by how distinct the perceived emotions combined with topical cues are as cues for lexical access. (c) The facially displayed emotions affect speech perception by conveying semantic cues; no effect via enhanced articulatory distinctiveness, nor of emotion-related state in the perceiver is needed for facilitation. (d) The combined findings suggest that emotional and topical cues provide constraints for activation spreading in the lexicon. (e) Both bottom-up and top-down factors are associated with perception of poorly specified speech, indicating that variation in information-processing abilities is a crucial factor for perception if there is paucity in sensory input. A conceptual framework for speech perception, comprising specification of the linguistic and paralinguistic information, as well as distinctiveness of primes, is presented. Generalisations of the findings to other forms of paralanguage and language processing are discussed.

Place, publisher, year, edition, pages
Linköping: Linköping University Electronic Press, 2003. 74 p.
Series
Linköping Studies in Education and Psychology, ISSN 1102-7517 ; 94
Keyword
Speech perception, speechreading, facial expressions, priming, phonemes, semantics, lipreading, auditory perception, cognition, paralinguistics, emotional content, Läppavläsning
National Category
Psychology
Identifiers
urn:nbn:se:liu:diva-6344 (URN)91-7373-754-2 (ISBN)
Public defence
2003-10-31, Eklundska salen, Hus Ingvar, Campus Valla, Linköpings universitet, Linköping, 13:00 (English)
Opponent
Supervisors
Available from: 2006-05-03 Created: 2006-05-03 Last updated: 2014-09-02Bibliographically approved

Open Access in DiVA

No full text

Other links

Publisher's full textLink to Ph.D. Thesis

Authority records BETA

Lyxell, BjörnJohansson, KarinaLidestam, BjörnRönnberg, Jerker

Search in DiVA

By author/editor
Lyxell, BjörnJohansson, KarinaLidestam, BjörnRönnberg, Jerker
By organisation
Department of Behavioural Sciences and LearningFaculty of Arts and SciencesDepartment of ENT - Head and Neck Surgery UHLThe Tema InstituteDepartment of Behavioural SciencesThe Swedish Institute for Disability ResearchDisability Research
Social Sciences

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 212 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf