liu.seSearch for publications in DiVA
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Speech-reading of synthetic and natural faces: Contextual cueing and mode of presentation
Linköping University, Department of Behavioural Sciences. Linköping University, Faculty of Arts and Sciences.
Linköping University, Department of Behavioural Sciences and Learning. Linköping University, Faculty of Arts and Sciences. Östergötlands Läns Landsting, Reconstruction Centre, Department of ENT - Head and Neck Surgery UHL.
2001 (English)In: Scandinavian Audiology, ISSN 0105-0397, Vol. 30, no 2, 89-94 p.Article in journal (Refereed) Published
Abstract [en]

A natural and a synthetic face were compared with regard to speechreading performance, with a visual and an audio-visual condition, and with three levels of contextual cueing in an experiment with 90 normal-hearing subjects. Auditory presentation (speech in noise) served as a control condition. The results showed main effects for type of face, presentation mode and contextual cueing, and also an interaction between presentation mode and type of face, such that performance was superior for the natural compared with the synthetic face, and especially in the audio-visual mode. Audiovisual speech-reading was more accurate than visual and auditory presentation and contextual cueing improved performance overall. It is suggested that a synthetic face can be a valuable and useful support if proper cueing and an auditory signal are provided, but it is outperformed by a natural face with regard to complementarity to an underspecified auditory speech signal.

Place, publisher, year, edition, pages
2001. Vol. 30, no 2, 89-94 p.
Keyword [en]
DEAF -- Means of communication, SPEECH perception, HEARING, AUDITORY perception, VISUAL perception
National Category
Social Sciences
Identifiers
URN: urn:nbn:se:liu:diva-13826DOI: 10.1080/010503901300112194OAI: oai:DiVA.org:liu-13826DiVA: diva2:21774
Note
Scandinavian Audiolog has now merged with International Journal of Audiology (as from 2002). Available from: 2006-05-03 Created: 2006-05-03 Last updated: 2009-08-19
In thesis
1. Semantic Framing of Speech: Emotional and Topical Cues in Perception of Poorly Specified Speech
Open this publication in new window or tab >>Semantic Framing of Speech: Emotional and Topical Cues in Perception of Poorly Specified Speech
2003 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

The general aim of this thesis was to test the effects of paralinguistic (emotional) and prior contextual (topical) cues on perception of poorly specified visual, auditory, and audiovisual speech. The specific purposes were to (1) examine if facially displayed emotions can facilitate speechreading performance; (2) to study the mechanism for such facilitation; (3) to map information-processing factors that are involved in processing of poorly specified speech; and (4) to present a comprehensive conceptual framework for speech perception, with specification of the signal being considered. Experi¬mental and correlational designs were used, and 399 normal-hearing adults participated in seven experiments. The main conclusions are summarised as follows. (a) Speechreading can be facilitated by paralinguistic information as constituted by facial displayed emotions. (b) The facilitatory effect of emitted emotional cues is mediated by their degree of specification in transmission and ambiguity as percepts; and by how distinct the perceived emotions combined with topical cues are as cues for lexical access. (c) The facially displayed emotions affect speech perception by conveying semantic cues; no effect via enhanced articulatory distinctiveness, nor of emotion-related state in the perceiver is needed for facilitation. (d) The combined findings suggest that emotional and topical cues provide constraints for activation spreading in the lexicon. (e) Both bottom-up and top-down factors are associated with perception of poorly specified speech, indicating that variation in information-processing abilities is a crucial factor for perception if there is paucity in sensory input. A conceptual framework for speech perception, comprising specification of the linguistic and paralinguistic information, as well as distinctiveness of primes, is presented. Generalisations of the findings to other forms of paralanguage and language processing are discussed.

Place, publisher, year, edition, pages
Linköping: Linköping University Electronic Press, 2003. 74 p.
Series
Linköping Studies in Education and Psychology, ISSN 1102-7517 ; 94
Keyword
Speech perception, speechreading, facial expressions, priming, phonemes, semantics, lipreading, auditory perception, cognition, paralinguistics, emotional content, Läppavläsning
National Category
Psychology
Identifiers
urn:nbn:se:liu:diva-6344 (URN)91-7373-754-2 (ISBN)
Public defence
2003-10-31, Eklundska salen, Hus Ingvar, Campus Valla, Linköpings universitet, Linköping, 13:00 (English)
Opponent
Supervisors
Available from: 2006-05-03 Created: 2006-05-03 Last updated: 2014-09-02Bibliographically approved

Open Access in DiVA

No full text

Other links

Publisher's full textLink to Ph.D. Thesis

Authority records BETA

Lidestam, BjörnLyxell, Björn

Search in DiVA

By author/editor
Lidestam, BjörnLyxell, Björn
By organisation
Department of Behavioural SciencesFaculty of Arts and SciencesDepartment of Behavioural Sciences and LearningDepartment of ENT - Head and Neck Surgery UHL
Social Sciences

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 124 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf