liu.seSearch for publications in DiVA
Change search
ReferencesLink to record
Permanent link

Direct link
The Role of Visual Speech Information in Supporting Perceptual Learning of Degraded Speech
Queens University, Canada .
Linköping University, Department of Behavioural Sciences and Learning, Disability Research. Linköping University, Faculty of Arts and Sciences.ORCID iD: 0000-0002-7810-1333
2012 (English)In: Journal of experimental psychology. Applied, ISSN 1076-898X, E-ISSN 1939-2192, Vol. 18, no 4, 419-435 p.Article in journal (Refereed) Published
Abstract [en]

Following cochlear implantation, hearing-impaired listeners must adapt to speech as heard through their prosthesis. Visual speech information (VSI; the lip and facial movements of speech) is typically available in everyday conversation. Here, we investigate whether learning to understand a popular auditory simulation of speech as transduced by a cochlear implant (noise-vocoded [NV] speech) is enhanced by the provision of VSI. Experiment 1 demonstrates that provision of VSI concurrently with a clear auditory form of an utterance as feedback after each NV utterance during training does not enhance learning over clear auditory feedback alone, suggesting that VSI does not play a special role in retuning of perceptual representations of speech. Experiment 2 demonstrates that provision of VSI concurrently with NV speech (a simulation of typical real-world experience) facilitates perceptual learning of NV speech, but only when an NV-only repetition of each utterance is presented after the composite NV/VSI form during training. Experiment 3 shows that this more efficient learning of NV speech is probably due to the additional listening effort required to comprehend the utterance when clear feedback is never provided and is not specifically due to the provision of VSI. Our results suggest that rehabilitation after cochlear implantation does not necessarily require naturalistic audiovisual input, but may be most effective when (a) training utterances are relatively intelligible (approximately 85% of words reported correctly during effortful listening), and (b) the individual has the opportunity to map what they know of an utterances linguistic content onto the degraded form.

Place, publisher, year, edition, pages
American Psychological Association (APA), 2012. Vol. 18, no 4, 419-435 p.
Keyword [en]
speech perception, cochlear implant rehabilitation, listening effort, cross-modal integration, audiovisual speech
National Category
Engineering and Technology
URN: urn:nbn:se:liu:diva-88370DOI: 10.1037/a0031042ISI: 000312919800007OAI: diva2:602872
Available from: 2013-02-04 Created: 2013-02-04 Last updated: 2015-04-16

Open Access in DiVA

No full text

Other links

Publisher's full text

Search in DiVA

By author/editor
Johnsrude, Ingrid S.
By organisation
Disability ResearchFaculty of Arts and Sciences
In the same journal
Journal of experimental psychology. Applied
Engineering and Technology

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Altmetric score

Total: 56 hits
ReferencesLink to record
Permanent link

Direct link