liu.seSearch for publications in DiVA
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Improving EEG-based decoding of the locus of auditory attention through domain adaptation
Linköping University, Department of Electrical Engineering, Automatic Control. Linköping University, Faculty of Science & Engineering.
Lund Univ, Sweden.
Lund Univ, Sweden.
Linköping University, Department of Electrical Engineering, Automatic Control. Linköping University, Faculty of Science & Engineering. Oticon AS, Denmark.ORCID iD: 0000-0001-9183-3427
Show others and affiliations
2023 (English)In: Journal of Neural Engineering, ISSN 1741-2560, E-ISSN 1741-2552, Vol. 20, no 6, article id 066022Article in journal (Refereed) Published
Abstract [en]

Objective. This paper presents a novel domain adaptation (DA) framework to enhance the accuracy of electroencephalography (EEG)-based auditory attention classification, specifically for classifying the direction (left or right) of attended speech. The framework aims to improve the performances for subjects with initially low classification accuracy, overcoming challenges posed by instrumental and human factors. Limited dataset size, variations in EEG data quality due to factors such as noise, electrode misplacement or subjects, and the need for generalization across different trials, conditions and subjects necessitate the use of DA methods. By leveraging DA methods, the framework can learn from one EEG dataset and adapt to another, potentially resulting in more reliable and robust classification models. Approach. This paper focuses on investigating a DA method, based on parallel transport, for addressing the auditory attention classification problem. The EEG data utilized in this study originates from an experiment where subjects were instructed to selectively attend to one of the two spatially separated voices presented simultaneously. Main results. Significant improvement in classification accuracy was observed when poor data from one subject was transported to the domain of good data from different subjects, as compared to the baseline. The mean classification accuracy for subjects with poor data increased from 45.84% to 67.92%. Specifically, the highest achieved classification accuracy from one subject reached 83.33%, a substantial increase from the baseline accuracy of 43.33%. Significance. The findings of our study demonstrate the improved classification performances achieved through the implementation of DA methods. This brings us a step closer to leveraging EEG in neuro-steered hearing devices.

Place, publisher, year, edition, pages
IOP Publishing Ltd , 2023. Vol. 20, no 6, article id 066022
Keywords [en]
auditory attention classification; parallel transport; domain adaptation; EEG; transfer learning; locus of attention
National Category
Biomedical Laboratory Science/Technology
Identifiers
URN: urn:nbn:se:liu:diva-200034DOI: 10.1088/1741-2552/ad0e7bISI: 001119479500001PubMedID: 37988748OAI: oai:DiVA.org:liu-200034DiVA, id: diva2:1827000
Note

Funding Agencies|ELLIIT Strategic Research Area

Available from: 2024-01-12 Created: 2024-01-12 Last updated: 2024-04-15
In thesis
1. Exploring Auditory Attention Using EEG
Open this publication in new window or tab >>Exploring Auditory Attention Using EEG
2024 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]

Listeners with normal-hearing often overlook their ability to comprehend speech in noisy environments effortlessly. Our brain’s adeptness at identifying and amplifying attended voices while suppressing unwanted background noise, known as the cocktail party problem, has been extensively researched for decades. Yet, many aspects of this complex puzzle remain unsolved and listeners with hearing-impairment still struggle to focus on a specific speaker in noisy environments. While recent intelligent hearing aids have improved noise suppression, the problem of deciding which speaker to enhance remains unsolved, leading to discomfort for many hearing aid users in noisy environments.

In this thesis, we explore the complexities of the human brain in challenging auditory environments. Two datasets are investigated where participants were tasked to selectively attend to one of two competing voices, replicating a cocktail-party scenario. The auditory stimuli trigger neurons to generate electrical signals that propagate in all directions. When a substantial number of neurons fire simultaneously, their collective electrical signal becomes detectable by small electrodes placed on the head. This method of measuring brain activity, known as electroencephalography (EEG), holds potential to provide feedback to the hearing aids, enabling adjustments to enhance attended voice(s).

EEG data is often noisy, incorporating neural responses with artifacts such as muscle movements, eye blinks and heartbeats. In the first contribution of this thesis, we focus on comparing different manual and automatic artifact-rejection techniques and assessing their impact on auditory attention decoding (AAD).

While EEG measurements offer high temporal accuracy, spatial resolution is inferior compared to alternative tools like magnetoencephalography (MEG). This difference poses a considerable challenge for source localization with EEG data. In the second contribution of this thesis, we demonstrate anticipated activity in the auditory cortex using EEG data from a single listener, employing Neuro-Current Response Functions (NCRFs). This method, previously evaluated only with MEG data, holds significant promise in hearing aid development.

EEG data may involve both linear and nonlinear components due to the propagation of the electrical signals through brain tissue, skull, and scalp with varying conductivities. In the third contribution, we aim to enhance source localization by introducing a binning-based nonlinear detection and compensation method. The results suggest that compensating for some nonlinear components produces more precise and synchronized source localization compared to original EEG data.

In the fourth contribution, we present a novel domain adaptation framework that improves AAD performances for listeners with initially low classification accuracy. This framework focuses on classifying the direction (left or right) of attended speech and shows a significant accuracy improvement when transporting poor data from one listener to the domain of good data from different listeners.

Taken together, the contributions of this thesis hold promise for improving the lives of hearing-impaired individuals by closing the loop between the brain and hearing aids.

Place, publisher, year, edition, pages
Linköping: Linköping University Electronic Press, 2024. p. 42
Series
Linköping Studies in Science and Technology. Licentiate Thesis, ISSN 0280-7971 ; 1993
National Category
Signal Processing
Identifiers
urn:nbn:se:liu:diva-202438 (URN)10.3384/9789180756327 (DOI)9789180756310 (ISBN)9789180756327 (ISBN)
Presentation
2024-05-16, Ada Lovelace, B Building, Campus Valla, Linköping, 13:15 (English)
Opponent
Supervisors
Available from: 2024-04-15 Created: 2024-04-15 Last updated: 2024-04-15Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textPubMed

Search in DiVA

By author/editor
Wilroth, JohannaSkoglund, MartinAlickovic, Emina
By organisation
Automatic ControlFaculty of Science & Engineering
In the same journal
Journal of Neural Engineering
Biomedical Laboratory Science/Technology

Search outside of DiVA

GoogleGoogle Scholar

doi
pubmed
urn-nbn

Altmetric score

doi
pubmed
urn-nbn
Total: 84 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf