Improved speech understanding in cocktail party scenarios through neuro-steered hearing prostheses
From 01-01-2018 to 31-12-2021
Description
People with hearing impairment often have difficulties to understand speech in noisy environments, which is why hearing aids and cochlear implants are usually equipped with speech enhancement algorithms to suppress background noise. However, in so-called ‘cocktail party’ scenarios where multiple speakers talk simultaneously, a fundamental problem appears: how can the algorithm decide which speaker the listener aims to attend to, and which speaker(s) should be treated as noise?
The goal of this project is to infer auditory attention from the neural activity of the listener, based on electroencephalography (EEG). We will fuse EEG signals with audio signals recorded by a hearing aid’s microphone array and analyze them jointly in a multimodal framework to perform auditory attention detection (AAD), and to control a speech enhancement algorithm to extract the attended speaker while suppressing interfering speakers and noise. In addition to the signal processing algorithm design, we will perform audiological experiments to identify the boundary conditions in which such a system can operate, and to investigate how the listening conditions influence attention-related neural markers, in particular for hearing-impaired subjects. Using a real-time closed-loop setup we will also investigate neural feedback effects. The ultimate goal is to design a real-time neuro-steered speech enhancement algorithm where the user can switch between multiple speakers by merely attending to one of them.
Team
- Tom Francart, Promoter
- Alexander Bertrand, Promoter
Financing
Funding: FWO - Research Foundation - Flanders
Program/Grant Type: FWO Project - FWO Research Project
Events
2/09/2024:
PhD defense - Martijn Oldenhof
Machine Learning for Advanced Chemical Analysis and Structure Recognition in Drug Discovery
3/09/2024:
Meet the Jury Igor Tetko on Advanced Machine Learning in Drug Discovery
12/09/2024:
Multimodal analysis of cell-free DNA for sensitive cancer detection in low-coverage and low-sample settings
Seminar by Antoine Passemiers
News
STADIUS Alumni Herman Verrelst – new CEO of Biocartis
08 June 2017
Herman Verrelst, the founder of KU Leuven spin-off Cartagenia, who has been working in Silicon Valley, US for the last few years will be returning to Belgium to follow the steps of Rudi Pauwels as CEO of the Belgian diagnostic company, Biocartis.
Supporting healthcare policymaking via machine learning – batteries included!
29 May 2017
STADIUS takes the lead in the data analytics efforts in an ambitious European Project MIDAS.
Marc Claesen gives an interview about his PhD for the magazine of the Faculty of Engineering Sciences "Geniaal"
10 February 2017
Did you know that in Belgium approximately one third of type 2 diabetes patients are unaware of their condition?
Joos Vandewalle is nieuwe voorzitter KVAB
09 October 2016
Op 5 oktober 2016 heeft de Algemene Vergadering van de Academie KVAB Joos Vandewalle verkozen tot voorzitter van de KVAB.