EEG-based Auditory Attention Detection with Estimated Speech Sources Separated from an Ideal-binary-masking Process

Lei Wang; Fei Chen

10.23919/APSIPAASC55919.2022.9980112

2022

14th Annual Summit and Conference of the Asia-Pacific-Signal-and-Information-Processing-Association (APSIPA ASC)

2640-009X

978-1-6654-8662-0

2022 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC)

1545-1549

7-10 Nov. 2022

Chiang Mai, Thailand

345 E 47TH ST, NEW YORK, NY 10017 USA

IEEE

Previous studies showed that auditory attention can be decoded from the corresponding electroencephalography (EEG) signals. Most existing EEG-based auditory attention detection (AAD) methods identify target speech in the competing-speaker scenes by comparing the correlation coefficients between the speech envelope of each clean stream and the speech envelope reconstructed from the EEG signals. The usage of separate speech streams limits the actualization of EEG-based AAD in the realistic environments. The current study aimed to develop and assess an EEG-based AAD method using the estimated speech sources separated from an ideal-binary-masking (IBM) process. Specially, the IBM-based speech processing method was first implemented to separate the speech sources in the competing-speaker scenes. Then the estimated IBM-processed speech sources were used to establish the AAD model and extract the target speech stream. Experimental results demonstrated that the AAD accuracies computed with the estimated IBM-processed speech sources were comparable to those with original clean speech sources over a range of signal-to-masker ratios. These findings indicate that the estimated IBM-processed speech sources provide necessary and sufficient information for the EEG-based AAD methods, which facilitate the extraction of attention-driven target speech streams in noisy environments.

Source separation Computational modeling Information processing Brain modeling Electroencephalography Decoding Data mining

第一

英语

CPCI-S

Shenzhen Key Laboratory of Robotics Perception and Intelligence[ZDSYS20200810171800001] ; Shenzhen Sustainable Support Program for High-level University[20200925154002001]

Computer Science ; Engineering ; Imaging Science & Photographic Technology ; Telecommunications

Computer Science, Artificial Intelligence ; Computer Science, Information Systems ; Engineering, Electrical & Electronic ; Imaging Science & Photographic Technology ; Telecommunications

WOS:000922154500249

IEEE

Shenzhen Key Laboratory of Robotics Perception and Intelligence, Southern University of Science and Technology, Shenzhen, China

Lei Wang,Fei Chen. EEG-based Auditory Attention Detection with Estimated Speech Sources Separated from an Ideal-binary-masking Process[C]. 345 E 47TH ST, NEW YORK, NY 10017 USA:IEEE,2022:1545-1549.