The Effects of Different Brain Regions on fNIRS-based Task-state Detection in Speech Imagery

Hewen Zhang; Zengzhi Guo; Fei Chen

10.1109/EMBC40787.2023.10340896

2023

45th Annual International Conference of the IEEE-Engineering-in-Medicine-and-Biology-Society (EMBC)

2375-7477

1558-4615

979-8-3503-2448-8

2023 45th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC)

1-4

24-27 July 2023

Sydney, Australia

345 E 47TH ST, NEW YORK, NY 10017 USA

IEEE

Brain-computer interface (BCI) based on speech imagery can decode users' verbal intent and help people with motor disabilities communicate naturally. Functional near-infrared spectroscopy (fNIRS) is a commonly used brain signal acquisition method. Asynchronous BCI can response to control commands at any time, which provides great convenience for users. Task state detection, defined as identifying whether user starts or continues covertly articulating, plays an important role in speech imagery BCIs. To better distinguish task state from idle state during speech imagery, this work used fNIRS signals from different brain regions to study the effects of different brain regions on task state detection accuracy. The imagined tonal syllables included four lexical tones and four vowels in Mandarin Chinese. The brain regions that were measured included Broca's area, Wernicke's area, Superior temporal cortex and Motor cortex. Task state detection accuracies of imagining tonal monosyllables with four different tones were analyzed. The average accuracy of four speech imagery tasks based on the whole brain was 0.67 and it was close to 0.69, which was the average accuracy based on Broca's area. The accuracies of Broca's area and the whole brain were significantly higher than those of other brain regions. The findings of this work demonstrated that using a few channels of Broca's area could result in a similar task state detection accuracy to that using all the channels of the brain. Moreover, it was discovered that speech imagery with tone 2/3 tasks yielded higher task state detection accuracy than speech imagery with other tones.

Area measurement Brain-computer interfaces Biology Task analysis Functional near-infrared spectroscopy

第一

英语

EI ; CPCI-S

National Natural Science Foundation of China[61971212] ; Basic Research Foundation of Shenzhen[JCYJ20220818101217037] ; Guangdong Basic and Applied Basic Research Foundation[2022B1515120056]

Computer Science ; Engineering

Computer Science, Artificial Intelligence ; Computer Science, Interdisciplinary Applications ; Engineering, Biomedical

WOS:001133788304011

20240215361423

Brain ; Brain computer interface ; Functional neuroimaging ; Near infrared spectroscopy

Biomedical Engineering:461.1 ; Computer Peripheral Equipment:722.2 ; Imaging Techniques:746

IEEE

Department of Electrical and Electronic Engineering, Southern University of Science and Technology, Shenzhen, China

Hewen Zhang,Zengzhi Guo,Fei Chen. The Effects of Different Brain Regions on fNIRS-based Task-state Detection in Speech Imagery[C]. 345 E 47TH ST, NEW YORK, NY 10017 USA:IEEE,2023:1-4.