Impacts of simplifying articulation movements imagery to speech imagery BCI performance

Guo, Zengzhi1,2; Chen, Fei2

2023-02-01

10.1088/1741-2552/acb232

Journal of Neural Engineering   影响因子和分区

1741-2560

1741-2552

Objective. Speech imagery (SI) can be used as a reliable, natural, and user-friendly activation task for the development of brain-computer interface (BCI), which empowers individuals with severe disabilities to interact with their environment. The functional near-infrared spectroscopy (fNIRS) is advanced as one of the most suitable brain imaging methods for developing BCI systems owing to its advantages of being non-invasive, portable, insensitive to motion artifacts, and having relatively high spatial resolution. Approach. To improve the classification performance of SI BCI based on fNIRS, a novel paradigm was developed in this work by simplifying the articulation movements in SI to make the articulation movement differences clearer between different words imagery tasks. A SI BCI was proposed to directly answer questions by covertly rehearsing the word '(sic)' or '(sic)' ('yes' or 'no' in English), and an unconstrained rest task also was contained in this BCI. The articulation movements of SI were simplified by retaining only the movements of the jaw and lips of vowels in Chinese Pinyin for words '(sic)' and '(sic)'. Main results. Compared with conventional speech imagery, simplifying the articulation movements in SI could generate more different brain activities among different tasks, which led to more differentiable temporal features and significantly higher classification performance. The average 3-class classification accuracies of the proposed paradigm across all 20 participants reached 69.6% and 60.2% which were about 10.8% and 5.6% significantly higher than those of the conventional SI paradigm operated in the 0-10 s and 0-2.5 s time windows, respectively. Significance. These results suggested that simplifying the articulation movements in SI is promising for improving the classification performance of intuitive BCIs based on speech imagery.

brain-computer interface functional near-infrared spectroscopy speech imagery simplifying articulation movements imagery

SCI ; EI

英语

通讯

Shenzhen Sustainable Support Program for High-level University[20200925154002001]

Engineering ; Neurosciences & Neurology

Engineering, Biomedical ; Neurosciences

WOS:000919292200001

IOP Publishing Ltd

20230613558736

Brain ; Brain mapping ; Image enhancement ; Infrared devices ; Near infrared spectroscopy

Biomedical Engineering:461.1 ; Computer Peripheral Equipment:722.2 ; Imaging Techniques:746

Web of Science

1.Harbin Inst Technol, Sch Elect & Informat Engn, Harbin, Peoples R China
2.Southern Univ Sci & Technol, Dept Elect & Elect Engn, Shenzhen, Peoples R China

Guo, Zengzhi,Chen, Fei. Impacts of simplifying articulation movements imagery to speech imagery BCI performance[J]. Journal of Neural Engineering,2023,20(1).

Guo, Zengzhi,&Chen, Fei.(2023).Impacts of simplifying articulation movements imagery to speech imagery BCI performance.Journal of Neural Engineering,20(1).

Guo, Zengzhi,et al."Impacts of simplifying articulation movements imagery to speech imagery BCI performance".Journal of Neural Engineering 20.1(2023).