Modeling speech intelligibility with recovered envelope from temporal fine structure stimulus

Chen, Fei1; Tsao, Yu2; Lai, Ying-Hui2,3

2016-07

10.1016/j.specom.2016.01.006

SPEECH COMMUNICATION   影响因子和分区

0167-6393

1872-7182

Temporal envelope and fine structure are two prominent acoustic cues for speech perception. Most existing speech-transmission-index based metrics make use of the temporal envelope information and discard the temporal fine structure (TFS) cue to predict speech intelligibility. Recent studies have shown that the TFS stimulus synthesized with multiband TFS waveforms contains rich intelligibility information, which is reflected as the recovered envelope from the TFS stimulus. The present study first assessed the performance of using the recovered envelope from the synthesized TFS stimulus to predict the intelligibility of noise-distorted and noise-suppressed speech. The TFS stimulus was synthesized and fed as an input into the conventional normalized covariance measure (NCM) module. The results showed that the recovered envelope from the TFS stimulus predicted the intelligibility as well as the original envelope extracted from the wideband speech signal did. In addition, an additive intelligibility model was designed to combine the envelope from wideband speech and the recovered envelope from the TFS stimulus to predict speech intelligibility. The prediction power was significantly improved when these two envelope waveforms were integrated. The present study suggests that the recovered envelope from the TFS stimulus may be alternative acoustic information for modeling speech intelligibility and improving the prediction power of the conventional NCM-based intelligibility index. (C) 2016 Elsevier B.V. All rights reserved.

Speech intelligibility Temporal fine structure Recovered envelope Normalized covariance measure

SCI ; EI

英语

第一 ; 通讯

Ministry of Science and Technology of Taiwan[MOST 104-2221-E-001-026-MY2]

Acoustics ; Computer Science

Acoustics ; Computer Science, Interdisciplinary Applications

WOS:000378440500008

ELSEVIER SCIENCE BV

20161002068569

Acoustic noise ; Atomic physics ; Forecasting ; Recovery ; Speech communication ; Speech transmission

Acoustic Noise:751.4 ; Speech:751.5 ; Atomic and Molecular Physics:931.3

COMPUTER SCIENCE

Web of Science

1.Southern Univ Sci & Technol, Dept Elect & Elect Engn, Xueyuan Rd 1088, Shenzhen, Peoples R China
2.Acad Sinica, Res Ctr Informat Technol Innovat, Taipei 115, Taiwan
3.Yuan Ze Univ, Dept Elect Engn, Chungli, Taiwan

Chen, Fei,Tsao, Yu,Lai, Ying-Hui. Modeling speech intelligibility with recovered envelope from temporal fine structure stimulus[J]. SPEECH COMMUNICATION,2016,81:120-128.

Chen, Fei,Tsao, Yu,&Lai, Ying-Hui.(2016).Modeling speech intelligibility with recovered envelope from temporal fine structure stimulus.SPEECH COMMUNICATION,81,120-128.

Chen, Fei,et al."Modeling speech intelligibility with recovered envelope from temporal fine structure stimulus".SPEECH COMMUNICATION 81(2016):120-128.