Comparing the Contributions of Amplitude and Phase to Speech Intelligibility in a Vocoder-based Speech Synthesis Model

Chen, Fei1; Chiao, Benson C. L.2; Int Speech Commun Assoc

10.21437/Interspeech.2016-66

2016

19909772

17TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2016), VOLS 1-5

08-12-September-2016

1355-1358

San Francisco, CA, United states

C/O EMMANUELLE FOXONET, 4 RUE DES FAUVETTES, LIEU DIT LOUS TOURILS, BAIXAS, F-66390, FRANCE

ISCA-INT SPEECH COMMUNICATION ASSOC

Vocoder-based speech synthesis model has been long used to assess the contribution of acoustic cue for speech recognition. This study compared the perceptual contributions of amplitude and phase by using two types of stimuli, i.e., amplitude- and phase-based vocoded stimuli. The amplitude-based vocoded stimuli were synthesized by preserving amplitude fluctuation cue but discarding phase cue (i.e., setting phase to zero), while the phase-based vocoded stimuli were synthesized by preserving phase cue and discarding amplitude cue (i.e., setting amplitude to unit). Listening experiments with normal hearing participants showed consistent findings with earlier studies that the intelligibility scores of both amplitude- and phase-based vocoded stimuli increased when using a large number of channels in vocoder-based speech synthesis. In addition, at all tested conditions, the intelligibility scores of amplitude-based vocoded stimuli were significantly larger than those of phase-based vocoded stimuli, suggesting that amplitude might carry more perceptual contribution than phase. This intelligibility advantage of amplitude over phase may be attributed to the difference in the amount of envelope information contained in the two types of vocoded stimuli.

Speech intelligibility amplitude and phase vocoder simulation

第一 ; 通讯

英语

CPCI-S ; ISSHP ; CPCI-SSH ; EI

National Natural Science Foundation of China[61571213]

Acoustics ; Computer Science ; Engineering ; Linguistics

Acoustics ; Computer Science, Artificial Intelligence ; Engineering, Electrical & Electronic ; Linguistics

WOS:000409394400283

20164603003709

Speech communication ; Speech processing ; Speech recognition ; Speech synthesis ; Vocoders

Speech:751.5 ; Sound Recording:752.2

Web of Science

1.Southern Univ Sci & Technol, Dept Elect & Elect Engn, Shenzhen, Peoples R China
2.Univ Hong Kong, Div Speech & Hearing Sci, Hong Kong, Hong Kong, Peoples R China

Chen, Fei,Chiao, Benson C. L.,Int Speech Commun Assoc. Comparing the Contributions of Amplitude and Phase to Speech Intelligibility in a Vocoder-based Speech Synthesis Model[C]. C/O EMMANUELLE FOXONET, 4 RUE DES FAUVETTES, LIEU DIT LOUS TOURILS, BAIXAS, F-66390, FRANCE:ISCA-INT SPEECH COMMUNICATION ASSOC,2016:1355-1358.