南方科技大学知识苑(SUSTech KC): Robot Hearing Through Optical Channel in a Cocktail Party Environment

题名	Robot Hearing Through Optical Channel in a Cocktail Party Environment
作者	Guo, Xiao; Ding, Siyi; Peng, Ti; Li, Kenan; Hong, Xiaoping
通讯作者	Hong, Xiaoping
发表日期	2022-12-01
DOI	10.1002/aisy.202200143
发表期刊	ADVANCED INTELLIGENT SYSTEMS 影响因子和分区
EISSN	2640-4567
卷号	5 期号:1
摘要	The cocktail party problem refers to a challenging process when the human sensory system tries to separate a specific voice from a loud mixture of background sound sources. The problem is much more demanding for machines and has become the holy grail in robotic hearing. Despite many advances in noise suppression, the intrinsic information from the contaminated acoustic channel remains difficult to recover. Herein, a simple-yet-powerful laser-assisted audio system termed robot ear accomplished by laser (REAL) is shown to probe the vibrations of sound-carrying surfaces (mask, throat, and other nearby surfaces) in optical channel, which is intrinsically immune to acoustic background noises. The results demonstrate that REAL can directly obtain the audio-frequency content from the laser without acoustic channel interference. The signals can be further transcribed into human-recognizable audios by exploiting the internal time and frequency correlations through memory-enabled neural networks. The REAL system would enable a new way in human-robot interaction. An interactive preprint version of the article can be found at: .
关键词	cocktail party problem human-robot interaction optical audio collection robot hearing
相关链接	[来源记录]
收录类别	SCI
语种	英语
学校署名	第一 ; 通讯
资助项目	SUSTech[Y01966105] ; DJI[K2096Z028]
WOS研究方向	Automation & Control Systems ; Computer Science ; Robotics
WOS类目	Automation & Control Systems ; Computer Science, Artificial Intelligence ; Robotics
WOS记录号	WOS:000895333100001
出版者	WILEY
来源库	Web of Science
引用统计	被引频次[WOS]：0
成果类型	期刊论文
条目标识符	http://sustech.caswiz.com/handle/2SGJ60CL/417087
专题	工学院_系统设计与智能制造学院
作者单位	Southern Univ Sci & Technol, Sch Syst Design & Intelligent Mfg, Shenzhen 518000, Peoples R China
第一作者单位	系统设计与智能制造学院
通讯作者单位	系统设计与智能制造学院
第一作者的第一单位	系统设计与智能制造学院
推荐引用方式 GB/T 7714	Guo, Xiao,Ding, Siyi,Peng, Ti,et al. Robot Hearing Through Optical Channel in a Cocktail Party Environment[J]. ADVANCED INTELLIGENT SYSTEMS,2022,5(1).
APA	Guo, Xiao,Ding, Siyi,Peng, Ti,Li, Kenan,&Hong, Xiaoping.(2022).Robot Hearing Through Optical Channel in a Cocktail Party Environment.ADVANCED INTELLIGENT SYSTEMS,5(1).
MLA	Guo, Xiao,et al."Robot Hearing Through Optical Channel in a Cocktail Party Environment".ADVANCED INTELLIGENT SYSTEMS 5.1(2022).