Target Speaker Extraction by Directly Exploiting Contextual Information in the Time-Frequency Domain
ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)(2024)
摘要
In target speaker extraction, many studies rely on the speaker embedding
which is obtained from an enrollment of the target speaker and employed as the
guidance. However, solely using speaker embedding may not fully utilize the
contextual information contained in the enrollment. In this paper, we directly
exploit this contextual information in the time-frequency (T-F) domain.
Specifically, the T-F representations of the enrollment and the mixed signal
are interacted to compute the weighting matrices through an attention
mechanism. These weighting matrices reflect the similarity among different
frames of the T-F representations and are further employed to obtain the
consistent T-F representations of the enrollment. These consistent
representations are served as the guidance, allowing for better exploitation of
the contextual information. Furthermore, the proposed method achieves the
state-of-the-art performance on the benchmark dataset and shows its
effectiveness in the complex scenarios.
更多查看译文
关键词
Speech separation,target speaker extraction,speaker embedding,contextual information,attention mechanism
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要