Beamformer-Guided Target Speaker Extraction
Mohamed Elminshawi (International Audio Laboratories Erlangen); Srikanth Raj Chetupalli (Fraunhofer IIS); Emanuel Habets (AudioLabs Erlangen)
-
SPS
IEEE Members: $11.00
Non-members: $15.00
We propose a Beamformer-guided Target Speaker Extraction (BG-TSE) method to extract a target speaker’s voice from a multi-channel recording informed by the direction of arrival of the target. The proposed method employs a front-end beamformer steered towards the target speaker to provide an auxiliary signal to a single-channel TSE system. By allowing for time-varying embeddings in the single-channel TSE block, the proposed method fully exploits the correspondence between the front-end beamformer output and the target speech in the microphone signal. Experimental evaluation on simulated multi-channel 2-speaker mixtures, in both anechoic and reverberant conditions, demonstrates the advantage of the proposed method compared to recent single-channel and multi-channel baselines.