ONLINE SPEAKER DIARIZATION OF MEETINGS GUIDED BY SPEECH SEPARATION - Département Image, Données, Signal
Communication Dans Un Congrès Année : 2024

ONLINE SPEAKER DIARIZATION OF MEETINGS GUIDED BY SPEECH SEPARATION

Résumé

Overlapped speech is notoriously problematic for speaker diarization systems. Consequently, the use of speech separation has recently been proposed to improve their performance. Although promising, speech separation models struggle with realistic data because they are trained on simulated mixtures with a fixed number of speakers. In this work, we introduce a new speech separation-guided diarization scheme suitable for the online speaker diarization of long meeting recordings with a variable number of speakers, as present in the AMI corpus. We envisage ConvTasNet and DPRNN as alternatives for the separation networks, with two or three output sources. To obtain the speaker diarization result, voice activity detection is applied on each estimated source. The final model is fine-tuned end-to-end, after first adapting the separation to real data using AMI. The system operates on short segments, and inference is performed by stitching the local predictions using speaker embeddings and incremental clustering. The results show that our system improves the state-of-the-art on the AMI headset mix, using no oracle information and under full evaluation (no collar and including overlapped speech). Finally, we show the strength of our system particularly on overlapped speech sections.
Fichier principal
Vignette du fichier
ICASSP_2024_ELIO_GRUTTADAURIA-final.pdf (606.07 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04419041 , version 1 (29-01-2024)

Identifiants

  • HAL Id : hal-04419041 , version 1

Citer

Elio Gruttadauria, Mathieu Fontaine, Slim Essid. ONLINE SPEAKER DIARIZATION OF MEETINGS GUIDED BY SPEECH SEPARATION. IEEE International Conference on Acoustics, Speech, and Signal Processing, Apr 2024, Seoul (Korea), South Korea. ⟨hal-04419041⟩
264 Consultations
176 Téléchargements

Partager

More