Text-informed audio source separation. Example-based approach using non-negative matrix partial co-factorization - Université de Rennes Accéder directement au contenu
Article Dans Une Revue Journal of Signal Processing Systems Année : 2014

Text-informed audio source separation. Example-based approach using non-negative matrix partial co-factorization

Résumé

The so-called informed audio source separation, where the separation process is guided by some auxiliary information, has recently attracted a lot of research interest since classical blind or non-informed approaches often do not lead to satisfactory performances in many practical applications. In this paper we present a novel text-informed framework in which a target speech source can be separated from the background in the mixture using the corresponding textual information. First, given the text, we propose to produce a speech example via either a speech synthesizer or a human. We then use this example to guide source separation and, for that purpose, we introduce a new variant of the non-negative matrix partial co-factorization (NMPCF) model based on a so-called excitation-filter-channel speech model. Such a modeling allows sharing the linguistic information between the speech example and the speech in the mixture. The corresponding multiplicative update (MU) rules are eventually derived for the parameters estimation and several extensions of the model are proposed and investigated. We perform extensive experiments to assess the effectiveness of the proposed approach in terms of source separation and alignment performance.
Fichier principal
Vignette du fichier
template.pdf (658.17 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01010602 , version 1 (20-06-2014)

Identifiants

  • HAL Id : hal-01010602 , version 1

Citer

Luc Le Magoarou, Alexey Ozerov, Ngoc Duong. Text-informed audio source separation. Example-based approach using non-negative matrix partial co-factorization. Journal of Signal Processing Systems, 2014, pp.13. ⟨hal-01010602⟩
397 Consultations
452 Téléchargements

Partager

Gmail Facebook X LinkedIn More