Skip to Main content Skip to Navigation
Theses

Apprentissage profond bout-en-bout pour le rehaussement de la parole

Guillaume Carbajal 1
1 MULTISPEECH - Speech Modeling for Facilitating Oral-Based Communication
Inria Nancy - Grand Est, LORIA - NLPKD - Department of Natural Language Processing & Knowledge Discovery
Abstract : This PhD falls within the development of hands-free telecommunication systems, more specifically smart speakers in domestic environments. The user interacts with another speaker at a far-end point and can be typically a few meters away from this kind of system. The microphones are likely to capture sounds of the environment which are added to the user's voice, such background noise, acoustic echo and reverberation. These types of distortion degrade speech quality, intelligibility and listening comfort for the far-end speaker, and must be reduced. Filtering methods can reduce individually each of these types of distortion. Reducing all of them implies combining the corresponding filtering methods. As these methods interact with each other which can deteriorate the user's speech, they must be jointly optimized. First of all, we introduce an acoustic echo reduction approach which combines an echo cancellation filter with a residual echo postfilter designed to adapt to the echo cancellation filter. To do so, we propose to estimate the postfilter coefficients using the short term spectra of multiple known signals, including the output of the echo cancellation filter, as inputs to a neural network. We show that this approach improves the performance and the robustness of the postfilter in terms of echo reduction, while limiting speech degradation, on several scenarios in real conditions. Secondly, we describe a joint approach for multichannel reduction of echo, reverberation and noise. We propose to simultaneously model the target speech and undesired residual signals after echo cancellation and dereveberation in a probabilistic framework, and to jointly represent their short-term spectra by means of a recurrent neural network. We develop a block-coordinate ascent algorithm to update the echo cancellation and dereverberation filters, as well as the postfilter that reduces the undesired residual signals. We evaluate our approach on real recordings in different conditions. We show that it improves speech quality and reduction of echo, reverberation and noise compared to a cascade of individual filtering methods and another joint reduction approach. Finally, we present an online version of our approach which is suitable for time-varying acoustic conditions. We evaluate the perceptual quality achieved on real examples where the user moves during the conversation.
Complete list of metadata

Cited literature [227 references]  Display  Hide  Download

https://hal.univ-lorraine.fr/tel-02877545
Contributor : Thèses Ul Connect in order to contact the contributor
Submitted on : Monday, June 22, 2020 - 3:03:12 PM
Last modification on : Wednesday, November 3, 2021 - 7:57:48 AM

File

DDOC_T_2020_0017_CARBAJAL.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : tel-02877545, version 1

Citation

Guillaume Carbajal. Apprentissage profond bout-en-bout pour le rehaussement de la parole. Informatique [cs]. Université de Lorraine, 2020. Français. ⟨NNT : 2020LORR0017⟩. ⟨tel-02877545⟩

Share

Metrics

Record views

154

Files downloads

2578