A. Abdulaziz and V. Kepuska, Noisy TIMIT speech, Linguistic Data Consortium V1, 2017.

A. , The Hitchhiker's Guide to the Galaxy, 1952.

S. Adavanne, A. Politis, J. Nikunen, and T. Virtanen, Sound event localization and detection of overlapping sources using convolutional recurrent neural networks, IEEE Journal of Selected Topics in Signal Processing, vol.13, issue.1, p.3448, 2019.

S. Adavanne, A. Politis, and T. Virtanen, Direction of arrival estimation for multiple sound sources using convolutional recurrent neural network, European Signal Processing Conference, p.14621466, 2018.

X. Alameda-pineda and R. Horaud, Vision-guided robot hearing. The International, Journal of Robotics Research, vol.34, issue.4-5, p.437456, 2015.
URL : https://hal.archives-ouvertes.fr/hal-00990766

M. Alber, S. Lapuschkin, P. Seegerer, M. Hägele, K. T. Schütt et al., iNNvestigate neural networks, vol.20, p.18, 2019.

J. B. Allen and D. A. Berkley, Image method for eciently simulating small-room acoustics, The Journal of the Acoustical Society of America, vol.65, issue.4, p.943950, 1979.

X. Anguera, C. Wooters, H. , and J. , Acoustic beamforming for speaker diarization of meetings, IEEE Transactions on Audio, Speech, and Language Processing, vol.15, issue.7, p.20112022, 2007.

S. Araki, T. Nakatani, H. Sawada, and S. Makino, Stereo source separation and source counting with MAP estimation with Dirichlet prior considering spatial aliasing problem, 5th International Conference on Independent Component Analysis and Signal Separation, p.742750, 2009.

A. Asaei, H. Bourlard, M. J. Taghizadeh, and V. Cevher, Computational methods for underdetermined convolutive speech localization and separation via modelbased sparse component analysis, Speech Communication, vol.76, 2016.

J. L. Ba, J. R. Kiros, and G. E. Hinton, Layer normalization, Advances in Neural Information Processing Systems, 2016.

S. Bach, A. Binder, G. Montavon, F. Klauschen, K. Müller et al., , 2015.

, On pixel-wise explanations for non-linear classier decisions by layer-wise relevance propagation, PLOS ONE, vol.10, issue.7, p.130140

L. Bahl, P. Brown, P. De-souza, and R. Mercer, Maximum mutual information estimation of hidden Markov model parameters for speech recognition, IEEE International Conference on Acoustics, Speech, and Signal Processing, vol.11, p.4952, 1986.

H. Barfuss and W. Kellermann, On the impact of localization errors on HRTFbased robust least-squares beamforming, German Annual Conference on Acoustics, p.10721075, 2016.

J. Barker, R. Marxer, E. Vincent, and S. Watanabe, The third`CHiME' speech separation and recognition challenge: Analysis and outcomes, Computer Speech & Language, vol.46, p.605626, 2017.
URL : https://hal.archives-ouvertes.fr/hal-01382108

J. Barker, S. Watanabe, E. Vincent, and J. Trmal, The fth 'CHiME' speech separation and recognition challenge: Dataset, task and baselines, p.15611565, 2018.

A. Barredo-arrieta, N. Díaz-rodríguez, J. Del-ser, A. Bennetot, S. Tabik et al., Explainable Articial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI. Information Fusion, vol.58, p.82115, 2020.

S. Becker, M. Ackermann, S. Lapuschkin, K. Müller, and W. Samek, , 2018.

, Interpreting and explaining deep neural networks for classication of audio signals

H. Bharadhwaj, Layer-wise relevance propagation for explainable deep learning based speech recognition, IEEE International Symposium on Signal Processing and Information Technology, p.168174, 2018.

C. M. Bishop, Pattern Recognition and Machine Learning, 2006.

C. Boeddeker, P. Hanebrink, L. Drude, J. Heymann, and R. Haeb-umbach, , 2017.

, Optimizing neural-network supported acoustic beamforming by algorithmic dierentiation, IEEE International Conference on Acoustics, Speech and Signal Processing, p.171175

A. S. Bregman, Auditory Scene Analysis: The Perceptual Organization of Sound, 1994.

A. W. Bronkhorst, The cocktail party phenomenon: A review of research on speech intelligibility in multiple-talker conditions, Acta Acustica united with Acustica, vol.86, issue.1, p.117128, 2000.

A. Brutti and M. Matassoni, On the relationship between early-to-late ratio of room impulse responses and ASR performance in reverberant environments, Speech Communication, vol.76, p.170185, 2016.

G. Carter, A. Nuttall, and P. Cable, The smoothed coherence transform. Proceedings of the IEEE, vol.61, p.14971498, 1973.

S. Chakrabarty and E. A. Habets, Broadband DOA estimation using convolutional neural networks trained with noise signals, IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, p.136140, 2017.

S. Chakrabarty and E. A. Habets, Multi-speaker localization using convolutional neural network trained with noise, NIPS 2017 Workshop on Machine Learning for Audio Processing, 2017.

Z. Chen, Y. Luo, and N. Mesgarani, Deep attractor network for singlemicrophone speaker separation, IEEE International Conference on Acoustics, Speech and Signal Processing, p.246250, 2017.

Z. Chen, S. Watanabe, H. Erdogan, and J. R. Hershey, Speech enhancement and recognition using multi-task learning of long short-term memory recurrent neural networks, In Interspeech, p.32743278, 2015.

Z. Chen, X. Xiao, T. Yoshioka, H. Erdogan, J. Li et al., Multichannel overlapped speech recognition with location guided speech extraction network, IEEE Spoken Language Technology Workshop, p.558565, 2018.

Z. Chen, T. Yoshioka, X. Xiao, J. Li, M. L. Seltzer et al., Ecient integration of xed beamformers and speech separation networks for multi-channel fareld speech separation, IEEE International Conference on Acoustics, Speech and Signal Processing, p.53845388, 2018.

K. Cho, B. Van-merrienboer, D. Bahdanau, and Y. Bengio, On the properties of neural machine translation: Encoderdecoder approaches, 8th Workshop on Syntax, Semantics and Structure in Statistical Translation, p.103111, 2014.

K. Cho, B. Van-merriënboer, C. Gulcehre, D. Bahdanau, F. Bougares et al., Learning phrase representations using RNN encoder-decoder for statistical machine translation, Conference on Empirical Methods in Natural Language Processing, p.17241734, 2014.
URL : https://hal.archives-ouvertes.fr/hal-01433235

H. Cox, R. Zeskind, and M. Owen, Robust adaptive beamforming, IEEE Transactions on Acoustics, Speech, and Signal Processing, vol.35, issue.10, p.13651376, 1987.

S. Davis and P. Mermelstein, Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentences, IEEE Transactions on Acoustics, Speech, and Signal Processing, vol.28, issue.4, p.357366, 1980.

N. Dehak, P. J. Kenny, R. Dehak, P. Dumouchel, and P. Ouellet, Front-end factor analysis for speaker verication, IEEE Transactions on Audio, Speech, and Language Processing, vol.19, issue.4, p.788798, 2011.

A. Deleforge, D. Di-carlo, M. Strauss, R. Serizel, and L. Marcenaro, Audiobased search and rescue with a drone: Highlights from the IEEE Signal Processing Cup 2019 student competition, IEEE Signal Processing Magazine, vol.36, issue.5, p.138144, 2019.
URL : https://hal.archives-ouvertes.fr/hal-02161897

A. Deleforge, F. Forbes, and R. Horaud, Acoustic space learning for soundsource separation and localization on binaural manifolds, International Journal of Neural Systems, vol.25, issue.01, p.1440003, 2014.
URL : https://hal.archives-ouvertes.fr/hal-00960796

A. Deleforge, R. Horaud, Y. Y. Schechner, and L. Girin, Co-localization of audio sources in images using binaural features and locally-linear regression, IEEE Transactions on Audio, Speech, and Language Processing, vol.23, issue.4, p.718731, 2015.
URL : https://hal.archives-ouvertes.fr/hal-01112834

A. Deleforge, A. Schmidt, and W. Kellermann, Audio-motor integration for robot audition, Multimodal Behavior Analysis in the Wild, p.2751, 2019.
URL : https://hal.archives-ouvertes.fr/hal-01929388

N. Delfosse and P. Loubaton, Adaptive blind separation of independent sources: A deation approach, Signal Processing, vol.45, issue.1, p.5983, 1995.

L. Deng and D. Yu, Deep Learning: Methods and Applications, 2014.

J. H. Dibiase, A High-Accuracy, Low-Latency Technique for Talker Localization in Reverberant Environments Using Microphone Arrays, 2000.

S. Doclo and M. Moonen, GSVD-based optimal ltering for single and multimicrophone speech enhancement, IEEE Transactions on Signal Processing, vol.50, issue.9, pp.2230-2244, 2002.

S. Doclo, A. Spriet, J. Wouters, and M. Moonen, Frequency-domain criterion for the speech distortion weighted multichannel Wiener lter for robust noise reduction, Speech Communication, vol.49, issue.7, p.636656, 2007.

L. Drude, J. Heitkaemper, C. Boeddeker, and R. Haeb-umbach, SMS-WSJ: Database, performance measures, and baseline recipe for multi-channel source separation and recognition, 2019.

J. Du, T. Gao, L. Sun, F. Ma, H. Wang et al., The USTC-iFlytek system for CHiME-4 challenge, 4th International Workshop on Speech Processing in Everyday Environments, p.3638, 2016.

N. Q. Duong, E. Vincent, and R. Gribonval, Under-determined reverberant audio source separation using a full-rank spatial covariance model, IEEE Transactions on Audio, Speech, and Language Processing, vol.18, issue.7, p.18301840, 2010.
URL : https://hal.archives-ouvertes.fr/inria-00435807

N. Q. Duong, E. Vincent, and R. Gribonval, Spatial location priors for Gaussian model based reverberant audio source separation, EURASIP Journal on Advances in Signal Processing, vol.2013, issue.1, p.149, 2013.
URL : https://hal.archives-ouvertes.fr/hal-00870191

D. El-badawy, I. Dokmani¢, and M. Vetterli, Acoustic DoA estimation by one unsophisticated sensor, International Conference on Latent Variable Analysis and Signal Separation, p.8998, 2017.

A. Ephrat, I. Mosseri, O. Lang, T. Dekel, K. Wilson et al., Looking to listen at the cocktail party: A speakerindependent audio-visual model for speech separation, ACM Transactions on Graphics, vol.37, issue.4, 2018.

H. Erdogan, J. R. Hershey, S. Watanabe, L. Roux, and J. , Phase-sensitive and recognition-boosted speech separation using deep recurrent neural networks, IEEE International Conference on Acoustics, Speech and Signal Processing, p.708712, 2015.

C. Evers, H. Loellmann, H. Mellmann, A. Schmidt, H. Barfuss et al., The LOCATA challenge: Acoustic source localization and tracking, 2020.

, Speech, and Language Processing, vol.28, p.16201643

C. F. Eyring, Reverberation time in dead rooms, The Journal of the Acoustical Society of America, vol.1, issue.2A, p.168168, 1930.

M. J. Gales, Maximum likelihood linear transformations for HMM based speech recognition, Computer Speech & Language, vol.12, issue.2, p.7598, 1998.

S. Galliano, E. Georois, G. Gravier, J. Bonastre, D. Mostefa et al., Corpus description of the ESTER evaluation campaign for the rich transcription of French broadcast news, 5th International Conference on Language Resources and Evaluation, p.139142, 2006.

S. Gannot, D. Burshtein, and E. Weinstein, Signal enhancement using beamforming and nonstationarity with applications to speech, IEEE Transactions on Signal Processing, vol.49, issue.8, p.16141626, 2001.

S. Gannot, E. Vincent, S. Markovich-golan, and A. Ozerov, A consolidated perspective on multimicrophone speech enhancement and source separation, IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol.25, issue.4, p.692730, 2017.
URL : https://hal.archives-ouvertes.fr/hal-01414179

R. Gao, T. Oh, K. Grauman, and L. Torresani, Listen to look: Action recognition by previewing audio, Conference on Computer Vision and Pattern Recognition, 2020.

I. Goodfellow, Y. Bengio, and A. Courville, Deep Learning, 2016.

G. Gravier, G. Adda, N. Paulson, M. Carré, A. Giraudel et al., The ETAPE corpus for the evaluation of speech-based TV content processing in the French language, 8th International Conference on Language Resources and Evaluation, p.114118, 2012.
URL : https://hal.archives-ouvertes.fr/hal-00712591

C. S. Greenberg, L. P. Mason, S. O. Sadjadi, and D. A. Reynolds, Two decades of speaker recognition evaluation at the national institute of standards and technology, Computer Speech & Language, vol.60, p.101032, 2020.

A. Gretsistas and M. D. Plumbley, A multichannel spatial compressed sensing approach for direction of arrival estimation, International Conference on Latent Variable Analysis and Signal Separation, p.458465, 2010.
URL : https://hal.archives-ouvertes.fr/inria-00565794

A. Grin, D. Pavlidi, M. Puigt, and A. Mouchtaris, Real-time multiple speaker DOA estimation in a circular microphone array based on matching pursuit, European Signal Processing Conference, p.23032307, 2012.

D. Grin and J. Lim, Signal estimation from modied short-time Fourier transform, IEEE Transactions on Acoustics, Speech, and Signal Processing, vol.32, issue.2, p.236243, 1984.

L. Griths and C. Jim, An alternative approach to linearly constrained adaptive beamforming, IEEE Transactions on Antennas and Propagation, vol.30, issue.1, p.2734, 1982.

T. Gustafsson, B. Rao, and M. Trivedi, Source localization in reverberant environments: Modeling and statistical analysis, IEEE Transactions on Speech and Audio Processing, vol.11, issue.6, p.791803, 2003.

E. A. Habets, RIR-Generator: Room impulse response generator, 2018.

E. A. Habets and P. A. Naylor, Dereverberation. In Audio Source Separation and Speech Enhancement, p.317343, 2018.

J. H. Hansen and T. Hasan, Speaker recognition by machines and humans: A tutorial review, IEEE Signal Processing Magazine, vol.32, issue.6, p.7499, 2015.

E. Hänsler and G. Schmidt, Acoustic Echo and Noise Control: A Practical Approach, 2005.

M. Harper, The automatic speech recogition in reverberant environments (AS-pIRE) challenge, IEEE Workshop on Automatic Speech Recognition and Understanding, p.547554, 2015.

O. Hazrati and P. C. Loizou, The combined eects of reverberation and noise on speech intelligibility by cochlear implant listeners, International Journal of Audiology, vol.51, issue.6, p.437443, 2012.

W. He, P. Motlicek, and J. Odobez, Deep neural networks for multiple speaker detection and localization, IEEE International Conference on Robotics and Automation, p.7479, 2018.

W. He, P. Motlicek, and J. Odobez, Joint localization and classication of multiple sound sources using a multi-task neural network, In Interspeech, p.312316, 2018.

J. Heitkaemper, D. Jakobeit, C. Boeddeker, L. Drude, and R. Haeb-umbach, , 2020.

, Demystifying TasNet: A dissecting approach, IEEE International Conference on Acoustics, Speech and Signal Processing, p.63596363

W. Herbordt, H. Buchner, S. Nakamura, and W. Kellermann, Outlier-robust DFT-domain adaptive ltering for bin-wise stepsize controls, and its application to a generalized sidelobe canceller, International Workshop on Acoustic Echo and Noise Control, p.113116, 2005.

W. Herbordt and W. Kellermann, Adaptive beamforming for audio signal acquisition, Adaptive Signal Processing: Applications to Real-World Problems, p.155194, 2003.

W. Herbordt, T. Trini, and W. Kellermann, Robust spatial estimation of the signal-to-interference ratio for non-stationary mixtures, International Workshop on Acoustic Echo and Noise Control, p.247250, 2003.

H. Hermansky, Perceptual linear predictive (PLP) analysis of speech, The Journal of the Acoustical Society of America, vol.87, issue.4, p.17381752, 1990.

J. R. Hershey, Z. Chen, J. Le-roux, and S. Watanabe, Deep clustering: Discriminative embeddings for segmentation and separation, IEEE International Conference on Acoustics, Speech and Signal Processing, p.3135, 2016.

J. Heymann, L. Drude, C. Boeddeker, P. Hanebrink, and R. Haeb-umbach, , 2017.

, Beamnet: End-to-end training of a beamformer-supported multi-channel ASR system

, IEEE International Conference on Acoustics, Speech and Signal Processing, p.53255329

J. Heymann, L. Drude, A. Chinaev, and R. Haeb-umbach, BLSTM supported GEV beamformer front-end for the 3rd CHiME challenge, IEEE Workshop on Automatic Speech Recognition and Understanding, p.444451, 2015.

T. Higuchi, N. Ito, T. Yoshioka, and T. Nakatani, Robust MVDR beamforming using time-frequency masks for online/oine ASR in noise, IEEE International Conference on Acoustics, Speech and Signal Processing, p.52105214, 2016.

T. Higuchi, K. Kinoshita, M. Delcroix, K. Molíková, and T. Nakatani, Deep clustering-based beamforming for separation with unknown number of sources, p.11831187, 2017.

G. Hinton, L. Deng, D. Yu, G. E. Dahl, . Mohamed et al., Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups, IEEE Signal Processing Magazine, vol.29, issue.6, p.8297, 2012.

S. Hochreiter and J. Schmidhuber, Long short-term memory, Neural Computation, vol.9, issue.8, p.17351780, 1997.

Y. Hoshen, R. J. Weiss, and K. W. Wilson, Speech acoustic modeling from raw multichannel waveforms, IEEE International Conference on Acoustics, Speech and Signal Processing, p.46244628, 2015.

S. Ioe and C. Szegedy, Batch normalization: Accelerating deep network training by reducing internal covariate shift, 32nd International Conference on Machine Learning, vol.37, p.448456, 2015.

Y. Isik, J. Le-roux, Z. Chen, S. Watanabe, and J. R. Hershey, Single-channel multi-speaker separation using deep clustering, p.545549, 2016.

H. Kayser and J. Anemüller, A discriminative learning approach to probabilistic acoustic source localization, International Workshop on Acoustic Signal Enhancement, p.99103, 2014.

C. Kim and R. M. Stern, Power-normalized cepstral coecients (PNCC) for robust speech recognition, IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol.24, issue.7, p.13151329, 2016.

D. P. Kingma and J. Ba, Adam: A method for stochastic optimization, 3rd International Conference for Learning Representations, 2015.

K. Kinoshita, M. Delcroix, S. Gannot, E. A. Habets, R. Haeb-umbach et al., A summary of the REVERB challenge: State-of-the-Art and remaining challenges in reverberant speech processing research, EURASIP Journal on Advances in Signal Processing, vol.2016, issue.1, p.1, 2016.

K. Kinoshita, L. Drude, M. Delcroix, and T. Nakatani, Listening to each speaker one by one with recurrent selective hearing networks, IEEE International Conference on Acoustics, Speech and Signal Processing, p.50645068, 2018.

C. Knapp and G. Carter, The generalized correlation method for estimation of time delay, IEEE Transactions on Acoustics, Speech, and Signal Processing, vol.24, issue.4, p.327, 1976.

P. Koehn, Neural Machine Translation, 2020.

M. Kolbaek, D. Yu, Z. Tan, and J. Jensen, Multitalker speech separation with utterance-level permutation invariant training of deep recurrent neural networks, 2017.

, IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol.25, issue.10, 19011913.

H. Kuttru, Room Acoustics, 2016.

C. J. Lam and A. C. Singer, Bayesian beamforming for DOA uncertainty: Theory and implementation, IEEE Transactions on Signal Processing, vol.54, issue.11, p.44354445, 2006.

B. Laufer, R. Talmon, and S. Gannot, Relative transfer function modeling for supervised source localization, IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, p.14, 2013.

B. Laufer, R. Talmon, and S. Gannot, Semi-supervised sound source localization based on manifold regularization, IEEE/ACM Transaction on Audio, Speech and Language, vol.24, issue.8, p.13931407, 2016.

J. Le-roux, J. R. Hershey, and F. Weninger, Deep NMF for speech separation, 2015.

, IEEE International Conference on Acoustics, Speech and Signal Processing, p.6670

J. Le-roux, G. Wichern, S. Watanabe, A. Sarro, and J. R. Hershey, Phasebook and friends: Leveraging discrete representations for source separation, IEEE Journal of Selected Topics in Signal Processing, vol.13, p.370382, 2019.

J. Le-roux, S. Wisdom, H. Erdogan, and J. R. Hershey, SDR half-baked or well done, IEEE International Conference on Acoustics, Speech and Signal Processing, p.626630, 2019.

Y. Lecun, Y. Bengio, and G. Hinton, Deep learning, Nature, vol.521, issue.7553, p.436444, 2015.

D. D. Lee and H. S. Seung, Learning the parts of objects by non-negative matrix factorization, Nature, vol.401, issue.6755, p.788, 1999.

F. Li, P. S. Nidadavolu, and H. Hermansky, A long, deep and wide articial neural net for robust speech recognition in unknown noise, vol.358, p.362, 2014.

J. Li, L. Deng, R. Haeb-umbach, and Y. Gong, Robust Automatic Speech Recognition: A Bridge to Practical Applications, 2015.

X. Li, Y. Ban, L. Girin, X. Alameda-pineda, and R. Horaud, Online localization and tracking of multiple moving speakers in reverberant environments, IEEE Journal of Selected Topics in Signal Processing, vol.13, issue.1, p.88103, 2019.
URL : https://hal.archives-ouvertes.fr/hal-01851985

H. Liu, Q. Yin, and W. Y. Wang, Towards explainable NLP: A generative explanation framework for text classication, 57th Annual Meeting of the ACL, p.55705581, 2019.

P. C. Loizou, Speech Enhancement: Theory and Practice, 2013.

S. M. Lundberg, G. Erion, H. Chen, A. Degrave, J. M. Prutkin et al., From local explanations to global understanding with explainable AI for trees, Nature Machine Intelligence, vol.2, issue.1, p.5667, 2020.

S. M. Lundberg and S. Lee, A unied approach to interpreting model predictions, Advances in Neural Information Processing Systems, p.47654774, 2017.

Y. Luo, E. Ceolini, C. Han, S. Liu, and N. Mesgarani, FaSNet: Low-latency adaptive beamforming for multi-microphone audio processing, IEEE Workshop on Automatic Speech Recognition and Understanding, p.260267, 2019.

Y. Luo, Z. Chen, and T. Yoshioka, Dual-path RNN: Ecient long sequence modeling for time-domain single-channel speech separation, IEEE International Conference on Acoustics, Speech and Signal Processing, p.4650, 2020.

Y. Luo and N. Mesgarani, Conv-TasNet: Surpassing ideal timefrequency magnitude masking for speech separation, Speech, and Language Processing, vol.27, p.12561266, 2019.

N. Ma, G. J. Brown, M. , and T. , Exploiting deep neural networks and head movements for binaural localisation of multiple speakers in reverberant conditions, p.33023306, 2015.

D. Maiwald and D. Kraus, Calculation of moments of complex Wishart and complex inverse Wishart distributed matrices, IEE Proceedings on Radar, Sonar and Navigation, vol.147, issue.4, p.162168, 2000.

D. Malioutov, M. Cetin, and A. Willsky, A sparse signal reconstruction perspective for source localization with sensor arrays, IEEE Transactions on Signal Processing, vol.53, issue.8, p.30103022, 2005.

M. I. Mandel and D. P. Ellis, EM localization and separation using interaural level and phase cues, IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, p.275278, 2007.

S. Marchand and A. Vialard, The Hough transform for binaural source localization, Digital Audio Eects Conference, p.252259, 2009.
URL : https://hal.archives-ouvertes.fr/hal-00406275

R. Martin and I. Cohen, Single-channel speech presence probability estimation and noise tracking, Audio Source Separation and Speech Enhancement, vol.87, p.106, 2018.

T. May, S. Van-de-par, and A. Kohlrausch, A probabilistic model for robust localization based on a binaural auditory front-end, IEEE Transactions on Audio, Speech, and Language Processing, vol.19, issue.1, p.113, 2011.

J. H. Mcdermott, The cocktail party problem, Current Biology, vol.19, issue.22, pp.1024-1027, 2009.

T. Menne, J. Heymann, A. Alexandridis, K. Irie, A. Zeyer et al., The RWTH/UPB/FORTH system combination for the 4th CHiME challenge evaluation, 4th International Workshop on Speech Processing in Everyday Environments, p.3944, 2016.

T. Menne, R. Schlüter, and H. Ney, Investigation into joint optimization of single channel speech enhancement and acoustic modeling for robust ASR, IEEE International Conference on Acoustics, Speech and Signal Processing, p.66606664, 2019.

T. Menne, I. Sklyar, R. Schlüter, and H. Ney, Analysis of deep clustering as preprocessing for automatic speech recognition of sparsely overlapping speech, p.26382642, 2019.

M. Mohri, F. Pereira, R. , and M. , Weighted nite-state transducers in speech recognition, Computer Speech & Language, vol.16, issue.1, p.6988, 2002.

C. Molnar, Interpretable Machine Learning -A Guide for Making Black Box Models Explainable, 2019.

J. Mouba and S. Marchand, A source localization/separation/respatialization system based on unsupervised classication of interaural cues, Digital Audio Eects Conference, p.233238, 2006.

H. Muckenhirn, V. Abrol, . Magimai, M. Doss, M. et al., Understanding and visualizing raw waveform-based CNNs, p.23452349, 2019.

G. J. Mysore and P. Smaragdis, A non-negative approach to semi-supervised separation of speech from noise with the use of temporal dynamics, IEEE International Conference on Acoustics, Speech and Signal Processing, p.1720, 2011.
URL : https://hal.archives-ouvertes.fr/hal-01084331

K. Nakamura, K. Nakadai, and H. G. Okuno, A real-time super-resolution robot audition system that improves the robustness of simultaneous speech recognition, Advanced Robotics, vol.27, issue.12, p.933945, 2013.

Q. Nguyen, L. Girin, G. Bailly, F. Elisei, and D. Nguyen, Autonomous sensorimotor learning for sound source localization by a humanoid robot, Workshop on Crossmodal Learning for Intelligent Robotics in Conjunction with IEEE/RSJ IROS, 2018.
URL : https://hal.archives-ouvertes.fr/hal-01921882

T. Nishino and K. Takeda, Binaural sound localization for untrained directions based on a Gaussian mixture model, European Signal Processing Conference, p.15, 2008.

A. A. Nugraha, Deep Neural Networks for Source Separation and Noise-Robust Speech Recognition, 2017.
URL : https://hal.archives-ouvertes.fr/tel-01684685

A. A. Nugraha, A. Liutkus, and E. Vincent, Multichannel audio source separation with deep neural networks, IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol.24, issue.9, p.16521664, 2016.
URL : https://hal.archives-ouvertes.fr/hal-01163369

A. V. Oppenheim and R. W. Schafer, Discrete-Time Signal Processing, 2009.

V. Panayotov, G. Chen, D. Povey, and S. Khudanpur, Librispeech: An ASR corpus based on public domain audio books, IEEE International Conference on Acoustics, Speech and Signal Processing, p.52065210, 2015.

A. Pandey and D. Wang, A new framework for CNN-based speech enhancement in the time domain, Speech, and Language Processing, vol.27, p.11791188, 2019.

R. Parhizkar, I. Dokmani¢, and M. Vetterli, Single-channel indoor microphone localization, IEEE International Conference on Acoustics, Speech and Signal Processing, p.14341438, 2014.

M. Pariente, S. Cornell, A. Deleforge, and E. Vincent, Filterbank design for end-to-end speech separation, IEEE International Conference on Acoustics, Speech and Signal Processing, p.63646368, 2020.
URL : https://hal.archives-ouvertes.fr/hal-02355623

M. Pariente and D. Pressnitzer, Predictive denoising of speech in noise using deep neural networks, The Journal of the Acoustical Society of America, vol.142, issue.4, p.26112611, 2017.

D. Pavlidi, A. Grin, M. Puigt, and A. Mouchtaris, Real-time multiple sound source localization and counting using a circular microphone array, IEEE Transactions on Audio, Speech, and Language Processing, vol.21, issue.10, p.21932206, 2013.
URL : https://hal.archives-ouvertes.fr/hal-01367320

V. Peddinti, D. Povey, and S. Khudanpur, A time delay neural network architecture for ecient modeling of long temporal contexts, p.24402444, 2015.

S. Perez, Report: Voice assistants in use to triple to 8 billion by 2023, 2019.

L. Perotin, Localisation et Rehaussement de Sources de Parole au Format Ambisonique, 2019.
URL : https://hal.archives-ouvertes.fr/tel-02393258

L. Perotin, A. Défossez, E. Vincent, R. Serizel, and A. Guérin, Regression versus classication for neural network based audio source localization, IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, p.343347, 2019.

L. Perotin, R. Serizel, E. Vincent, and A. Guérin, Multichannel speech separation with recurrent neural networks from high-order ambisonics recordings, IEEE International Conference on Acoustics, Speech and Signal Processing, p.3640, 2018.
URL : https://hal.archives-ouvertes.fr/hal-01699759

L. Perotin, R. Serizel, E. Vincent, and A. Guérin, CRNN-based multiple DoA estimation using acoustic intensity features for ambisonics recordings, IEEE Journal of Selected Topics in Signal Processing, vol.13, issue.1, p.2233, 2019.
URL : https://hal.archives-ouvertes.fr/hal-01839883

D. Povey, Discriminative Training for Large Vocabulary Speech Recognition, 2003.

D. Povey, A. Ghoshal, G. Boulianne, L. Burget, O. Glembek et al., The Kaldi speech recognition toolkit, IEEE Workshop on Automatic Speech Recognition and Understanding, 2011.

D. Povey, V. Peddinti, D. Galvez, P. Ghahremani, V. Manohar et al., Purely sequence-trained neural networks for ASR based on lattice-free MMI, p.27512755, 2016.

K. Qian, Y. Zhang, S. Chang, X. Yang, D. Florencio et al., Deep learning based speech beamforming, IEEE International Conference on Acoustics, Speech and Signal Processing, p.53895393, 2018.

L. Rabiner and B. Juang, Fundamentals of Speech Recognition, 1993.

C. Rascon and I. Meza, Localization of sound sources in robotics: A review, Robotics and Autonomous Systems, vol.96, p.184210, 2017.

M. T. Ribeiro, S. Singh, and C. Guestrin, Why should I trust you? Explaining the predictions of any classier, ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, p.11351144, 2016.

S. Rickard and Ö. Ylmaz, On the approximate W-disjoint orthogonality of speech, IEEE International Conference on Acoustics, Speech and Signal Processing, vol.1, p.529532, 2002.

F. Rosenblatt, The perceptron: A probabilistic model for information storage and organization in the brain, Psychological Review, vol.65, issue.6, p.386408, 1958.

P. R. Roth, Eective measurements using digital signal analysis, IEEE Spectrum, vol.8, issue.4, p.6270, 1971.

N. Ryant, K. Church, C. Cieri, A. Cristia, J. Du et al., The second DIHARD diarization challenge: Dataset, task, and baselines, p.978982, 2019.

M. Sadeghi and X. Alameda-pineda, Robust unsupervised audio-visual speech enhancement using a mixture of variational autoencoders, IEEE International Conference on Acoustics, Speech and Signal Processing, p.75347538, 2020.
URL : https://hal.archives-ouvertes.fr/hal-02534911

M. Sadeghi, S. Leglaive, X. Alameda-pineda, L. Girin, and R. Horaud, Audio-visual speech enhancement using conditional variational auto-encoder

, IEEE/ACM Transactions on Audio, Speech and Language Processing

T. N. Sainath, R. J. Weiss, K. W. Wilson, A. Narayanan, M. Bacchiani et al., Raw multichannel processing using deep neural networks, New Era for Robust Speech Recognition: Exploiting Deep Learning, p.105133, 2017.

D. Salvati, C. Drioli, and G. L. Foresti, Exploiting CNNs for improving acoustic source localization in noisy and reverberant conditions, IEEE Transactions on Emerging Topics in Computational Intelligence, vol.2, issue.2, p.103116, 2018.

H. Sawada, S. Araki, R. Mukai, and S. Makino, Grouping separated frequency components by estimating propagation model parameters in frequency-domain blind source separation, IEEE Transactions on Audio, Speech, and Language Processing, vol.15, issue.5, p.15921604, 2007.

R. Schmidt, Multiple emitter location and signal parameter estimation, IEEE Transactions on Antennas and Propagation, vol.34, issue.3, p.276280, 1986.

R. R. Selvaraju, M. Cogswell, A. Das, R. Vedantam, D. Parikh et al., , 2017.

. Grad-cam, Visual explanations from deep networks via gradient-based localization, Proceedings of the IEEE international conference on computer vision, p.618626

R. Serizel, M. Moonen, B. Van-dijk, and J. Wouters, Low-rank approximation based multichannel Wiener lter algorithms for noise reduction with application in cochlear implants, IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol.22, issue.4, p.785799, 2014.

L. S. Shapley, A value for n-person games, Contributions to the Theory of Games, vol.2, p.307317, 1953.

Z. Shi, H. Lin, L. Liu, R. Liu, S. Hayakawa et al., Fur-caNet: An end-to-end deep gated convolutional, long short-term memory, deep neural networks for single channel speech separation, 2019.

A. Shrikumar, P. Greenside, and A. Kundaje, Learning important features through propagating activation dierences, International Conference on Machine Learning, p.31453153, 2017.

A. Shrikumar, P. Greenside, A. Shcherbina, and A. Kundaje, Not just a black box: Learning important features through propagating activation dierences, 2017.

K. Simonyan, A. Vedaldi, and A. Zisserman, Deep inside convolutional networks: Visualising image classication models and saliency maps, ICLR Workshop, 2014.

S. Sivasankaran, A. A. Nugraha, E. Vincent, J. A. Morales-cordovilla, S. Dalmia et al., Robust ASR using neural network based speech enhancement and feature simulation, IEEE Workshop on Automatic Speech Recognition and Understanding, p.482489, 2015.
URL : https://hal.archives-ouvertes.fr/hal-01204553

P. Smaragdis, Convolutive speech bases and their application to supervised speech separation, IEEE Transactions on Audio, Speech, and Language Processing, vol.15, issue.1, p.112, 2007.

P. Smaragdis and J. Brown, Non-negative matrix factorization for polyphonic music transcription, IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, p.177180, 2003.

D. Smilkov, N. Thorat, B. Kim, F. Viégas, and M. Wattenberg, Smooth-Grad: Removing noise by adding noise, ICML Workshop on Visualization for Deep Learning, 2017.

M. Souden, S. Araki, K. Kinoshita, T. Nakatani, and H. Sawada, A multichannel MMSE-based framework for speech source separation and noise reduction, IEEE Transactions on Audio, Speech, and Language Processing, vol.21, issue.9, p.19131928, 2013.

M. Souden, J. Benesty, A. , and S. , On optimal frequency-domain multichannel linear ltering for noise reduction, IEEE Transactions on Audio, Speech, and Language Processing, vol.18, issue.2, p.260276, 2010.

A. Spriet, M. Moonen, and J. Wouters, Spatially pre-processed speech distortion weighted multi-channel Wiener ltering for noise reduction, Signal Processing, vol.84, issue.12, p.23672387, 2004.

J. T. Springenberg, A. Dosovitskiy, T. Brox, and M. Riedmiller, Striving for simplicity: The all convolutional net, ICLR Workshop, 2015.

N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, , 2014.

, Dropout: A simple way to prevent neural networks from overtting, Journal of Machine Learning Research, vol.15, 19291958.

M. Sundararajan, A. Taly, Y. , and Q. , Axiomatic attribution for deep networks, International Conference on Machine Learning, p.33193328, 2017.

P. Swietojanski, J. Li, and S. Renals, Learning hidden unit contributions for unsupervised acoustic model adaptation, IEEE/ACM Transactions on Audio, Speech and Language Processing, vol.24, issue.8, p.14501463, 2016.

N. Takahashi, S. Parthasaarathy, N. Goswami, and Y. Mitsufuji, Recursive speech separation for unknown number of speakers, p.13481352, 2019.

R. Takeda and K. Komatani, Discriminative multiple sound source localization based on deep neural networks using independent location model, IEEE Spoken Language Technology Workshop, p.603609, 2016.

R. Talmon, I. Cohen, and S. Gannot, Supervised source localization using diusion kernels, IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, p.245248, 2011.

R. Talmon, D. Kushnir, R. R. Coifman, I. Cohen, and S. Gannot, Parametrization of linear systems using diusion kernels, IEEE Transactions on Signal Processing, vol.60, issue.3, p.11591173, 2012.

M. Taseska and E. A. Habets, MMSE-based source extraction using positionbased posterior probabilities, IEEE International Conference on Acoustics, Speech and Signal Processing, p.664668, 2013.

M. Taseska and E. A. Habets, Spotforming: Spatial ltering with distributed arrays for position-selective sound acquisition, IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol.24, issue.7, p.12911304, 2016.

M. Taseska and E. A. Habets, DOA-informed source extraction in the presence of competing talkers and background noise, EURASIP Journal on Advances in Signal Processing, vol.2017, issue.1, p.60, 2017.

I. J. Tashev, L. Le, V. Gopalakrishna, and A. Lovitt, Cost function for sound source localization with arbitrary microphone arrays, Joint Workshop on Hands-Free Speech Communications and Microphone Arrays, p.7680, 2017.

P. Taylor, Text-to-Speech Synthesis, 2009.

G. Tur, Spoken Language Understanding: Systems for Extracting Semantic Information from Speech, 2011.

M. Vacher, E. Vincent, M. Bobillier-chaumon, T. Joubert, F. Portet et al., The VocADom project: Speech interaction for well-being and reliance improvement, 20th International Conference on Human-Computer Interaction with Mobile Devices and Services, 2018.
URL : https://hal.archives-ouvertes.fr/hal-01830217

C. Valentini-botinhao, X. Wang, S. Takaki, Y. , and J. , Speech enhancement for a noise-robust text-to-speech synthesis system using deep recurrent neural networks, In Interspeech, p.352356, 2016.

A. Van-den-oord, S. Dieleman, H. Zen, K. Simonyan, O. Vinyals et al., Wavenet: A generative model for raw audio, 9th ISCA Speech Synthesis Workshop, p.125125, 2016.

H. L. Van-trees, Optimum Array Processing, 2002.

P. Vecchiotti, N. Ma, S. Squartini, and G. J. Brown, End-to-end binaural sound localisation from the raw waveform, IEEE International Conference on Acoustics, Speech and Signal Processing, p.451455, 2019.

K. Veselý, A. Ghoshal, L. Burget, and D. Povey, Sequence-discriminative training of deep neural networks. In Interspeech, p.23452349, 2013.

F. Vesperini, P. Vecchiotti, E. Principi, S. Squartini, and F. Piazza, A neural network based algorithm for speaker localization in a multi-room environment, IEEE International Workshop on Machine Learning for Signal Processing, p.16, 2016.

D. Vijayasenan and F. Valente, Speaker diarization of meetings based on large TDOA feature vectors, IEEE International Conference on Acoustics, Speech and Signal Processing, p.41734176, 2012.

E. Vincent, R. Gribonval, and C. Févotte, Performance measurement in blind audio source separation, IEEE Transactions on Audio, Speech, and Language Processing, vol.14, issue.4, p.14621469, 2006.
URL : https://hal.archives-ouvertes.fr/inria-00544230

E. Vincent, M. G. Jafari, S. A. Abdallah, M. D. Plumbley, and M. E. Davies, , 2011.

, Probabilistic modeling paradigms for audio source separation, Machine Audition: Principles, Algorithms and Systems, p.162185

E. Vincent, T. Virtanen, and S. Gannot, Audio Source Separation and Speech Enhancement, 2018.
URL : https://hal.archives-ouvertes.fr/hal-01881431

T. Virtanen, R. Singh, R. , and B. , Techniques for Noise Robustness in Automatic Speech Recognition, 2012.

Z. Wang, J. Li, Y. Yan, and E. Vincent, Semi-supervised learning with deep neural networks for relative transfer function inverse regression, IEEE International Conference on Acoustics, Speech and Signal Processing, p.191195, 2018.
URL : https://hal.archives-ouvertes.fr/hal-01797886

Z. Wang, E. Vincent, R. Serizel, Y. , and Y. , Rank-1 constrained multichannel Wiener lter for speech recognition in noisy environments, Computer Speech & Language, vol.49, p.3751, 2018.

Z. Wang and D. Wang, Combining spectral and spatial features for deep learning based blind speaker separation, Speech, and Language Processing, vol.27, p.457468, 2019.

Z. Wang, J. Le-roux, and J. R. Hershey, Alternative objective functions for deep clustering, IEEE International Conference on Acoustics, Speech and Signal Processing, p.686690, 2018.

Z. Wang, J. Le-roux, and J. R. Hershey, Multi-channel deep clustering: discriminative spectral and spatial embeddings for speaker-independent speech separation, IEEE International Conference on Acoustics, Speech and Signal Processing, p.15, 2018.

Z. Wang, J. Le-roux, D. Wang, and J. R. Hershey, End-to-end speech separation with unfolded iterative phase reconstruction, vol.2708, p.2712, 2018.

Z. Wang, K. Tan, W. , and D. , Deep learning based phase reconstruction for speaker separation: A trigonometric perspective, IEEE International Conference on Acoustics, Speech and Signal Processing, p.7175, 2019.

E. Warsitz and R. Haeb-umbach, Blind acoustic beamforming based on generalized eigenvalue decomposition, IEEE Transactions on Audio, Speech, and Language Processing, vol.15, issue.5, p.15291539, 2007.

S. Watanabe, M. Delcroix, F. Metze, and J. R. Hershey, New Era for Robust Speech Recognition: Exploiting Deep Learning, 2017.

G. Wichern, J. Antognini, M. Flynn, L. R. Zhu, E. Mcquinn et al., WHAM!: Extending speech separation to noisy environments, p.13681372, 2019.

M. Wölfel and J. Mcdonough, Distant Speech Recognition, 2009.

X. Xiao, S. Watanabe, H. Erdogan, L. Lu, J. R. Hershey et al., Deep beamforming networks for multichannel speech recognition, IEEE International Conference on Acoustics, Speech and Signal Processing, p.57455749, 2016.

X. Xiao, S. Zhao, X. Zhong, D. L. Jones, E. S. Chng et al., A learningbased approach to direction of arrival estimation in noisy and reverberant environments, IEEE International Conference on Acoustics, Speech and Signal Processing, p.28142818, 2015.

W. Xiong, J. Droppo, X. Huang, F. Seide, M. L. Seltzer et al., , 2017.

, IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol.25, issue.12, pp.2410-2423

O. Ylmaz and S. Rickard, Blind separation of speech mixtures via time-frequency masking, IEEE Transactions on Signal Processing, vol.52, issue.7, p.18301847, 2004.

J. Yin and T. Chen, Direction-of-arrival estimation using a sparse representation of array covariance vectors, IEEE Transactions on Signal Processing, vol.59, issue.9, p.44894493, 2011.

T. Yoshioka, N. Ito, M. Delcroix, A. Ogawa, K. Kinoshita et al., The NTT CHiME-3 system: Advances in speech enhancement and recognition for mobile multimicrophone devices, IEEE Workshop on Automatic Speech Recognition and Understanding, p.436443, 2015.

T. Yoshioka, A. Sehr, M. Delcroix, K. Kinoshita, R. Maas et al., Making machines understand us in reverberant rooms: Robustness against reverberation for automatic speech recognition, IEEE Signal Processing Magazine, vol.29, issue.6, p.114126, 2012.

S. J. Young, J. J. Odell, and P. C. Woodland, Tree-based state tying for high accuracy acoustic modelling, Workshop on Human Language Technology, p.307312, 1994.

D. Yu, M. Kolbaek, Z. Tan, and J. Jensen, Permutation invariant training of deep models for speaker-independent multi-talker speech separation, IEEE International Conference on Acoustics, Speech and Signal Processing, p.241245, 2017.

J. Yu, B. Wu, R. Gu, S. Zang, L. Chen et al., Audio-visual multi-channel recognition of overlapped speech, 2020.

M. D. Zeiler and R. Fergus, Visualizing and understanding convolutional networks, European Conference on Computer Vision, p.818833, 2014.

L. Zhang, Z. Shi, J. Han, A. Shi, and D. Ma, FurcaNeXt: End-to-end monaural speech separation with dynamic gated dilated temporal convolutional networks, International Conference on Multimedia Modeling, p.653665, 2020.

W. Zhang, Y. Zhou, and Y. Qian, Robust DOA estimation based on convolutional neural network and time-frequency masking, p.27032707, 2019.

K. Molíková, M. Delcroix, K. Kinoshita, T. Ochiai, T. Nakatani et al., SpeakerBeam: Speaker aware neural network for target speaker extraction in speech mixtures, IEEE Journal of Selected Topics in Signal Processing, vol.13, issue.4, p.800814, 2019.