Skip to Main content Skip to Navigation
Theses

Acquisition et modélisation de données articulatoires dans un contexte multimodal

Abstract : There is no single technique that will allow all relevant behaviour of the speech articulators (lips, tongue, palate...) to be spatially ant temporally acquired. Thus, this thesis investigates the fusion of multimodal articulatory data. A framework is described in order to acquire and fuse automatically an important database of articulatory data. This includes: 2D Ultrasound (US) data to recover the dynamic of the tongue, stereovision data to recover the 3D dynamic of the lips, electromagnetic sensors that provide 3D position of points on the face and the tongue, and 3D Magnetic Resonance Imaging (MRI) that depict the vocal tract for various sustained articulations. We investigate the problems of the temporal synchronization and the spatial registration between all these modalities, and also the extraction of the shape articulators from the data (tongue tracking in US images). We evaluate the uncertainty of our system by quantifying the spatial and temporal inaccuracies of the components of the system, both individually and in combination. Finally, the fused data are evaluated on an existing articulatory model to assess their quality for an application in speech production.
Document type :
Theses
Complete list of metadatas

Cited literature [109 references]  Display  Hide  Download

https://hal.univ-lorraine.fr/tel-01748311
Contributor : Thèses Ul <>
Submitted on : Thursday, March 29, 2018 - 11:31:21 AM
Last modification on : Friday, October 23, 2020 - 5:01:20 PM
Long-term archiving on: : Friday, September 14, 2018 - 8:57:05 AM

File

SCD_T_2009_0097_ARON.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : tel-01748311, version 1

Collections

Citation

Michaël Aron. Acquisition et modélisation de données articulatoires dans un contexte multimodal. Autre [cs.OH]. Université Henri Poincaré - Nancy 1, 2009. Français. ⟨NNT : 2009NAN10097⟩. ⟨tel-01748311⟩

Share

Metrics

Record views

52

Files downloads

352