Skip to Main content Skip to Navigation

Analyse contextuelle des gestes de désignation en dialogue homme-machine

Abstract : Usual interfaces suppose the user to translate his intention into machine language, i.e. software commands. On the contrary, multimodal Human-Computer interfaces appear to the user as a communication partner able to adapt to his expression. However, almost ail works are devoted to the verbal aspect of human expression, and limit gesture to simple and stereotypic forms like pointings. This study is aimed at modelling natural referring gestures appearing in multimodal dialogues. Indeed, psychological works indicate the importance and omnipresence of gestures in Human-Human communication. Moreover, these approaches reveal the role of prime importance played by perception to prepare, produce, control and interpret gestures. Our work investigates the relations between perception and action on the basis of empirical date collected through a Wizard of Oz experiment. A dedicated experimentation soft-ware has been especially developed to record and study spatial and temporal dialogue features in more accurate way than usual data. The corpus study has shown the strong influence of perceptual context on multimodal expression and in particular on gesture. On this conclusion, a perception oriented contextual gesture analysis has been developed allowing to face wilh the numerous variability and ambiguity sources. Psychological principles as affordances and the Gestalttheorie laws introduced in our approach allow us to narrow perception and referring action, and 50 to put action back in its perceptual context of production.
Document type :
Complete list of metadata
Contributor : Thèses UL Connect in order to contact the contributor
Submitted on : Thursday, March 29, 2018 - 10:50:32 AM
Last modification on : Monday, January 11, 2021 - 1:30:01 PM

Links full text


  • HAL Id : tel-01747072, version 1



Frédéric Wolff. Analyse contextuelle des gestes de désignation en dialogue homme-machine. Autre [cs.OH]. Université Henri Poincaré - Nancy 1, 1999. Français. ⟨NNT : 1999NAN10042⟩. ⟨tel-01747072⟩



Record views