Skip to Main content Skip to Navigation
Theses

Traitement automatique des langues et génération automatique d'exercices de grammaire

Émilie Colin 1
1 SYNALP - Natural Language Processing : representations, inference and semantics
LORIA - NLPKD - Department of Natural Language Processing & Knowledge Discovery
Abstract : Our perspectives are educational, to create grammar exercises for French. Paraphrasing is an operation of reformulation. Our work tends to attest that sequence-to-sequence models are not simple repeaters but can learn syntax. First, by combining various models, we have shown that the representation of information in multiple forms (using formal data (RDF), coupled with text to extend or reduce it, or only text) allows us to exploit a corpus from different angles, increasing the diversity of outputs, exploiting the syntactic levers put in place. We also addressed a recurrent problem, that of data quality, and obtained paraphrases with a high syntactic adequacy (up to 98% coverage of the demand) and a very good linguistic level. We obtain up to 83.97 points of BLEU-4*, 78.41 more than our baseline average, without syntax leverage. This rate indicates a better control of the outputs, which are varied and of good quality in the absence of syntax leverage. Our idea was to be able to work from raw text : to produce a representation of its meaning. The transition to French text was also an imperative for us. Working from plain text, by automating the procedures, allowed us to create a corpus of more than 450,000 sentence/representation pairs, thanks to which we learned to generate massively correct texts (92% on qualitative validation). Anonymizing everything that is not functional contributed significantly to the quality of the results (68.31 of BLEU, i.e. +3.96 compared to the baseline, which was the generation of text from non-anonymized data). This second work can be applied the integration of a syntax lever guiding the outputs. What was our baseline at time 1 (generate without constraint) would then be combined with a constrained model. By applying an error search, this would allow the constitution of a silver base associating representations to texts. This base could then be multiplied by a reapplication of a generation under constraint, and thus achieve the applied objective of the thesis. The formal representation of information in a language-specific framework is a challenging task. This thesis offers some ideas on how to automate this operation. Moreover, we were only able to process relatively short sentences. The use of more recent neural modelswould likely improve the results. The use of appropriate output strokes would allow for extensive checks. *BLEU : quality of a text (scale from 0 (worst) to 100 (best), Papineni et al. (2002))
Document type :
Theses
Complete list of metadatas

Cited literature [190 references]  Display  Hide  Download

https://hal.univ-lorraine.fr/tel-02949349
Contributor : Thèses Ul <>
Submitted on : Friday, September 25, 2020 - 3:15:34 PM
Last modification on : Wednesday, October 14, 2020 - 4:04:47 AM

File

DDOC_T_2020_0059_COLIN.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : tel-02949349, version 1

Citation

Émilie Colin. Traitement automatique des langues et génération automatique d'exercices de grammaire. Traitement du texte et du document. Université de Lorraine, 2020. Français. ⟨NNT : 2020LORR0059⟩. ⟨tel-02949349⟩

Share

Metrics

Record views

84

Files downloads

296