OATAO - Open Archive Toulouse Archive Ouverte Open Access Week

IRIT at CheckThat! 2018

Agez, Romain and Bosc, Clément and Lespagnol, Cédric and Mothe, Josiane and Petitcol, Noémie IRIT at CheckThat! 2018. (2018) In: 9th Conference and Labs of the Evaluation Forum, Living Labs (CLEF 2018), 10 September 2018 - 14 September 2018 (Avignon, France).

(Document in English)

PDF (Author's version) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader

Official URL: http://ceur-ws.org/Vol-2125/paper_132.pdf


The 2018 CLEF CheckThat! is composed of two tasks: (1) Check-Worthiness and (2) Factuality. We participated to task (1) only which purpose is to evaluate the check-worthiness of claims in political debates. Our method to achieve this goal is to represent each claim by a vector of five computed values that correspond to scores on five criteria. These vectors are then used with machine learning algorithms to classify claims as check-worthy or not. We submitted three runs using different machine learning algorithms. The best result we achieved using the offi-cial measure MAP ranks our primary run the 12th over the 16 submitted runs. Our first contrastive run is ranked 2nd with the Mean Precision@1 measure.

Item Type:Conference or Workshop Item (Paper)
Additional Information:Thanks to CEUR editor, a free open-access publication service of Sun SITE Central Europe operated under the umbrella of RWTH Aachen University. This paper appears in vol 2125 Ceur Workshop Proceedings ISSN : 1613-0073 The definitive version is available at http://ceur-ws.org/Vol-2125/paper_132.pdf
HAL Id:hal-02289947
Audience (conference):International conference proceedings
Uncontrolled Keywords:
Institution:Université de Toulouse > Institut National Polytechnique de Toulouse - Toulouse INP (FRANCE)
French research institutions > Centre National de la Recherche Scientifique - CNRS (FRANCE)
Université de Toulouse > Université Toulouse III - Paul Sabatier - UT3 (FRANCE)
Université de Toulouse > Université Toulouse - Jean Jaurès - UT2J (FRANCE)
Université de Toulouse > Université Toulouse 1 Capitole - UT1 (FRANCE)
Laboratory name:
Deposited On:12 Sep 2019 10:06

Repository Staff Only: item control page