CheckThat! at CLEF 2019: Automatic Identification and Verification of Claims.

Tamer Elsayed; Preslav Nakov; Alberto Barrón-Cedeño; Maram Hasanain; Reem Suwaileh; Giovanni Da San Martino; Pepa Atanasova

doi:10.1007/978-3-030-15719-7_41

CheckThat! at CLEF 2019: Automatic Identification and Verification of Claims.

Tamer Elsayed, Preslav Nakov, Alberto Barrón-Cedeño, Maram Hasanain, Reem Suwaileh, Giovanni Da San Martino, Pepa Atanasova

Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review

39 Citations (Scopus)

Abstract

We introduce the second edition of the CheckThat! Lab, part of the 2019 Cross-Language Evaluation Forum (CLEF). CheckThat! proposes two complementary tasks. Task 1: predict which claims in a political debate should be prioritized for fact-checking. Task 2: rank Web-retrieved pages against a check-worthy claim based on their usefulness for fact-checking, extract useful passages from those pages, and then use them all to decide whether the claim is factually true or false. Checkthat! provides a full evaluation framework, consisting of data in English (derived from fact-checking sources) and Arabic (gathered and annotated from scratch) and evaluation based on mean average precision (MAP) for ranking and F
for classification tasks.

Original language	English
Title of host publication	Advances in Information Retrieval : 41st European Conference on IR Research, ECIR 2019, Cologne, Germany, April 14–18, 2019, Proceedings, Part II
Number of pages	7
Publisher	Springer
Publication date	2019
Pages	309-315
DOIs	https://doi.org/10.1007/978-3-030-15719-7_41
Publication status	Published - 2019
Externally published	Yes

Bibliographical note

DBLP License: DBLP's bibliographic metadata records provided through http://dblp.org/ are distributed under a Creative Commons CC0 1.0 Universal Public Domain Dedication. Although the bibliographic metadata records are provided consistent with CC0 1.0 Dedication, the content described by the metadata records is not. Content may be subject to copyright, rights of privacy, rights of publicity and other restrictions.

Access to Document

10.1007/978-3-030-15719-7_41

Cite this

Elsayed, T., Nakov, P., Barrón-Cedeño, A., Hasanain, M., Suwaileh, R., Martino, G. D. S., & Atanasova, P. (2019). CheckThat! at CLEF 2019: Automatic Identification and Verification of Claims. In Advances in Information Retrieval: 41st European Conference on IR Research, ECIR 2019, Cologne, Germany, April 14–18, 2019, Proceedings, Part II (pp. 309-315). Springer. https://doi.org/10.1007/978-3-030-15719-7_41

CheckThat! at CLEF 2019: Automatic Identification and Verification of Claims. / Elsayed, Tamer; Nakov, Preslav; Barrón-Cedeño, Alberto et al.
Advances in Information Retrieval: 41st European Conference on IR Research, ECIR 2019, Cologne, Germany, April 14–18, 2019, Proceedings, Part II. Springer, 2019. p. 309-315.

Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review

Elsayed, T, Nakov, P, Barrón-Cedeño, A, Hasanain, M, Suwaileh, R, Martino, GDS & Atanasova, P 2019, CheckThat! at CLEF 2019: Automatic Identification and Verification of Claims. in Advances in Information Retrieval: 41st European Conference on IR Research, ECIR 2019, Cologne, Germany, April 14–18, 2019, Proceedings, Part II. Springer, pp. 309-315. https://doi.org/10.1007/978-3-030-15719-7_41

Elsayed T, Nakov P, Barrón-Cedeño A, Hasanain M, Suwaileh R, Martino GDS et al. CheckThat! at CLEF 2019: Automatic Identification and Verification of Claims. In Advances in Information Retrieval: 41st European Conference on IR Research, ECIR 2019, Cologne, Germany, April 14–18, 2019, Proceedings, Part II. Springer. 2019. p. 309-315 doi: 10.1007/978-3-030-15719-7_41

@inproceedings{ec82adb0fd8240998bda314c5809c043,

title = "CheckThat! at CLEF 2019: Automatic Identification and Verification of Claims.",

abstract = "We introduce the second edition of the CheckThat! Lab, part of the 2019 Cross-Language Evaluation Forum (CLEF). CheckThat! proposes two complementary tasks. Task 1: predict which claims in a political debate should be prioritized for fact-checking. Task 2: rank Web-retrieved pages against a check-worthy claim based on their usefulness for fact-checking, extract useful passages from those pages, and then use them all to decide whether the claim is factually true or false. Checkthat! provides a full evaluation framework, consisting of data in English (derived from fact-checking sources) and Arabic (gathered and annotated from scratch) and evaluation based on mean average precision (MAP) for ranking and F for classification tasks.",

author = "Tamer Elsayed and Preslav Nakov and Alberto Barr{\'o}n-Cede{\~n}o and Maram Hasanain and Reem Suwaileh and Martino, {Giovanni Da San} and Pepa Atanasova",

note = "DBLP License: DBLP's bibliographic metadata records provided through http://dblp.org/ are distributed under a Creative Commons CC0 1.0 Universal Public Domain Dedication. Although the bibliographic metadata records are provided consistent with CC0 1.0 Dedication, the content described by the metadata records is not. Content may be subject to copyright, rights of privacy, rights of publicity and other restrictions.",

year = "2019",

doi = "10.1007/978-3-030-15719-7_41",

language = "English",

pages = "309--315",

booktitle = "Advances in Information Retrieval",

publisher = "Springer",

address = "Switzerland",

}

TY - GEN

T1 - CheckThat! at CLEF 2019: Automatic Identification and Verification of Claims.

AU - Elsayed, Tamer

AU - Nakov, Preslav

AU - Barrón-Cedeño, Alberto

AU - Hasanain, Maram

AU - Suwaileh, Reem

AU - Martino, Giovanni Da San

AU - Atanasova, Pepa

N1 - DBLP License: DBLP's bibliographic metadata records provided through http://dblp.org/ are distributed under a Creative Commons CC0 1.0 Universal Public Domain Dedication. Although the bibliographic metadata records are provided consistent with CC0 1.0 Dedication, the content described by the metadata records is not. Content may be subject to copyright, rights of privacy, rights of publicity and other restrictions.

PY - 2019

Y1 - 2019

N2 - We introduce the second edition of the CheckThat! Lab, part of the 2019 Cross-Language Evaluation Forum (CLEF). CheckThat! proposes two complementary tasks. Task 1: predict which claims in a political debate should be prioritized for fact-checking. Task 2: rank Web-retrieved pages against a check-worthy claim based on their usefulness for fact-checking, extract useful passages from those pages, and then use them all to decide whether the claim is factually true or false. Checkthat! provides a full evaluation framework, consisting of data in English (derived from fact-checking sources) and Arabic (gathered and annotated from scratch) and evaluation based on mean average precision (MAP) for ranking and F for classification tasks.

AB - We introduce the second edition of the CheckThat! Lab, part of the 2019 Cross-Language Evaluation Forum (CLEF). CheckThat! proposes two complementary tasks. Task 1: predict which claims in a political debate should be prioritized for fact-checking. Task 2: rank Web-retrieved pages against a check-worthy claim based on their usefulness for fact-checking, extract useful passages from those pages, and then use them all to decide whether the claim is factually true or false. Checkthat! provides a full evaluation framework, consisting of data in English (derived from fact-checking sources) and Arabic (gathered and annotated from scratch) and evaluation based on mean average precision (MAP) for ranking and F for classification tasks.

U2 - 10.1007/978-3-030-15719-7_41

DO - 10.1007/978-3-030-15719-7_41

M3 - Article in proceedings

SP - 309

EP - 315

BT - Advances in Information Retrieval

PB - Springer

ER -