CheckThat! at CLEF 2019: Automatic Identification and Verification of Claims.

Tamer Elsayed; Preslav Nakov; Alberto Barrón-Cedeño; Maram Hasanain; Reem Suwaileh; Giovanni Da San Martino; Pepa Atanasova

doi:10.1007/978-3-030-15719-7_41

CheckThat! at CLEF 2019: Automatic Identification and Verification of Claims.

Tamer Elsayed, Preslav Nakov, Alberto Barrón-Cedeño, Maram Hasanain, Reem Suwaileh, Giovanni Da San Martino, Pepa Atanasova

Publikation: Bidrag til bog/antologi/rapport › Konferencebidrag i proceedings › Forskning › peer review

39 Citationer (Scopus)

Abstract

We introduce the second edition of the CheckThat! Lab, part of the 2019 Cross-Language Evaluation Forum (CLEF). CheckThat! proposes two complementary tasks. Task 1: predict which claims in a political debate should be prioritized for fact-checking. Task 2: rank Web-retrieved pages against a check-worthy claim based on their usefulness for fact-checking, extract useful passages from those pages, and then use them all to decide whether the claim is factually true or false. Checkthat! provides a full evaluation framework, consisting of data in English (derived from fact-checking sources) and Arabic (gathered and annotated from scratch) and evaluation based on mean average precision (MAP) for ranking and F
for classification tasks.

Originalsprog	Engelsk
Titel	Advances in Information Retrieval : 41st European Conference on IR Research, ECIR 2019, Cologne, Germany, April 14–18, 2019, Proceedings, Part II
Antal sider	7
Forlag	Springer
Publikationsdato	2019
Sider	309-315
DOI	https://doi.org/10.1007/978-3-030-15719-7_41
Status	Udgivet - 2019
Udgivet eksternt	Ja

Bibliografisk note

DBLP License: DBLP's bibliographic metadata records provided through http://dblp.org/ are distributed under a Creative Commons CC0 1.0 Universal Public Domain Dedication. Although the bibliographic metadata records are provided consistent with CC0 1.0 Dedication, the content described by the metadata records is not. Content may be subject to copyright, rights of privacy, rights of publicity and other restrictions.

Adgang til dokumentet

10.1007/978-3-030-15719-7_41

Citationsformater

Elsayed, T., Nakov, P., Barrón-Cedeño, A., Hasanain, M., Suwaileh, R., Martino, G. D. S., & Atanasova, P. (2019). CheckThat! at CLEF 2019: Automatic Identification and Verification of Claims. I Advances in Information Retrieval: 41st European Conference on IR Research, ECIR 2019, Cologne, Germany, April 14–18, 2019, Proceedings, Part II (s. 309-315). Springer. https://doi.org/10.1007/978-3-030-15719-7_41

CheckThat! at CLEF 2019: Automatic Identification and Verification of Claims. / Elsayed, Tamer; Nakov, Preslav; Barrón-Cedeño, Alberto et al.
Advances in Information Retrieval: 41st European Conference on IR Research, ECIR 2019, Cologne, Germany, April 14–18, 2019, Proceedings, Part II. Springer, 2019. s. 309-315.

Publikation: Bidrag til bog/antologi/rapport › Konferencebidrag i proceedings › Forskning › peer review

Elsayed, T, Nakov, P, Barrón-Cedeño, A, Hasanain, M, Suwaileh, R, Martino, GDS & Atanasova, P 2019, CheckThat! at CLEF 2019: Automatic Identification and Verification of Claims. i Advances in Information Retrieval: 41st European Conference on IR Research, ECIR 2019, Cologne, Germany, April 14–18, 2019, Proceedings, Part II. Springer, s. 309-315. https://doi.org/10.1007/978-3-030-15719-7_41

Elsayed T, Nakov P, Barrón-Cedeño A, Hasanain M, Suwaileh R, Martino GDS et al. CheckThat! at CLEF 2019: Automatic Identification and Verification of Claims. I Advances in Information Retrieval: 41st European Conference on IR Research, ECIR 2019, Cologne, Germany, April 14–18, 2019, Proceedings, Part II. Springer. 2019. s. 309-315 doi: 10.1007/978-3-030-15719-7_41

@inproceedings{ec82adb0fd8240998bda314c5809c043,

title = "CheckThat! at CLEF 2019: Automatic Identification and Verification of Claims.",

abstract = "We introduce the second edition of the CheckThat! Lab, part of the 2019 Cross-Language Evaluation Forum (CLEF). CheckThat! proposes two complementary tasks. Task 1: predict which claims in a political debate should be prioritized for fact-checking. Task 2: rank Web-retrieved pages against a check-worthy claim based on their usefulness for fact-checking, extract useful passages from those pages, and then use them all to decide whether the claim is factually true or false. Checkthat! provides a full evaluation framework, consisting of data in English (derived from fact-checking sources) and Arabic (gathered and annotated from scratch) and evaluation based on mean average precision (MAP) for ranking and F for classification tasks.",

author = "Tamer Elsayed and Preslav Nakov and Alberto Barr{\'o}n-Cede{\~n}o and Maram Hasanain and Reem Suwaileh and Martino, {Giovanni Da San} and Pepa Atanasova",

note = "DBLP License: DBLP's bibliographic metadata records provided through http://dblp.org/ are distributed under a Creative Commons CC0 1.0 Universal Public Domain Dedication. Although the bibliographic metadata records are provided consistent with CC0 1.0 Dedication, the content described by the metadata records is not. Content may be subject to copyright, rights of privacy, rights of publicity and other restrictions.",

year = "2019",

doi = "10.1007/978-3-030-15719-7_41",

language = "English",

pages = "309--315",

booktitle = "Advances in Information Retrieval",

publisher = "Springer",

address = "Switzerland",

}

TY - GEN

T1 - CheckThat! at CLEF 2019: Automatic Identification and Verification of Claims.

AU - Elsayed, Tamer

AU - Nakov, Preslav

AU - Barrón-Cedeño, Alberto

AU - Hasanain, Maram

AU - Suwaileh, Reem

AU - Martino, Giovanni Da San

AU - Atanasova, Pepa

N1 - DBLP License: DBLP's bibliographic metadata records provided through http://dblp.org/ are distributed under a Creative Commons CC0 1.0 Universal Public Domain Dedication. Although the bibliographic metadata records are provided consistent with CC0 1.0 Dedication, the content described by the metadata records is not. Content may be subject to copyright, rights of privacy, rights of publicity and other restrictions.

PY - 2019

Y1 - 2019

N2 - We introduce the second edition of the CheckThat! Lab, part of the 2019 Cross-Language Evaluation Forum (CLEF). CheckThat! proposes two complementary tasks. Task 1: predict which claims in a political debate should be prioritized for fact-checking. Task 2: rank Web-retrieved pages against a check-worthy claim based on their usefulness for fact-checking, extract useful passages from those pages, and then use them all to decide whether the claim is factually true or false. Checkthat! provides a full evaluation framework, consisting of data in English (derived from fact-checking sources) and Arabic (gathered and annotated from scratch) and evaluation based on mean average precision (MAP) for ranking and F for classification tasks.

AB - We introduce the second edition of the CheckThat! Lab, part of the 2019 Cross-Language Evaluation Forum (CLEF). CheckThat! proposes two complementary tasks. Task 1: predict which claims in a political debate should be prioritized for fact-checking. Task 2: rank Web-retrieved pages against a check-worthy claim based on their usefulness for fact-checking, extract useful passages from those pages, and then use them all to decide whether the claim is factually true or false. Checkthat! provides a full evaluation framework, consisting of data in English (derived from fact-checking sources) and Arabic (gathered and annotated from scratch) and evaluation based on mean average precision (MAP) for ranking and F for classification tasks.

U2 - 10.1007/978-3-030-15719-7_41

DO - 10.1007/978-3-030-15719-7_41

M3 - Article in proceedings

SP - 309

EP - 315

BT - Advances in Information Retrieval

PB - Springer

ER -