CENTRE@CLEF2018: Overview of the replicability task

Nicola Ferro, Maria Maistro, Tetsuya Sakai, Ian Soboroff

Research output: Contribution to journalConference articleResearchpeer-review

Abstract

Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our first attempt to propose a lab on reproducibility named CENTRE and held during CLEF 2018. The aim of CENTRE is to run a reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the first edition of CENTRE@CLEF 2018, as well as some suggestions for future editions.

Original languageEnglish
JournalCEUR Workshop Proceedings
Volume2125
ISSN1613-0073
Publication statusPublished - 1 Jan 2018
Externally publishedYes
Event19th Working Notes of CLEF Conference and Labs of the Evaluation Forum, CLEF 2018 - Avignon, France
Duration: 10 Sep 201814 Sep 2018

Conference

Conference19th Working Notes of CLEF Conference and Labs of the Evaluation Forum, CLEF 2018
Country/TerritoryFrance
CityAvignon
Period10/09/201814/09/2018

Cite this