Overview of CENTRE@CLEF 2018: A first tale in the systematic reproducibility realm

Nicola Ferro, Maria Maistro*, Tetsuya Sakai, Ian Soboroff

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

17 Citations (Scopus)

Abstract

Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our first attempt to propose a lab on reproducibility named CENTRE and held during CLEF 2018. The aim of CENTRE is to run a reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the first edition of CENTRE@CLEF 2018, as well as some suggestions for future editions.

Original languageEnglish
Title of host publicationExperimental IR Meets Multilinguality, Multimodality, and Interaction - 9th International Conference of the CLEF Association, CLEF 2018, Proceedings
EditorsEric SanJuan, Fionn Murtagh, Jian Yun Nie, Laure Soulier, Linda Cappellato, Patrice Bellot, Josiane Mothe, Chiraz Trabelsi, Nicola Ferro
Number of pages8
PublisherSpringer
Publication date1 Jan 2018
Pages239-246
ISBN (Print)9783319989310
DOIs
Publication statusPublished - 1 Jan 2018
Externally publishedYes
Event9th International Conference of the CLEF Association, CLEF 2018 - Avignon, France
Duration: 10 Sep 201814 Sep 2018

Conference

Conference9th International Conference of the CLEF Association, CLEF 2018
Country/TerritoryFrance
CityAvignon
Period10/09/201814/09/2018
SeriesLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11018 LNCS
ISSN0302-9743

Cite this