Overview of CENTRE@CLEF 2019: Sequel in the Systematic Reproducibility Realm

Nicola Ferro; Norbert Fuhr; Maria Maistro; Tetsuya Sakai; Ian Soboroff

doi:10.1007/978-3-030-28577-7_24

Overview of CENTRE@CLEF 2019: Sequel in the Systematic Reproducibility Realm

Nicola Ferro^*, Norbert Fuhr, Maria Maistro, Tetsuya Sakai, Ian Soboroff

^*Corresponding author for this work

Machine Learning

Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review

10 Citations (Scopus)

Abstract

Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our second attempt to propose a lab on reproducibility named CENTRE, held during CLEF 2019. The aim of CENTRE is to run both a replicability and reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the second edition of CENTRE@CLEF 2019.

Original language	English
Title of host publication	Experimental IR Meets Multilinguality, Multimodality, and Interaction : 10th International Conference of the CLEF Association, CLEF 2019 Lugano, Switzerland, September 9–12, 2019 Proceedings
Editors	Fabio Crestani, Martin Braschler, Jacques Savoy, Andreas Rauber, Henning Müller, David E. Losada, Gundula Heinatz Bürki, Linda Cappellato, Nicola Ferro
Publisher	Springer
Publication date	2019
Pages	287-300
ISBN (Print)	9783030285760
DOIs	https://doi.org/10.1007/978-3-030-28577-7_24
Publication status	Published - 2019
Event	10th International Conference of the CLEF Association, CLEF 2019 - Lugano, Switzerland Duration: 9 Sep 2019 → 12 Sep 2019

Conference

Conference	10th International Conference of the CLEF Association, CLEF 2019
Country/Territory	Switzerland
City	Lugano
Period	09/09/2019 → 12/09/2019

Series	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	11696 LNCS
ISSN	0302-9743

Access to Document

10.1007/978-3-030-28577-7_24

Cite this

Ferro, N., Fuhr, N., Maistro, M., Sakai, T., & Soboroff, I. (2019). Overview of CENTRE@CLEF 2019: Sequel in the Systematic Reproducibility Realm. In F. Crestani, M. Braschler, J. Savoy, A. Rauber, H. Müller, D. E. Losada, G. Heinatz Bürki, L. Cappellato, & N. Ferro (Eds.), Experimental IR Meets Multilinguality, Multimodality, and Interaction: 10th International Conference of the CLEF Association, CLEF 2019 Lugano, Switzerland, September 9–12, 2019 Proceedings (pp. 287-300). Springer. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) Vol. 11696 LNCS https://doi.org/10.1007/978-3-030-28577-7_24

Overview of CENTRE@CLEF 2019 : Sequel in the Systematic Reproducibility Realm. / Ferro, Nicola; Fuhr, Norbert; Maistro, Maria; Sakai, Tetsuya; Soboroff, Ian.

Experimental IR Meets Multilinguality, Multimodality, and Interaction: 10th International Conference of the CLEF Association, CLEF 2019 Lugano, Switzerland, September 9–12, 2019 Proceedings. ed. / Fabio Crestani; Martin Braschler; Jacques Savoy; Andreas Rauber; Henning Müller; David E. Losada; Gundula Heinatz Bürki; Linda Cappellato; Nicola Ferro. Springer, 2019. p. 287-300 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 11696 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review

Ferro, N, Fuhr, N, Maistro, M, Sakai, T & Soboroff, I 2019, Overview of CENTRE@CLEF 2019: Sequel in the Systematic Reproducibility Realm. in F Crestani, M Braschler, J Savoy, A Rauber, H Müller, DE Losada, G Heinatz Bürki, L Cappellato & N Ferro (eds), Experimental IR Meets Multilinguality, Multimodality, and Interaction: 10th International Conference of the CLEF Association, CLEF 2019 Lugano, Switzerland, September 9–12, 2019 Proceedings. Springer, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11696 LNCS, pp. 287-300, 10th International Conference of the CLEF Association, CLEF 2019, Lugano, Switzerland, 09/09/2019. https://doi.org/10.1007/978-3-030-28577-7_24

Ferro N, Fuhr N, Maistro M, Sakai T, Soboroff I. Overview of CENTRE@CLEF 2019: Sequel in the Systematic Reproducibility Realm. In Crestani F, Braschler M, Savoy J, Rauber A, Müller H, Losada DE, Heinatz Bürki G, Cappellato L, Ferro N, editors, Experimental IR Meets Multilinguality, Multimodality, and Interaction: 10th International Conference of the CLEF Association, CLEF 2019 Lugano, Switzerland, September 9–12, 2019 Proceedings. Springer. 2019. p. 287-300. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 11696 LNCS). https://doi.org/10.1007/978-3-030-28577-7_24

Ferro, Nicola ; Fuhr, Norbert ; Maistro, Maria ; Sakai, Tetsuya ; Soboroff, Ian. / Overview of CENTRE@CLEF 2019 : Sequel in the Systematic Reproducibility Realm. Experimental IR Meets Multilinguality, Multimodality, and Interaction: 10th International Conference of the CLEF Association, CLEF 2019 Lugano, Switzerland, September 9–12, 2019 Proceedings. editor / Fabio Crestani ; Martin Braschler ; Jacques Savoy ; Andreas Rauber ; Henning Müller ; David E. Losada ; Gundula Heinatz Bürki ; Linda Cappellato ; Nicola Ferro. Springer, 2019. pp. 287-300 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 11696 LNCS).

@inproceedings{fff45e725fbe4e228664670a8eaf6f50,

title = "Overview of CENTRE@CLEF 2019: Sequel in the Systematic Reproducibility Realm",

abstract = "Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our second attempt to propose a lab on reproducibility named CENTRE, held during CLEF 2019. The aim of CENTRE is to run both a replicability and reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the second edition of CENTRE@CLEF 2019.",

author = "Nicola Ferro and Norbert Fuhr and Maria Maistro and Tetsuya Sakai and Ian Soboroff",

year = "2019",

doi = "10.1007/978-3-030-28577-7_24",

language = "English",

isbn = "9783030285760",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer",

pages = "287--300",

editor = "Fabio Crestani and Martin Braschler and Jacques Savoy and Andreas Rauber and Henning M{\"u}ller and Losada, {David E.} and {Heinatz B{\"u}rki}, Gundula and Linda Cappellato and Nicola Ferro",

booktitle = "Experimental IR Meets Multilinguality, Multimodality, and Interaction",

address = "Switzerland",

note = "10th International Conference of the CLEF Association, CLEF 2019 ; Conference date: 09-09-2019 Through 12-09-2019",

}

TY - GEN

T1 - Overview of CENTRE@CLEF 2019

T2 - 10th International Conference of the CLEF Association, CLEF 2019

AU - Ferro, Nicola

AU - Fuhr, Norbert

AU - Maistro, Maria

AU - Sakai, Tetsuya

AU - Soboroff, Ian

PY - 2019

Y1 - 2019

N2 - Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our second attempt to propose a lab on reproducibility named CENTRE, held during CLEF 2019. The aim of CENTRE is to run both a replicability and reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the second edition of CENTRE@CLEF 2019.

AB - Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our second attempt to propose a lab on reproducibility named CENTRE, held during CLEF 2019. The aim of CENTRE is to run both a replicability and reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the second edition of CENTRE@CLEF 2019.

UR - http://www.scopus.com/inward/record.url?scp=85070722624&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-28577-7_24

DO - 10.1007/978-3-030-28577-7_24

M3 - Article in proceedings

AN - SCOPUS:85070722624

SN - 9783030285760

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 287

EP - 300

BT - Experimental IR Meets Multilinguality, Multimodality, and Interaction

A2 - Crestani, Fabio

A2 - Braschler, Martin

A2 - Savoy, Jacques

A2 - Rauber, Andreas

A2 - Müller, Henning

A2 - Losada, David E.

A2 - Heinatz Bürki, Gundula

A2 - Cappellato, Linda

A2 - Ferro, Nicola

PB - Springer

Y2 - 9 September 2019 through 12 September 2019

ER -