Repeatability and workability evaluation of SIGMOD 2011

Philippe Bonnet; Stefan Manegold; Matias Bjørling; Wei Cao; Javier Gonzalez; Joel Granados; Nancy Hall; Stratos Idreos; Milena Ivanova; Ryan Johnson; David Koop; Tim Kraska; René Müller; Dan Olteanu; Paolo Papotti; Christine Reilly; Dimitris Tsirogiannis; Cong Yu; Juliana Freire; Dennis Shasha

doi:10.1145/2034863.2034873

Repeatability and workability evaluation of SIGMOD 2011

Philippe Bonnet^*, Stefan Manegold, Matias Bjørling, Wei Cao, Javier Gonzalez, Joel Granados, Nancy Hall, Stratos Idreos, Milena Ivanova, Ryan Johnson, David Koop, Tim Kraska, René Müller, Dan Olteanu, Paolo Papotti, Christine Reilly, Dimitris Tsirogiannis, Cong Yu, Juliana Freire, Dennis Shasha

^*Corresponding author for this work

Research output: Contribution to journal › Journal article › Research › peer-review

21 Citations (Scopus)

Abstract

SIGMOD has offered, since 2008, to verify the experiments published in the papers accepted at the conference. This year, we have been in charge of reproducing the experiments provided by the authors (repeatability), and exploring changes to experiment parameters (workability). In this paper, we assess the SIGMOD repeatability process in terms of participation, review process and results. While the participation is stable in terms of number of submissions, we find this year a sharp contrast between the high participation from Asian authors and the low participation from American authors. We also find that most experiments are distributed as Linux packages accompanied by instructions on how to setup and run the experiments. We are still far from the vision of executable papers.

Original language	English
Journal	SIGMOD Record
Volume	40
Issue number	2
Pages (from-to)	45-48
Number of pages	4
ISSN	0163-5808
DOIs	https://doi.org/10.1145/2034863.2034873
Publication status	Published - Jun 2011
Externally published	Yes

Access to Document

10.1145/2034863.2034873

Cite this

Bonnet, P., Manegold, S., Bjørling, M., Cao, W., Gonzalez, J., Granados, J., Hall, N., Idreos, S., Ivanova, M., Johnson, R., Koop, D., Kraska, T., Müller, R., Olteanu, D., Papotti, P., Reilly, C., Tsirogiannis, D., Yu, C., Freire, J., & Shasha, D. (2011). Repeatability and workability evaluation of SIGMOD 2011. SIGMOD Record, 40(2), 45-48. https://doi.org/10.1145/2034863.2034873

Repeatability and workability evaluation of SIGMOD 2011. / Bonnet, Philippe; Manegold, Stefan; Bjørling, Matias; Cao, Wei; Gonzalez, Javier; Granados, Joel; Hall, Nancy; Idreos, Stratos; Ivanova, Milena; Johnson, Ryan; Koop, David; Kraska, Tim; Müller, René; Olteanu, Dan; Papotti, Paolo; Reilly, Christine; Tsirogiannis, Dimitris; Yu, Cong; Freire, Juliana; Shasha, Dennis.

In: SIGMOD Record, Vol. 40, No. 2, 06.2011, p. 45-48.

Research output: Contribution to journal › Journal article › Research › peer-review

Bonnet, P, Manegold, S, Bjørling, M, Cao, W, Gonzalez, J, Granados, J, Hall, N, Idreos, S, Ivanova, M, Johnson, R, Koop, D, Kraska, T, Müller, R, Olteanu, D, Papotti, P, Reilly, C, Tsirogiannis, D, Yu, C, Freire, J & Shasha, D 2011, 'Repeatability and workability evaluation of SIGMOD 2011', SIGMOD Record, vol. 40, no. 2, pp. 45-48. https://doi.org/10.1145/2034863.2034873

Bonnet, Philippe ; Manegold, Stefan ; Bjørling, Matias ; Cao, Wei ; Gonzalez, Javier ; Granados, Joel ; Hall, Nancy ; Idreos, Stratos ; Ivanova, Milena ; Johnson, Ryan ; Koop, David ; Kraska, Tim ; Müller, René ; Olteanu, Dan ; Papotti, Paolo ; Reilly, Christine ; Tsirogiannis, Dimitris ; Yu, Cong ; Freire, Juliana ; Shasha, Dennis. / Repeatability and workability evaluation of SIGMOD 2011. In: SIGMOD Record. 2011 ; Vol. 40, No. 2. pp. 45-48.

@article{5f62402488434d62a008d1a68ab108bd,

title = "Repeatability and workability evaluation of SIGMOD 2011",

abstract = "SIGMOD has offered, since 2008, to verify the experiments published in the papers accepted at the conference. This year, we have been in charge of reproducing the experiments provided by the authors (repeatability), and exploring changes to experiment parameters (workability). In this paper, we assess the SIGMOD repeatability process in terms of participation, review process and results. While the participation is stable in terms of number of submissions, we find this year a sharp contrast between the high participation from Asian authors and the low participation from American authors. We also find that most experiments are distributed as Linux packages accompanied by instructions on how to setup and run the experiments. We are still far from the vision of executable papers.",

author = "Philippe Bonnet and Stefan Manegold and Matias Bj{\o}rling and Wei Cao and Javier Gonzalez and Joel Granados and Nancy Hall and Stratos Idreos and Milena Ivanova and Ryan Johnson and David Koop and Tim Kraska and Ren{\'e} M{\"u}ller and Dan Olteanu and Paolo Papotti and Christine Reilly and Dimitris Tsirogiannis and Cong Yu and Juliana Freire and Dennis Shasha",

year = "2011",

month = jun,

doi = "10.1145/2034863.2034873",

language = "English",

volume = "40",

pages = "45--48",

journal = "S I G M O D Record",

issn = "0163-5808",

publisher = "Association for Computing Machinery, Inc.",

number = "2",

}

TY - JOUR

T1 - Repeatability and workability evaluation of SIGMOD 2011

AU - Bonnet, Philippe

AU - Manegold, Stefan

AU - Bjørling, Matias

AU - Cao, Wei

AU - Gonzalez, Javier

AU - Granados, Joel

AU - Hall, Nancy

AU - Idreos, Stratos

AU - Ivanova, Milena

AU - Johnson, Ryan

AU - Koop, David

AU - Kraska, Tim

AU - Müller, René

AU - Olteanu, Dan

AU - Papotti, Paolo

AU - Reilly, Christine

AU - Tsirogiannis, Dimitris

AU - Yu, Cong

AU - Freire, Juliana

AU - Shasha, Dennis

PY - 2011/6

Y1 - 2011/6

N2 - SIGMOD has offered, since 2008, to verify the experiments published in the papers accepted at the conference. This year, we have been in charge of reproducing the experiments provided by the authors (repeatability), and exploring changes to experiment parameters (workability). In this paper, we assess the SIGMOD repeatability process in terms of participation, review process and results. While the participation is stable in terms of number of submissions, we find this year a sharp contrast between the high participation from Asian authors and the low participation from American authors. We also find that most experiments are distributed as Linux packages accompanied by instructions on how to setup and run the experiments. We are still far from the vision of executable papers.

AB - SIGMOD has offered, since 2008, to verify the experiments published in the papers accepted at the conference. This year, we have been in charge of reproducing the experiments provided by the authors (repeatability), and exploring changes to experiment parameters (workability). In this paper, we assess the SIGMOD repeatability process in terms of participation, review process and results. While the participation is stable in terms of number of submissions, we find this year a sharp contrast between the high participation from Asian authors and the low participation from American authors. We also find that most experiments are distributed as Linux packages accompanied by instructions on how to setup and run the experiments. We are still far from the vision of executable papers.

U2 - 10.1145/2034863.2034873

DO - 10.1145/2034863.2034873

M3 - Journal article

AN - SCOPUS:80053402117

VL - 40

SP - 45

EP - 48

JO - S I G M O D Record

JF - S I G M O D Record

SN - 0163-5808

IS - 2

ER -