Developing a Test Collection for the Evaluation of Integrated Search

Marianne Lykke, Birger Larsen, Haakon Lund, Peter Ingwersen

Publikation: Bidrag til bog/antologi/rapportKonferencebidrag i proceedingsForskningpeer review

42 Citationer (Scopus)
2254 Downloads (Pure)

Abstract

he poster discusses the characteristics needed in an information retrieval (IR) test collection to facilitate the evaluation of integrated search, i.e. search across a range of different sources but with one search box and one ranked result list, and describes and analyses a new test collection constructed for this purpose. The test collection consists of approx. 18,000 monographic records, 160,000 papers and journal articles in PDF and 275,000 abstracts with a varied set of metadata and vocabularies from the physics domain, 65 topics based on real work tasks and corresponding graded relevance assessments. The test collection may be used for systems- as well as user-oriented evaluation.
OriginalsprogEngelsk
TitelAdvances in Information Retrieval : 32nd European Conference on IR Research, ECIR 2010, Milton Keynes, UK, March 28-31, 2010, Proceedings
RedaktørerCathal Gurrin, Yulan He, Gabriella Kazai, Udo Kruschwitz, Suzanne Little, Thomas Roelleke, Stefan Rüger, Keith van Rijsbergen
Vol/bind5993
ForlagSpringer
Publikationsdato2010
Sider627-630
DOI
StatusUdgivet - 2010
BegivenhedEuropean Conference on IR Research - Milton Keynes, Storbritannien
Varighed: 28 mar. 201031 maj 2010
Konferencens nummer: 32

Konference

KonferenceEuropean Conference on IR Research
Nummer32
Land/OmrådeStorbritannien
ByMilton Keynes
Periode28/03/201031/05/2010
NavnLecture notes in computer science
Nummer5993
ISSN0302-9743

Emneord

  • Design af testsamlinger
  • Integreret søgning

Citationsformater