Please use this identifier to cite or link to this item: https://doi.org/10.48441/4427.265
License: 
Publisher DOI: 10.7802/1253
Title: LibRank Task Collections
Other Titles: LibRank - New approaches to relevance ranking in Library Information Systems
Language: English (United States)
Authors: Lewandowski, Dirk  
Behnert, Christiane 
Plassmeier, Kim 
Borst, Timo 
Issue Date: 2016
Is supplement to: https://doi.org/10.1016/j.acalib.2015.07.010
Abstract: 
Within the research project LibRank we evaluated a sample of factors for relevance ranking in library information systems by using a test system with EconBiz data. EconBiz is an academic search portal for economics by the German National Library of Economics (ZBW - Zentralbibliothek für Wirtschaftswissenschaften, Leibnitz-Informationszentrum Wirtschaft). We applied standard procedures in Information Retrieval evaluation by using human relevance assessments. The research data were obtained in three evaluation runs and are published in 3 files including: A) Search queries with descriptions; B) Document URLs with relevance assessments; C) Ranking factors and weightings.
URI: http://hdl.handle.net/20.500.12738/12249
DOI: 10.48441/4427.265
Institute: Department Information 
Fakultät Design, Medien und Information 
Forschungsgruppe Search Studies 
Type: Dataset
Appears in Collections:Research Data (with datasets)

Files in This Item:
File Description SizeFormat
A_Search_queries_descriptions.xlsxA) Search queries with descriptions: This file contains 600 queries and 600 descriptions of the possible information needs. These were the queries used in all three evaluation runs. However, not every task had been fully completed by the jurors, so that there are also queries with no assessment data.62.58 kBMicrosoft Excel XMLView/Open
B_Document_URLs_relevance_assessments.xlsxB) Document URLs with relevance assessments: This file contains the assessed documents and their assessment data for all three evaluation runs. In run 1 and 2, the documents were assessed by subject specialists at the ZBW, in run 3 we recruited students of economics. In the file, we attached some notes to the columns. For a detailed description of the research design, please see the working paper accessible via the project website www.librank.info8.8 MBMicrosoft Excel XMLView/Open
C_Ranking_factors_weightings.xlsxC) Ranking factors and weightings: This file contains an overview of the ranking factors and the specific weightings used in all three evaluation runs. These data are in supplement to the demonstrator, which is available via the project website www.librank.info.15.92 kBMicrosoft Excel XMLView/Open
Show full item record

Page view(s)

201
checked on Jul 1, 2022

Download(s)

78
checked on Jul 1, 2022

Google ScholarTM

Check

Note about this record

Export

This item is licensed under a Creative Commons License Creative Commons