Please use this identifier to cite or link to this item:
https://doi.org/10.48441/4427.265
License: | Publisher DOI: | 10.7802/1253 | Title: | LibRank Task Collections | Other Titles: | LibRank - New approaches to relevance ranking in Library Information Systems | Language: | English | Authors: | Lewandowski, Dirk Behnert, Christiane Plassmeier, Kim Borst, Timo |
Issue Date: | 2016 | Is supplement to: | https://doi.org/10.1016/j.acalib.2015.07.010 | Abstract: | Within the research project LibRank we evaluated a sample of factors for relevance ranking in library information systems by using a test system with EconBiz data. EconBiz is an academic search portal for economics by the German National Library of Economics (ZBW - Zentralbibliothek für Wirtschaftswissenschaften, Leibnitz-Informationszentrum Wirtschaft). We applied standard procedures in Information Retrieval evaluation by using human relevance assessments. The research data were obtained in three evaluation runs and are published in 3 files including: A) Search queries with descriptions; B) Document URLs with relevance assessments; C) Ranking factors and weightings. |
URI: | http://hdl.handle.net/20.500.12738/12249 | DOI: | 10.48441/4427.265 | Review status: | Unknown / not specified | Institute: | Department Information Fakultät Design, Medien und Information Forschungsgruppe Search Studies |
Type: | Dataset |
Appears in Collections: | Research Data (with datasets) |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
A_Search_queries_descriptions.xlsx | A) Search queries with descriptions: This file contains 600 queries and 600 descriptions of the possible information needs. These were the queries used in all three evaluation runs. However, not every task had been fully completed by the jurors, so that there are also queries with no assessment data. | 62.58 kB | Microsoft Excel XML | View/Open |
B_Document_URLs_relevance_assessments.xlsx | B) Document URLs with relevance assessments: This file contains the assessed documents and their assessment data for all three evaluation runs. In run 1 and 2, the documents were assessed by subject specialists at the ZBW, in run 3 we recruited students of economics. In the file, we attached some notes to the columns. For a detailed description of the research design, please see the working paper accessible via the project website www.librank.info | 8.8 MB | Microsoft Excel XML | View/Open |
C_Ranking_factors_weightings.xlsx | C) Ranking factors and weightings: This file contains an overview of the ranking factors and the specific weightings used in all three evaluation runs. These data are in supplement to the demonstrator, which is available via the project website www.librank.info. | 15.92 kB | Microsoft Excel XML | View/Open |
Note about this record
Export
This item is licensed under a Creative Commons License