LibRank Task Collections

Name: LibRank Task Collections
Creator: Lewandowski, Dirk
License: https://creativecommons.org/licenses/by-sa/4.0/

Lizenz:	CC BY-SA 4.0 (Attribution-ShareAlike 4.0)
Verlagslink DOI:	10.7802/1253
Titel:	LibRank Task Collections
Sonstige Titel:	LibRank - New approaches to relevance ranking in Library Information Systems
Sprache:	Englisch
Autorenschaft:	Lewandowski, Dirk Behnert, Christiane Plassmeier, Kim Borst, Timo
Erscheinungsdatum:	2016
Ist Ergänzung zu:	https://doi.org/10.1016/j.acalib.2015.07.010
Zusammenfassung:	Within the research project LibRank we evaluated a sample of factors for relevance ranking in library information systems by using a test system with EconBiz data. EconBiz is an academic search portal for economics by the German National Library of Economics (ZBW - Zentralbibliothek für Wirtschaftswissenschaften, Leibnitz-Informationszentrum Wirtschaft). We applied standard procedures in Information Retrieval evaluation by using human relevance assessments. The research data were obtained in three evaluation runs and are published in 3 files including: A) Search queries with descriptions; B) Document URLs with relevance assessments; C) Ranking factors and weightings.
URI:	http://hdl.handle.net/20.500.12738/12249
DOI:	10.48441/4427.265
Begutachtungsstatus:	Unbekannt / keine Angabe
Einrichtung:	Department Information Fakultät Design, Medien und Information Forschungsgruppe Search Studies
Dokumenttyp:	Dataset
Enthalten in den Sammlungen:	Research Data (with datasets)

Datei	Beschreibung	Größe	Format
A_Search_queries_descriptions.xlsx	A) Search queries with descriptions: This file contains 600 queries and 600 descriptions of the possible information needs. These were the queries used in all three evaluation runs. However, not every task had been fully completed by the jurors, so that there are also queries with no assessment data.	62.58 kB	Microsoft Excel XML	Öffnen/Anzeigen
B_Document_URLs_relevance_assessments.xlsx	B) Document URLs with relevance assessments: This file contains the assessed documents and their assessment data for all three evaluation runs. In run 1 and 2, the documents were assessed by subject specialists at the ZBW, in run 3 we recruited students of economics. In the file, we attached some notes to the columns. For a detailed description of the research design, please see the working paper accessible via the project website www.librank.info	8.8 MB	Microsoft Excel XML	Öffnen/Anzeigen
C_Ranking_factors_weightings.xlsx	C) Ranking factors and weightings: This file contains an overview of the ranking factors and the specific weightings used in all three evaluation runs. These data are in supplement to the demonstrator, which is available via the project website www.librank.info.	15.92 kB	Microsoft Excel XML	Öffnen/Anzeigen