OATAO - Open Archive Toulouse Archive Ouverte Open Access Week

Overview of INEX 2014

Bellot, Patrice and Bogers, Toine and Geva, Shlomo and Hall, Mark and Huurdeman, Hugo and Kamps, Jaap and Kazai, Gabriella and Koolen, Marijn and Moriceau, Véronique and Mothe, Josiane and Preminger, Michael and Sanjuan, Eric and Schenkel, Ralf and Skov, Mette and Tannier, Xavier and Walsh, David Overview of INEX 2014. (2014) In: International Workshop of the Initiative for the Evaluation of XML Retrieval - INEX 2014, 15 September 2014 - 18 September 2014 (Sheffield, United Kingdom).

[img]
Preview
(Document in English)

PDF (Author's version) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
470kB

Official URL: http://dx.doi.org/10.1007/978-3-319-11382-1_19

Abstract

INEX investigates focused retrieval from structured documents by providing large test collections of structured documents, uniform evaluation measures, and a forum for organizations to compare their results. This paper reports on the INEX 2014 evaluation campaign, which consisted of three tracks: The Interactive Social Book Search Track investigated user information seeking behavior when interacting with various sources of information, for realistic task scenarios, and how the user interface impacts search and the search experience. The Social Book Search Track investigated the relative value of authoritative metadata and user generated content for search and recommendation using a test collection with data from Amazon and LibraryThing, and user profiles and personal catalogues. The Tweet Contextualization Track investigated tweet contextualization, helping a user to understand a tweet by providing him with a short background summary generated from relevant Wikipedia passages aggregated into a coherent summary. INEX 2014 was an exciting year for INEX in which we for the third time ran our workshop as part of the CLEF labs in order to facilitate knowledge transfer between evaluation forums. This paper gives an overview of all the INEX 2014 tracks, their aims and task, the built test-collections, the participants, and gives an initial analysis of the results.

Item Type:Conference or Workshop Item (Paper)
Additional Information:Thanks to Springer editor. The original publication is available at http://link.springer.com/book/10.1007/978-3-319-11382-1
HAL Id:hal-01123498
Audience (conference):International conference proceedings
Uncontrolled Keywords:
Institution:Other partners > Aix-Marseille Université - AMU (FRANCE)
Other partners > Arts et Métiers ParisTech (FRANCE)
French research institutions > Centre National de la Recherche Scientifique - CNRS (FRANCE)
Université de Toulouse > Institut National Polytechnique de Toulouse - INPT (FRANCE)
Université de Toulouse > Université Toulouse III - Paul Sabatier - UPS (FRANCE)
Université de Toulouse > Université Toulouse - Jean Jaurès - UT2J (FRANCE)
Université de Toulouse > Université Toulouse 1 Capitole - UT1 (FRANCE)
Other partners > Université du Sud Toulon-Var - USTV (FRANCE)
Other partners > Aalborg University (DENMARK)
Other partners > Edge Hill University (UNITED KINGDOM)
Other partners > Oslo and Akershus University College of Applied Sciences - HiOA (NORWAY)
Other partners > Queensland University of Technology - QUT (AUSTRALIA)
Other partners > Semion Ltd (UNITED KINGDOM)
Other partners > University of Amsterdam - UvA (NETHERLANDS)
Other partners > Université d'Avignon et des Pays de Vaucluse (FRANCE)
Other partners > Universität Passau (GERMANY)
Laboratory name:
Statistics:download
Deposited By: IRIT IRIT
Deposited On:03 Mar 2015 11:33

Repository Staff Only: item control page