OATAO - Open Archive Toulouse Archive Ouverte Open Access Week

Learning to Rank System Configurations

Deveaud, Romain and Mothe, Josiane and Nie, Jian-Yun Learning to Rank System Configurations. (2016) In: 25th ACM International Conference on Information and Knowledge Management (CIKM 2016), 24 October 2016 - 28 October 2016 (Indianapolis, United States).

(Document in English)

PDF (Author's version) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader

Official URL: http://dx.doi.org/10.1145/2983323.2983894


Information Retrieval (IR) systems heavily rely on a large number of parameters, such as the retrieval model or various query expansion parameters, whose values greatly in uence the overall retrieval effectiveness. However, setting all these parameters individually can often be a tedious task, since they can all affect one another, while also vary for different queries. We propose to tackle this problem by dealing with entire system configurations (i.e. a set of parameters representing an IR system) instead of single parameters, and to apply state-of-the-art Learning to Rank techniques to select the most appropriate configuration for a given query. The experiments we conducted on two TREC AdHoc collections show that this approach is feasible and significantly outperforms the traditional way to configure a system using grid search, as well as the top performing systems of the TREC tracks. We also show an analysis on the impact of different groups of parameters on retrieval effectiveness.

Item Type:Conference or Workshop Item (Paper)
Additional Information:The definitive version is available at http://dl.acm.org This papers appears in CIKM'16 : Proceedings of the 25th ACM International Conference on Information and Knowledge Management ISBN: 978-1-4503-4073-1 The original PDF is available at: https://dl.acm.org/citation.cfm?id=2983894
HAL Id:hal-01682971
Audience (conference):International conference proceedings
Uncontrolled Keywords:
Institution:French research institutions > Centre National de la Recherche Scientifique - CNRS (FRANCE)
Université de Toulouse > Institut National Polytechnique de Toulouse - Toulouse INP (FRANCE)
Other partners > Université de Montréal - UdeM (CANADA)
Université de Toulouse > Université Toulouse III - Paul Sabatier - UT3 (FRANCE)
Université de Toulouse > Université Toulouse - Jean Jaurès - UT2J (FRANCE)
Université de Toulouse > Université Toulouse 1 Capitole - UT1 (FRANCE)
Laboratory name:
Deposited On:19 Dec 2017 10:59

Repository Staff Only: item control page