OATAO - Open Archive Toulouse Archive Ouverte Open Access Week

Query Performance Prediction and Effectiveness Evaluation Without Relevance Judgments: Two Sides of the Same Coin

Mizzaro, Stefano and Mothe, Josiane and Roitero, Kevin and Ullah, Md Zia Query Performance Prediction and Effectiveness Evaluation Without Relevance Judgments: Two Sides of the Same Coin. (2018) In: 41st International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2018), 8 July 2018 - 12 July 2018 (Ann-Arbor, MI, United States).

[img] (Document in English)

PDF (Autho's version) - Depositor and staff only - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
321kB

Official URL: https://doi.org/10.1145/3209978.3210146

Abstract

Some methods have been developed for automatic effectiveness evaluation without relevance judgments. We propose to use those methods, and their combination based on a machine learning approach, for query performance prediction. Moreover, since predicting average precision as it is usually done in query performance prediction literature is sensitive to the reference system that is chosen, we focus on predicting the average of average precision values over several systems. Results of an extensive experimental evaluation on ten TREC collections show that our proposed methods outperform state-of-the-art query performance predictors.

Item Type:Conference or Workshop Item (Paper)
Additional Information:Thanks to ACM. The definitive version is available at http://dl.acm.org This papers appears in Proceedings of ACM SIGIR 2018 978-1-4503-5657-2 The original PDF is available at: https://dl.acm.org/citation.cfm?doid=3209978.3210146
Audience (conference):International conference proceedings
Uncontrolled Keywords:
Institution:French research institutions > Centre National de la Recherche Scientifique - CNRS (FRANCE)
Université de Toulouse > Institut National Polytechnique de Toulouse - Toulouse INP (FRANCE)
Université de Toulouse > Université Toulouse III - Paul Sabatier - UT3 (FRANCE)
Université de Toulouse > Université Toulouse - Jean Jaurès - UT2J (FRANCE)
Université de Toulouse > Université Toulouse 1 Capitole - UT1 (FRANCE)
Other partners > Università degli studi di Udine - UNIUD (ITALY)
Laboratory name:
Statistics:download
Deposited On:01 Oct 2019 11:51

Repository Staff Only: item control page