Can we predict QPP? An approach based on multivariate outliers
원문 초록
Query performance prediction (QPP) aims to forecast the effectiveness of a search engine across a range of queries and documents. While state-of-the-art predictors offer a certain level of precision, their accuracy is not flawless. Prior research has recognized the challenges inherent in QPP but often lacks a thorough qualitative analysis. In this paper, we delve into QPP by examining the factors that influence the predictability of query performance accuracy. We propose the working hypothesis that while some queries are readily predictable, others present significant challenges. By focusing on outliers, we aim to identify the queries that are particularly challenging to predict. To this end, we employ multivariate outlier detection method. Our results demonstrate the effectiveness of this approach in identifying queries on which QPP do not perform well, yielding less reliable predictions. Moreover, we provide evidence that excluding these hard-to-predict queries from the analysis significantly enhances the overall accuracy of QPP.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Robust Spatiotemporal Epidemic Modeling with Integrated Adaptive Outlier Detection
Diversify and Conquer: Open-set Disagreement for Robust Semi-supervised Learning with Outliers
Importance Sampling for Nonlinear Models
Benign Samples Matter! Fine-tuning On Outlier Benign Samples Severely Breaks Safety
Adversarial Subspace Generation for Outlier Detection in High-Dimensional Data
Out-of-Distribution Detection on Graphs: A Survey
토론
이 논문과 연결된 포럼 글이 아직 없습니다.