Counterfactual Estimation and Optimization of Click Metrics for Search Engines
원문 초록
Optimizing an interactive system against a predefined online metric is particularly challenging, when the metric is computed from user feedback such as clicks and payments. The key challenge is the counterfactual nature: in the case of Web search, any change to a component of the search engine may result in a different search result page for the same query, but we normally cannot infer reliably from search log how users would react to the new result page. Consequently, it appears impossible to accurately estimate online metrics that depend on user feedback, unless the new engine is run to serve users and compared with a baseline in an A/B test. This approach, while valid and successful, is unfortunately expensive and time-consuming. In this paper, we propose to address this problem using causal inference techniques, under the contextual-bandit framework. This approach effectively allows one to run (potentially infinitely) many A/B tests offline from search log, making it possible to estimate and optimize online metrics quickly and inexpensively. Focusing on an important component in a commercial search engine, we show how these ideas can be instantiated and applied, and obtain very promising results that suggest the wide applicability of these techniques.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Towards Robust Multimodal Emotion Recognition under Missing Modalities and Distribution Shifts
Graph Style Transfer for Counterfactual Explainability
Causal Cartographer: From Mapping to Reasoning Over Counterfactual Worlds
Performative Validity of Recourse Explanations
Recover Experimental Data with Selection Bias using Counterfactual Logic
Data Fusion for Partial Identification of Causal Effects
토론
이 논문과 연결된 포럼 글이 아직 없습니다.