The Effects of Data Split Strategies on the Offline Experiments for CTR Prediction
원문 초록
Click-through rate (CTR) prediction is a crucial task in online advertising to recommend products that users are likely to be interested in. To identify the best-performing models, rigorous model evaluation is necessary. Offline experimentation plays a significant role in selecting models for live user-item interactions, despite the value of online experimentation like A/B testing, which has its own limitations and risks. Often, the correlation between offline performance metrics and actual online model performance is inadequate. One main reason for this discrepancy is the common practice of using random splits to create training, validation, and test datasets in CTR prediction. In contrast, real-world CTR prediction follows a temporal order. Therefore, the methodology used in offline evaluation, particularly the data splitting strategy, is crucial. This study aims to address the inconsistency between current offline evaluation methods and real-world use cases, by focusing on data splitting strategies. To examine the impact of different data split strategies on offline performance, we conduct extensive experiments using both random and temporal splits on a large open benchmark dataset, Criteo.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Feature Staleness Aware Incremental Learning for CTR Prediction
Generative Click-through Rate Prediction with Applications to Search Advertising
v-TCM: Vertical-aware Transformer Click Model for Web Search
TiSASRec: Time Interval Aware Self-Attention for Sequential Recommendation
Deep Neural Networks for YouTube Recommendations
Conformation-Aware Structure Prediction of Antigen-Recognizing Immune Proteins
토론
이 논문과 연결된 포럼 글이 아직 없습니다.