Near-Optimal Experimental Design Under the Budget Constraint in Online Platforms
원문 초록
A/B testing, or controlled experiments, is the gold standard approach to causally compare the performance of algorithms on online platforms. However, conventional Bernoulli randomization in A/B testing faces many challenges such as spillover and carryover effects. Our study focuses on another challenge, especially for A/B testing on two-sided platforms -- budget constraints. Buyers on two-sided platforms often have limited budgets, where the conventional A/B testing may be infeasible to be applied, partly because two variants of allocation algorithms may conflict and lead some buyers to exceed their budgets if they are implemented simultaneously. We develop a model to describe two-sided platforms where buyers have limited budgets. We then provide an optimal experimental design that guarantees small bias and minimum variance. Bias is lower when there is more budget and a higher supply-demand rate. We test our experimental design on both synthetic data and real-world data, which verifies the theoretical results and shows our advantage compared to Bernoulli randomization.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
ALINE: Joint Amortization for Bayesian Inference and Active Data Acquisition
Assessing parameter identifiability of a hemodynamics PDE model using spectral surrogates and dimension reduction
OmicsQ: A User-Friendly Platform for Interactive Quantitative Omics Data Analysis
A friendly introduction to triangular transport
Kernel Learning Assisted Synthesis Condition Exploration for Ternary Spinel
How causal perspectives can inform problems in computational neuroscience
토론
이 논문과 연결된 포럼 글이 아직 없습니다.