Upper Confidence Bounds for Combining Stochastic Bandits
원문 초록
We provide a simple method to combine stochastic bandit algorithms. Our approach is based on a "meta-UCB" procedure that treats each of $N$ individual bandit algorithms as arms in a higher-level $N$-armed bandit problem that we solve with a variant of the classic UCB algorithm. Our final regret depends only on the regret of the base algorithm with the best regret in hindsight. This approach provides an easy and intuitive alternative strategy to the CORRAL algorithm for adversarial bandits, without requiring the stability conditions imposed by CORRAL on the base algorithms. Our results match lower bounds in several settings, and we provide empirical validation of our algorithm on misspecified linear bandit and model selection problems.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
mTSBench: Benchmarking Multivariate Time Series Anomaly Detection and Model Selection at Scale
Leveraging Predictive Equivalence in Decision Trees
The use of cross validation in the analysis of designed experiments
Router-R1: Teaching LLMs Multi-Round Routing and Aggregation via Reinforcement Learning
Tuning the Right Foundation Models is What you Need for Partial Label Learning
Behavioral Augmentation of UML Class Diagrams: An Empirical Study of Large Language Models for Method Generation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.