Finite-Time Logarithmic Bayes Regret Upper Bounds
arXiv (Cornell University)(2023)
摘要
We derive the first finite-time logarithmic Bayes regret upper bounds for
Bayesian bandits. In a multi-armed bandit, we obtain O(c_Δlog n) and
O(c_h log^2 n) upper bounds for an upper confidence bound algorithm, where
c_h and c_Δ are constants depending on the prior distribution and the
gaps of bandit instances sampled from it, respectively. The latter bound
asymptotically matches the lower bound of Lai (1987). Our proofs are a major
technical departure from prior works, while being simple and general. To show
the generality of our techniques, we apply them to linear bandits. Our results
provide insights on the value of prior in the Bayesian setting, both in the
objective and as a side information given to the learner. They significantly
improve upon existing Õ(√(n)) bounds, which have become standard
in the literature despite the logarithmic lower bound of Lai (1987).
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要