Two-Stage Bandits
Murray K. Clayton, Jeffrey A. Witmer
The Annals of Statistics · 1988 · Volume 16 · Issue 2
Abstract
Two stochastic processes, or "arms," that yield dichotomous responses are available for use in a two-stage decision problem. During the first stage, arms are chosen sequentially; the resulting observations are discounted by a fixed value $\beta$. A single arm must be used in the second stage, in which observations are not discounted. The decision to end the first stage is based on the data obtained. Optimal strategies are considered in the presence of the random discount sequence that arises in this setting. This extends the work of Berry and Fristedt (1979).
Keywords
62C10, random discounting, regular discounting, sequential decisions, Two-stage bandit
Enable JavaScript for citation tools and additional paper interactions.