Open Access
November, 1979 Adaptive Design and Stochastic Approximation
T. L. Lai, Herbert Robbins
Ann. Statist. 7(6): 1196-1221 (November, 1979). DOI: 10.1214/aos/1176344840

Abstract

When $y = M(x) + \varepsilon$, where $M$ may be nonlinear, adaptive stochastic approximation schemes for the choice of the levels $x_1, x_2, \cdots$ at which $y_1, y_2, \cdots$ are observed lead to asymptotically efficient estimates of the value $\theta$ of $x$ for which $M(\theta)$ is equal to some desired value. More importantly, these schemes make the "cost" of the observations, defined at the $n$th stage to be $\sum^n_1(x_i - \theta)^2$, to be of the order of $\log n$ instead of $n$, an obvious advantage in many applications. A general asymptotic theory is developed which includes these adaptive designs and the classical stochastic approximation schemes as special cases. Motivated by the cost considerations, some improvements are made in the pairwise sampling stochastic approximation scheme of Venter.

Citation

Download Citation

T. L. Lai. Herbert Robbins. "Adaptive Design and Stochastic Approximation." Ann. Statist. 7 (6) 1196 - 1221, November, 1979. https://doi.org/10.1214/aos/1176344840

Information

Published: November, 1979
First available in Project Euclid: 12 April 2007

zbMATH: 0426.62059
MathSciNet: MR550144
Digital Object Identifier: 10.1214/aos/1176344840

Subjects:
Primary: 62L20
Secondary: 60F15 , 62K99

Keywords: adaptive design , Adaptive stochastic approximation , asymptotic normality , iterated logarithm , least squares , logarithmic cost , pairwise sampling schemes , regression

Rights: Copyright © 1979 Institute of Mathematical Statistics

Vol.7 • No. 6 • November, 1979
Back to Top