On recursive estimation for time varying autoregressive processes



The Annals of Statistics

On recursive estimation for time varying autoregressive processes

Eric Moulines, Pierre Priouret, and François Roueff

Source: Ann. Statist. Volume 33, Number 6 (2005), 2610-2654.

Abstract

This paper focuses on recursive estimation of time varying autoregressive processes in a nonparametric setting. The stability of the model is revisited and uniform results are provided when the time-varying autoregressive parameters belong to appropriate smoothness classes. An adequate normalization for the correction term used in the recursive estimation procedure allows for very mild assumptions on the innovations distributions. The rate of convergence of the pointwise estimates is shown to be minimax in β-Lipschitz classes for 0<β≤1. For 1<β≤2, this property no longer holds. This can be seen by using an asymptotic expansion of the estimation error. A bias reduction method is then proposed for recovering the minimax rate.

Primary Subjects: 62M10, 62G08, 60J27
Secondary Subjects: 62G20
Keywords: Locally stationary processes; nonparametric estimation; recursive estimation; time-varying autoregressive model

Full-text: Access denied (no subscription detected)

We're sorry, but we are unable to provide you with the full text of this article because we are not able to identify you as a subscriber.
If you have a personal subscription to this journal, then please login. If you are already logged in, then you may need to update your profile to register your subscription. Read more about accessing full-text
Alternatively, the document is available for a cost of $15. Select the "buy article" button below to purchase this document from a secured VeriSign, Inc. site.
Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.aos/1140191668
Digital Object Identifier: doi:10.1214/009053605000000624

References

Aguech, R., Moulines, E. and Priouret, P. (2000). On a perturbation approach for the analysis of stochastic tracking algorithm. SIAM J. Control Optim. 39 872--899.
Mathematical Reviews (MathSciNet): MR1786334
Digital Object Identifier: doi:10.1137/S0363012998333852
Baranger, J. (1991). Analyse Numérique. Hermann, Paris.
Belitser, E. (2000). Recursive estimation of a drifted autoregressive parameter. Ann. Statist. 28 860--870.
Mathematical Reviews (MathSciNet): MR1792790
Digital Object Identifier: doi:10.1214/aos/1015952001
Project Euclid: euclid.aos/1015952001
Brockwell, P. J. and Davis, R. A. (1991). Time Series: Theory and Methods, 2nd ed. Springer, New York.
Mathematical Reviews (MathSciNet): MR1093459
Zentralblatt MATH: 0709.62080
Dahlhaus, R. (1996). Asymptotic statistical inference for nonstationary processes with evolutionary spectra. Athens Conference on Applied Probability and Time Series Analysis 2. Lecture Notes in Statist. 115 145--159. Springer, New York.
Mathematical Reviews (MathSciNet): MR1466743
Dahlhaus, R. (1996). On the Kullback--Leibler information divergence of locally stationary processes. Stochastic Process. Appl. 62 139--168.
Mathematical Reviews (MathSciNet): MR1388767
Digital Object Identifier: doi:10.1016/0304-4149(95)00090-9
Dahlhaus, R. (1997). Fitting time series models to non-stationary processes. Ann. Statist. 25 1--37.
Mathematical Reviews (MathSciNet): MR1429916
Digital Object Identifier: doi:10.1214/aos/1034276620
Project Euclid: euclid.aos/1034276620
Dahlhaus, R. and Giraitis, L. (1998). On the optimal segment length for parameter estimates for locally stationary time series. J. Time Ser. Anal. 19 629--655.
Mathematical Reviews (MathSciNet): MR1665941
Digital Object Identifier: doi:10.1111/1467-9892.00114
Dedecker, J. and Doukhan, P. (2003). A new covariance inequality and applications. Stochastic Process. Appl. 106 63--80.
Mathematical Reviews (MathSciNet): MR1983043
Digital Object Identifier: doi:10.1016/S0304-4149(03)00040-1
Dunford, N. and Schwartz, J. T. (1958). Linear Operators 1. Wiley, New York.
Mathematical Reviews (MathSciNet): MR0117523
Zentralblatt MATH: 0084.10402
Gill, R. D. and Levit, B. Y. (1995). Applications of the van Trees inequality: A Bayesian Cramér--Rao bound. Bernoulli 1 59--79.
Mathematical Reviews (MathSciNet): MR1354456
Grenier, Y. (1983). Time-dependent ARMA modeling of nonstationary signals. IEEE Trans. Acoustics, Speech and Signal Processing 31 899--911.
Guo, L. (1994). Stability of recursive stochastic tracking algorithms. SIAM J. Control Optim. 32 1195--1225.
Mathematical Reviews (MathSciNet): MR1288247
Digital Object Identifier: doi:10.1137/S0363012992225606
Hall, P. and Heyde, C. C. (1980). Martingale Limit Theory and Its Application. Academic Press, New York.
Mathematical Reviews (MathSciNet): MR0624435
Zentralblatt MATH: 0462.60045
Hallin, M. (1978). Mixed autoregressive-moving average multivariate processes with time-dependent coefficients. J. Multivariate Anal. 8 567--572.
Mathematical Reviews (MathSciNet): MR0520964
Digital Object Identifier: doi:10.1016/0047-259X(78)90034-9
Horn, R. A. and Johnson, C. R. (1991). Topics in Matrix Analysis. Cambridge Univ. Press.
Mathematical Reviews (MathSciNet): MR1091716
Zentralblatt MATH: 0729.15001
Kailath, T. (1980). Linear Systems. Prentice Hall, Englewood Cliffs, NJ.
Mathematical Reviews (MathSciNet): MR0569473
Zentralblatt MATH: 0454.93001
Kushner, H. and Yin, G. (1997). Stochastic Approximation Algorithms and Applications. Springer, New York.
Mathematical Reviews (MathSciNet): MR1453116
Zentralblatt MATH: 0914.60006
Ljung, L. and Söderström, T. (1983). Theory and Practice of Recursive Identification. MIT Press, Cambridge, MA.
Mathematical Reviews (MathSciNet): MR719192
Zentralblatt MATH: 0548.93075
Priouret, P. and Veretennikov, A. Y. (1995). A remark on stability of the LMS tracking algorithm. Stoch. Anal. Appl. 16 118--128.
Solo, V. and Kong, X. (1995). Adaptive Signal Processing Algorithms: Stability and Performance. Prentice Hall, Englewood Cliffs, NJ.
Mathematical Reviews (MathSciNet): MR0117523
Zentralblatt MATH: 0084.10402
Subba Rao, T. (1970). The fitting of non-stationary time-series models with time-dependent parameters. J. Roy. Statist. Soc. Ser. B 32 312--322.
Mathematical Reviews (MathSciNet): MR0269065

2008 © Institute of Mathematical Statistics