This paper focuses on recursive estimation of time varying autoregressive processes in a nonparametric setting. The stability of the model is revisited and uniform results are provided when the time-varying autoregressive parameters belong to appropriate smoothness classes. An adequate normalization for the correction term used in the recursive estimation procedure allows for very mild assumptions on the innovations distributions. The rate of convergence of the pointwise estimates is shown to be minimax in β-Lipschitz classes for 0<β≤1. For 1<β≤2, this property no longer holds. This can be seen by using an asymptotic expansion of the estimation error. A bias reduction method is then proposed for recovering the minimax rate.
Primary Subjects: 62M10, 62G08, 60J27
Secondary Subjects: 62G20
Full-text: Access denied (no subscription detected)
We're sorry, but we are unable to provide you with the full text of this article because we are not able to identify you as a subscriber.
If you have a personal subscription to this journal, then please login. If you are already logged in, then you may need to update your profile to register your subscription.
Read more about accessing full-text
Alternatively, the document is available for a cost of $15. Select the "buy article" button below to purchase this document from a secured VeriSign, Inc. site.
References
Aguech, R., Moulines, E. and Priouret, P. (2000). On a perturbation approach for the analysis of stochastic tracking algorithm. SIAM J. Control Optim. 39 872--899.
Baranger, J. (1991). Analyse Numérique. Hermann, Paris.
Belitser, E. (2000). Recursive estimation of a drifted autoregressive parameter. Ann. Statist. 28 860--870.
Brockwell, P. J. and Davis, R. A. (1991). Time Series: Theory and Methods, 2nd ed. Springer, New York.
Dahlhaus, R. (1996). Asymptotic statistical inference for nonstationary processes with evolutionary spectra. Athens Conference on Applied Probability and Time Series Analysis 2. Lecture Notes in Statist. 115 145--159. Springer, New York.
Dahlhaus, R. (1996). On the Kullback--Leibler information divergence of locally stationary processes. Stochastic Process. Appl. 62 139--168.
Dahlhaus, R. (1997). Fitting time series models to non-stationary processes. Ann. Statist. 25 1--37.
Dahlhaus, R. and Giraitis, L. (1998). On the optimal segment length for parameter estimates for locally stationary time series. J. Time Ser. Anal. 19 629--655.
Dedecker, J. and Doukhan, P. (2003). A new covariance inequality and applications. Stochastic Process. Appl. 106 63--80.
Dunford, N. and Schwartz, J. T. (1958). Linear Operators 1. Wiley, New York.
Gill, R. D. and Levit, B. Y. (1995). Applications of the van Trees inequality: A Bayesian Cramér--Rao bound. Bernoulli 1 59--79.
Grenier, Y. (1983). Time-dependent ARMA modeling of nonstationary signals. IEEE Trans. Acoustics, Speech and Signal Processing 31 899--911.
Guo, L. (1994). Stability of recursive stochastic tracking algorithms. SIAM J. Control Optim. 32 1195--1225.
Hall, P. and Heyde, C. C. (1980). Martingale Limit Theory and Its Application. Academic Press, New York.
Hallin, M. (1978). Mixed autoregressive-moving average multivariate processes with time-dependent coefficients. J. Multivariate Anal. 8 567--572.
Horn, R. A. and Johnson, C. R. (1991). Topics in Matrix Analysis. Cambridge Univ. Press.
Kailath, T. (1980). Linear Systems. Prentice Hall, Englewood Cliffs, NJ.
Kushner, H. and Yin, G. (1997). Stochastic Approximation Algorithms and Applications. Springer, New York.
Ljung, L. and Söderström, T. (1983). Theory and Practice of Recursive Identification. MIT Press, Cambridge, MA.
Mathematical Reviews (MathSciNet):
MR719192
Priouret, P. and Veretennikov, A. Y. (1995). A remark on stability of the LMS tracking algorithm. Stoch. Anal. Appl. 16 118--128.
Solo, V. and Kong, X. (1995). Adaptive Signal Processing Algorithms: Stability and Performance. Prentice Hall, Englewood Cliffs, NJ.
Subba Rao, T. (1970). The fitting of non-stationary time-series models with time-dependent parameters. J. Roy. Statist. Soc. Ser. B 32 312--322.