Convergence rates of kernel density estimators for stationary time series are well studied. For invertible linear processes, we construct a new density estimator that converges, in the supremum norm, at the better, parametric, rate n−1/2. Our estimator is a convolution of two different residual-based kernel estimators. We obtain in particular convergence rates for such residual-based kernel estimators; these results are of independent interest.
References
Ango Nze, P. and Doukhan, P. (1998). Functional estimation for time series: Uniform convergence properties. J. Statist. Plann. Inference 68 5--29.
Ango Nze, P. and Portier, P. (1994). Estimation of the density and of the regression functions of an absolutely regular stationary process. Publ. Inst. Statist. Univ. Paris 38 59--88.
Ango Nze, P. and Rios, R. (2000). Density estimation in $L^\infty$ norm for mixing processes. J. Statist. Plann. Inference 83 75--90.
Berk, K. H. (1974). Consistent autoregressive spectral estimates. Ann. Statist. 2 489--502.
Bryk, A. and Mielniczuk, J. (2005). Asymptotic properties of density estimates for linear processes: Application of projection method. J. Nonparametr. Statist. 17 121--133.
Cai, Z. and Roussas, G. G. (1992). Uniform strong estimation under $\alpha$-mixing, with rates. Statist. Probab. Lett. 15 47--55.
Castellana, J. V. and Leadbetter, M. R. (1986). On smoothed probability density estimation for stationary processes. Stochastic Process. Appl. 21 179--193.
Chanda, K. C. (1983). Density estimation for linear processes. Ann. Inst. Statist. Math. 35 439--446.
Coulon-Prieur, C. and Doukhan, P. (2000). A triangular central limit theorem under a new weak dependence condition. Statist. Probab. Lett. 47 61--68.
Dedecker, J. and Merlevède, F. (2002). Necessary and sufficient conditions for the conditional central limit theorem. Ann. Probab. 30 1044--1081.
Doukhan, P. and Louhichi, S. (2001). Functional estimation of a density under a new weak dependence condition. Scand. J. Statist. 28 325--341.
Frees, E. W. (1994). Estimating densities of functions of observations. J. Amer. Statist. Assoc. 89 517--525.
Giné, E. and Mason, D. M. (2007). On local $U$-statistic processes and the estimation of densities of functions of several sample variables. Ann. Statist. 35. To appear.
Hall, P. and Hart, J. D. (1990). Convergence rates in density estimation for data from infinite-order moving average processes. Probab. Theory Related Fields 87 253--274.
Hallin, M. and Tran, L. T. (1996). Kernel density estimation for linear processes: Asymptotic normality and optimal bandwidth derivation. Ann. Inst. Statist. Math. 48 429--449.
Honda, T. (2000). Nonparametric density estimation for a long-range dependent linear process. Ann. Inst. Statist. Math. 52 599--611.
Liebscher, E. (1999). Estimating the density of the residuals in autoregressive models. Stat. Inference Stoch. Process. 2 105--117.
Lu, Z. (2001). Asymptotic normality of kernel density estimators under dependence. Ann. Inst. Statist. Math. 53 447--468.
Masry, E. (1986). Recursive probability density estimation for weakly dependent stationary processes. IEEE Trans. Inform. Theory 32 254--267.
Masry, E. (1987). Almost sure convergence of recursive density estimators for stationary mixing processes. Statist. Probab. Lett. 5 249--254.
Masry, E. (1997). Multivariate probability density estimation by wavelet methods: Strong consistency and rates for stationary time series. Stochastic Process. Appl. 67 177--193.
Masry, E. (2002). Multivariate probability density estimation for associated processes: Strong consistency and rates. Statist. Probab. Lett. 58 205--219.
Müller, U. U., Schick, A. and Wefelmeyer, W. (2005). Weighted residual-based density estimators for nonlinear autoregressive models. Statist. Sinica 15 177--195.
Robinson, P. M. (1983). Nonparametric estimators for time series. J. Time Ser. Anal. 4 185--207.
Robinson, P. M. (1986). Nonparametric estimation from time series residuals. Cahiers Centre Études Rech. Opér. 28 197--202.
Robinson, P. M. (1987). Time series residuals with application to probability density estimation. J. Time Ser. Anal. 8 329--344.
Roussas, G. G. (1990). Asymptotic normality of the kernel estimate under dependence conditions: Application to hazard rate. J. Statist. Plann. Inference 25 81--104.
Roussas, G. G. (1991). Kernel estimates under association: Strong uniform consistency. Statist. Probab. Lett. 12 393--403.
Roussas, G. G. (2000). Asymptotic normality of the kernel estimate of a probability density function under association. Statist. Probab. Lett. 50 1--12.
Rudin, W. (1974). Real and Complex Analysis, 2nd ed. McGraw-Hill, New York.
Saavedra, A. and Cao, R. (1999). Rate of convergence of a convolution-type estimator of the marginal density of an MA$(1)$ process. Stochastic Process. Appl. 80 129--155.
Saavedra, A. and Cao, R. (2000). On the estimation of the marginal density of a moving average process. Canad. J. Statist. 28 799--815.
Schick, A. and Wefelmeyer, W. (2004). Root $n$ consistent and optimal density estimators for moving average processes. Scand. J. Statist. 31 63--78.
Schick, A. and Wefelmeyer, W. (2004). Root $n$ consistent density estimators for sums of independent random variables. J. Nonparametr. Statist. 16 925--935.
Schick, A. and Wefelmeyer, W. (2004). Functional convergence and optimality of plug-in estimators for stationary densities of moving average processes. Bernoulli 10 889--917.
Schick, A. and Wefelmeyer, W. (2005). Convergence rates in weighted $L_1$ spaces of kernel density estimators for linear processes. Technical report, Dept. Mathematical Sciences, Binghamton Univ.
Schick, A. and Wefelmeyer, W. (2006). Pointwise convergence rates and central limit theorems for kernel density estimators in linear processes. Statist. Probab. Lett. 76 1756--1760.
Schick, A. and Wefelmeyer, W. (2007). Root-$n$ consistent density estimators of convolutions in weighted $L_1$-norms. J. Statist. Plann. Inference 137 1765--1774.
Tran, L. T. (1989). Recursive density estimation under dependence. IEEE Trans. Inform. Theory 35 1103--1108.
Tran, L. T. (1990). Recursive kernel density estimators under a weak dependence condition. Ann. Inst. Statist. Math. 42 305--329.
Tran, L. T. (1990). Kernel density estimation under dependence. Statist. Probab. Lett. 10 193--201.
Tran, L. T. (1992). Kernel density estimation for linear processes. Stochastic Process. Appl. 41 281--296.
Wu, W. B. and Mielniczuk, J. (2002). Kernel density estimation for linear processes. Ann. Statist. 30 1441--1459.