Abstract
In many statistical applications, data are collected over time, and they are likely correlated. In this paper, we investigate how to incorporate the correlation information into the local linear regression. Under the assumption that the error process is an auto-regressive process, a new estimation procedure is proposed for the nonparametric regression by using local linear regression method and the profile least squares techniques. We further propose the SCAD penalized profile least squares method to determine the order of auto-regressive process. Extensive Monte Carlo simulation studies are conducted to examine the finite sample performance of the proposed procedure, and to compare the performance of the proposed procedures with the existing one. From our empirical studies, the newly proposed procedures can dramatically improve the accuracy of naive local linear regression with working-independent error structure. We illustrate the proposed methodology by an analysis of real data set.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Altman, N.S. Kernel smoothing of data with correlated errors. Journal of the American Statistical Association, 85: 749–759 (1990)
Brockwell, P.J., Davis, R.A. Time series: theorey and methods. Springer-Verlag, New York, 1991
Engle, R.F., Granger, C.W.J., Rice, J., Weiss, A. Semiparametric estimates of the relation between weather and electricity sales. J. Amer. Stat. Assoc., 81: 310–320 (1986)
Fan, J., Gijbels, I. Local polynomial modeling and its applications. Chapman and Hall, London, 1996
Fan, J., Huang, T. Profile likelihood inferences on semiparametric varying-coefficient partially linear models. Bernoulli. 11: 1031–1059 (2005)
Fan, J., Huang, T., Li, R. Analysis of longitudinal data with semiparametric estimation of covariance function. Journal of American Statistical Association, 102: 632–641 (2007)
Fan, J., Li, R. Variable selection via nonconcave penalized likelihood and its oracle properties. Journal of American Statistical Association, 96: 1348–1360 (2001)
Fan, J. and Li, R. New Estimation and Model Selection Procedures for Semiparametric Modeling in Longitudinal Data Analysis. Journal of American Statistical Association, 99: 710–723 (2004)
Fan, J., Yao, Q. Nonlinear time series: nonparametric and parametric methods. Springer-Verlag, New York, 2003
Gu, C. Smoothing spline ANOVA models. Springer-Verlag, New York, 2002
Hart, J.D. Kernel regression estimation with time series errors. Journal of the Royal Statistical Society (Series B), 53: 173–187 (1991)
Hansen, L. P. (1982). Large sample properties of generalized method of moments estimators. Econometrics, 59, 1029–1054
Heckman, N. Spline smoothing in partly linear models. J. Royal Stat. Soc. (Series B), 48: 244–248 (1986)
Liang, K., Zeger, S. Longitudinal data-analysis using generalized linear-models. Biometrika, 73: 13–22 (1986)
Lin, X., Carroll, R. Nonparametric function estimation for clustered data when the predictor is measured without/with error. Journal of The American Statistical Association, 95: 520–534 (2000)
Opsomer, J. Estimating a function by local linear regression when the errors are correlated. preprint 95-42. Department of Statistics, Iowa State University, 1995
Opsomer, J., Wang, Y. and Yang, Y. Nonparametric Regression with Correlated Errors. Statistical Science, 16: 134–153 (2001)
Qu, A., Lindsay, B., Li, B. Improving Generalized Estimating Equations Using Quadratic Inference Functions. Biometrika, 87: 823–836 (2000)
Ruppert, D., Sheather, S.J., Wand, M.P. An effective bandwidth selector for local least squares regression. Journal of American Statistical Association, 90: 1257–1270 (1995)
Severini, T.A., Staniswalis, J.G. Quasi-likelihood estimation in semiparametric models. J. Amer. Stat. Assoc., 89: 501–511 (1994)
Silverman, B.W. Density estimation for statistics and data analysis. Chapman and Hall, London, 1986
Speckman, P. Kernel smoothing in partial linear models. Journal. Royal Statist. Soc. B, 50: 413–436 (1988)
Wahba, G. Partial spline models for semiparametric estimation of functions of several variables, in Statist. Analysis of Time Ser., Proceedings of the Japan U.S. Joint Seminar, Tokyo, 319–329 (1984)
Wang, H., Li, R., Tsai, C.L. Tuning parameter selectors for the smoothly clipped absolute deviation method. Biometrika, 94: 553–568 (2007)
Wang, N. Marginal nonparametric kernel regression accounting within-subject correlation. Biometrika, 90: 29–42 (2003)
Xiao, Z., Linton, O., Carroll, R.J., Mammen, E. More efficient local polynomial estimation in nonparametric regression with autocorrelated errors. Journal of the American Statistical Association, 98: 980–992 (2003)
Zeger, S., Liang, K. Longitudinal data-analysis for discrete and continuous outcomes. Biometrics, 42:121–130 (1986)
Author information
Authors and Affiliations
Corresponding author
Additional information
Runze Li’s research was supported by National Institute on Drug Abuse grant R21 DA024260, and Yan Li is supported by National Science Foundation grant DMS 0348869 as a graduate research assistant.
Rights and permissions
About this article
Cite this article
Li, R., Li, Y. Local linear regression for data with AR errors. Acta Math. Appl. Sin. Engl. Ser. 25, 427–444 (2009). https://doi.org/10.1007/s10255-008-8813-3
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10255-008-8813-3