Abstract
We consider the application of shrinkage and penalty estimation for a Poisson regression model. We present a large sample theory for the full model, submodel, and shrinkage estimators in terms of their respective asymptotic bias and risk. Generally speaking, shrinkage estimators are more efficient than the full model estimator. Nowadays, variable selection is of fundamental importance for modeling and data analysis. A number of variable selection approaches have been proposed in the literature. On the other hand, absolute penalty estimation strategy is useful for simultaneous variable selection and estimation. For this purpose, we consider three penalty estimators, namely, LASSO, adaptive LASSO, and SCAD. We assess the relative performance of the penalty estimators with the shrinkage estimators using Monte Carlo simulation. The relative performance of each estimation strategy is given in terms of a simulated mean squared error. The simulation results reveal that shrinkage method is an effective consistent model selection technique and is comparable to the LASSO, adaptive LASSO, and SCAD when the model is sparse and number predictors in the model is weak. Finally, the listed estimation strategies are appraised through the application to two real data sets.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ahmed, S. E. (1997). Asymptotic shrinkage estimation: the regression case. Applied Statistical Science, II, 113–139.
Ahmed, S. E., Doksum, K. A., Hossain, S., & You, J. (2007). Shrinkage, pretest and absolute penalty estimators in partially linear models. Australian and New Zealand Journal of Statistics, 49, 435–454.
Ahmed, S. E., Hossain, S., & Doksum, K. A. (2012). LASSO and shrinkage estimation in Weibull censored regression models. Journal of Statistical Planning and Inference, 12, 1272–1284.
Ahmed, S. E., Hussein, A. A., & Sen, P. K. (2006). Risk comparison of some shrinkage m-estimators in linear models. Nonparametric Statistics, 18(4–6), 401–415.
Ahmed, S. E., Saleh, A. K., & Md, E. (1999). Estimation of regression coefficients in an exponential regression model with censored observation. Journal of Japan Statistical Society, 29, 55–64.
Cameron, A. C., & Trivedi, P. K. (1998). Regression Analysis of Count Data. UK: Cambridge University Press.
Fan, J., & Li, R. (2001). Variable selection via nonconcave penalized likelihood and its oracle properties. Journal of the American Statistical Association, 96(456), 1348–1360.
Hossain, S., & Ahmed, S. E. (2012). Shrinkage and penalty estimators in a Poisson regression mode. Australian and New Zealand Journal of Statistics, 54, 359–373.
Judge, G. G., & Mittelhammaer, R. C. (2004). A semiparametric basis for combining estimation problem under quadratic loss. Journal of the American Statistical Association, 99, 479–487.
Park, M., & Hastie, T. (2007). An \({L}_1\) regularization-path algorithm for generalized linear models. Journal of the Royal Statistical Society: Series B, 69, 659–677.
Santos, J. A., & Neves, M. M. (2008). A local maximum likelihood estimator for poisson regression. Metrika, 68, 257–270.
Sapra, S. K. (2003). Pre-test estimation in poisson regression model. Applied Economics Letters, 10, 541–543.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2014 The Author(s)
About this chapter
Cite this chapter
Ahmed, S.E. (2014). Estimation Strategies in Poisson Regression Models. In: Penalty, Shrinkage and Pretest Strategies. SpringerBriefs in Statistics. Springer, Cham. https://doi.org/10.1007/978-3-319-03149-1_6
Download citation
DOI: https://doi.org/10.1007/978-3-319-03149-1_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-03148-4
Online ISBN: 978-3-319-03149-1
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)