Summary
The generalized ridge estimator, which considers generalizations of mean square error, is presented, and a mathematical rule of determining the optimalk-value is discussed. The generalized ridge estimator is examined in comparison with the least squares, the pseudoinverse, theJames-Stein-type shrinkage, and the principal component estimators, especially focusing their attention on improved adjustments for regression coefficients. An alternative estimation approach that better integrates a priori information is noted. Finally, combining the generalized ridge and robust regression methods is suggested.
Similar content being viewed by others
References
Albert, A.: Regression and the Moore-Penrose Pseudoinverse. 1972.
Andrews, D.F.: A Robust Method for Multiple Linear Regression. Technometrics16, 1974. 523–531.
Belsley, D.A.: Estimation of System of Simultaneous Equations, and Computational Specification of Gremlin. Ann. Economic and Social Measurement3, 1974, 551–614.
Goldstein, M., andA.F.M. Smith: Ridge-Type Estimators for Regression Analysis. J. Roy. Stat. Soc. B36, 1974. 284–291.
Hoerl, A.E., andR.W. Kennard: Ridge Regression. Biased Estimation for Non-Orthogonal Problems. Technometrics12, 1970, 55–67.
Holland, P.W.: Weighted Ridge Regression: Combining Ridge and Robust Regression Methods, Working paper 11, Computer Research Center for Economics and Management Science, NBER, Inc., 1973, 1–19.
Huber, J.P.: Robust Statistics: A Review. Ann. Math. Stat.43, 1972, 1041–1067.
James, W., andC. Stein: Estimation with Quadratic Loss. Proc. Fourth Berkeley Symp.1, 1960, 361–379.
Lindley, D.V., andA.F.M. Smith: Bayes Estimates for the Linear Model. J. Roy. Stat. Soc. B34, 1972, 1–41.
Marquardt, D.M.: Generalized Inverse, Ridge Regression, Biased Linear Estimation, and Non-Linear Estimation, Technometrics12, 1970, 591–612.
Myoken, H.: Ridge Estimation and I11-Condition in Regression System, Oikonomika, Society of Economics, Nagoya City University,9, 1973, 75–82.
Myoken, H., andY. Uchida: Multicollinearity and Ridge Regression, the special paper presented at the Joint Session of Regression Analysis and Its Practice, the Annual. Meeting of Japanese Statistical Society. 1974.
Penrose, R.: A Generalized Iverse for Matrices. Proc. Cambridge Philos. Soc.51, 1955, 406–413.
Sclove, S.L.: Improved Estimators for Coefficients in Linear Regression. J. Amer. Stat. Ass.63, 1968, 597–606.
Theobald, C.M.: Generalization of Mean Square Error Applied to Ridge Regression. J. Roy. Stat. Soc. B36, 1974, 103–106.
Tukey, J.W.: A Way Forward for Robust Regression. Unpublished memorandum, Bell Lavatories (Murray Hill) 1973.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Myoken, H., Uchida, Y. The generalized ridge estimator and improved adjustments for regression parameters. Metrika 24, 113–124 (1977). https://doi.org/10.1007/BF01893398
Received:
Issue Date:
DOI: https://doi.org/10.1007/BF01893398