Summary
Eigenvalue decomposition (EVD) and/or singular value decomposition (SVD) play important roles in many multivariate data analysis techniques as computational tools for dimension reduction. A variety of EVD and SVD have been developed to deal with specific kinds of dimension reduction problems. This paper explicates various relationships among those decompositions with the prospect of exploiting them in practical applications of multivariate analysis.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
de Leeuw J (1982) Generalized eigenvalue problems with positive semi-definite matrices. Psyhometrika 47: 87–93
De Moor B (1991) Generalizations of the OSVD: Structure, properties and applications. In: Vaccaro RJ (ed) SVD and signal processing, II: Algorithms, analysis and applications. Elsevier, Amsterdam, pp 83–98
De Moor BLR, Golub GH (1991) The restricted singular value decomposition: Properties and applications.- SIAM Journal: Matrix Analysis and Applications 12: 401–425
Eckart C, Young G (1936) The approximation of one matrix by another of lower rank. Psychometrika 1: 211–218
Fernando KV, Hammarling SJ (1988) A product induced singular value decomposition for two matrices and balanced realization. In: Datta BN, Johnson CR, Kaashoek MA, Plemmons R, Sontag E (eds) Linear algebra in signal systems and control. SIAM, Philadelphia, pp 128–140
Golub GH, Van Loan CF (1989) Matrix computations ( 2nd Ed ). Johns Hopkins University Press, Baltimore
Guttman L (1944) General theory and methods of matric factoring. Psychometrika 9: 1–16
Guttman L (1957) A necessary and sufficient formula for matric factoring. Psychometrika 22: 79–81
Koene R, Takane Y (1999) Discriminant component pruning: Regularization and interpretation of multi-layered back-propagation networks. Neural Computation 11: 783–802
Mirsky L (1960) Symmetric gage functions and unitarily invariant norms. Quarterly Journal of Mathematics 11: 50–59
Paige CC (1986) Computing the generalized singular value decomposition. SIAM Journal: Scientific Computing 7: 1126–1146
Paige CC, Saunders MA (1981) Towards a generalized singular value decomposition. SIAM Journal: Numerical Analysis 18: 398–405
Rao CR, Mitra SK (1971) Generalized inverse of matrices and its applications. Wiley, New York
Takane Y, Shibayama T (1991) Principal component analysis with external information on both subjects and variables. Psychometrika 56: 97–120
Takane Y, Hunter MA (2001) Constrained principal component analysis: A comprehensive theory. Applicable Algebra in Engineering, Communication and Computing 12: 391–419
Takane Y, Hwang, H (2002) Generalized constrained canonical correlation analysis. Multivariate Behavioral Research 37: 163–195
Takane Y, Yanai H, Hwang H (2002) An improved method for generalized constrained canonical correlation analysis. Submitted to Computational Statistics and Data Analysis.
ten Berge JMF (1993) Least squares optimization in multivariate analysis. DSWO Press, Leiden
Van Loan CF (1976) Generalizing the singular value decomposition. SIAM Journal: Numerical Analysis 13: 76–83
Wedderburn JHM (1934) Lectures on matrices. Colloquium Publications 17, Providence, American Mathematical Society
Yanai H, Takane Y (1992) Canonical correlation analysis with linear constraints. Linear Algebra and Its Applications 176: 75–89
Zha H (1991a) The restricted singular value decomposition of matrix triplets. SIAM Journal: Matrix Analysis and Applications 12: 172–194
Zha H (1991b) The product singular value decomposition of matrix trplets. BIT 31: 711–726
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2003 Springer Japan
About this paper
Cite this paper
Takane, Y. (2003). Relationships among Various Kinds of Eigenvalue and Singular Value Decompositions. In: Yanai, H., Okada, A., Shigemasu, K., Kano, Y., Meulman, J.J. (eds) New Developments in Psychometrics. Springer, Tokyo. https://doi.org/10.1007/978-4-431-66996-8_4
Download citation
DOI: https://doi.org/10.1007/978-4-431-66996-8_4
Publisher Name: Springer, Tokyo
Print ISBN: 978-4-431-66998-2
Online ISBN: 978-4-431-66996-8
eBook Packages: Springer Book Archive