Skip to main content

Relationships among Various Kinds of Eigenvalue and Singular Value Decompositions

  • Conference paper

Summary

Eigenvalue decomposition (EVD) and/or singular value decomposition (SVD) play important roles in many multivariate data analysis techniques as computational tools for dimension reduction. A variety of EVD and SVD have been developed to deal with specific kinds of dimension reduction problems. This paper explicates various relationships among those decompositions with the prospect of exploiting them in practical applications of multivariate analysis.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • de Leeuw J (1982) Generalized eigenvalue problems with positive semi-definite matrices. Psyhometrika 47: 87–93

    Article  MATH  Google Scholar 

  • De Moor B (1991) Generalizations of the OSVD: Structure, properties and applications. In: Vaccaro RJ (ed) SVD and signal processing, II: Algorithms, analysis and applications. Elsevier, Amsterdam, pp 83–98

    Google Scholar 

  • De Moor BLR, Golub GH (1991) The restricted singular value decomposition: Properties and applications.- SIAM Journal: Matrix Analysis and Applications 12: 401–425

    Article  MATH  Google Scholar 

  • Eckart C, Young G (1936) The approximation of one matrix by another of lower rank. Psychometrika 1: 211–218

    Article  MATH  Google Scholar 

  • Fernando KV, Hammarling SJ (1988) A product induced singular value decomposition for two matrices and balanced realization. In: Datta BN, Johnson CR, Kaashoek MA, Plemmons R, Sontag E (eds) Linear algebra in signal systems and control. SIAM, Philadelphia, pp 128–140

    Google Scholar 

  • Golub GH, Van Loan CF (1989) Matrix computations ( 2nd Ed ). Johns Hopkins University Press, Baltimore

    MATH  Google Scholar 

  • Guttman L (1944) General theory and methods of matric factoring. Psychometrika 9: 1–16

    Article  MathSciNet  MATH  Google Scholar 

  • Guttman L (1957) A necessary and sufficient formula for matric factoring. Psychometrika 22: 79–81

    Article  MathSciNet  MATH  Google Scholar 

  • Koene R, Takane Y (1999) Discriminant component pruning: Regularization and interpretation of multi-layered back-propagation networks. Neural Computation 11: 783–802

    Article  Google Scholar 

  • Mirsky L (1960) Symmetric gage functions and unitarily invariant norms. Quarterly Journal of Mathematics 11: 50–59

    Article  MathSciNet  MATH  Google Scholar 

  • Paige CC (1986) Computing the generalized singular value decomposition. SIAM Journal: Scientific Computing 7: 1126–1146

    Article  MathSciNet  MATH  Google Scholar 

  • Paige CC, Saunders MA (1981) Towards a generalized singular value decomposition. SIAM Journal: Numerical Analysis 18: 398–405

    Article  MathSciNet  MATH  Google Scholar 

  • Rao CR, Mitra SK (1971) Generalized inverse of matrices and its applications. Wiley, New York

    MATH  Google Scholar 

  • Takane Y, Shibayama T (1991) Principal component analysis with external information on both subjects and variables. Psychometrika 56: 97–120

    Article  MathSciNet  MATH  Google Scholar 

  • Takane Y, Hunter MA (2001) Constrained principal component analysis: A comprehensive theory. Applicable Algebra in Engineering, Communication and Computing 12: 391–419

    MathSciNet  MATH  Google Scholar 

  • Takane Y, Hwang, H (2002) Generalized constrained canonical correlation analysis. Multivariate Behavioral Research 37: 163–195

    Article  Google Scholar 

  • Takane Y, Yanai H, Hwang H (2002) An improved method for generalized constrained canonical correlation analysis. Submitted to Computational Statistics and Data Analysis.

    Google Scholar 

  • ten Berge JMF (1993) Least squares optimization in multivariate analysis. DSWO Press, Leiden

    Google Scholar 

  • Van Loan CF (1976) Generalizing the singular value decomposition. SIAM Journal: Numerical Analysis 13: 76–83

    Article  MATH  Google Scholar 

  • Wedderburn JHM (1934) Lectures on matrices. Colloquium Publications 17, Providence, American Mathematical Society

    Google Scholar 

  • Yanai H, Takane Y (1992) Canonical correlation analysis with linear constraints. Linear Algebra and Its Applications 176: 75–89

    Article  MathSciNet  MATH  Google Scholar 

  • Zha H (1991a) The restricted singular value decomposition of matrix triplets. SIAM Journal: Matrix Analysis and Applications 12: 172–194

    Article  MathSciNet  MATH  Google Scholar 

  • Zha H (1991b) The product singular value decomposition of matrix trplets. BIT 31: 711–726

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

H. Yanai A. Okada K. Shigemasu Y. Kano J. J. Meulman

Rights and permissions

Reprints and permissions

Copyright information

© 2003 Springer Japan

About this paper

Cite this paper

Takane, Y. (2003). Relationships among Various Kinds of Eigenvalue and Singular Value Decompositions. In: Yanai, H., Okada, A., Shigemasu, K., Kano, Y., Meulman, J.J. (eds) New Developments in Psychometrics. Springer, Tokyo. https://doi.org/10.1007/978-4-431-66996-8_4

Download citation

  • DOI: https://doi.org/10.1007/978-4-431-66996-8_4

  • Publisher Name: Springer, Tokyo

  • Print ISBN: 978-4-431-66998-2

  • Online ISBN: 978-4-431-66996-8

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics