Abstract
In recent years, nonlinear dimensionality reduction (NLDR) techniques have attracted much attention in visual perception and many other areas of science. We propose an efficient algorithm called Riemannian manifold learning (RML). A Riemannian manifold can be constructed in the form of a simplicial complex, and thus its intrinsic dimension can be reliably estimated. Then the NLDR problem is solved by constructing Riemannian normal coordinates (RNC). Experimental results demonstrate that our algorithm can learn the data’s intrinsic geometric structure, yielding uniformly distributed and well organized low-dimensional embedding data.
Chapter PDF
References
Donoho, D.: High-Dimensional Data Analysis: The Curses and Blessings of Dimensionality. In: Mathematical Challenges of the 21st Century, American Mathematical Society, Los Angeles (2000)
Jolliffe, I.: Principal Component Analysis. Springer, New York (1989)
Cox, T., Cox, M.: Multidimensional Scaling. Chapman & Hall, London (1994)
Bourlard, H., Kamp, Y.: Auto-association by multilayer perceptrons and singular value decomposition. Biological Cybernetics 59, 291–294 (1988)
Erwin, E., Obermayer, K., Schulten, K.: Self-organizing maps: Ordering, convergence properties and energy functions. Biological Cybernetics 67, 47–55 (1992)
Durbin, R., Willshaw, D.: An analogue approach to the travelling salesman problem using an elastic net method. Nature 326, 689–691 (1987)
Bishop, C., Svenson, M., Williams, C.: Gtm: The generative topographic mapping. Neural Computation 10, 215–234 (1998)
Hastie, T., Stuetzle, W.: Principal curves. J. American Statistical Association 84, 502–516 (1989)
Tenenbaum, J., Silva, V.d., Langford, J.: A global geometric framework for nonlinear dimensionality reduction. Science 290, 2319–2323 (2000)
Silva, V., Tenenbaum, J.: Global versus local methods in nonlinear dimensionality reduction. In: Advances in Neural Information Processing Systems, MIT Press, Cambridge (2003)
Roweis, S., Saul, L.: Nonlinear dimensionality reduction by locally linear embedding. Science 290, 2323–2326 (2000)
Belkin, M., Niyogi, P.: Laplacian eigenmaps for dimensionality reduction and data representation. Neural Computation 15, 1373–1396 (2003)
He, X., Yan, S., Hu, Y., Niyogi, P., Zhang, H.: Face recognition using laplacianfaces. IEEE Trans. Pattern Analysis and Machine Intelligence 27, 328–340 (2005)
Donoho, D., Grimes, C.: Hessian eigenmaps: New tools for nonlinear dimensionality reduction. In: Proc. National Academy of Science, pp. 5591–5596 (2003)
Weinberger, K., Saul, L.: Unsupervised learning of image manifolds by semidefinite programming. In: Proc. CVPR, pp. 988–995 (2004)
Brand, M.: Charting a manifold. In: Advances in Neural Information Processing Systems, MIT Press, Cambridge (2003)
Zhang, Z., Zha, H.: Principal manifolds and nonlinear dimensionality reduction via tangent space alignment. SIAM Journal on Scientific Computing 26, 313–338 (2004)
Nadler, B., Lafon, S., Coifman, R., Kevrekidis, I.: Diffusion maps, spectral clustering and reaction coordinates of dynamical systems. Journal of Applied and Computational Harmonic Analysis (submitted)
Seung, H., Lee, D.: The manifold ways of perception. Science 290, 2268–2269 (2000)
Sha, F., Saul, L.: Analysis and extension of spectral methods for nonlinear dimensionality reduction. In: Proc. Int. Conf. Machine Learning, Germany (2005)
Brun, A., Westin, C.F., Herberthson, M., Knutsson, H.: Fast manifold learning based on riemannian normal coordinates. In: Proc. 14th Scandinavian Conf. on Image Analysis, Joensuu, Finland (2005)
Jost, J.: Riemannian Geometry and Geometric Analysis, 3rd edn. Springer, Heidelberg (2002)
Freedman, D.: Efficient simplicial reconstructions of manifolds from their samples. IEEE Trans. Pattern Analysis and Machine Intelligence 24, 1349–1357 (2002)
Cormen, T., Leiserson, C., Rivest, R., Stein, C.: Introduction to Algorithms. MIT Press, Cambridge (2001)
Golub, G., Loan, C.: Matrix Computations, 3rd edn. Jonhs Hopkins Univ. (1996)
Levina, E., Bickel, P.: Maximum likelihood estimation of intrinsic dimension. In: Advances in Neural Information Processing Systems, MIT Press, Cambridge (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lin, T., Zha, H., Lee, S.U. (2006). Riemannian Manifold Learning for Nonlinear Dimensionality Reduction. In: Leonardis, A., Bischof, H., Pinz, A. (eds) Computer Vision – ECCV 2006. ECCV 2006. Lecture Notes in Computer Science, vol 3951. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11744023_4
Download citation
DOI: https://doi.org/10.1007/11744023_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-33832-1
Online ISBN: 978-3-540-33833-8
eBook Packages: Computer ScienceComputer Science (R0)