Copyright © 2004 Elsevier B.V. All rights reserved.
Letters
Relative gradient speeding up additive updates for nonnegative matrix factorization
Available online 18 February 2004.
References and further reading may be available for this article. To view references and further reading you must purchase this article.
Abstract
There exist two kinds of iterative updates for nonnegative matrix factorization: additive and multiplicative. The former does not take into consideration the characteristic of the parameter space of the constrained optimization while the latter holds the nonnegativity well. The relative gradient has better convergence rate than the ordinary gradient, and has been successfully used for neural learning, especially for blind source separation and independent component analysis. This paper applies the relative gradient to speed up the additive updates for nonnegative matrix factorization according to square Euclidean error. The primary experiments on synthetic and real datasets demonstrate the effectiveness of the proposed method.
Author Keywords: Author Keywords: Nonnegative matrix factorization; Relative gradient; Additive updates; Multiplicative updates






E-mail Article
Add to my Quick Links

Cited By in Scopus (1)






