Nonlinear Theory and Its Applications, IEICE
Online ISSN : 2185-4106
ISSN-L : 2185-4106
Regular Section
Information geometry of rotor Boltzmann machines
Masaki Kobayashi
Author information
JOURNAL FREE ACCESS

2016 Volume 7 Issue 2 Pages 266-282

Details
Abstract

A complex-valued Hopfield neural network is a useful model for processing multi-level data. A rotor Hopfield network is an extension of a complex-valued Hopfield neural network but much more flexible. In addition, a rotor Hopfield neural network has excellent storage capacity and noise robustness characteristics. In the present work, we investigate the rotor Boltzmann machine (RoBM), a stochastic model of a rotor Hopfield neural network, through information geometry, which is a useful tool for analyzing stochastic models. We discuss RoBM through concepts of information geometry, such as the Fisher metric, parameters and potential functions. Moreover, we provide natural gradient descent learning and em-algorithms for RoBM as applications of information geometry.

Content from these authors
© 2016 The Institute of Electronics, Information and Communication Engineers
Previous article Next article
feedback
Top