Abstract
In this paper, we pursue application of Gibbs measure theory to LBP in two ways. First, we show this theory can be applied directly to LBP for factor graphs, where one can use higher-order potentials. Consequently, we show beliefs are just marginal probabilities for a certain Gibbs measure on a computation tree. We also give a convergence criterion using this tree. Second, to see the usefulness of this approach, we apply a well-known general condition and a special one, which are developed in Gibbs measure theory, to LBP. We compare these two criteria and another criterion derived by the best present result. Consequently, we show that the special condition is better than the others and also show the general condition is better than the best present result when the influence of one-body potentials is sufficiently large. These results surely encourage the use of Gibbs measure theory in this area.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Frey, B.J.: Graphical Models for Pattern Classification, Data Compression and Channel Coding. MIT press, Cambridge (1998)
Georgii, H.-O.: Gibbs Measures and Phase Transitions. Walter de Gruyter, Berlin, New York (1988)
Ihler, A.T., Fisher, J.W., Willsky, A.S.: Loopy Belief Propagation: Convergence and Effects of Message Errors. Journal of Machine Learning Research 6, 905–936 (2005)
McEliece, R.J., MacKay, D.J.C., Cheng, J.F.: Turbo Decoding as an Instance of Pearl’s “Belief Propagation” Algorithm. IEEE Journal on Selected Areas in Communication 16(2), 140–152 (1998)
Mooij, J.M., Kappen, H.J.: Sufficient conditions for convergence of Loopy Belief Propagation. In: Proc. of 21st Conf. on Unc. in Art. Int., Edinburgh, pp. 396–403 (2005)
Murphy, K.P., Weiss, Y., Jordan, M.I.: Loopy belief propagation for approximate inference: an empirical study. In: Proc. of the 15th Conf. on Unc. in Art. Int., pp. 467–475. Morgan Kaufmann, San Francisco (1999)
Taga, N., Mase, S.: On the Convergence of Loopy Belief Propagation Algorithm for Different Update Rules. IEICE transactions on Fundamentals of Electronics, Communications and Computer Sciences E89-(2), 575–582 (2006)
Tatikonda, S.C., Jordan, M.I.: Loopy Belief Propagation and Gibbs Measures. In: Proc. of the 18th Conf. on Unc. in Art. Int., pp. 493–500. Morgan Kaufmann, San Francisco (2002)
Weiss, Y.: Correctness of Local Probability Propagation in Graphical Models with Loops, Neur. Comp., vol. 12, pp. 1–41. MIT press, Cambridge (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Taga, N., Mase, S. (2006). Applications of Gibbs Measure Theory to Loopy Belief Propagation Algorithm. In: Gelbukh, A., Reyes-Garcia, C.A. (eds) MICAI 2006: Advances in Artificial Intelligence. MICAI 2006. Lecture Notes in Computer Science(), vol 4293. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11925231_19
Download citation
DOI: https://doi.org/10.1007/11925231_19
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-49026-5
Online ISBN: 978-3-540-49058-6
eBook Packages: Computer ScienceComputer Science (R0)