Abstract
G. Edelman, O. Sporns, and G. Tononi introduced in theoretical biology the neural complexity of a family of random variables. A previous work showed that this functional is a special case of intricacy, i.e., an average of the mutual information of subsystems with specific mathematical properties. Moreover, its maximum value grows at a definite speed with the size of the system. In this work, we compute exactly this speed of growth by building “approximate maximizers” subject to an entropy condition. These approximate maximizers work simultaneously for all intricacies. We also establish some properties of arbitrary approximate maximizers, in particular the existence of a threshold in the size of subsystems of approximate maximizers: most smaller subsystems are almost equidistributed, most larger subsystems determine the full system. The main ideas are a random construction of almost maximizers with a high statistical symmetry and the consideration of entropy profiles, i.e., the average entropies of sub-systems of a given size. The latter gives rise to interesting questions of probability and information theory.
Article PDF
Similar content being viewed by others
References
Barnett L., Buckley C.L., Bullock S.: Neural complexity and structural connectivity. Phys. Rev. E 79, 051914 (2009)
Buzzi, J., Zambotti, L.: Mean mutual information and symmetry breaking for finite random fields. Ann. Inst. H. Poincaré (B), Probab. Stat. (2011, to appear)
Cover T., Thomas J.: Elements of Information Theory. Wiley, New York (2006)
Edelman G., Gally J.: Degeneracy and complexity in biological systems. Proc. Natl. Acad. Sci. USA 98, 13763–13768 (2001)
Greven A., Keller G., Warnecke G.: Entropy. Princeton University Press, USA (2003)
Holthausen K., Breidbach O.: Analytical description of the evolution of neural networks: learning rules and complexity. Biol. Cybern. 81, 169–176 (1999)
Krichmar J., Nitz D., Gally J., Edelman G.: Characterizing functional hippocampal pathways in a brain-based device as it solves a spatial memory task. Proc. Natl. Acad. Sci. USA 102, 2111–2116 (2005)
Makarychev, K., Makarychev, Y., Romashchenko, A., Vereshchagin, N.: A new class of non-Shannon-type inequalities for entropies, Communications in Information and Systems, vol. 2, No. 2, pp. 147–166. International Press, USA (2002)
Mézard M., Montanari A.: Information, Physics, and Computation. Oxford University Press, USA (2009)
Peled, R., Yadin, A., Yehudayoff, A.: The maximal probability that k-wise independent bits are all 1. Random Structures and Algorithms (to appear). http://arxiv.org/abs/0801.0059
Seth A., Izhikevich E., Reeke G., Edelman G.: Theories and measures of consciousness: an extended framework. Proc. Natl. Acad. Sci. USA 103, 10799–10804 (2006)
Seth A.K.: Models of consciousness. Scholarpedia 2(1), 1328 (2007)
Shanahan M.P.: Dynamical complexity in small-world networks of spiking neurons. Phys. Rev. E 78, 041924 (2008)
Sporns O., Tononi G., Edelman G.: Connectivity and complexity: the relationship between neuroanatomy and brain dynamics. Neural Netw. 13(8–9), 909–922 (2000)
Sporns O.: Networks analysis, complexity, and brain function. Complexity 8, 56–60 (2002)
Sporns O.: Complexity. Scholarpedia 2(10), 1623 (2007)
Tononi G., Sporns O., Edelman G.: A measure for brain complexity: relating functional segregation and integration in the nervous system. Proc. Natl. Acad. Sci. USA 91, 5033–5037 (1994)
Tononi G., Sporns O., Edelman G.: A complexity measure for selective matching of signals by the brain. Proc. Natl. Acad. Sci. USA 93, 3422–3427 (1996)
Tononi G., Sporns O., Edelman G.: Measures of degeneracy and redundancy in biological networks. Proc. Natl. Acad. Sci. USA 96, 3257–3262 (1999)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Buzzi, J., Zambotti, L. Approximate maximizers of intricacy functionals. Probab. Theory Relat. Fields 153, 421–440 (2012). https://doi.org/10.1007/s00440-011-0350-y
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00440-011-0350-y