Skip to main content

Exponential Family and Inverse Problems

On Metamorphoses of Probability Theory

  • Chapter
Optimization and Inverse Problems in Electromagnetism
  • 566 Accesses

Abstract

We associate Inverse Problems with a structure called Exponential Family. This structure is pivotal in many fundamental theories (Bayesian Probability Theory, Maximum Entropy Principle, Fourier-Laplace Transforms, Generatingfunctionology, Sufficient Statistics, Lie Groups, ...), and offers extensive applications to Physical Theories and Complex Systems.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. A. Gottvald, “Information, Physics, Computing”, unpubl. Lecture Notes presented at Kyoto University (Japan), Dec. 13–15, 2001 (to appear)

    Google Scholar 

  2. A. Gottvald, “Beyond the Max Ent Principle: Bayes, Fourier, Zipf and Spirals in Metamorphoses”, in Energy and Information in Non-linear Systems, A. Gottvald (ed.), CSAEM, Brno, 2001, pp. 48–51

    Google Scholar 

  3. Ch. C. Gillispie, “Pierre-Simon Laplace, 1749–1827, A Life in Exact Science,” Princeton Univ. Press, Princeton, 1997

    Google Scholar 

  4. A. Gottvald, “Laplacé s Demon and Maxwell’s Demon: From Historical Myths to Topological Evolution,” in Proc. of 8th MENDEL Conf. on Soft Computing, Brno (CR), 2002, pp. 139–146

    Google Scholar 

  5. M. A. Akivis and B. A. Rosenfeld, “Élie Cartan (1869–1951),” American Mathematical Society, Providence, 1993

    Google Scholar 

  6. S. Kullback, “Information Theory and Statistics,” Dover Publ. Inc., Mineola, 1997 (first published 1959 )

    Google Scholar 

  7. H. Jeffreys, “Theory of Probability,” Clarendon Press, Oxford, 1998 (first published 1939 )

    Google Scholar 

  8. E. T. Jaynes, “Probability Theory - the Logic of Science”, Cambridge, to appear in April 2003; on-line: http://www.omega.albany.edu:8008/JaynesBook

  9. E. T. Jaynes, “Where do we Stand on Maximum Entropy?” in The Maximum Entropy Formalism, R. D. Levine and M. Tribus (eds.), M. I. T. Press, Cambridge, MA, p. 15; online: http://www.bayes.wustl.edu

  10. E. T. Jaynes, “The Evolution of Carnot’s Principle,” in Maximum-Entropy and Bayesian Methods in Science and Engineering, G. J. Erickson and C. R. Smith (eds.), Kluwer, Dordrecht, p. 267; on-line: http://www.bayes.wustl.edu

  11. E. T. Jaynes, “Prior Probabilities and Transformation Groups,” around 1965, unpublished manuscrips; on-line: http://www.bayes.wustl.edu/etj/groups.pdf

  12. M. Grendâr, jr., and M. Grendâr, “What is the Question that MaxEnt Answers? A Probabilistic Interpretation,” in Bayesian Inference and Maximum Entropy Methods in Science and Engineering, A. Mohammad-Djafari (ed.), AIP Press, New York, pp. 83–94; on-line: http://www.lanl.gov/abs/math-ph/009020

  13. M. Grendâr, jr., and M. Grendâr, “MiniMax Entropy and Maximum Likelihood,” in Bayesian Inference and Maximum Entropy Methods in Science and Engineering, A. Mohammad-Djafari (ed.), AIP Press, New York, pp. 49–61; on-line: http://www.lanl.gov/abs/math.PR/0009129

  14. R. N. Bracewell, “The Fourier Transform and Its Applications,” McGraw-Hill, Boston, 2000 (first published 1965 )

    Google Scholar 

  15. A. Rényi, “Probability Theory,” (Czech version: Academia, Praha, 1972; German original: Wahrscheinlichkeitsrechnung mit einem Anhang über Informationstheorie,“ VEB deutscher Verlag der Wissenschaften, Berlin, 1962

    Google Scholar 

  16. H. S. Wilf, “Generatingfunctionology,” Academic Press, San Diego, 1994

    Google Scholar 

  17. C. C. Rodriguez, “Entropie Priors,” on-line: http://www.omega.albany.edu:8008/entpriors.ps

  18. C. C. Rodriguez, “Are We Cruising a Hypotheses Space,”, in Maximum Entropy and Bayesian Methods, W. von der Linden, V. Dose, R. Fischer and R. Preuss (eds.), Kluver Academic Publishers, 1998, pp. 131–139; on-line: http://www.omega.albany.edu:8008/

  19. C. C. Rodriguez, “Unreal Probabilities: Partial Truth with Clifford Numbers,” in Maximum Entropy and Bayesian Methods, W. von der Linden, V. Dose, R. Fischer and R. Preuss (eds.), Kluver Academic Publishers, 1998, pp. 247–270; on-line: http://www.omega.albany.edu:8008/

  20. A. Caticha, “Probability and Entropy in Quantum Theory,” in Maximum Entropy and Bayesian Methods, W. von der Linden, V. Dose, R. Fischer and R. Preuss (eds.), Kluver Academic Publishers, 1998, pp. 237–246

    Google Scholar 

  21. J. Baez, “The Octonions,” Bull. Amer. Math. Soc. 39 (2002), pp. 145–205; on-line: http://www.math.ucr.edu/home/baez/Octonions/octonions.htm

  22. L. Frappat, A. Sciarrino and P. Sorba, “Dictionary on Lie Algebras and Superalgebras,” Academic Press, San Diego, 2000

    Google Scholar 

  23. N. Bourbaki, “Lie Groups and Lie Algebras,” Springer, Berlin, 1989 (first published 1971, 1972 )

    Google Scholar 

  24. J. F. Adams, “Lectures on Exceptional Lie Groups,” The University of Chicago Press, Chicago, 1996

    Google Scholar 

  25. J. H. Conway and N. J. A. Sloane, “Sphere Packings, Lattices and Groups,” Springer, New York, 1999

    MATH  Google Scholar 

  26. M. Schroeder, “Fractals, Chaos, Power Laws,” Freeman and Comp., New York, 1991

    MATH  Google Scholar 

  27. A. Gottvald, “Planck’s Law and the Rise of Information Physics,” in Energy and Information in Non-linear Systems, A. Gottvald (ed.), CSAEM, Brno, 2001, pp. 44–47

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2003 Springer Science+Business Media Dordrecht

About this chapter

Cite this chapter

Gottvald, A. (2003). Exponential Family and Inverse Problems. In: Rudnicki, M., Wiak, S. (eds) Optimization and Inverse Problems in Electromagnetism. Springer, Dordrecht. https://doi.org/10.1007/978-94-017-2494-4_17

Download citation

  • DOI: https://doi.org/10.1007/978-94-017-2494-4_17

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-90-481-6375-5

  • Online ISBN: 978-94-017-2494-4

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics