Skip to main content
SpringerLink
Log in

Optimization in Biology Parameter Estimation and the Associated Optimization Problem

  • Chapter
  • First Online:
Uncertainty in Biology

Part of the book series: Studies in Mechanobiology, Tissue Engineering and Biomaterials ((SMTEB,volume 17))

Abstract

Parameter estimation—the assignment of values to the parameters in a model—is an important and time-consuming task in computational biology. Recent computational and algorithmic developments have provided novel tools to improve this estimation step. One of these improvements concerns the optimization step, where the parameter space is explored to find interesting regions. In this chapter we review the parameter estimation problem, with a special emphasis on the associated optimization methods. In relation to this, we also provide concepts and tools to help you select the appropriate methodology for a specific scenario.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Allman, E.S., Rhodes, J.A.: Mathematical Models in Biology. Cambridge University Press, Cambridge (2003)

    Book  Google Scholar 

  2. Banga, J.R.: Optimization in computational systems biology. BMC Syst. Biol. 2, 47 (2008). doi:10.1186/1752-0509-2-47

    Article  MathSciNet  Google Scholar 

  3. Berg, J.M., Tymoczko, J.L., Stryer, L.: Biochemistry, 5th edn. W. H. Freeman, New York (2002)

    Google Scholar 

  4. Bishop, C.M.: Neural Networks for Pattern Recognition, 1st edn. Oxford University Press, New York (1996)

    MATH  Google Scholar 

  5. Brännmark, C., Palmér, R., Glad, S.T., Cedersund, G., Strålfors, P.: Mass and information feedbacks through receptor endocytosis govern insulin signaling as revealed using a parameter-free modeling framework. J. Biol. Chem. 285(26), 20171–20179 (2010)

    Article  Google Scholar 

  6. Britton, N.F.: Essential Mathematical Biology, p. 335. Springer, New York (2005)

    Google Scholar 

  7. Cedersund, G.: Prediction uncertainty estimation despite unidentifiability: an overview of recent developments. In: Uncertainty in Biology, A Computational Modeling Approach. Springer, Cham (2016, this volume)

    Google Scholar 

  8. Cedersund, G.: Conclusions via unique predictions obtained despite unidentifiability-new definitions and a general method. FEBS J. 279(18), 3513–3527 (2012). doi:10.1111/j.1742-4658.2012.08725.x

    Article  Google Scholar 

  9. Chaouiya, C., Berenguier, D., Keating, S.M., Naldi, A., van Iersel, M.P., Rodriguez, N., Dräger, A., Büchel, F., Cokelaer, T., Kowal, B., Wicks, B., Gonçalves, E., Dorier, J., Page, M., Monteiro, P.T., von Kamp, A., Xenarios, L., de Jong, H., Hucka, M., Klamt, S., Thieffry, D., Le Novère, N., Saez-Rodriguez, J., Helikar, T.: SBML Qualitative Models: a model representation format and infrastructure to foster interactions between qualitative modelling formalisms and tools BMC Syst. Biol. 7(135), (2013)

    Google Scholar 

  10. De Jong, H.: Modeling and simulation of genetic regulatory systems: a literature review. J. Comput. Biol. 9(1), 67–103 (2002)

    Article  Google Scholar 

  11. De Jong K.: Genetic algorithms: a 30 year perspective. In: Booker, L., Forrest, S., Mitchell, M., Riolo, R. (eds) Perspectives on Adaptation in Natural and Artificial Systems, Oxford University Press, New York (2005)

    Google Scholar 

  12. De Jong, K.A.: Evolutionary computation: a unified approach. MIT Press, Cambridge (2006)

    Google Scholar 

  13. Dorigo, M., Birattari, M., Stützle, T.: Ant colony optimization–artificial ants as a computational intelligence technique. IEEE Comput. intell. Mag. 1, 28–39 (2006)

    Article  Google Scholar 

  14. Egea, J.: New heuristics for global optimization of complex bioprocesses. Dissertation, University de Vigo (2008)

    Google Scholar 

  15. Egea, J., Rodriguez-Fernandez, M., Banga, J., Martí, R.: Scatter search for chemical and bio-process optimization. J. Glob. Optim. 37(3), 481–503 (2007)

    Article  MATH  Google Scholar 

  16. Garny, A., Nickerson, D., Cooper, J., Weber dos Santos, R., Miller, A.K., McKeever, S., Nielsen, P., Hunter, P.J.: CellML and associated tools and techniques. Philos. Trans. R. Soc. A 366(1878), 3017–3043 (2008)

    Google Scholar 

  17. Gerstner, W., Sprekeler, H., Deco, G.: Theory and simulation in neuroscience. Science (New York, N.Y.) 338(6103), 60–65 (2012). doi:10.1126/science.1227356

    Article  Google Scholar 

  18. Glover, F.: Heuristics for integer programming using surrogate constraints. Decis. Sci. 8(1), 156–166 (1977)

    Article  Google Scholar 

  19. Glover, F., Kochenberger, G.A.: Handbook of metaheuristics 57. International Series in Operations Research & Management Science, Springer, New York (2003)

    Google Scholar 

  20. Goldberg, D.E.: Genetic Algorithms in Search, Optimization and Machine Learning, 1st edn. Addison-Wesley Longman Publishing Co., Inc, Boston (1989)

    MATH  Google Scholar 

  21. Gomez-Cabrero, D., Ardid, S., Cano-Colino, M., Tegnér, J., Compte, A.: Neuroswarm: a methodology to explore the constraints that function imposes on simulation parameters in large-scale networks of biological neurons. In: Uncertainty in Biology, A Computational Modeling Approach. Springer, Cham (2016, this volume)

    Google Scholar 

  22. Gomez-Cabrero, D., Compte, A., Tegnér, J.: Workflow for generating competing hypothesis from models with parameter uncertainty. Interface Focus 1(3), 438–449 (2011). doi:10.1098/rsfs.2011.0015

    Google Scholar 

  23. Greenberg, H.J., Hart, W.E., Lancia, G.: Opportunities for combinatorial optimization in computational biology. INFORMS J. Comput. 16(3), 211–231 (2004)

    Article  MATH  MathSciNet  Google Scholar 

  24. Gustafsson, M., Hörnquist, M., Lundström, J., Björkegren, J., Tegnér, J.: Reverse engineering of gene networks with LASSO and nonlinear basis functions. Ann. N.Y. Acad. Sci. 1158, 265–275 (2009). doi:10.1111/j.1749-6632.2008.03764.x

    Article  Google Scholar 

  25. Hart, W.E.: Adaptive global optimization with local search. Doctoral Dissertation, University of California, San Diego (1994)

    Google Scholar 

  26. Hodgkin, A.L.: Chance and Design in Electrophysiology: An informal account of certain experiments on nerve carried out between 1934 and 1952. J. Physiol. 263(I), 1–21 (1976)

    Google Scholar 

  27. Hodgkin, A.L., Huxley, A.F.: Currents carried by sodium and potassium ions through the membrane of the giant axon of Loligo This information is current as of January 29, This is the final published version of this article; it is available at: this version of the article may not be. J. Physiol. (Paris) 116, 449–472 (1952)

    Google Scholar 

  28. Holland, J.H.: Adaptation in natural and artificial systems: an introductory analysis with applications to biology, control, and artificial intelligence. University of Michigan Press, Ann Arbor (1975)

    Google Scholar 

  29. Hoops, S., Sahle, S., Gauges, R., Lee, C., Pahle, J., Simus, N., Singhal, M., Xu, L., Mendes, P., Kummer, U.: COPASI-a COmplex PAthway SImulator. Bioinformatics 22(24), 3067–3074 (2006)

    Article  Google Scholar 

  30. Hopfield, J.J.: Neural networks and physical systems with emergent collective computational abilities. Proc. Natl. Acad. Sci. U.S.A. 79, 2554–2558 (1982)

    Article  MathSciNet  Google Scholar 

  31. Hübner, K., Sahle, S., Kummer, U.: Applications and trends in systems biology in biochemistry. FEBS J. 278(16), 2767–2857 (2011)

    Article  Google Scholar 

  32. Kennedy, J., Eberhart, R.C.: Particle swarm optimization. In: Proceedings IEEE international conference on neural networks, Piscataway, pp. 1942–1948 (1995)

    Google Scholar 

  33. Kennedy J, Eberhart RC.: (2001) Swarm Intelligence. Morgan Kaufmann Publishers, Massachusetts (2001)

    Google Scholar 

  34. Koza, J.R.: Genetic Programming: On the Programming of Computers by Means of Natural Selection. MIT Press, Cambridge (1992)

    Google Scholar 

  35. Kirkpatrick, S., Gelatt Jr, C.D., Vecchi, M.: Optimization by simulated annealing. Science 220(4598), 671–680 (1983)

    Google Scholar 

  36. Larranaga, P.: Machine learning in bioinformatics. Briefings Bioinf. 7(1), 86–112 (2006). doi:10.1093/bib/bbk007

    Article  MathSciNet  Google Scholar 

  37. Li, Z., Li, P., Krishnan, A., Liu, J.: Large-scale dynamic gene regulatory network inference combining differential equation models with local dynamic Bayesian network analysis. Bioinformatics (Oxford, England) 27(19), 2686–2691 (2011). doi:10.1093/bioinformatics/btr454

    Google Scholar 

  38. Mannakee, B.K., Ragsdale, A.P., Transtrum, M.K., Gutenkunst, R.N.: Sloppiness and the geometry of parameter space. In: Uncertainty in Biology, A Computational Modeling Approach. Springer, Cham (2016, this volume)

    Google Scholar 

  39. Markowetz, F.: How to understand the cell by breaking it: network analysis of gene perturbation screens. PLoS Comput. Biol. 6(2), e1000655 (2010). doi:10.1371/journal.pcbi.1000655

    Article  Google Scholar 

  40. Martinez-Estudillo, A., Hervas-Martinez, C., Martinez-Estudillo, F., Garca-Pedrajas, N.: Hybrid method based on clustering for evolutionary algorithms with local search. IEEE Trans. Syst. Man Cybernetics 34(1) (2004)

    Google Scholar 

  41. Maza, M., Yuret, D.: Dynamic hill climbing: overcoming the limitations of optimization techniques. In: Proceedings of the 2nd Turkish Symposium on Artificial Inteligence and ANN, 1993

    Google Scholar 

  42. Myers, C.R., Gutenkunst, R.N., Sethna, J.P.: Python unleashed on systems biology. Comput. Sci. Eng. 9, 34 (2007)

    Google Scholar 

  43. Nyman, E., Brännmark, C., Palmér, R., Brugård, J., Nyström, F.H., Strålfors, P., Cedersund, G.: A hierarchical whole-body modeling approach elucidates the link between in Vitro insulin signaling and in Vivo glucose homeostasis. J. Biol. Chem. 286(29), 26028–26041 (2011)

    Article  Google Scholar 

  44. Pettersson, T.: Global optimization methods for estimation of descriptive models. Master’s thesis, Linköping University, Sweden (2008)

    Google Scholar 

  45. Poli, R.: Analysis of the publications on the applications of particle swarm optimisation. J. Artif. Evol. Appl. 2008, 1–10 (2008)

    Google Scholar 

  46. Press, W., Teukolsky, S., Vetterling, W., Flannery, B.: Numerical Recipes in C, 2nd edn. Cambridge University Press, Cambridge (1992)

    MATH  Google Scholar 

  47. Roy, R., Dehuri, S., Cho, S.B.: A novel particle Swarm optimization algorithm for multi-objective combinatorial optimization problem. Int. J. Appl. Metaheuristic Comput. (IJAMC) 2(4), 41–57 (2012)

    Google Scholar 

  48. Schlitt, T., Brazma, A.: Current approaches to gene regulatory network modelling. BMC Bioinform. 8(Suppl 6), S9 (2007). doi:10.1186/1471-2105-8-S6-S9

    Article  Google Scholar 

  49. Schmidt, H., Jirstrand, M.: Systems biology toolbox for MATLAB: a computational platform for research in systems biology. Bioinformatics 22(4), 514–515 (2006)

    Article  Google Scholar 

  50. Scholma, J., Schivo, S., Urquidi Camacho, R.,a, van de Pol, J., Karperien, M., Post, J.N.: Biological networks 101: computational modeling for molecular biologists. Gene 533(1), 379–384 (2014). doi:10.1016/j.gene.2013.10.010

    Google Scholar 

  51. Segrè, D., Zucker, J., Katz, J., Lin, X., Haeseleer, P.D., Rindone, W.P., Church,G.M.: From Annotated Genomes to Metabolic Flux Models and Kinetic Parameter Fitting. OMICS J. Integr. Biol. 7(3), 301–316 (2003)

    Google Scholar 

  52. Sejnowski, T.J., Koch, C., Churchland, P.S.: Computational Neuroscience. Science 241, 1299–1306 (1987)

    Article  Google Scholar 

  53. Skogsberg, J., Lundström, J., Kovacs, A., Nilsson, R., Noori, P., Maleki, S., Björkegren,J.: Transcriptional profiling uncovers a network of cholesterol-responsive atherosclerosis target genes. PLoS Genet. 4(3), e1000036 (2008). doi:10.1371/journal.pgen.1000036

    Google Scholar 

  54. Swameye, I., Muller, T.G., Timmer, J., Sandra, O., Klingmuller, U.: Identification of nucleocytoplasmic cycling as a remote sensor in cellular signaling by databased modeling. Proc. Natl. Acad. Sci. 100, 1028–1033 (2003)

    Google Scholar 

  55. Triki, E., Collette, Y., Siarry, P.A.: Theoretical study on the behavior of simulated annealing leading to a new cooling schedule. Eur. J. Oper. Res. 166(1 SPEC. ISS.), 77–92 (2005)

    Google Scholar 

  56. Van Geit, W., Achard, P., De Schutter, E.: Neurofitter: a parameter tuning package for a wide range of electrophysiological neuron models. Front. Neuroinformatics 1, 1 (2007). doi:10.3389/neuro.11.001.2007

  57. Van Geit, W., De Schutter, E., Achard, P.: Automated neuron model optimization techniques: a review. Biol. Cybern. 99(4–5), 241–251 (2008). doi:10.1007/s00422-008-0257-6

    Article  MATH  Google Scholar 

  58. Van Riel, NW.: Dynamic modelling and analysis of biochemical networks: mechanism-based models and model-based experiments. Briefings Bioinf. 7(4), 364–374 (2006). doi:10.1093/bib/bbl040

    Google Scholar 

  59. Wolpert, D.H., Macready, W.G.: No free lunch theorems for optimization. IEEE Trans. Evol. Comput. 1, 67–82 (1997)

    Article  Google Scholar 

  60. Zimmer, D.C.: Parameter estimation for stochastic models of biochemical reactions. J. Comput. Sci. Syst. Biol. 6, 011–021 (2012). doi:10.4172/jcsb.1000095

    MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Integrative Systems Biology, Department of Biomedical Engineering, Linköping University, 58185, Linköping, Sweden

    Gunnar Cedersund

  2. Department of Clinical and Experimental Medicine, Linköping University, 58185, Linköping, Sweden

    Gunnar Cedersund

  3. Stockholm, Sweden

    Oscar Samuelsson & Gordon Ball

  4. Unit of Computational Medicine, Department of Medicine, Karolinska Institutet, Solna, Sweden

    Jesper Tegnér

  5. Center for Molecular Medicine, Stockholm, Sweden

    David Gomez-Cabrero

Authors
  1. Gunnar Cedersund
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Oscar Samuelsson
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Gordon Ball
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jesper Tegnér
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. David Gomez-Cabrero
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Gunnar Cedersund .

Editor information

Editors and Affiliations

  1. Biomechanics Research Unit, University of Liège, Liège 1, Belgium

    Liesbet Geris

  2. Center for Molecular Medicine, Karolinska University Hospital, Stockholm, Sweden

    David Gomez-Cabrero

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Cedersund, G., Samuelsson, O., Ball, G., Tegnér, J., Gomez-Cabrero, D. (2016). Optimization in Biology Parameter Estimation and the Associated Optimization Problem. In: Geris, L., Gomez-Cabrero, D. (eds) Uncertainty in Biology. Studies in Mechanobiology, Tissue Engineering and Biomaterials, vol 17. Springer, Cham. https://doi.org/10.1007/978-3-319-21296-8_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-21296-8_7

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-21295-1

  • Online ISBN: 978-3-319-21296-8

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation