Abstract
We present a comprehensive theory for analysis and understanding of transition events between an initial set A and a target set B for general ergodic finite-state space Markov chains or jump processes, including random walks on networks as they occur, e.g., in Markov State Modelling in molecular dynamics. The theory allows us to decompose the probability flow generated by transition events between the sets A and B into the productive part that directly flows from A to B through reaction pathways and the unproductive part that runs in loops and is supported on cycles of the underlying network. It applies to random walks on directed networks and nonreversible Markov processes and can be seen as an extension of Transition Path Theory. Information on reaction pathways and unproductive cycles results from the stochastic cycle decomposition of the underlying network which also allows to compute their corresponding weight, thus characterizing completely which structure is used how often in transition events. The new theory is illustrated by an application to a Markov State Model resulting from weakly damped Langevin dynamics where the unproductive cycles are associated with periodic orbits of the underlying Hamiltonian dynamics.
Similar content being viewed by others
References
B. Altaner, S. Grosskinsky, S. Herminghaus, L. Katthän, M. Timme, J. Vollmer, Phys. Rev. E 85, 041133 (2012)
G.R. Bowman, V.S. Pande, F. Noé, editors, An Introduction to Markov State Models and Their Application to Long Timescale Molecular Simulation, Vol. 797 of Advances in Experimental Medicine and Biology (Springer, 2014)
M. Cameron, E. Vanden-Eijnden, J. Stat. Phys. 156(3), 427 (2014)
J. Chodera, N. Singhal, V.S. Pande, K. Dill, W. Swope, J. Chem. Phys., 126 (2007)
N. Djurdjevac-Conrad, R. Banisch, Ch. Schütte, J. Comp. Dynamics (2014) [arXiv:1407.8039v2] [math-ph]
E. Weinan, E. Vanden-Eijnden, Metastability, conformation dynamics, and transition pathways in complex systems, Multiscale modelling and simulation, Lect. Notes Comput. Sci. Eng., Vol. 39 (Springer, Berlin, 2004), p. 35
E. Weinan, E. Vanden-Eijnden, J. Stat. Phys. 123, 503 (2006)
E. Weinan, E. Vanden-Eijnden, Ann. Rev. Phys. Chem. 61, 391 (2010)
D. Jiang, M. Qian, M.-P. Quian, Mathematical theory of nonequilibrium steady states: on the frontier of probability and dynamical systems (Springer, 2004)
S.L. Kalpazidou, Cycle Representations of Markov Processes (Springer, 2006)
K.J. Kohlhoff, D. Shukla, M. Lawrenz, G.R. Bowman, D.E. Konerding, D. Belov, R.B. Altman, V.S. Pande, Nat. Chem. 6(1), 15 (2014)
T. Li, E. Weinan, E. Vanden Eijnden, Proc. Nat. Acad. Sci., 105 (2008)
J. Mattingly, A.M. Stuart, D.J. Higham, Stochastic Process Appl. 101(2), 185 (2002)
P. Metzner, Transition Path Theory for Markov Processes: Application to molecular dynamics, Ph.D. thesis, Free University Berlin , 2007
P. Metzner, Ch. Schütte, E. Vanden-Eijnden, J. Chem. Phys. 125(8), 084110 (2006)
P. Metzner, Ch. Schütte, E. Vanden-Eijnden, Multiscale Modeling Simul. 7(3), 1192 (2009)
F. Noe, S. Fischer, Curr. Opin. Struct. Biol. 18, 154 (2008)
F. Noe, I. Horenko, Ch. Schütte, J.C. Smith, J. Chem. Phys. 126, 155102 (2007)
F. Noé, Ch. Schütte, E. Vanden-Eijnden, L. Reich, T. Weikl, PNAS 106(45), 19011 (2009)
A.C. Pan, B. Roux, J. Chem. Phys. 129(6), 064107 (2008)
J.-H. Prinz, H. Wu, M. Sarich, B. Keller, M. Fischbach, M. Held, J.D. Chodera, Ch. Schütte, F. Noé, J. Chem. Phys. 134, 174105 (2011)
H. Risken, The Fokker-Planck Equation, 2nd edition (Springer, New York, 1996)
M. Sarich, N. Djurdjevac, S. Bruckner, T.O.F. Conrad, Ch. Schütte, J. Comp. Dyn. 1(1), 191 (2014)
J. Schnakenberg, Rev. Mod. Phys. 48, 571 (1976)
Ch. Schütte, M. Sarich, Metastability and Markov State Models in Molecular Dynamics: Modeling, Analysis, Algorithmic Approaches, Vol. 24 of Courant Lecture Notes (American Mathematical Society, 2013)
C.R. Schwantes, R.T. McGibbon, V.S. Pande, J. Chem. Phys. 141(9) (2014)
E. Vanden-Eijnden, Transition path theory, In Computer Simulations in Condensed Matter Systems: From Materials to Chemical Biology, Vol. 1, edited by M. Ferrario, G. Ciccotti, K. Binder, Vol. 703 of Lecture Notes in Physics (Springer Berlin Heidelberg, 2006), p. 453
H. Wang, Ch. Schütte, J. Chem. Theory Computation (2015)
R.K.P. Zia, B. Schmittmann, J. Stat. Mechan. Theo. Exper. 7 (2007)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Banisch, R., Djurdjevac Conrad, N. & Schütte, C. Reactive flows and unproductive cycles for random walks on complex networks. Eur. Phys. J. Spec. Top. 224, 2369–2387 (2015). https://doi.org/10.1140/epjst/e2015-02417-8
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1140/epjst/e2015-02417-8