- Editors' Suggestion
- You're Mobile Enabled
- Access by Universitaet Linz
Dynamical Mean-Field Theory of Complex Systems on Sparse Directed Networks
Phys. Rev. Lett. 134, 037401 – Published 24 January, 2025
Abstract
Although real-world complex systems typically interact through sparse and heterogeneous networks, analytic solutions of their dynamics are limited to models with all-to-all interactions. Here, we solve the dynamics of a broad range of nonlinear models of complex systems on sparse directed networks with a random structure. By generalizing dynamical mean-field theory to sparse systems, we derive an exact equation for the path probability describing the effective dynamics of a single degree of freedom. Our general solution applies to key models in the study of neural networks, ecosystems, epidemic spreading, and synchronization. Using the population dynamics algorithm, we solve the path-probability equation to determine the phase diagram of a seminal neural network model in the sparse regime, showing that this model undergoes a transition from a fixed-point phase to chaos as a function of the network topology.
Physics Subject Headings (PhySH)
Article Text
Complex dynamical systems are modeled by
where
The foremost problem in the study of complex systems is how to reduce the dynamics of many interacting elements to the dynamics of a few variables . Dynamical mean-field theory (DMFT)
On the other hand, the dynamics of complex systems on sparse networks has been extensively studied in the case of Ising spins . In this context, both the cavity method and DMFT provide an analytic solution in terms of the path probability for the effective dynamics of a single dynamical variable. However, the presence of bidirected edges induces a temporal feedback, which, in the particular case of sparse systems, leads to an exponential growth of the path-probability dimension , rendering numerical computations unfeasible. Approximation schemes, such as the one-time approximation , make these computations possible . When the interactions are directed or unidirectional, there is no temporal feedback and the path-probability equation can be efficiently solved .
Inspired by these results for Ising spins, in this Letter we solve the dynamics of models governed by Eq. on sparse directed networks with an heterogeneous topology. The solution represents a foundational step in the study of complex systems, as it ultimately incorporates the sparse and heterogeneous structure of complex networks into the formalism of DMFT. Directed networks are interesting because they model the nonreciprocal interactions in real-world complex systems , including the human cortex , food webs , gene regulatory networks , online social networks , and the World Wide Web . The formalism presented here thus opens the possibility to analytically investigate how realistic interactions impact the dynamics of complex systems.
By generalizing DMFT to sparse systems, we obtain an exact equation for the path probability describing the effective dynamics of a single variable for
As an application, we determine the phase diagram of the neural network model by Sompolinsky et al. in the sparse regime. We show that the phase diagram displays trivial and nontrivial fixed-point phases, a chaotic phase with zero mean activity, and a chaotic phase with nonzero mean activity . By calculating certain macroscopic observables, we determine the transition lines as functions of the mean degree and the variance of the coupling strengths, showing their consistency with the universal critical lines derived from random matrix theory . In particular, we provide numerical evidence that the transition between the chaotic phases coincides with the vanishing of the gap between the leading and the subleading eigenvalue of the interaction matrix.
Let
where
Equation defines a network ensemble where directed links are randomly placed between pairs of nodes with probability
We solve the coupled dynamics of Eq. on directed networks by using dynamical mean-field theory (DMFT)
of the probability density
yields the time evolution of the macroscopic quantities
Clearly,
In , we calculate the average of
where
is the average over the effective dynamics governed by
Equation is formally similar to other distributional equations appearing in the study of sparse disordered systems
In Fig. , we compare the solutions of Eq. with numerical simulations of the original coupled dynamics, Eq. , for finite
respectively. In , we compare the solutions of Eq. with numerical simulations for two additional cases: the NN model on networks with power-law indegree distributions and the susceptible-infected-susceptible (SIS) model at the epidemic threshold. In all cases, the agreement between our theoretical results for
Dynamics of the mean
An important question is whether Eq. recovers the analytic results of fully connected models as
To demonstrate the strength of Eq. and its concrete applications, we derive the phase diagram of the NN model on sparse directed networks. In this context,
The two distinct regimes in Eq. result from the gap-gapless transition in the spectrum of
We emphasize that the linear stability analysis of the trivial solution provides no information about the relaxation dynamics or the stationary solutions that emerge when
Phase diagrams
Figure characterizes the transition between the fixed-point Phases I and II. As
for
Continuous transition between the fixed-point phases for the NN model on directed random networks. The coupling strengths follow a Gaussian distribution with mean
Dynamics of
We have developed a dynamical mean-field theory of complex systems on sparse directed networks, deriving an exact path-probability equation for the effective dynamics in the limit
The numerical solution of Eq. does not require generating networks from the configuration model , providing moderate computational advantages over large-scale simulations of Eq. on networks . Beyond its numerical applications, Eq. provides a foundational framework for studying the stationary states , computing correlation functions , deriving approximate dynamical equations for macroscopic order parameters, and developing systematic perturbative approaches .
Our work paves the way for exploring the role of sparse heterogeneous networks on the dynamics of ecosystems, coupled oscillators, epidemic spreading, and beyond. Future works include determining the phase diagram of the sparse Lotka-Volterra model , the influence of external noise on phase diagrams , and the role of network heterogeneities on the critical exponents of complex systems . Lastly, it would be interesting to connect the present formalism with the cavity method in .
F. L. M. thanks Tuan Minh Pham and Alessandro Ingrosso for many stimulating discussions. The author also thanks Thomas Peron and Tuan Minh Pham for their valuable comments on the manuscript. F. L. M. acknowledges support from CNPq (Grant No 402487/2023-0) and from the ICTP through the Associates Program (2023-2028).
Supplemental Material
The supplemental material details how to solve the dynamics of models of complex systems on sparse directed networks using dynamical mean-field theory. It also includes a detailed account of the population dynamics algorithm, used to solve the final self-consistent equation.
References (84)
- H. Sompolinsky, A. Crisanti, and H. J. Sommers, Chaos in random neural networks, Phys. Rev. Lett. 61, 259 (1988).
- Jonathan Kadmon and Haim Sompolinsky, Transition to chaos in random neuronal networks, Phys. Rev. X 5, 041030 (2015).
- Daniel Martí, Nicolas Brunel, and Srdjan Ostojic, Correlations between synapses in pairs of neurons slow down dynamics in randomly connected neural networks, Phys. Rev. E 97, 062314 (2018).
- A. Crisanti and H. Sompolinsky, Path integral approach to random neural networks, Phys. Rev. E 98, 062120 (2018).
- Carles Martorell, Rubén Calvo, Alessia Annibale, and Miguel A. Muñoz, Dynamically selected steady states and criticality in non-reciprocal networks, Chaos, Solitons Fractals 182, 114809 (2024).
- Manfred Opper and Sigurd Diederich, Phase transition and 1/f noise in a game dynamical model, Phys. Rev. Lett. 69, 1616 (1992).
- Guy Bunin, Ecological communities with Lotka-Volterra dynamics, Phys. Rev. E 95, 042414 (2017).
- Ada Altieri, Felix Roy, Chiara Cammarota, and Giulio Biroli, Properties of equilibria and glassy phases of the random Lotka-Volterra model with demographic noise, Phys. Rev. Lett. 126, 258301 (2021).
- Angélica S. Mata and Silvio C. Ferreira, Pair quenched mean-field theory for the susceptible-infected-susceptible model on complex networks, Europhys. Lett. 103, 48003 (2013).
- P. Van Mieghem, Epidemic phase transition of the SIS type in networks, Europhys. Lett. 97, 48004 (2012).
- A. V. Goltsev, S. N. Dorogovtsev, J. G. Oliveira, and J. F. F. Mendes, Localization and spreading of diseases in complex networks, Phys. Rev. Lett. 109, 128702 (2012).
- Romualdo Pastor-Satorras, Claudio Castellano, Piet Van Mieghem, and Alessandro Vespignani, Epidemic processes in complex networks, Rev. Mod. Phys. 87, 925 (2015).
- J. C. Stiller and G. Radons, Dynamics of nonlinear oscillators with random interactions, Phys. Rev. E 58, 1789 (1998).
- Francisco A. Rodrigues, Thomas K. DM. Peron, Peng Ji, and Jürgen Kurths, The Kuramoto model in complex networks, Phys. Rep. 610, 1 (2016).
- Axel Prüser, Sebastian Rosmej, and Andreas Engel, Nature of the volcano transition in the fully disordered Kuramoto model, Phys. Rev. Lett. 132, 187201 (2024).
- Fabian Baumann, Philipp Lorenz-Spreen, Igor M. Sokolov, and Michele Starnini, Modeling echo chambers and polarization dynamics in social networks, Phys. Rev. Lett. 124, 048301 (2020).
- Fabian Baumann, Philipp Lorenz-Spreen, Igor M. Sokolov, and Michele Starnini, Emergence of polarized ideological opinions in multidimensional topic spaces, Phys. Rev. X 11, 011012 (2021).
- Claude Godrèche and Jean-Marc Luck, Characterising the nonequilibrium stationary states of Ornstein–Uhlenbeck processes, J. Phys. A 52, 035002 (2018).
- Andrea Crisanti and Matteo Paoluzzi, Most probable path of active Ornstein-Uhlenbeck particles, Phys. Rev. E 107, 034110 (2023).
- Francesco Ferraro, Christian Grilletta, Amos Maritan, Samir Suweis, and Sandro Azaele, Exact solution of dynamical mean-field theory for a linear system with annealed disorder, arXiv:2405.05183.
- I. Z. Kiss, J. C. Miller, and P. L. Simon, Mathematics of Epidemics on Networks: From Exact to Approximate Models, Interdisciplinary Applied Mathematics (Springer International Publishing, New York, 2017).
- Diogo H. Silva, Francisco A. Rodrigues, and Silvio C. Ferreira, High prevalence regimes in the pair-quenched mean-field theory for the susceptible-infected-susceptible model on networks, Phys. Rev. E 102, 012313 (2020).
- V. Thibeault, A. Allard, and P. Desrosiers, The low-rank hypothesis of complex systems, Nat. Phys. 20, 294 (2024).
- P. C. Martin, E. D. Siggia, and H. A. Rose, Statistical dynamics of classical systems, Phys. Rev. A 8, 423 (1973).
- A. C. C. Coolen, Chapter 15 statistical mechanics of recurrent neural networks II—dynamics, in Neuro-Informatics and Neural Modelling, Handbook of Biological Physics Vol. 4, edited by F. Moss and S. Gielen (North-Holland, Amsterdam, 2001), pp. 619–684.
- John A Hertz, Yasser Roudi, and Peter Sollich, Path integral methods for the dynamics of stochastic and disordered systems, J. Phys. A 50, 033001 (2016).
- F Roy, G Biroli, G Bunin, and C Cammarota, Numerical implementation of dynamical mean field theory for disordered systems: Application to the Lotka–Volterra model of ecosystems, J. Phys. A 52, 484001 (2019).
- Tobias Galla, Dynamically evolved community size and stability of random Lotka-Volterra ecosystems(a), Europhys. Lett. 123, 48004 (2018).
- Jannis Schuecker, Sven Goedeke, and Moritz Helias, Optimal sequence memory in driven random networks, Phys. Rev. X 8, 041029 (2018).
- Francesca Mastrogiuseppe and Srdjan Ostojic, Linking connectivity, dynamics, and computations in low-rank recurrent neural networks, Neuron 99, 609 (2018).
- Lyle Poley, Joseph W. Baron, and Tobias Galla, Generalized Lotka-Volterra model with hierarchical interactions, Phys. Rev. E 107, 024313 (2023).
- Fabián Aguirre-López, Heterogeneous mean-field analysis of the generalized Lotka-Volterra model on a network, J. Phys. A 57, 345002 (2024).
- Jong Il Park, Deok-Sun Lee, Sang Hoon Lee, and Hye Jin Park, Incorporating heterogeneous interactions for ecological biodiversity, Phys. Rev. Lett. 133, 198402 (2024).
- Tuan Minh Pham and Kunihiko Kaneko, Dynamical theory for adaptive systems, J. Stat. Mech. 113501 (2024).
- Valentina Ros, Felix Roy, Giulio Biroli, and Guy Bunin, Quenched complexity of equilibria for asymmetric generalized Lotka–Volterra equations, J. Phys. A 56, 305003 (2023).
- M. Newman, Networks: An Introduction (Oxford University Press, Oxford, 2010).
- Paulo R. Guimarães, The structure of ecological networks across levels of organization, Annu. Rev. Ecol. Evol. Syst. 51, 433 (2020).
- J. P. L. Hatchett, B. Wemmenhove, I. Pérez Castillo, T. Nikoletopoulos, N. S. Skantzos, and A. C. C. Coolen, Parallel dynamics of disordered Ising spin systems on finitely connected random graphs, J. Phys. A 37, 6201 (2004).
- I. Neri and D. Bollé, The cavity approach to parallel dynamics of Ising spins on a graph, J. Stat. Mech. (2009) P08009.
- Kazushi Mimura and A. C. C. Coolen, Parallel dynamics of disordered Ising spin systems on finitely connected directed random graphs with arbitrary degree distributions, J. Phys. A 42, 415001 (2009).
- Yasser Roudi and John Hertz, Dynamical tap equations for non-equilibrium Ising spin glasses, J. Stat. Mech. (2011) P03031.
- Erik Aurell and Hamed Mahmoudi, Dynamic mean-field and cavity methods for diluted Ising systems, Phys. Rev. E 85, 031119 (2012).
- P. Zhang, Inference of kinetic Ising model on sparse graphs, J. Stat. Phys. 148, 502 (2012).
- Gino Del Ferraro and Erik Aurell, Dynamic message-passing approach for kinetic spin models with reversible dynamics, Phys. Rev. E 92, 010102(R) (2015).
- E. Aurell, G. Del Ferraro, E. Domínguez, and R. Mulet, Cavity master equation for the continuous time dynamics of discrete-spin models, Phys. Rev. E 95, 052119 (2017).
- Eduardo Domínguez Vázquez, Gino Del Ferraro, and Federico Ricci-Tersenghi, A simple analytical description of the non-stationary dynamics in Ising spin systems, J. Stat. Mech. (2017) 033303.
- Giuseppe Torrisi, Alessia Annibale, and Reimer Kühn, Overcoming the complexity barrier of the dynamic message-passing method in networks with fat-tailed degree distributions, Phys. Rev. E 104, 045313 (2021).
- Giuseppe Torrisi, Reimer Kühn, and Alessia Annibale, Uncovering the non-equilibrium stationary properties in sparse boolean networks, J. Stat. Mech. (2022) 053303.
- Freya Behrens, Barbora Hudcová, and Lenka Zdeborová, Backtracking dynamical cavity method, Phys. Rev. X 13, 031021 (2023).
- Freya Behrens, Barbora Hudcová, and Lenka Zdeborová, Dynamical phase transitions in graph cellular automata, Phys. Rev. E 109, 044312 (2024).
- B. Derrida, E. Gardner, and A. Zippelius, An exactly solvable asymmetric neural network model, Europhys. Lett. 4, 167 (1987).
- Malbor Asllani, Renaud Lambiotte, and Timoteo Carletti, Structure and dynamical behavior of non-normal networks, Sci. Adv. 4, eaau9403 (2018).
- Yangfan Peng, Antje Bjelde, Pau Vilimelis Aceituno, Franz X. Mittermaier, Henrike Planert, Sabine Grosser, Julia Onken, Katharina Faust, Thilo Kalbhenn, Matthias Simon, Helena Radbruch, Pawel Fidzinski, Dietmar Schmitz, Henrik Alle, Martin Holtkamp, Imre Vida, Benjamin F. Grewe, and Jörg R. P. Geiger, Directed and acyclic synaptic connectivity in the human layer 2-3 cortical microcircuit, Science 384, 338 (2024).
- Jennifer A. Dunne, Richard J. Williams, and Neo D. Martinez, Food-web structure and network theory: The role of connectance and size, Proc. Natl. Acad. Sci. U.S.A. 99, 12917 (2002).
- Jordi Bascompte, Disentangling the web of life, Science 325, 416 (2009).
- S. S. Shen-Orr, R. Milo, S. Mangan, and U. Alon, Network motifs in the transcriptional regulation network of Escherichia coli, Nat. Genet. 31, 64 (2002).
- Tong Ihn Lee et al., Transcriptional regulatory networks in Saccharomyces cerevisiae, Science 298, 799 (2002).
- Haewoon Kwak, Changhyun Lee, Hosung Park, and Sue Moon, What is twitter, a social network or a news media? in Proceedings of the 19th International Conference on World Wide Web (Association for Computing Machinery, New York, USA, 2010), pp. 591–600.
- Christoph Schweimer, Christine Gfrerer, Florian Lugstein, David Pape, Jan A. Velimsky, Robert Elsässer, and Bernhard C. Geiger, Generating Simple Directed Social Network Graphs for Information Spreading (Association for Computing Machinery, New York, USA, 2022), pp. 1475–1485.
- R. Pastor-Satorras and A. Vespignani, Evolution and Structure of the Internet: A Statistical Physics Approach (Cambridge University Press, Cambridge, England, 2004).
- M Mézard and G Parisi, The Bethe lattice spin glass revisited, Eur. Phys. J. B 20, 217 (2001).
- M Mézard and G Parisi, The cavity method at zero temperature, J. Stat. Phys. 111, 1 (2003).
- Reimer Kühn, Spectra of sparse random matrices, J. Phys. A 41, 295002 (2008).
- Fernando Lucas Metz, Izaak Neri, and Tim Rogers, Spectral theory of sparse non-Hermitian random matrices, J. Phys. A 52, 434003 (2019).
- R. Abou-Chacra, D. J. Thouless, and P. W. Anderson, A selfconsistent theory of localization, J. Phys. C 6, 1734 (1973).
- M. Mézard and A. Montanari, Information, Physics, and Computation, Oxford Graduate Texts (Oxford University Press, Oxford, 2009).
- Izaak Neri and Fernando Lucas Metz, Eigenvalue outliers of non-Hermitian random matrices with a local tree structure, Phys. Rev. Lett. 117, 224101 (2016).
- Izaak Neri and Fernando Lucas Metz, Linear stability analysis of large dynamical systems on random directed graphs, Phys. Rev. Res. 2, 033313 (2020).
- Fernando Lucas Metz and Izaak Neri, Localization and universality of eigenvectors in directed random graphs, Phys. Rev. Lett. 126, 040604 (2021).
- M. E. J. Newman, S. H. Strogatz, and D. J. Watts, Random graphs with arbitrary degree distributions and their applications, Phys. Rev. E 64, 026118 (2001).
- Bailey K. Fosdick, Daniel B. Larremore, Joel Nishimura, and Johan Ugander, Configuring random graph models with fixed degree sequences, SIAM Rev. 60, 315 (2018).
- See Supplemental Material at http://link.aps.org/supplemental/10.1103/PhysRevLett.134.037401 for all derivations of DMFT and a detailed account of the population dynamics algorithm.
- Charles Bordenave and Marc Lelarge, Resolvent of large random graphs, Random Struct. Algorithms 37, 332 (2010).
- Fernando L. Metz and Jeferson D. Silva, Spectral density of dense random networks and the breakdown of the Wigner semicircle law, Phys. Rev. Res. 2, 043116 (2020).
- Fernando L. Metz and Thomas Peron, Mean-field theory of vector spin models on networks with arbitrary degree distributions, J. Phys.: Complexity 3, 015008 (2022).
- Jeferson D. Silva and Fernando L. Metz, Analytic solution of the resolvent equations for heterogeneous random graphs: Spectral and localization properties, J. Phys.: Complexity 3, 045012 (2022).
- Leonardo S. Ferreira and Fernando L. Metz, Nonequilibrium dynamics of the Ising model on heterogeneous networks with an arbitrary distribution of threshold noise, Phys. Rev. E 107, 034127 (2023).
- G. Timár, A. V. Goltsev, S. N. Dorogovtsev, and J. F. F. Mendes, Mapping the structure of directed networks: Beyond the bow-tie diagram, Phys. Rev. Lett. 118, 078301 (2017).
- Ivan Kryven, Emergence of the giant weak component in directed random graphs with arbitrary degree distributions, Phys. Rev. E 94, 012315 (2016).
- G. L. Baker and J. P. Gollub, Chaotic Dynamics: An Introduction (Cambridge University Press, Cambridge, England, 1996).
- Maximilian Gelbrecht, Jürgen Kurths, and Frank Hellmann, Monte Carlo basin bifurcation analysis, New J. Phys. 22, 033032 (2020).
- F. L. Metz, G. Parisi, and L. Leuzzi, Finite-size corrections to the spectrum of regular random graphs: An analytical solution, Phys. Rev. E 90, 052109 (2014).
- Thibaut Arnoulx de Pirey and Guy Bunin, Critical behavior of a phase transition in the dynamics of interacting populations, arXiv:2402.05063.
- Mattia Tarabolo and Luca Dall’Asta, Gaussian approximation of dynamic cavity equations for linearly-coupled stochastic dynamics, arXiv:2406.14200.