Biological neural networks can operate in qualitatively distinct dynamical regimes, and transitions between these regimes are thought to underlie changes in computation and behavior. A seminal theoretical foundation for understanding such regimes was provided by Sompolinsky, Crisanti, and Sommers (SCS), who showed that random recurrent networks undergo a transition from quiescent activity to asynchronous chaos. This result established a paradigmatic link between random connectivity, dynamical instability, and internally generated fluctuations in neural circuits. Dynamical mean-field theory (DMFT), introduced in this context, has since become a powerful framework for constructing phase diagrams of recurrent network dynamics. Here, we extend the SCS framework to two-population firing-rate networks with segregated excitatory and inhibitory neurons and target-specific inhibitory couplings that break excitation–inhibition balance. Using DMFT, we derive self-consistent equations for macroscopic observables and stability conditions that distinguish mean-driven from fluctuation-driven routes to instability. We identify three qualitatively distinct organizations of phase diagrams. When the mean mode remains stable, including at the strictly balanced point, the system displays the classical SCS phenomenology of quiescent activity and zero-mean asynchronous chaos. In excitation-dominated networks, additional regimes emerge, including persistent activity. Depending on the eigenvalues of the stability matrix, excitation-dominated networks can further exhibit either chaos with non-vanishing mean activity, corresponding to structured or synchronous chaos, or collective oscillations. However, these oscillations do not coexist with chaotic fluctuations around the periodic mean trajectory; instead, the onset of collective oscillations suppresses the chaotic component, in a regime reminiscent of input-induced suppression of chaos. Together, these results generalize the seminal SCS theory to circuits with explicit excitatory–inhibitory structure and target-specific inhibition, providing a unified DMFT-based framework linking inhibitory architecture to the organization of large-scale dynamical regimes in recurrent neural networks.
We address the problem of defining connected components in hypergraphs, which are models for systems with higher-order interactions. For graphs with dyadic interactions, connected components are defined in terms of paths connecting nodes along the graph. However, defining connected components in hypergraphs is a more involved problem, as one needs to consider the higher-order nature of the interactions associated with the hyperedge. Higher-order interactions can be taken into consideration through a logic associated with the hyperedges, two examples being OR-logic and AND-logic; these logical operations can be considered two limiting cases corresponding to non-cooperative and fully cooperative interactions, respectively. In this paper we show how connected components can be defined in hypergraphs with OR or AND logic. While OR-logic and AND-logic provide the same connected components for nondirected hypergraphs, for directed hypergraphs the strongly connected component of AND-logic is a subset of the OR-logic strongly connected component. Interestingly, higher-order interactions change the general topological properties of connected components in directed hypergraphs. Notably, while for directed graphs the strongly connected component is the intersection of its in- and out-component, in hypergraphs with AND-logic the intersection of in- and out-component does not equal the strongly connected component. We develop a theory for the fraction of nodes that are part of the largest connected component and through comparison with real-world data we show that degree-cardinality correlations play a significant role.
The neural model introduced by Sompolinsky, Crisanti, and Sommers (SCS) nearly four decades ago has become a paradigmatic framework for studying complex dynamics in random recurrent networks. In its original formulation, with balanced positive and negative couplings, the model exhibits two phases: a quiescent regime, where all activity ceases, and a regime of ongoing irregular collective activity, termed asynchronous chaos (AC), in which state variables fluctuate strongly in time and across units but average to zero across the network. Building on recent work, we analyze an extension of the SCS model that breaks this coupling balance, yielding a richer phase diagram. In addition to the classical quiescent and AC phases, two additional regimes emerge, marked by spontaneous symmetry breaking. In the persistent-activity (PA) phase, each unit settles into a distinct, stable activation state. In the synchronous-chaotic (SC) phase, dynamics remain irregular and chaotic but fluctuate around a nonzero mean, generating sustained long-time autocorrelations. Using analytical techniques based on dynamical mean-field theory, complemented by extensive numerical simulations, we show how structural disorder gives rise to symmetry and ergodicity breaking. Remarkably, the resulting phase diagram closely parallels that of the Sherrington-Kirkpatrick spin-glass model, with the onset of the SC phase coinciding with the transition associated with replica-symmetry breaking. All key features of spin glasses, including ergodicity breaking, have clear counterparts in this recurrent network context, albeit with crucial idiosyncratic differences, highlighting a unified perspective on complexity in disordered systems.
We consider a simple neural network model, evolving via non-linear coupled stochastic differential equations, where neural couplings are random Gaussian variables with non -zero mean and arbitrary degree of reciprocity. Using a path -integral approach, we analyse the dynamics, averaged over the network ensemble, in the thermodynamic limit. Our results show that for any degree of reciprocity in the couplings, two types of criticality emerge, corresponding to ferromagnetic and spin -glass order, respectively. The critical lines separating the disordered from the ordered phases is consistent with spectral properties of the coupling matrix, as derived from random matrix theory. As the non -reciprocity (or asymmetry) in the couplings increases, both ordered phases diminish in size, ultimately resulting in the disappearance of the spin -glass phase when the couplings become anti -symmetric. We investigate non -fixed point steady-state solutions for uncorrelated interactions. For such solutions the time -lagged correlation function evolves according to a gradient -descent dynamics on a potential, which depends on the stationary variance. Our analysis shows that in the spin -glass region, the variance dynamically selected by the system leads the correlation function to evolve on the separatrix curve, limiting different realizable steady states, whereas in the ferromagnetic region, a fixed point solution is selected as the only realizable steady state. In the spin -glass region, stationary solutions are unstable against perturbations that break time -translation invariance, indicating chaotic behaviour in large single network instances. Numerical analysis of Lyapunov exponents confirms that chaotic behaviour emerges throughout the spin -glass region, for any value of the coupling correlations. While negative correlations increase the strength of chaos, positive ones reduce it, with chaos disappearing for reciprocal (i.e. symmetric) couplings, where marginal stability is attained. On the other hand, in finite size non -reciprocal networks, fixed points and limit cycles can arise in the spin -glass region, especially close to the critical line. Finally, we show that chaos is suppressed when the strength of external noise exceeds a certain threshold. Intriguing analogies between chaotic phases in non -equilibrium systems and spin -glass phases in equilibrium are put forward.
We introduce a clustering coefficient for nondirected and directed hypergraphs, which we call the quad clustering coefficient. We determine the average quad clustering coefficient and its distribution in real-world hypergraphs and compare its value with those of random hypergraphs drawn from the configuration model. We find that real-world hypergraphs exhibit a nonnegligible fraction of nodes with a maximal value of the quad clustering coefficient, while we do not find such nodes in random hypergraphs. Interestingly, these highly clustered nodes can have large degrees and can be incident to hyperedges of large cardinality. Moreover, highly clustered nodes are not observed in an analysis based on the pairwise clustering coefficient of the associated projected graph that has binary interactions, and hence higher order interactions are required to identify nodes with a large quad clustering coefficient.
In this work we present a rigorous and straightforward method to detect the onset of the instability of replica-symmetric theories in information processing systems, which does not require a full replica analysis as in the method originally proposed by de Almeida and Thouless for spin glasses. The method is based on an expansion of the free-energy obtained within one-step of replica symmetry breaking (RSB) around the RS value. As such, it requires solely continuity and differentiability of the free-energy and it is robust to be applied broadly to systems with quenched disorder. We apply the method to the Hopfield model and to neural networks with multi-node Hebbian interactions, as case studies. In the appendices we test the method on the Sherrington-Kirkpatrick and the Ising P-spin models, recovering the AT lines known in the literature for these models, as a special limit, which corresponds to assuming that the transition from the RS to the RSB phase can be obtained by varying continuously the order parameters. Our method provides a generalization of the AT approach, which does not rely on this limit and can be applied to systems with discontinuous phase transitions, as we show explicitly for the spherical P-spin model, recovering the known RS instability line.
Information in the form of data, which can be stored and transferred between users, can be viewed as an intangible commodity, which can be traded in exchange for money. Determining the fair price at which a string of data should be traded is an important and open problem in many settings. In this work we develop a statistical physics framework that allows one to determine analytically the fair price of information exchanged between players in a game of chance. For definiteness, we consider a game where N players bet on the binary outcome of a stochastic process and share the entry fees pot if successful. We assume that one player holds information about past outcomes of the game, which they may either use exclusively to improve their betting strategy or offer to sell to another player. We find a sharp transition as the number of players N is tuned across a critical value, between a phase where the transaction is always profitable for the seller and one where it may not be. In both phases, different regimes are possible, depending on the "quality" of information being put up for sale: we observe symbiotic regimes, where both parties collude effectively to rig the game in their favor, competitive regimes, where the transaction is unappealing to the data holder as it overly favors a competitor for scarce resources, and even prey-predator regimes, where an exploitative data holder could be giving away bad-quality data to undercut a competitor. Our analytical framework can be generalized to more complex settings and constitutes a flexible tool to address the rich and timely problem of pricing information in games of chance.
Hebbian neural networks with multi-node interactions, often called Dense Associative Memories, have recently attracted considerable interest in the statistical mechanics community, as they have been shown to outperform their pairwise counterparts in a number of features, including resilience against adversarial attacks, pattern retrieval with extremely weak signals and supra-linear storage capacities. However, their analysis has so far been carried out within a replica-symmetric theory. In this manuscript, we relax the assumption of replica symmetry and analyse these systems at one step of replica-symmetry breaking, focusing on two different prescriptions for the interactions that we will refer to as supervised and unsupervised learning. We derive the phase diagram of the model using two different approaches, namely Parisi’s hierarchical ansatz for the relationship between different replicas within the replica approach, and the so-called telescope ansatz within Guerra’s interpolation method: our results show that replica-symmetry breaking does not alter the threshold for learning and slightly increases the maximal storage capacity. Further, we also derive analytically the instability line of the replica-symmetric theory, using a generalization of the De Almeida and Thouless approach.
Statistical mechanics of spin glasses is one of the main strands toward a comprehension of information processing by neural networks and learning machines. Tackling this approach, at the fairly standard replica symmetric level of description, recently Hebbian attractor networks with multi-node interactions (often called Dense Associative Memories) have been shown to outperform their classical pairwise counterparts in a number of tasks, from their robustness against adversarial attacks and their capability to work with prohibitively weak signals to their supra-linear storage capacities. Focusing on mathematical techniques more than computational aspects, in this paper we relax the replica symmetric assumption and we derive the one-step broken-replica-symmetry picture of supervised and unsupervised learning protocols for these Dense Associative Memories: a phase diagram in the space of the control parameters is achieved, independently, both via the Parisi's hierarchy within then replica trick as well as via the Guerra's telescope within the broken-replica interpolation. Further, an explicit analytical investigation is provided to deepen both the big-data and ground state limits of these networks as well as a proof that replica symmetry breaking does not alter the thresholds for learning and slightly increases the maximal storage capacity. Finally the De Almeida and Thouless line, depicting the onset of instability of a replica symmetric description, is also analytically derived highlighting how, crossed this boundary, the broken replica description should be preferred.
Efficiently identifying the most important communities and key transition nodes in weighted and unweighted networks is a prevalent problem in a wide range of disciplines. Here, we focus on the optimal clustering using variational kinetic parameters, linked to Markov processes defined on the underlying networks, namely, the slowest relaxation time and the Kemeny constant. We derive novel relations in terms of mean first passage times for optimizing clustering via the Kemeny constant and show that the optimal clustering boundaries have equal round-trip times to the clusters they separate. We also propose an efficient method that first projects the network nodes onto a 1D reaction coordinate and subsequently performs a variational boundary search using a parallel tempering algorithm, where the variational kinetic parameters act as an energy function to be extremized. We find that maximization of the Kemeny constant is effective in detecting communities, while the slowest relaxation time allows for detection of transition nodes. We demonstrate the validity of our method on several test systems, including synthetic networks generated from the stochastic block model and real world networks (Santa Fe Institute collaboration network, a network of co-purchased political books, and a street network of multiple cities in Luxembourg). Our approach is compared with existing clustering algorithms based on modularity and the robust Perron cluster analysis, and the identified transition nodes are compared with different notions of node centrality.
We present Graphie, a novel navigational interface to visualize Acts and Bills included in the UK's legislation digital repository [legislation.gov.uk]. Graphie provides a network representation of the hierarchical structure of an Act of Parliament, which is typically organized in a tree-like fashion according to the content and information contained in each sub-branch. Nodes in Graphie represent sections of an Act (or individual provisions), while links embody the hierarchical connections between them. The legal map provided by Graphie is easily navigable by hovering on nodes, which are also color-coded and numbered to provide easily accessible information about the underlying content. The full textual content of each node is also available on a dedicated hyperlinked canvas. The building block of Graphie is Sofia, an offline data pipeline designed to support different data visualizations by parsing and modelling data provided by [legislation.gov.uk] in open access form. While we focus on the Housing Act 2004 for illustrative purposes, our platform is scalable, versatile, and provides users with a unified toolbox to visualize and explore the UK legal corpus in a fast and user-friendly way.
The Bradley effect concerns the discrepancy between opinion polls and actual election outcomes that emerges when candidates do not exhibit mainstream ideological, sexual or racial features. This effect was first observed during the 1982 election for the Governor of California that resulted in a significant loss for the black Democratic candidate, Tom Bradley, despite him being ahead in polls. It has been argued that poll respondents tend to mask their true political preference and favour of what is generally considered more socially acceptable. We propose an exactly solvable statistical mechanical model, which allows for a quantitative exploration of this phenomenon. The model includes three main ingredients: (i) the tendency of individuals to align their real preference to the declared (public) opinions of others, (ii) a term accounting for an individual integrity factor, which induces voters to be consistent between their public and private opinions, and (iii) a self-monitoring component, which tunes the strength by which an individual is affected by and wishes to publicly conform to social norms. We observe the emergence of order in a wide range of parameters of the model and discuss the effect of noise on the correlation between hidden and public preference. Finally, we present an application of this model to the prediction of election outcomes.
In this work we propose a novel method to calculate mean first-passage times (MFPTs) for random walks on graphs, based on a dimensionality reduction technique for Markov State Models, known as local-equilibrium (LE). We show that for a broad class of graphs, which includes trees, LE coarse-graining preserves the MFPTs between certain nodes, upon making a suitable choice of the coarse-grained states (or clusters). We prove that this relation is exact for graphs that can be coarse-grained into a one-dimensional lattice where each cluster connects to the lattice only through a single node of the original graph. A side result of the proof generalises the well-known essential edge lemma (EEL), which is valid for reversible random walks, to irreversible walkers. Such a generalised EEL leads to explicit formulae for the MFPTs between certain nodes in this class of graphs. For graphs that do not fall in this class, the generalised EEL provides useful approximations if the graph allows a one-dimensional coarse-grained representation and the clusters are sparsely interconnected. We first demonstrate our method for the simple random walk on the $c$-ary tree, then we consider other graph structures and more general random walks, including irreversible random walks.
We analyse the equilibrium behaviour and non-equilibrium dynamics of sparse Boolean networks with self-interactions that evolve according to synchronous Glauber dynamics. Equilibrium analysis is achieved via a novel application of the cavity method to the temperature-dependent pseudo-Hamiltonian that characterises the equilibrium state of systems with parallel dynamics. Similarly, the non-equilibrium dynamics can be analysed by using the dynamical version of the cavity method. It is well known, however, that when self-interactions are present, direct application of the dynamical cavity method is cumbersome, due to the presence of strong memory effects, which prevent explicit analysis of the dynamics beyond a few time steps. To overcome this difficulty, we show that it is possible to map a system of $N$ variables to an equivalent bipartite system of $2N$ variables, for which the dynamical cavity method can be used under the usual one time approximation scheme. This substantial technical advancement allows for the study of transient and long-time behaviour of systems with self-interactions. Finally, we study the dynamics of systems with multi-node interactions, recently used to model gene regulatory networks, by mapping this to a bipartite system of Boolean variables with 2-body interactions. We show that when interactions have a degree of bidirectionality such systems are able to support a multiplicity of diverse attractors, an important requirement for a gene-regulatory network to sustain multi-cellular life.
We introduce a model for the retrieval of information hidden in legal texts. These are typically organised in a hierarchical (tree) structure, which a reader interested in a given provision needs to explore down to the ‘deepest’ level (articles, clauses, …). We assess the structural complexity of legal trees by computing the mean first-passage time a random reader takes to retrieve information planted in the leaves. The reader is assumed to skim through the content of a legal text based on their interests/keywords, and be drawn towards the sought information based on keywords affinity, i.e. how well the Chapters/Section headers of the hierarchy seem to match the informational content of the leaves. Using randomly generated keyword patterns, we investigate the effect of two main features of the text—the horizontal and vertical coherence—on the searching time, and consider ways to validate our results using real legal texts. We obtain numerical and analytical results, the latter based on a mean-field approximation on the level of patterns, which lead to an explicit expression for the complexity of legal trees as a function of the structural parameters of the model.
Dynamic processes of interacting units on a network are out of equilibrium in general. In the case of a directed tree, the dynamic cavity method provides an efficient tool that characterises the dynamic trajectory of the process for the linear threshold model. However, because of the computational complexity of the method, the analysis has been limited to systems where the largest number of neighbours is small. We devise an efficient implementation of the dynamic cavity method which substantially reduces the computational complexity of the method for systems with discrete couplings. Our approach opens up the possibility to investigate the dynamic properties of networks with fat-tailed degree distribution. We exploit this new implementation to study properties of the non-equilibrium steady-state. We extend the dynamic cavity approach to calculate the pairwise correlations induced by different motifs in the network. Our results suggest that just two basic motifs of the network are able to accurately describe the entire statistics of observed correlations. Finally, we investigate models defined on networks containing bi-directional interactions. We observe that the stationary state associated with networks with symmetric or anti-symmetric interactions is biased towards the active or inactive state respectively, even if independent interaction entries are drawn from a symmetric distribution. This phenomenon, which can be regarded as a form of spontaneous symmetry-breaking, is peculiar to systems formulated in terms of Boolean variables, as opposed to Ising spins.
We study the impact of vaccination on the risk of epidemics spreading through structured networks using the cavity method of statistical physics. We relax the assumption that vaccination prevents all transmission of a disease used in previous studies, such that vaccinated nodes have a small probability of transmission. To do so we extend the cavity method to study networks where nodes have heterogeneous transmissibility. We find that vaccination with partial transmission still provides herd immunity and show how the herd immunity threshold depends upon the assortativity between nodes of different transmissibility. In addition, we study the impact of social distancing via bond percolation and show that percolation targeting links between nodes of high transmissibility can reduce the risk of an epidemic greater than targeting links between nodes of high degree. Finally, we extend recent methods to compute the distributional equations of risk in populations with heterogeneous transmissibility and show how targeted social distancing measures may reduce overall risk greater than untargeted vaccination campaigns, by comparing the effect of random and targeted strategies of node and link deletion on the risk distribution.
We apply a mean-field model of interactions between migrating barchan dunes, the CAFE model, which includes spontaneous calving, aggregation, fragmentation, and mass-exchange, yielding a steady-state size distribution that can be resolved for different choices of interaction parameters. The CAFE model is applied to empirically measured distributions of dune sizes in two barchan swarms in the north circumpolar region of Mars, three swarms in Morocco, and one in Mauritania, each containing more than 1000 bedforms. When the sizes of bedforms are rescaled by the mean size in each zone two attractor states appear, with the Tarfaya zones all displaying a common distribution and the Martian and Mauritanian zones sharing a different distribution. Comparison of these attractor states with the outputs of the CAFE model reveals that the Tarfaya-type distribution results from a preference for aggregation and fragmentation interactions whereas the Mars-Mauritania distribution is more likely a result of exchange-dominated interactions. We observe that there appears to be a greater number of collisions happening in Tarfaya than in the other areas which is consistent with a greater rate of aggregation-fragmentation processes as suggested by our model. Our comparison with the CAFE model also predicts a universal rule for the outputs of the different types of interactions with exchange interactions favouring the production of two dunes roughly equal in size. Fragmentation interactions often result in three bedforms with volumes approximately in the ratio 1:1:2. Finally, we find that spontaneous calving of dunes does not play an important role in shaping the size distributions in barchan swarms.
An important question in representative democracies is how to determine the optimal parliament size of a given country. According to an old conjecture, known as the cubic root law, there is a fairly universal power-law relation, with an exponent equal to 1/3, between the size of an elected parliament and the country's population. Empirical data in modern European countries support such universality but are consistent with a larger exponent. In this work, we analyse this intriguing regularity using tools from complex networks theory. We model the population of a democratic country as a random network, drawn from a growth model, where each node is assigned a constituency membership sampled from an available set of size D. We calculate analytically the modularity of the population and find that its functional relation with the number of constituencies is strongly non-monotonic, exhibiting a maximum that depends on the population size. The criterion of maximal modularity allows us to predict that the number of representatives should scale as a power-law in the size of the population, a finding that is qualitatively confirmed by the empirical analysis of real-world data.
Describing the anti-tumour immune response as a series of cellular kinetic reactions from known immunological mechanisms, we create a mathematical model that shows the CD4 $$^{+}$$ /CD8 $$^{+}$$ T-cell ratio, T-cell infiltration and the expression of MHC-I to be interacting factors in tumour elimination. Methods from dynamical systems theory and non-equilibrium statistical mechanics are used to model the T-cell dependent anti-tumour immune response. Our model predicts a critical level of MHC-I expression which determines whether or not the tumour escapes the immune response. This critical level of MHC-I depends on the helper/cytotoxic T-cell ratio. However, our model also suggests that the immune system is robust against small changes in this ratio. We also find that T-cell infiltration and the specificity of the intra-tumour TCR repertoire will affect the critical MHC-I expression. Our work suggests that the functional form of the time evolution of MHC-I expression may explain the qualitative behaviour of tumour growth seen in patients.