Nonlinear Analogue of the May-Wigner Instability Transition
Yan V. Fyodorov, Boris A. Khoruzhenko
Model
Consider a system of coupled non-linear autonomous ODEs of the form
where and the components of the vector field are zero mean random functions of the state vector . To put this model in the context of the discussion above, if is an equilibrium of (2), i.e., if then, in the immediate neighbourhood of system (2) reduces to May’s model (1) with and .
The non-linear system (2) may have multiple equilibria whose number and locations depend on the realisation of the random field . To visualise the global picture, it is helpful to consider first a special case of a gradient-descent flow, characterised by the existence of a potential function such that . In this case, system (2) can be rewritten as , with being the associated Lyapunov function describing the effective landscape. In the domain of , the state vector moves in the direction of the steepest descent, i.e., perpendicular to the level surfaces towards ever smaller values of . This provides a useful geometric intuition. The term represents the globally confining parabolic potential, i.e., a deep well on the surface of , which does not allow to escape to infinity. At the same time the random potential may generate many local minima of (shallow wells) which will play the role of attractors for our dynamical system. Moreover, if the confining term is strong enough then the full landscape will only be a small perturbation of the parabolic well, typically with a single stable equilibrium located close to . In the opposite case of relatively weak confining term, the disorder-dominated landscape will be characterised by a complicated random topology with many points of equilibria, both stable and unstable. Note that in physics, complicated energy landscapes is a generic feature of glassy systems with intriguingly slow long-time relaxation and non-equilibrium dynamics, see e.g. .
The above picture of a gradient-descent flow is however only a very special case since the generic systems of ODEs (2) are not gradient. The latter point can easily be understood in the context of model ecosystems. For, by linearising a gradient flow in a vicinity of any equilibrium, one always obtains a symmetric community matrix, whilst the community matrices of model ecosystems are in general asymmetric. Note also a discussion of an interplay between non-gradient dynamics in random environment and glassy behaviour in .
To allow for a suitable level of generality we therefore suggest to choose the dimensional vector field as a sum of ‘gradient’ and non-gradient (‘solenoidal’) contributions:
where we require the matrix to be antisymmetric: . The meaning of this decomposition is that vector fields can be generically divided into a conservative irrotational component, sometimes called ‘longitudinal’, whose gradient connects the attractors or repellers and a solenoidal curl field, also called ‘transversal’. As discussed in, e.g., such a representation is closely related to the so-called Hodge decomposition of differential forms and generalises the well-known Helmholtz decomposition of the dimensional vector fields into curl-free and divergence-free parts to higher dimensions. Correspondingly, we will call the scalar potential and the matrix the vector potential. The normalising factor in front of the sum on the right-hand side in (3) ensures that the transversal and longitudinal parts of are of the same order of magnitude for large .
Finally, to make the model as simple as possible and amenable to a rigorous and detailed mathematical analysis we choose the scalar potential and the components , , of the vector potential to be statistically independent, zero mean Gaussian random fields, with smooth realisations and the additional assumptions of homogeneity (translational invariance) and isotropy reflected in the covariance structure:
Here the angular brackets stand for the ensemble average over all realisations of and , and is the Kronecker delta: if and zero otherwise.
For simplicity, we also assume that the functions and do not depend on . This implies
where the ‘radial spectral’ densities have finite total mass: . We normalize these densities by requiring that . The ratio
is a dimensionless measure of the relative strengths of the longitudinal and transversal components of : if then is divergence free and if it is curl free.
Results
Determining and classifying all points of equilibria of a dynamical system with many degrees of freedom is a well-known formidable analytical and computational problem. In this paper we shall focus our investigation on the simplest, yet informative characteristic of system (2) by counting its total number of equilibria, that is the total number of solutions of the simultaneous equations
Certainly, finding is a good starting point of any phase portrait analysis.
Had we restricted ourselves to the gradient-descent flows, would simply count the number of stationary points (minima, maxima, or saddle-points) on the surface of the Lyapunov function . The problem of counting and classifying stationary points of high-dimensional random energy landscapes of various types attracted considerable interest in recent years . In particular, works study such energy landscapes generated by a potential equivalent to the above Lyapunov function. One of the main conclusions of that study is that for large the topology of the Lyapunov function changes drastically with decrease of the strength of the confining term relative to that of the interaction term in . The change manifests itself in the emergence of multitude of equilibria, exponential in number. Such a transition is intimately connected to the spin-glass like restructuring of the Boltzmann-Gibbs measure induced by the Lyapunov function when the latter is treated as an effective energy landscape.
We shall prove below that for large the general autonomous system (2)–(3) exhibits a similar drastic change in the total number of equilibria when the control parameter
drops below the threshold value . As in the case of gradient systems, the proof involves the Kac-Rice formula as a starting point. However, performing the subsequent steps requires quite different mathematical techniques due to the asymmetry of the Jacobian matrix for non-gradient systems.
The Kac-Rice formula, see e.g. , counts solutions of simultaneous algebraic equations. Under our assumptions (homogeneity, isotropy and Gaussianity of and ), this formula yields the ensemble average of in terms of that of the modulus of the spectral determinant of the Jacobian matrix , (see Materials and Methods):
thus bringing the original non-linear problem into the realms of the random matrix theory.
The probability (ensemble) distribution of the matrix can easily be determined in closed form. Indeed, the matrix entries of are zero mean Gaussian variables and their covariance structure, at spatial point x, can be obtained from (4)–(5) by differentiation:
where . Thus, to leading order in the limit ,
where , are zero mean Gaussians with
and is a standard Gaussian, , which is statistically independent of . Note that for the divergence free fields (i.e., if ) the entries of are statistically independent in the limit , exactly as in May’s model. On the other side, if has a longitudinal component () then this implies positive correlation between the pairs of matrix entries of symmetric about the main diagonal: if . Such distributions of the community matrix has also been used in the neighbourhood stability analysis of model ecosystems . Finally, in the limiting case of curl free fields (), the matrix is real symmetric.
The representation (8) comes in handy as it allows one to express (7) as a random matrix integral:
where and the angle brackets stand for averaging over the real elliptic ensemble of random matrices defined in (9), see also (20). This one-parameter family of random matrices interpolates between the Gaussian Orthogonal Ensemble of real symmetric matrices (GOE, ) and real Ginibre ensemble of fully asymmetric matrices (rGinE, ), see for discussions. Both rGinE and its one-parameter extension (9) have enjoyed considerable interest in the literature in recent years .
The matrix is asymmetric (unless ) and can have real as well as complex eigenvalues. The latter come in complex-conjugate pairs. Their density, in the limit , is constant inside the ellipse with the main half-axis and vanishes sharply outside . The corresponding theorem is known as the Elliptic Law and its validity extends beyond the Gaussian matrix distributions . However, in the context of our investigation it is the density of real eigenvalues of that appears to be most relevant.
Denote by the density of real eigenvalues of matrices (9) averaged over all realisations of . It is convenient to normalize in such a way that gives the average number of real eigenvalues of in the interval . A crucial observation is that is directly related to the averaged value of the modulus of the determinant that appears in (10). Namely,
where and is the average density of real eigenvalues of matrices of size . For the limiting case this relation appeared originally in , and it can be extended to any without much difficulty (see SI for a derivation of (11) following the approach of ). In the limiting case of real symmetric matrices , all eigenvalues of are real and relation (11) is also valid .
Combining (10) and (11) and changing the variable of integration from to , one can express for system (2) with degrees of freedom in terms of the density of real eigenvalues in the elliptic ensemble of random matrices (9) of size :
where and . The importance of this relation is due to the fact that is known in closed form in terms of Hermite polynomials . This allows us to carry out an asymptotic evaluation of the integral in (12) and calculate in the limit . The key finding that emerges from this calculation is that changes drastically around . If then
On the other hand, if then, to leading order in the limit ,
where for all . Therefore, if then grows exponentially with . The factor in front of the exponential in (14) is given by as long as . The gradient limit can be approached by scaling with . Setting , one obtains . This regime describes a weakly non-gradient flow. The corresponding regime for ensembles of asymmetric matrices was discovered long ago .
Close to the phase transition point the complexity exponent vanishes quadratically, as , implying that the width of the transition region around is . According to the general lore of phase transitions, for large but finite there exists a ‘critical regime’ where the number of equilibria changes smoothly between the two ‘phases’ (13) and (14). A quick inspection of (12) shows that the corresponding crossover profile is determined by the profile of in the vicinity of the ‘spectral edge’ , see Materials and Methods. After rescaling , , the density converges to in the limit , where :
with . In terms of , the critical crossover profile is given by
where . The right-hand side of (16) interpolates smoothly between the two regimes (13) and (14), when parameter runs from to .
Although our investigation is concerned with the ensemble average of the number of equilibria , we expect that in the limit the deviations of from its average are relatively small. This is certainly the case above the critical threshold, for . For, under some additional technical assumptions on the decay of correlations for , the system (2) will almost certainly have at least one stationary point, see for the relevant results about the maxima of homogeneous Gaussian fields. Therefore, and the established convergence of to 1 in the limit actually implies that the probability for to take other values than one is close to zero for large . The problem of estimating the deviation of from its average value in the opposite regime is much harder and is an open and interesting questionIn this context we would like to mention the recent work of Subag who proved that the deviations of from in the spherical -spin model are negligible in the limit of large system size. Though that model is different from ours, it is not dissimilar to the gradient limit of of our model , for instance, the average number of equilibria grows exponentially with . Thus one might hope to adopt the technique of to our model. Another relevant reference is ..
Discussion
In this paper we introduced a model describing generic large complex systems and examined the dependence of the total number of equilibria in such systems on the system complexity as measured by the number of degrees of freedom and the interaction strength. The inspiration for our work came from May’s pioneering study of the neighbourhood stability of large model ecosystems. Our outlook is complementary to that of May’s in that it adopts a global point of view which is not limited to the neighbourhood of the presumed equilibrium.
In the context of model ecosystems our analysis is applicable to complex multi-species communities in which each kind of species on its own becomes extinct and thus interaction between species is key to persistence of the community. The key feature of our analysis is that in the presence of interactions, as the complexity increases, there is an abrupt change from a simple set of equilibria (typically, a single equilibrium for large number of species ) to a complex set of equilibria, with their total number growing exponentially with . In the latter regime, we expect the stable equilibria to be only a tiny proportion of all the multitude of equilibria, see discussion below, which is indicative of long relaxation times and transient non-equilibrium behaviour.
We expect this sharp transition in the phase portrait to be shared by other systems of randomly coupled autonomous ODE’s with large number of degrees of freedom. To that end, it is appropriate to mention that very recently a similar ‘explosion in complexity’ was reported in a model of neural network consisting of randomly interconnected neural units . The model considered in is essentially of the form (2) but with the particular choice of where is an odd sigmoid function representing the synaptic nonlinearity and are independent centred Gaussian variables representing the synaptic connectivity between neuron and . Although being Gaussian, the corresponding (non-gradient) vector field is not homogeneous and thus seems rather different from our choice and not easily amenable to a rigorous analysis. Nevertheless, a shrewd semi-heuristic analysis of revealed that close to the critical coupling threshold the two models actually display very similar behaviour, described essentially by the same exponential growth in the total number of equilibria with rate . This fact points towards considerable universality of the transition from (13) to (14) and suggests that the crossover function (16) may be universal as well.
Our model captures an abrupt change in the dynamics of large complex systems on the macroscopic scale. At the same time zooming in to classify each and every equilibrium point into locally stable or unstable seems a hard task. For, although linearising the field around a given equilibrium is fairly straightforward, with the outcome being the Jacobian matrix (8), conditioning by the positions of equilibria and taking into account all eventualities is a highly non-trivial task. Given the stochastic setup of our model the question about stability of individual equilibria may be even the wrong question to ask, whereas addressing the statistics of the number of stable equilibria seems very appropriate.
Arguments similar to those in the previous section yield the ensemble average of the total number of stable equilibria, , over all realisations of the vector field in terms the random matrix integral (cf.(10)):
where , if all eigenvalues of matrix have real parts less than the spectral parameter , and otherwise. In the limiting case of a purely gradient dynamics , the rescaled Jacobian matrix is real symmetric with all eigenvalues real. In this case the above integral can be related to the probability density of the maximal eigenvalue of the GOE matrix , with the latter being a well-studied object in the random matrix theory, see e.g. and references therein. This observation can then be used to evaluate for . One finds that if , whilst if then, to leading order in , , with . Thus, in the case of purely gradient dynamics, as the complexity increases, large nonlinear autonomous systems assembled at random undergo an abrupt change from a typical phase portrait with a single stable equilibrium to a phase portrait dominated by an exponential number of unstable equilibria with an admixture of a smaller, but still exponential in , number of stable equilibria.
It was suggested to us by J.-P. Bouchaud that in the general case of non-gradient dynamics , it would be natural to expect a further phase transition in the plane such that below a certain number stable equilibria are no longer exponentially abundant in the limit (i.e. ), with further implications for the global dynamics. Unfortunately, for a fixed only vanishing fraction of order of of eigenvalues of remain real, and the relation of the integral in Eq. (17) to statistics of the largest real eigenvalue in the elliptic ensemble seems to be lost. This fact prevented us so far from reliable counting of stable equilibria for the general case of non-gradient flows. In principle, for given values of parameters one may attempt to evaluate the ensemble average in the integral in Eq. (17) numerically, and then to evaluate numerically the integral itself. Although such a procedure seems tractable, its actual implementation with sufficient precision is not straightforward, especially in the limit due to the exponentially large values involved. Clarification of the status of the picture suggested by J.-P. Bouchaud and related studies remain an important outstanding issue and is left for a future work.
Furthermore, at every spatial point the vector is Gaussian with uncorrelated and identically distributed components,
Therefore , and evaluating the integral on the right-hand side in (19) one arrives at (7).
Real elliptic matrices and asymptotics of The joint probability density function of the matrix entries in the elliptic ensemble of real Gaussian random matrices of size is given by
where is the normalisation constant and . It is straightforward to verify that the covariance of matrix entries is given by the expression specified in (9). The mean density of real eigenvalues of in the elliptic ensemble (20) is known in closed form in terms of Hermite polynomials, see . Assuming for simplicity that is even, one has where
Here and are rescaled Hermite polynomials, . This, together with the integral (12) allow one to evaluate in the limit . We shall sketch the corresponding evaluation below.
The asymptotics of in the bulk and at the edge of the support of the distribution of real eigenvalues in the real elliptic ensemble were found in , and outside the support it can also be readily extracted using (21)-(22). In particular, in the bulk, i.e., for , the contribution of (21) to is dominant and, to leading order in ,
At the same time for both (21) and (22) yield exponentially small contributions to , with (22) being dominant. Our evaluation yields
The form of (12) suggest the application of the Laplace method. One easily finds that has a minimum at which belongs to the domain as long as .Thus, applying the Laplace method and taking into account the asymptotic formula
one arrives at the asymptotic expression (14) for in the parameter range . For the saddle-point occurs in the domain so that the analysis requires search for the minimum of . After straighforward algebra we find which is equal to zero at . One also verifies that this is a point of minimum for and a further simple calculation then yields . Calculating the saddle-point contribution then yields (13).
The above asymptotic analysis assumes that . Let us now discuss the modifications required to study the scaling regime of weakly non-gradient flow for . We only need to evaluate the leading contribution to given by (21). By making use of the above integral representation for the scaled Hermite polynomials and applying the scaling , we can write
where . Recalling that the limit of as is 1 if and 0 if , one obtains
Substituting this expression into the integrand of (12) and evaluating the integral in the limit (hence, ) by the Laplace method then yields in the weakly non-gradient regime.
Finally, our calculation of the profile of in the transitional region uses the fact that in such a regime the main contribution to the integral (12) comes from the neighbourhood of the spectral edge, , where we have, to the leading order in ,
This together with (26) and (15) converts (12) to (16).
References
Housholder reflections and partial triangularization of real matrices
The key idea of is based on employing Householder reflections described by matrices
and consider the Hausholder reflection built from the above according to (27). Then it is easy to check that . This implies that for any nonzero vector there exists a Housholder reflection such that , with .
Let be a real eigenvalue of the matrix with real entries , i.e. for some column vector of unit length. Our goal is to demonstrate that it is always possible to represent that matrix as
Considering now the volume element our next goal to write it down in terms of independent variables parametrizing the right-hand side of (29), that is variables parametrizing , components of , parameter for , and the remaining parameters for representing the matrix . A convenient parametrization for comes from employing (28) for the vector , which shows that the last components of that vector can be used as independent variables, whereas normalization fixes the first component. Writing with and employing (27) yields an explicit parametrization :
The problem therefore amounts to calculating the Jacobian of the transformation . To that end we start with differentiating (29) which gives
where we employed that and used the notation for the matrix commutator. A direct calculation using (30) shows that the matrix can be symbolically written as
where the expression for is immaterial for our goals, and
Substituting (31) into the expression for we find that
From this expression we easily read off the required Jacobian to be given by
where the last factor symbolically denotes the part of the Jacobian coming from the transformation described in (Housholder reflections and partial triangularization of real matrices). A straightforward calculation shows that
so that finally we arrive at the change-of-measure formula
Elliptic Ensemble of Gaussian Random Matrices.
The Joint Probability Density (JPD) of the Elliptic Ensemble of Gaussian random matrices of size whose entries have covariance is given by
where is the corresponding normalization factor
Our goal is to find the JPD of variables used to perform the partial triangulation of via (29), with the role of played now by . We have
Taking into account the change-of-measure formula (Housholder reflections and partial triangularization of real matrices) we see that the corresponding JPD can be written as
By definition, the density of real eigenvalues is obtained by integrating the above JPD over variables and finally over . After performing the integrals over and we immediately arrive at the relation
where is a certain constant which can be found explicitly. This is precisely equivalent to Equation (13) in the main text with the obvious change of notations: and .