Bulk universality of sparse random matrices
Jiaoyang Huang, Benjamin Landon, Horng-Tzer Yau
Introduction
The universality of the spectral statistics of random matrices has been a central subject since the pioneering works of Wigner , Gaudin , Mehta and Dyson . The first such universality result is the global semicircle law of Wigner which states that under some weak moment conditions, the empirical eigenvalue distribution of a matrix with i.i.d. entries converges weakly to the deterministic semicircle law
The Wigner-Dyson-Gaudin-Mehta conjecture, or ‘bulk universality’ conjecture, states that the local statistics of the eigenvalues of random matrix ensembles should be universal in the sense that they depend only on the symmetry class of the random matrix ensemble but are otherwise independent of the law of the matrix entries. Here, local statistics refers to the behaviour of the eigenvalues in the scaling in which their typical distance is order .
A prominent class of random matrices are Wigner matrices. These matrices have independent centered entries with a uniform subexponential decay condition and identical variances. The Wigner-Dyson-Gaudin-Mehta conjecture for Wigner matrices was recently established in a series of papers for all symmetry classes. Parallel results in various cases were obtained in .
The conclusion of the papers was that Wigner matrices, and even the wider class of generalized Wigner matrices in which the variances of the entries may differ, exhibit bulk universality in the following two forms. The first is that the -point correlation functions are universal after averaging over a small energy window. The second is that the distribution of the eigenvalue gaps with a fixed label are universal. For Wigner matrices, the universality of the averaged -point correlaton functions is equivalent to the universality of a local average of eigenvalue gaps. However, there is no rigorous mathematical relation between the universality of the eigenvalue gaps with a fixed label and the universality of the -point correlation functions at a fixed energy. Universality at a fixed energy has recently been established for all symmetry classes in , but we will not be concerned with this type of convergence in this work.
Wigner matrices were orginally introduced in by Wigner to model the spectra of heavy atoms, and are widely used to model systems in which all elements strongly interact with one another. However, for systems in which the links between different elements are broken, a better description is offered by the so-called sparse (or dilute) random matrices which have an average of nonzero elements per row, for .
Aside from theoretical physics models, sparse random matrices also arise in graph theory in the study of sparse random graphs. Perhaps the simplest example is the Erdős-Rényi ensemble which consists of a random graph on vertices in which each edge is chosen independently with probability . The adjacency matrix of this graph is called the Erdős-Rényi matrix. The Erdős-Rényi matrix has typically nonzero entries in each column and is sparse if . As the matrix entries take values or , the mean of the entries is not . Ignoring the nonzero mean for the moment, the Erdős-Rényi matrix can be viewed as a singular Wigner matrix, as the probability distribution of the matrix elements is highly concentrated around . The singular nature of this ensemble can be expressed by the fact that the -th moment of a matrix entry is bounded by
When , this decay in is much slower than in the case of Wigner matrices.
It was conjectured in that for sparse random matrices there exists a critical value , such that for , the bulk eigenvalues are strongly correlated and are characterized by GOE/GUE random matrix statistics; for , the eigenvalues remain uncorrelated and follow Poisson statistics. This conjecture is supported by a wealth of numerical simulations and a nonrigorous supersymmetric approach . The best rigorous result in this direction was obtained in the works and asserts that if
then the averaged -point correlation functions of the Erdős-Rényi ensemble coincide with the GOE.
In the present work we prove that in the regime
the local statistics of the Erdős-Rényi ensemble exhibit bulk universality. In addition to proving that the averaged -point correlation functions coincide with the GOE, we also prove the universality of the eigenvalue gaps with a fixed label. To further place the present work in context we recall the three-step strategy developed in for proving universality for Wigner matrices:
Establish a local semicircle law controlling the number of eigenvalues in windows of size .
Analyze the local ergodicity of Dyson Brownian motion (DBM) to obtain universality for Wigner ensembles with a small Gaussian component.
A density argument comparing a general Wigner matrix to one with a small Gaussian component.
For an overview of this three-step strategy and more details we refer the reader to . The local semicircle law for sparse random matrices in the regime (1.4) was established in . However, in Steps (2) and (3) were only completed for sparse random matrices in the regime (1.3).
The key input from Step (1) into Step (2) is a high-probability a-priori bound on the eigenvalue locations which is a corollary of the strong semicircle law. In the case of Wigner matrices, this bound is optimal and it allows one to conclude that local equilibrium is reached by DBM in times . Sparse random matrices do not obey as strong a semicircle law and so the time to equilibrium found in the work was much longer. Moreover, due to the slow decay of the third moment, the approximation in Step (3) is not as strong in the case of Wigner matrices and so could not be used for the large times required by Step (2). These two factors led to the condition (1.3) of .
In the recent work , the optimal time of Dyson Brownian motion to local equilibrium was established for a wide class of initial data (see for related results on DBM with general initial data). Using this as an input we will prove that DBM reaches local equilibrium in the optimal time when the initial data is a sparse random matrix. For the comparison of correlation functions, Step (3) was obtained in via a Green function comparison theorem. In this paper, we will use a lemma of which asserts continuity of DBM when viewed as a matrix Ornstein-Uhlenbeck process. It is interesting to note that this continuity lemma provides a very convenient tool for Step (3) in the sparse setting whenever a “weak local semicircle law” is valid – and in the case of sparse random matrices this is provided by a result of .
The universality of a single gap was established in for Wigner matrices, i.e., for . The work also yields gap universality for DBM after the optimal time and so our task is similar to the proof of the correlation function universality in that we must establish Step (3) and compare the gap distributions. However, the completion of Step (3) presents a major difficulty. Previously, for gap universality this step was based on results of or which states that the gap distribution of two Wigner ensembles coincide provided that the first four moments of these two ensembles match. However, these results were based on two inputs: firstly, certain level repulsion estimates; secondly, an optimal eigenvalue rigidity estimate.
Optimal eigenvalue rigidity estimates for Wigner ensembles were proven in . This estimate states that for any eigenvalue in the bulk we have that with overwhelming probability, where is the deterministic classical location of the -th eigenvalue. The best known rigidity result for sparse random matrices is from , where it was shown that the bulk eigenvalues satisfy with overwhelming probability.
Moreover, we do not expect that optimal rigidity holds for sparse random matrices. In fact in , it was shown that for sparse random matrices the linear statistics
converges to a normal random variable with variance , for satisfying some regularity conditions. This implies that the fluctuations of the eigenvalues are at least of order on average, and so we do not expect optimal rigidity to hold if .
As mentioned above, the lack of rigidity for sparse ensembles resulted in the longer time to equilibrium for DBM being found in , and it again causes difficulty in trying to compare gap statistics. Rigidity results are a crucial input in establishing level repulsion estimates for Wigner matrices which are needed in order to compare the gap statistics of two ensembles. It was proven in that a level repulsion estimate will hold for DBM after a short time. We show that one can combine the delocalization of eigenvectors together with the Ornstein-Uhlenbeck continuity lemma of to pass this level repulsion from DBM to the initial sparse random matrix. This level repulsion estimate then gives us a key input for Step (3) and we are able to conclude universality of the gap statistics.
Previous level repulsion estimates were obtained in for Wigner ensembles whose entries have a smooth distribution. Estimates without a smoothness condition were obtained in and also in the very recent work . A weak level repulsion estimate for Wigner matrices also follows from the results of .
In fact, our strategy outlined above applies to a wider class of random matrices than sparse or Wigner random matrices alone. We will prove that bulk universality holds for a class of random matrices obeying only a weak estimate on the distribution of its eigenvalues, a weak decay condition on the third moment of the entries and an eigenvector delocalization estimate.
The remainder of the paper is outlined as follows. In Section 2 we introduce the random matrix models under consideration, which we will call ‘stable’ random matrices, and state our main results. In Section 3 we obtain bulk universality for Gaussian divisible ensembles. In Section 4 we state and prove our level repulsion results for stable random matrices. In Section 5 we complete Step (3) outlined above and compare the bulk statistics of a general stable random matrix and a Gaussian divisible ensemble. In Section 6 we prove that sparse random matrices are stable and conclude universality for sparse random matrices.
Definition of model and main results
In our paper we will only state and prove our results for real symmetric random matrix ensembles. All of our methods extend with only notational changes to complex Hermitian ensembles.
In this section we introduce the class of sparse random matrices that we study. We follow the notations and definitions of . The motivating example is the Erdős-Rényi matrix whose entries are independent up to the constraint that the matrix is symmetric, and equal to with probability and with probability . It is notationally convenient to replace the parameter with defined through
We allow to depend on . We also rescale the matrix so that the bulk of its spectrum lies in an interval of order . For the Erdős-Rényi matrix we define to be the symmetric matrix whose entries are independent up and each element is distributed according to
We further extract the mean of each entry and write
where is the unit vector
Note that the matrix elements of are centered. It is easy to check that the matrix elements of satisfy the moment bounds
We are prompted to make the following definition. We introduce two parameters and which may be -dependent.
is a sparse random matrix with sparsity parameter and mean if it is of the form
where is a deterministic number satisfying
and is a matrix with real and independent entries up to the symmetry constraint which satisfy
for and where is a positive constant. We assume that satisfies
2 Universality of sparse random matrices
Our main result is the bulk universality of sparse random matrices as defined above.
Let be a sparse random matrix as defined in Definition 2.1, with sparsity parameter satisfying
for some number . Then exhibits bulk universality in the following two forms. Firstly, has the single gap universality in the bulk. For any and index
Secondly, the averaged -point correlation functions of are universal in the bulk. We denote the -point correlation function functions of and by and respectively, then for any and , and
3 Stable random matrices
and the mean may depend on .
We define the following matrix stochastic differential equation which is an Ornstein-Uhlenbeck version of the Dyson Brownian motion. The dynamics of the matrix entries are given by the stochastic differential equations
where is symmetric with a family of independent Brownian motions. We denote , and so is our original matrix. More explicitly, for the entries of , we have
where , denotes a standard gaussian orthogonal ensemble, which is independent of . The entries of the matrix is given by
We define the deformed matrix by
where unless in which case will be a number satisfying .
Let be an deterministic real symmetric matrix. We denote the eigenvalues of as and corresponding eigenvectors . For any (small) number , we call the matrix -general if:
The eigenvectors of are completely delocalized: .
The eigenvalues of do not accumulate: there is an universal constant , such that for any interval with length , we have .
The entries of are independent up to symmetry.
For any time , where can be arbitrarily small, the random matrix defined in (2.17) satisfies the weak local semicircle law, i.e. for any (large) number , and (small) number , the following holds with probability larger than ,
For any time , any (large) number , and (small) number , is -general with probability larger than , with the constants in Definition 2.3 uniformly in .
The second condition (2) implies that for any , the eigenvalues for with overwhelming probability.
In order to simplify our proof we have assumed that the matrix elements are independent. Independence is mainly used in the comparison Lemma 4.3, which will still hold if the matrix entries of are weakly correlated.
The motivating example of our paper is the sparse random matrix, and we have therefore assumed that the Stieltjes transform of the empirical eigenvalue distribution of is close to , i.e., the semicircle law. The semicircle law, however, does not play an active role and our methods can be applied to the case in which the semicircle law is replaced by other densities. We will not pursue this direction and refer the interested reader to and for examples in which the limiting eigenvalue density differs from the semicircle law.
In this paper we will prove that the local statistics of stable random matrices are universal.
Let be a stable random matrix as defined in Definition 2.4. The local statistics of in the bulk are universal. Firstly, has gap universality with a fixed label in the bulk. For any and index , we have
The averaged -point correlation functions of are universal in the bulk. We denote the -point correlation function functions of and by and respectively, then for any and , and
The goal of this section is to establish bulk universality for the matrix valued stochastic process defined as in (2.17) after a short time .
Let be a stable random matrix, and let be defined as in (2.17). For any small there is a constant , which depends on , such that the following holds for . and any index
Moreover, for any , and , we have
For the proof we shall first restate the main result of in a form convenient for our proof. For this we will introduce some notation. For a deterministic matrix we define
where is a GOE matrix and is the constant from (2.17). We denote by the Stieltjes transform of the free convolution of the empirical eigenvalue distribution of and the semicircle law of , and so is the Stieltjes transform of empirical eigenvalue distribution of . More explicitly, is defined as the unique solution to the functional equation
The free convolution is well-studied, see, e.g, . It is known that is the Stieltjes transform of a measure with a density which we denote by which is analytic on the interior of its support, for any . Denote the classical eigenvalue locations of the density and by and , respectively,
The following follows from Theorem 2.5 of .
Fix and suppose that there are constants and such that
for all large enough . Above is any index satisfying where .
and the set of real symmetric matrices
and is from the constant in (2.19) of Definition 2.4.
Let and as above. Then, for any and ,
Therefore we have . Since , for any , such that and , we have that . The defining relation (3.8) leads to
To control we have the following stability estimate of : for any with non-negative imaginary part, and , then
From this lemma we conclude the following.
For any , time , any real symmetric matrix , and we have
Moreover for any index such that , we have
where the constant is from the definition (3.8) of the set .
where we have used on . Moreover, we have
given . (3.15) and (3.16) together lead to (3.13).
This follows from [25, Lemma 7.17], using Lemma 3.3 as input. Therefore,
By the hypotheses of stability of we have that with probability greater than for any large . We denote the density of free convolution of and as , and its -th classical eigenvalue location as . From Theorem 3.2 we have
But then by Lemma 3.4 we have that , therefore
for some depending on first derivative and the support of the test function . We therefore obtain that for that
if we choose small enough, such that . And if we take expectation over , (3.1) follows.
for for any . For this argument, we refer the reader to, e.g., [14, Theorem 2.1]. We conclude (3.1) by integrating over . ∎
Level repulsion for stable random matrices
In this section we prove the following level repulsion estimate for stable random matrices. It will be used for the comparison of the single gap statistics between and in Section 5.
Let be a stable random matrix as defined in Section 2.3. Given any , any (small) number , and any index , we have
The above estimate suffices for the comparison of the single gap statistics of and . We have not tried to optimize the exponent , which is far from optimal. The proof below is easily modified to give for any .
It was proven in that a level repulsion estimate holds for the matrix for . To obtain the level repulsion estimate for , we need to prove that the change of eigenvalues up to time is negligible. For this we will repeatedly use the following lemma which asserts continuity of DBM when viewed as a matrix Ornstein-Uhlenbeck process. It is a minor modification of [6, Lemma A.2].
Define as in (2.15). Let be a smooth function on the space of real symmetric matrices satisfying
Above, the deformed matrix is defined by , where unless and is a number satisfying . Then
Given a real symmetric matrix , we denote its eigenvalues by , and corresponding eigenvectors . If is a simple eigenvalue of , we define to be the orthogonal projection to the one-dimensional eigenspace corresponding to , and the resolvent the unique real symmetric matrix inverting on the range of , and vanishing on the range of . can be written explicitly as
Moreover can be written as the following contour integral,
where we pick the contour to enclose only . From the above formula it is clear that is a smooth function on a neighbourhood of if is a single eigenvalue. We refer the reader to the book [29, Chapter XII] for related properties.
If is a single eigenvalue of , we define the quantity
This quantity plays an important role in , where it was observed that it captures quantitatively the derivatives of . Here we write it in terms of the Green function, and prove it is stable under the DBM (2.15). As a result, based on the idea of Green function comparison, it can be used to derive the weak level repulsion estimate Theorem 4.1, once we know such an estimate for larger times, see Theorem 4.4.
Since is not well-defined on the space of real symmetric matrices (it will blow up when is not a single eigenvalue), we have to compose it with a cutoff function , where and the (small) constant will be chosen later. We choose the cutoff function which satisfies the following two properties: (1) is smooth, and the first three derivatives are bounded by some constant , i.e. . (2) On the interval , , and for , .
If is a single eigenvalue of , then in a neighborhood of , is smooth; if is not a single eigenvalue of , then in a neighborhood of , is constant, which is also smooth. Therefore is a well defined smooth function on the space of real symmetric matrices.
Our proof of Theorem 4.1 consists of three steps:
In the remainder of this section we denote the eigenvalues of by , and so the eigenvalues of are .
The following level repulsion estimate is an immediate consequence of [25, Theorem 3.6].
Let be a stable random matrix as defined in Section 2.3. Given any (small) number , and (large) number , we have that
for any and .
From this we derive the following estimate.
for for any and all small .
By our assumption with probability larger than , the matrix is -general in the sense of Definition 2.3. Combining this with Theorem 4.4, we have
For those which are -general in the sense of Definition 2.3, , for . On the event that is -general and , we derive the estimate,
where can be any small number. Therefore
This finishes the proof of the first step. In order to apply Lemma 4.3 for the second step, we need to control the third derivative of .
Let be an deterministic real symmetric matrix. If is -general in the sense of Definition 2.3 and
We denote the resolvent of and by and the eigenvalues and eigenvectors of . Notice that (4.9) implies . The same dyadic argument leading to (4.8) yields
Also we have the trivial bound for higher moments
We denote by the matrix whose matrix elements are zero everywhere except at the and position, where it equals one. From the formula (4.3),
Notice that . By the Leibniz rule, (4.13) can be written as a sum of terms in the following form
where . We will only prove (4.10) for ; that is, we will prove
The computations for are much easier. To evaluate (4.14), we need to compute the first three derivatives of with respect to the -th entry of . We use the following formula to compute the derivatives of ,
where the contour encloses only . The -th derivative with respect to -th entry is
Some straightforward but tedious integration similar to (4.16), (4.17),(4.18) reveals that is a sum of the following terms (for simplicity of notation we write ):
Indeed, if one takes a close look at the expression (4.14), the only singularity enclosed by our contour is . Therefore by Cauchy’s formula, the integral is sum of terms with denominators: , as appearing in the above expressions.
Since the eigenvectors of are completely delocalized we see that
This, together with the bounds (4.11) and (4.12) yields (4.15) ∎
Notice that the right hand side of (4.20) vanishes unless . Since is stable, satisfies all the assumptions in Lemma 4.10, with probability larger than for any large number . Therefore
On the complement of the above event we will use the following deterministic bound
We want to apply Lemma 4.3 with . For this choice of we can take to satisfy
where the last factor is from the third moment of . We conclude that
Since the two numbers can be arbitrarily small, therefore we can choose and (4.21) simplifies to
and the proof is easily concluded by the Markov inequality. ∎
Bulk universality of stable random matrices
In this section we prove bulk universality for stable random matrices , i.e., Theorem 2.8 by comparing the local statistics between and . This will yield the theorem as Theorem 3.1 shows that the latter ensemble exhibits bulk universality. In the following of this section we denote the eigenvalues of by . And so the eigenvalues of are .
We will obtain the gap universality of from the more general comparison result below.
Let be a stable random matrix and let be defined as in (2.15). Take . Then for small enough we have
For simplicity of notation, we only state the proof for case, i.e. for any
Take a cutoff function such that for and for , where and is a small constant. By the level repulsion of and from the previous section, we know that
Notice that is a well defined smooth function on the space of symmetric functions. Moreover, if the matrix is -general in the sense of Definition 2.3 the same argument as in Proposition 4.6 implies
where and are constants. Therefore by Lemma 4.3, we have
if we take . ∎
For the universality of the correlation functions, due to the lack of optimal rigidity, one can not directly deduce universality from (5.1). We need to prove the following Green function comparison lemma:
Let be a stable random matrix as defined in Section 2.3, and let be defined as in (2.15). Let be arbitrary and choose an with . For any sequence of positive integers , any set of complex parameters , where , , , and the signs are arbitrary, we have the following. Let be the resolvent and let be a test function such that for any multi-index with and for any sufficiently small, we have
for some constant . Then the following holds:
where and are constants depending on , , and . The second term above is the same as the first term, but with replacing everywhere.
For simplicity of notation, we state the proof only for and case, i.e.
We will prove this lemma using Lemma 4.3. We must compute derivatives of the trace of the Green’s function of the deformed matrix . We denote the resolvent of by . For the derivatives of , we have , where is the matrix whose matrix elements are zero everywhere except at the and position, where it equals one. Since has at most two nonzero elements, the trace contains at most terms. Furthermore, each term is a product of entries of , e.g. . We first derive a bound on the resolvent entries down to when is -general. Using the delocalization of the eigenvectors we have,
For -general we have , for . We can divide the summation over into ,
When is not -general we still have the deterministic upper bound
Therefore we can take for in Lemma 4.3. For we have the upper bound
Once we have the above lemma, the following theorem from [15, Theorem 2.1] transforms the information of the Green function to the correlation functions of and will complete the proof of Theorem 2.8.
provided that is chosen so that .
The universality of the gap statistics follows from Theorem 3.1 and Lemma 5.1. The universality of the correlation functions follows from Theorem 3.1, Lemma 5.2 and Theorem 5.3. ∎
Universality of sparse random matrices
In this section we prove Theorem 2.2, the bulk universality of sparse matrices, by checking that sparse matrices satisfy the hypotheses of Definition 2.4 of stable random matrices. In the following we collect some facts about sparse matrices proved in .
Let be a sparse Wigner matrix as in Definition 2.1. We denote the eigenvalues of as , the corresponding eigenvectors , and the resolvent . Then for all (small) , (large) and large enough the following holds with probability larger than .
All eigenvalues of are in the interval $-3\leq\lambda_{1}\leq\lambda_{2}\cdots\leq\lambda_{N-1}\leq 3\lambda_{N}$.
We have the weak local semi-circle law for individual resolvent entries: there exists a constant such that , for
We have the local semi-circle law for the Stieltjes transform of eigenvalues of :
Sparse random matrices in the sense of Definition 2.1 are stable. Therefore, Theorem 2.2 holds.
Conditions (1) and (3) of Definition 2.4, i.e., the independent entries and moment conditions, follow from the definition of a sparse matrix. The fact that is -general, i.e., condition (4), will follow from the bounds (ii) in Theorem 6.1. If the resolvent elements of are bounded down to the scale then by taking and in the following identity
we see that and so the eigenvectors of are completely delocalized. For any interval , such that , we have
Therefore, we get that by rearranging the above expression.
It therefore suffices to prove that the resolvent entries of the deformed matrix are bounded down to the scale . For each , is a sparse matrix and so by Theorem 6.1 we know that its resolvent entries are bounded with probability greater than for any large .
The deformed matrix is a rank two perturbation of , i.e. , where is the matrix whose matrix elements are zero everywhere except at the and position, where it equals . By our assumption on the moments of sparse Wigner matrix (2.9), we have that
for any large . We denote the resolvent of as . The resolvent elements of are given by the formula
with probability greater than , for sufficiently large. We get , by taking maximum over and in above estimate, and rearranging it. This finishes the proof that with probability larger than for any (large) number , is general.
For the local semi-circle law of , i.e., condition (2), the variance of the diagonal terms and off-diagonal terms of are and respectively. Therefore after normalizing by , it is a generalized sparse matrix. By (3.12), the normalization factor gives us an error of order at most : with probability larger than ,
where is the Stieltjes transform of the empirical eigenvalue distribution of . Therefore we can take in (2.19).
We have checked that sparse random matrices are stable, and so Theorem 2.2 now follows from Theorem 2.8. ∎