Random matrices: Universality of local eigenvalue statistics

Terence Tao, Van Vu

Introduction

The goal of this paper is to establish a universality property for the local eigenvalue statistics for random matrices. To simplify the presentation, we are going to focus on Wigner Hermitian matrices, which are perhaps the most prominent model in the field. We emphasize however that our main theorem (Theorem 15) is stated in a much more general setting, and can be applied to various other models of random matrices (such as random real symmetric matrices, for example).

Let nn be a large number. A Wigner Hermitian matrix (of size nn) is defined as a random Hermitian n×nn\times n matrix MnM_{n} with upper triangular complex entries ζij:=ξij+−1τij\zeta_{ij}:=\xi_{ij}+\sqrt{-1}\tau_{ij} (1≤i<j≤n1\leq i<j\leq n) and diagonal real entries ξii\xi_{ii} (1≤i≤n1\leq i\leq n) where

For 1≤i<j≤n1\leq i<j\leq n, ξij,τij\xi_{ij},\tau_{ij} are iid copies of a real random variable ξ\xi with mean zero and variance 1/21/2.

Given an n×nn\times n Hermitian matrix AA, we denote its nn eigenvalues as

The study of the eigenvalues λi(Wn)\lambda_{i}(W_{n}) of (normalized) Wigner Hermitian matrices has been one of the major topics of study in random matrix theory. The properties of these eigenvalues are not only interesting in their own right, but also have been playing essential roles in many other areas of mathematics, such as mathematical physics, probability, combinatorics, and the theory of computing.

It will be convenient to introduce the following notation for frequent events depending on nn, in increasing order of likelihood:

EE holds asymptotically almost surely ifSee Section 1.7 for our conventions on asymptotic notation. P(E)=1−o(1){\mathbf{P}}(E)=1-o(1).

EE holds with high probability if P(E)≥1−O(n−c){\mathbf{P}}(E)\geq 1-O(n^{-c}) for some constant c>0c>0.

EE holds with overwhelming probability if P(E)≥1−OC(n−C){\mathbf{P}}(E)\geq 1-O_{C}(n^{-C}) for every constant C>0C>0 (or equivalently, that P(E)≥1−exp⁡(−ω(log⁡n)){\mathbf{P}}(E)\geq 1-\exp(-\omega(\log n))).

EE holds almost surely if P(E)=1{\mathbf{P}}(E)=1.

Note from the union bound that the intersection of O(nO(1))O(n^{O(1)}) many events with uniformly overwhelming probability, still has overwhelming probability. Unfortunately, the same is not true for events which are merely of high probability, which will cause some technical difficulties in our arguments.

A cornerstone of this theory is the Wigner semicircular law. Denote by ρsc\rho_{sc} the semi-circle density function with support on $$,

Let MnM_{n} be a Wigner Hermitian matrix. Then for any real number xx,

in the sense of probability (and also in the almost sure sense, if the MnM_{n} are all minors of the same infinite Wigner Hermitian matrix), where we use ∣I∣|I| to denote the cardinality of a finite set II.

Wigner proved this theorem for special ensembles. The general version above is due to Pastur (see for a detailed discussion). The semi-circular law in fact holds under substantially more general hypotheses than those given in Definition 1, but we will not discuss this matter further here. One consequence of Theorem 5 is that we expect most of the eigenvalues of WnW_{n} to lie in the interval (−2+ε,2+ε)(-2+{\varepsilon},2+{\varepsilon}) for ε>0{\varepsilon}>0 small; we shall thus informally refer to this region as the bulk of the spectrum.

Several stronger versions of Theorem 5 are known. For instance, it is known (see e.g. , ) that asymptotically almost surely, one has

for all 1≤j≤n1\leq j\leq n and some absolute constant δ>0\delta>0, where −2≤t(a)≤2-2\leq t(a)\leq 2 is defined by the formula

asymptotically almost surely (see for further discussion).

Theorem 5 addressed the global behavior of the eigenvalues. The local properties are much harder and their studies require much more sophisticated tools. Most of the precise theorems have been obtained for the GUE, defined in Example 2. In the next few paragraphs, we mention some of the most famous results concerning this model.

2. Distribution of the spacings (gaps) of the eigenvalues of GUE

In this section MnM_{n} is understood to have the GUE distribution.

For a vector x=(x1,…,xn)x=(x_{1},\dots,x_{n}) where x1<x2⋯<xnx_{1}<x_{2}\dots<x_{n}, define the normalized gap distribution Sn(s;x)S_{n}(s;x) by the formula

where An:=nMnA_{n}:=\sqrt{n}M_{n} is the fine-scale normalization of MnM_{n}, and p(σ)p(\sigma) is the Gaudin distribution, given by the formula

where KK is the integral operator on L2((0,s))L^{2}((0,s)) with the Dyson sine kernel

In fact a stronger result is known in the bulk of the spectrum. Let lnl_{n} be any sequence of numbers tending to infinity such that ln/nl_{n}/n tends to zero. Define

It is proved in that for any fixed −2<u<2-2<u<2, we have

The eigenvalue gap distribution has received much attention in the mathematics community, partially thanks to the fascinating (numerical) coincidence with the gap distribution of the zeros of the zeta functions. For more discussions, we refer to and the references therein.

3. k𝑘k-point correlation for GUE

In the GUE case, one has an explicit formula for ρn(n)\rho_{n}^{(n)}, obtained by Ginibre :

where Zn(2)>0Z_{n}^{(2)}>0 is a normalizing constant, known as the partition function. From this formula, one can compute ρn(k)\rho_{n}^{(k)} explicitly. Indeed, it was established by Gaudin and Mehta that

where the kernel Kn(x,y)K_{n}(x,y) is given by the formula

and h0,…,hn−1h_{0},\ldots,h_{n-1} are the first nn Hermite polynomials, normalized to be orthonormal with respect to e−x2 dxe^{-x^{2}}\ dx. From this and the asymptotics of Hermite polynomials, it was shown by Dyson that

for any fixed −2<u<2-2<u<2 and real numbers t1,…,tkt_{1},\dots,t_{k}, where the Dyson sine kernel KK was defined in (6).

4. The universality conjecture and previous results

It has been conjectured, since the 1960s, by Wigner, Dyson, Mehta, and many others, that the local statistics (such as the above limiting distributions) are universal, in the sense that they hold not only for the GUE, but for any other Wigner random matrix also. This conjecture was motivated by similar phenomena in physics, such as the same laws of thermodynamics, which should emerge no matter what the details of atomic interaction.

The universality conjecture is one of the central questions in the theory of random matrices. In many cases, it is stated for a specific local statistics (such as the gap distribution or the kk-point correlation, see [33, page 9] for example). These problems have been discussed in numerous books and surveys (see ).

Despite the conjecture’s long and distinguished history and the overwhelming supporting numerical evidence, rigorous results on this problem for general Wigner random matrices have only begun to emerge recently. At the edge of the spectrum, Soshnikov proved the universality of the joint distribution of the largest kk eigenvalues (for any fixed kk), under the extra assumption that the atom distribution is symmetric:

Let kk be a fixed integer and MnM_{n} be a Wigner Hermitian matrix, whose atom distribution is symmetric. Set Wn:=1nMnW_{n}:=\frac{1}{\sqrt{n}}M_{n}. Then the joint distribution of the kk dimensional random vector

has a weak limit as n→∞n\rightarrow\infty, which coincides with that in the GUE case. The result also holds for the smallest eigenvalues λ1,…,λk\lambda_{1},\dots,\lambda_{k}.

Note that this significantly strengthens (4) in the symmetric case. (For the non-symmetric case, see , for some recent results).

Returning to the bulk of the spectrum, Johansson proved (11) and (8) for random Hermitian matrices whose entries are gauss divisible. (See also the paper of Ben Arous and Péché where they discussed the removal of a technical condition in .) More precisely, Johansson considered the model Mn=(1−t)1/2Mn1+t1/2Mn2M_{n}=(1-t)^{1/2}M^{1}_{n}+t^{1/2}M^{2}_{n}, where 0<t≤10<t\leq 1 is fixed (i.e. independent of nn), Mn1M^{1}_{n} is a Wigner Hermitian matrix and Mn2M^{2}_{n} is a GUE matrix independent of Mn1M^{1}_{n}. We will refer to such matrices as Johansson matrices.

(11) (in the weak sense) and (8) (and hence (5)) hold for Johansson matrices, as n→∞n\rightarrow\infty. By “weak sense”, we mean that

The property of being gauss divisible can be viewed as a strong regularity assumption on the atom distribution. Very recently, Erdős, Peche, Ramirez, Schlein and Yau , have relaxed this regularity assumption significantly. In particular in an analogue of Theorem 8 (with k=2k=2 for the correlation and lnl_{n} polynomial in nn for the gap distribution) is proven assuming that the atom distribution is of the form

where V(x)∈C6V(x)\in C^{6} and ∑i=16∣Vj(x)∣≤C(1+x2)k\sum_{i=1}^{6}|V^{j}(x)|\leq C(1+x^{2})^{k} and ν(x)≤C′exp⁡(−δx2)\nu(x)\leq C^{\prime}\exp(-\delta x^{2}), for some fixed k,δ,C,C′k,\delta,C,C^{\prime}. It was remarked in that the last (exponential decay) assumption can be weakened somewhat.

We note that both Erdős et al and our approach make important, but different use of the ideas and results by Erdos,Schlein and Yau () concerning the rate of convergence to the semi-circle law. (See page 24 and Section 5 for a detailed description.)

Finally, let us mention that in a different direction, universality was established by Deift, Kriecherbauer, McLaughlin, Venakides and Zhou, , Pastur and Shcherbina , Bleher and Its for a different model of random matrices, where the joint distribution of the eigenvalues is given explicitly by the formula

where VV is a general function and cn>0c_{n}>0 is a normalization factor. The case V=x2V=x^{2} corresponds to (9). For a general VV, the entries of the matrix are correlated, and so this model differs from the Wigner model. (See for some recent developments concerning these models, which are studied using the machinery of orthogonal polynomials.)

One of the main difficulties in establishing universality for general matrix ensembles lies in the fact that most of the results obtained in the GUE case (and the case in Johansson’s theorem and those in ) came from heavy use of the explicit joint distribution of the eigenvalues such as (9) and (13). The desired limiting distributions were proved using estimates on integrals with respect to these measures. Very powerful tools have been developed to handle this task (see for example), but they cannot be applied for general Wigner matrices where an explicit measure is not available.

Nevertheless, some methods have been developed which do not require the explicit joint distribution. For instance, Soshnikov’s result was obtained using the (combinatorial) trace method rather than from an explicit formula from the distribution, although it is well understood that this method, while efficient for the studying of the edge, is of much less use in the study of the spacing distribution in the bulk of the spectrum. The recent argument in also avoid explicit formulae, relying instead on an analysis of the Dyson Brownian motion, which describes the stochastic dynamics of the spectrum of Johansson matrices Mn=(1−t)1/2Mn1+t1/2Mn2M_{n}=(1-t)^{1/2}M^{1}_{n}+t^{1/2}M^{2}_{n} in the tt variable. (On the other hand, the argument in uses explicit formulae for the joint distribution.) However, it appears that their method still requires a high degree of regularity on the atom distribution, whereas here we shall be interested in methods that do not require any regularity hypotheses at all (and in particular will be applicable to discrete atom distributionsSubsequently to the release of this paper, we have realized that the two methods can in fact be combined to address the gap distribution problem and the kk-point correlation problem even for discrete distributions without requiring moment conditions; see for details..

5. Universality theorems

In this paper, we introduce a new method to study the local statistics. This method is based on the Lindeberg strategy of replacing non-gaussian random variables with gaussian ones. (For more modern discussions about Lindeberg’s method, see .) Using this method, we are able to prove universality for general Wigner matrices under very mild assumptions. For instance, we have

The limiting gap distribution (5) holds for Wigner Hermitian matrices whose atom distribution ξ\xi has support on at least 3 points. The stronger version (8) holds for Wigner Hermitian matrices whose atom distribution ξ\xi has support on at least 3 points and the third moment Eξ3{\mathbf{E}}\xi^{3} vanishes.

Our method also enables us to prove the universality of the variance and higher moments. Thus, the whole distribution of Sn(s,λ)S_{n}(s,\lambda) is universal, not only its expectation. See Remark 31.

The kk-point correlation (11) (in the weak sense) holds for Wigner Hermitian matrices whose atom distribution ξ\xi has support on at least 3 points and the third moment Eξ3{\mathbf{E}}\xi^{3} vanishes.

These theorems (and several others, see Section 1.6) are consequences of our more general main theorem below (Theorem 15). Roughly speaking, Theorem 15 states that the local statistics of the eigenvalues of a random matrix is determined by the first four moments of the atom distributions.

Theorem 15 applies in a very general setting. We will consider random Hermitian matrix MnM_{n} with entries ξij\xi_{ij} obeying the following condition.

A random Hermitian matrix An=(ζij)1≤i,j≤nA_{n}=(\zeta_{ij})_{1\leq i,j\leq n} is said to obey condition C0 if

The ζij\zeta_{ij} are independent (but not necessarily identically distributed) for 1≤i≤j≤n1\leq i\leq j\leq n, and have mean zero and variance 11.

(Uniform exponential decay) There exist constants C,C′>0C,C^{\prime}>0 such that

for all t≥C′t\geq C^{\prime} and 1≤i,j≤n1\leq i,j\leq n.

Clearly, all Wigner Hermitian matrices obey condition C0. However, the class of matrices obeying condition C0 is much richer. For instance the gaussian orthogonal ensemble (GOE), in which ζij≡N(0,1)\zeta_{ij}\equiv N(0,1) independently for all i<ji<j and ζii≡N(0,2)\zeta_{ii}\equiv N(0,2), is also essentially of this formNote that for GOE an diagonal entry has variance 22 rather than 11. We thank Sean O’Rourke for pointing out this issue. On the other hand, Theorem 15 still holds if we change the variances of the diagonal entries, see Remark 16, and so are all Wigner real symmetric matrices (the definition of which is given at the end of this section).

We say that two complex random variables ζ\zeta and ζ′\zeta^{\prime} match to order kk if

for all m,l≥0m,l\geq 0 such that m+l≤km+l\leq k.

Given two random matrices An=(ζij)1≤i,j≤nA_{n}=(\zeta_{ij})_{1\leq i,j\leq n} and An′=(ζij′)1≤i,j≤nA^{\prime}_{n}=(\zeta^{\prime}_{ij})_{1\leq i,j\leq n} obeying condition C0, ζij\zeta_{ij} and ζij′\zeta^{\prime}_{ij} automatically match to order 11. If they are both Wigner Hermitian matrices, then they automatically match to order 22. If furthermore they are also symmetric (i.e. AnA_{n} has the same distribution as −An-A_{n}, and similarly for An′A^{\prime}_{n} and −An′-A^{\prime}_{n}) then ζij\zeta_{ij} and ζij′\zeta^{\prime}_{ij} automatically match to order 33.

If ζij\zeta_{ij} and ζij′\zeta^{\prime}_{ij} only match to order 33 rather than 44, then there is a positive constant CC independent of c0c_{0} such that the conclusion (16) still holds provided that one strengthens (15) to

The proof of this theorem begins at Section 3.3. As mentioned earlier, Theorem 15 asserts (roughly speaking) that the fine spacing statistics of a random Hermitian matrix in the bulk of the spectrum are only sensitive to the first four moments of the entries. It may be possible to reduce the number of matching moments in this theorem, but this seems to require a refinement to the method; see Section 3.2 for further discussion.

Theorem 15 still holds if we assume that the diagonal entries ζii\zeta_{ii} and ζii′\zeta_{ii}^{\prime} have the same mean and variance, for all 1≤i≤n1\leq i\leq n, but these means and variances can be different at different ii. The proof is essentially the same. In our analysis, we consider the random vector formed by non-diagonal entries of a row, and it is important that these entries have mean zero and the same variance, but the mean and variance of the diagonal entry never plays a role. Details will appear elsewhere.

In a subsequent paper , we show that the condition εn≤i1<i2⋯<ik≤(1−ε)n{\varepsilon}n\leq i_{1}<i_{2}\dots<i_{k}\leq(1-{\varepsilon})n can be omitted. In other words, Theorem 15 also holds for eigenvalues at the edge of the spectrum.

Applying Theorem 15 for the special case when Mn′M^{\prime}_{n} is GUE, we obtain

Let MnM_{n} be a Wigner Hermitian matrix whose atom distribution ξ\xi satisfies Eξ3=0{\mathbf{E}}\xi^{3}=0 and Eξ4=34E\xi^{4}=\frac{3}{4} and Mn′M_{n}^{\prime} be a random matrix sampled from GUE. Then with GG, AnA_{n}, An′A^{\prime}_{n} as in the previous theorem, and nn sufficiently large, one has

In the proof of Theorem 15, the following lower tail estimate on the consecutive spacings plays an important role. This theorem is of independent interest, and will also help in applications of Theorem 15.

Let 0<ε<10<{\varepsilon}<1 be a constant, and let MnM_{n} be a random matrix obeying Condition C0. Set An:=nMnA_{n}:=\sqrt{n}M_{n}. Then for every c0>0c_{0}>0, and for nn sufficiently large depending on ε{\varepsilon}, c0c_{0} and the constants C,C′C,C^{\prime} in Definition 12, and for each εn≤i≤(1−ε)n{\varepsilon}n\leq i\leq(1-{\varepsilon})n, one has λi+1(An)−λi(An)≥n−c0\lambda_{i+1}(A_{n})-\lambda_{i}(A_{n})\geq n^{-c_{0}} with high probability. In fact, one has

for some c1>0c_{1}>0 depending on c0c_{0} (and independent of ε{\varepsilon}).

The proof of this theorem begins at Section 3.5.

6. Applications

By using Theorem 15 and Theorem 19 in combination with existing results in the literature for GUE (or other special random matrix ensembles) one can establish universal asymptotic statistics for a wide range of random matrices. For instance, consider the ithi^{th} eigenvalue λi(Mn)\lambda_{i}(M_{n}) of a Wigner Hermitian matrices. In the GUE case, Gustavsson, based on , proved that λi\lambda_{i} has gaussian fluctuation:

Let i=i(n)i=i(n) be such that i/n→ci/n\to c as n→∞n\to\infty for some 0<c<10<c<1. Let MnM_{n} be drawn from the GUE. Set An:=nMnA_{n}:=\sqrt{n}M_{n}. Then

in the sense of distributions, where t()t() is defined in (3). (More informally, we have λi(Mn)≈t(i/n)n+N(0,2log⁡n(4−t(i/n)2)n)\lambda_{i}(M_{n})\approx t(i/n)\sqrt{n}+N(0,\frac{2\log n}{(4-t(i/n)^{2})n}).)

As an application of our main results, we have

The conclusion of Theorem 20 also holds for any other Wigner Hermitian matrix MnM_{n} whose atom distribution ξ\xi satisfies Eξ3=0{\mathbf{E}}\xi^{3}=0 and Eξ4=34{\mathbf{E}}\xi^{4}=\frac{3}{4}.

Let MnM_{n} be a Wigner Hermitian matrix, and let Mn′M^{\prime}_{n} be drawn from GUE. Let i,c,ti,c,t be as in Theorem 20, and let c0c_{0} be as in Theorem 19. In view of Theorem 20, it suffices to show that

for all intervals I=[a,b]I=[a,b], and nn sufficiently large depending on ii and the constants C,C′C,C^{\prime} in Definition 1, where I+:=[a−n−c0/10,b+n−c0/10]I_{+}:=[a-n^{-c_{0}/10},b+n^{-c_{0}/10}] and I−:=[a+n−c0/10,b−n−c0/10]I_{-}:=[a+n^{-c_{0}/10},b-n^{-c_{0}/10}].

On the other hand, one can choose GG to obey (15). Thus by Corollary 18 we have

and the second inequality in (18) follows from the triangle inequality. The first inequality is similarly proven using a smooth function that equals 11 on I−I_{-} and vanishes outside of II. ∎

The same argument lets one establish the universality of the asymptotic joint distribution law for any kk eigenvalues λi1(Mn),…,λik(Mn)\lambda_{i_{1}}(M_{n}),\ldots,\lambda_{i_{k}}(M_{n}) in the bulk of the spectrum of a Wigner Hermitian matrix for any fixed kk (the GUE case is treated in ). In particular, we have the generalization

for all i1,…,iki_{1},\ldots,i_{k} between εn{\varepsilon}n and (1−ε)n(1-{\varepsilon})n for some fixed ε>0{\varepsilon}>0, and all intervals I1,…,IkI_{1},\ldots,I_{k}, assuming nn is sufficiently large depending on ε{\varepsilon} and kk, and Ij,−⊂Ij⊂Ij,+I_{j,-}\subset I_{j}\subset I_{j,+} are defined as in the proof of Corollary 21. The details are left as an exercise to the interested reader.

Another quantity of interest is the least singular value

of a Wigner Hermitian matrix. In the GUE case, we have the following asymptotic distribution:

[1, Theorem 3.1.2], For any fixed t>0t>0, and MnM_{n} drawn from GUE, one has

with the asymptotics f(t)=−tπ−t2π2−t3π3+O(t4)f(t)=\frac{-t}{\pi}-\frac{t^{2}}{\pi^{2}}-\frac{t^{3}}{\pi^{3}}+O(t^{4}) as t→0t\to 0.

Using our theorems, we can extend this result to more general ensembles:

The conclusions of Theorem 23 also hold for any other Wigner Hermitian matrix MnM_{n} whose atom distribution ξ\xi has Eξ3=0{\mathbf{E}}\xi^{3}=0 and Eξ4=34{\mathbf{E}}\xi^{4}=\frac{3}{4}.

Let MnM_{n} be a Wigner Hermitian matrix, and let Mn′M^{\prime}_{n} be drawn from GUE. Let NIN_{I} be the number of eigenvalues of Wn′W^{\prime}_{n} in an interval II. It is well known (see [1, Chapter 4]) that

asymptotically almost surely (cf. (2) and Theorem 20). Applying this fact to the two intervals I=[−∞,±t2n]I=[-\infty,\pm\frac{t}{2\sqrt{n}}], we conclude that

for either choice of sign ±\pm. Using (18) (or (19)) (and modifying tt slightly), we conclude that the same statement is true for MnM_{n}. In particular, we have

and similarly for Mn′M^{\prime}_{n}. Using (19), we see that

for some c>0c>0. Putting this together, we conclude that

A similar universality result for the least singular value of non-Hermitian matrices was recently established by the authors in . Our arguments in also used the Lindeberg strategy, but were rather different in many other respects (in particular, they proceeded by analyzing random submatrices of the inverse matrix Mn−1M_{n}^{-1}). One consequence of Corollary 24 is that MnM_{n} is asymptotically almost surely invertible. For discrete random matrices, this is already a non-trivial fact, first proven in . If Theorem 23 can be extended to the Johansson matrices considered in , then the arguments below would allow one to remove the fourth moment hypothesis in Corollary 24 (assuming that ξ\xi is supported on at least three points).

The above corollary still holds under a weaker assumption that the first three moments of ξ\xi match those of the gaussian variable; in other words, we can omit the last assumption that Eξ4=3/4{\mathbf{E}}\xi^{4}=3/4. Details will appear else where.

By combining this result with (4) one also obtains a universal distribution for the condition number σ1(Mn)/σn(Mn)\sigma_{1}(M_{n})/\sigma_{n}(M_{n}) of Wigner Hermitian matrices (note that the non-independent nature of σ1(Mn)\sigma_{1}(M_{n}) and σn(Mn)\sigma_{n}(M_{n}) is not relevant, because (4) gives enough concentration of σ1(Mn)\sigma_{1}(M_{n}) that it can effectively be replaced with 2n2\sqrt{n}). We omit the details.

Now we are going to prove the first part of Theorem 9. Note that in contrast to previous applications, we are making no assumptions on the third and fourth moments of the atom distribution ξ\xi. The extra observation here is that we do not always need to compare MnM_{n} with GUE. It is sufficient to compare it with any model where the desired statistics have been computed. In this case, we are going to compare MnM_{n} with a Johansson matrix. The definition of Johansson matrices provides more degrees of freedom via the parameters tt and Mn1M_{n}^{1}, and we can use this to remove the condition of the third and fourth moments.

Let ξ\xi be a real random variable with mean zero, variance 11, third moment Eξ3=α3{\mathbf{E}}\xi^{3}=\alpha_{3}, and fourth moment Eξ4=α4<∞{\mathbf{E}}\xi^{4}=\alpha_{4}<\infty. Then α4−α32−1≥0\alpha_{4}-\alpha_{3}^{2}-1\geq 0, with equality if and only if ξ\xi is supported on exactly two points. Conversely, if α4−α32−1≥0\alpha_{4}-\alpha_{3}^{2}-1\geq 0, then there exists a real random variable with the specified moments.

setting b:=−1b:=-1 and a:=−α3a:=-\alpha_{3} we obtain the inequality α4−α32−1≥0\alpha_{4}-\alpha_{3}^{2}-1\geq 0. Equality only occurs when E(ξ2−α3ξ−1)2=0{\mathbf{E}}(\xi^{2}-\alpha_{3}\xi-1)^{2}=0, which by the quadratic formula implies that ξ\xi is supported on at most two points.

Now we show that every pair (α3,α4)(\alpha_{3},\alpha_{4}) with α4−α32−1≥0\alpha_{4}-\alpha_{3}^{2}-1\geq 0 arises as the moments of a random variable with mean zero and variance 11. The set of all such moments is clearly convex, so it suffices to check the case when α4−α32−1=0\alpha_{4}-\alpha_{3}^{2}-1=0. But if one considers the random variable ξ\xi which equals tan⁡θ\tan\theta with probability cos⁡2θ\cos^{2}\theta and −cot⁡θ-\cot\theta with probability sin⁡2θ\sin^{2}\theta for some −π/2<θ<π/2-\pi/2<\theta<\pi/2, one easily computes that ξ\xi has mean zero, variance 11, third moment −2cot⁡(2θ)-2\cot(2\theta), and fourth moment 4cosec⁡(2θ)−34\operatorname{cosec}(2\theta)-3, and the claim follows from the trigonometric identity cosec⁡(2θ)2=cot⁡(2θ)2+1\operatorname{cosec}(2\theta)^{2}=\cot(2\theta)^{2}+1. ∎

The more general truncated moment problem (i.e., the truncated version of the classical Hamburger moment sequence problem, see ) was solved by Curto and Fialkow .

Let ξ\xi be a real random variable with mean zero and variance 11, which is supported on at least three points. Then ξ\xi matches to order 44 with (1−t)1/2ξ′+t1/2ξG(1-t)^{1/2}\xi^{\prime}+t^{1/2}\xi_{G} for some 0<t<10<t<1 and some independent ξ′,ξG\xi^{\prime},\xi_{G} of mean zero and variance 11, where ξG≡N(0,1)\xi_{G}\equiv N(0,1) is Gaussian.

The formal characteristic function Eesξ:=∑j=0∞sjj!Eξj{\mathbf{E}}e^{s\xi}:=\sum_{j=0}^{\infty}\frac{s^{j}}{j!}{\mathbf{E}}\xi^{j} has the expansion 1+12s2+16α3s3+124α4s4+O(s5)1+\frac{1}{2}s^{2}+\frac{1}{6}\alpha_{3}s^{3}+\frac{1}{24}\alpha_{4}s^{4}+O(s^{5}); by Lemma 28, we have α4−α32−1>0\alpha_{4}-\alpha_{3}^{2}-1>0. Observe that ξ\xi will match to order 44 with (1−t)1/2ξ′+t1/2ξG(1-t)^{1/2}\xi^{\prime}+t^{1/2}\xi_{G} if and only if one has the identity

where α3′,α4′\alpha^{\prime}_{3},\alpha^{\prime}_{4} are the moments of ξ′\xi^{\prime}. Formally dividing out by 1+t2s2+t8s41+\frac{t}{2}s^{2}+\frac{t}{8}s^{4}, one can thus solve for α3′,α4′\alpha^{\prime}_{3},\alpha^{\prime}_{4} in terms of α3,α4\alpha_{3},\alpha_{4}. Observe that as t→0t\to 0, α3′,α4′\alpha^{\prime}_{3},\alpha^{\prime}_{4} must converge to α3,α4\alpha_{3},\alpha_{4} respectively. Thus, for tt sufficiently small, we will have α4′−(α3′)2−1>0\alpha^{\prime}_{4}-(\alpha^{\prime}_{3})^{2}-1>0. The claim now follows from Lemma 28. ∎

(Proof of the first part of Theorem 9) Let MnM_{n} be as in this theorem and consider (5). By Corollary 30, we can find a Johansson matrix Mn′M^{\prime}_{n} which matches MnM_{n} to order 44. By Theorem 8, (5) already holds for Mn′M^{\prime}_{n}. Thus it will suffice to show that

By (7) and linearity of expectation, it suffices to show that

uniformly for all εn≤i≤(1−ε)n{\varepsilon}n\leq i\leq(1-{\varepsilon})n, for each fixed ε>0{\varepsilon}>0. But this follows by a modification of the argument used to prove (18) (or (19)), using a function G(x,y)G(x,y) of two variables which is a smooth approximant to the indicator function of the half-space {y−x≤s}\{y-x\leq s\} (and using Theorem 19 to errors caused by shifting ss); we omit the details. The second part of the theorem will be treated together with Theorem 11. ∎

By considering P({λi+1(An)−λi(An)≤s}∧{λj+1(An)−λj(An)≤s}){\mathbf{P}}(\{\lambda_{i+1}(A_{n})-\lambda_{i}(A_{n})\leq s\}\wedge\{\lambda_{j+1}(A_{n})-\lambda_{j}(A_{n})\leq s\}) we can prove the universality of the variance of Sn(s,λ)S_{n}(s,\lambda). The same applies for higher moments.

The proof of Theorem 11 is a little more complicated. We first need a strengthening of (2) which may be of independent interest.

Let MnM_{n} be a Wigner Hermitian matrix whose atom distribution ξ\xi has vanishing third moment. Then for any fixed c>0c>0 and ε>0{\varepsilon}>0, and any εn≤j≤(1−ε)n{\varepsilon}n\leq j\leq(1-{\varepsilon})n, one has

asymptotically almost surely, where t()t() was defined in (3).

asymptotically almost surely. Let Mn′M^{\prime}_{n} be drawn from GUE, thus the off-diagonal entries of MnM_{n} and Mn′M^{\prime}_{n} match to third order. From (20) we have

asymptotically almost surely. The claim now follows from the last part of Theorem 15, letting G=G(λj)G=G(\lambda_{j}) be a smooth cutoff equal to 11 on [t(jn)n−n+c/2,t(jn)n+n+c/2]\left[t\left(\frac{j}{n}\right)n-n^{+c}/2,t\left(\frac{j}{n}\right)n+n^{+c}/2\right] and vanishing outside of [t(jn)n−n+c,t(jn)n+nc]\left[t\left(\frac{j}{n}\right)n-n^{+c},t\left(\frac{j}{n}\right)n+n^{c}\right]. ∎

Fix k,uk,u, and let MnM_{n} be as in Theorem 11. By Corollary 30, we can find a Johansson matrix Mn′M^{\prime}_{n} whose entries match MnM_{n} to fourth order. By Theorem 8 (and a slight rescaling), it suffices to show that the quantity

only changes by o(1)o(1) when the matrix MnM_{n} is replaced with Mn′M^{\prime}_{n}, for any fixed test function ff. By an approximation argument we can take ff to be smooth.

for each individual i1,…,iki_{1},\ldots,i_{k} and some absolute constant c0>0c_{0}>0. Meanwhile, by Theorem 32, we see that asymptotically almost surely, the only i1,…,iki_{1},\ldots,i_{k} which contribute to (22) lie within O(nc)O(n^{c}) of t−1(u)nt^{-1}(u)n, where c>0c>0 can be made arbitrarily small. The claim then follows from the triangle inequality (choosing cc small enough compared to c0c_{0}). ∎

This proof is similar to the one above. We already know that P(λi+1−λi≤s){\mathbf{P}}(\lambda_{i+1}-\lambda_{i}\leq s) is basically the same in the two models (MnM_{n} and Mn′M^{\prime}_{n}). Theorem 32 now shows that after fixing a small neighborhood of uu, the interval of indices ii that involve fluctuates by at most ncn^{c}, where cc can be made arbitrarily small. ∎

In fact, in the above applications, we only need Theorem 32 to hold for Johansson matrices. Thus, in order to remove the third moment assumption, it suffices to have this theorem for Johansson matrices (without the third moment assumption). We believe this is within the power of the determinant process method, but do not pursue this direction here.

As another application, we can prove the following asymptotic for the determinant (and more generally, the characteristic polynomial) of a Wigner Hermitian matrix. The detailed proof is deferred to Appendix A.

Let MnM_{n} be a Wigner Hermitian matrix whose atom distribution ξ\xi has vanishing third moment and is supported on at least three points. Then there is a constant c>0c>0 such that

More generally, for fixed any complex number zz, one has

where the decay rate of o(1)o(1) is allowed to depend on zz.

A similar result was established for iid random matrices in (see also for a refinement), based on controlling the distance from a random vector to a subspace. That method relied heavily on the joint independence of all entries and does not seem to extend easily to the Hermitian case. We also remark that a universality result for correlations of the characteristic polynomial has recently been established in .

Let us now go beyond the model of Wigner Hermitian matrices. As already mentioned, our main theorem also applies for real symmetric matrices. In the next paragraphs, we formulate a few results one can obtain in this direction.

Let nn be a large number. A Wigner symmetric matrix (of size nn) is a random symmetric matrix Mn=(ξij)1≤i,j≤nM_{n}=(\xi_{ij})_{1\leq i,j\leq n} where for 1≤i<j≤n1\leq i<j\leq n, ξij\xi_{ij} are iid copies of a real random variable ξ\xi with mean zero, variance 11, and exponential decay (as in Definition 1), while for 1≤i=j≤n1\leq i=j\leq n, ξii\xi_{ii} are iid copies of a real random variable ξ′\xi^{\prime} with mean zero, variance 22, and exponential decay. We set Wn:=1nMnW_{n}:=\frac{1}{\sqrt{n}}M_{n} and An:=nMnA_{n}:=\sqrt{n}M_{n} as before.

The Gaussian orthogonal ensemble (GOE) is the Wigner symmetric matrix in which the off-diagonal atom distribution ξ\xi is the Gaussian N(0,1)N(0,1), and the diagonal atom distribution ξ′\xi^{\prime} is N(0,2)N(0,2).

As remarked earlier, while the Wigner symmetric matrices do not, strictly speaking, obey Condition C0 due to the diagonal variance being 22 instead of 11, it is not hard to verify that all the results in this paper continue to hold after changing the diagonal variance to 22. As a consequence, we can easily deduce the following analogue of Theorems 9 and 11.

The limiting gap distribution and kk-correlation function of Wigner symmetric real matrices with atom variable σ\sigma satisfying Eσ3=0{\mathbf{E}}\sigma^{3}=0 and Eσ4=3{\mathbf{E}}\sigma^{4}=3 are the same as those for GOE. (The explicit formulae for the limiting gap distribution and kk-correlation function for GOE can be found in . The limit of the kk-correlation function is again in the weak sense.)

The proof of Theorem 38 is similar to that of Theorems 9, 11 and is omitted. The reason that we need to match the moments to order 44 here (compared to lower orders in Theorems 9 and 11) is that there is currently no analogue of Theorem 8 for the GOE. Once such a result becomes available, the order automatically reduces to those in Theorems 9 and 11, respectively.

Finally let us mention that our results can be refined and extended in several directions. For instance, we can handle Hermitian matrices whose upper triangular entries are still independent, but having a non-trivial covariance matrix (the real and imaginary parts need not be independent). The diagonal entries can have mean different from zero (which, in the case the off-diagonal entries are gaussian, corresponds to gaussian matrices with external field and has been studied in ) and we can obtain universality results in this case as well. We can also refine our argument to prove universality near the edge of the spectrum. These extensions and many others will be discussed in a subsequent paper.

7. Notation

We consider nn as an asymptotic parameter tending to infinity. We use X≪YX\ll Y, Y≫XY\gg X, Y=Ω(X)Y=\Omega(X), or X=O(Y)X=O(Y) to denote the bound X≤CYX\leq CY for all sufficiently large nn and for some constant CC. Notations such as X≪kY,X=Ok(Y)X\ll_{k}Y,X=O_{k}(Y) mean that the hidden constant CC depend on another constant kk. X=o(Y)X=o(Y) or Y=ω(X)Y=\omega(X) means that X/Y→0X/Y\rightarrow 0 as n→∞n\rightarrow\infty; the rate of decay here will be allowed to depend on other parameters. The eigenvalues are always ordered increasingly.

Preliminaries: Tools from linear algebra and probability

It is useful to keep in mind the (Courant-Fisher) minimax characterization of the eigenvalues

From this, one easily obtain Weyl’s inequality

Another consequence of the minimax formula is the Cauchy interlacing inequality

for all 1≤i<n1\leq i<n, whenever AnA_{n} is an n×nn\times n Hermitian matrix and An−1A_{n-1} is the top n−1×n−1n-1\times n-1 minor. In a similar spirit, one has

for all 1≤i<n1\leq i<n, whenever A,BA,B are n×nn\times n Hermitian matrices with BB being positive semi-definite and rank 11. If BB is instead negative semi-definite, one has

Let A,BA,B be Hermitian matrices of the same size where BB has rank one. Then for any interval II,

where NI(M)N_{I}(M) is the number of eigenvalues of MM in II.

One also has the following more precise version of the Cauchy interlacing inequality:

By diagonalising An−1A_{n-1} (noting that this does not affect either side of (25)), we may assume that An−1=diag⁡(λ1(An−1),…,λn−1(An−1))A_{n-1}=\operatorname{diag}(\lambda_{1}(A_{n-1}),\ldots,\lambda_{n-1}(A_{n-1})) and uj(An−1)=eju_{j}(A_{n-1})=e_{j} for j=1,…,n−1j=1,\ldots,n-1. One then easily verifies that the characteristic polynomial det⁡(An−λI)\det(A_{n}-\lambda I) of AnA_{n} is equal to

when λ\lambda is distinct from λ1(An−1),…,λn−1(An−1)\lambda_{1}(A_{n-1}),\ldots,\lambda_{n-1}(A_{n-1}). Since uj(An−1)∗Xu_{j}(A_{n-1})^{*}X is non-zero by hypothesis, we see that this polynomial does not vanish at any of the λj(An−1)\lambda_{j}(A_{n-1}). Substituting λi(An)\lambda_{i}(A_{n}) for λ\lambda, we obtain (25). ∎

The following lemma will be useful to control the coordinates of eigenvectors.

where uj(An−1)u_{j}(A_{n-1}) is a unit eigenvector corresponding to the eigenvalue λj(An−1)\lambda_{j}(A_{n-1}).

By subtracting λi(A)I\lambda_{i}(A)I from AA we may assume λi(A)=0\lambda_{i}(A)=0. The eigenvector equation then gives

Since ∥v′∥2+∣x∣2=1\|v^{\prime}\|^{2}+|x|^{2}=1, we conclude

Since ∥An−1−1X∥2=∑j=1n−1(λj(An−1))−2∣uj(An−1)∗X∣2\|A_{n-1}^{-1}X\|^{2}=\sum_{j=1}^{n-1}(\lambda_{j}(A_{n-1}))^{-2}|u_{j}(A_{n-1})^{*}X|^{2}, the claim follows. ∎

The Stieltjes transform sn(z)s_{n}(z) of a Hermitian matrix WW is defined for complex zz by the formula

It has the following alternate representation (see e.g. [2, Chapter 11]):

Let W=(ζij)1≤i,j≤nW=(\zeta_{ij})_{1\leq i,j\leq n} be a Hermitian matrix, and let zz be a complex number not in the spectrum of WW. Then we have

By Schur’s complement, 1ζkk−z−ak∗(Wk−zI)−1ak\frac{1}{\zeta_{kk}-z-a_{k}^{*}(W_{k}-zI)^{-1}a_{k}} is the kthk^{th} diagonal entry of (W−zI)−1(W-zI)^{-1}. Taking traces, one obtains the claim. ∎

2. Tools from Probability

We will make frequent use of the following lemma, whose proof is presented in Appendix B. This lemma is a generalization of a result in .

Another useful tool is the following theorem, which is a corollary of a more general theorem proved in Appendix D.

for some σ>0\sigma>0. Let ζ1,…,ζn\zeta_{1},\ldots,\zeta_{n} be independent complex random variables with mean zero, variance E∣ζj∣2{\mathbf{E}}|\zeta_{j}|^{2} equal to 11, and obeying E∣ζi∣3≤C{\mathbf{E}}|\zeta_{i}|^{3}\leq C for some C≥1C\geq 1. For each 1≤i≤N1\leq i\leq N, let SiS_{i} be the complex random variable

(Upper tail bound on SiS_{i}) For t≥1t\geq 1, we have P(∣Si∣≥t)≪exp⁡(−ct2)+Cσ{\mathbf{P}}(|S_{i}|\geq t)\ll\exp(-ct^{2})+C\sigma for some absolute constant c>0c>0.

(Lower tail bound on S⃗\vec{S}) For any t≤Nt\leq\sqrt{N}, one has P(∣S⃗∣≤t)≪O(t/N)⌊N/4⌋+CN4t−3σ{\mathbf{P}}(|\vec{S}|\leq t)\ll O(t/\sqrt{N})^{\lfloor N/4\rfloor}+CN^{4}t^{-3}\sigma.

Overview of argument

We now give a high-level proof of our main results, Theorem 15 and Theorem 19, contingent on several technical propositions that we prove in later sections.

In the hypotheses of Theorem 15 and Theorem 19, it is assumed that one has the uniform exponential decay property (14) on the coefficients ζij\zeta_{ij} on the random matrix MnM_{n}. From this and the union bound, we thus see that

with overwhelming probability. Since events of probability less than, say, O(n−100)O(n^{-100}) are negligible for the conclusion of either Theorem 15 or Theorem 19, we may thus apply a standard truncation argument (see e.g. ) and redefine the atom variables ζij\zeta_{ij} on the events where their magnitude exceeds log⁡C+1n\log^{C+1}n, so that one in fact has

almost surely. (This modification may affect the first, second, third, and fourth moments on the real and imaginary parts of the ζij\zeta_{ij} by a very small factor (e.g. O(n−10)O(n^{-10})), but one can easily compensate for this by further adjustment of the ζij\zeta_{ij}, using the Weyl inequalities (23) if necessary; we omit the details.) Thus we will henceforth assume that (27) holds for proving both Theorem 15 and Theorem 19.

If one only assumed some finite number of moment conditions on ζij\zeta_{ij}, rather than the exponential condition (14), then one could only truncate the ∣ζij∣|\zeta_{ij}| to be of size n1/C0n^{1/C_{0}} for some constant C0C_{0} rather than polylogarithmic in nn. While several of our arguments extend to this setting, there is a key induction on nn argument in Section 3.5 that seems to require ∣ζij∣|\zeta_{ij}| to be of size no(1)n^{o(1)} or better, which is the main reason why our results are restricted to random variables of exponential decay. However, this appears to be a largely technical restriction, and it seems very plausible that the results of this paper can be extended to atom distributions that are only assumed to have a finite number of moments bounded.

For technical reasons, it is also convenient to make the qualitative assumption that the ζij\zeta_{ij} have an (absolutely) continuous distribution in the complex plane, rather than a discrete one. This is so that pathological events such as eigenvalue collision will only occur with probability zero and can thus be ignored (though one of course still must deal with the event that two eigenvalues have an extremely small but non-zero separation). None of our bounds will depend on any quantitative measure of how continuous the ζij\zeta_{ij} are, so one can recover the discrete case from the continuous one by a standard limiting argument (approximating a discrete distribution by a smooth one while holding nn fixed, and using the Weyl inequalities (23) to justify the limiting process); we omit the details.

2. Proof strategy for Theorem 15

For sake of exposition let us restrict attention to the case k=1k=1, thus we wish to show that the expectation EG(λi(An)){\mathbf{E}}G(\lambda_{i}(A_{n})) of the random variable G(λi(An))G(\lambda_{i}(A_{n})) only changes by O(n−c0)O(n^{-c_{0}}) if one replaces AnA_{n} with another random matrix An′A^{\prime}_{n} with moments matching up to fourth order off the diagonal (and up to second order on the diagonal). To further simplify the exposition, let us suppose that the coefficients ζpq\zeta_{pq} of AnA_{n} (or An′A^{\prime}_{n}) are real-valued rather than complex-valued.

Let us freeze (or condition on) all the entries of AnA_{n} except for the pqpq and qpqp entries. For any complex number zz, let A(z)A(z) denote the matrix which equals AnA_{n} except at the pqpq, qpqp, entries, where it equals zz and z‾\overline{z} respectively. (Actually, with our hypotheses, we only need to consider real-valued zz.) Thus it would suffice to show that

for all (or at least most) choices of the frozen entries of AnA_{n}, where F(z):=G(λi(A(z)))F(z):=G(\lambda_{i}(A(z))). Note from (27) that we only care about values of zz of size O(n1/2+o(1))O(n^{1/2+o(1)}).

Suppose we could show the derivative estimates

for l=1,2,3,4,5l=1,2,3,4,5. (If zz were complex-valued rather than real, we would need to differentiate in the real and imaginary parts of zz separately, as FF is not holomorphic, but let us ignore this technicality for now.) Then by Taylor’s theorem with remainder, we would have

and similarly for F(nζpq′)F(\sqrt{n}\zeta^{\prime}_{pq}). Since n−5/2+O(c0)+o(1)=O(n−2−c0)n^{-5/2+O(c_{0})+o(1)}=O(n^{-2-c_{0}}) for nn large enough and c0c_{0} small enough, we thus obtain the claim (28) thanks to the hypothesis that the first four moments of ζpq\zeta_{pq} and ζpq′\zeta^{\prime}_{pq} match. (Note how this argument barely fails if only three moments are assumed to match, though it is possible that some refinement of this argument might still succeed by exploiting further cancellations in the fourth order term 14!F(4)(0)n4ζpq4\frac{1}{4!}F^{(4)}(0)\sqrt{n}^{4}\zeta_{pq}^{4}.)

Now we discuss why one would expect an estimate such as (29) to be plausible. For simplicity we first focus attention on the easiest case l=1l=1, thus we now wish to show that F′(z)=O(n−1+O(c0)+o(1))F^{\prime}(z)=O(n^{-1+O(c_{0})+o(1)}). By (15) and the chain rule, it suffices to show that

A crude application of the Weyl bound (23) gives ddzλi(A(z))=O(1)\frac{d}{dz}\lambda_{i}(A(z))=O(1), which is not good enough for what we want (although in the actual proof, we will take advantage of a variant of this crude bound to round zz off to the nearest multiple of n−100n^{-100}, which is useful for technical reasons relating to the union bound). But we can do better by recalling the Hadamard first variation formula

Now suppose we wish to establish the l=2l=2 version of (29). Again applying the chain rule, we would now seek to establish the bound

For this, we apply the Hadamard second variation formula

where πui(A(z))⊥\pi_{u_{i}(A(z))^{\perp}} is the orthogonal projection to the orthogonal complement ui(A(z))⊥u_{i}(A(z))^{\perp} of ui(A(z))u_{i}(A(z)), and (A(z)−λi(A(z))I)−1(A(z)-\lambda_{i}(A(z))I)^{-1} is the inverse of A(z)−λi(A(z))A(z)-\lambda_{i}(A(z)) on that orthogonal complement. (This formula is valid as long as the eigenvalues λj(A(z))\lambda_{j}(A(z)) are simple, which is almost surely the case due to the hypothesis of continuous distribution.) One can expand out the right-hand side in terms of the other (unit-normalized) eigenvectors uj(A(z))u_{j}(A(z)), j≠ij\neq i as

By using Erdős-Schlein-Yau type estimates one expects ∣uj(A(z))∗A′(z)ui(A(z))∣|u_{j}(A(z))^{*}A^{\prime}(z)u_{i}(A(z))| to be of size about O(n−1+o(1))O(n^{-1+o(1)}), while from Theorem 19 we expect ∣λj(z)−λi(z)∣|\lambda_{j}(z)-\lambda_{i}(z)| to be bounded below by n−c0n^{-c_{0}} with high probability, and so the claim (30) is plausible (one still needs to sum over jj, of course, but one expects λj(z)−λi(z)\lambda_{j}(z)-\lambda_{i}(z) to grow roughly linearly in jj and so this should only contribute a logarithmic factor O(log⁡n)=O(no(1))O(\log n)=O(n^{o(1)}) at worst). So we see for the first time how Theorem 19 is going to be an essential component in the proof of Theorem 15. Similar considerations also apply to the third, fourth, and fifth derivatives of λi(A(z))\lambda_{i}(A(z)), though as one might imagine the formulae become more complicated.

There is however a technical difficulty that arises, namely that the lower bound

holds with high probability, but not with overwhelming probability (see Definition 3 for definitions). Indeed, given that eigenvalue collision is a codimension two event for real symmetric matrices and codimension three for Hermitian ones, one expects the failure probability to be about n−2c0n^{-2c_{0}} in the real case and n−3c0n^{-3c_{0}} in the complex case (this heuristic is also supported by the gap statistics for GOE and GUE). As one needs to take the union bound over many values of zz (about n100n^{100} or so), this presents a significant problem. However, this difficulty can be avoided by going back to the start of the argument and replacing the quantity G(λi(z))G(\lambda_{i}(z)) with a “regularized” variant which vanishes whenever λi(z)\lambda_{i}(z) gets too close to another eigenvalue. To do this, it is convenient to introduce the quantity

this quantity is normally of size O(1)O(1), but becomes large precisely when the gap between λi(A(z))\lambda_{i}(A(z)) and other eigenvalues becomes small. The strategy is then to replace G(λi(A(z)))G(\lambda_{i}(A(z))) by a truncated variant G(λi(A(z)),Qi(A(z)))G(\lambda_{i}(A(z)),Q_{i}(A(z))) which is supported on the region where QiQ_{i} is not too large (e.g. of size at most nc0n^{c_{0}}), and apply the swapping strategy to the latter quantity instead. (For this, one needs control on derivatives of Qi(A(z))Q_{i}(A(z)) as well as on λi(A(z))\lambda_{i}(A(z)), but it turns out that such bounds are available; this smoothness of QiQ_{i} is one reason why we work with QiQ_{i} in the first place, rather than more obvious alternatives such as inf⁡j≠i∣λj(A(z))−λi(A(z))∣\inf_{j\neq i}|\lambda_{j}(A(z))-\lambda_{i}(A(z))|.) Finally, to remove the truncation at the beginning and end of the iterated swapping process, one appeals to Theorem 19. Notice that this result is now only used twice, rather than O(n2)O(n^{2}) or O(n100)O(n^{100}) times, and so the total error probability remains acceptably bounded.

One way to interpret this truncation trick is that while the “bad event” that QiQ_{i} is large has reasonably large probability (of order about n−c0n^{-c_{0}}), which makes the union bound ineffective, the QiQ_{i} does not change too violently when swapping one or more of the entries of the random matrix, and so one is essentially faced with the same bad event throughout the O(n2)O(n^{2}) different swaps (or throughout the O(n100)O(n^{100}) or so different values of zz). So the union bound is actually far from the truth in this case.

3. High-level proof of Theorem 15

We now begin the rigorous proof of Theorem 15, breaking it down into simpler propositions which will be proven in subsequent sections.

The heart of the argument consists of two key propositions. The first proposition asserts that one can swap a single coefficient (or more precisely, two coefficients) of a (deterministic) matrix AA as long as AA obeys a certain “good configuration condition”:

There exists a positive constant C1C_{1} such that the following holds. Let k≥1k\geq 1 and ε1>0{\varepsilon}_{1}>0, and assume nn sufficiently large depending on these parameters. Let 1≤i1<…<ik≤n1\leq i_{1}<\ldots<i_{k}\leq n. For a complex parameter zz, let A(z)A(z) be a (deterministic) family of n×nn\times n Hermitian matrices of the form

where ep,eqe_{p},e_{q} are unit vectors. We assume that for every 1≤j≤k1\leq j\leq k and every ∣z∣≤n1/2+ε1|z|\leq n^{1/2+{\varepsilon}_{1}} whose real and imaginary parts are multiples of n−C1n^{-C_{1}}, we have

(Eigenvalue separation) For any 1≤i≤n1\leq i\leq n with ∣i−ij∣≥nε1|i-i_{j}|\geq n^{{\varepsilon}_{1}}, we have

(Delocalization at iji_{j}) If Pij(A(z))P_{i_{j}}(A(z)) is the orthogonal projection to the eigenspace associated to λij(A(z))\lambda_{i_{j}}(A(z)), then

whenever Pij,αP_{i_{j},\alpha} is the orthogonal projection to the eigenspaces corresponding to eigenvalues λi(A(z))\lambda_{i}(A(z)) with 2α≤∣i−ij∣<2α+12^{\alpha}\leq|i-i_{j}|<2^{\alpha+1}.

We say that A(0),ep,eqA(0),e_{p},e_{q} are a good configuration for i1,…,iki_{1},\ldots,i_{k} if the above properties hold. Assuming this good configuration, then we have

for all 0≤j≤50\leq j\leq 5, and ζ,ζ′\zeta,\zeta^{\prime} are random variables with ∣ζ∣,∣ζ′∣≤n1/2+ε1|\zeta|,|\zeta^{\prime}|\leq n^{1/2+{\varepsilon}_{1}} almost surely, which match to order rr for some r=2,3,4r=2,3,4.

If GG obeys the improved derivative bounds

for 0≤j≤50\leq j\leq 5 and some sufficiently large absolute constant CC, then we can strengthen n−(r+1)/2+O(ε1)n^{-(r+1)/2+O({\varepsilon}_{1})} in (34) to n−(r+1)/2−ε1n^{-(r+1)/2-{\varepsilon}_{1}}.

The need to restrict zz to multiples of n−C1n^{-C_{1}}, as opposed to all complex zz in the disk of radius n1/2+ε1n^{1/2+\varepsilon_{1}}, is so that we can verify the hypotheses in the next proposition using the union bound (so long as the events involved hold with overwhelming probability). For C1C_{1} large enough, we will be able to use rounding methods to pass from the discrete setting of multiples of n−C1n^{-C_{1}} to the continuous setting of arbitrary complex numbers in the disk without difficulty.

We prove this proposition in Section 4. To use this proposition, we of course need to have the good configuration property hold often. This leads to the second key proposition:

We will prove this proposition in Section 5.

Given these two propositions (and Theorem 19) we can now prove Theorem 15. As discussed at the beginning of the section, we may assume that the ζij\zeta_{ij} are continuously distributed in the complex plane and obey the bound (27).

Let 0<ε<10<{\varepsilon}<1 and k≥1k\geq 1, and assume c0c_{0} is sufficiently small and C1C_{1} sufficiently large. Let Mn,Mn′,ζij,ζij′,An,An′,GM_{n},M^{\prime}_{n},\zeta_{ij},\zeta^{\prime}_{ij},A_{n},A^{\prime}_{n},G, i1,…,iki_{1},\ldots,i_{k} be as in Theorem 15.

For each 1≤j≤k1\leq j\leq k, one has Qij(An)≤nc0Q_{i_{j}}(A_{n})\leq n^{c_{0}} with high probability.

For brevity we omit the AnA_{n} variable. Fix jj. Suppose that Qij>nc0Q_{i_{j}}>n^{c_{0}}, then

and so by the pigeonhole principle there exists an integer 0≤m≪log⁡n0\leq m\ll\log n such that

uniformly in mm (and similarly for λij−2m\lambda_{i_{j}-2^{m}}), since the log⁡n\log n loss caused by the number of mm’s can easily be absorbed into the right-hand side.

Fix mm. Suppose that ∣λij+2m−λij∣≪234mn−c0/2|\lambda_{i_{j}+2^{m}}-\lambda_{i_{j}}|\ll 2^{\frac{3}{4}m}n^{-c_{0}/2}; then expressing the left-hand side as ∑k=02m−1λij+k+1−λij+k\sum_{k=0}^{2^{m}-1}\lambda_{i_{j}+k+1}-\lambda_{i_{j}+k} and using Markov’s inequality we see that

The claim now follows from Theorem 19. (There is a slight issue when 2m∼n2^{m}\sim n, so that the index ij+ki_{j}+k may leave the bulk; but then one works with, say, λij+2m−1−λij\lambda_{i_{j}+2^{m-1}}-\lambda_{i_{j}} instead of λij+2m−λij\lambda_{i_{j}+2^{m}}-\lambda_{i_{j}}). ∎

One can also use Theorem 60 below to control all terms in the sum with ∣i−ij∣≫log⁡C′n|i-i_{j}|\gg\log^{C^{\prime}}n for some C′C^{\prime}, leading to a simpler proof of Lemma 49.

Of course, Lemma 49 also applies with AnA_{n} replaced by An′A^{\prime}_{n}.

where η(x)\eta(x) is a smooth cutoff to the region x≤nc0x\leq n^{c_{0}} which equals 11 on x≤nc0/2x\leq n^{c_{0}}/2. From (15) and the chain rule we see that

for j=0,1,2,3,4,5j=0,1,2,3,4,5. Also, from Lemma 49 we have

for some c>0c>0, and similarly with AnA_{n} replaced by An′A^{\prime}_{n}. Thus (by choosing c0c_{0} small enough) to prove (16) it will suffice to show that the quantity

only changes by at most n−c0/2n^{-c_{0}}/2 (say) when one replaces AnA_{n} by An′A^{\prime}_{n}.

As discussed in Section 3.2, it will suffice to show that the quantity (35) changes by at most n−2−c0/4n^{-2-c_{0}}/4 when one swaps the ζpq\zeta_{pq} entry with 1≤p<q≤n1\leq p<q\leq n to ζpq′\zeta^{\prime}_{pq} (and ζqp\zeta_{qp} with ζqp′\zeta^{\prime}_{qp}), and changes by at most n−1−c0/4n^{-1-c_{0}}/4 when one swaps a diagonal entry ζpp\zeta_{pp} with ζpp′\zeta^{\prime}_{pp}. But these claims follow from Proposition 48 and Proposition 46. (The last part of Proposition 46 is used in the case when one only has three moments matching rather than four.)

The proof of Theorem 15 is now complete (contingent on Theorem 19, Proposition 46, and Proposition 48).

4. Proof strategy for Theorem 19

We now informally discuss the proof of Theorem 19.

The machinery of Erdős, Schlein, and Yau, which is useful in particular for controlling the Stieltjes transform of Wigner matrices, will allow us to obtain good lower bounds on the spectral gap λi(An)−λi−1(An)\lambda_{i}(A_{n})-\lambda_{i-1}(A_{n}) in the bulk as soon as k≫log⁡C′nk\gg\log^{C^{\prime}}n for a sufficiently large CC’; see Theorem 60 for a precise statement. The difficulty here is that kk is exactly 11. To overcome this difficulty, we will try to amplify the value of kk by looking at the top left n−1×n−1n-1\times n-1 minor An−1A_{n-1} of AnA_{n}, and observing the following “backwards gap propagation” phenomenon:

If λi(An)−λi−k(An)\lambda_{i}(A_{n})-\lambda_{i-k}(A_{n}) is very small, then λi(An−1)−λi−k−1(An−1)\lambda_{i}(A_{n-1})-\lambda_{i-k-1}(A_{n-1}) will also be small with reasonably high probability.

If one accepts this phenomenon, then by iterating it about log⁡C′n\log^{C^{\prime}}n times one can enlarge the spacing kk to be of the size large enough so that a Erdős-Schlein-Yau type bound can be invoked to obtain a contradiction. (There will be a technical difficulty caused by the fact that the failure probability of this phenomenon, when suitably quantified, can be as large as 1/log⁡O(1)n1/\log^{O(1)}n, thus apparently precluding the ability to get a polynomially strong bound on the failure rate, but we will address this issue later.)

Note that the converse of this statement follows from the Cauchy interlacing property (24). To explain why this phenomenon is plausible, observe from (24) that if λi(An)−λi−k(An)\lambda_{i}(A_{n})-\lambda_{i-k}(A_{n}) is small, then λi(An)−λi−k−1(An−1)\lambda_{i}(A_{n})-\lambda_{i-k-1}(A_{n-1}) is also small. On the other hand, from Lemma 40 one has the identity

where XX is the rightmost column of AnA_{n} (with the bottom entry nζnn\sqrt{n}\zeta_{nn} removed).

One expects ∣uj(An−1)∗X∣2|u_{j}(A_{n-1})^{*}X|^{2} to have size about nn on the average (cf. Lemma 43). In particular, if λi(An)−λi−k(An−1)\lambda_{i}(A_{n})-\lambda_{i-k}(A_{n-1}) is small (e.g. of size O(n−c)O(n^{-c})), then the j=i−1j=i-1 term is expected give a large negative contribution (of size ≫n1+c\gg n^{1+c}) to the left-hand side of (36). Meanwhile, the right-hand side is much smaller, of size O(n)O(n) or so on the average; so we expect to have the large negative contribution mentioned earlier to be counterbalanced by a large positive contribution from some other index. The index which is most likely to supply such a large positive contribution is j=ij=i, and so one expects λi(An−1)−λi(An)\lambda_{i}(A_{n-1})-\lambda_{i}(A_{n}) to be small (also of size O(n−c)O(n^{-c}), in fact). A similar argument also leads one to expect λi−k(An)−λi−k−1(An)\lambda_{i-k}(A_{n})-\lambda_{i-k-1}(A_{n}) to be small, and the claimed phenomenon then follows from the triangle inequality.

In order to make the above strategy rigorous, there are a number of technical difficulties. The first is that the counterbalancing term mentioned above need not come from j=ij=i, but could instead come from another value of jj, or perhaps a “block” of several jj put together, and so one may have to replace the gap λi(An−1)−λi−k−1(An−1)\lambda_{i}(A_{n-1})-\lambda_{i-k-1}(A_{n-1}) by a more general type of gap. A second problem is that the gap λi(An−1)−λi−k−1(An−1)\lambda_{i}(A_{n-1})-\lambda_{i-k-1}(A_{n-1}) is going to be somewhat larger than the gap λi(An)−λi−k(An)\lambda_{i}(A_{n})-\lambda_{i-k}(A_{n}), and one is going to be iterating this gap growth about log⁡O(1)n\log^{O(1)}n times. In order to be able to contradict Theorem 60 at the end of the argument, the net gap growth should only be O(nc)O(n^{c}) at most for some small c>0c>0. So one needs a reasonable control on the ratio between the gap for An−1A_{n-1} and the gap for AnA_{n}; in particular, if one can keep the former gap to be at most (1+1k)O(log⁡0.9n)(1+\frac{1}{k})^{O(\log^{0.9}n)} times the latter gap, then the net growth in the gap telescopes to (log⁡O(1)n)O(log⁡0.9n)(\log^{O(1)}n)^{O(\log^{0.9}n)}, which is indeed less than O(nc)O(n^{c}) and thus acceptable. To address these issues, we fix a base value n0n_{0} of nn, and for any 1≤i−l<i≤n≤n01\leq i-l<i\leq n\leq n_{0}, we define the regularized gap

where C1>1C_{1}>1 is a large constant (depending on CC) to be chosen later. (We need to cap i+−i−i_{+}-i_{-} off at log⁡C1n0\log^{C_{1}}n_{0} to prevent the large values of i+−i−i_{+}-i_{-} from overwhelming the infimum, which is not what we want.)

We will shortly establish a rigorous result that asserts, roughly speaking, that if the gap gi,l,n+1g_{i,l,n+1} is small, then the gap gi,l+1,ng_{i,l+1,n} is also likely to be small, thus giving a precise version of the phenomenon mentioned earlier.

There is one final obstacle, which has to do with the failure probability when gi,l,n+1g_{i,l,n+1} is small but gi,l+1,ng_{i,l+1,n} is large. If this event could be avoided with overwhelming probability (or even a high probability), then one would be done by the union bound (note we only need to take the union over O(log⁡O(1)n)O(\log^{O(1)}n) different events). While many of the events that could lead to failure can indeed be avoided with high probability, there is one type of event which does cause a serious problem, namely that the inner products uj(An−1)∗Xu_{j}(A_{n-1})^{*}X for i−≤j≤i+i_{-}\leq j\leq i_{+} could be unexpectedly small. Talagrand’s inequality (Lemma 43) can be used to control this event effectively when i+−i−i_{+}-i_{-} is large, but when i+−i−i_{+}-i_{-} is small the probability of failure can be as high as 1/log⁡cn1/\log^{c}n for some c>0c>0. However, one can observe that such high failure rates only occur when gi,l+1,ng_{i,l+1,n} is only slightly larger than gi,l,n+1g_{i,l,n+1}. Indeed, one can show that the probability that gi,l,n+1g_{i,l,n+1} is much higher than gi,l+1,ng_{i,l+1,n}, say of size 2mgi,l,n+12^{m}g_{i,l,n+1} or more, is only O(2−m/2/log⁡cn)O(2^{-m/2}/\log^{c}n) (for reasonable values of mm), and in fact (thanks to Talagrand’s inequality) the constant cc can be increased to be much larger when ll is large. This is still not quite enough for a union bound to give a total failure probability of O(n−c)O(n^{-c}), but one can exploit the martingale-type structure of the problem (or more precisely, the fact that the column XX remains random, with independent entries, even after conditioning out all of the block An−1A_{n-1}) to multiply the various bad failure probabilities together to end up with the final bound of O(n−c)O(n^{-c}).

5. High-level proof of Theorem 19

We now prove Theorem 19. Fix ε,c0{\varepsilon},c_{0}. We write i0i_{0} and n0n_{0} for i,ni,n, thus

and the task is to show that ∣λi0(An0)−λi0(An0−1)∣≥n0−c0|\lambda_{i_{0}}(A_{n_{0}})-\lambda_{i_{0}}(A_{n_{0}-1})|\geq n_{0}^{-c_{0}} with high probability. We can of course assume that n0n_{0} is large compared to all other parameters. We can also assume the bound (27), and that the distribution of the AnA_{n} is continuous, so that events such as repeated eigenvalues occur with probability zero and can thus be neglected.

We let C1C_{1} be a large constant to be chosen later. For any l,nl,n with 1≤i−l<i≤n≤n01\leq i-l<i\leq n\leq n_{0}, we define the normalized gap gi,l,ng_{i,l,n} by (37). It will suffice to show that

The first main tool for this will be the following (deterministic) lemma, proven in Section 6.

Suppose that n0/2≤n<n0n_{0}/2\leq n<n_{0} and l≤εn/10l\leq{\varepsilon}n/10 is such that

for some 0<δ≤10<\delta\leq 1 (which can depend on nn), and that

Then one of the following statements hold:

(Macroscopic spectral concentration) There exists 1≤i−<i+≤n+11\leq i_{-}<i_{+}\leq n+1 with i+−i−≥log⁡C1/2ni_{+}-i_{-}\geq\log^{C_{1}/2}n such that ∣λi+(An+1)−λi−(An+1)∣≤δ1/4exp⁡(log⁡0.95n)(i+−i−)|\lambda_{i_{+}}(A_{n+1})-\lambda_{i_{-}}(A_{n+1})|\leq\delta^{1/4}\exp(\log^{0.95}n)(i_{+}-i_{-}).

(Small inner products) There exists εn/2≤i−≤i0−l<i0≤i+≤(1−ε/2)n{\varepsilon}n/2\leq i_{-}\leq i_{0}-l<i_{0}\leq i_{+}\leq(1-{\varepsilon}/2)n with i+−i−≤log⁡C1/2ni_{+}-i_{-}\leq\log^{C_{1}/2}n such that

(Large eigenvalue) For some 1≤i≤n+11\leq i\leq n+1 one has

(Large inner product in bulk) There exists εn/10≤i≤(1−ε/10)n{\varepsilon}n/10\leq i\leq(1-{\varepsilon}/10)n such that

(Large inner product near i0i_{0}) There exists εn/10≤i≤(1−ε/10)n{\varepsilon}n/10\leq i\leq(1-{\varepsilon}/10)n with ∣i−i0∣≤log⁡C1n|i-i_{0}|\leq\log^{C_{1}}n such that

In applications δ\delta will be a small negative power of nn. The main bad event here is (ii) (and to a lesser extent, (vii)); the other events will have a polynomially small probability of occurrence in practice (as a function of nn) and so can be easily discarded. The events (ii), (vii) are more difficult to discard, since their probability is not polynomially small in nn, if mm is small. On the other hand, these probabilities decay exponentially in mm, and furthermore are independent in a martingale sense, and this will be enough for us to obtain a proper control. The exact numerical values of the exponents such as 0.90.9, 0.950.95, 0.80.8, etc. are not particularly important, though of course they need to lie between and 11.

The second key proposition bounds the probability that each of the bad events (i)-(vii) occur, proven in Section 7.

Suppose that n0/2≤n<n0n_{0}/2\leq n<n_{0} and l≤εn/10l\leq{\varepsilon}n/10, and set δ:=n0−κ\delta:=n_{0}^{-\kappa} for some sufficiently small fixed κ>0\kappa>0. Then:

The events (i), (iii), (iv), (v), (vi) in Lemma 51 all fail with high probability.

There is a constant C′C^{\prime} such that all the coefficients of the eigenvectors uj(An)u_{j}(A_{n}) for εn/2≤j≤(1−ε/2)n{\varepsilon}n/2\leq j\leq(1-{\varepsilon}/2)n are of magnitude at most n−1/2log⁡C′nn^{-1/2}\log^{C^{\prime}}n with overwhelming probability. Conditioning AnA_{n} to be a matrix with this property, the events (ii) and (vii) occur with a conditional probability of at most 2−κm+n−κ2^{-\kappa m}+n^{-\kappa}.

Furthermore, there is a constant C2C_{2} (depending on C′,κ,C1C^{\prime},\kappa,C_{1}) such that if l≥C2l\geq C_{2} and AnA_{n} is conditioned as in (b), then (ii) and (vii) in fact occur with a conditional probability of at most 2−κmlog⁡−2C1n+n−κ2^{-\kappa m}\log^{-2C_{1}}n+n^{-\kappa}.

Let us assume these two propositions for now and conclude the proof of Theorem 19.

We may assume c0c_{0} is small. Set κ:=c0/10\kappa:=c_{0}/10. For each n0−log⁡2C1n0≤n≤n0n_{0}-\log^{2C_{1}}n_{0}\leq n\leq n_{0}, let EnE_{n} be the event that one of the eigenvectors uj(An)u_{j}(A_{n}) for εn/2≤j≤(1−ε/2)n{\varepsilon}n/2\leq j\leq(1-{\varepsilon}/2)n has a coefficient of magnitude more than n−1/2log⁡nC′n^{-1/2}\log^{C^{\prime}}_{n}, and let E0E_{0} be the event that at least one of the exceptional events (i), (iii)-(vi), or EnE_{n} hold for some n−log⁡2C1n0≤n≤n0n-\log^{2C_{1}}n_{0}\leq n\leq n_{0}; then by Proposition 53 and the union bound we have

(say). It thus suffices to show that the event

To bound this, the first step is to increase the ll parameter from 11 to C2C_{2}, in order to use Proposition 53(c). Set 2m:=n0κ/C22^{m}:=n_{0}^{\kappa/C_{2}}. From Proposition 53(b), we see that the event that EnE_{n} fails, but (ii) or (vii) holds for n=n0−1n=n_{0}-1, l=1l=1, and some i−,i+i_{-},i_{+} occurs with probability O(2−κm+n0−κ)O(2^{-\kappa m}+n_{0}^{-\kappa}). Applying Lemma 51 (noting that n0−10κ≤δn_{0}^{-10\kappa}\leq\delta) we conclude that

We can iterate this process C2C_{2} times and conclude

substituting in the definition of mm, we conclude

By Markov’s inequality, it suffices to show that

(say), where for each n0−log⁡C1n0≤n≤n0−C2n_{0}-\log^{C_{1}}n_{0}\leq n\leq n_{0}-C_{2}, ZnZ_{n} is the random variable

We now establish a recursive inequality for EZn−κ/2I(E0c){\mathbf{E}}Z_{n}^{-\kappa/2}{\mathbf{I}}(E_{0}^{c}). Let n0−log⁡C1n0≤n<n0−C2n_{0}-\log^{C_{1}}n_{0}\leq n<n_{0}-C_{2}. Suppose we condition AnA_{n} so that EnE_{n} fails. Then for any m≥0m\geq 0, we see from Proposition 53(c) that (ii) or (vii) holds for l=n0−nl=n_{0}-n and some i−,i+i_{-},i_{+} with (conditional) probability at most O(2−κmlog⁡−2C1n+n−κ)O(2^{-\kappa m}\log^{-2C_{1}}n+n^{-\kappa}). Applying Lemma 51, we conclude that

Note that this inequality is also vacuously true of AnA_{n} is such that EnE_{n} holds, since the event E0cE_{0}^{c} is then empty.

Observe that if Zn>2mZn+1Z_{n}>2^{m}Z_{n+1} for some m≥0m\geq 0 then gi0,n0−n,n+1≤δ∧gi0,n0−n+1,n≥2mgi0,n0−n,n+1g_{i_{0},n_{0}-n,n+1}\leq\delta\wedge g_{i_{0},n_{0}-n+1,n}\geq 2^{m}g_{i_{0},n_{0}-n,n+1}. Thus

Since we are conditioning on AnA_{n}, ZnZ_{n} is deterministic. Also, from the definition of ZnZ_{n}, this event is vacuous for 2m>n8κ2^{m}>n^{8\kappa}, thus we can simplify the above bound as

Now we multiply this by 2mκ/22^{m\kappa/2} and sum over m≥0m\geq 0 to obtain

(say). Undoing the conditioning on AnA_{n}, we conclude

Applying (43) (and the trivial bound Zn−κ/2≤n9κ2/2Z_{n}^{-\kappa/2}\leq n^{9\kappa^{2}/2}) we have

On the other hand, if E0cE_{0}^{c} holds, then by (i) we have

whenever 1≤i−≤i−log⁡C1/2n0<i≤i+≤n1\leq i_{-}\leq i-\log^{C_{1}/2}n_{0}<i\leq i_{+}\leq n. From this we have

Inserting this into (45) we obtain (44) as required.

Good configurations have stable spectra

The purpose of this section is to prove Proposition 46. The first stage is to obtain some equations for the derivatives of eigenvalues of Hermitian matrices with respect to perturbations.

Suppose that λi(A)\lambda_{i}(A) is a simple eigenvalue, which means that λi(A)≠λj(A)\lambda_{i}(A)\neq\lambda_{j}(A) for all j≠ij\neq i; note that almost all Hermitian matrices have simple eigenvalues. We then define Pi(A)P_{i}(A) to be the orthogonal projection to the one-dimensional eigenspace corresponding to λi(A)\lambda_{i}(A); thus, if ui(A)u_{i}(A) is a unit eigenvector for the eigenvalue λi(A)\lambda_{i}(A), then Pi(A)=ui(A)ui(A)∗P_{i}(A)=u_{i}(A)u_{i}(A)^{*}. We also define the resolvent Ri(A)R_{i}(A) to be the unique Hermitian matrix inverting A−λi(A)IA-\lambda_{i}(A)I on the range of I−Pi(A)I-P_{i}(A), and vanishing on the range of Pi(A)P_{i}(A). If u1(A),…,un(A)u_{1}(A),\ldots,u_{n}(A) form an orthonormal eigenbasis associated to the λ1(A),…,λn(A)\lambda_{1}(A),\ldots,\lambda_{n}(A), we can write Ri(A)R_{i}(A) explicitly as

By (23), each eigenvalue function A↦λi(A)A\mapsto\lambda_{i}(A) for 1≤i≤n1\leq i\leq n is continuous. However, we will need a quantitative control on the derivatives of this function. The first observation is that λi\lambda_{i} (and Pi,Ri,QiP_{i},R_{i},Q_{i}) depend smoothly on AA whenever that eigenvalue is simple (even if other eigenvalues have multiplicity):

Let 1≤i≤n1\leq i\leq n, and let A0A_{0} be a Hermitian matrix which has a simple eigenvalue at λi(A0)\lambda_{i}(A_{0}). Then λi\lambda_{i}, PiP_{i}, RiR_{i}, and QiQ_{i} are smooth for AA in a neighborhood of A0A_{0}.

By the Weyl inequality (23), λi(A0)\lambda_{i}(A_{0}) stays away from the other λj(A0)\lambda_{j}(A_{0}) by a bounded distance for all A0A_{0} in a neighborhood of A0A_{0}. In particular, the characteristic polynomial det⁡(A−λI)\det(A-\lambda I) has a simple zero at λi(A)\lambda_{i}(A) for all such AA. Since this polynomial also depends smoothly on AA, the smoothness of λi\lambda_{i} now follows. As A−λi(A)IA-\lambda_{i}(A)I depends smoothly on AA, has a single zero eigenvalue, and has all other eigenvalues bounded away from zero, we see that the one-dimensional kernel ker⁡(A−λi(A)I)\ker(A-\lambda_{i}(A)I) also depends smoothly on AA near A0A_{0}. Since PiP_{i} is the orthogonal projection to this kernel, the smoothness of PiP_{i} now follows.

Since A−λi(A)IA-\lambda_{i}(A)I depends smoothly on AA, and has eigenvalues bounded away from zero on the range of 1−Pi1-P_{i} (which also smoothly dependent on AA), we see that RiR_{i} (and hence QiQ_{i}) also depend smoothly on AA. ∎

It will be convenient to introduce some more notation, to deal with the technical fact that zz is complex-valued rather than real. For any smooth function f(z)f(z) (which may be scalar, vector, or matrix-valued), we use

where the (k+1)(k+1)-tuple (∇mf)∗(∇k−mg)(\nabla^{m}f)*(\nabla^{k-m}g) is defined as

The exact coefficients here are not important, and one can view (∇mf)∗(∇k−mg)(\nabla^{m}f)*(\nabla^{k-m}g) simply as a bilinear combination of ∇mf\nabla^{m}f and ∇k−mg\nabla^{k-m}g. Note that (47) is valid for matrix-valued f,gf,g as well as scalar f,gf,g. For a tuple (A1,…,Al)(A_{1},\dots,A_{l}) of matrices, we define

We can now give the higher order Hadamard variation formulae:

We differentiate these identities kk times using the Leibniz rule (47) to obtain

Multiplying (55) by PiP_{i} and taking traces one obtains (48) (the m=0m=0 terms cancel because of (53), which implies that trace⁡(A(∇mPi)Pi)=λitrace⁡((∇mPi)Pi)\operatorname{trace}(A(\nabla^{m}P_{i})P_{i})=\lambda_{i}\operatorname{trace}((\nabla^{m}P_{i})P_{i})).

We next compute ∇kPi\nabla^{k}P_{i} using the decomposition

Multiplying both sides of (56) by PiP_{i} (on the right) and using the identity PiPi=PiP_{i}P_{i}=P_{i}, we get a cancelation which implies

Repeating the same trick with I−PiI-P_{i} instead of PiP_{i}, we have

This gives two of the four components of ∇kPi\nabla^{k}P_{i}. To obtain the other components, multiply (55) on the left by I−PiI-P_{i} and notice that the (I−Pi)(∇kλi)Pi(I-P_{i})(\nabla^{k}\lambda_{i})P_{i} term vanishes because of (54). Rearranging the terms, we obtain

Applying RiR_{i} on the left and PiP_{i} on the right and using (46), we get

These, together with (58), (59) and (57) imply (49).

Now we turn to RiR_{i}. Here, we use the identities (46)

Differentiating the second identity kk times gives (50). Differentiating the first identity kk times, meanwhile, gives

multiplying on the right by RiR_{i}, we obtain (51), and then (52) follows. ∎

We isolate the k=1k=1 case of Proposition 55, obtaining the Hadamard variation formulae

2. Bounding the derivatives

We now use the recursive inequalities obtained in the previous section to bound the derivatives of λi\lambda_{i} and PiP_{i}, assuming some quantitative control on the spectral gap between λi\lambda_{i} and other eigenvalues, and on the matrix AA and its derivatives. Let us begin with a crude bound.

Let A=A(z)A=A(z) be an n×nn\times n matrix varying (real)-linearly in zz (thus ∇kA=0\nabla^{k}A=0 for k≥2k\geq 2), with

for some V>0V>0. Let 1≤i≤n1\leq i\leq n. At some fixed value of zz, suppose we have the spectral gap condition

for all j≠ij\neq i and some r>0r>0 (in particular, λi(A(z))\lambda_{i}(A(z)) is a simple eigenvalue). Then for all k≥1k\geq 1 we have (at this fixed choice of zz)

Observe that the spectral gap condition (62) ensures that

for any Hermitian matrix BB, which follows as PiP_{i} is a rank one orthogonal projection.

To prove (63), (64), we induct on kk. The case k=1k=1 follows from (60), (61), (68), and (67); and then, for k>1k>1, the claim follows from the induction hypotheses and (48), (49), (67), (68).

To prove (65), we also induct on kk. The case k=0k=0 follows from (67). For k≥1k\geq 1, the claim then follows from the induction hypotheses and (52).

To prove (66), we use the product rule to bound

This crude bound is insufficient for our applications, and we will need to supplement it with one that strengthens the spectral condition, and also assumes an “delocalization” property for the projections Pα,PβP_{\alpha},P_{\beta} relative to the perturbation A˙\dot{A}.

Let A=A(z)A=A(z) be an n×nn\times n matrix varying real-linearly in zz. Let 1≤i≤n1\leq i\leq n. At some fixed value of zz, suppose that λi=λi(A(z))\lambda_{i}=\lambda_{i}(A(z)) is a simple eigenvalue, and that we have a partition

where JJ is a finite index set (not containing ii), and PαP_{\alpha} are orthogonal projections to invariant spaces on AA (i.e. to spans of eigenvectors not corresponding to λi\lambda_{i}). Suppose that on the range of each PαP_{\alpha}, the eigenvalues of A−λiA-\lambda_{i} have magnitude at least rαr_{\alpha} for some rα>0r_{\alpha}>0; equivalently, we have

Suppose also that we have the delocalization bounds

for all α,β∈J\alpha,\beta\in J and some v>0v>0 and cα≥1c_{\alpha}\geq 1 with ci=1c_{i}=1, and the strong spectral gap condition

for some L>0L>0. Then at this fixed choice of zz, and for all α,β∈J\alpha,\beta\in J, we have

We remark that we can unify the bounds (73)-(75) and (76)-(78) by allowing α,β\alpha,\beta to vary in J∪{i}J\cup\{i\} rather than JJ, and adopting the convention that ri:=1/Lr_{i}:=1/L.

Note that the projections PiP_{i} and the PαP_{\alpha} are idempotent and all annihilate each other, and commute with AA and RiR_{i}. We will use these facts throughout this proof without further comment.

To prove (72)-(75), we again induct on kk. When k=1k=1, the claim (72) follows from (60), (70), and (68), while (73)-(75) follow from (61) and (70). (For (75) we in fact obtain that the left-hand side is zero.)

Now suppose inductively that k>1k>1, and that the claims have already been proven for all smaller values of kk.

We first prove (72). From (48) and the linear nature of AA, we have

From (68) and the inductive hypothesis (73) we have

for any 1≤m≤k−11\leq m\leq k-1, and thus by the inductive hypothesis (72) we see that

Next, by splitting (∇A)∗(∇k−1Pi)Pi(\nabla A)*(\nabla^{k-1}P_{i})P_{i} as ∑α∈J∪{i}(∇A)∗Pα(∇k−1Pi)Pi\sum_{\alpha\in J\cup\{i\}}(\nabla A)*P_{\alpha}(\nabla^{k-1}P_{i})P_{i} and using (68), we have

Using (70) and the inductive hypotheses (73), (74), we thus have

Applying (71) we conclude (72) as desired.

Now we prove (73). From (49) (or (58)) we have

Applying the inductive hypotheses (73), (74), we conclude

bounding one of the 1rα\frac{1}{r_{\alpha}} factors crudely by LL and then summing using (71) we obtain (73) as desired.

Now we prove (75). From (49) (or (59)) we have

Using the inductive hypotheses (74), (75), we obtain

Bounding one of the 1rγ\frac{1}{r_{\gamma}} factors crudely by LL and applying (71) we obtain (75) as desired.

Finally, we prove (74). Since Pα(∇kPi)PiP_{\alpha}(\nabla^{k}P_{i})P_{i} has the same Frobenius norm as its adjoint Pi(∇kPi)PαP_{i}(\nabla^{k}P_{i})P_{\alpha}, it suffices to bound ∥Pα(∇kPi)Pi∥F\|P_{\alpha}(\nabla^{k}P_{i})P_{i}\|_{F}. From (49) we have

From the inductive hypotheses (72), (74) and crudely bounding 1rα\frac{1}{r_{\alpha}} by LL, we have

and using (70) and the inductive hypothesis (74) we have

Applying (71) we obtain (74) as required.

Having proven (72)-(75) for all k≥1k\geq 1, we now prove (76)-(78) by induction. The claim is easily verified for k=0k=0 (note that the left-hand side of (76) and (77) in fact vanishes, as does the left-hand side of (78) unless α=β\alpha=\beta), so suppose k≥1k\geq 1 and that (76)-(78) has been proven for smaller values of kk.

Applying (73), (74) and the induction hypotheses (76), (77) we conclude

crudely bounding one of the 1rα\frac{1}{r_{\alpha}} factors by LL and using (71) we obtain the claim.

Similarly, to prove (77), we apply (50) as before to obtain

applying (73), (74) and the induction hypotheses (77), (78) we conclude

Again, bounding one of the 1rβ\frac{1}{r_{\beta}} factors by LL and using (71) we obtain the claim.

Finally, we prove (78). From (51) we have

As RiPβ=PβRiPβR_{i}P_{\beta}=P_{\beta}R_{i}P_{\beta} has a norm of at most 1rβ\frac{1}{r_{\beta}}, we conclude

From (72), the crude bound 1rβ≤L\frac{1}{r_{\beta}}\leq L, and the induction hypothesis (78) we have

From (75) and 1rβ≤L\frac{1}{r_{\beta}}\leq L we similarly have

and using the induction hypothesis (77), (78) and (70), we obtain

Putting all this together we obtain (78) as claimed. ∎

We extract a special case of the above lemma, in which the perturbation only affects a single entry (and its transpose):

Let A=A(z)A=A(z) be an n×nn\times n matrix depending on a complex parameter zz of the form

for some vectors ep,eqe_{p},e_{q}. Let 1≤i≤n1\leq i\leq n. At some fixed value of zz, suppose that λi=λi(A(z))\lambda_{i}=\lambda_{i}(A(z)) is a simple eigenvalue, and that we have a partition

where JJ is a finite index set, and PαP_{\alpha} are orthogonal projections to invariant spaces on AA (i.e. to spans of eigenvectors not corresponding to λi\lambda_{i}). Suppose that on the range of each PαP_{\alpha}, the eigenvalues of A−λiA-\lambda_{i} have magnitude at least rαr_{\alpha} for some rα>0r_{\alpha}>0. Suppose also that we have the incompressibility bounds

for all α∈J∪{i}\alpha\in J\cup\{i\} and some w>0w>0 and dα≥1d_{\alpha}\geq 1. Then at this value of zz, and for all k≥1k\geq 1, we have

A short computation shows that the hypotheses of Lemma 57 are obeyed with vv replaced by O(w2)O(w^{2}), cαc_{\alpha} set equal to dα1/2d_{\alpha}^{1/2}, and LL equal to O(∑α∈Jdαrα)O(\sum_{\alpha\in J}\frac{d_{\alpha}}{r_{\alpha}}). From (72) we then conclude (79). As for (80), we see from the product rule that

which we can split further using Cauchy-Schwarz as

Bounding one of the factors of 1rα\frac{1}{r_{\alpha}} in the first sum by LL, and 1rαrβ\frac{1}{r_{\alpha}r_{\beta}} in the second sum by L2L^{2}, and using (71) and the choices for vv and LL, we obtain the claim. ∎

3. Conclusion of the argument

We can now prove Proposition 46. Fix k≥1k\geq 1, r=2,3,4r=2,3,4 and ε1>0{\varepsilon}_{1}>0, and suppose that C1C_{1} is sufficiently large. We assume A(0),ep,eq,i1,…,ik,G,F,ζ,ζ′A(0),e_{p},e_{q},i_{1},\ldots,i_{k},G,F,\zeta,\zeta^{\prime} are as in the proposition.

We may of course assume that F(z0)≠0F(z_{0})\neq 0 for at least one z0z_{0} with ∣z0∣≤n1/2+ε1|z_{0}|\leq n^{1/2+{\varepsilon}_{1}}, since the claim is vacuous otherwise.

for all ∣z∣≤n1/2+ε1|z|\leq n^{1/2+{\varepsilon}_{1}} and 0≤m≤50\leq m\leq 5. Then by Taylor expansion, one has

where PP is a polynomial of degree at most rr whose coefficients are of size at most nO(ε1)n^{O({\varepsilon}_{1})}. Taking expectations for both F(ζ)F(\zeta) and F(ζ′)F(\zeta^{\prime}), we obtain the claim (34) when ζ,ζ′\zeta,\zeta^{\prime}. A similar argument gives the improved version of (34) at the end of Proposition 46 if one can improve the right-hand side of (81) to O(n−m−C′mε1)O(n^{-m-C^{\prime}m{\varepsilon}_{1}}) for some sufficiently large absolute constant C1′C^{\prime}_{1}.

It remains to show (81). By up to five applications of the chain rule, the above claims follow from

Suppose that F(z0)≠0F(z_{0})\neq 0 for at least one z0z_{0} with ∣z0∣≤n1/2+ε1|z_{0}|\leq n^{1/2+{\varepsilon}_{1}}. Then for all zz with ∣z0∣≤n1/2+ε1|z_{0}|\leq n^{1/2+{\varepsilon}_{1}}, and all 1≤j≤k1\leq j\leq k, we have

for all zz with ∣z∣≤n1/2+ε1|z|\leq n^{1/2+{\varepsilon}_{1}} and all 0≤k≤100\leq k\leq 10.

For a technical reason having to do with a subsequent iteration argument, we will replace (82) with the slightly weaker bound

By the definition of QiQ_{i}, we have, as a consequence, that

By the Weyl inequalities (23), we thus have

whenever ∣z−z0∣≪n−1−2ε1|z-z_{0}|\ll n^{-1-2{\varepsilon}_{1}}. From Lemma 56, we conclude that

for all m≥1m\geq 1, whenever ∣z−z0∣≪n−1−2ε1|z-z_{0}|\ll n^{-1-2{\varepsilon}_{1}}. In particular, from (83) and the fundamental theorem of calculus we have

Note that by setting C1C_{1} sufficiently large, we can find zz such that ∣z−z0∣≪n−1−2ε1|z-z_{0}|\ll n^{-1-2{\varepsilon}_{1}}, ∣z∣≤n1/2+ε1|z|\leq n^{1/2+{\varepsilon}_{1}}, and that the real and imaginary parts of zz are integer multiples of n−C1n^{-C_{1}}. Then (32), (33) holds for this value of zz. Applying Corollary 58 we conclude that

for all k≥1k\geq 1, where rαr_{\alpha} is the minimal value of ∣λi−λij∣|\lambda_{i}-\lambda_{i_{j}}| for ∣i−ij∣≥2α|i-i_{j}|\geq 2^{\alpha}. Note that

while from (31) we have (with room to spare)

for all k≥1k\geq 1. Combining this with (85), (86) we conclude that

for all zz with ∣z−z0∣≪n−1+ε1|z-z_{0}|\ll n^{-1+{\varepsilon}_{1}}, and 0≤k≤100\leq k\leq 10.

This establishes the lemma in a ball B(z0,n−1−2ε1)B(z_{0},n^{-1-2{\varepsilon}_{1}}) of radius n−1−2ε1n^{-1-2{\varepsilon}_{1}} centered at z0z_{0}. To extend the result to the remainder of the region {z:∣z∣≤n1/2+ε1}\{z:|z|\leq n^{1/2+{\varepsilon}_{1}}\}, we observe from (88) that QijQ_{i_{j}} varies by at most O(n−1.9)O(n^{-1.9}) (say) on this ball (instead of 1.91.9 we can write any constant less than 22, given that ε1{\varepsilon}_{1} is sufficiently small). Because of the gap between (82) and (83), we now see that (83) continues to hold for all other points z1z_{1} in B(z0,n−1−2ε1)B(z_{0},n^{-1-2{\varepsilon}_{1}}) with ∣z1∣≤n1/2+ε1|z_{1}|\leq n^{1/2+{\varepsilon}_{1}}. Repeating the above arguments with z0z_{0} replaced by z1z_{1}, and continuing this process, we can eventually cover the entire ball {z:∣z∣≤n1/2+ε1}\{z:|z|\leq n^{1/2+{\varepsilon}_{1}}\} by these estimates. The key point here is that at every point of the process (83) holds, since the length of the process is only n3/2+3ε1n^{3/2+3{\varepsilon}_{1}} while in each step the value of QijQ_{i_{j}} changes by at most O(n−1.99)O(n^{-1.99}). ∎

The proof of Proposition 46 is now complete.

Good configurations occur frequently

The purpose of this section is to prove Proposition 48. The arguments here are largely based on those in .

We will first reduce matters to the following concentration estimate for the empirical spectral distribution:

For any ε,δ>0{\varepsilon},\delta>0 and any random Hermitian matrix Mn=(ζij)1≤i,j≤nM_{n}=(\zeta_{ij})_{1\leq i,j\leq n} whose upper-triangular entries are independent with mean zero and variance 11, and such that ∣ζij∣≤K|\zeta_{ij}|\leq K almost surely for all i,ji,j and some 1≤K≤n1/2−ε1\leq K\leq n^{1/2-{\varepsilon}}, and any interval II in [−2+ε,2−ε][-2+{\varepsilon},2-{\varepsilon}] of width ∣I∣≥K2log⁡20nn|I|\geq\frac{K^{2}\log^{20}n}{n}, the number of eigenvalues NIN_{I} of Wn:=1nMnW_{n}:=\frac{1}{\sqrt{n}}M_{n} in II obeys the concentration estimate

with overwhelming probability. In particular, NI=Θε(n∣I∣)N_{I}=\Theta_{\varepsilon}(n|I|) with overwhelming probability.

Similar results were established in assuming stronger regularity hypotheses on the ζij\zeta_{ij}. The proof of this result follows their approach, but also uses Lemma 43 and few other ideas which make the current more general setting possible. In our applications we will take K=log⁡O(1)nK=\log^{O(1)}n, though Theorem 60 also has non-trivial content for larger values of KK. The loss of K2log⁡20nK^{2}\log^{20}n can certainly be improved, though for our applications any bound which is polylogarithmic for K=log⁡O(1)nK=\log^{O(1)}n will suffice.

Let us assume Theorem 60 for the moment. We can then conclude a useful bound on eigenvectors (which will also be applied to prove Theorem 19):

Let ε,Mn,Wn,ζij,K{\varepsilon},M_{n},W_{n},\zeta_{ij},K be as in Theorem 60. Then for any 1≤i≤n1\leq i\leq n with λi(Wn)∈[−2+ε,2−ε]\lambda_{i}(W_{n})\in[-2+{\varepsilon},2-{\varepsilon}], if ui(Wn)u_{i}(W_{n}) denotes a unit eigenvector corresponding to λi(Wn)\lambda_{i}(W_{n}), then with overwhelming probability each coordinate of ui(Mn)u_{i}(M_{n}) is Oε(K2log⁡20nn1/2)O_{{\varepsilon}}(\frac{K^{2}\log^{20}n}{n^{1/2}}).

By symmetry and the union bound, it suffices to establish this for the first coordinate of ui(Wn)u_{i}(W_{n}). By Lemma 41, it suffices to establish a lower bound

with overwhelming probability. The left-hand side can be written as ∥πHX∥2\|\pi_{H}X\|^{2}, where HH is the span of all the eigenvectors associated to JJ. The claim now follows from Lemma 43. ∎

We also have the following minor variant:

The conclusions of Theorem 60 and Proposition 62 continues to hold if one replaces a single diagonal entry ζpp\zeta_{pp} of MnM_{n} by a deterministic real number x=O(K)x=O(K), or if one replaces a single off-diagonal entry ζpq\zeta_{pq} of MnM_{n} by a deterministic complex number z=O(K)z=O(K) (and also replaces ζqp\zeta_{qp} with z‾\overline{z}).

After the indicated replacement, the new matrix Mn′M^{\prime}_{n} differs from the original matrix by a Hermitian matrix of rank at most 22. The modification of Theorem 60 then follows from Theorem 60 and Lemma 39. The modification of Proposition 62 then follows by repeating the proof. (One of the coefficients of XX might now be deterministic rather than random, but it is easy to see that this does not significantly impact Lemma 43.) ∎

Now we can prove Proposition 48. Let ε,ε1,C,C1,k,i1,…,ik,p,q,A(0){\varepsilon},{\varepsilon}_{1},C,C_{1},k,i_{1},\ldots,i_{k},p,q,A(0) be as in that proposition. By the union bound we may fix 1≤j≤k1\leq j\leq k, and also fix the ∣z∣≤n1/2+ε1|z|\leq n^{1/2+{\varepsilon}_{1}} whose real and imaginary parts are multiples of n−C1n^{-C_{1}}. By the union bound again and Corollary 63 (with K=log⁡CnK=\log^{C}n), the eigenvalue separation condition (31) holds with overwhelming probability for every 1≤i≤n1\leq i\leq n with ∣i−j∣≥nε1|i-j|\geq n^{{\varepsilon}_{1}}, as does (32) (note that ∥Pij(A(z))ep∥\|P_{i_{j}}(A(z))e_{p}\| is the magnitude of the pthp^{th} coordinate of a unit eigenvector uij(A(z))u_{i_{j}}(A(z)) of A(z)A(z)). A similar argument using Pythagoras’ theorem gives (33) with overwhelming probability, unless the eigenvalues λi(A(z))\lambda_{i}(A(z)) contributing to (33) are not contained in the bulk region [(−2+ε′)n,(2−ε′)n][(-2+{\varepsilon}^{\prime})n,(2-{\varepsilon}^{\prime})n] for some ε′>0{\varepsilon}^{\prime}>0 independent of nn. However, it is known (see ; one can also deduce this fact from Theorem 60) that λi(A(z))\lambda_{i}(A(z)) will fall in this bulk region with overwhelming probability whenever ε2n≤i≤(1−ε2)n\frac{{\varepsilon}}{2}n\leq i\leq(1-\frac{{\varepsilon}}{2})n (say), if ε′{\varepsilon}^{\prime} is small enough depending on ε{\varepsilon}. Thus, with overwhelming probability, a contribution outside the bulk region can only occur if 2α≫εn2^{\alpha}\gg_{\varepsilon}n, in which case the claim follows by estimating ∥Pij,α(A(z))ep∥\|P_{i_{j},\alpha}(A(z))e_{p}\| crudely by ∥ep∥=1\|e_{p}\|=1, and similarly for ∥Pij,α(A(z))eq∥\|P_{i_{j},\alpha}(A(z))e_{q}\|. This concludes the proof of Proposition 48 assuming Theorem 60.

2. Spectral concentration

Following , we consider the Stieltjes transform

of WnW_{n}, together with its semicircular counterpart

(which was computed explicitly in (107)). We will primarily be interested in the imaginary part

of the Stieltjes transform in the upper half-plane η>0\eta>0.

It is well known that the convergence of the empirical spectral distribution of WnW_{n} to ρsc(x)\rho_{sc}(x) is closely tied to the convergence of sns_{n} to ss (see , for example). In particular, we have the following precise connection (cf. [17, Corollary 4.2]), whose proof is deferred to Appendix C.

Let 1/10≥η≥1/n1/10\geq\eta\geq 1/n, and L,ε,δ>0L,{\varepsilon},\delta>0. Suppose that one has the bound

with (uniformly) overwhelming probability for all zz with ∣Re⁡(z)∣≤L|{\operatorname{Re}}(z)|\leq L and Im⁡(z)≥η{\operatorname{Im}}(z)\geq\eta. Then for any interval II in [−L+ε,L−ε][-L+{\varepsilon},L-{\varepsilon}] with ∣I∣≥max⁡(2η,ηδlog⁡1δ)|I|\geq\max(2\eta,\frac{\eta}{\delta}\log\frac{1}{\delta}), one has

In view of this lemma, it suffices to show that for each complex number zz with Re⁡(z)≤2−ε/2{\operatorname{Re}}(z)\leq 2-{\varepsilon}/2 and Im⁡(z)≥η:=K2log⁡19nn{\operatorname{Im}}(z)\geq\eta:=\frac{K^{2}\log^{19}n}{n}, one has

with (uniformly) overwhelming probability.

Fix zz as above. From (107), s(z)s(z) is the unique solution to the equation

with Im⁡s(z)>0{\operatorname{Im}}s(z)>0. The strategy is then to obtain a similar equation for sn(z)s_{n}(z) (note that one automatically has Im⁡(sn(z))>0{\operatorname{Im}}(s_{n}(z))>0).

Wn,kW_{n,k} is the matrix WnW_{n} with the kthk^{th} row and column removed, and aka_{k} is the kthk^{th} row of WnW_{n} with the kthk^{th} element removed.

The entries of aka_{k} are independent of each other and of Wn,kW_{n,k}, and have mean zero and variance 1n\frac{1}{n}. By linearity of expectation we thus have, on conditioning on Wn,kW_{n,k}

is the Stieltjes transform of Wn,kW_{n,k}. From the Cauchy interlacing law (24) we have

We now claim that a similar estimate holds for YkY_{k} itself:

For each 1≤k≤n1\leq k\leq n, one has Yk=sn(z)+O(1log⁡n)Y_{k}=s_{n}(z)+O(\frac{1}{\log n}) with overwhelming probability.

Assume this proposition for the moment. By hypothesis, 1nζkk≤K/n≤n−ε\frac{1}{\sqrt{n}}\zeta_{kk}\leq K/\sqrt{n}\leq n^{-{\varepsilon}} almost surely. Inserting these bounds into (92), we see that

with overwhelming probability (compare with (91)). This implies that with overwhelming probability either sn(z)=s(z)+o(1)s_{n}(z)=s(z)+o(1) or that sn(z)=−z+o(1)s_{n}(z)=-z+o(1). On the other hand, as Im⁡sn(z){\operatorname{Im}}s_{n}(z) is necessarily positive, the second possibility can only occur when Im⁡z=o(1){\operatorname{Im}}z=o(1). A continuity argument (as in ) then shows that the second possibility cannot occur at all (note that s(z)s(z) stays a fixed distance away from −z-z for zz in a compact set) and the claim follows.

3. A preliminary concentration bound

It remains to prove Proposition 65. We begin with a preliminary bound (cf. [19, Theorem 5.1]):

The proof, which follows the arguments from , but using Lemma 43 to simplify things somewhat, is presented in Appendix C.

Now we prove Proposition 65. Fix kk, and write z=x+−1ηz=x+\sqrt{-1}\eta. From (93) it suffices to show that

with overwhelming probability. Decomposing YkY_{k} as in (114), it thus suffices to show that

with overwhelming probability, where Rj:=∣uj(Wn,k)∗ak∣2−1/nR_{j}:=|u_{j}(W_{n,k})^{*}a_{k}|^{2}-1/n.

where HH is the space spanned by the uj(Wn,k)∗u_{j}(W_{n,k})^{*} for i−≤j≤i+i_{-}\leq j\leq i_{+}. From Lemma 43 and the union bound, we conclude that with overwhelming probability

By the triangle inequality, this implies that

and hence by a further application of the triangle inequality

Since η≥K2log⁡19n/n\eta\geq K^{2}\log^{19}n/n, the bound (95) (together with Proposition 66) already lets one dispose of the contribution to (94) where ∣λj(Wn,k)−x∣≤K2log⁡10n/n|\lambda_{j}(W_{n,k})-x|\leq K^{2}\log^{10}n/n. For the remaining contributions, we subdivide into O(log⁡3n)O(\log^{3}n) intervals {j:i−≤j≤i+}\{j:i_{-}\leq j\leq i_{+}\} such that in each interval a≤∣λj(Wn,k)−x∣≤(1+1log⁡2n)aa\leq|\lambda_{j}(W_{n,k})-x|\leq(1+\frac{1}{\log^{2}n})a for some a≥K2log⁡10n/na\geq K^{2}\log^{10}n/n (the value of aa varies from interval to interval). For each such interval, the function 1λj(Wn,k)−(x+−1η)\frac{1}{\lambda_{j}(W_{n,k})-(x+\sqrt{-1}\eta)} has magnitude O(1a)O(\frac{1}{a}) and fluctuates by at most O(1alog⁡2n)O(\frac{1}{a\log^{2}n}) as jj ranges over the interval. From (95), (96) we conclude

with overwhelming probability. By Proposition 66, i+−i−≪ani_{+}-i_{-}\ll an with overwhelming probability. Thus we have

with overwhelming probability. Summing over the values of aa (taking into account the lower bound aa) we obtain (94) as desired.

Propagation of narrow spectral gaps

We now prove Lemma 51. Fix i0,l,ni_{0},l,n. Assume for contradiction that all of the conclusions fail. We will always assume that n0n_{0} (and hence nn) is sufficiently large.

By (37), we can find 1≤i−≤i0−l<i0≤i+≤n+11\leq i_{-}\leq i_{0}-l<i_{0}\leq i_{+}\leq n+1 such that

If i+−i−≥log⁡C1/2ni_{+}-i_{-}\geq\log^{C_{1}/2}n, then conclusion (i) holds (for nn large enough), so we may assume that

We now study the eigenvalue equation (25) for i=i−i=i_{-}, which we rearrange as

On the other hand, since conclusions (iii), (iv) fail, we have

thanks to the bounds i+−i−≥1i_{+}-i_{-}\geq 1, (41) and (99). By the triangle inequality, we thus have

Note that all the summands on the left-hand side are non-negative. By a dyadic partition and the pigeonhole principle (using the convergence of the series 1/l21/l^{2}), we can thus find k≥1k\geq 1 such that

Let’s first suppose that 2k−1≥log⁡C1/2n2^{k-1}\geq\log^{C_{1}/2}n. Then by the failure of conclusion (i), we have

for all jj in the summation in (100), and thus (by (41), (99) and the trivial bounds i+−i−≥1i_{+}-i_{-}\geq 1 and k=O(log⁡n)k=O(\log n))

On the other hand, from the failure of conclusion (v), we have

for εn/10≤j≤(1−ε/10)n{\varepsilon}n/10\leq j\leq(1-{\varepsilon}/10)n. This already contradicts (101) when the range of summation in (101) is contained in the bulk region εn/10≤j≤(1−ε/10)n{\varepsilon}n/10\leq j\leq(1-{\varepsilon}/10)n. The only remaining case is when (101) approaches the edge, which only occurs when 2k≫εn2^{k}\gg{\varepsilon}n. But in this case we note from Pythagoras’ theorem and the failure of conclusion (vi) that

leading again to a contradiction with (101). We may therefore assume that 2k−1<log⁡C1/2n2^{k-1}<\log^{C_{1}/2}n, thus k=O(C1log⁡log⁡n)k=O(C_{1}\log\log n).

By the failure of conclusion (vii), we now have ∣uj(An)∗Xn∣2≪2m/2nlog⁡0.8n|u_{j}(A_{n})^{*}X_{n}|^{2}\ll 2^{m/2}n\log^{0.8}n for all jj in the summation in (100); we conclude that

If we set i−−:=i−−2k−1i_{--}:=i_{-}-2^{k-1}, we conclude that 0<i−−i−−<log⁡C1/2n0<i_{-}-i_{--}<\log^{C_{1}/2}n and

An analogous argument, starting with i=i+i=i_{+} in (25) instead of i=i−i=i_{-} and reflecting all the indices, allows us to find i++i_{++} with 0≤i++−i+<log⁡C1/2n0\leq i_{++}-i_{+}<\log^{C_{1}/2}n such that

where α:=i++−i−−i+−i−−1\alpha:=\frac{i_{++}-i_{--}}{i_{+}-i_{-}}-1. Note that (1+α)(i+−i−)=i++−i−−≤log⁡C1N(1+\alpha)(i_{+}-i_{-})=i_{++}-i_{--}\leq\log^{C_{1}}N, and so by (37), (40)

Combining this with (103), (98) we conclude that

But this contradicts the elementary estimate (1+α)x≥1+xα(1+\alpha)^{x}\geq 1+x\alpha for α>0\alpha>0 and x≥1x\geq 1, and Lemma 51 follows.

Bad events are rare

We now prove Proposition 53. Let the notation and assumptions be as in that proposition.

We first prove (a). The truncation assumption (27) ensures that the events (iii), (v), (vi) from Proposition 51 are empty for nn large enough. The event (i) fails with overwhelming probability thanks to Theorem 60. The event (iv) fails with overwhelming probability because of the well-known fact that the operator norm of AnA_{n} is O(n)O(n) with overwhelming probability (see e.g. ; there are many proofs, for instance one can start by observing that ∥An∥op≤2sup⁡x∥Anx∥\|A_{n}\|_{op}\leq 2\sup_{x}\|A_{n}x\|, where xx ranges over a 1/21/2-net of the unit ball, and use the union bound followed by a standard concentration of measure result, such as the Chernoff inequality). This concludes the proof of (a).

Now we prove (b) and (c) jointly. By (27) and Proposition 62 we can find C′C^{\prime} such that all the coefficients of the eigenvectors uj(An)u_{j}(A_{n}) for εn/2≤j≤(1−ε/2)n{\varepsilon}n/2\leq j\leq(1-{\varepsilon}/2)n are of magnitude at most n−1/2log⁡C′nn^{-1/2}\log^{C^{\prime}}n with overwhelming probability.

Let us first consider (vii), in which we will be able to obtain the better upper bound of 2−κm2−2C1n2^{-\kappa m}2^{-2C_{1}n} for the conditional probability of occurrence (thus establishing (b) and (c) simultaneously for (vii)). If 2m≥log⁡C3n2^{m}\geq\log^{C_{3}}n for some sufficiently large C3C_{3}, then the desired bound comes from (27) and Lemma 43. (In fact, the Chernoff bound would suffice as well, and the event fails with overwhelming probability.) Now suppose instead that 2m≤log⁡O(1)n2^{m}\leq\log^{O(1)}n. We wish to show that

and wi,1,…,wi,nw_{i,1},\ldots,w_{i,n} are the coefficients of ui(An)u_{i}(A_{n}), which by hypothesis have magnitude O(n−1/2log⁡C′n)O(n^{-1/2}\log^{C^{\prime}}n) and square-sum to 11.

Observe that SiS_{i} has mean zero and variance 11. Applying Theorem 44 and (27), we conclude that

for any t≥1t\geq 1 and some absolute constant c>0c>0, which easily yields (104) in the range 2m≤log⁡O(1)n2^{m}\leq\log^{O(1)}n.

The consideration of (ii) is similar. Write the left-hand side of (42) as ∥πH(Xn)∥\|\pi_{H}(X_{n})\|, where HH is the span of the uj(An)u_{j}(A_{n}) for i−≤j<i+i_{-}\leq j<i_{+}. Applying (27) and Lemma 43 we obtain the claim when i+−i−≥log⁡C3ni_{+}-i_{-}\geq\log^{C_{3}}n for sufficiently large c3c_{3} (in fact (ii) now fails with overwhelming probability), so we may assume instead that i+−i−≤log⁡O(1)ni_{+}-i_{-}\leq\log^{O(1)}n. In this case, the event (ii) can now be expressed as

From the orthonormality of the ui(An)u_{i}(A_{n}), we see that S⃗\vec{S} has mean zero and has covariance matrix equal to the identity. Applying Theorem 44 again, we see that

Applying this with t:=(i+−i−)1/22m/4log⁡0.005nt:=\frac{(i_{+}-i_{-})^{1/2}}{2^{m/4}\log^{0.005}n} and using the fact that i+−i−≥l≥C2i_{+}-i_{-}\geq l\geq C_{2} by hypothesis, one concludes that (106) occurs with probability

which proves the claim as long as C2C_{2} is large and 2m≤n1/1002^{m}\leq n^{1/100}. But the case 2m≥n1/1002^{m}\geq n^{1/100} then follows by noting that the probability of the event (106) is non-increasing in mm. The proof of Proposition 53 is now complete.

Appendix A Concentration of determinant

(which can be verified for instance by applying contour integration to a branch cut of (4−z2)1/2log⁡z(4-z^{2})^{1/2}\log z around the slit $$; see also Remark 67 below) and Stirling’s formula, it suffices to prove the latter claim.

Fix zz; we allow implied constants to depend on zz. We of course have

asymptotically almost surely for some c>0c>0. Making the change of variables y=t(x)y=t(x), where tt is defined in (3), it suffices to show that

asymptotically almost surely for some c>0c>0.

From Theorem 11 (with k=1k=1) we have inf⁡j∣λj(Wn)−z∣≥n−2\inf_{j}|\lambda_{j}(W_{n})-z|\geq n^{-2} (say) asymptotically almost surely (because the expected number of eigenvalues in the interval [z−n−2,z+n−2][z-n^{-2},z+n^{-2}] is o(1)o(1)). From this (and (4)) we conclude that sup⁡jlog⁡∣λj(Wn)−z∣=O(log⁡n)\sup_{j}\log|\lambda_{j}(W_{n})-z|=O(\log n) asymptotically almost surely. Thus, the contribution of all jj with ∣t(jn)−Re⁡z∣≤n−ε\left|t\left(\frac{j}{n}\right)-{\operatorname{Re}}z\right|\leq n^{-{\varepsilon}} will be negligible for any fixed ε>0{\varepsilon}>0, and it suffices to show that

By (2) we see that with probability 1−o(1)1-o(1), one has λj(Wn)=t(jn)+O(n−δ)\lambda_{j}(W_{n})=t\left(\frac{j}{n}\right)+O(n^{-\delta}) for all 1≤j≤n1\leq j\leq n and some absolute constant δ>0\delta>0, where −2≤t(a)≤2-2\leq t(a)\leq 2 is defined by (3). By Taylor expansion, we thus have asymptotically almost surely that

(say) for all 1≤j≤n1\leq j\leq n with ∣t(jn)−Re⁡z∣>n1−ε\left|t\left(\frac{j}{n}\right)-{\operatorname{Re}}z\right|>n^{1-{\varepsilon}}, if ε{\varepsilon} is chosen sufficiently small depending on δ\delta. The claim then follows (for ε{\varepsilon} small enough) by approximating ∫01log⁡∣t(x)−z∣ dx\int_{0}^{1}\log|t(x)-z|\ dx by its Riemann integral away from the possible singularity at Re⁡z{\operatorname{Re}}z.

The logarithmic potential ∫−22log⁡∣y−z∣ρsc(y) dy\int_{-2}^{2}\log|y-z|\rho_{sc}(y)\ dy for the semicircular distribution can be computed explicitly as

where z2−4\sqrt{z^{2}-4} is the branch of the square root of z2−4z^{2}-4 with cut at $whichisasymptotictowhich is asymptotic toz$ at infinity; this can be seen by integrating the formula

for the Stieltjes formula for the semicircular potential, which can be easily verified by the Cauchy integral formula.

Appendix B The distance between a random vector and a subspace

The prupose of this appendix is to prove Lemma 43. We restate this lemma for the reader’s convenience.

It is easy to show that E∥πH(X)∥2=d{\mathbf{E}}\|\pi_{H}(X)\|^{2}=d, so it is indeed natural to expect that with high probability πH(X)\pi_{H}(X) is around d\sqrt{d}.

In a previous paper , the authors proved Lemma 68 for the special case when ξi\xi_{i} are Bernoulli random variables (taking value ±1\pm 1 with probability half). This proof is a simple generalization of one in (see also [46, Appendix E]). We use the following theorem, which is a consequence of Talagrand’s inequality (see [46, Theorem E.2] or ).

In fact, the results still holds for the space D1×⋯×Dn{\mathbf{D}}_{1}\times\dots\times{\mathbf{D}}_{n} where Di{\mathbf{D}}_{i} are complex region with diameter 22.

An easy change of variables reveals the following generalization of this inequality: if μ\mu is supported on a dilate K⋅DnK\cdot{\mathbf{D}}^{n} of the unit disk for some K>0K>0, rather than Dn{\mathbf{D}}^{n} itself, then for every r>0r>0 we have

In what follows, we assume that K≥g(n)K\geq g(n), where g(n)g(n) is tending (arbitrarily slowly) to infinity with nn. The map X→∣πH(X)∣X\rightarrow|\pi_{H}(X)| is clearly convex and 11-Lipschitz. Applying (108) we conclude that

for any t>0t>0. To conclude the proof, it suffices to show that

Let P=(pjk)1≤j,k≤nP=(p_{jk})_{1\leq j,k\leq n} be the n×nn\times n orthogonal projection matrix onto HH. We have that trace⁡P2=trace⁡P=∑ipii=d\operatorname{trace}P^{2}=\operatorname{trace}P=\sum_{i}p_{ii}=d and ∣pii∣≤1|p_{ii}|\leq 1. Furthermore,

Consider the event E+{\mathcal{E}}_{+} that ∣πH(X)∣≥d+2K|\pi_{H}(X)|\geq\sqrt{d}+2K. Since this implies ∣πH(X)∣2≥d+4dK+4K2|\pi_{H}(X)|^{2}\geq d+4\sqrt{d}K+4K^{2}, we have

Let S1:=∑i=1npii(∣ξi∣2−1)S_{1}:=\sum_{i=1}^{n}p_{ii}(|\xi_{i}|^{2}-1), then we have by Chebyshev’s inequality

On the other hand, by the assumption on KK

Similarly, set S2:=∣∑i≠jpijξiξ‾∣.S_{2}:=|\sum_{i\neq j}p_{ij}\xi_{i}\overline{\xi}|. We have ES22=∑i≠j∣pij∣2≤d.{\mathbf{E}}S_{2}^{2}=\sum_{i\neq j}|p_{ij}|^{2}\leq d. So again by Chebyshev’s inequality

It follows that P(E+)≤1/5{\mathbf{P}}({\mathcal{E}}_{+})\leq 1/5 and so M(∥πH(X)∥)≤d+2KM(\|\pi_{H}(X)\|)\leq\sqrt{d}+2K. To prove the lower bound, let E−{\mathcal{E}}_{-} be the event that ∥πH(X)∥≤d−2K\|\pi_{H}(X)\|\leq\sqrt{d}-2K and notice that

Both terms on the RHS can be bounded by 1/51/5 by the same argument as above. The proof is complete.

Appendix C Controlling the spectral density by the Stieltjes transform

In this appendix we establish Lemma 64 and Proposition 66.

(Proof of Lemma 64.) From (90) we see that with overwhelming probability, one has

for all −L≤x≤L-L\leq x\leq L which are multiples of n−100n^{-100} (say). From (89) one concludes that

whenever I⊂[−L,L]I\subset[-L,L] is an interval of length ∣I∣=η|I|=\eta. Summing in II, we thus obtain the bound

with overwhelming probability whenever I⊂[−L,L]I\subset[-L,L] has length ∣I∣≥η|I|\geq\eta. (One could also invoke Proposition 66 for this step.)

Next, let I⊂[−L+ε,L−ε]I\subset[-L+{\varepsilon},L-{\varepsilon}] be such that ∣I∣≥2η|I|\geq 2\eta, and consider the function

where the sum ranges over all x∈Ix\in I that are multiples of n−100n^{-100}. Observe that

With overwhelming probability, we have sn(x+−1η)=s(x+−1η)+O(δ)s_{n}(x+\sqrt{-1}\eta)=s(x+\sqrt{-1}\eta)+O(\delta) for all xx in the sum by hypothesis, and hence

On the other hand, from Riemann integration one sees that

(say). One can then establish the pointwise bounds

when y∉Iy\not\in I and dist⁡(y,I)≤∣I∣\operatorname{dist}(y,I)\leq|I|,

when y∉Iy\not\in I and dist⁡(y,I)>∣I∣\operatorname{dist}(y,I)>|I|, and (since ηπ(η2+∣y−x∣2)\frac{\eta}{\pi(\eta^{2}+|y-x|^{2})} has integral 11) in the remaining case

and a similar argument using Riemann integration and (111) (as well as the trivial bound NJ≤nN_{J}\leq n when JJ lies outside [−L,L][-L,L]) gives

Putting all this together, we conclude that

The latter error term can be absorbed into the former since ∣I∣≥ηδlog⁡1δ|I|\geq\frac{\eta}{\delta}\log\frac{1}{\delta}, and the claim follows. ∎

(Proof of Lemma 66) By the union bound it suffices to show this for ∣I∣=η:=K2log⁡2nn|I|=\eta:=\frac{K^{2}\log^{2}n}{n}. Let xx be the center of II, then by (89) it suffices to show that the event that

for some large absolute constant CC, fails with overwhelming probability.

Suppose that we have both (112) and (113). By (92) we have

using the crude bound ∣Im⁡1z∣≤1∣Im⁡z∣|{\operatorname{Im}}\frac{1}{z}|\leq\frac{1}{|{\operatorname{Im}}z|}, we conclude

On the other hand, by writing Wn,kW_{n,k} in terms of an orthonormal basis uj(Wn,k)u_{j}(W_{n,k}) of eigenfunctions, one sees that

On the other hand, from (112) we can find 1≤i−<i+≤n1\leq i_{-}<i_{+}\leq n with i+−i−≥ηni_{+}-i_{-}\geq\eta n such that λi(Wn)∈I\lambda_{i}(W_{n})\in I for all i−≤i≤i+i_{-}\leq i\leq i_{+}; by the Cauchy interlacing property (24) we thus have λi(Wn,k)∈I\lambda_{i}(W_{n,k})\in I for i−≤i<i+i_{-}\leq i<i_{+}. We conclude that

where PHkP_{H_{k}} is the orthogonal projection to the i+−i−i_{+}-i_{-}-dimensional space HkH_{k} spanned by the eigenvectors uj(Wn,k)u_{j}(W_{n,k}) for i−≤j<i+i_{-}\leq j<i_{+}. Putting all this together, we conclude that

On the other hand, from Lemma 68 we see that ∥PHkak∥2=O(η)\|P_{H_{k}}a_{k}\|^{2}=O(\eta) with overwhelming probability. (One has to take the union bound over all possible choices of i−,i+i_{-},i_{+}, but there are only O(n2)O(n^{2}) such choices at most, so this is not a problem.) The claim then follows by taking CC sufficiently large. ∎

Appendix D A multidimensional Berry-Esséen theorem

In this section, we prove Theorem 44. We will need the following multidimensional Berry-Esséen theorem, which is a generalisation of [46, Proposition D.2].

We obtain the result by repeating the proof of [46, Proposition D.2] with some proper modification. For the readers convenience, we present all details.

It suffices to prove (117), as (118) follows by replacing Ω\Omega with its complement.

where 1Ω1_{\Omega} is the indicator function of Ω\Omega. Observe that ff equals 11 on Ω\∂εΩ\Omega\backslash\partial_{\varepsilon}\Omega, vanishes outside of Ω∪∂εΩ\Omega\cup\partial_{\varepsilon}\Omega, and is smoothly varying between and 11 on ∂εΩ\partial_{\varepsilon}\Omega. Thus it will suffice to show that

We now use a Lindeberg replacement trick (cf. ). For each 1≤i≤n1\leq i\leq n, let gig_{i} be a complex gaussian with mean zero and with the same covariance matrix as ζi\zeta_{i}, thus

In particular gig_{i} has mean zero and variance 11. We construct the g1,…,gng_{1},\ldots,g_{n} to be jointly independent. Observe from (116) that the random variable

has mean zero and covariance matrix MM, and thus has the same distribution as GG. Thus if we define the random variables

we have the telescoping triangle inequality

By Taylor’s theorem with remainder we thus have

Observe that ζj\zeta_{j}, gjg_{j} are independent of Sj′S^{\prime}_{j}, and have the same mean and covariance matrix. Subtracting (121) from (122) and taking expectations using (115) we conclude that

The bounds here are not best possible, but are sufficient for our applications.

(Proof of Theorem 44) We first prove the upper tail bound on SiS_{i}. Here, the main tool is the N=1N=1 case of Theorem 71. The variance of SiS_{i} is

since the rows of AA have unit size. Thus, the 2×22\times 2 covariance matrix of SiS_{i} is O(1)O(1). Let GiG_{i} be a complex gaussian with mean zero and the same covariance matrix as SiS_{i}. By Theorem 71, we have

for any ε>0{\varepsilon}>0. Selecting ε:=110{\varepsilon}:=\frac{1}{10} (say), and using the fact that GG has variance 11, we conclude that

and the claim follows from (26) and (123).

by the orthonormality of the rows of AA. Thus, by (116), the operator norm of the covariance matrix MM of SS has operator norm at most 11. On the other hand, we have

for any ε>0{\varepsilon}>0. By (26), (123) we have

Setting ε:=t/2N{\varepsilon}:=t/\sqrt{2N}, we conclude that

Let GVG_{V} be the orthogonal projection of GG to VV. Clearly

The gaussian GVG_{V} has mean zero and covariance matrix at least 14IV\frac{1}{4}I_{V} (i.e. all eigenvalues are at least 1/41/4). By applying a linear transformation to reduce the covariance, we see that the quantity P(∣GV∣≤2t){\mathbf{P}}(|G_{V}|\leq 2t) is maximized when the covariance matrix exactly 14IV\frac{1}{4}I_{V}. Thus, in any orthonormal basis of GVG_{V}, the ⌊N/2⌋\lfloor N/2\rfloor g1,…,g⌊N/2⌋g_{1},\ldots,g_{\lfloor N/2\rfloor} components of GVG_{V} are independent real gaussians of variance 1/41/4. If ∣GV∣≤2t|G_{V}|\leq 2t, then g12+…+g⌊N/2⌋2≤4t2g_{1}^{2}+\ldots+g_{\lfloor N/2\rfloor}^{2}\leq 4t^{2}, and thus (by Markov’s inequality) gi2≤8t2/Ng_{i}^{2}\leq 8t^{2}/N for at least ⌊N/4⌋\lfloor N/4\rfloor of the indices ii. The number of choices of these indices is at most 2⌊N/2⌋2^{\lfloor N/2\rfloor}, and the events gi2≤2t2/Ng_{i}^{2}\leq 2t^{2}/N are independent and occur with probability O(t/N)O(t/\sqrt{N}), so we conclude from the union bound that

Acknowledgement. We would like to thank P. Sarnak for bringing this beautiful problem to our attention. We would like to thank M. Krishnapur and S. Chatterjee who introduced us to the Lindeberg method. We would like to thank G. Ben Arous, M. Krishnapur, K. Johansson, J. Lebowitz, S. Péché, B. Rider, A. Soshnikov and O. Zeitouni for useful conversations regarding the state-of-the-art of GUE/ GOE and Johansson matrices. Part of the paper was written while the second author was visiting Microsoft Research in Boston and he would like to thank J. Chayes and C. Borgs for their hospitality. We thank Alain-Sol Sznitman and the anonymous referees for corrections.

References