Random matrices: Universal properties of eigenvectors

Terence Tao, Van Vu

Introduction

Consider a random Hermitian n×nn\times n matrix MnM_{n} with nn real eigenvalues (counting multiplicity)

By the spectral theorem, one can find an orthonormal basis

Unfortunately, the eigenvectors ui(Mn)u_{i}(M_{n}) are not unique in either the Hermitian or real symmetric cases; even if one assumes that the spectrum of MnM_{n} is simple, in the sense that

one has the freedom to rotate each ui(Mn)u_{i}(M_{n}) by a unitWe use −1\sqrt{-1} to denote the imaginary unit, in order to free up the symbol ii as an index variable. phase e−1θ∈U(1)e^{\sqrt{-1}\theta}\in U(1). In the real symmetric case, in which we force the eigenvectors to have real coefficients, one only has the freedom to multiply each ui(Mn)u_{i}(M_{n}) by a sign ±∈O(1)\pm\in O(1). However, one can eliminate this U(1)U(1) phase ambiguity or O(1)O(1) sign ambiguity (in the case of simple spectrum) by a adopting a variety of viewpoints:

One can consider the rank one projection operators

instead of the eigenvectors ui(Mn)u_{i}(M_{n}), thus the pqpq coefficient Pi,p,q(Mn)P_{i,p,q}(M_{n}) of Pi(Mn)P_{i}(M_{n}) is given by the formula

One can perform the ad hoc normalization of requiring ui,p(Mn)u_{i,p}(M_{n}) to be positive real, where pp is the first index for which ui,p(Mn)≠0u_{i,p}(M_{n})\neq 0 (generically we will have p=1p=1, and as we will see shortly, for Wigner matrices we will also have p=1p=1 with high probability).

One can perform the random normalization of replacing ui(Mn)u_{i}(M_{n}) with a randomly chosen rotation e−1θui(Mn)e^{\sqrt{-1}\theta}u_{i}(M_{n}) (in the Hermitian case) or ±ui(Mn)\pm u_{i}(M_{n}) (in the real symmetric case) (each the random phase or sign being chosen independently of each other, and (if MnM_{n} is itself random) of MnM_{n}).

Note that PiP_{i}, [ui(Mn)][u_{i}(M_{n})], the ad hoc normalized ui(Mn)u_{i}(M_{n}), and the randomly normalized ui(Mn)u_{i}(M_{n}) in viewpoints (i)-(iv) respectively will be uniquely defined as long as the spectrum is simple (indeed, it suffices to have λi−1(Mn)<λi(Mn)<λi+1(Mn)\lambda_{i-1}(M_{n})<\lambda_{i}(M_{n})<\lambda_{i+1}(M_{n})). In the proofs of our main results, we shall adopt viewpoint (i) (which is natural from the perspective of spectral theory). However, in order to express our results in explicit coordinates, we will adopt the more ad hoc viewpoint (iii) or the random viewpoint (iv) in the statements of our results.

Notations. We consider nn as an asymptotic parameter tending to infinity. We use X≪YX\ll Y, Y≫XY\gg X, Y=Ω(X)Y=\Omega(X), or X=O(Y)X=O(Y) to denote the bound X≤CYX\leq CY for all sufficiently large nn and for some constant CC. Notations such as X≪kY,X=Ok(Y)X\ll_{k}Y,X=O_{k}(Y) mean that the hidden constant CC depend on another constant kk. X=o(Y)X=o(Y) or Y=ω(X)Y=\omega(X) means that X/Y→0X/Y\rightarrow 0 as n→∞n\rightarrow\infty; the rate of decay here will be allowed to depend on other parameters.

We will need some definitions that capture the intuition that a certain event EE occurs very frequently.

EE holds asymptotically almost surely if P(E)=1−o(1){\mathbf{P}}(E)=1-o(1).

EE holds with high probability if P(E)≥1−O(n−c){\mathbf{P}}(E)\geq 1-O(n^{-c}) for some constant c>0c>0.

EE holds with overwhelming probability if P(E)≥1−OC(n−C){\mathbf{P}}(E)\geq 1-O_{C}(n^{-C}) for every constant C>0C>0 (or equivalently, that P(E)≥1−exp⁡(−ω(log⁡n)){\mathbf{P}}(E)\geq 1-\exp(-\omega(\log n))).

EE holds almost surely if P(E)=1{\mathbf{P}}(E)=1.

The goal of this paper is to understand the distribution of the eigenvectors ui(Mn)u_{i}(M_{n}) (as normalized using viewpoint (iii) or (iv), for sake of concreteness) of a class of random matrix ensembles known as Wigner random matrices.

Let us first identify the class of matrices we are working with.

Let n≥1n\geq 1 be an integer (which we view as a parameter going off to infinity). An n×nn\times n Wigner Hermitian matrix MnM_{n} is defined to be a random Hermitian n×nn\times n matrix Mn=(ξij)1≤i,j≤nM_{n}=(\xi_{ij})_{1\leq i,j\leq n}, in which the ξij\xi_{ij} for 1≤i≤j≤n1\leq i\leq j\leq n are jointly independent with ξji=ξij‾\xi_{ji}=\overline{\xi_{ij}}. For 1≤i<j≤n1\leq i<j\leq n, we require that the ξij\xi_{ij} have mean zero and variance one, while for 1≤i=j≤n1\leq i=j\leq n we require that the ξij\xi_{ij} (which are necessarily real) have mean zero and variance σ2\sigma^{2} for some σ2>0\sigma^{2}>0 independent of i,j,ni,j,n. (Note that we do not require the ξij\xi_{ij} to be identically distributed, either on or off the diagonal.)

We say that the Wigner matrix ensemble obeys condition C0 if we have the exponential decay condition

for all 1≤i,j≤n1\leq i,j\leq n and t≥C′t\geq C^{\prime}, and some constants C,C′C,C^{\prime} (independent of i,j,ni,j,n). We say that the Wigner matrix ensemble obeys condition C1 with constant C0C_{0} if one has

for some constant CC (independent of nn).

Of course, Condition C0 implies Condition C1 for any C0C_{0}, but not conversely.

The distribution of coefficients of a matrix distributed using the Haar measure on the unitary or orthogonal groups has been studied by many authors , , , , , , , , . It is known (see ) that each coefficient, after multiplication by n\sqrt{n}, is asymptotically complex normal (in the unitary case) or real normal (in the orthogonal case). In fact the same is true for the joint distribution of multiple coefficients:

If instead we make the weaker assumption that k=o(n/log⁡n)k=o(n/\log n), then it is possible to couple together ui,pu_{i,p} and ξi,p\xi_{i,p} such that sup⁡1≤i,p≤k∣nui,p−ξi,p∣\sup_{1\leq i,p\leq k}|\sqrt{n}u_{i,p}-\xi_{i,p}| converges to zero in probability.

In it is also shown that the hypotheses k=o(n)k=o(\sqrt{n}), k=o(n/log⁡n)k=o(n/\log n) in the above two results are best possible. Of course, by symmetry, one can replace the top left k×kk\times k minor (ui,p)1≤i,p≤k(u_{i,p})_{1\leq i,p\leq k} of the orthogonal matrix (u1,…,un)(u_{1},\ldots,u_{n}) with any other k×kk\times k minor and obtain the same results.

As a corollary of Theorem 3, we obtain an asymptotic for the distribution of eigenvector coefficients of GUE or GOE (normalizing using viewpoint (iii)).

If k=o(n)k=o(\sqrt{n}), then (nuia,pb(Mn))1≤a,b≤k(\sqrt{n}u_{i_{a},p_{b}}(M_{n}))_{1\leq a,b\leq k} and (ξia,pb)1≤a,b≤k(\xi_{i_{a},p_{b}})_{1\leq a,b\leq k} differ by o(1)o(1) in variation norm.

If instead we make the weaker assumption that k=o(n/log⁡n)k=o(n/\log n), then it is possible to couple together MnM_{n} and ξi,p\xi_{i,p} such that sup⁡1≤a,b≤k∣nuia,pb(Mn)−ξia,pb∣\sup_{1\leq a,b\leq k}|\sqrt{n}u_{i_{a},p_{b}}(M_{n})-\xi_{i_{a},p_{b}}| converges to zero in probability.

The main objective of this paper is to develop analogues of Corollary 4 for the more general Wigner ensembles from Definition 2. In particular, we would like to consider ensembles MnM_{n} which are allowed to be discrete instead of continuous.

One immediate difficulty that arises in the discrete setting is that one can now have a non-zero probability that the spectrum is non-simple. However, we have the following gap theorem from , , :

Suppose that MnM_{n} is a Wigner random matrix obeying Condition C1 with a sufficiently large constant C0C_{0}, and let c0>0c_{0}>0 be independent of nn. Write An:=nMnA_{n}:=\sqrt{n}M_{n} for the rescaled matrix. Then for any 1≤i<n1\leq i<n, one has

for all sufficiently large nn, where c1>0c_{1}>0 depends only on c0c_{0}.

In the bulk case εn<i<(1−ε)n{\varepsilon}n<i<(1-{\varepsilon})n assuming Condition C0, see [17, Theorem 19]. For the extension to the edge case, see [18, Theorem 1.14]. For the relaxation of Condition C0 to Condition C1 (with a sufficiently large C0C_{0}), see [19, Section 2]. See also for some related level repulsion estimates (assuming some additional regularity hypotheses on MnM_{n}). ∎

Of course, one has λi(An)=nλi(Mn)\lambda_{i}(A_{n})=\sqrt{n}\lambda_{i}(M_{n}). From the above theorem and the union bound, we see that there is an absolute constant c>0c>0 such that if m=O(nc)m=O(n^{c}) and 1≤i1<…<im≤n1\leq i_{1}<\ldots<i_{m}\leq n, and MnM_{n} obeys Condition C1 with a sufficiently large C0C_{0}, then with probability 1−O(n−c)1-O(n^{-c}), the eigenvalues λi1(Mn),…,λim(Mn)\lambda_{i_{1}}(M_{n}),\ldots,\lambda_{i_{m}}(M_{n}) will all occur with multiplicity one, so that one can meaningfully normalise the eigenvectors ui1(Mn),…,uim(Mn)u_{i_{1}}(M_{n}),\ldots,u_{i_{m}}(M_{n}) according to any of the viewpoints (i), (ii), (iii), (iv) mentioned previously, outside of an exceptional event of probability O(n−c)O(n^{-c}). On that exceptional event, we define the orthonormal eigenvector basis ui(Mn)u_{i}(M_{n}) (and related objects such as the rank one projection Pi(Mn)P_{i}(M_{n})) in some arbitrary (measurable) fashion.

We now turn to the distribution of the coefficients of the eigenvectors. As the ensembles MnM_{n} may be discrete, the eigenvector coefficients ui,j(Mn)u_{i,j}(M_{n}) may be discrete also, and so one does not expect to have convergence in variation distance any more. Instead, we will consider the weaker notion of vague convergence, which resembles the condition (1), but with FF now required to be compactly supported, and either continuous or smooth. We need the following definition:

Let k,l≥1k,l\geq 1. Two Wigner random matrices Mn=(ξij)1≤i,j≤nM_{n}=(\xi_{ij})_{1\leq i,j\leq n} and Mn′=(ξij′)1≤i,j≤nM^{\prime}_{n}=(\xi^{\prime}_{ij})_{1\leq i,j\leq n} are said to match to order kk off the diagonal, and match to order ll on the diagonal, if one has ERe⁡(ξij)aIm⁡(ξij)b=ERe⁡(ξij′)aIm⁡(ξij′)b{\mathbf{E}}{\operatorname{Re}}(\xi_{ij})^{a}{\operatorname{Im}}(\xi_{ij})^{b}={\mathbf{E}}{\operatorname{Re}}(\xi^{\prime}_{ij})^{a}{\operatorname{Im}}(\xi^{\prime}_{ij})^{b} whenever a,b≥0a,b\geq 0 and 1≤i≤j≤n1\leq i\leq j\leq n are integers such that a+b≤ka+b\leq k (if i<ji<j) or a+b≤la+b\leq l (if i=ji=j).

We can now give our first main result, which partially extends Corollary 4 to other Wigner ensembles:

(Vague convergence) If k=O(nδ)k=O(n^{\delta}), then one has

If instead we make the stronger assumption that k=O(1)k=O(1), then it is possible to couple together MnM_{n} and ξi,p\xi_{i,p} such that sup⁡1≤a,b≤k∣nuia,pb(Mn)−ξia,pb∣\sup_{1\leq a,b\leq k}|\sqrt{n}u_{i_{a},p_{b}}(M_{n})-\xi_{i_{a},p_{b}}| converges to zero in probability. In particular, this implies that (nuia,pb)1≤a,b≤k(\sqrt{n}u_{i_{a},p_{b}})_{1\leq a,b\leq k} converges to (ξia,pb)1≤a,b≤k(\xi_{i_{a},p_{b}})_{1\leq a,b\leq k} in distribution.

If one uses the random normalization (iv) instead of (iii), then the conclusions are the same, except that the absolute values are not present in the definition of ξi,1\xi_{i,1}.

The bound k=O(1)k=O(1) in (ii) can be extended by our method (with some effort) to k=o(log⁡1/2n)k=o(\log^{1/2}n), but this still falls far short of the analogous range in Corollary 4. It is reasonable to expect that these bounds are not best possible (particularly if one places some additional regularity hypotheses on the coefficients of MnM_{n}).

We will deduce Theorem 7 from Corollary 4 by establishing a four moment theorem for eigenvectors, which is the main technical result of this paper:

The bounds are uniform in the choice of i1,…,ik,p1,…,pk,q1,…,qki_{1},\ldots,i_{k},p_{1},\ldots,p_{k},q_{1},\ldots,q_{k}.

The deduction of Theorem 7 from Corollary 4 and Theorem 8 is routine and is performed in Section 2.

Theorem 8 is an extension of the four moment theorem for eigenvalues established in , , . Indeed, the latter theorem is essentially the special case of Theorem 8 in which k=O(1)k=O(1), and GG only depends on the first kk components (nλia(Mn))1≤a≤k(\sqrt{n}\lambda_{i_{a}}(M_{n}))_{1\leq a\leq k} of Φ(Mn)\Phi(M_{n}). Unsurprisingly, the proof of Theorem 8 will rely heavily on the machinery developed in , , .

Theorem 8 was announced at the AIM workshop “Random matrices” in December 2010. We have found out that recently a result in the same spirit has been proved by Knowles and Yin using a somewhat different method. Knowles and Yin handled the k=O(1)k=O(1) case with Condition C1 replaced by the stronger Condition C0. Furthermore, they needeed control on k+5k+5 derivatives of GG rather than just 55 derivatives, and also a level repulsion hypothesis similar to (6), (7) below. On the other hand, their result holds for generalized Wigner matrices.

The need for four matching moments in Theorem 8 is believed to be necessary; see . However, we conjecture that Corollary 4 continues to hold without the matching moment hypothesis.

We can use Theorem 8 (together with other tools) to obtain a four moment theorem for the resolvent (or Green’s function) coefficients

where AnA_{n} is the rescaled matrix An:=nMnA_{n}:=\sqrt{n}M_{n} (so in particular ui(An)=ui(Mn)u_{i}(A_{n})=u_{i}(M_{n}) and Pi(An)=Pi(Mn)P_{i}(A_{n})=P_{i}(M_{n})).

for some constant c0>0c_{0}>0 independent of nn.

We isolate the z=0z=0 case of this theorem as a corollary:

Under the conditions of Theorem 9, we have

We prove Theorem 9 in Section 5; it is established by combining Theorem 8 with an eigenvalue rigidity result from and a local semicircle law from . This result generalizes a similar four moment theorem from ( ( [9, Theorem 2.3]). Its main strengths as compared against that result are that η\eta is allowed to go all the way to zero. In particular, one can take zz to be zero, thus giving control of the coefficients of the inverse matrix Mn−1M_{n}^{-1}. On the other hand, the result in [9, Theorem 2.3] does not require the hypothesis (6), (7), and allows the entries in MnM_{n} (or Mn′M^{\prime}_{n}) to have different variances, and the bounds are slightly sharper.

The same proof allows one to control the joint distribution of kk coefficients of several resolvents with k=O(nδ)k=O(n^{\delta}) for some sufficiently small δ>0\delta>0, assuming a level repulsion estimate at each energy zz.

The hypotheses (6), (7) are natural, as when these claims fail one would expect the resolvent to be unusually large. However, in practice such hypotheses are in fact automatic and can thus be omitted. For instance, we have

If the real and imaginary parts of the off-diagonal coefficients of MnM_{n} are iid and supported on at least three points, and MnM_{n} obeys Condition C1for a sufficiently large C0C_{0}, then (6) holds.

If z=0z=0 and MnM_{n} obeys Condition C1for C0=4C_{0}=4, then (6) holds.

For (i), see ; an earlier result assuming smoothness and decay on the coefficients (but without the requirement of iid real and imaginary parts) was established in (see also for a more refined result). The claim (ii) was recently established (by a rather different method) in ∎

It is in fact likely that (6) and (7) in fact always hold whenever Condition C1is satisfied for a sufficiently large C0C_{0}, but we do not attempt to establish this fact here.

As another application, we can use our new results to obtain central limit theorems concerning eigenvectors. Here is a sample result.

ui(Mn)u_{i}(M_{n}) is normalized using the procedure (iii), and a⋅e1=o(1)a\cdot e_{1}=o(1); or

ui(Mn)u_{i}(M_{n}) is normalized using the procedure (iv).

As an example to illustrate Theorem 13, we can take a=an:=1n(1,…,1)∈Sn−1a=a_{n}:=\frac{1}{\sqrt{n}}(1,\ldots,1)\in S^{n-1}, and i:=⌊n/2⌋i:=\lfloor n/2\rfloor. Then Theorem 13 asserts that the sum of the entries of the middle eigenvector u⌊n/2⌋(Mn)u_{\lfloor n/2\rfloor}(M_{n}) (using either normalization (iii) or normalization (iv)) is gaussian in the limit.

We prove Theorem 13 in Section 4 as a consequence of Corollary 4 and a general central limit theorem on averages of approximately independent symmetric random variables (Proposition 25) which may be of independent interest. It should be possible to extend this result to more general ensembles MnM_{n} (and to obtain the analogous results for ensembles that match GUE rather than GOE), and to obtain central limit theorems for the joint distribution of several statistics of the form nui(Mn)⋅an\sqrt{n}u_{i}(M_{n})\cdot a_{n}, but we do not pursue this matter here.

The four moment theorem can be extended to handle the singular values of iid covariance matrices, instead of the eigenvalues of Wigner matrices; see . It is possible to use that extension to establish an analogue of Theorem 8 for the singular values and singular vectors of such matrices, and an analogue of Theorem 9 for the inverses of such matrices (which, as is well known, can be expressed in terms of the singular value decomposition of the matrix). We omit the details.

Proof of Theorem 7

We establish the claim in the GOE case only, as the GUE case is similar. We shall also establish the claim just for the normalization (iii), as the normalization (iv) can be treated similarly (or deduced directly from the results for (iii)).

Let C0C_{0} be as in Theorem 8, let δ>0\delta>0 be sufficiently small, and let MnM_{n}, u1(Mn),…,un(Mn)u_{1}(M_{n}),\ldots,u_{n}(M_{n}), ξi,j\xi_{i,j}, kk, i1,…,ik,p1,…,pki_{1},\ldots,i_{k},p_{1},\ldots,p_{k}, and FF be as in that theorem. Let Mn′M^{\prime}_{n} be drawn from GOE, and write An:=nMnA_{n}:=\sqrt{n}M_{n} and An′:=nMn′A^{\prime}_{n}:=\sqrt{n}M^{\prime}_{n}. We initially assume that k=O(nδ)k=O(n^{\delta}). By adding a dummy index and relabeling if necessary, we may assume without loss of generality that p1=1p_{1}=1.

and thus by Corollary 4, we have an analogous estimate for the quantities nPia,1,1(An′)=(nuia,1(An′))2nP_{i_{a},1,1}(A^{\prime}_{n})=(\sqrt{n}u_{i_{a},1}(A^{\prime}_{n}))^{2}:

Applying Theorem 8 (assuming that δ\delta is sufficiently small depending on c0c_{0}, so that the losses of nO(δ)n^{O(\delta)} coming from bounding the derivatives of F0F_{0} can be absorbed into the n−c0n^{-c_{0}} factor) we conclude that

Now we can prove part (i) of Theorem 7. From (8) one has

Thus, to prove (2), it suffices by the triangle inequality to show that

with the understanding that the right-hand side vanishes when any of the xa,1x_{a,1} vanish. Similarly for AnA_{n}. From construction we can easily verify that

for all 0≤j≤50\leq j\leq 5. The claim (i) now follows from Theorem 8 (assuming δ\delta sufficiently small depending on c0c_{0}).

Finally, we prove Claim (ii) of Theorem 7. Assume that k=O(1)k=O(1). Let ε=ε(n)=o(1)>0{\varepsilon}={\varepsilon}(n)=o(1)>0 be a slowly decaying function of nn to be chosen later. Observe that asymptotically almost surely, one has

and thus by (i), we conclude that asymptotically almost surely, we also have

Write ξ⃗:=(ξia,pb)1≤a,b≤k\vec{\xi}:=(\xi_{i_{a},p_{b}})_{1\leq a,b\leq k}. Applying Claim (i) (approximating the indicator functions 1Qi1_{Q_{i}} from above and below by smooth functions) and using the continuous nature of ξ⃗\vec{\xi}, we see that

if ε{\varepsilon} is sufficiently slowly decaying in nn. From this, we see that we may couple u⃗\vec{u} and ξ⃗\vec{\xi} together in such a fashion that with probability 1−o(1)1-o(1), u⃗\vec{u} and ξ⃗\vec{\xi} lie in the same cube QiQ_{i}, which in particular implies that u⃗−ξ⃗=o(1)\vec{u}-\vec{\xi}=o(1). The claim follows.

Proof of four moment theorem

In this section we prove Theorem 8. We will follow closely the arguments from , , .

Let us first review the general strategy from for handling the eigenvalues. As in , we introduce the normalised matrices

(whose mean eigenvalue spacing is comparable to 11). For sake of exposition let us restrict attention to the case k=1k=1, thus we wish to show that the expectation EG(λi(An)){\mathbf{E}}G(\lambda_{i}(A_{n})) of the random variable G(λi(An))G(\lambda_{i}(A_{n})) only changes by O(n−c0)O(n^{-c_{0}}) if one replaces AnA_{n} with another random matrix An′A^{\prime}_{n} with moments matching up to fourth order off the diagonal (and up to second order on the diagonal). To further simplify the exposition, let us suppose that the coefficients ζpq\zeta_{pq} of AnA_{n} (or An′A^{\prime}_{n}) are real-valued rather than complex-valued.

Let us freeze (or condition on) all the entries of AnA_{n} except for the pqpq and qpqp entries. For any complex number zz, let A(z)A(z) denote the matrix which equals AnA_{n} except at the pqpq, qpqp, entries, where it equals zz and z‾\overline{z} respectively. (Actually, with our hypotheses, we only need to consider real-valued zz.) Thus it would suffice to show that

for all (or at least most) choices of the frozen entries of AnA_{n}, where F(z):=G(λi(A(z)))F(z):=G(\lambda_{i}(A(z))). (A standard argument allows us to restrict attention to values of zz of size O(n1/2+O(1/C0))O(n^{1/2+O(1/C_{0})}).)

Suppose we could show the derivative estimates

for l=1,2,3,4,5l=1,2,3,4,5. Then by Taylor’s theorem with remainder, we would have

and so in particular (using the hypothesis z=O(n1/2+O(1/C0))z=O(n^{1/2+O(1/C_{0})}))

and similarly for F(nζpq′)F(\sqrt{n}\zeta^{\prime}_{pq}). Since n−5/2+O(c0)+O(1/C0)+o(1)=O(n−2−c0)n^{-5/2+O(c_{0})+O(1/C_{0})+o(1)}=O(n^{-2-c_{0}}) for C0C_{0} and nn large enough and c0c_{0} small enough, we thus obtain the claim (10) thanks to the hypothesis that the first four moments of ζpq\zeta_{pq} and ζpq′\zeta^{\prime}_{pq} match. (Note how this argument barely fails if only three moments are assumed to match, though it is possible that some refinement of this argument might still succeed by exploiting further cancellations in the fourth order term 14!F(4)(0)n4ζpq4\frac{1}{4!}F^{(4)}(0)\sqrt{n}^{4}\zeta_{pq}^{4}.)

We can use exactly this strategy for eigenvectors, replacing λi\lambda_{i} by Pi,p,qP_{i,p,q} (say). A key point here is that the derivatives of FF is computed based on the basic relation Anui=λiuiA_{n}u_{i}=\lambda_{i}u_{i} and the chain rule. Thus, in order to bound the derivatives of FF (for the four moment theorem for eigenvalues), we needed to obtain estimates for the derivatives of both λi\lambda_{i} and uiu_{i}. The same estimates can be used to bound the derivatives of FF in the proof of the four moment theorem for eigenvectors. In order to make kk as large as nΩ(1)n^{\Omega(1)}, one needs to follow the proof closely and make certain adjustments.

2. Formal proof

We now turn to the details. The first step is to truncate away the event that an eigenvalue gap is unexpectedly small. Define

This quantity is usually bounded from above:

with high probability for all 1≤a≤k1\leq a\leq k.

See [17, Lemma 49]. Strictly speaking, this lemma assumed Condition C0 and was restricted to the bulk of the spectrum, but this was solely because at the time of writing of that paper, the gap theorem (Theorem 5) was only established in that setting. Inserting Theorem 5 as a replacement for [17, Theorem 19] in the proof of [17, Lemma 49], we obtain the claim. ∎

In view of this lemma (and its obvious counterpart for Mn′M^{\prime}_{n}), we can (if k=O(nδ)k=O(n^{\delta}) for a sufficiently small δ\delta) deduce the four moment theorem from the following truncated version:

Then for any 1≤i1,i2,…,ik≤n1\leq i_{1},i_{2},\ldots,i_{k}\leq n and 1≤p1,…,pk,q1,…,qk≤n1\leq p_{1},\ldots,p_{k},q_{1},\ldots,q_{k}\leq n, and for nn sufficiently large depending on ε,δ,c0{\varepsilon},\delta,c_{0} (and the constant CC in Definition 2) we have

The reduction of Theorem 8 to Theorem 17 using Lemma 16 proceeds exactly as in [17, §3.3] and is omittedNote that now that kk is as large as O(nδ)O(n^{\delta}), some factors of O(nO(δ))O(n^{O(\delta)}) may be lost in the bounds, but this can be absorbed by the n−c1n^{-c_{1}} gain in the conclusion of Theorem 17..

As in , we adopt the Lindeberg strategy of swapping each matrix entry of MnM_{n} (and its transpose) one at a time. A key definition is that of a good configuration, which is a slightly modified version of the same concept from . Let ε1,C1{\varepsilon}_{1},C_{1} be parameters (independent of nn) to be selected later. For a given nn, we fix k,i1,…,ik,Gk,i_{1},\ldots,i_{k},G as in Theorem 17.

For a complex parameter zz, let A(z)A(z) be a (deterministic) family of n×nn\times n Hermitian matrices of the form

where ep,eqe_{p},e_{q} are unit vectors. We say that A(z)A(z) is a good configuration if for every 1≤a≤k1\leq a\leq k and every ∣z∣≤n1/2+ε1|z|\leq n^{1/2+{\varepsilon}_{1}} whose real and imaginary parts are multiples of n−C1n^{-C_{1}}, we have the following properties:

(Eigenvalue separation) For any 1≤i≤n1\leq i\leq n with ∣i−ia∣≥nε1|i-i_{a}|\geq n^{{\varepsilon}_{1}}, we have

(Delocalization) There exists an orthonormal eigenfunction basis u1(A(z)),…,un(A(z))u_{1}(A(z)),\ldots,u_{n}(A(z)) such that

To show Theorem 17, it then suffices to establish the following two claims. The first claim, which we shall establish shortly, is an analogue of [17, Proposition 46], and involves a single (deterministic) good configuration A(z)A(z):

Suppose that C1C_{1} is sufficiently large, and let ε1>0{\varepsilon}_{1}>0. Let A(z)A(z) be a good configuration. Then one has

whenever ζ,ζ′\zeta,\zeta^{\prime} are random complex variables that match to order rr for some r=2,3,4r=2,3,4, and bounded almost surely by O(n1/2+ε1)O(n^{1/2+{\varepsilon}_{1}}).

The second claim is an analogue of [17, Proposition 48]:

Let ε1>0{\varepsilon}_{1}>0 and C1≥1C_{1}\geq 1, and assume that C0≥1C_{0}\geq 1 is sufficiently large depending on ε1{\varepsilon}_{1}. Let A(0)=(ζij)1≤i,j≤nA(0)=(\zeta_{ij})_{1\leq i,j\leq n} be a random Hermitian matrix with independent upper-triangular entries and ∣ζij∣≤n1/2+10/C0|\zeta_{ij}|\leq n^{1/2+10/C_{0}} for all 1≤i,j≤n1\leq i,j\leq n, with ζpq=ζqp=0\zeta_{pq}=\zeta_{qp}=0, but with ζij\zeta_{ij} having mean zero and variance nn for all other ijij, and also being distributed continuously in the complex plane. Then A(0)A(0) is a good configuration with overwhelming probability.

This is almost identical to the argumentsThe hypotheses in [17, §5] did not have the loss of n10/C0n^{10/C_{0}} in the bound for ζij\zeta_{ij}, but such bounds only cause losses of O(nO(1/C0))O(n^{O(1/C_{0})}) in the final bounds, which can be absorbed into the nε1n^{{\varepsilon}_{1}} factors in the definition of a good configuration if C0C_{0} is sufficiently large depending on ε1{\varepsilon}_{1}. in [17, §5]. Those arguments already give (14) with overwhelming probability. To obtain the delocalization of eigenvectors, one can use [18, Proposition 1.12] (see also the proof of [17, Corollary 63] to deal with the fact that the pqpq and qpqp entries are not random). ∎

With these two propositions, we can establish Theorem 17 by first using Condition C1 to truncate to the case when Mn,Mn′M_{n},M^{\prime}_{n} have entries of size O(n10/C0)O(n^{10/C_{0}}) (say), and perturbing them to be continuous, and then replacing the entries of MnM_{n} with Mn′M^{\prime}_{n} one at a time just as in [17, §3.3]. Because the entries of MnM_{n} and Mn′M^{\prime}_{n} match to order 44 off the diagonal and to order 22 on the diagonal, each of the O(n2)O(n^{2}) off-diagonal replacements costs an error of O(n−5/2+O(ε1)+O(δ))O(n^{-5/2+O({\varepsilon}_{1})+O(\delta)}), while each of the O(n)O(n) diagonal replacements costs an error of O(n−3/2+O(ε1)+O(δ))O(n^{-3/2+O({\varepsilon}_{1})+O(\delta)}), and so the net error is acceptable if ε1,δ{\varepsilon}_{1},\delta are sufficiently small (and if C0C_{0} is large enough that Proposition 20 applies).

It remains to establish Proposition 19. As in , we will need derivative bounds on various spectral statistics of A(z)A(z). For each 1≤i≤n1\leq i\leq n, we introduce the resolvent-type matrices

Let 1≤i≤n1\leq i\leq n, and let A0A_{0} be a Hermitian matrix which has a simple eigenvalue at λi(A0)\lambda_{i}(A_{0}). Then λi(A)\lambda_{i}(A), Pi(A)P_{i}(A), Ri(A)R_{i}(A), and Qi(A)Q_{i}(A) depend smoothly on AA in a neighborhood of A0A_{0}.

Now we turn to more quantitative bounds on derivatives. If f(z)f(z) is a scalar, vector, or matrix-valued function depending smoothly (but not holomorphically) on a complex parameter zz, we define the derivatives ∇mf\nabla^{m}f of ff to be the vector (or tensor)-valued quantity

Let A=A(z)A=A(z) be an n×nn\times n Hermitian matrix varying (real)-linearly in zz (thus ∇kA=0\nabla^{k}A=0 for k≥2k\geq 2), with

for some V>0V>0. Let 1≤i≤n1\leq i\leq n. At some fixed value of zz, suppose we have the spectral gap condition

for all j≠ij\neq i and some r>0r>0 (in particular, λi(A(z))\lambda_{i}(A(z)) is a simple eigenvalue). Then for all k≥1k\geq 1 we have (at this fixed choice of zz)

In practice, this crude bound is insufficient, and we will need the following more advanced bound:

Let A=A(z)A=A(z) be an n×nn\times n matrix depending on a complex parameter zz of the form

for some vectors ep,eqe_{p},e_{q}. We abbreviaate λi=λi(A(z))\lambda_{i}=\lambda_{i}(A(z)), Pi=Pi(A(z))P_{i}=P_{i}(A(z)), etc.

Let 1≤i≤n1\leq i\leq n. At some fixed value of zz, suppose that λi=λi(A(z))\lambda_{i}=\lambda_{i}(A(z)) is a simple eigenvalue, and that we have a partition

where JJ is a finite index set, and PαP_{\alpha} are orthogonal projections to invariant spaces on AA (i.e. to spans of eigenvectors not corresponding to λi\lambda_{i}). Suppose that on the range of each PαP_{\alpha}, the eigenvalues of A−λiA-\lambda_{i} have magnitude at least rαr_{\alpha} for some rα>0r_{\alpha}>0. Suppose also that we have the incompressibility bounds

for all α∈J∪{i}\alpha\in J\cup\{i\} and some w>0w>0 and dα≥1d_{\alpha}\geq 1, with di:=1d_{i}:=1. Then at this value of zz, and for all k≥1k\geq 1, we have the bounds

for all k≥0k\geq 0 and all α,β∈J\alpha,\beta\in J at this value of zz. Here ∥T∥F:=(trace⁡TT∗)1/2\|T\|_{F}:=(\operatorname{trace}TT^{*})^{1/2} is the Frobenius norm of TT.

See [17, Corollary 58], which is a special case of [17, Lemma 57]. The bounds (22), (23), (24) do not appear explicitly in [17, Corollary 58], but come directly from the equations [17, (73), (74), (75)] in [17, Lemma 57] after plugging in the parameters indicated in the proof of [17, Corollary 58]. ∎

We can now prove Proposition 19 and thus Theorem 8. This will be a repetition of the material in [17, Section 4.3]; we sketch the main points here.

Fix k≥1k\geq 1, r=2,3,4r=2,3,4 and ε1>0{\varepsilon}_{1}>0, and suppose that C1C_{1} is sufficiently large. We assume A(0),ep,eq,i1,…,ik,G,F,ζ,ζ′A(0),e_{p},e_{q},i_{1},\ldots,i_{k},G,F,\zeta,\zeta^{\prime} are as in the proposition.

We may of course assume that F(z0)≠0F(z_{0})\neq 0 for at least one z0z_{0} with ∣z0∣≤n1/2+ε1|z_{0}|\leq n^{1/2+{\varepsilon}_{1}}, since the claim is vacuous otherwise.

Using Taylor expansion and the chain rule exactly as in [17, Section 4.3], it suffices to show that

Suppose that F(z0)≠0F(z_{0})\neq 0 for at least one z0z_{0} with ∣z0∣≤n1/2+ε1|z_{0}|\leq n^{1/2+{\varepsilon}_{1}}. Then for all zz with ∣z0∣≤n1/2+ε1|z_{0}|\leq n^{1/2+{\varepsilon}_{1}}, and all 1≤j≤k1\leq j\leq k, we have

for all zz with ∣z∣≤n1/2+ε1|z|\leq n^{1/2+{\varepsilon}_{1}} and all 0≤m≤100\leq m\leq 10.

The bounds (26), (28) were already proven in [17, Lemma 59]; the arguments in the proof of that lemma also show that

uniformly for all zz with ∣z∣≤n1/2+ε1|z|\leq n^{1/2+{\varepsilon}_{1}}.

Now we prove (27). Arguing inductively as in the proof of [17, Lemma 59], it suffices to establish the claim for zz in the ball B(z0,n−1−2ε1)B(z_{0},n^{-1-2{\varepsilon}_{1}}). Let us first establish this for zz whose real and imaginary parts are a multiple of n−C1n^{-C_{1}}. At this value of zz, we can apply Proposition 23 exactly as in [17, Section 4.3] to obtain the bounds

for all 0≤m≤100\leq m\leq 10, 1≤j≤k1\leq j\leq k, and 0≤α,β≤log⁡n0\leq\alpha,\beta\leq\log n, where rαr_{\alpha} is the minimal value of ∣λi−λij∣|\lambda_{i}-\lambda_{i_{j}}| for ∣i−ij∣≥2α|i-i_{j}|\geq 2^{\alpha}, and Pij(α)P_{i_{j}}^{(\alpha)} is the spectral projection to those eigenvalues with 2α≤∣i−ij∣<2α+12^{\alpha}\leq|i-i_{j}|<2^{\alpha+1}.

for all −1≤α,β≤log⁡n-1\leq\alpha,\beta\leq\log n, where we adopt the convention that Pij(−1):=PijP_{i_{j}}^{(-1)}:=P_{i_{j}}. Now, we expand

Applying the triangle and Cauchy-Schwarz inequalities we conclude that

From the hypothesis (15) and Pythagoras’ theorem we have

so from (32) we obtain (27) as required, at least when the real and imaginary parts of zz are multiples of n−C1n^{-C_{1}}. The general case can then be handled (for C1C_{1} large enough) by an appeal to Lemma 22 by arguing exactly as in [17, Section 4.3].

Proof of Theorem 13

We now prove Theorem 13. The main tool is the following general central limit theorem:

(Exchangeability) The distribution of uu is symmetric with respect to the permutation group SnS_{n}.

For any distinct i1,…,iki_{1},\ldots,i_{k} with kk fixed, nui1,…,nuik\sqrt{n}u_{i_{1}},\ldots,\sqrt{n}u_{i_{k}} converges jointly in distribution to kk iid copies of N(0,1)N(0,1) as n→∞n\to\infty.

(Symmetry) The distribution of uu is symmetric with respect to the reflection group {−1,+1}n\{-1,+1\}^{n}.

We now prove Proposition 25. Let A=AnA=A_{n} be a quantity growing slowly to infinity that we will choose later. We truncate

where ui,≤:=ui1∣ui∣≤A/nu_{i,\leq}:=u_{i}1_{|u_{i}|\leq A/\sqrt{n}} and ui,>:=ui1∣ui∣>A/nu_{i,>}:=u_{i}1_{|u_{i}|>A/\sqrt{n}}. We then split u=u≤+u>u=u_{\leq}+u_{>} correspondingly. It will suffice to show that, for a suitable choice of AA,

a⋅u>a\cdot u_{>} converges in probability to zero.

We first consider the second claim. Here we use the second moment method. It suffices to show that

Set a=(a1,,˙an)a=(a_{1},\dot{,}a_{n}). The left-hand side can be expanded as

Using the symmetry hypothesis (iv), we see that if i≠ji\neq j, then ui,>uj,>u_{i,>}u_{j,>} has a symmetric distribution and thus has mean zero. Thus only the diagonal terms contribute. Using hypothesis (i) and the unit normalization of aa, the second moment becomes

for any fixed KK, where G≡N(0,1)G\equiv N(0,1), and thus (since A=AnA=A_{n} goes to infinity)

Now we turn to Claim 1. Here we use the moment method. By Carleman’s theorem (see e.g. ), it suffices to show that for each fixed positive integer kk,

By the symmetry hypothesis (iii), the expectation vanishes unless each index ii appears an even number of times. Using hypothesis (ii) (and (iii)), we see that

where G1,…,GnG_{1},\ldots,G_{n} are iid copies of N(0,1)N(0,1), uniformly in i1,…,iki_{1},\ldots,i_{k}, if AnA_{n} grows sufficiently slowly to infinity. Observe that

since ∑i=1naiGi≡G\sum_{i=1}^{n}a_{i}G_{i}\equiv G, and that (as before) the summands vanish unless each index ii appears an even number of times. Thus it suffices to show that

where the sum ∗* is over all kk-tuples 1≤i1,…,ik≤n1\leq i_{1},\ldots,i_{k}\leq n in which each index ii appears an even number of times, and the implied constants in the O()O() notation are allowed to depend on kk.

Suppose there are ll distinct indices appearing, then the contribution of this case is at most

(since we have ajrm≤ajr2a_{j_{r}}^{m}\leq a_{j_{r}}^{2} whenever mm is a positive even number). But as aa is a unit vector, this sums to O(1)O(1) as required. This concludes the proof of Proposition 25 and hence Theorem 13.

Proof of Theorem 9

We now prove Theorem 9. Let Mn,Mn′,C,z,E,η,p,qM_{n},M^{\prime}_{n},C,z,E,\eta,p,q be as in that theorem. Let c1>0c_{1}>0 be a small constant to be chosen later, and let c2>0c_{2}>0 be an even smaller constant (depending on c1c_{1}) to be chosen later. Write An:=nMnA_{n}:=\sqrt{n}M_{n} and An′:=nMn′A^{\prime}_{n}:=\sqrt{n}M^{\prime}_{n}.

Let us call an expression depending on MnM_{n} (or AnA_{n}) stable if it only changes by O(n−c)O(n^{-c}) for some c>0c>0 if MnM_{n} is replaced by Mn′M^{\prime}_{n}. Our task is thus to show that EG((1nMn−zI)pq−1){\mathbf{E}}G\left(\left(\frac{1}{\sqrt{n}}M_{n}-zI\right)^{-1}_{pq}\right) is stable.

We first subtract off the “global” portion of the resolvent (1nMn−zI)pq−1\left(\frac{1}{\sqrt{n}}M_{n}-zI\right)^{-1}_{pq}. Set z0:=E+in−1+c2/2z_{0}:=E+in^{-1+c_{2}/2}. Applying the local semicircle law from [9, Theorem 2.1], one hasStrictly speaking, the statement of [9, Theorem 2.1] only controls the diagonal component p=qp=q of the resolvent. However, an inspection of the proof of that theorem (see in particular [9, (3.13)] and [9, Proposition 3.3]) reveals that the off-diagonal components p≠qp\neq q were also controlled by the argument.

with overwhelming probability for some c>0c>0, where δpq\delta_{pq} is the Kronecker delta function and msc(z0)m_{sc}(z_{0}) is semicircular Stieltjes transform

This type of result already gives the claim when η≥n−1+c2/2\eta\geq n^{-1+c_{2}/2}, so we may assume that η<n−1+c2/2\eta<n^{-1+c_{2}/2}. After shifting GG by msc(z0)δpqm_{sc}(z_{0})\delta_{pq}, and using the regularity bounds on GG, it thus suffices to show that the expression

Note that FF decays quadratically in xx rather than linearly, due to the subtraction of the comparison term 1x−nz0\frac{1}{x-nz_{0}}; this will allow us to easily neglect the contribution of the spectrum that is far from EE in the rest of the argument.

We now invoke the eigenvalue rigidity result from [10, Theorem 2.2]. Among other things, this theorem gives an interval [i−,i+]⊂[1,n][i_{-},i_{+}]\subset[1,n] of length i+−i−=O(nc2)i_{+}-i_{-}=O(n^{c_{2}}) (depending only on nn, EE, and c2c_{2}) which contains most of the eigenvalues close to EE, in the sense that we have

with overwhelming probability. In fact, we have the stronger assertion that

for all i∈[1,n]\[i−,i+]i\in[1,n]\backslash[i_{-},i_{+}] with overwhelming probability. In particular, this implies that

Also, by the delocalization of eigenvalues (established in the bulk in [7, Theorem 4.8] (see also the earlier result [6, Theorem 1.2] handling the smooth case), and up to the edge in [18, Proposition 1.12]), we have

with overwhelming probability for all 1≤i,p≤n1\leq i,p\leq n, and hence

with overwhelming probability for all 1≤i,p,q,≤n1\leq i,p,q,\leq n. As such, we see that with overwhelming probability, we have

with overwhelming probability. Using the regularity bounds on GG, it thus suffices to show that the quantity

of FF. From the hypothesis (6), we see that for each i∈[i−,i+]i\in[i_{-},i_{+}], one has

with probability at least 1−O(n−10c2)1-O(n^{-10c_{2}}) (say), if c2c_{2} is sufficiently small depending on c1c_{1} and on the implied constant in the high probability event (6). In particular, by the union bound, we have

Similarly for An′A^{\prime}_{n} using (7). It thus suffices to show that the quantity

is stable. But this follows directly from Theorem 8 (if c1,c2c_{1},c_{2} are small enough). The proof of Theorem 9 is now complete.

The exponential decay hypothesis (Condition C0) in Theorem 9 is needed only to be able to use the eigenvalue rigidity result from and the local semicircle law from . It is quite likely that in both cases, one can relax Condition C0 to Condition C1 (conceding some factors of nO(1/C0)n^{O(1/C_{0})} in the process), which would then allow one to achieve a similar relaxation in Theorem 9.

References