Circular law, Extreme Singular values and Potential theory
Guangming Pan, Wang Zhou
Introduction
Let {}, be a double array of independent and identically distributed (i.i.d.) complex random variables (r.v.’s) with and . The complex eigenvalues of the matrix are denoted by . The two-dimensional empirical spectral distribution is defined as
The study of is related to understanding the random behavior of slow neutron resonances in nuclear physics. See . Since 1950’s it has been conjectured that, under the unit varaince condition, converges to the so-called circular law, i.e. the uniform distribution over the unit disk in the complex plane. Up to now, this conjecture is only proved in some partial cases.
The first answer for complex normal matrices was given in based on the joint density function of the eigenvalues of . Huang in reported that this result was obtained in an unpublished paper of Silverstein (1984). After more than one decade, Edelman also showed that the expected empirical spectral distribution converges to the circular law for real normal matrices. It is Girko who investigated the circular law for general matrix with independent entries for the first time in . But Girko imposed, not only moment conditions, but also strong smooth conditions on matrix entries. Later on, he further published a series of papers (for example, ) about this problem. However, as pointed out in and , Girko’s argument includes serious mathematical gaps. The rigorous argument of the conjecture was given by Bai in his 1997 celebrated paper for general random matrices. In addition to the finite moment condition Bai still assumed that the joint density of the real and imaginary part of the entries is bounded. Again, the result was further improved by Bai and Silverstein under the assumption in their comprehensive book , but the finiteness condition of the density of matrix entries is still there. Recently, Götze and Tikhomirov gave a proof of the convergence of to the circular law under the strong moment assumption that the entries have sub-Gaussian tails or are sparsely non-zero instead of the condition about the density of the entries in .
Generally speaking, there are five approaches to studying the spectral distribution of random matrices. The difficulty of the circular conjecture is that the methodologies used in Hermitian matrices do not work well in non-Hermitian ones. There was no powerful tool to attack this conjecture.
1. Moment method. Moments are very important characteristics of r.v.’s. They have many applications in probability and statistics. For example, we have moment estimators in statistics. As far as we know, it is Wigner who introduced moment method into random matrices. Since then, the moment method has been very successful in establishing the convergence of the empirical spectral distribution of Hermitian matrices. Bai did a lot of important work. One can refer to . But moment method fails to work in non-Hermitian ones, because for any complex r.v. uniformly distributed over any disk centered at , one can verify that for any
2. Stietjes transform. Another powerful tool in random matrices theory is the Stieltjes transform, which is defined by
for any distribution function . The basic property of Stieltjes transform is that it is a representing class of probability measures. This property offers one a strong analytic machine. Still see and the references therein. However, the Stieltjes transform of is unbounded if coincides with one eigenvalue. So this leads to serious difficulties when dealing with the Stieltjes transform of .
3. Orthogonal polynomials. The study of orthogonal polynomials goes back as far as Hermite. For the deep connections between orthogonal polynomials and random matrices, one can refer to . Orthogonal polynomials are usually limited to Guassian random matrices. Moreover, orthogonal polynomials are only suitable to deriving the spacing between consecutive eigenvalues for large classes of random matrices (see ).
4. Characteristic functions. There is a long history of characteristic functions. In 1810, Laplace used Fourier transform, i.e. characteristic functions to prove central limit theorem for bounded r.v.’s. Then in 1934 P. Lévy reproved Linderberg central limit theorem by characteristic functions. From that time on, characteristic functions are well known to almost every mathematician. Surprisingly, one can not see any application of characteristic functions in random matrices until 1984. Girko combined together the characteristic function of and the Stieltjes transform, trying to prove the conjecture in . Developing ideas proposed by Girko , Bai reduced the conjecture to estimating the smallest singular value of in . However, one should note that some uniform estimate of the smallest singular values of with respect to will be required if the method in is employed.
5. Potential theory. Potential theory is the terminology given to the wide area of analysis encompassing such topics as harmonic and subharmonic functions, the boundary problem, harmonic measure, Green’s function, potentials and capacity. Since Doob’s famous book appeared, it is widely accepted that potential theory and probability theory are closely related. For example, superharmonic functions correspond to supermartingales.
The logarithmic potential of a measure (see ) is defined by
where is any positive finite Borel measure with support in a compact subset of the complex plane. There is also an inversion formula, i.e. can be defined through as , where is the two dimensional Laplacian operator. This relation makes Khoruzhenko in suggest to use potential theory to derive the circular law. Then Götze and Tikhomirov in used the logarithmic potential of convoluted by a smooth distribution to provide a proof for the convergence of to the circular law with entries being sub-Gaussian or sparsely non-zero.
In this paper, the conjecture, the convergence of to the circular law with probability one, is established under the assumption that the underlying r.v.’s have finite fourth moment. Compared with , we work on the logarithmic potential of directly, while depends on the logarithmic potential of a convolution of and the uniform distribution on the disk of radius .
The main result of this paper is formulated as follows.
Suppose that are i.i.d. complex r.v.’s with and . Then, with probability one, the empirical spectral distribution function converges to the uniform distribution over the unit disk in two dimensional space.
The bounded density condition in and the sub-Gaussian assumption in are not needed any more.
Theorem 1 will be handled by potential theory in conjunction with estimates for the smallest singular value of .
The research of the smallest singular values originates from von Neumann and his colleagues. They guessed that
with being the smallest singular value of . Edelman in proved it for random Gaussian matrices, i.e., for each
Rudelson and Vershynin in solved it for real random matrices, i.e., for every there exist and depending only on and the fourth moment of so that
Moreover, since (1.5) fails to hold for the random sign matrices ( being symmetric r.v.’s), Spielman and Teng speculated that for random sign matrices for any
Again, (1.7) has been proved for real random matrices with i.i.d. subgaussian entries in .
We will adapt Rudelson and Vershynin’s method to obtain the order of the smallest singular value for complex matrices perturbed by a constant matrix.
Formally, let , where is a fixed complex matrix and , a random matrix. Denote the singular values of by arranged in the non-increasing order. Particularly, the smallest singular value is
where means Euclidean norm, and we denote the spectral norm of a matrix by .
Let be i.i.d. complex r.v.’s with and . Let . Then for every ,
where and depend only on , , E\big{(}Re(X_{11})\big{)}^{2}, E\big{(}Im(X_{11})\big{)}^{2}, and .
In Theorem 2, is arbitrary. It can depend on . is a constant not smaller than . In Section 3 when we apply (1.8) in the proof of Theorem 1, we will select .
Theorem 2 includes Theorem 5.1 in as a special case, where , the r.v.’s are real and have finite fourth moment. Therefore, (1.6) is true with replaced by when has finite fourth moment and (), i.e.,
Moreover, if is a subgaussian matrix and , by Lemma 2.4 of or Fact 2.4 of , (1.7) holds with replaced by , i.e.,
This exponential rate is better than the polynomial rate in Tao and Vu .
Furthermore, for general random matrices, similar to steps (3.3)-(3.4) in Section 3 one can conclude that
In addition to the assumptions of Theorem 2, suppose that and with , then for any
where is any positive number and with the convergence rate slower than any preassigned one as .
Taking , Corollary 1 then leads to a polynomial bound for the singularity probability:
For random sign matrices Tao and Vu showed that for every there exists so that
Recently, Tao and Vu reported a result concerning the smallest singular value of a perturbed matrix too. Under some mild conditions, they proved that
Compared with their results, (1.9) gives an explicit dependence between the bound on and probability, while the relationship between and in and is implicit. In addition, (1.9) holds for general random matrices, while Tao and Vu’s theorem basically applies to discrete random matrices.
In this paper, we will use the letters to denote some finite absolute constants.
The argument of Theorem 2 is presented in the next section and the proof of the circular law is given in the last section.
Smallest singular value
In this section the smallest singular value of the matrix perturbed by a constant matrix will be characterized. We begin first with the estimation of the so-called small ball probability.
We first establish a small ball probability for big via central limit theorem for complex r.v.’s . Before we state the next result, let us introduce some more notation and terminology. and will denote the real and imaginary part of a complex number . Write , for . For real r.v.’s and , if \big{(}E(\xi-E\xi)(\eta-E\eta)\big{)}^{2}=E(\xi-E\xi)^{2}E(\eta-E\eta)^{2}>0, then we will say that and are linearly correlated.
Let be i.i.d. complex r.v.’s with variances at least , and let be complex numbers such that for all . Then for every ,
where is a finite constant depending only on , and .
The case where or follows from Berry-Esseen inequality directly.
Now suppose and are not linearly correlated, and P\big{(}Re(\eta_{k})=0\big{)}<1, P\big{(}Im(\eta_{k})=0\big{)}<1. Let and . Define and . Obviously, , where . In order to apply Berry-Esseen inequality, we need to get a lower bound for . For , we have
For , let . So the smallest value of in $1t_{0}\in(0,1)a\sigma_{1},\ \sigma_{2}\sigma_{12}E|\hat{\eta}_{1k}-E\hat{\eta}_{1k}|^{2}\geq a|b_{k}|^{2}E|\hat{\eta}_{2k}-E\hat{\eta}_{2k}|^{2}\geq a|b_{k}|^{2}$. By Berry-Esseen inequality, one can then conclude that
where is a constant depending only on , and .
Thus (2.4) follows from (2.5), (2.6) and the following inequality
Theorem 3 only yields a polynomial rate . Next, an improved small ball probability is needed for our future use. To this end, some concepts will be presented which are parallel to those of .
where the subset is given by . Similarly, for , define
where and denote, respectively, the real part and imaginary part of .
Similar to the real case, the complex incompressible vector are also evenly spread, i.e. many coordinates are of the order .
Let . Then there is a set of cardinality with so that for or ,
By Lemma 3.4 in , for , there is a set of cardinality so that
Hence and if . On the other hand, either or must be bigger than . The assertion follows. ∎
(1) Suppose that are i.i.d. real r.v.’s, or imaginary r.v.’s, or complex ones with linearly correlated and . If and , for any , then
where depend only on .
(2) Let be i.i.d. complex r.v.’s with and , then (2.8) holds or
where depend only on , and .
(1). We only consider the case where the r.v.’s are real. The other two cases follow from the real case. Let and . Noting that
Let , and . It is observed that Theorem 3 implies Theorem 4 for big values of (constant order or even larger). Therefore we can suppose in what follows that
where is a constant which will be specified later.
If the real part of is linearly correlated to the imaginary part of , then we have (2.8). Therefore we assume in the sequel that is not linearly correlated to .
Set where and is an independent copy of . Then
where is some positive constant depending only on and .
On the other hand, . The Paley-Zygmund inequality () gives that
which is a positive constant depending only on , , and . Following we introduce a new r.v. conditioned on , that is, for any measurable function
With the notation , it is observed that
by taking . All the remaining arguments including the analysis for the level sets are similar to those of and so we here omit the details. Thus, one can conclude that for every
where , and are positive constants depending only on , , and ..
Finally, combining (2.14) and Lemma 2.1 in one can obtain the small ball probability for complex case (when applying (2.14) to the spread part of the vector one can suppose that by re-scaling and ). Thus we complete the proof. ∎
To treat the compressible vector, the following lemma is needed.
Suppose that are i.i.d. centered complex r.v.’s with and . Let be complex numbers. Then for and any vector there is such that the sum satisfy
where depends only on and .
On the other hand by Burkholder inequality we have
Hence Paley-Zygmund inequality gives that
where depends only on and . ∎
2. Proof of Theorem 2
The whole argument is similar to that of and we only sketch the proof. For more details one can refer to .
Since can be decomposed as the union of and , we then consider the smallest singular value on each set separately.
By Lemma 2 there are and depending on only so that
Actually, the proof is similar to that of Proposition 3.4 in . The only difference is that we should use our Lemma 2 instead of Lemma 3.6 in . Therefore similar to Lemma 3.3 in , we have, there exist so that
Let denote the column vectors of and the span of all columns except the -th column. One can check that Lemma 3.5 in is still true in complex case and hence
When all are real r.v.’s, or when and are linearly correlated or when we have
where denotes the event that . One can check that Lemma 3.6 in applies to complex case and hence
where is a constant depending only on , and . Further,
where and denote, respectively, the events that the real part and imaginary part of the vector satisfy (2.7) in Lemma 1, and denote, respectively, the spread part of the real part and imaginary part of the vector . By (2.8) in Theorem 4 and (2.3) we have
where are positive constants depending only on , and .
Here the level set is defined as
where and are some constants. For more details about and , see . Further, one can similarly prove that Lemma 5.8 in holds in our case and therefore we obtain
which, combined with the fact that the cardinal number is of order , then implies that
where . Similarly, one may also show that
Picking up the above argument one can conclude that
where and depend only on , , and .
For all the remaining case, i.e. , and , are not linearly correlated, one has
and one can similarly obtain (2.18) for complex case. Theorem 2 follows from (2.15)-(2.19) immediately.
The convergence of logarithmic potential and circular law
In this part the logarithmic potential will be used to show that the circular law is true. According to Lower Envelop Theorem and Unicity Theorem (see Theorem 6.9, p.73, and Corollary 2.2, p.98, in ), it suffices to show that the corresponding potential converges to the potential of the circular law.
To make use of Theorem 2 one needs to bound the maximum singular value of . To this end, we would like to present an important fact which was proved in , that is, if (1) , (2) (3) and (4) , where with the convergence rate slower than any preassigned one as . Then for any
where is any positive number (proved for real case in , for complex case see Chapter 5 of ).
Let the random matrix with . Then one can show that
see Lemma 2.2 of (the argument of the complex case is similar to that of the real one). Here the notation means infinitely often. Thus it is sufficient to consider the random matrix in order to prove the conjecture.
Taking in Theorem 2 one can obtain that
where . Here one should note that from (3.3) re-scaling the underlying r.v.’s is trivial. Moreover
Therefore, applying (3.1) and choosing an appropriate in (3.3), we have
where both and depend only on , , E\big{(}Re(X_{11})\big{)}^{2}, E\big{(}Im(X_{11})\big{)}^{2}, and .
In the sequel, to simplify the notation, we still use the notation instead of and instead of the empirical spectral distribution corresponding to . But one should keep in mind that are non-centered and .
Before we prove the convergence of the logarithmic potential of , we will characterize the relation between the potential of the circular law and the integral of logarithmic function with respect to , the limiting distribution of as below.
Let . One can then verify that
On the other hand by Lemma 4.4 in one has
Therefore for any with , we have
Let and then . Therefore, from Lemma 4.2 of the left and right end point, and , of the support of satisfy
as . In addition,
We now proceed to prove the convergence of the potential of . The potential of is
where is the identity matrix. We will prove
as . Observe that by the fourth moment condition
where denotes the maximum eigenvalue of . It follows that for any and sufficiently large
Here we do not present the proof of the convergence of to with the desired convergence rate for each . Indeed, the rank inequality (see Theorem 11.43 in ) can be used to re-centralize and then Lemma 10.15 in provides the convergence rate under the assumption .
On the other hand, by (3.4) and Borel-Cantelli lemma,
Here we take in (3.4). One should observe that in Theorem 5.1 in can be dependent on , so does in Theorem 2. Moreover, from Lemma 4.2 in one can conclude that
So for all large , almost surely is compactly supported on the disk . Here we have used the fact that all the eigenvalues of an matrix are dominated by the largest singular value of the same matrix. Consequently Theorem 1 follows from Lemma 3 combined with Lower Envelop Theorem and Unicity Theorem for logarithmic potential of measures (see Theorem 6.9, p.73, and Corollary 2.2, p.98, in ).
Acknowledgments
The authors would like to thank Prof. Z. D. Bai for his helpful discussions when we read Chapter 10 of Bai and Silverstein’s book.