On Bernoulli Decompositions for Random Variables, Concentration Bounds, and Spectral Localization
Michael Aizenman, Francois Germinet, Abel Klein, Simone Warzel
Introduction
This article has a twofold purpose. As a general observation it is noted that in any random variable one may find a Bernoulli component. A decomposition which is based on the above observation allows then to extend results which for systems of Bernoulli variables are available by combinatorial methods to systems of random variables of arbitrary distribution.
A Bernoulli decomposition of a real-valued random variable is a representation of the form
where and are functions on , the variable is uniformly distributed in , and is a Bernoulli random variable taking the values with probabilities independently of . The relation in (1.1) is to be understood as expressing equality of the distributions of the corresponding random variables.
Bernoulli decompositions are constructed here for arbitrary random variables of non-degenerate distributions. For certain purposes it is useful to have positive uniform conditional variance of the Bernoulli term, i.e.,
We present such a representation below and discuss related issues of optimality.
Two applications mentioned here: i. anti-concentration bounds for monotone, though not necessarily linear, functions of independent random variables, and ii. a proof, based on the Bernoulli case [BK], of spectral localization for random Schrödinger operators with arbitrary probability distributions for the single site coupling constants.
In the first application, we consider functions of independent non-degenerate random variables whose distributions are either identical or, in a sense explained below, are of widths greater than some common . It is shown here that if for some the function satisfies
with a constant which depends on the uniform bounds on the distributions of . The proof employs the Bernoulli representation along with the combinatorial bounds of Sperner [S], and the more general LYM lemma [E].
The use of combinatorial estimates for concentration bounds first appeared in the context of Bernoulli variables in P. Erdös’ variant of the Littlewood-Offord Lemma [Er]. The presence of a Bernoulli component in any random variable was noted implicitly in the work of A. N. Kolmogorov [Ko] where it was put to use in an improvement of the earlier concentration bounds of W. Doeblin and P. Lévy [DoL, Do] on linear functions of independent random variables. Initially, Kolmogorov did not extract the maximal benefit from the method by not connecting it with Sperner theory, and in particular the concentration bound in [Ko] includes an unnecessary logarithmic factor; the corresponding improvement was made by B. A. Rogozin [R1]. The bounds were further improved in a series of works, in particular [Es, K, R2] where use was also made of other methods. One may note here that perhaps quite naturally a general method like the Bernoulli decomposition is not optimized for specific applications. Nevertheless, it has the benefit of providing a simple perspective on a number of topics.
In our second application, we establish spectral localization for a broad class of continuum, alloy-type random Schrödinger operators (cf. (4.1)), building on a result of J. Bourgain and C. Kenig [BK] for the Bernoulli case. The model and the results are presented more explicitly in Section 4. The main point to be made here is that the understanding of spectral localization for the Bernoulli case can be extended through the Bernoulli decomposition to random operators with single site coupling parameters of arbitrary distribution (cf. Theorem 4.2).
Bernoulli decompositions for random variables
Randomness often is in the eyes of the beholder, as probability measures are used to express averages over specified sets of rather varied nature. However, it may be true that the most elementary model underlying the basic popular perception of probability is the simple ‘coin toss’, with two possible outcomes: heads or tails, which is modeled by a Bernoulli random variable: a binary variable equal to with probability and equal to with probability .
The following statement assert that any real valued random variable has a Bernoulli component, which can even be chosen to be of uniformly positive variance.
Given a real random variable by default we shall denote its probability distribution by and let be the function defined by
One may observe that is the ‘inverse’ distribution function of , which takes values in the essential range of . It can alternatively be described by
Let be a non-degenerate real-valued random variable with a probability distribution . Then, for each , admits a decomposition of the form:
in the sense of equality of the corresponding probability distributions, where:
and are independent random variables, with a binary variable taking the values with probabilities , correspondingly, and having the uniform distribution in ,
is the monotone non-decreasing function
is the function
for at least one value of we have
Some explicit expressions for are mentioned in Remark 2.1 below. The Bernoulli component of the measure is not a uniquely defined notion, and other representations similar to (2.3) but with different distributions for the conditional variance of the Bernoulli component, i.e., for , can also be obtained. In the following construction its uniform positivity may be lost but one gains the feature that the range of values which assumes reaches up to the diameter of the support of the measure .
Let be a non-degenerate real-valued random variable with probability distribution . Then, for each , admits a decomposition of the form:
where , and the function are as in Theorem 2.1, satisfying the above (1) and (2), but instead of (3) and (4) the following holds
is the non-increasing function:
for any and such that
at the particular value we have
where the probability is with respect to the uniform random variable .
In the proofs we employ two versions of what is called here the Pac-Man algorithm for the construction of a joint distribution of a pair of random variables, of the form , whose marginal probability measures, , , satisfy
The representations (2.3) and (2.7) correspond to letting:
The two Theorems will be proven in reverse order.
This relation allows to represent, in terms similar to (2.7), as
with the random variable with the uniform distribution in $$.
Extending the above representation, we now define a pair of coupled random variables through the following functions of :
By (2.16) the random variable seen on the right side of (2.7) has the same distribution as . The statement (2) readily follows from the definition (2.1) and (2.1).
For a proof of (4’) we note that (2.9) is equivalent to
This implies for all , and hence (2.10) holds true. ∎
For the representation (2.3) we shall employ the following variant of (2.1):
In this case, both and are monotone non-decreasing in and
for all , where . Moreover, for any we have the lower bound
For a sufficient condition for the uniform positivity of let us consider the arrival/departure times:
The times are non-random and depend on and only. If
then for each we have
The collection of such that (2.22) is not empty whenever the support of the measure includes more than one point. ∎
Explicit lower bounds on . For the Bernoulli decomposition which is presented in Theorem 2.1 (i.e., based on the ‘chasing Pac-Men’ algorithm), an expression for the lower bound in terms of the distribution function of is given in (2.34) below. A simple lower bound can be obtained in terms of just the “half-time” points for the two markers. i.e., from (2.20) with :
This shows that for continuous measures one has , i.e., (2.6), for any .
At the particular value we then have and
An alternative form. For another form of a Bernoulli decomposition, with a binary random variable , let
When such a substitution is made in (2.3) the two resulting functions and are monotone non-decreasing in and is constant over each interval of constancy of . It follows that the value of can be expressed in terms of , and thus one obtains a representation of the form:
with and independent random variables, and a measurable function which is determined by and .
2. Optimality of the Pac-Man algorithm
In applications of the decomposition it is desirable to maximize the conditional variance of the binary term. We shall now address related questions from an optimal transport perspective, and in particular establish optimality, in a certain limited sense, of the ‘chasing Pac-Men’ construction.
In addition to the explicit choices presented in Theorems 2.1 and 2.2 there are other possibilities for a Bernoulli decomposition of the form (2.3). With a change of variables as in (2.1), such representations can alternatively be expressed in terms of joint distributions of the variables , with the properties listed in the following definition.
where , and for .
The minimal conditional variation is maximized by the ‘chasing Pac-Men’ algorithm which is presented in the proof of Theorem 2.1, i.e. for any Bernoulli decomposition
where yields the same value as .
The maximal conditional variation is maximized by the ‘colliding Pac-Men’ algorithm of Theorem 2.2, for which equals the diameter of the essential support of .
The equality: is a simple consequence of the left-continuity property of the chasing Pac-Men algorithm, where and hence also .
To prove (2.32) let us first establish a helpful expression for . Denoting by the distribution functions corresponding to and of (2.1) we have:
For the ‘chasing Pac-Men’ construction, of Theorem 2.1:
The statements (2.33) follow directly from the definition of the Pac-Man process (2.1). In the derivation of (2.34), we shall use the fact that for all and :
It follows that for any :
and therefore . Thus: .
which implies that . Therefore
It follows that , which completes the proof of (2.34). ∎
The second assertion is an elementary consequence of (2.8). To prove (1) we shall show that for any it is also true that .
The condition (2.30) readily implies that , or , and hence
Eq. (2.42) means that and . Since the probabilities of the two events add to less than the complement of their union is of positive probability, and this implies:
and hence . This concludes the proof of (2.32). ∎
The idea of seeking optimal joint realizations of random variables with constrained marginals has allowed to present a wide range of analytical results from a common ‘optimal transport’ perspective (see, e.g., [V]). The most familiar variants of the problem concern couplings which minimize a distance function between the two coupled variables. As our discussion demonstrates, it may also be of interest to seek couplings which maximize the difference between the two variables with constrained marginals.
Concentration Bounds
We shall now demonstrate how the Bernoulli decomposition yields probabilistic bounds from combinatorial results. If there is any novelty in this section it is in the formulation of the bounds for the non-linear case, as the two main ideas were noted before in the context of linear functions: P. Erdös [Er] observed that concentration bounds for linear functions of Bernoulli variables can be derived from the combinatorial theory of E. Sperner [S], and B. A. Rogozin [R1] has used the Bernoulli decomposition of A. N. Kolmogorov [Ko] for the further extension of these bounds to arbitrary random variables.
First, we present some essentially known results of Sperner theory; in the second subsection these results will be combined with the Bernoulli decomposition to yield concentration bounds for functions of independent random variables.
The configuration space for a collection of Bernoulli random variables is partially ordered by the relation defined by:
A set is said to be an antichain if it does not contain any pair of configurations which are compatible in the sense of “”. The original Sperner Lemma states that for any such set: . A more general result is the LYM inequality for antichains (cf. [An]):
where .
The LYM inequality has the following probabilistic implication.
Let be independent copies of a Bernoulli random variable with
where . Then for any antichain :
where , is the standard deviation of , and is an independent constant which does not exceed .
Let be the subset of consisting of configurations with . Then:
where is the binomial distribution, and the inequality is by (3.2). The maximum of over , which is known to occur near (cf. [F, Theorem 1 on p. 140]) yields (3.4). ∎
The bound (3.4) has the virtue of being valid for all ; for it holds with a smaller constant which tends to the asymptotic value (implied by (3.5) and Stirling’s formula).
Following is an extension of Lemma 3.1 to the case of non-identically distributed random variables.
Let , where are independent Bernoulli random variables with possibly different values of , and set
Then, for any antichain :
where is an independent constant which does not exceed .
The proof gives us the chance to introduce the technique of ‘double sampling’.
We start from the observation that any Bernoulli variable with parameter as in (3.3) may be decomposed in terms of two independent Bernoulli variables and as
By the definition of , eq. (3.6), for all . Hence the variables may be represented as in (3.8) with independent identically distributed (iid) Bernoulli variables with common . We abbreviate this representation as . Evaluating the probability by first conditioning on the values of , one has
For specified values of the variables , the event depends only on the values of with in the set , and as such it is an antichain in . Bounding its conditional probability by Lemma 3.1 we obtain
where is the common standard deviation of .
The event is of exponentially small probability, as can be seen by a standard large deviation estimate for independent variables. It then readily follows that
with a constant for which elementary estimates yield . ∎
For completeness it should be added that in addition to the anti-concentration upper bounds it is of interest to know the asymptotic behavior. That is covered by known results, such as is presented in Engel [E, Theorem 7.2.1]:
which amounts to a ‘local’ central limit theorem (CLT).
2. Concentration Bounds for Functions of Independent Random Variables
We shall now employ the Bernoulli decomposition of Section 2, along with the results presented in the previous subsection, for an upper bound on the concentration probability
where are independent random variables.
Let be a collection of independent random variables whose distributions satisfy, for all :
where can also be replaced by the constant of (3.7).
We start by selecting by the condition . Next, we represent the variables using Theorem 2.2:
with a collection of iid Bernoulli variables taking values with probability . From (2.10) one may conclude that for all :
By virtue of (3.17), the set is an antichain in its dependence on with . Lemma 3.1 thus yields
with . We conclude by the large-deviation argument used in the proof of Lemma 3.2. Using (3.20) the expected value of is bounded below:
Therefore is a large deviation event and its probability is exponentially bounded. Elementary estimates lead to
with the same constant as in (3.7). ∎
A simpler proof for iid variables. For iid non-degenerate random variables the theorem has a simpler proof using the binary decomposition of Theorem 2.1; there is no need for the large deviation argument. The constants in the theorem will then depend on the value of and its corresponding lower bound in (2.6).
concentration inequalities as in (3.18) go back to W. Doeblin, P. Lévy [DoL, Do], P. Erdös [Er] (for the Bernoulli case, where it reduces to the Littlewood-Offord problem), A. N. Kolmogorov [Ko], B. A. Rogozin [R1], H. Kesten [K] and C. G. Esseen [Es]. In this case, sharper inequalities than (3.18) are known, e.g. [R3],
where is some constant. A recent application of the discrete case of the concentration bounds is found in [TV].
An extension. As it is already true for (3.27), the statement of Theorem 3.1 has an immediate extension to functions which in some variables are monotone increasing and in some are monotone decreasing, satisfying the natural analog of (3.17). For this extension, one only needs to replace and in (3.18) by .
and for which if and only in .
An Application to Random Schrödinger Operators
As a demonstration of a possible uses of the elementary observations which are made in this article, let us present the case of spectral localization under random iid single site potential for an arbitrary probability distribution.
The (continuum) Anderson Hamiltonian is the random Schrödinger operator given by
Although definitions of localization may come in several flavors, they all include (or imply) spectral localization (i.e., pure point spectrum), as given in the following definition.
This property is clearly invariant under translations. The defining condition is equivalent to the requirement that for a spanning set of vectors the spectral measure is pure-point within . The set of for which this holds for the random operator is known to be measurable.
In the one-dimensional case the continuous Anderson Hamiltonian has been long known to exhibit spectral localization in the whole real line for any non-degenerate , i.e. when the random potential is not constant [GoMP, DSS]. In the multidimensional case, localization at the bottom of the spectrum is already known at great, but nevertheless not all-inclusive, generality; cf. [St, Kl, BK] and references therein. The Bernoulli decomposition presented here allows to prove localization for general non-degenerate single site distributions .
More explicitly, the simplest case to deal with, for the different approaches which yield proofs of localization, has been when the single site probability distribution is absolutely continuous with bounded derivative. The absolute continuity condition can be relaxed to Hölder continuity of , both in the approach based on the multiscale analysis which was introduced in [FrS] and is discussed in [Kl], and in the one based on the fractional moment method of [AM, AE+]. (The basis in the former case is an improved analysis of the Wegner estimate, which can be found in [St, CHK].) However, techniques relying on the regularity of seem to reach their limit with log-Hölder continuity. In particular, until recently the Bernoulli random potential had been beyond the reach of analysis in more than one dimension. For that extreme case, i.e., of with , localization at the bottom of the spectrum was recently proven by Bourgain and Kenig [BK]. A crucial step in the analysis of [BK] is the estimation of the probabilities of energy resonances using Sperner’s Lemma, i.e., the version of (3.4).
The point which we would like to make here is that the Bernoulli decomposition of random variables enables one to turn the latter result of Bourgain and Kenig [BK] into a tool for a general proof of localization at the edge of the spectrum for arbitrary non-degenerate .
where is as in (4.2), satisfying the above condition (1), but instead of (2):
Due to the presence of the background potential the spectrum of need not be deterministic, i.e., equal to some fixed set with probability one. For our main purpose it would suffice to restrict attention to for which the spectrum of is almost surely . Such restriction is not included in the following statement but instead there is a caveat in the conclusion.
The extended BK result, whose proof is presented in [GK], is:
Given a function as above, and: , and , there exist such that any random operator of the form (4.4), satisfying conditions (1), (2’) and (3), for otherwise arbitrary external potential , with probability one, either exhibits spectral localization in or .
Theorem 2.1 allows now to deduce the following general statement from the above non-trivial Bernoulli result.
Let be a Schrödinger operator with the random potential given by (4.2), satisfying the above conditions (1) and (2). Then for some the operator , with probability one, exhibits spectral localization in .
The Bernoulli decomposition (2.3) allows to write the coefficients in the random potential in the form:
As a consequence, the random operator can be written as:
This implies that when conditioned on the values of the operator is of the form (4.4), with , and independent of . Thus, by Theorem 4.1 there exists such that when conditioned on with probability one, either exhibits spectral localization or has no spectrum in . However, the latter is excluded (almost surely, also with respect to the conditional probability) by (4.3) and Fubini. ∎
In addition to the spectral localization it is also of interest to establish the existence of uniform localization length, i.e., to prove that all eigenfunctions of with eigenvalue in satisfy
This can be accomplished in the following two ways, for which the details are presented in [GK].
To establish uniform localization length under the hypotheses of Theorem 4.2 one may use the Bernoulli decomposition (4.6) before performing the multiscale analysis which is behind the proof of Theorem 4.1. The multiscale analysis is then executed for the random Schrödinger operator in (4.7), in such a way that all events in the analysis are jointly measurable in and .
An alternative proof of Theorem 4.2, which yields also uniform localization length, can be based on the concentration bound of Theorem 3.1. Namely, the Bourgain-Kenig proof can be extended to arbitrary single site probability distribution , with the probabilities of energy resonance estimated by the concentration bound instead of by Sperner’s Lemma as in [BK] (see [GK]).
Acknowledgements
We thank the Oberwolfach center for hospitality at a meeting where the four-way collaboration started, and the Isaac Newton Institute where some of the work was done. We also thank B. Sudakov for an instructive review of the recent results in Sperner’s theory, S. Molchanov for alerting us to relevant references, and M. Cranston for many helpful discussions of results in probability theory. This work was supported in parts by the NSF grants DMS-0602360 (MA), DMS-0457474 (AK) and DMS-0701181 (SW), and a Rothschild Fellowship at INI (MA).