On reverse hypercontractivity
Elchanan Mossel, Krzysztof Oleszkiewicz, Arnab Sen
Introduction
Log-Sobolev and hypercontractive inequalities play a fundamental role in a number of areas in analysis and probability theory including the study of Gaussian processes (see, e.g., [Gro78, Jan97]), analysis of Markov chains (see, e.g., [SC97]) and discrete Fourier analysis starting in [KKL88, Tal94].
The strength of a simple hypercontractive inequality like (1.1) lies in the fact that it tensorizes. This led to many applications in discrete Fourier analysis (starting with [KKL88]) and even earlier in the study of Gaussian processes. Extending (1.1) to other spaces turned out to be a non-trivial task. For the case of the spaces , with , the first bounds were established by Talagrand [Tal94]. Exact formulas have been obtained by Oleszkiewicz [Ole03] in the cases where either or . Wolff then extended these results [Wol07] to general discrete spaces and, in a slightly less precise form, to all and all : let be a finite probability space with ; then there exists some universal positive constant such that for as above and certain , given by an explicit though complicated formula,
A ‘reverse’ hypercontractivity is shortly proved and discussed in a paper by Borell [Bor82] in the 80’s. This result, proven for the measure , states that
This inequality which also tensorizes is indeed ‘reverse’ in many ways. Not only the inequality goes ‘the other way’ and the roles of and get reversed, it is also the case that and are less than (indeed they may be negative(!); note, however, that the function has to take positive values).
As far as we know, Borell’s result was first used in a paper published more than 20 years later [MOR+06], where it is used to analyze mixing of short random walks on the discrete cube as well as to provide tight bounds on the Non-Interactive Correlation Distillation (NICD) problem.
Motivated by generalization of applications in [MOR+06] as well as by other applications that will be discussed later, we wish to extend Borell’s results to other discrete probability spaces. Noting the similarity of the inequalities (1.1) and (1.2) it is tempting to conjecture (as the first named author have done) that the formulas for hypercontracitivity and reverse hypercontractivity are ‘the same’: in particular, for discrete spaces there is a dependency on the size of the smallest atom in space as in the above-mentioned results for hypercontractivity. The conjecture is further supported by the fact that for diffusions both hypercontractivity and reverse hypercontractivity are equivalent to the standard log-Sobolev inequality (for more details see [Bak94]; some pioneering results relating hypercontractivity to reverse hypercontractivity were obtained already in [BJ]).
The conjecture turns out to be far from true. In fact our results show that for every discrete probability space :
In particular, reverse hypercontractive inequalities hold uniformly for all probability spaces.
It is well known that hypercontractive inequalities are intimately related to logarithmic Sobolev inequalities and our proof of (1.3) is based on extension of this connection to ‘norms’ (such extensions were noted before, see, e.g., Bakry’s lecture notes [Bak94]). At the heart of the proof is a new monotonicity result showing that under the appropriate normalization log-Sobolev inequalities are monotone in the norm parameter for all . This result in turn is based on an extension of the Stroock-Varopoulos inequality to general norms. The result allows us to show how reverse hypercontractive inequalities follow directly from standard hypercontractive inequalities and furthermore from standard log-Sobolev and modified log-Sobolev inequalities.
After we develop the theory of reverse hypercontractive inequalities, we derive a number of novel results regarding mixing of Markov chains run for short time starting from large sets, in general cubes, the symmetric group and Ising configurations (via Glauber dynamics). We further derive a quantitative Arrow’s Theorem for general distributions and inverse polynomial bounds for the NICD problem for general -sided dice. We proceed with formal definitions and statements of the main results.
2. General setup
for any , and any such that on , there is .
Alternatively, one can replace the fourth condition by the non-negativeness of the carré du champ (as a function-valued quadratic form), i.e., for . The Markov semigroup of operators generated by is given by
Recall that in this setup we have for and for . The operators are symmetric linear contractions in -norm for every and . They are mean-preserving, i.e.,
Recall that is a true norm for but it is only a pseudo-norm (triangle inequality fails) for (unless ). It is an easy and well-known fact that for any the map is continuous and non-decreasing.
Note that the map is a continuous order-reversing involution on and with fixed points and . It is worth observing that for , even though we will not make use of this fact.
3. Log-Sobolev inequalities
We now recall the definition of log-Sobolev inequalities.
for every . We will say that -logSob is satisfied with constant if
for . Finally, we will say that -logSob is satisfied with constant if
for every .
Logarithmic Sobolev inequalities were introduced by Gross in his seminal paper [Gro75]. Gross defined logarithmic Sobolev inequality for . The definition was later extended by Bakry [Bak94] to any real (including -logSob inequality). Finally, we remark that -logSob inequality is also known in the literature as modified log-Sobolev inequality (see, e.g., [Wu00, GQ03, Goe04, BT06]). The 1-logSob inequality is also called “entropic inequality” as it implies the exponential decay of entropy along the semigroup.
Our definition uses a novel and non-standard normalization factor in (1.4). The choice of this normalization makes our -logSob constants invariant under Hölder conjugation (see Lemma 3.2). Moreover, this normalization is crucial to prove the main result of the paper - the monotonicity of the inequality for (see Theorem 1.7).
In our main result we prove a general result relating -logSob inequalities for different values of .
Let . Assume that -logSob holds with a constant . Then also -logSob holds true with the same constant .
It has been proved in [Bak94, Proposition 3.1] that if -logSob holds with constant , then any -logSob also holds with the same constant and for the converse is true in case of diffusions with invariant measure .
Using the fact that simple operators satisfy -logSob with the constant (proved in [BT06]; the proof is reproduced in our Lemma 3.5 below) we obtain the following corollary:
4. Reverse hypercontractive estimates
Using Theorem 1.7 we derive the following general reverse hypercontractive bounds:
If a symmetric Markov semigroup satisfies -logSob with constant and then for all and every for all we have .
Using Corollary 1.9 this implies in turn that:
In fact, for simple operators we derive the following stronger result:
The reverse hypercontractive inequality (1.2) for a simple operator and the space with the uniform measure was derived prior to ours by Borell. His result is tight.
5. Application 1: Mixing of large sets in Markov chains
Our first application of the new inequality is to mixing of Markov chains from large sets. The statement and proof of the theorem below are a generalization of the main result of [MOR+06] where it was proven for the random walk on the discrete cube .
First, the Expander Mixing Lemma (see, e.g., [AS08, Chapter 9]) implies that if Poincaré inequality holds with constant then:
The inequality (1.6) will be better (up to constants) than our inequality (1.5) in the case where the sets and are large, say , since in this case we obtain the lower bound of which is (except for the factor ) the best that one can hope for. However, in the case where the sets and are small, say , the expander mixing lemma gives nothing while (1.5) gives a lower bound that is a power of the measures of the original sets.
The second technique uses total variation mixing times. Indeed, if the worst total variation distance at time is at most , then we have:
Again - applying this bound requires that one of the sets or is large (of measure at least ). Moreover, in many examples the time when the total variation distance is at most is much larger than the -logSob constant . Therefore if is of order , then the mixing time bound (1.7) gives nothing while our result (1.5) gives an efficient lower bound.
We demonstrate this point by proving new mixing bounds from large sets for various classical Markov chains, including:
Short random walks on general product spaces. In this case we derive tighter results in subsection 9.1.
The random transposition card shuffle on the symmetric group. Here it is known that hat the 1-logSob constant of this chain is of order [GQ03, BT03, Goe04] while the mixing time is . Thus again, we obtain new results on mixing from large sets. Similar logic applies to the Top-to-random transposition walk on symmetric group, see [Goe04, DFP92] for the 1-logSob constant and the mixing time. We provide the details in subsections 9.4 and 9.5.
Random walk on the spanning trees of certain graphs. See subsection 9.6.
The Bernoulli-Laplace model. See subsection 9.7.
A natural Markovian queueing process - the Markov process. The last example is interesting since it has infinite -logSob constant and an infinite mixing time. More details on this example are given in subsection 9.2
6. Application 2: A general quantitative Arrow theorem
Arrow’s Impossibility Theorem [Arr50, Arr63] is a fundamental result in social choice theory. It considers voters who rank candidates. Arrow considered functions that aggregate individual rankings (elements of the permutation group ) to result in a preference between every pair of the alternatives. Arrow showed that if the following desired properties hold simultaneously when :
Transitivity - induces a transitive ranking for all ,
Unanimity - for every pair of alternatives and , if all voters rank above then also ranks above ,
Independence of irrelevant alternatives (IIA) - for every pair of alternatives, the resulting outcome regarding the preference between and is determined by the individual preferences between and ,
then is a dictator function, i.e., it is determined by a single voter.
It is natural to ask how robust is the result when considering natural distributions over . This question was analyzed by Kalai [Kal02] who studied it for the case of the uniform distribution over and showed that for every , there exists a such that if satisfies:
Following a challenge by Kalai, Mossel [Mos12] proved a stronger result for any number of alternatives and without the assumption that is fair. His result shows that for and every , there exists a such that if satisfies
A key ingredient of the proof in [Mos12] is the use of reverse hypercontractive inequalities. It is further noted in [Mos12] that it should be possible to extend the proof to general product distributions on given appropriate reverse hypercontractive bounds for general two point spaces. Our results imply the following extension.
We note that considering general product distributions gives a more realistic model of actual voting (though the independence assumption in this line of work is still problematic in real voting scenarios).
7. Application 3: Non-interactive correlation distillation from dice source
The problem of non-interactive correlation distillation deals with players who receive correlated random strings and whose collective goal is to agree with the highest possible probability on a random variable with a given distribution. Suppose there are players and a ‘cosmic source’. Assume first that the source generates a string of i.i.d. bits. Each player gets to receive an independent noisy copy of . Each player then produces a single random bit based on her input. The players wish to have unanimous agreement on their outputs but are not allowed to communicate. The problem is to understand to what extent the players can successfully ‘distill’ the correlations in their strings into a shared random bit.
where the supremum is taken over all choices of balanced functions . Since a balanced function defined on variables can be also thought of a balanced function of variables, for a fixed and , is a non-decreasing function of and so, exists. One of the main results of [MOR+06] says that when , we have
The upper bound of the above result uses an application of reverse hypercontractivity for simple semigroup on symmetric two-point space. Here we generalize this bound and give an inverse polynomial bounds (in ) on the agreement probability for general .
Fix . Then there exist positive constants and such that for all ,
The first named author enjoyed the hospitality of Isaac Newton Institute, Cambridge while completing part of this research. The second named author enjoyed hospitality of University of California, Berkeley and Isaac Newton Institute, Cambridge while doing this research. We thank Dominique Bakry, Franck Barthe, Nick Crawford, Michel Ledoux and Cyril Roberto for helpful comments and discussions. We thank an anonymous referee for numerous helpful suggestions including suggesting simpler proof of Lemma 2.3.
Comparison of Dirichlet forms
The following theorem extends the classical Stroock-Varopoulos inequality [Str84, Var85] (covering the case , of the present result). Theorem 2.1 is the main tool in proving Theorem 1.7. Note that some terms in the statement below may take negative values.
Let and . Then
for every .
The above result has a natural extension to the case or , with replacing the right (resp. left) hand side of the asserted inequality; then it suffices to use functions and (or and , respectively) in the proof. One can also simply pass to the limit.
The proof of the theorem will use the following lemmas.
for all . Then for every there is
where by we denote , etc.
for all . Then for every there is
is nonnegative. Clearly, and for all . Now it is enough to notice that the assumptions of Lemma 2.4 yield which implies that is non-decreasing on and non-increasing on . ∎
It suffices to use Lemma 2.4 with , , , , and . Indeed, to verify the assumptions of Lemma 2.4 one needs to check whether for all ,
This is, however, obvious since the function is even and convex for every and thus it is non-decreasing on . Choosing and recalling that ends the proof. ∎
For any there is
It follows immediately from Lemma 2.4 applied to with , , , and . ∎
For any positive , the function is log-convex on the real line: either it is positive and its logarithm is convex, or it is identically equal to zero (if is constant). It is also obviously symmetric with respect to , so that it is non-decreasing on , which is a re-formulation of Theorem 2.1. Indeed, the log-convexity follows easily from the formula (2.1) and Hölder’s inequality, if one can first prove that the functions and, equivalently, are log-convex for any pair of fixed nonnegative numbers . This, however, is an immediate consequence of the identity and Hölder’s inequality. We skip standard discussion of the cases and .
Logarithmic Sobolev inequalities
In this section we prove various properties of log-Sobolev inequalities and in particular Theorem 1.7. We begin with a simple claim relating -logSob to the Poincaré inequality. We suspect that both Lemma 3.1 and Lemma 3.2 below were previously known in the literature but we did not find any explicit reference.
-logSob holds with constant if and only if the standard Poincaré inequality holds with constant , i.e.,
For and set . Assuming that satisfies -logSob with constant we obtain
By the homogeneity of variance and bilinearity of we get
On the other hand, let be positive and assume that the Poincaré inequality holds with constant . By using it for we arrive at
The following easy observation allows us to restrict study of the -logSob inequalities to the case (also, it reveals that -logSob is, in a sense, a replacement for -logSob).
For there is nothing to prove, whereas for it suffices to notice that by setting we obtain an equivalent ‘self-dual’ version of -logSob:
We now prove Theorem 1.7 using the extension of the classical Stroock-Varopoulos inequality proven in Theorem 2.1.
It is a direct consequence of the ‘self-dual’ reformulation (3.1) of -logSob, Theorem 2.1, and Remark 2.2. The fact that -logSob with constant implies -logSob (with the same constant) for every may be proved in two natural ways. One can deduce the Poincaré inequality with constant from -logSob by setting and letting tend to zero (as in the first part of proof of Lemma 3.1, and use Lemma 3.1 to finish the argument). Alternatively, one can first deduce from -logSob the -logSob inequalities (with the same constant) for arbitrarily close to zero, and then simply apply limit transition . ∎
In view of Lemma 3.1 and Theorem 1.7, the -logSob inequalities, , can be treated as a family interpolating in a continuous and monotone way between the classical Poincaré and logaritmic Sobolev inequalities. Another approach to the interpolation problem may be found in [LO00]. Relation between the two approaches seems unclear to the present authors and perhaps it deserves some further investigation.
However, it is well known that all the -logSob inequalties for are in a sense equivalent, at least if we do not care too much about constants (we do not know whether all -logSob inequalities for are equivalent in a similar sense).
Let . Assume that -logSob holds true with a constant . Then also -logSob holds true, with constant .
It follows from [Bak94, Proposition 3.1] that in case of diffusions with invariant measure any -logSob implies any -logSob with the same constant. However, we did not find in the literature any reference to the results of the same form as Proposition 3.3 regarding reversible Markov chains. On the other hand, one can first deduce from -logSob a hypercontractive inequality and then deduce -logSob from it, which in turn yields -logSob. This way around was known before but it yields much worse estimates.
Indeed, since it suffices to prove that for every positive , which follows easily from Lemma 2.3 applied to , , , , and . The inequality
Since for every the function is non-decreasing on , we finish the proof by setting and noting that . ∎
Usually it is not easy to prove the classical logarithmic Sobolev inequality (-logSob in our notation). On the other hand, the following lemma provides a modified logarithmic Sobolev inequality (-logSob in our notation) for a large class of simple semigroups.
The -logSob inequalities obviously share the tensorization property of the classical logarithmic Sobolev and Poincaré inequalities. This is a standard observation but we include it here for reader’s convenience. For assume that is a finite (this assumption may be relaxed) probability space with an associated space of real functions on , and a Markov semigroup generated by a self-adjoint positive semi-definite operator (all of them enjoying properties described in the Preliminaries section). Now let us consider a new semigroup of operators acting on a space of real-valued functions on a product probability space
We obtain it by defining its generator as
Equivalently, we may define it by setting, for ,
We skip the proof, referring the reader to the classical tensorization argument: subadditivity of entropy (or variance, if ). ∎
Hypercontractivity
Since, as explained in the preliminaries, is also strictly positive, we may apply to it the -logSob inequality, which will yield monotonicity of the map upon appropriate choice of the function .
2. Hypercontractivity estimate
Let and let be a symmetric Markov semigroup.
Assume that satisfies -logSob with constant . Let or . Then for every and every there is . In other words, is a linear contraction from to .
Conversely, if there exists such that
for all and such that , and for all positive then sastisfies -logSob with the constant .
That the concepts of logarithmic Sobolev inequality and hypercontractivity are intimately connected goes back to Gross [Gro75]. In fact, the converse part of the above proposition follows from Theorem 1.2 of [Gro75] though we add a short proof here for the sake of completeness. But the hypothesis of the forward direction (-logSob implies hypecontractivity) of our proposition is weaker than that of [Gro75] since [Gro75] assumes that -logSob holds for a nonempty open interval - see Theorem 1.1 of [Gro75] for more details. We also comment that for we recover the part (i) and (ii) of Theorem 3.5 of Diaconis and Saloff-Coste [DSC96] on the classical equivalence of the logarithmic Sobolev inequality and hypercontractivity for the reversible Markov chains (with essentially the same proof).
In the proof of the first assertion without loss of generality we can assume that - indeed, since is order preserving, the pointwise inequality implies that pointwise, and thus whereas and have the same -th norm. Furthermore, without loss of generality we may assume that is strictly positive (which follows by considering functions instead of and then letting ).
Theorem 1.7 and Lemma 3.2 imply that satisfies -logSob with constant for all . Let , so that . Then and (4.1) together with the -logSob imply that the map in non-increasing on . Comparing its values at the ends of the interval we arrive at for , where . To finish the proof of the first assertion for it suffices to express as , and use the fact that the semigroup is contractive in -norm ().
To prove the second assertion let us fix some and some positive . For let , so that . Since the map is non-increasing on by using (4.1) at we infer that -logSob holds true with the constant . Passing to the limit ends the proof. ∎
Reverse hypercontractivity - preliminary results
In this section we prove some preliminary results regarding reverse hypercontractivity.
We first state the following corollary of Jensen’s inequality establishing ‘reverse contraction’:
Indeed, may be expressed as infimum of a family of affine functions:
2. Duality and tensorization
The standard statement of the duality of -norms is that for and we have
A slightly less known observation can be found in [Bor82]:
Let . Then for any positive there is
We skip its proof since it is an easy exercise.
The standard duality of the -norms implies that is Banach space dual to for any , and from the symmetry of the semigroup we deduce that
The case is less standard and a bit more delicate (in particular, note that this is no longer the Banach space setting). We will need the following auxiliary result which was previously used by Borell [Bor82].
Let and . Assume that for every positive . Then also for every positive .
where we have used Lemma 5.2, the symmetry of , assumptions of the proposition, and again Lemma 5.2. ∎
Assume the set-up of Subsection 3.1. Let . If for each , for all positive functions , then for all functions .
The proof is an easy modification of the standard argument for showing the usual hypercontractive inequalities tensorize where Minkowski inequality is to be replaced by the reverse Minkowski inequality (Lemma 5.1). We omit details. ∎
Reverse hypercontractivity - general results
We establish an analogue of Proposition 4.1 for and below , extending results of Borell, [Bor82]. Now we restrict our considerations to positive functions.
Let and let be a symmetric Markov semigroup.
Assume that satisfies -logSob with some constant . Let . Then for every and every positive there is .
Conversely, if there exists such that
for all and such that , and for all positive then satisfies -logSob with the constant .
Theorem 3.3 of Bakry’s lecture notes [Bak94] established similar equivalence between reverse hypercontractivity and -logSob when . Indeed the converse part of Proposition 6.1 follows from that. But the forward direction, which turns out to be more useful in practice, Theorem 3.3 of [Bak94] assumes that -logSob holds for all belonging to some nonempty open interval instead of a single point.
Let us divide the proof of the first assertion into two basic cases: and (and in fact we will need to prove only first of them since the second follows then by Proposition 5.3). Once they are proved, the assertion for and will follow by passing to a limit ( and , respectively), while the case will follow from
since for (we "glue" the two cases together at zero).
Let us assume , then. Consider a function defined on . Then and , so that by (4.1) the map is non-increasing on because -logSob implies -logSob, with the same constant , by Theorem 1.7. At the right end of the interval the map takes on the value , so that for . For we simply express as and use Lemma 5.1.
To prove the converse assertion, let us fix some and a positive . For let , so that . Since the map is non-decreasing on formula (4.1) used at yields -logSob with the constant . Passing to the limit ends the proof. ∎
We can now prove Theorem 1.10. In fact we will prove the following result which includes an inverse.
If a symmetric Markov semigroup satisfies -logSob with constant and then for all and every positive for all we have .
Conversely, if for some a symmetric Markov semigroup satisfies for all and all positive then it also satisfies -logSob with the constant .
By Theorem 1.7 for all also -logSob holds, with the same constant . The assertion follows immediately from Proposition 6.1.
The converse assertion is easy - Proposition 6.1 implies that satisfies -logSob with the same constant for all , and it suffices to pass to the limit (). ∎
As in [Bor82, MOR+06] we can now obtain the two function version corollary.
We conclude this section by proving Corollary 1.11.
Indeed, Lemma 3.5 and Proposition 3.7 (in the product case) imply that satisfies -logSob with constant , so that it suffices to use Corollary 6.3. ∎
Improved reverse bounds for simple semigroups
Actually, we can significantly weaken the condition in Corollary 1.11 for simple operators and prove Theorem 1.12.
It suffices to prove the claim in the case - Proposition 5.3 together with an observation that for there is and
It is easy to check that is a convex function with and (actually, the same properties hold true in the case , and in the case with , but we will not need those). The inequality
holds true for every . Indeed, due to the properties of listed above it suffices to prove that
which immediately follows from the elementary inequality , and from the fact that the map
which ends the proof - recall that the exponent is negative. The first inequality above was just an application of the elementary , with , . The last inequality follows from the fact that obtains its minimum at .
The case follows by an obvious limit transition. ∎
Note that we could obtain a better reverse hypercontractivity constant than those given in Theorem 1.12 by first maximizing the function over and then by trying to solve for in terms of and such that (7.2) holds. This would lead to an equation of the form
But unfortunately, in general, can not be recovered explicitly from the above equation. However, in the special case when , can explicitly be solved as
as and, equivalently, . Thus, under assumptions of Theorem 1.12 about the semigroup, there exists a function given by , with as , such that for all and positive we have for every . Also, by duality, there exists a function given by , with as , such that for all and positive we have for every .
for all .
where we used Theorem 1.12 in the first and the second inequality and Lemma 5.1 in the third inequality. ∎
We now obtain the following corollary regarding -correlation.
Consider a product space where are finite probability spaces. We say that are -correlated if is distributed according to and the conditional distribution of given is given as follows: for each independently, with probability , and with probability , is sampled independently from .
Let be the product probability space in Definition 7.3. Let be two sets such that . Let be distributed according to the product measure and be a -correlated copy of for some . Then
Let and be the characteristic functions of the sets and respectively. Note that
for all such that . We now take in (7.6) to conclude the proof. ∎
We can also use Corollary 6.4 which deals with general symmetric Markov semigroups to get a lower bound . But this bound is worse than what we have achieved by using Corollary 7.2 that improves on the bounds provided by Corollary 6.4 in the case of simple semigroups.
which holds for all . We skip some tedious but straightforward calculations.
Under assumptions of Lemma 7.4 we also have
where is some universal constant. This is a significant strengthening when is close to , especially in view of Remark 7.6.
Indeed, it suffices to notice that in the proof of Corollary 7.2 one can take and , using Remark 7.1 rather than Theorem 1.12. Thus (7.4) holds true for all . Let us set . The asymptotic behavior of established in Remark 7.1 implies that as . Thus, by choosing the constant large enough and close enough to , we prove that for there is , i.e., , and therefore (7.4) holds true for . By repeating the proof of Lemma 7.4 we arrive at
for . This, together with (7.5) used for , yields (7.7).
A similar asymptotic strengthening applies to many further results of the next two sections (whenever one deals with simple semigroups and their tensor products, and also in Section 8 for close to zero) but we will omit these generalizations for the sake of brevity.
Reverse hypercontractivity for some non-simple operators
For some of the applications afterwards we will be interested in operators that are not necessarily simple but are obtained by composing a simple operator with a non-simple operator. In this section we extend some of the reverse hypercontractive results to this setup.
Assume that is a finite probability space and is Markov kernel on . Let and
Thus is Markovian and the kernel can be written as composition of two Markov kernels in the following way:
Using the decomposition (8.2), by Theorem 1.12 we obtain
Consider the set-up of Proposition 8.1. Then for all and all nonnegative , we have
for all .
where and are -valued random variables.
Let and be the characteristic function of the sets and respectively. Note that
for all such that . We take to conclude the proof. ∎
The following example shows that the condition cannot be dropped in general. Take and to be the unbiased Bernoulli measure on . Let the kernel be as follows:
Mixing of Markov chains for big sets
In this section we prove Theorem 1.14 which establishes mixing for Markov chains satisfying -logSob. We then give a number of examples where the theorem can be applied to yield new results on mixing of Markov chains starting from big sets. We begin with a proof of the theorem:
Take and to be the characteristic functions of and , respectively. Then by Corollary 6.4, for any choice of with , we get
By setting and (this choice follows from a simple optimization) we conclude the proof. ∎
and the corresponding Markov semigroup can be expressed as
From Lemma 3.5, Proposition 3.7 and Theorem 1.14 it follows that:
Let be the continuous-time random walk on the general hypercube with distributed according to the product measure . Let and . Then for any with and , and for , we have
In fact, a much better bound can be obtained by repeating the proof of Theorem 1.14 with the two function bound in Corollary 6.4 which applies to simple operators and their tensors:
Let be the continuous-time random walk on the general hypercube with distributed according to the product measure . Let and . Then for any with and , and for , we have
Note that the pair is -correlated in the sense of Definition 7.3, with . Let and , so that and . By Corollary 7.2 applied to and we have
and the first inequality of the assertion follows easily. The second inequality in the assertion of the proposition is elementary. ∎
The bound of Proposition 9.2 is quite tight, especially for small values of , , and . Indeed, let us fix , choose such that and , and then define two subsets of the discrete cube, and . Now it suffices to use the CLT as in Remark 7.6 (recall that in our setting ) and observe that
while and . We skip tedious but quite standard calculations.
We note that the mixing time of the above walk is of order . Therefore using the mixing time it is impossible to obtain effective bounds even when one of the sets or has a large measure and is of order .
2. An example from queueing theory
In this subsection, we will give an example where we will show reverse hypercontractivity for Markov semigroup arising from a standard q/q/ process (defined below). We will not use any knowledge about the -logSob constants of the semigroup but establish reverse hypercontractivity by taking Poissonian limit of the reverse hypercontractive estimate for -dimensional hypercube with product Bernoulli measure (). The example is of interest for a number of reasons:
It deals with a Markov chain defined on an infinite state space.
It is an example where the -logSob and the mixing time are both infinite (see [BL98], the fact that the mixing time is infinite is trivial), yet it is possible to obtain reverse hypercontractive and mixing estimates.
It is a natural example for queueing theory.
So, as , the sequence of generators converges to the generator which is given by
Here means the convergence in distribution.
Let (resp. ) be the semigroup corresponding to the Markov process (resp. ).
Letting , by (9.2), we conclude that
Similarly by approximating the process by the process and applying Proposition 9.2, we obtain
Note again that this result holds in an example where the mixing time and -logSob constant are infinite (see [BL98] where it is shown that the -logSob is finite).
The Ising model on a finite graph has the state space . The probability of a spin configuration is given by the Gibbs distribution,
The Glauber dynamics for the Ising model is a family of continuous time Markov chains on the state space , reversible with respect to Gibbs distribution, given by the generator
where is the configuration with the spin at flipped. We consider the two examples of transition rates :
Metropolis: c(u,\sigma)=\exp\big{(}2h\sigma(u)+2\beta\sigma(u)\sum_{uv\in E}\sigma(u)\big{)}\wedge 1.
Heat-bath: c(u,\sigma)=\left[1+\exp\big{(}-2h\sigma(u)-2\beta\sigma(u)\sum_{uv\in E}\sigma(u)\big{)}\right]^{-1}.
The example above can be easily extended to other spin systems and other graphs as long as -logSob inequality is established.
4. Random transposition walk on symmetric group
The random transposition walk on the group of permutations of elements is the walk generated by the set of all transpositions . The Markov transition from any is described by picking a transposition uniformly at random from and compose it with to get a new permutation . It was shown in [GQ03, BT03, Goe04] that the 1-logSob constant of this chain is of order . More precisely,
5. Top-to-random transposition walk on symmetric group
This is a random walk on generated by the set of transpositions . Again the 1-logSob constant of this chain satisfies [Goe04]
6. Random walk on spanning trees
This is a natural random walk on the space of all spanning trees of a graph . Suppose be our current spanning tree. We choose an edge and another edge uniformly at random. If is a spanning tree of , we update to , otherwise we remain at . It was shown in [JS02] that the -logSob constant of this walk satisfies
7. Bernoulli-Laplace model
This is natural random walk on the subsets of size of the ground set , . So, the state space has size . If the current state of Markov chain is an -set , we pick an element uniformly at random from and pick an element uniformly at random from and switch the elements to obtain a new -set . This is also known as simple exclusion process on the complete graph on vertices. The -logSob constant of this chain satisfies [GQ03, BT03, Goe04]
A quantitative Arrow theorem for general ranking distributions
Our goal in this section is to prove Theorem 1.15. We begin by briefly introducing some additional notation. Let be a set of alternatives. A transitive preference over is a ranking of the alternatives from top to bottom where ties are not allowed. Such a ranking naturally corresponds to a permutation of the elements . The group of all rankings will be denoted by . A constitution is a function that associates to every -tuple of transitive preferences, and every pair of alternatives a (strict) preference between and . Some key properties of constitutions include Transitivity, Independence of Irrelevant Alternatives (IIA), Unanimity (all defined at the introduction). Recall that the constitution is a dictator on voter , if , for all , or , for all , where is the inverse of the permutation .
We begin with some notation and definitions from [Mos12].
Given and for each pair of alternatives , we define binary vectors in the following manner:
Thus, if satisfies the IIA property then there exist functions for every pair of candidates and such that
where is such that if ranks over and otherwise and where we have for all and all .
Note that for , the probability of non-transitive outcome is given by
In the rest of the subsection, we denote by , the probability mass of smallest atom of the distributions of the random vectors on for triplets of distinct alternatives .
Let form a basis of . Then we can express in its Fourier basis as follows:
We define variance-influence of variable on as
When is -valued, it can be easily checked that the above two notions of influences are equivalent up to a multiplicative factor (independent of ) as follows:
We also need the notion of low-degree variance-influences. For , this is defined as follows:
Under our assumption on the minimum atom of , it’s not difficult to show that for any three distinct alternatives and any voter , we have
The following lemma is a consequence of the reverse hypercontractivity in the biased space. It is the key ingredient needed to extend the argument of [Mos12] to the nonuniform case.
Here voter is called ‘pivotal’ for at if is a non-constant function of the variable when we freeze the other variables at .
Clearly, are i.i.d. with a joint distribution on determined by . Let and be the marginal distributions of and respectively. Note that the event is determined by and the event is determined by and the their intersection probability is determined by the joint probability distribution of the random vectors and . Let and be the subsets of defined by:
where and so that and .
The reminder of the proof is a straightforward (though somewhat tedious) generalization of the proof given in [Mos12] that does not use reverse hypercontractivity. A sketch of the modifications needed is given in Appendix A.
Non-interactive correlation distillation for dice
The proof of Theorem 1.16 is a generalization of the proof given in [MOR+06]. The proof of the upper bound uses reverse hypercontractivity while the lower bound is based on the analysis of a simple protocol that is based on the plurality function and the analysis relies the on normal approximation. Here we give the proof of the upper bound. The proof of the lower bound is an easy (if tedious) adaptation of [MOR+06] and is given in Appendix B.
Note that the probability of all players output is
where is a -correlated copy of . Let . Thus if and is the simple semigroup on with the uniform measure, then we have
On the other hand, Corollary 7.2 gives us that
If we take in the above inequality, we have
which implies that for any and sufficiently large. ∎
It is an interesting problem to find the exact exponent in Theorem 1.16 for which as . A priori such an exponent might depend on .
Observations and open problems
Our main result on the monotonicity of -logSob inequalities implies that the Poincaré (-logSob) inequality is the weakest among them.
However several open problems regarding monotonicity:
Are there intervals such that -logSob inequalities are equivalent for all reversible Markov semigroups and all . In other words, for which intervals , there exist constants such that for all , -logSob with constant implies -logSob with constant ? Note that Proposition 3.3 implies a positive answer to this question with the interval for any . Note that this interval can not be extended to $S_{n}2\Theta(n\log n)1\Theta(n)$ [GQ03, Goe04].
Can one establish similar monotonicity property for hypercontractive inequalities?
Here we show that the Poincaré inequality may be deduced from reverse hypercontractivity for fixed . This provides a partial answer to question (II) above.
Let and . Assume that a symmetric Markov semigroup satisfies the reverse hypercontractivity estimate for every . Then it also satisfies the Poincaré inequality
2. Spectral gap does not imply 111-logSob
Here we show that the -logSob inequality does not imply the -logSob inequality. In particular it gives a partial answer to question (I) above by showing that the -logSob inequalities in the interval $\mathcal{G}=\{G_{1},G_{2},\ldots\}d$-regular (spectral) expander if
For each , is a -regular graph on vertices.
The random walk on satisfies a Poincaré inequality with constant that does not depend on .
Assume, by way of contradication that there exists a constant such that for each , -logSob constants for the random walks on are bounded above by . Let be the continuous-time random walk on . Since the underlying graph is -regular, the stationary distribution is the uniform measure on . So, if we take and for in (1.5), then we have
where is a constant that depends on . This implies that
for some constant . Since the right hand side of the above inequality decays faster than any polynomial, it contradicts (12.1). This proves that -logSob constant for the random walk on tends to infinity as .
Explicit lower bounds on -logSob constants for connected -regular graphs on vertices can be found in [Goe04, BT06]. But our proof is different in the sense that it relies on the new mixing bounds implied by reverse hypercontractivity.
3. Generalizations to infinite spaces
It is straightforward to generalize most of the result of Sections 1-9 of the paper to infinite probability spaces. The only point which requires some care is to work with the appropriate classes of functions. Since the applications in the current paper deal mainly with finite spaces we omit this straightforward extension.
References
Appendix A Proof of Theorem 1.15
We continue in the proof of the general quantitative Arrow theorem following [Mos12].
The next step is to replace Theorem 7.1 and Theorem 11.11 in [Mos12] by the following two lemmas respectively.
For every there exist and such that the following hold. Let and let be the social choice function defined by and . Assume that for all and it holds that
or there exists a social choice function which is either a dictator or always ranks one candidate at top/bottom such that . Moreover, one can take
For every , there exist and such that the following hold. Let . Assume that for all and all it holds that
and for all it holds that
The proofs of the above two lemmas are almost identical to those given in [Mos12]. The only difference is that instead of Theorem 11.10 of [Mos12] we now use its modified version as follows.
For every , there exist and such that the following hold. Let . Assume that for all and all it holds that
and for all and it holds that
The proof of Lemma A.3 depends on Gaussian Arrow’s theorem (see Theorem 11.7 of [Mos12]) and the following generalization of some Gaussian invariance result proved in [Mos12] (see Theorem 11.9). The latter may be of independent interest.
For the constant functions and it holds that and .
If and are two functions such that for all , it holds that
The proof is same as Theorem 11.9 of [Mos12]. The only difference is that we now need to apply the version of Theorem 3.20 in [MOO10] under hypothesis H3 instead of hypothesis H4. ∎
We will only give a brief sketch the proof of theorem for . The proof for follows from a general argument given in [Mos12].
Take as in Lemma A.2 and .
Let be the three pairwise preference functions. Let (where the values of will be determined later). We will consider three cases:
There exist two voters and two functions such that
For every two functions and every , it holds that
There exists a voter such that for all
First note that each satisfies at least one of the three conditions (A.8), (A.9) or (A.10). Thus it suffices to prove the theorem for each of the three cases.
We thus obtain that where is given in (10.1) by taking large .
In case (A.9), by Lemma A.2, it follows that Either (if (A.3) does not hold) there exists a function which always puts a candidate at top/bottom and , Or, .
Similarly in the remaining case (A.10), we have by Lemma A.1 that Either Or . The proof follows. ∎
Keller [Kel11] proved that one may take in the special case when is uniform. It’s an interesting open question to see whether such polynomial dependence of on holds for general distribution .
Appendix B A lower bound for the NICD problem using a plurality function
We will analyze the protocol where all players use some balanced plurality function that we are going to described below. Define to be the number of times is present in the string and set . Then we define our pluraity function as
Note that if is the unique value in which occurs most frequently in string , that is, if , then . Also, note that if is any permutation of then
which implies that is balanced.
Define and where is a -correlated of .
The probability of total agreement among players is bounded below by the probability event that they all output which is at least
The last step is justified by the fact that is a sufficient statistics for the conditional distribution of given .
and for all
It now follows from multidimensional Central Limit Theorem that
as , where (resp. ) is the two-dimensional (resp. -dimensional) normal distribution with mean zero and covariance matrix (resp. ) given by
where and . From (B.2), it follows that as ,
Recall that the conditional distribution given is where . Also recall that if is a standard normal random variable, then
and this bound is sharp in the asymptotic sense
The proof of the lower bound is now complete by Lemma B.1. ∎
Fix . Let and . Then there exists such that for ,
Note that with probability one. Therefore,
The conditional distribution of given is given by
where . The lemma now follows from the normal tail estimate. ∎