On reverse hypercontractivity

Elchanan Mossel, Krzysztof Oleszkiewicz, Arnab Sen

Introduction

Log-Sobolev and hypercontractive inequalities play a fundamental role in a number of areas in analysis and probability theory including the study of Gaussian processes (see, e.g., [Gro78, Jan97]), analysis of Markov chains (see, e.g., [SC97]) and discrete Fourier analysis starting in [KKL88, Tal94].

The strength of a simple hypercontractive inequality like (1.1) lies in the fact that it tensorizes. This led to many applications in discrete Fourier analysis (starting with [KKL88]) and even earlier in the study of Gaussian processes. Extending (1.1) to other spaces turned out to be a non-trivial task. For the case of the spaces (Ω,μ)=({0,1},αδ0+(1−α)δ1)(\Omega,\mu)=(\{0,1\},\alpha\delta_{0}+(1-\alpha)\delta_{1}), with α≤1/2\alpha\leq 1/2, the first bounds were established by Talagrand [Tal94]. Exact formulas have been obtained by Oleszkiewicz [Ole03] in the cases where either p>2=qp>2=q or p=2>q>1p=2>q>1. Wolff then extended these results [Wol07] to general discrete spaces and, in a slightly less precise form, to all p>q≥2p>q\geq 2 and all 2≥p>q>12\geq p>q>1: let (Ω,μ)(\Omega,\mu) be a finite probability space with α=min⁡ω∈Ωμ{ω}>0\alpha=\min_{\omega\in\Omega}\mu\{\omega\}>0; then there exists some universal positive constant ε\varepsilon such that for p,qp,q as above and certain t0=t0(p,q,α)t_{0}=t_{0}(p,q,\alpha), given by an explicit though complicated formula,

A ‘reverse’ hypercontractivity is shortly proved and discussed in a paper by Borell [Bor82] in the 80’s. This result, proven for the measure (Ω,μ)=({0,1},12(δ0+δ1))(\Omega,\mu)=(\{0,1\},\frac{1}{2}(\delta_{0}+\delta_{1})), states that

This inequality which also tensorizes is indeed ‘reverse’ in many ways. Not only the inequality goes ‘the other way’ and the roles of pp and qq get reversed, it is also the case that pp and qq are less than 11 (indeed they may be negative(!); note, however, that the function ff has to take positive values).

As far as we know, Borell’s result was first used in a paper published more than 20 years later [MOR+06], where it is used to analyze mixing of short random walks on the discrete cube {0,1}n\{0,1\}^{n} as well as to provide tight bounds on the Non-Interactive Correlation Distillation (NICD) problem.

Motivated by generalization of applications in [MOR+06] as well as by other applications that will be discussed later, we wish to extend Borell’s results to other discrete probability spaces. Noting the similarity of the inequalities (1.1) and (1.2) it is tempting to conjecture (as the first named author have done) that the formulas for hypercontracitivity and reverse hypercontractivity are ‘the same’: in particular, for discrete spaces there is a dependency on the size of the smallest atom in space as in the above-mentioned results for hypercontractivity. The conjecture is further supported by the fact that for diffusions both hypercontractivity and reverse hypercontractivity are equivalent to the standard log-Sobolev inequality (for more details see [Bak94]; some pioneering results relating hypercontractivity to reverse hypercontractivity were obtained already in [BJ]).

The conjecture turns out to be far from true. In fact our results show that for every discrete probability space (Ω,μ)(\Omega,\mu):

In particular, reverse hypercontractive inequalities hold uniformly for all probability spaces.

It is well known that hypercontractive inequalities are intimately related to logarithmic Sobolev inequalities and our proof of (1.3) is based on extension of this connection to ‘norms’ p<1p<1 (such extensions were noted before, see, e.g., Bakry’s lecture notes [Bak94]). At the heart of the proof is a new monotonicity result showing that under the appropriate normalization log-Sobolev inequalities are monotone in the norm parameter pp for all p∈p\in. This result in turn is based on an extension of the Stroock-Varopoulos inequality to general norms. The result allows us to show how reverse hypercontractive inequalities follow directly from standard hypercontractive inequalities and furthermore from standard log-Sobolev and modified log-Sobolev inequalities.

After we develop the theory of reverse hypercontractive inequalities, we derive a number of novel results regarding mixing of Markov chains run for short time starting from large sets, in general cubes, the symmetric group and Ising configurations (via Glauber dynamics). We further derive a quantitative Arrow’s Theorem for general distributions and inverse polynomial bounds for the NICD problem for general mm-sided dice. We proceed with formal definitions and statements of the main results.

2. General setup

for any f∈Hf\in{\mathcal{H}}, and any ω∈Ω\omega\in\Omega such that f≤f(ω)f\leq f(\omega) on Ω\Omega, there is (Lf)(ω)≥0(Lf)(\omega)\geq 0.

Alternatively, one can replace the fourth condition by the non-negativeness of the carré du champ (as a function-valued quadratic form), i.e., L(f2)≤2fLfL(f^{2})\leq 2fLf for f∈Hf\in{\mathcal{H}}. The Markov semigroup of operators (Tt)t≥0:H→H(T_{t})_{t\geq 0}:{\mathcal{H}}\rightarrow{\mathcal{H}} generated by LL is given by

Recall that in this setup we have Tt1=1T_{t}1=1 for t≥0t\geq 0 and E(f,1)=0{\mathcal{E}}(f,1)=0 for f∈Hf\in{\mathcal{H}}. The operators TtT_{t} are symmetric linear contractions in LpL^{p}-norm for every p∈[1,∞)p\in[1,\infty) and t≥0t\geq 0. They are mean-preserving, i.e.,

Recall that ∥⋅∥p\|\cdot\|_{p} is a true norm for p≥1p\geq 1 but it is only a pseudo-norm (triangle inequality fails) for p<1p<1 (unless ∣Ω∣=1|\Omega|=1). It is an easy and well-known fact that for any f∈H(0,∞)f\in{\mathcal{H}}_{(0,\infty)} the map p↦∥f∥pp\mapsto\|f\|_{p} is continuous and non-decreasing.

Note that the map p↦p′p\mapsto p^{\prime} is a continuous order-reversing involution on (−∞,1)(-\infty,1) and (1,∞)(1,\infty) with fixed points and 22. It is worth observing that (2−p)′=2−p′(2-p)^{\prime}=2-p^{\prime} for p≠1p\neq 1, even though we will not make use of this fact.

3. Log-Sobolev inequalities

We now recall the definition of log-Sobolev inequalities.

for every f∈H(0,∞)f\in{\mathcal{H}}_{(0,\infty)}. We will say that 11-logSob is satisfied with constant C>0C>0 if

for f∈H(0,∞)f\in{\mathcal{H}}_{(0,\infty)}. Finally, we will say that -logSob is satisfied with constant C>0C>0 if

for every f∈H(0,∞)f\in{\mathcal{H}}_{(0,\infty)}.

Logarithmic Sobolev inequalities were introduced by Gross in his seminal paper [Gro75]. Gross defined logarithmic Sobolev inequality for p>1p>1. The definition was later extended by Bakry [Bak94] to any real pp (including 11-logSob inequality). Finally, we remark that 11-logSob inequality is also known in the literature as modified log-Sobolev inequality (see, e.g., [Wu00, GQ03, Goe04, BT06]). The 1-logSob inequality is also called “entropic inequality” as it implies the exponential decay of entropy along the semigroup.

Our definition uses a novel and non-standard normalization factor p24(p−1)\frac{p^{2}}{4(p-1)} in (1.4). The choice of this normalization makes our pp-logSob constants invariant under Hölder conjugation (see Lemma 3.2). Moreover, this normalization is crucial to prove the main result of the paper - the monotonicity of the inequality for p∈p\in (see Theorem 1.7).

In our main result we prove a general result relating pp-logSob inequalities for different values of pp.

Let 0≤q≤p≤20\leq q\leq p\leq 2. Assume that pp-logSob holds with a constant C>0C>0. Then also qq-logSob holds true with the same constant CC.

It has been proved in [Bak94, Proposition 3.1] that if 22-logSob holds with constant CC, then any pp-logSob also holds with the same constant and for p>0p>0 the converse is true in case of diffusions with invariant measure μ\mu.

Using the fact that simple operators satisfy 11-logSob with the constant 44 (proved in [BT06]; the proof is reproduced in our Lemma 3.5 below) we obtain the following corollary:

4. Reverse hypercontractive estimates

Using Theorem 1.7 we derive the following general reverse hypercontractive bounds:

If a symmetric Markov semigroup (Tt)t≥0(T_{t})_{t\geq 0} satisfies rr-logSob with constant CC and r≥1r\geq 1 then for all q<p<1q<p<1 and every f∈H(0,∞)f\in{\mathcal{H}}_{(0,\infty)} for all t≥C4log⁡1−q1−pt\geq\frac{C}{4}\log\frac{1-q}{1-p} we have ∥Ttf∥q≥∥f∥p\|T_{t}f\|_{q}\geq\|f\|_{p}.

Using Corollary 1.9 this implies in turn that:

In fact, for simple operators we derive the following stronger result:

The reverse hypercontractive inequality (1.2) for a simple operator and the space {−1,1}\{-1,1\} with the uniform measure was derived prior to ours by Borell. His result is tight.

5. Application 1: Mixing of large sets in Markov chains

Our first application of the new inequality is to mixing of Markov chains from large sets. The statement and proof of the theorem below are a generalization of the main result of [MOR+06] where it was proven for the random walk on the discrete cube {0,1}n\{0,1\}^{n}.

First, the Expander Mixing Lemma (see, e.g., [AS08, Chapter 9]) implies that if Poincaré inequality holds with constant DD then:

The inequality (1.6) will be better (up to constants) than our inequality (1.5) in the case where the sets AA and BB are large, say π{A}π(B)≥2π{A}π{B}e−t/D\pi\{A\}\pi(B)\geq 2\sqrt{\pi\{A\}\pi\{B\}}e^{-t/D}, since in this case we obtain the lower bound of 12π{A}π{B}\frac{1}{2}\pi\{A\}\pi\{B\} which is (except for the factor 22) the best that one can hope for. However, in the case where the sets AA and BB are small, say π{A}π{B}≤π{A}π{B}e−t/D\pi\{A\}\pi\{B\}\leq\sqrt{\pi\{A\}\pi\{B\}}e^{-t/D}, the expander mixing lemma gives nothing while (1.5) gives a lower bound that is a power of the measures of the original sets.

The second technique uses total variation mixing times. Indeed, if the worst total variation distance at time tt is at most ϵ\epsilon, then we have:

Again - applying this bound requires that one of the sets AA or BB is large (of measure at least ϵ\epsilon). Moreover, in many examples the time tt when the total variation distance is at most 1/e1/e is much larger than the 11-logSob constant CC. Therefore if tt is of order CC, then the mixing time bound (1.7) gives nothing while our result (1.5) gives an efficient lower bound.

We demonstrate this point by proving new mixing bounds from large sets for various classical Markov chains, including:

Short random walks on general product spaces. In this case we derive tighter results in subsection 9.1.

The random transposition card shuffle on the symmetric group. Here it is known that hat the 1-logSob constant CC of this chain is of order nn [GQ03, BT03, Goe04] while the mixing time is Θ(nlog⁡n)\Theta(n\log n). Thus again, we obtain new results on mixing from large sets. Similar logic applies to the Top-to-random transposition walk on symmetric group, see [Goe04, DFP92] for the 1-logSob constant and the mixing time. We provide the details in subsections 9.4 and 9.5.

Random walk on the spanning trees of certain graphs. See subsection 9.6.

The Bernoulli-Laplace model. See subsection 9.7.

A natural Markovian queueing process - the q/q/∞q/q/\infty Markov process. The last example is interesting since it has infinite 22-logSob constant and an infinite mixing time. More details on this example are given in subsection 9.2

6. Application 2: A general quantitative Arrow theorem

Arrow’s Impossibility Theorem [Arr50, Arr63] is a fundamental result in social choice theory. It considers nn voters who rank kk candidates. Arrow considered functions F:Skn→{−1,1}(k2)F:S_{k}^{n}\to\{-1,1\}^{k\choose 2} that aggregate individual rankings (elements of the permutation group SkS_{k}) to result in a preference between every pair of the kk alternatives. Arrow showed that if the following desired properties hold simultaneously when k≥3k\geq 3:

Transitivity - F(σ)F(\sigma) induces a transitive ranking for all σ∈Skn\sigma\in S_{k}^{n},

Unanimity - for every pair of alternatives aa and bb, if all voters rank aa above bb then FF also ranks aa above bb,

Independence of irrelevant alternatives (IIA) - for every pair of alternatives, the resulting outcome regarding the preference between aa and bb is determined by the individual preferences between aa and bb,

then FF is a dictator function, i.e., it is determined by a single voter.

It is natural to ask how robust is the result when considering natural distributions over SknS_{k}^{n}. This question was analyzed by Kalai [Kal02] who studied it for the case of the uniform distribution over S3nS_{3}^{n} and showed that for every ϵ>0\epsilon>0, there exists a δ>0\delta>0 such that if FF satisfies:

Following a challenge by Kalai, Mossel [Mos12] proved a stronger result for any number of alternatives and without the assumption that FF is fair. His result shows that for k≥3k\geq 3 and every ϵ>0\epsilon>0, there exists a δ>0\delta>0 such that if FF satisfies

A key ingredient of the proof in [Mos12] is the use of reverse hypercontractive inequalities. It is further noted in [Mos12] that it should be possible to extend the proof to general product distributions on SknS_{k}^{n} given appropriate reverse hypercontractive bounds for general two point spaces. Our results imply the following extension.

We note that considering general product distributions gives a more realistic model of actual voting (though the independence assumption in this line of work is still problematic in real voting scenarios).

7. Application 3: Non-interactive correlation distillation from dice source

The problem of non-interactive correlation distillation deals with players who receive correlated random strings and whose collective goal is to agree with the highest possible probability on a random variable with a given distribution. Suppose there are k≥2k\geq 2 players and a ‘cosmic source’. Assume first that the source generates a string xx of nn i.i.d. bits. Each player gets to receive an independent noisy copy of xx. Each player then produces a single random bit based on her input. The players wish to have unanimous agreement on their outputs but are not allowed to communicate. The problem is to understand to what extent the players can successfully ‘distill’ the correlations in their strings into a shared random bit.

where the supremum is taken over all choices of balanced functions (Fi)1≤i≤k(F_{i})_{1\leq i\leq k}. Since a balanced function defined on nn variables can be also thought of a balanced function of (n+1)(n+1) variables, for a fixed kk and ρ\rho, Mρ(k,n)\mathcal{M}_{\rho}(k,n) is a non-decreasing function of nn and so, lim⁡n→∞Mρ(k,n)\lim_{n\to\infty}\mathcal{M}_{\rho}(k,n) exists. One of the main results of [MOR+06] says that when m=2m=2, we have

The upper bound of the above result uses an application of reverse hypercontractivity for simple semigroup on symmetric two-point space. Here we generalize this bound and give an inverse polynomial bounds (in kk) on the agreement probability for general mm.

Fix ρ∈(0,1)\rho\in(0,1). Then there exist positive constants γ1=γ1(ρ),γ2=γ2(ρ),c1=c1(m,ρ)\gamma_{1}=\gamma_{1}(\rho),\gamma_{2}=\gamma_{2}(\rho),c_{1}=c_{1}(m,\rho) and c2=c2(m,ρ)c_{2}=c_{2}(m,\rho) such that for all k≥2k\geq 2,

The first named author enjoyed the hospitality of Isaac Newton Institute, Cambridge while completing part of this research. The second named author enjoyed hospitality of University of California, Berkeley and Isaac Newton Institute, Cambridge while doing this research. We thank Dominique Bakry, Franck Barthe, Nick Crawford, Michel Ledoux and Cyril Roberto for helpful comments and discussions. We thank an anonymous referee for numerous helpful suggestions including suggesting simpler proof of Lemma 2.3.

Comparison of Dirichlet forms

The following theorem extends the classical Stroock-Varopoulos inequality [Str84, Var85] (covering the case p=2p=2, q∈(1,2]q\in(1,2] of the present result). Theorem 2.1 is the main tool in proving Theorem 1.7. Note that some terms in the statement below may take negative values.

Let p,q∈(0,2]∖{1}p,q\in(0,2]\setminus\{1\} and p>qp>q. Then

for every g∈H(0,∞)g\in{\mathcal{H}}_{(0,\infty)}.

The above result has a natural extension to the case p=1p=1 or q=1q=1, with E(log⁡g,g){\mathcal{E}}(\log g,g) replacing the right (resp. left) hand side of the asserted inequality; then it suffices to use functions φ1(x)=log⁡x\varphi_{1}(x)=\log x and φ2(x)=x\varphi_{2}(x)=x (or ψ1(x)=log⁡x\psi_{1}(x)=\log x and ψ2(x)=x\psi_{2}(x)=x, respectively) in the proof. One can also simply pass to the limit.

The proof of the theorem will use the following lemmas.

for all a,b∈Ia,b\in I. Then for every f:Ω→If:\Omega\rightarrow I there is

where by φ1(f)\varphi_{1}(f) we denote φ1∘f∈H\varphi_{1}\circ f\in{\mathcal{H}}, etc.

for all a,b∈Ia,b\in I. Then for every f:Ω→If:\Omega\rightarrow I there is

is nonnegative. Clearly, Φ(x,x)=0\Phi(x,x)=0 and ∂Φ∂a(x,x)=0\frac{\partial\Phi}{\partial a}(x,x)=0 for all x∈Ix\in I. Now it is enough to notice that the assumptions of Lemma 2.4 yield ∂∂b∂∂aΦ≤0\frac{\partial}{\partial b}\frac{\partial}{\partial a}\Phi\leq 0 which implies that Φ(⋅,x)\Phi(\cdot,x) is non-decreasing on [x,∞)∩I[x,\infty)\cap I and non-increasing on (−∞,x]∩I(-\infty,x]\cap I. ∎

It suffices to use Lemma 2.4 with I=(0,∞)I=(0,\infty), φ1(x)=px1/p\varphi_{1}(x)=px^{1/p}, φ2(x)=p′x1/p′\varphi_{2}(x)=p^{\prime}x^{1/p^{\prime}}, ψ1(x)=qx1/q\psi_{1}(x)=qx^{1/q}, and ψ2(x)=q′x1/q′\psi_{2}(x)=q^{\prime}x^{1/q^{\prime}}. Indeed, to verify the assumptions of Lemma 2.4 one needs to check whether for all a,b>0a,b>0,

This is, however, obvious since the function w↦sw+s−ww\mapsto s^{w}+s^{-w} is even and convex for every s>0s>0 and thus it is non-decreasing on (0,∞)(0,\infty). Choosing s=a/bs=a/b and recalling that 0<1/p−1/2≤1/q−1/20<1/p-1/2\leq 1/q-1/2 ends the proof. ∎

For any f∈H(0,∞)f\in{\mathcal{H}}_{(0,\infty)} there is

It follows immediately from Lemma 2.4 applied to I=(0,∞)I=(0,\infty) with φ1(x)=log⁡x\varphi_{1}(x)=\log x, φ2(x)=log⁡x\varphi_{2}(x)=\log x, ψ1(x)=x\psi_{1}(x)=x, and ψ2(x)=−1/x\psi_{2}(x)=-1/x. ∎

For any positive gg, the function u↦1u(1−u)E(gu,g1−u)u\mapsto\frac{1}{u(1-u)}{\mathcal{E}}(g^{u},g^{1-u}) is log-convex on the real line: either it is positive and its logarithm is convex, or it is identically equal to zero (if gg is constant). It is also obviously symmetric with respect to 1/21/2, so that it is non-decreasing on [1/2,∞)[1/2,\infty), which is a re-formulation of Theorem 2.1. Indeed, the log-convexity follows easily from the formula (2.1) and Hölder’s inequality, if one can first prove that the functions u↦(bu−au)/uu\mapsto(b^{u}-a^{u})/u and, equivalently, u↦(b1−u−a1−u)/(1−u)u\mapsto(b^{1-u}-a^{1-u})/(1-u) are log-convex for any pair of fixed nonnegative numbers a>ba>b. This, however, is an immediate consequence of the identity (bu−au)/u=∫absu−1 ds,(b^{u}-a^{u})/u=\int_{a}^{b}s^{u-1}\,ds, and Hölder’s inequality. We skip standard discussion of the cases u=0u=0 and u=1u=1.

Logarithmic Sobolev inequalities

In this section we prove various properties of log-Sobolev inequalities and in particular Theorem 1.7. We begin with a simple claim relating -logSob to the Poincaré inequality. We suspect that both Lemma 3.1 and Lemma 3.2 below were previously known in the literature but we did not find any explicit reference.

-logSob holds with constant CC if and only if the standard Poincaré inequality holds with constant C/2C/2, i.e.,

For g∈Hg\in{\mathcal{H}} and δ>0\delta>0 set f=eδgf=e^{\delta g}. Assuming that ff satisfies -logSob with constant CC we obtain

By the homogeneity of variance and bilinearity of E{\mathcal{E}} we get

On the other hand, let f∈Hf\in{\mathcal{H}} be positive and assume that the Poincaré inequality holds with constant C/2C/2. By using it for g=log⁡fg=\log f we arrive at

The following easy observation allows us to restrict study of the pp-logSob inequalities to the case p∈p\in (also, it reveals that 11-logSob is, in a sense, a replacement for ±∞\pm\infty-logSob).

For p=0p=0 there is nothing to prove, whereas for p≠0p\neq 0 it suffices to notice that by setting g=fpg=f^{p} we obtain an equivalent ‘self-dual’ version of pp-logSob:

We now prove Theorem 1.7 using the extension of the classical Stroock-Varopoulos inequality proven in Theorem 2.1.

It is a direct consequence of the ‘self-dual’ reformulation (3.1) of pp-logSob, Theorem 2.1, and Remark 2.2. The fact that pp-logSob with constant CC implies -logSob (with the same constant) for every p≠0p\neq 0 may be proved in two natural ways. One can deduce the Poincaré inequality with constant C/2C/2 from pp-logSob by setting f=eδgf=e^{\delta g} and letting δ\delta tend to zero (as in the first part of proof of Lemma 3.1, and use Lemma 3.1 to finish the argument). Alternatively, one can first deduce from pp-logSob the qq-logSob inequalities (with the same constant) for qq arbitrarily close to zero, and then simply apply limit transition q→0q\to 0. ∎

In view of Lemma 3.1 and Theorem 1.7, the pp-logSob inequalities, p∈p\in, can be treated as a family interpolating in a continuous and monotone way between the classical Poincaré and logaritmic Sobolev inequalities. Another approach to the interpolation problem may be found in [LO00]. Relation between the two approaches seems unclear to the present authors and perhaps it deserves some further investigation.

However, it is well known that all the pp-logSob inequalties for p∈(1,2]p\in(1,2] are in a sense equivalent, at least if we do not care too much about constants (we do not know whether all pp-logSob inequalities for p∈(0,1)p\in(0,1) are equivalent in a similar sense).

Let 1<q≤p≤21<q\leq p\leq 2. Assume that qq-logSob holds true with a constant C>0C>0. Then also pp-logSob holds true, with constant (p−1)q2(q−1)p2C\frac{(p-1)q^{2}}{(q-1)p^{2}}C.

It follows from [Bak94, Proposition 3.1] that in case of diffusions with invariant measure μ\mu any qq-logSob implies any pp-logSob with the same constant. However, we did not find in the literature any reference to the results of the same form as Proposition 3.3 regarding reversible Markov chains. On the other hand, one can first deduce from qq-logSob a hypercontractive inequality and then deduce 22-logSob from it, which in turn yields pp-logSob. This way around was known before but it yields much worse estimates.

Indeed, since (p−1)q2(q−1)p2=qq′pp′\frac{(p-1)q^{2}}{(q-1)p^{2}}=\frac{qq^{\prime}}{pp^{\prime}} it suffices to prove that E(g1/q,g1/q′)≤E(g1/p,g1/p′){\mathcal{E}}(g^{1/q},g^{1/q^{\prime}})\leq{\mathcal{E}}(g^{1/p},g^{1/p^{\prime}}) for every positive g∈Hg\in{\mathcal{H}}, which follows easily from Lemma 2.3 applied to I=(0,∞)I=(0,\infty), φ1(x)=x1/q\varphi_{1}(x)=x^{1/q}, φ2(x)=x1/q′\varphi_{2}(x)=x^{1/q^{\prime}}, ψ1(x)=x1/p\psi_{1}(x)=x^{1/p}, and ψ2(x)=x1/p′\psi_{2}(x)=x^{1/p^{\prime}}. The inequality

Since for every s>0s>0 the function w↦sw+s−ww\mapsto s^{w}+s^{-w} is non-decreasing on [0,∞)[0,\infty), we finish the proof by setting s=a/bs=a/b and noting that 1q−12≥1p−12≥0\frac{1}{q}-\frac{1}{2}\geq\frac{1}{p}-\frac{1}{2}\geq 0. ∎

Usually it is not easy to prove the classical logarithmic Sobolev inequality (22-logSob in our notation). On the other hand, the following lemma provides a modified logarithmic Sobolev inequality (11-logSob in our notation) for a large class of simple semigroups.

The pp-logSob inequalities obviously share the tensorization property of the classical logarithmic Sobolev and Poincaré inequalities. This is a standard observation but we include it here for reader’s convenience. For i=1,i=1, 2,…,2,\ldots, nn assume that (Ωi,μi)(\Omega_{i},\mu_{i}) is a finite (this assumption may be relaxed) probability space with an associated space Hi{\mathcal{H}}_{i} of real functions on Ωi\Omega_{i}, and a Markov semigroup (Tt(i))t≥0:Hi→Hi(T^{(i)}_{t})_{t\geq 0}:{\mathcal{H}}_{i}\rightarrow{\mathcal{H}}_{i} generated by a self-adjoint positive semi-definite operator LiL_{i} (all of them enjoying properties described in the Preliminaries section). Now let us consider a new semigroup (Tt)t≥0(T_{t})_{t\geq 0} of operators acting on a space H=H1⊗H2⊗…⊗Hn{\mathcal{H}}={\mathcal{H}}_{1}\otimes{\mathcal{H}}_{2}\otimes\ldots\otimes{\mathcal{H}}_{n} of real-valued functions on a product probability space

We obtain it by defining its generator L:H→HL:{\mathcal{H}}\rightarrow{\mathcal{H}} as

Equivalently, we may define it by setting, for t≥0t\geq 0,

We skip the proof, referring the reader to the classical tensorization argument: subadditivity of entropy (or variance, if p=0p=0). ∎

Hypercontractivity

Since, as explained in the preliminaries, ft(p)f_{t(p)} is also strictly positive, we may apply to it the pp-logSob inequality, which will yield monotonicity of the map p↦∥Tt(p)f∥pp\mapsto\|T_{t(p)}f\|_{p} upon appropriate choice of the function t(p)t(p).

2. Hypercontractivity estimate

Let r∈(1,2]r\in(1,2] and let (Tt)t≥0(T_{t})_{t\geq 0} be a symmetric Markov semigroup.

Assume that (Tt)t≥0(T_{t})_{t\geq 0} satisfies rr-logSob with constant CC. Let r′≤q≤pr^{\prime}\leq q\leq p or 1<q≤p≤r1<q\leq p\leq r. Then for every t≥C4log⁡p−1q−1t\geq\frac{C}{4}\log\frac{p-1}{q-1} and every f∈Hf\in{\mathcal{H}} there is ∥Ttf∥p≤∥f∥q\|T_{t}f\|_{p}\leq\|f\|_{q}. In other words, TtT_{t} is a linear contraction from Lq(Ω,μ)L^{q}(\Omega,\mu) to Lp(Ω,μ)L^{p}(\Omega,\mu).

Conversely, if there exists C>0C>0 such that

for all pp and qq such that 1<q<p≤r1<q<p\leq r, and for all positive f∈Hf\in{\mathcal{H}} then (Tt)t≥0(T_{t})_{t\geq 0} sastisfies rr-logSob with the constant CC.

That the concepts of logarithmic Sobolev inequality and hypercontractivity are intimately connected goes back to Gross [Gro75]. In fact, the converse part of the above proposition follows from Theorem 1.2 of [Gro75] though we add a short proof here for the sake of completeness. But the hypothesis of the forward direction (rr-logSob implies hypecontractivity) of our proposition is weaker than that of [Gro75] since [Gro75] assumes that rr-logSob holds for a nonempty open interval - see Theorem 1.1 of [Gro75] for more details. We also comment that for r=2r=2 we recover the part (i) and (ii) of Theorem 3.5 of Diaconis and Saloff-Coste [DSC96] on the classical equivalence of the logarithmic Sobolev inequality and hypercontractivity for the reversible Markov chains (with essentially the same proof).

In the proof of the first assertion without loss of generality we can assume that f≥0f\geq 0 - indeed, since TtT_{t} is order preserving, the pointwise inequality −∣f∣≤f≤∣f∣-|f|\leq f\leq|f| implies that ∣Ttf∣≤Tt∣f∣|T_{t}f|\leq T_{t}|f| pointwise, and thus ∥Ttf∥p≤∥Tt∣f∣ ∥p\|T_{t}f\|_{p}\leq\|T_{t}|f|\,\|_{p} whereas ff and ∣f∣|f| have the same qq-th norm. Furthermore, without loss of generality we may assume that ff is strictly positive (which follows by considering functions f+εf+\varepsilon instead of ff and then letting ε→0+\varepsilon\to 0^{+}).

Theorem 1.7 and Lemma 3.2 imply that (Tt)t≥0(T_{t})_{t\geq 0} satisfies ss-logSob with constant CC for all s∈(1,r]∪[r′,∞)s\in(1,r]\cup[r^{\prime},\infty). Let t(s)=C4log⁡s−1q−1t(s)=\frac{C}{4}\log\frac{s-1}{q-1}, so that t(q)=0t(q)=0. Then s2t′(s)=Cs24(s−1)s^{2}t^{\prime}(s)=\frac{Cs^{2}}{4(s-1)} and (4.1) together with the ss-logSob imply that the map s↦∥Tt(s)f∥ss\mapsto\|T_{t(s)}f\|_{s} in non-increasing on [q,p][q,p]. Comparing its values at the ends of the interval we arrive at ∥Ttp,qf∥p≤∥f∥q\|T_{t_{p,q}}f\|_{p}\leq\|f\|_{q} for f>0f>0, where tp,q=C4log⁡p−1q−1t_{p,q}=\frac{C}{4}\log\frac{p-1}{q-1}. To finish the proof of the first assertion for t>tp,qt>t_{p,q} it suffices to express TtT_{t} as Tt−tp,q∘Ttp,qT_{t-t_{p,q}}\circ T_{t_{p,q}}, and use the fact that the semigroup is contractive in LpL^{p}-norm (p>1p>1).

To prove the second assertion let us fix some q∈(1,r)q\in(1,r) and some positive f∈Hf\in{\mathcal{H}}. For p∈[q,r)p\in[q,r) let t(p)=C4log⁡p−1q−1t(p)=\frac{C}{4}\log\frac{p-1}{q-1}, so that t(q)=0t(q)=0. Since the map p↦∥Tt(p)f∥pp\mapsto\|T_{t(p)}f\|_{p} is non-increasing on [q,r)[q,r) by using (4.1) at p=qp=q we infer that qq-logSob holds true with the constant CC. Passing to the limit q→r−q\to r^{-} ends the proof. ∎

Reverse hypercontractivity - preliminary results

In this section we prove some preliminary results regarding reverse hypercontractivity.

We first state the following corollary of Jensen’s inequality establishing ‘reverse contraction’:

Indeed, Φ\Phi may be expressed as infimum of a family CΦ{\mathcal{C}}_{\Phi} of affine functions:

2. Duality and tensorization

The standard statement of the duality of LpL^{p}-norms is that for p>1p>1 and f∈Hf\in{\mathcal{H}} we have

A slightly less known observation can be found in [Bor82]:

Let p∈(−∞,1)p\in(-\infty,1). Then for any positive f∈Hf\in{\mathcal{H}} there is

We skip its proof since it is an easy exercise.

The standard duality of the LpL^{p}-norms implies that Lp′(Ω,μ)L^{p^{\prime}}(\Omega,\mu) is Banach space dual to Lp(Ω,μ)L^{p}(\Omega,\mu) for any p>1p>1, and from the symmetry of the semigroup (Tt)t≥0(T_{t})_{t\geq 0} we deduce that

The case p,q∈(−∞,1)p,q\in(-\infty,1) is less standard and a bit more delicate (in particular, note that this is no longer the Banach space setting). We will need the following auxiliary result which was previously used by Borell [Bor82].

Let p,q∈(−∞,1)p,q\in(-\infty,1) and t≥0t\geq 0. Assume that ∥Ttf∥q≥∥f∥p\|T_{t}f\|_{q}\geq\|f\|_{p} for every positive f∈Hf\in{\mathcal{H}}. Then also ∥Ttf∥p′≥∥f∥q′\|T_{t}f\|_{p^{\prime}}\geq\|f\|_{q^{\prime}} for every positive f∈Hf\in{\mathcal{H}}.

where we have used Lemma 5.2, the symmetry of TtT_{t}, assumptions of the proposition, and again Lemma 5.2. ∎

Assume the set-up of Subsection 3.1. Let −∞<q<p<1-\infty<q<p<1. If for each 1≤i≤n1\leq i\leq n, ∥Tt(i)f∥q≥∥f∥p\|T_{t}^{(i)}f\|_{q}\geq\|f\|_{p} for all positive functions f∈Hif\in\mathcal{H}_{i}, then ∥Ttf∥q≥∥f∥p\|T_{t}f\|_{q}\geq\|f\|_{p} for all functions f∈H(0,∞)f\in\mathcal{H}_{(0,\infty)}.

The proof is an easy modification of the standard argument for showing the usual hypercontractive inequalities tensorize where Minkowski inequality is to be replaced by the reverse Minkowski inequality (Lemma 5.1). We omit details. ∎

Reverse hypercontractivity - general results

We establish an analogue of Proposition 4.1 for pp and qq below 11, extending results of Borell, [Bor82]. Now we restrict our considerations to positive functions.

Let r∈(0,1)r\in(0,1) and let (Tt)t≥0(T_{t})_{t\geq 0} be a symmetric Markov semigroup.

Assume that (Tt)t≥0(T_{t})_{t\geq 0} satisfies rr-logSob with some constant C>0C>0. Let r′≤q≤p≤rr^{\prime}\leq q\leq p\leq r. Then for every t≥C4log⁡1−q1−pt\geq\frac{C}{4}\log\frac{1-q}{1-p} and every positive f∈Hf\in{\mathcal{H}} there is ∥Ttf∥q≥∥f∥p\|T_{t}f\|_{q}\geq\|f\|_{p}.

Conversely, if there exists C>0C>0 such that

for all pp and qq such that 0<q<p≤r0<q<p\leq r, and for all positive f∈Hf\in{\mathcal{H}} then (Tt)t≥0(T_{t})_{t\geq 0} satisfies rr-logSob with the constant CC.

Theorem 3.3 of Bakry’s lecture notes [Bak94] established similar equivalence between reverse hypercontractivity and rr-logSob when r<1r<1. Indeed the converse part of Proposition 6.1 follows from that. But the forward direction, which turns out to be more useful in practice, Theorem 3.3 of [Bak94] assumes that rr-logSob holds for all rr belonging to some nonempty open interval instead of a single point.

Let us divide the proof of the first assertion into two basic cases: 0<q≤p≤r0<q\leq p\leq r and r′≤q≤p<0r^{\prime}\leq q\leq p<0 (and in fact we will need to prove only first of them since the second follows then by Proposition 5.3). Once they are proved, the assertion for 0≤q≤p≤r0\leq q\leq p\leq r and r′≤q≤p≤0r^{\prime}\leq q\leq p\leq 0 will follow by passing to a limit (q→0+q\to 0^{+} and p→0−p\to 0^{-}, respectively), while the case q<0<pq<0<p will follow from

since t−C4log⁡11−p≥C4log⁡(1−q)t-\frac{C}{4}\log\frac{1}{1-p}\geq\frac{C}{4}\log(1-q) for t≥C4log⁡1−q1−pt\geq\frac{C}{4}\log\frac{1-q}{1-p} (we "glue" the two cases together at zero).

Let us assume 0<q≤p≤r0<q\leq p\leq r, then. Consider a function t(q)=C4log⁡1−q1−pt(q)=\frac{C}{4}\log\frac{1-q}{1-p} defined on (0,p](0,p]. Then t(p)=0t(p)=0 and q2t′(q)=Cq24(q−1)q^{2}t^{\prime}(q)=\frac{Cq^{2}}{4(q-1)}, so that by (4.1) the map q↦∥Tt(q)f∥qq\mapsto\|T_{t(q)}f\|_{q} is non-increasing on (0,p](0,p] because rr-logSob implies qq-logSob, with the same constant CC, by Theorem 1.7. At the right end of the interval the map takes on the value ∥f∥p\|f\|_{p}, so that ∥Ttp,qf∥q≥∥f∥p\|T_{t_{p,q}}f\|_{q}\geq\|f\|_{p} for tp,q=C4log⁡1−q1−pt_{p,q}=\frac{C}{4}\log\frac{1-q}{1-p}. For t>tp,qt>t_{p,q} we simply express TtfT_{t}f as Tt−tp,q(Ttp,qf)T_{t-t_{p,q}}(T_{t_{p,q}}f) and use Lemma 5.1.

To prove the converse assertion, let us fix some p∈(0,r)p\in(0,r) and a positive f∈Hf\in{\mathcal{H}}. For q∈(0,p]q\in(0,p] let t(q)=C4log⁡1−q1−pt(q)=\frac{C}{4}\log\frac{1-q}{1-p}, so that t(p)=0t(p)=0. Since the map q↦∥Tt(q)f∥qq\mapsto\|T_{t(q)}f\|_{q} is non-decreasing on (0,p](0,p] formula (4.1) used at q=pq=p yields pp-logSob with the constant CC. Passing to the limit p→r−p\to r^{-} ends the proof. ∎

We can now prove Theorem 1.10. In fact we will prove the following result which includes an inverse.

If a symmetric Markov semigroup (Tt)t≥0(T_{t})_{t\geq 0} satisfies rr-logSob with constant CC and r≥1r\geq 1 then for all q<p<1q<p<1 and every positive f∈Hf\in{\mathcal{H}} for all t≥C4log⁡1−q1−pt\geq\frac{C}{4}\log\frac{1-q}{1-p} we have ∥Ttf∥q≥∥f∥p\|T_{t}f\|_{q}\geq\|f\|_{p}.

Conversely, if for some C>0C>0 a symmetric Markov semigroup (Tt)t≥0(T_{t})_{t\geq 0} satisfies ∥TC4log⁡1−q1−pf∥q≥∥f∥p\|T_{\frac{C}{4}\log\frac{1-q}{1-p}}f\|_{q}\geq\|f\|_{p} for all 0<q<p<10<q<p<1 and all positive f∈Hf\in{\mathcal{H}} then it also satisfies 11-logSob with the constant CC.

By Theorem 1.7 for all r∈(0,1)r\in(0,1) also rr-logSob holds, with the same constant CC. The assertion follows immediately from Proposition 6.1.

The converse assertion is easy - Proposition 6.1 implies that (Tt)t≥0(T_{t})_{t\geq 0} satisfies rr-logSob with the same constant CC for all r∈(0,1)r\in(0,1), and it suffices to pass to the limit (r→1−r\to 1^{-}). ∎

As in [Bor82, MOR+06] we can now obtain the two function version corollary.

We conclude this section by proving Corollary 1.11.

Indeed, Lemma 3.5 and Proposition 3.7 (in the product case) imply that (Tt)t≥0(T_{t})_{t\geq 0} satisfies 11-logSob with constant 44, so that it suffices to use Corollary 6.3. ∎

Improved reverse bounds for simple semigroups

Actually, we can significantly weaken the condition t≥log⁡1−q1−pt\geq\log\frac{1-q}{1-p} in Corollary 1.11 for simple operators and prove Theorem 1.12.

It suffices to prove the claim in the case q<p≤0q<p\leq 0 - Proposition 5.3 together with an observation that for 0≤q<p<10\leq q<p<1 there is p′<q′≤0p^{\prime}<q^{\prime}\leq 0 and

It is easy to check that Ψs\Psi_{s} is a convex function with Ψs(0)=Ψs′(0)=0\Psi_{s}(0)=\Psi_{s}^{\prime}(0)=0 and Ψs′′(x)=(1−s)(1+x)s−2\Psi_{s}^{\prime\prime}(x)=(1-s)(1+x)^{s-2} (actually, the same properties hold true in the case s>0s>0, and in the case s=0s=0 with Ψ0(x)=x−log⁡(1+x)\Psi_{0}(x)=x-\log(1+x), but we will not need those). The inequality

holds true for every x∈(−1,∞)x\in(-1,\infty). Indeed, due to the properties of Ψs\Psi_{s} listed above it suffices to prove that

which immediately follows from the elementary inequality (1+x)θ≤1+θx(1+x)^{\theta}\leq 1+\theta x, and from the fact that the map

which ends the proof - recall that the exponent pp is negative. The first inequality above was just an application of the elementary (1+x)a≤1+ax(1+x)^{a}\leq 1+ax, with a=∣p∣/∣q∣∈(0,1)a=|p|/|q|\in(0,1), x>−1x>-1. The last inequality follows from the fact that Ψs\Psi_{s} obtains its minimum at s=0s=0.

The case p=0p=0 follows by an obvious limit transition. ∎

Note that we could obtain a better reverse hypercontractivity constant than those given in Theorem 1.12 by first maximizing the function Ψq′′(θx)/Ψp′′(x)\Psi_{q}^{\prime\prime}(\theta x)/\Psi_{p}^{\prime\prime}(x) over x∈(−1,∞)x\in(-1,\infty) and then by trying to solve for θ\theta in terms of pp and qq such that (7.2) holds. This would lead to an equation of the form

But unfortunately, in general, θ\theta can not be recovered explicitly from the above equation. However, in the special case when −∞<q<p=0-\infty<q<p=0, θ\theta can explicitly be solved as

as q→0−q\rightarrow 0^{-} and, equivalently, q′→0+q^{\prime}\rightarrow 0^{+}. Thus, under assumptions of Theorem 1.12 about the semigroup, there exists a function η:(−∞,0)⟶(0,∞)\eta:(-\infty,0)\longrightarrow(0,\infty) given by η(q)=−log⁡θ(q)\eta(q)=-\log\theta(q), with η(q)=−12q−14q2+O(q3)\eta(q)=-\frac{1}{2}q-\frac{1}{4}q^{2}+O(q^{3}) as q→0−q\rightarrow 0^{-}, such that for all q<0q<0 and positive ff we have ∥Ttf∥q≥∥f∥0\|T_{t}f\|_{q}\geq\|f\|_{0} for every t≥η(q)t\geq\eta(q). Also, by duality, there exists a function τ:(0,1)⟶(0,∞)\tau:(0,1)\longrightarrow(0,\infty) given by τ(p)=−log⁡θ(p′)\tau(p)=-\log\theta(p^{\prime}), with τ(p)=12p+14p2+O(p3)\tau(p)=\frac{1}{2}p+\frac{1}{4}p^{2}+O(p^{3}) as p→0+p\rightarrow 0^{+}, such that for all p∈(0,1)p\in(0,1) and positive ff we have ∥Ttf∥0≥∥f∥p\|T_{t}f\|_{0}\geq\|f\|_{p} for every t≥τ(p)t\geq\tau(p).

for all t≥log⁡(2−p)(2−q)4(1−p)(1−q)t\geq\log\frac{(2-p)(2-q)}{4(1-p)(1-q)}.

where we used Theorem 1.12 in the first and the second inequality and Lemma 5.1 in the third inequality. ∎

We now obtain the following corollary regarding ρ\rho-correlation.

Consider a product space (Ω,μ)=(∏i=1nΩi,⊗i=1nμi)(\Omega,\mu)=(\prod_{i=1}^{n}\Omega_{i},\otimes_{i=1}^{n}\mu_{i}) where (Ωi,μi)(\Omega_{i},\mu_{i}) are finite probability spaces. We say that (x,y)∈Ω2(x,y)\in\Omega^{2} are ρ\rho-correlated if xx is distributed according to μ\mu and the conditional distribution of yy given xx is given as follows: for each ii independently, with probability ρ\rho, yi=xiy_{i}=x_{i} and with probability 1−ρ1-\rho, yiy_{i} is sampled independently from μi\mu_{i}.

Let (Ω,μ)(\Omega,\mu) be the product probability space in Definition 7.3. Let A,B⊆ΩA,B\subseteq\Omega be two sets such that μ{A},μ{B}≥ϵ≥0\mu\{A\},\mu\{B\}\geq\epsilon\geq 0. Let xx be distributed according to the product measure μ\mu and yy be a ρ\rho-correlated copy of xx for some 0≤ρ<10\leq\rho<1. Then

Let ff and gg be the characteristic functions of the sets AA and BB respectively. Note that

for all 0<p,q<10<p,q<1 such that ρ=4(1−p)(1−q)(2−p)(2−q)\rho=\frac{4(1-p)(1-q)}{(2-p)(2-q)}. We now take p=q=2(1−ρ)2−ρp=q=\frac{2(1-\sqrt{\rho})}{2-\sqrt{\rho}} in (7.6) to conclude the proof. ∎

We can also use Corollary 6.4 which deals with general symmetric Markov semigroups to get a lower bound ϵ21−ρ\epsilon^{\frac{2}{1-\sqrt{\rho}}}. But this bound is worse than what we have achieved by using Corollary 7.2 that improves on the bounds provided by Corollary 6.4 in the case of simple semigroups.

which holds for all ρ∈[0,1)\rho\in[0,1). We skip some tedious but straightforward calculations.

Under assumptions of Lemma 7.4 we also have

where κ\kappa is some universal constant. This is a significant strengthening when ρ\rho is close to 11, especially in view of Remark 7.6.

Indeed, it suffices to notice that in the proof of Corollary 7.2 one can take t1=τ(p)t_{1}=\tau(p) and t2=τ(q)t_{2}=\tau(q), using Remark 7.1 rather than Theorem 1.12. Thus (7.4) holds true for all t≥τ(p)+τ(q)t\geq\tau(p)+\tau(q). Let us set p=q=1−ρ−C⋅(1−ρ)3p=q=1-\rho-C\cdot(1-\rho)^{3}. The asymptotic behavior of τ(p)\tau(p) established in Remark 7.1 implies that e−2τ(p)=1−p+O(p3)e^{-2\tau(p)}=1-p+O(p^{3}) as p→0+p\rightarrow 0^{+}. Thus, by choosing the constant CC large enough and ρ^∈(0,1)\hat{\rho}\in(0,1) close enough to 11, we prove that for ρ∈(ρ^,1)\rho\in(\hat{\rho},1) there is e−2τ(p)≥ρe^{-2\tau(p)}\geq\rho, i.e., 2τ(p)≤log⁡(1/ρ)2\tau(p)\leq\log(1/\rho), and therefore (7.4) holds true for t=log⁡(1/ρ)t=\log(1/\rho). By repeating the proof of Lemma 7.4 we arrive at

for ρ∈(ρ^,1)\rho\in(\hat{\rho},1). This, together with (7.5) used for ρ≤ρ^\rho\leq\hat{\rho}, yields (7.7).

A similar asymptotic strengthening applies to many further results of the next two sections (whenever one deals with simple semigroups and their tensor products, and also in Section 8 for α,α⋆\alpha,\alpha^{\star} close to zero) but we will omit these generalizations for the sake of brevity.

Reverse hypercontractivity for some non-simple operators

For some of the applications afterwards we will be interested in operators that are not necessarily simple but are obtained by composing a simple operator with a non-simple operator. In this section we extend some of the reverse hypercontractive results to this setup.

Assume that (Ω,μ)(\Omega,\mu) is a finite probability space and KK is Markov kernel on Ω\Omega. Let ν=μK\nu=\mu K and

Thus S:=T−α⋆∘KS:=T_{-\alpha^{\star}}\circ K is Markovian and the kernel KK can be written as composition of two Markov kernels in the following way:

Using the decomposition (8.2), by Theorem 1.12 we obtain

Consider the set-up of Proposition 8.1. Then for all 0<p,q<10<p,q<1 and all nonnegative f,gf,g, we have

for all α⋆≥log⁡(2−p)(2−q)4(1−p)(1−q)\alpha^{\star}\geq\log\frac{(2-p)(2-q)}{4(1-p)(1-q)}.

where x=(x1,x2,…,xn)x=(x_{1},x_{2},\ldots,x_{n}) and y=(y1,y2,…,yn)y=(y_{1},y_{2},\ldots,y_{n}) are Ωn\Omega^{n}-valued random variables.

Let ff and gg be the characteristic function of the sets AA and BB respectively. Note that

for all 0<p,q<10<p,q<1 such that 1−α=4(1−p)(1−q)(2−p)(2−q)1-\alpha=\frac{4(1-p)(1-q)}{(2-p)(2-q)}. We take p=q=2(1−1−α)2−1−αp=q=\frac{2(1-\sqrt{1-\alpha})}{2-\sqrt{1-\alpha}} to conclude the proof. ∎

The following example shows that the condition α>0\alpha>0 cannot be dropped in general. Take Ω={0,1}\Omega=\{0,1\} and μ\mu to be the unbiased Bernoulli measure on Ω\Omega. Let the kernel KK be as follows:

Mixing of Markov chains for big sets

In this section we prove Theorem 1.14 which establishes mixing for Markov chains satisfying 11-logSob. We then give a number of examples where the theorem can be applied to yield new results on mixing of Markov chains starting from big sets. We begin with a proof of the theorem:

Take ff and gg to be the characteristic functions of AA and BB, respectively. Then by Corollary 6.4, for any choice of 0<p,q<10<p,q<1 with (1−p)(1−q)=e−4t/C(1-p)(1-q)=e^{-4t/C}, we get

By setting p=1−e−4t/C1+e−2t/C(b/a)p=\frac{1-e^{-4t/C}}{1+e^{-2t/C}(b/a)} and q=1−e−4t/C1+e−2t/C(a/b)q=\frac{1-e^{-4t/C}}{1+e^{-2t/C}(a/b)} (this choice follows from a simple optimization) we conclude the proof. ∎

and the corresponding Markov semigroup can be expressed as

From Lemma 3.5, Proposition 3.7 and Theorem 1.14 it follows that:

Let XtX_{t} be the continuous-time random walk on the general hypercube (Ωn,μ⊗n)(\Omega^{n},\mu^{\otimes n}) with X0X_{0} distributed according to the product measure μ⊗n\mu^{\otimes n}. Let a,b≥0a,b\geq 0 and τ>0\tau>0. Then for any A,B⊆ΩnA,B\subseteq\Omega^{n} with μ⊗n{A}=e−a2/2\mu^{\otimes n}\{A\}=e^{-a^{2}/2} and μ⊗n{B}=e−b2/2\mu^{\otimes n}\{B\}=e^{-b^{2}/2}, and for t≥τnt\geq\tau n, we have

In fact, a much better bound can be obtained by repeating the proof of Theorem 1.14 with the two function bound in Corollary 6.4 which applies to simple operators and their tensors:

Let XtX_{t} be the continuous-time random walk on the general hypercube (Ωn,μ⊗n)(\Omega^{n},\mu^{\otimes n}) with X0X_{0} distributed according to the product measure μ⊗n\mu^{\otimes n}. Let a,b≥0a,b\geq 0 and τ>0\tau>0. Then for any A,B⊆ΩnA,B\subseteq\Omega^{n} with μ⊗n{A}=e−a2/2\mu^{\otimes n}\{A\}=e^{-a^{2}/2} and μ⊗n{B}=e−b2/2\mu^{\otimes n}\{B\}=e^{-b^{2}/2}, and for t≥τnt\geq\tau n, we have

Note that the pair (X0,Xt)(X_{0},X_{t}) is ρ\rho-correlated in the sense of Definition 7.3, with ρ=e−t/n\rho=e^{-t/n}. Let p=(2−2ρ)abρ+(2−ρ)ap=\frac{(2-2\rho)a}{b\sqrt{\rho}+(2-\rho)a} and q=(2−2ρ)baρ+(2−ρ)bq=\frac{(2-2\rho)b}{a\sqrt{\rho}+(2-\rho)b}, so that p,q∈(0,1)p,q\in(0,1) and 4(1−p)(1−q)(2−p)(2−q)=ρ\frac{4(1-p)(1-q)}{(2-p)(2-q)}=\rho. By Corollary 7.2 applied to f=1Af=1_{A} and g=1Bg=1_{B} we have

and the first inequality of the assertion follows easily. The second inequality in the assertion of the proposition is elementary. ∎

The bound of Proposition 9.2 is quite tight, especially for small values of τ\tau, μ⊗n{A}\mu^{\otimes n}\{A\}, and μ⊗n{B}\mu^{\otimes n}\{B\}. Indeed, let us fix t=τnt=\tau n, choose α=α(a),β=β(b)\alpha=\alpha(a),\beta=\beta(b) such that (2π)−1/2∫α∞e−u2/2 du=e−a2/2(2\pi)^{-1/2}\int_{\alpha}^{\infty}e^{-u^{2}/2}\,du=e^{-a^{2}/2} and (2π)−1/2∫β∞e−u2/2 du=e−b2/2(2\pi)^{-1/2}\int_{\beta}^{\infty}e^{-u^{2}/2}\,du=e^{-b^{2}/2}, and then define two subsets of the discrete cube, A={z:n−1/2∑i=1nzi≤−α}A=\{z:n^{-1/2}\sum_{i=1}^{n}z_{i}\leq-\alpha\} and B={z:n−1/2∑i=1nzi≥β}B=\{z:n^{-1/2}\sum_{i=1}^{n}z_{i}\geq\beta\}. Now it suffices to use the CLT as in Remark 7.6 (recall that in our setting ρ=e−τ\rho=e^{-\tau}) and observe that

while lim⁡a→∞α(a)/a=1\lim_{a\to\infty}\alpha(a)/a=1 and lim⁡b→∞β(b)/b=1\lim_{b\to\infty}\beta(b)/b=1. We skip tedious but quite standard calculations.

We note that the mixing time of the above walk is of order nlog⁡nn\log n. Therefore using the mixing time it is impossible to obtain effective bounds even when one of the sets AA or BB has a large measure and tt is of order nn.

2. An example from queueing theory

In this subsection, we will give an example where we will show reverse hypercontractivity for Markov semigroup arising from a standard q/q/∞\infty process (defined below). We will not use any knowledge about the pp-logSob constants of the semigroup but establish reverse hypercontractivity by taking Poissonian limit of the reverse hypercontractive estimate for nn-dimensional hypercube with product Bernoulli measure (p=λ/np=\lambda/n). The example is of interest for a number of reasons:

It deals with a Markov chain defined on an infinite state space.

It is an example where the 22-logSob and the mixing time are both infinite (see [BL98], the fact that the mixing time is infinite is trivial), yet it is possible to obtain reverse hypercontractive and mixing estimates.

It is a natural example for queueing theory.

So, as n→∞n\to\infty, the sequence of generators L(n)L^{(n)} converges to the generator LL which is given by

Here →d\stackrel{{\scriptstyle d}}{{\to}} means the convergence in distribution.

Let (Tt(n))t≥0(T^{(n)}_{t})_{t\geq 0} (resp. (Tt)t≥0(T_{t})_{t\geq 0}) be the semigroup corresponding to the Markov process (Yt(n))t≥0(Y^{(n)}_{t})_{t\geq 0} (resp. (Yt)t≥0(Y_{t})_{t\geq 0}).

Letting n→∞n\to\infty, by (9.2), we conclude that

Similarly by approximating the process (Yt)t≥0(Y_{t})_{t\geq 0} by the process Y(n)Y^{(n)} and applying Proposition 9.2, we obtain

Note again that this result holds in an example where the mixing time and 22-logSob constant are infinite (see [BL98] where it is shown that the 11-logSob is finite).

The Ising model on a finite graph (V,E)(V,E) has the state space Ω={−1,+1}V\Omega=\{-1,+1\}^{V}. The probability of a spin configuration σ∈Ω\sigma\in\Omega is given by the Gibbs distribution,

The Glauber dynamics for the Ising model is a family of continuous time Markov chains on the state space Ω\Omega, reversible with respect to Gibbs distribution, given by the generator

where σu\sigma^{u} is the configuration σ\sigma with the spin at uu flipped. We consider the two examples of transition rates c(u,σ)c(u,\sigma):

Metropolis: c(u,\sigma)=\exp\big{(}2h\sigma(u)+2\beta\sigma(u)\sum_{uv\in E}\sigma(u)\big{)}\wedge 1.

Heat-bath: c(u,\sigma)=\left[1+\exp\big{(}-2h\sigma(u)-2\beta\sigma(u)\sum_{uv\in E}\sigma(u)\big{)}\right]^{-1}.

The example above can be easily extended to other spin systems and other graphs as long as 11-logSob inequality is established.

4. Random transposition walk on symmetric group

The random transposition walk on the group SnS_{n} of permutations of nn elements is the walk generated by the set of all transpositions Cn={(i,j):1≤i<j≤n}\mathcal{C}_{n}=\{(i,j):1\leq i<j\leq n\}. The Markov transition from any σ∈Sn\sigma\in S_{n} is described by picking a transposition τ\tau uniformly at random from Cn\mathcal{C}_{n} and compose it with σ\sigma to get a new permutation τ∘σ∈Sn\tau\circ\sigma\in S_{n}. It was shown in [GQ03, BT03, Goe04] that the 1-logSob constant CC of this chain is of order nn. More precisely,

5. Top-to-random transposition walk on symmetric group

This is a random walk on SnS_{n} generated by the set of transpositions Dn={(1,j):2≤j≤n}\mathcal{D}_{n}=\{(1,j):2\leq j\leq n\}. Again the 1-logSob constant CC of this chain satisfies [Goe04]

6. Random walk on spanning trees

This is a natural random walk on the space of all spanning trees of a graph G=(V,E)G=(V,E). Suppose TT be our current spanning tree. We choose an edge e∈Ee\in E and another edge f∈Tf\in T uniformly at random. If T′=T∪{e}∖{f}T^{\prime}=T\cup\{e\}\setminus\{f\} is a spanning tree of GG, we update TT to T′T^{\prime}, otherwise we remain at TT. It was shown in [JS02] that the 22-logSob constant of this walk satisfies

7. Bernoulli-Laplace model

This is natural random walk on the subsets of size rr of the ground set {1,2,…,n}\{1,2,\ldots,n\}, 1≤r<n1\leq r<n. So, the state space has size (nr){n\choose r}. If the current state of Markov chain is an rr-set AA, we pick an element ii uniformly at random from AA and pick an element jj uniformly at random from {1,2,…,n}∖A\{1,2,\ldots,n\}\setminus A and switch the elements to obtain a new rr-set A′=A∪{j}∖{i}A^{\prime}=A\cup\{j\}\setminus\{i\}. This is also known as simple exclusion process on the complete graph on nn vertices. The 11-logSob constant of this chain satisfies [GQ03, BT03, Goe04]

A quantitative Arrow theorem for general ranking distributions

Our goal in this section is to prove Theorem 1.15. We begin by briefly introducing some additional notation. Let A={a,b,…,}A=\{a,b,\ldots,\} be a set of k≥3k\geq 3 alternatives. A transitive preference over AA is a ranking of the alternatives from top to bottom where ties are not allowed. Such a ranking naturally corresponds to a permutation σ\sigma of the elements 1,…,k1,\ldots,k. The group of all rankings will be denoted by SkS_{k}. A constitution is a function FF that associates to every nn-tuple σ=(σ(1),…,σ(n))\sigma=(\sigma(1),\ldots,\sigma(n)) of transitive preferences, and every pair of alternatives a,b∈A,a,b\in A, a (strict) preference between aa and bb. Some key properties of constitutions include Transitivity, Independence of Irrelevant Alternatives (IIA), Unanimity (all defined at the introduction). Recall that the constitution FF is a dictator on voter jj, if F(σ)=σ(j)F(\sigma)=\sigma(j), for all σ\sigma, or F(σ)=σ(j)−1F(\sigma)=\sigma(j)^{-1}, for all σ\sigma, where σ(j)−1\sigma(j)^{-1} is the inverse of the permutation σ(j)\sigma(j).

We begin with some notation and definitions from [Mos12].

Given σ=(σ(1),…,σ(n))∈Skn\sigma=(\sigma(1),\ldots,\sigma(n))\in S_{k}^{n} and for each pair of alternatives a,b∈Aa,b\in A, we define binary vectors xa>b=xa>b(σ)x^{a>b}=x^{a>b}(\sigma) in the following manner:

Thus, if FF satisfies the IIA property then there exist functions fa>bf^{a>b} for every pair of candidates aa and bb such that

where fa>b:{−1,1}n→{−1,1}f^{a>b}:\{-1,1\}^{n}\to\{-1,1\} is such that fa>b=+1f^{a>b}=+1 if FF ranks aa over bb and fa>b=−1f^{a>b}=-1 otherwise and where we have fa>b(x)=−fb>a(x)f^{a>b}(x)=-f^{b>a}(x) for all a,ba,b and all xx.

Note that for k=3k=3, the probability of non-transitive outcome is given by

In the rest of the subsection, we denote by α\alpha, the probability mass of smallest atom of the distributions of the random vectors (xa>b(1),xb>c(1),xc>a(1))(x^{a>b}(1),x^{b>c}(1),x^{c>a}(1)) on {−1,1}3\{-1,1\}^{3} for triplets of distinct alternatives a,b,c∈Aa,b,c\in A.

Let {ψ0≡1,ψ1}\{\psi_{0}\equiv 1,\psi_{1}\} form a basis of L2({−1,1},μp)L^{2}(\{-1,1\},\mu_{p}). Then we can express ff in its Fourier basis as follows:

We define variance-influence of variable ii on ff as

When ff is ±1\pm 1-valued, it can be easily checked that the above two notions of influences are equivalent up to a multiplicative factor (independent of nn) as follows:

We also need the notion of low-degree variance-influences. For d>0d>0, this is defined as follows:

Under our assumption on the minimum atom of ϱ\varrho, it’s not difficult to show that for any three distinct alternatives a,b,c∈Aa,b,c\in A and any voter ii, we have

The following lemma is a consequence of the reverse hypercontractivity in the biased space. It is the key ingredient needed to extend the argument of [Mos12] to the nonuniform case.

Here voter jj is called ‘pivotal’ for fa>bf^{a>b} at σ\sigma if fa>bf^{a>b} is a non-constant function of the jthj^{th} variable when we freeze the other (n−1)(n-1) variables at xa<b(σ)x^{a<b}(\sigma).

Clearly, (xa>b(i),xb>c(i))1≤i≤n(x^{a>b}(i),x^{b>c}(i))_{1\leq i\leq n} are i.i.d. with a joint distribution on {−1,1}2\{-1,1\}^{2} determined by ϱ\varrho. Let μ\mu and ν\nu be the marginal distributions of xa>b(i)x^{a>b}(i) and xb>c(i)x^{b>c}(i) respectively. Note that the event AA is determined by xa>bx^{a>b} and the event BB is determined by xb>cx^{b>c} and the their intersection probability is determined by the joint probability distribution of the random vectors xa<bx^{a<b} and xb<cx^{b<c}. Let A0A_{0} and B0B_{0} be the subsets of {−1,1}n\{-1,1\}^{n} defined by:

where e1=(−1,1,…,1)e_{1}=(-1,1,\ldots,1) and e2=(1,−1,1,…,1)e_{2}=(1,-1,1,\ldots,1) so that (x1,…,xn)e1=(−x1,x2,…,xn)(x_{1},\ldots,x_{n})e_{1}=(-x_{1},x_{2},\ldots,x_{n}) and (x1,…,xn)e2=(x1,−x2,x3…,xn)(x_{1},\ldots,x_{n})e_{2}=(x_{1},-x_{2},x_{3}\ldots,x_{n}).

The reminder of the proof is a straightforward (though somewhat tedious) generalization of the proof given in [Mos12] that does not use reverse hypercontractivity. A sketch of the modifications needed is given in Appendix A.

Non-interactive correlation distillation for dice

The proof of Theorem 1.16 is a generalization of the proof given in [MOR+06]. The proof of the upper bound uses reverse hypercontractivity while the lower bound is based on the analysis of a simple protocol that is based on the plurality function and the analysis relies the on normal approximation. Here we give the proof of the upper bound. The proof of the lower bound is an easy (if tedious) adaptation of [MOR+06] and is given in Appendix B.

Note that the probability of all players output j∈Ωj\in\Omega is

where yy is a ρ\rho-correlated copy of xx. Let fi,j(x):=1{Fi(x)=j}f_{i,j}(x):=\mathbf{1}_{\{F_{i}(x)=j\}}. Thus if t=log⁡(1/ρ)t=\log(1/\rho) and TtT_{t} is the simple semigroup on Ω\Omega with the uniform measure, then we have

On the other hand, Corollary 7.2 gives us that

If we take p=q=2(1−ρ)2−ρp=q=\frac{2(1-\sqrt{\rho})}{2-\sqrt{\rho}} in the above inequality, we have

which implies that δ≤k−β\delta\leq k^{-\beta} for any 0<β<2(1−ρ)ρ0<\beta<\frac{2(1-\sqrt{\rho})}{\sqrt{\rho}} and kk sufficiently large. ∎

It is an interesting problem to find the exact exponent γ\gamma in Theorem 1.16 for which lim⁡n→∞Mρ(k,n)=k−γ+o(1)\lim_{n\to\infty}\mathcal{M}_{\rho}(k,n)=k^{-\gamma+o(1)} as k→∞k\to\infty. A priori such an exponent might depend on mm.

Observations and open problems

Our main result on the monotonicity of rr-logSob inequalities implies that the Poincaré (-logSob) inequality is the weakest among them.

However several open problems regarding monotonicity:

Are there intervals II such that rr-logSob inequalities are equivalent for all reversible Markov semigroups and all r∈Ir\in I. In other words, for which intervals II, there exist constants c(I)c(I) such that for all r,s∈Ir,s\in I, rr-logSob with constant CC implies ss-logSob with constant c(I)Cc(I)C? Note that Proposition 3.3 implies a positive answer to this question with the interval [1+ϵ,2][1+\epsilon,2] for any ϵ>0\epsilon>0. Note that this interval can not be extended to $.Thisfollowsforexamplefromthefactthatfortherandomtranspositioncardshufflingonthesymmetricgroup. This follows for example from the fact that for the random transposition card shuffling on the symmetric groupS_{n},,2−logSobconstantis-logSob constant is\Theta(n\log n)[LY98]whereas[LY98] whereas1−logSobconstantisknowntobe-logSob constant is known to be\Theta(n)$ [GQ03, Goe04].

Can one establish similar monotonicity property for hypercontractive inequalities?

Here we show that the Poincaré inequality may be deduced from reverse hypercontractivity for fixed q<p<1q<p<1. This provides a partial answer to question (II) above.

Let q<p<1q<p<1 and t>0t>0. Assume that a symmetric Markov semigroup satisfies the reverse hypercontractivity estimate ∥Ttf∥q≥∥f∥p\|T_{t}f\|_{q}\geq\|f\|_{p} for every f∈H(0,∞)f\in{\mathcal{H}}_{(0,\infty)}. Then it also satisfies the Poincaré inequality

2. Spectral gap does not imply 111-logSob

Here we show that the -logSob inequality does not imply the 11-logSob inequality. In particular it gives a partial answer to question (I) above by showing that the rr-logSob inequalities in the interval $arenotallequivalent.Recallthatafamilygraphsare not all equivalent. Recall that a family graphs\mathcal{G}=\{G_{1},G_{2},\ldots\}iscalledais called ad$-regular (spectral) expander if

For each nn, Gn=(Vn,En)G_{n}=(V_{n},E_{n}) is a dd-regular graph on nn vertices.

The random walk on GnG_{n} satisfies a Poincaré inequality with constant C0C_{0} that does not depend on nn.

Assume, by way of contradication that there exists a constant C1C_{1} such that for each nn, 11-logSob constants for the random walks on GnG_{n} are bounded above by C1C_{1}. Let (Xtn)t≥0(X^{n}_{t})_{t\geq 0} be the continuous-time random walk on GnG_{n}. Since the underlying graph is dd-regular, the stationary distribution π\pi is the uniform measure on GnG_{n}. So, if we take A={u}A=\{u\} and B={v}B=\{v\} for u,v∈Vnu,v\in V_{n} in (1.5), then we have

where α>0\alpha>0 is a constant that depends on C1C_{1}. This implies that

for some constant c′>0c^{\prime}>0. Since the right hand side of the above inequality decays faster than any polynomial, it contradicts (12.1). This proves that 11-logSob constant for the random walk on GnG_{n} tends to infinity as n→∞n\to\infty.

Explicit lower bounds on 11-logSob constants for connected dd-regular graphs on nn vertices can be found in [Goe04, BT06]. But our proof is different in the sense that it relies on the new mixing bounds implied by reverse hypercontractivity.

3. Generalizations to infinite spaces

It is straightforward to generalize most of the result of Sections 1-9 of the paper to infinite probability spaces. The only point which requires some care is to work with the appropriate classes of functions. Since the applications in the current paper deal mainly with finite spaces we omit this straightforward extension.

References

Appendix A Proof of Theorem 1.15

We continue in the proof of the general quantitative Arrow theorem following [Mos12].

The next step is to replace Theorem 7.1 and Theorem 11.11 in [Mos12] by the following two lemmas respectively.

For every ϵ>0\epsilon>0 there exist δ(ϵ)>0\delta(\epsilon)>0 and τ(δ)>0\tau(\delta)>0 such that the following hold. Let f1,f2,f3:{−1,1}n→{−1,1}f_{1},f_{2},f_{3}:\{-1,1\}^{n}\to\{-1,1\} and let FF be the social choice function defined by fa>b=f1,fb>c=f2f^{a>b}=f_{1},f^{b>c}=f_{2} and fc>a=f3f^{c>a}=f_{3}. Assume that for all 1≤i≤31\leq i\leq 3 and j>1j>1 it holds that

or there exists a social choice function GG which is either a dictator or always ranks one candidate at top/bottom such that D(F,G)≤9ϵD(F,G)\leq 9\epsilon. Moreover, one can take

For every ϵ>0\epsilon>0, there exist δ(ϵ)>0\delta(\epsilon)>0 and τ(δ)>0\tau(\delta)>0 such that the following hold. Let f1,f2,f3:{−1,1}n→f_{1},f_{2},f_{3}:\{-1,1\}^{n}\to. Assume that for all 1≤i≤31\leq i\leq 3 and all u∈{−1,1}u\in\{-1,1\} it holds that

and for all 1≤j≤n1\leq j\leq n it holds that

The proofs of the above two lemmas are almost identical to those given in [Mos12]. The only difference is that instead of Theorem 11.10 of [Mos12] we now use its modified version as follows.

For every ϵ>0\epsilon>0, there exist δ(ϵ)>0\delta(\epsilon)>0 and τ(δ)>0\tau(\delta)>0 such that the following hold. Let f1,f2,f3:{−1,1}n→f_{1},f_{2},f_{3}:\{-1,1\}^{n}\to. Assume that for all 1≤i≤31\leq i\leq 3 and all u∈{−1,1}u\in\{-1,1\} it holds that

and for all 1≤i≤31\leq i\leq 3 and 1≤j≤n1\leq j\leq n it holds that

The proof of Lemma A.3 depends on Gaussian Arrow’s theorem (see Theorem 11.7 of [Mos12]) and the following generalization of some Gaussian invariance result proved in [Mos12] (see Theorem 11.9). The latter may be of independent interest.

For the constant functions 11 and −1-1 it holds that 1~=1\widetilde{1}=1 and −1~=−1\widetilde{-1}=-1.

If ff and gg are two functions such that for all 1≤i≤n1\leq i\leq n, it holds that

The proof is same as Theorem 11.9 of [Mos12]. The only difference is that we now need to apply the version of Theorem 3.20 in [MOO10] under hypothesis H3 instead of hypothesis H4. ∎

We will only give a brief sketch the proof of theorem for k=3k=3. The proof for k>3k>3 follows from a general argument given in [Mos12].

Take τ=τ(ϵ)=δ0Clog⁡(2/α)log⁡(1/δ0)αδ0,δ0=18(ϵ/2)2+1/(2α2)\tau=\tau(\epsilon)=\delta_{0}^{C\log(2/\alpha)\frac{\log(1/\delta_{0})}{\alpha\delta_{0}}},\delta_{0}=\frac{1}{8}(\epsilon/2)^{2+1/(2\alpha^{2})} as in Lemma A.2 and η=ατ/2\eta=\alpha\tau/2.

Let fa>b,fb>c,fc>a:{−1,1}n→{−1,1}f^{a>b},f^{b>c},f^{c>a}:\{-1,1\}^{n}\to\{-1,1\} be the three pairwise preference functions. Let η=δ\eta=\delta (where the values of CC will be determined later). We will consider three cases:

There exist two voters i≠j∈[n]i\neq j\in[n] and two functions f≠g∈{fa>b,fb>c,fc>a}f\neq g\in\{f^{a>b},f^{b>c},f^{c>a}\} such that

For every two functions f≠g∈{fa>b,fb>c,fc>a}f\neq g\in\{f^{a>b},f^{b>c},f^{c>a}\} and every i∈[n]i\in[n], it holds that

There exists a voter j′j^{\prime} such that for all j≠j′j\neq j^{\prime}

First note that each FF satisfies at least one of the three conditions (A.8), (A.9) or (A.10). Thus it suffices to prove the theorem for each of the three cases.

We thus obtain that P(F)>δP(F)>\delta where δ\delta is given in (10.1) by taking large CC.

In case (A.9), by Lemma A.2, it follows that Either (if (A.3) does not hold) there exists a function GG which always puts a candidate at top/bottom and D(F,G)<3ϵD(F,G)<3\epsilon, Or, P(F)>18(ϵ/2)2+1/(2α2)≫δP(F)>\frac{1}{8}(\epsilon/2)^{2+1/(2\alpha^{2})}\gg\delta.

Similarly in the remaining case (A.10), we have by Lemma A.1 that Either D(F,G)<9ϵD(F,G)<9\epsilon Or P(F)>14(ϵ/2)2+1/(2α2)≫δP(F)>\frac{1}{4}(\epsilon/2)^{2+1/(2\alpha^{2})}\gg\delta. The proof follows. ∎

Keller [Kel11] proved that one may take δ=Cϵ3\delta=C\epsilon^{3} in the special case when ϱ\varrho is uniform. It’s an interesting open question to see whether such polynomial dependence of δ\delta on ϵ\epsilon holds for general distribution ϱ\varrho.

Appendix B A lower bound for the NICD problem using a plurality function

We will analyze the protocol where all players use some balanced plurality function PLUn\texttt{PLU}_{n} that we are going to described below. Define nj=#{i:xi=j}n_{j}=\#\{i:x_{i}=j\} to be the number of times jj is present in the string xx and set R={j∈Ω:nj=max⁡l∈Ωnl}R=\{j\in\Omega:n_{j}=\max_{l\in\Omega}n_{l}\}. Then we define our pluraity function as

Note that if jj is the unique value in Ω\Omega which occurs most frequently in string xx, that is, if R={j}R=\{j\}, then PLUn(x)=j\texttt{PLU}_{n}(x)=j. Also, note that if σ\sigma is any permutation of Ω\Omega then

which implies that PLUn\texttt{PLU}_{n} is balanced.

Define Wj=Wj(n):=n−1/2∑i=1n(1{xi=j}−m−1)W_{j}=W_{j}^{(n)}:=n^{-1/2}\sum_{i=1}^{n}(\mathbf{1}_{\{x_{i}=j\}}-m^{-1}) and Wj′=Wj′(n):=n−1/2∑i=1n(1{yi=j}−m−1)W^{\prime}_{j}={W^{\prime}_{j}}^{(n)}:=n^{-1/2}\sum_{i=1}^{n}(\mathbf{1}_{\{y_{i}=j\}}-m^{-1}) where yy is a ρ\rho-correlated of xx.

The probability of total agreement among kk players is bounded below by the probability event that they all output 11 which is at least

The last step is justified by the fact that WjW_{j} is a sufficient statistics for the conditional distribution of Wj′W_{j}^{\prime} given xx.

and for all 1≤j≠j′≤m1\leq j\neq j^{\prime}\leq m

It now follows from multidimensional Central Limit Theorem that

as n→∞n\to\infty, where N2(0,Σ)N_{2}(0,\Sigma) (resp. Nm(0,Γ)N_{m}(0,\Gamma)) is the two-dimensional (resp. mm-dimensional) normal distribution with mean zero and covariance matrix Σ\Sigma (resp. Γ\Gamma) given by

where (Z1,Z2)∼N2(0,Σ)(Z_{1},Z_{2})\sim N_{2}(0,\Sigma) and (Xj,1≤j≤m)∼Nm(0,Γ)(X_{j},1\leq j\leq m)\sim N_{m}(0,\Gamma). From (B.2), it follows that as n→∞n\to\infty,

Recall that the conditional distribution Z2Z_{2} given Z1Z_{1} is N(ρZ1,σ2.12)N(\rho Z_{1},\sigma_{2.1}^{2}) where σ2.12=(1−ρ2)m−1(1−m−1)≤m−1\sigma_{2.1}^{2}=(1-\rho^{2})m^{-1}(1-m^{-1})\leq m^{-1}. Also recall that if NN is a standard normal random variable, then

and this bound is sharp in the asymptotic sense

The proof of the lower bound is now complete by Lemma B.1. ∎

Fix ρ∈(0,1)\rho\in(0,1). Let (Xj,1≤j≤m)∼Nm(0,m−1Im−m−21m1m′)(X_{j},1\leq j\leq m)\sim N_{m}(0,m^{-1}I_{m}-m^{-2}\mathbf{1}_{m}\mathbf{1}_{m}^{\prime}) and a=a(k,m)=2log⁡(km)ma=a(k,m)=\tfrac{\sqrt{2\log(km)}}{\sqrt{m}}. Then there exists γ2=γ2(ρ)>0\gamma_{2}=\gamma_{2}(\rho)>0 such that for k≥2k\geq 2,

Note that X1+X2+…+Xm=0X_{1}+X_{2}+\ldots+X_{m}=0 with probability one. Therefore,

The conditional distribution of X2X_{2} given Xj,j≥3X_{j},j\geq 3 is given by

where N∼N(0,1)N\sim N(0,1). The lemma now follows from the normal tail estimate. ∎