Hypercontractive inequalities via SOS, and the Frankl--Rödl graph
Manuel Kauers, Ryan O'Donnell, Li-Yang Tan, Yuan Zhou
Introduction
The hypercontractive inequality is almost always used with either or . The -hypercontractivity inequality — i.e., the case , , — is a particularly useful case, as is the following easy corollary:
Theorem 1.1 is known to have a proof which is noticeably simpler than that of the general hypercontractive inequality [MOO05]. Theorem 1.1 can be used to prove, e.g., the KKL Theorem [KKL88], the sharp small-set expansion statement for the -noisy hypercube, and the Invariance Principle of [MOO10]. More generally, the hypercontractivity inequality has the following corollary:
This corollary is often used to control the behavior of low-degree polynomials of random bits.
Reverse hypercontractivity is perhaps most often used to show that if are large sets and is a -correlated pair of random strings then there is a substantial chance that and . This was first deduced in [MOR+06] by deriving the following consequence of reverse hypercontractivity:
The reverse hypercontractive inequality has been used, e.g., in problems related to approximability and hardness of approximation [FKO07, She09, BHM12], and problems in quantitative social choice [MOO10, Mos12a, MOS12b, Kel12, MR12].
The present work is concerned with proving hypercontractive inequalities via “sums of squares” (SOS); i.e., in the Positivstellensatz proof system introduced by Grigoriev and Vorobjov [GV01]. A recent work of Barak et al. [BBH+12] showed that the Khot–Vishnoi [KV05] SDP integrality gap instances for Unique-Games are actually well-solved by the “-round Lasserre SDP hierarchy”; equivalently, the “degree- SOS hierarchy”. This is despite the fact that they are strong gap instances for superconstantly many rounds of other weaker SDP hierarchies such as Lovász–Schrijver+ and Sherali–Adams+ [RS09, KS09]. The key to analyzing the optimum value of the Khot–Vishnoi instances is the hypercontractive inequality, and perhaps the key technical component of the Barak et al. result is showing that Theorem 1.1 has a degree- “SOS proof”. That is, if we treat each as a formal “indeterminate”, then is a degree- polynomial in the indeterminates, and Barak et al. showed that it is a sum of squared polynomials (hence always nonnegative).
The connection between SOS proofs and SDP relaxations for optimization problems was made independently by Lasserre [Las00] and Parrilo [Par00]. Roughly speaking, if a system of -variate polynomial inequalities can be refuted within the degree- SOS proof system of Grigoriev and Vorobjov [GV01], then this refutation can also be found efficiently by solving a semidefinite program of size . The associated “degree- SOS hierarchy” for approximating optimization problems is known to be at least as strong as the Lovász–Schrijver+ and Sherali–Adams+ SDP hierarchies, and the [BBH+12] result shows that it can be noticeably stronger for the notorious Unique Games problem. (For more details, see e.g. [OZ13, BBH+12].)
Later, [OZ13] showed that the degree- SOS hierarchy correctly analyzes the value of the [DKSV06] instances of Balanced-Separator, which are known to be superconstant-factor integrality gap instances for superconstantly many rounds of the “LH SDP hierarchy” [RS09]. It was also shown in [OZ13] that the degree- SOS hierarchy certifies the value of the [KV05] instances of Max-Cut to within factor , whereas superconstantly many rounds of the Sherali–Adams+ hierarchy are still off by a factor of [RS09, KS09]. (The here was very recently improved to any . [DMN13]) The key to the former result was an SOS proof of the KKL Theorem (relying on [BBH+12]’s SOS proof of Theorem 1.1); the key to the latter was an SOS proof of an Invariance Principle variant, which in turn needed an SOS proof of higher-norm hypercontractivity, Theorem 1.2. The work [OZ13] was unable to actually obtain Theorem 1.2 with an SOS proof, but instead obtained a weaker version which sufficed for their purposes.
Still, the full power of the SOS hierarchy is far from well-understood. Analyzing what can and cannot be proved with low-degree SOS proofs is evidently very important; for example, it’s consistent with our current knowledge that the degree- SOS hierarchy refutes the Unique-Games Conjecture, gives a -approximation for Uniform Sparsest-Cut, a -approximation for Vertex-Cover, and certifies that any graph with chromatic number exceeding is not -colorable.
In particular, hypercontractive inequalities have played a key role in many of the sophisticated SDP integrality gap instances. Thus it is natural to ask: Can a sharp version of the hypercontractive inequality be proved in the SOS proof system? Can any version of the reverse hypercontractive inequality be proved? As we will see, the latter question is particularly relevant for the known SDP integrality instances of the -Coloring and Vertex-Cover problems.
2 Our results
The main result in this paper is an SOS proof of the reverse hypercontractivity Theorem 1.3 for all equal to the reciprocal of an even integer. As one application of this, we show that just the degree- algorithm from the SOS hierarchy can certify that the “Frankl–Rödl” SDP integrality gap instances for -Coloring have chromatic number . Finally, we also give an SOS proof of the sharp -hypercontractive inequality for all even integers ; in fact, a version with relaxed moment conditions. We find it interesting to see that the two powerful hypercontractive inequalities admit proofs as “elementary” as sum-of-squares proofs. On the other hand, to obtain these proofs we had to use somewhat elaborate methods, including computer algebra techniques.
As mentioned, Barak et al. [BBH+12] gave an SOS proof of Theorem 1.1, that . Although there is a very easy proof of this theorem “in ZFC” [MOO05], that proof uses the Cauchy–Schwarz inequality, whose square-roots do not obviously translate into SOS statements. The SOS proof in [BBH+12] gets around this by proving the generalized statement , allowing them to replace Cauchy–Schwarz with . In [OZ13] this SOS proof was very slightly generalized to cover the -hypercontractive inequality, for . That work also gave an SOS proof of a weakened version of Theorem 1.2 for all even integers , namely . (Attention is restricted to even integers because the -hypercontractive inequality cannot even be stated as a polynomial inequality otherwise.)
In Section 3 we prove the full -hypercontractive inequality for all even integers . Our strategy is as follows. First, we give a simple proof (“in ZFC”) of -hypercontractivity for all even integers ; our proof works not just for random bits but for any random variables satisfying fairly liberal moment bounds. Indeed, we are not aware of any previous work showing that such moment bounds are sufficient for hypercontractivity. However this proof relies on the well-known fact that the hypercontractivity inequality tensorizes [KS88], which in turn uses the triangle inequality for the -norm, an inequality that cannot even be stated in SOS. For our SOS extension of this result we move to a -function version of the statement as in [BBH+12]; this requires some more work. Our final theorem is as follows:
As corollaries we have SOS proofs of and .
We prove this result in Section 4. An induction on easily reduces the problem to the case; for each , this is an inequality in four real indeterminates. Then by homogeneity we can further reduce to an inequality in just two indeterminates. Nevertheless, giving an SOS-proof of this “two-point inequality” for all seems to be surprisingly tricky. As an example of the problem we need to solve (the case), the reader is invited to try the following puzzle:
is a sum of squared polynomials in and .”
Our solution is presented in Section 4.1. Our high level approach is to employ a change of variables which reduces the task to proving a sequence of one-variable real inequalities. This is helpful because every nonnegative univariate polynomial is SOS; hence we can use any mathematical technique to verify the one-variable inequalities. We establish the one-variable inequalities using techniques from computer algebra. Peculiarly, this approach only works for the specific choice ; however the proof for general can be deduced since the two-point inequality is linear in .
2.1 Application to integrality gap instances for 333-Coloring and Vertex-Cover
Along the lines of [BBH+12, OZ13], our SOS proof of the reverse hypercontractive inequality also has applications to integrality gap instances; specifically, for the -Coloring and Vertex-Cover problems. These problems can be put in a common framework by considering the Maximum Independent-Set problem:
Given graph we define the (fractional) size of its maximum independent set:
There is a one-way connection with -Coloring: any graph with chromatic number has . There is a two-way connection with the Vertex-Cover problem: a set is independent if and only if its complement is a vertex cover (i.e., every meets ). Thus , the minimum (fractional) size of a vertex cover in , is equal to .
Finding the chromatic number or minimum vertex cover of a graph is an -hard problem; thus it has been common to seek efficient approximation algorithms. For example, one may seek an efficient algorithm which can -color any -colorable graph, or find a vertex cover of size at most times the minimum. Neither of these problems is known to be polynomial-time solvable; nor is either known to be -hard. In fact, the -colorability question shows an enormous gap; we only know an efficient algorithm for -coloring -colorable graphs [ACC06], and -hardness of -coloring them [KLS00, GK04]. For Vertex-Cover, there is an easy linear-time -approximation algorithm [GJ79, Gavril 1974], whereas achieving a -approximation is known to be -hard [DS05].
Based on the -year lack of progress on the algorithms side, it is reasonable to suspect that there is no efficient -approximation algorithm for Vertex-Cover. Similarly, one may suspect that there is no efficient algorithm for -coloring -colorable graphs. Indeed, these statements are known to be true assuming the Unique-Games Conjecture in the first case [KR08], and a closely related variant of the Unique-Games Conjecture in the second [DMR09]. However there is reasonable doubt about the Unique-Games Conjecture [ABS10] and it’s important to seek alternative evidence of hardness. One very good form of evidence is showing that strong, generic polynomial-time optimization algorithms fail to give good approximations to the value of the optimal solution. Specifically, one can seek integrality gaps for the canonical hierarchies of linear programming and semidefinite relaxations of the problem. In this work we will often describe integrality gaps in more “proof-theoretic language”. For example, instead of saying that for Vertex-Cover, the complete graph is a factor- integrality gap instance for the linear program, we will say that linear programming “fails to certify , even though ”.
There is a long line of work on integrality gaps for Chromatic-Number, Independent-Set, and Vertex-Cover. Specific works on integrality gaps for Vertex-Cover include [KG98, Cha02, ABL02, ABLT06, Tou06, FO06, STT07a, STT07b, GMT08, GM08, Sch08, CMM09, Tul09, GMPT10, GM10, BCGM11] (see Georgiou’s thesis [Geo10] for a recent survey), and papers on integrality gaps for -Coloring include [KMS98, KG98, AK98, Cha02, FLS04, AG11]. Furthermore, almost any paper on the Lovász -Function [Lov79] is implicitly concerned with integrality gaps for these problems.
Both for -Coloring and Vertex-Cover, the integrality gap papers working with the strongest SDP relaxation employ the “Frankl–Rödl graphs” as their hard instances:
The following theorem is essentially due to Frankl and Rödl [FR87] (a few small details are only worked out in [GMPT10]):
whenever and is sufficiently large.
To obtain our result we need to show an SOS proof for the Frankl–Rödl Theorem. A key ingredient in Frankl and Rödl’s original proof is the vertex isoperimetric inequality on , due to Harper. The standard proof of this inequality involves a “shifting” argument which we do not see how to carry out with SOS. However, it is known that inequalities of this type can also be proved using the reverse hypercontractive inequality studied in this paper. In particular, Benabbas, Hatami, and Magen [BHM12] have very recently proven a “density” variation of the Frankl–Rödl Theorem using the reverse hypercontractive inequality. We obtain the SOS proof for the Frankl–Rödl Theorem by combining our SOS proof for the reverse hypercontractive inequality and an SOS version of the Benabbas–Hatami–Magen proof; see Section 5.
Preliminaries
We describe the SOS (Positivstellensatz) proof system of Grigoriev and Vorobjov [GV01] using the notation from the work [OZ13]; for more details, please see that paper.
Finally, when we will sometimes use the shorthand
which simply means that is SOS and .
We will use the following facts and lemmas in our SOS proofs. The first one, in particular, we use throughout without comment.
The following fact is a well-known consequence of the Fundamental Theorem of Algebra.
A univariate polynomial is SOS if it is nonnegative. In other words, we have
It is also well known that for homogeneous polynomials, one can reduce the number of variables by by “dehomogenizing” the polynomial, getting an SOS representation (if there is one), and rehomogenizing it to get an SOS representation of the original polynomial. Applying this trick to Fact 2.3, we get:
A homogeneous bivariate polynomial is SOS if it is nonnegative.
and each power is either a square or times a square. ∎
Since is a degree- homogeneous polynomial, the claim follows from Fact 2.4: the inequality is indeed true by convexity of . ∎
The hypercontractive inequality in SOS
As a warmup, we give a simple proof (“in ZFC”) of the -hypercontractive inequality for all even integers , which implies Theorem 1.2 for all even integers . As mentioned, we do this under a significantly weakened moment condition:
For a real random variable , the condition is that and
Our proof will show that these moment conditions are sharp; none of them can be relaxed.
By converting to factorials and expanding, one verifies that
By the even moment conditions , each summand in (1) is at most the corresponding term in (2) and the proof is complete. ∎
By considering in (1) and (2) it is easy to see for each in turn that the associated -moment condition cannot be further relaxed.
Our SOS extension of this result requires the following lemma:
Let be an even positive integer and let be indeterminates. Then
The non-SOS proof would be to just apply the AM-GM inequality. For the SOS proof we first trivially write
We then apply the fact that to each summand to deduce
We are now ready to state and prove the full version of Theorem 1.4.
Let be a sequence of independent real random variables satisfying the -Moment Conditions. Then
We prove (3) by induction on . The base case, , is trivial. For general , we can decompose each as
Formally, this means introducing the shorthand , and similarly for . We also introduce the notation , for each , and similarly . Note that these latter four do not depend on . By definition we have .
Using the fact that is independent of all , and has zero odd moments, the left-hand side of (3) can be written as follows:
We apply Lemma 3.3 to each (notice that each is multiplied against an SOS polynomial) to obtain
where the second inequality uses the -Moments Condition and the bound on , and the third inequality uses the induction hypothesis. (Again, note that each inequality is multiplied against an SOS polynomial.) It is easy to check that and so the right-hand side of (3) is simply
Thus to complete the inductive proof, it suffices to show that for each , the coefficient on in (5) is equal to . By symmetry, and taking the sum over first in (5), it suffices to check that for each we have
With a modest amount of work it is possible to prove this identity by “traditional” enumerative combinatorics methods; however it is much more efficient to simply use Zeilberger’s algorithm [Zei90, PWZ97]. This algorithm automatically generates the key rational function
Then, writing for the expression in the sum on the left-hand side of (6), we have
as can be verified by a trivial calculation. Summing the above equation for shows that , where . Together with the initial value , it follows by induction that for all , as required. ∎
The reverse hypercontractive inequality in SOS
This section is devoted to providing a proof Theorem 1.5, the reverse hypercontractivity in the SOS proof system. More precisely:
For each fixed , we prove Theorem 4.1 by induction on . The base case of the induction is the following -variable inequality:
Proving this base case will be the key challenge; for now, we give the induction which proves Theorem 4.1.
Let . Given indeterminates , for , let be shorthand for , let be shorthand for , and similarly define shorthands , . Now
By four applications of induction, we deduce
Now applying the base case of the induction (Theorem 4.2) to the right-hand side of the above we conclude that
Our remaining task is to prove the -variable base case, Theorem 4.2. Let us make a few simplifications. First, we claim it suffices to prove it in the case . To see this, note that
is linear in . Thus if we can show it is SOS for both and , it follows easily that it is SOS for all . And for the task is easy:
by Lemma 2.6. Next, for clarity we make a change of variables; our task becomes showing that for real indeterminates ,
Finally, by homogeneity we can reduce the above to proving the following “two-point inequality”:
Suppose we show that is equal to a sum of squares, say where each is a bivariate polynomial. Viewing this as an SOS identity in only, we deduce that for each since (here denotes the degree of viewed as a univariate polynomial in , and likewise ); similarly, for each . Then
and in the summation each expression is a polynomial in . ∎
It remains to establish the Two-Point Inequality via an SOS proof.
We remind the reader that there is of course a “ZFC” proof of the Two-Point Inequality, since it follows as a special case of the reverse hypercontractive inequality.
This section is devoted to proving the Two-Point Inequality; i.e., showing is SOS. After significant trial and error, we were led to the crucial idea of rewriting it under the following substitutions:
Next we use to eliminate , obtaining
Now we expand in the latter sum so that we can write it as an even polynomial in . We get
In fact that is precisely what we show below, using some computer algebra assistance. We remark, though, that is not a priori clear that this strategy should work; i.e., that should be nonnegative. It does not follow from the truth of the Two-Point Inequality. To see this, observe that whereas the Two-Point Inequality is known to hold for any , it is not true that for all . In fact, for we have
which is nonnegative for all only for the specific choice .
Nevertheless, we now complete the proof of the Two-Point Inequality by showing that are all nonnegative.
For we have (as noted in (9)); henceforth we may assume . For we substitute , into (8); since we get . By Remark 4.3 we have and hence for all .
Denoting the sum in this expression by , Zeilberger’s algorithm [Zei90, PWZ97] finds the recurrence equation
valid for all . The recurrence can be obtained for example by simply typing the command
SumTools[Hypergeometric][ZeilbergerRecurrence](
binomial(2*k,2*j)*(1-t)^(2*k-2*j)/(1+t)^(2*k)*(-4*t)^j,
into the computer algebra software Maple.
Since the coefficients in this recurrence do not depend on but only on , the recurrence can be solved in closed form. Together with the initial values and , it follows that . (Not every computer algebra system may deliver the solution in this form; however, for the correctness of the proof it is sufficient to check that is indeed a solution of the recurrence. This is easy to verify.) Hence,
using the fact that the parenthesized expression is clearly nonnegative. We now split into two cases.
. In this case we simply use that to obtain
which is indeed nonnegative when .
. In this case we use the following estimates:
Note that , and the latter quantity is at most for all . Since is decreasing for we have
It remains to show that for . Since is a quadratic polynomial with negative leading coefficient, we only need to check that . We have , which is clearly nonnegative for . Finally, one may check that
which is evidently nonnegative for . ∎
In fact, we will prove the stronger claim that each is nonnegative even when is set to . I.e., we will show that
is nonnegative. To see that this is indeed stronger, simply note that and are convex combinations of the same two main quantities, but has less of its “weight” on the first quantity , which is clearly nonnegative. We will furthermore show that even .
This is not particularly easy to prove by hand, but using computer assistance yields a compact proof. Using automated guessing [Kau09] one can discover that the following recurrence seems to hold for all integers :
The correctness of this recurrence was shown by computing an ideal of annihilating operators for from the sum definition using creative telescoping and holonomic closure properties, and then showing by a Gröbner basis computation that the guessed recurrence belongs to this ideal. A detailed description of this calculation would lead a bit to far, the interested reader is referred to [Kou13, Kau13, Kau14] for recent introductions to the relevant computational techniques and the algebraic theory behind them.
The Frankl-Rödl Theorem in SOS
We prove Theorem 5.1 by “SOS-izing” the Benabbas–Hatami–Magen Fourier-theoretic proof [BHM12] of the following “density” version of the Frankl–Rödl Theorem:
Here the goes to rather slowly in , which means that the Benabbas–Hatami–Magen proof only recovers the Frankl–Rödl Theorem for . This is due to comparison between the and operators described below; it seems possible that some additional technical work would allow for smaller values of .
Benabbas, Hatami, and Magen [BHM12] introduce the following operator:
The key technical contribution of [BHM12] is showing how to pass between the operators (which are relevant for Frankl–Rödl analysis) and the operators (for which we have reverse hypercontractivity). Intuitively, the operators and should be similar (at least if is bounded away from and ). However there is one caveat: “parity” issues with . For example, if is the indicator of the strings of even Hamming weight, then
Benabbas, Hatami, and Magen evade this parity issue by considering the operator .
For integer , we define the operator .
The crucial theorem in [BHM12]’s work is the following:
where each real number satisfies
Given Theorem 5.5, Benabbas, Hatami, and Magen are able to deduce their main Theorem 5.2 from the reverse hypercontractivity result Theorem 1.3 without too much trouble. We now show that this deduction can also be carried out in the SOS proof system. Specifically, we give here the proof of our Theorem 5.1, relying on the SOS proof of hypercontractivity (Theorem 4.1) from Section 4.
Write (where ) and write . For let us denote
because if ’s Hamming weight has the same parity as ’s then their distance can only be (an even integer) not (an odd one). Using Theorem 5.5 it follows that
(with the second bound using .) We now write to denote and also ; then
We have , from which we may easily deduce
Since we may apply our reverse hypercontractivity result Theorem 4.1 (in Section 4) to deduce
We’re now almost done. First, formally for each . Second, for simplicity we use the bound
where the second inequality is Lemma 2.6. Finally, from Lemma 2.5 we may deduce
for sufficiently large, using our upper bound on . Combining the previous two statements we can get
Conclusions
We describe here a few questions left open by our work. Regarding reverse hypercontractivity, it seems we may not have given the Book proof of the SOS Two-Point Inequality. We would be happy to see a more elegant “human proof”, but even more interesting would be a computer algebra technique that could automatically prove SOS-ness, symbolically for all .
The authors would like to thank Siavosh Benabbas and Hamed Hatami for the advance copy of [BHM12]. Proposition 4.5 was independently proven by Fedor Nazarov; we are very grateful to him for sharing his proof with us. Thanks also to Rajsekar Manokaran, Toni Pitassi, and Doron Zeilberger for helpful discussions.