The Unique Games Conjecture, Integrality Gap for Cut Problems and Embeddability of Negative Type Metrics into $\ell_1$
Subhash A. Khot, Nisheeth K. Vishnoi
Introduction
In recent years, the theory of metric embeddings has played an increasing role in algorithm design. The best approximation algorithms for several NP-hard problems rely on techniques (and theorems) used to embed one metric space into another while preserving all pairwise distances up to a certain not too large factor, known as the distortion of the embedding.
Perhaps, the most well-known application of this paradigm is the SparsestCut problem. Given an -vertex graph along with a set of demand pairs, one seeks to find a non-trivial partition of the graph that minimizes the sparsity, i.e., the ratio of the number of edges cut to the number of demand pairs cut. Strictly speaking, the problem thus defined is the non-uniform version of SparsestCut and in the absence of a qualification, we always mean the non-uniform version. In contrast, the uniform version refers to the special case when the set of demand pairs consists of all possible vertex pairs. In the uniform version, the sparsity is the same (up to a factor and a normalization factor of ) as the ratio of the number of edges cut to the size of the smaller side of the partition. A closely related problem is the BalancedEdge-Separator problem where one desires a partition that cuts a constant fraction of demand pairs and minimizes the number of the edges cut. In its uniform version, one desires a balanced partition, say a -partition,In the uniform case, for a parameter a partition of the vertex set is said to be a partition if each side of the partition contains at least fraction of the vertices. that minimizes the number of the edges cut.
2 Our Contribution
Non-uniform BalancedEdge-Separator has an integrality gap of at least where is an arbitrarily small constant. The integrality gap holds for a standard SDP relaxation with the triangle inequality constraints.
A surprising aspect of our integrality gap construction is that it proceeds via the Unique Games Conjecture (UGC) of Khot (see Section 3 for the statement of the conjecture). We first prove that the UGC implies a super-constant hardness result for non-uniform BalancedEdge-Separator.
Assuming the Unique Games Conjecture, non-uniform BalancedEdge-Separator is NP-hard to approximate within any constant factor.
The integrality gap instance for the UniqueGames SDP relaxation (see Figure 4) is stated below and is one of our main contributions. Here, we choose to provide an informal description of this construction (the reader should be able to understand this construction without even looking at the SDP relaxation).
For every edge , the sets of vectors and are almost the same up to some small perturbation. To be precise, there is a permutation such that , . In other words, for every edge , the basis moves smoothly/continuously to the basis .
For any labeling , i.e., assignment of an integer to every , for at least fraction of the edges , we have . In other words, no matter how we choose to assign a vector for every vertex , the movement from to is discontinuous for almost all edges .
All vectors in have coordinates in the set and, hence, any three of them satisfy the triangle inequality constraint.
This UniqueGames integrality gap instance construction is rather non-intuitive (at least to the authors when this paper was first written): One can walk on the graph by changing the basis continuously, but as soon as one picks a representative vector for each basis, the motion becomes discontinuous almost everywhere. Of course, one can pick these representatives in a continuous fashion for any small enough local sub-graph of , but there is no way to pick representatives in a global fashion.
Before we present a high-level overview of our proofs and discuss the difficulties involved, we give a brief overview of related and subsequent works since the publication of our paper in 2005.
3 Subsequent Works
For non-uniform BalancedEdge-Separator and, hence, non-uniform SparsestCut, our lower bound was improved to by Krauthgamer and Rabani and then to in a sequence of papers by Lee and Naor and Cheeger, Kleiner and Naor . For the uniform case, Devanur et al. obtained the first super-constant lower bound of , thus, disproving the ARV conjecture as well. This latter bound has been recently improved to by Kane and Meka , building on the short code construction of Barak et al. . At a high level, the constructions in are in the same spirit as oursBoth and use a result of Kahn, Kalai and Linial instead of Bourgain (Theorem 2.14) as in our paper. whereas the constructions in are entirely different, based on the geometry of Heisenberg group.
In hindsight, our paper may be best viewed as a scheme that translates a UGC-based hardness result into an integrality gap for a SDP relaxation with triangle inequality constraints. In the conference version of our paper , we applied this scheme to the MaxCut and MinUncut problems as well. In particular, for MaxCut, we showed that the integrality gap for the Goemans and Williamson’s SDP relaxation remains unchanged even after adding triangle inequality constraints. Subsequent works of Raghavendra and Steurer and Khot and Saket cited above extend this paradigm in two directions: Firstly, their SDP solution satisfies additional constraints given by a super-constant number of rounds of the so-called Sherali-Adams LP hierarchy and secondly, they demonstrate that the paradigm holds for every constraint satisfaction problem (CSP). Since these two works already present more general results and in a more intuitive manner, we omit our results for MaxCut and MinUncut from this paper and keep the overall presentation cleaner by restricting only to SparsestCut.
Further, a result of Raghavendra shows that the integrality gap for a certain canonical SDP relaxation can be translated into a UGC-based hardness result with the same gap (this is a translation in the opposite direction as ours). Combined with the results in , one concludes that the integrality gap for the basic SDP relaxation remains unchanged even after adding a super-constant number of rounds of the Sherali-Adams LP relaxation. Finally, our techniques have inspired integrality gap for problems that are strictly speaking not CSPs, e.g., integrality gap for the QuadraticProgramming problem in and some new non-embeddability results, e.g., for the edit distance .
Rest of the Introduction
The overall construction can be divided into three steps:
A PCP reduction from UniqueGames to BalancedEdge-Separator.
Constructing an integrality gap instance for a natural SDP relaxation of UniqueGames.
We present an overview of each of these steps in three separate sections. Before we do that, let us summarize the precise notion of an integrality gap instance of BalancedEdge-Separator. To keep things simple in this exposition, we pretend as if our construction works for the uniform version of BalancedEdge-Separator as well. (Actually it does not; we have to work with the non-uniform version which complicates things a little.)
Given a graph , BalancedEdge-Separator asks for a -partition of that cuts as few edges as possible (however, the algorithm is allowed to output a roughly balanced partition, say -partition). We denote an edge between vertices by The SDP relaxation of BalancedEdge-Separator appears in Figure 1.
Note that a -valued solution represents a true partition and, hence, this is an SDP relaxation. Constraint (4) is the triangle inequality constraint and Constraint (5) stipulates that the partition be balanced.Notice that if a set of vectors is such that for every vector in the set, its antipode is also in the set, then constraint (5) is automatically satisfied. Our construction obeys this property. The notion of integrality gap is summarized in the following definition:
An integrality gap instance of BalancedEdge-Separator is a graph and an assignment of unit vectors to its vertices such that:
Every balanced partition (say -partition, this choice is arbitrary) of cuts at least fraction of edges.
The set of vectors satisfy (3)-(5), and the SDP objective value in Equation (2) is at most .
The integrality gap is defined to be (thus, we desire that ).
The PCP Reduction from Unique Games to Balanced Edge-Separator
An instance of UniqueGames consists of a graph and permutations for every edge . The goal is to find a labeling that satisfies as many edges as possible. An edge is satisfied if . Let denote the maximum fraction of edges satisfied by any labeling.
UGC (Informal Statement): It is NP-hard to decide whether an instance of UniqueGames has (YES instance) or (NO instance), where can be made arbitrarily small by choosing to be a sufficiently large constant.
It is possible to construct an instance of BalancedEdge-Separator from an instance of UniqueGames. We describe only the high level idea here. The construction is parameterized by . The graph has a block of vertices for every . This block contains one vertex for every point in the Boolean hypercube . Denote the set of these vertices by More precisely,
We let . For every edge , the graph has edges between the blocks and . These edges are supposed to capture the constraint that the labels of and are consistent, i.e., . Roughly speaking, a vertex is connected to a vertex if and only if, after identifying the coordinates in via the permutation , the Hamming distance between the bit-strings and is about . This reduction has the following two properties:
(Completeness/YES case): If , then the graph has a -partition that cuts at most fraction of its edges.
(Soundness/NO Case): If , then every -partition of cuts at least fraction of its edges.
We were imprecise on two counts: (1) The soundness property holds only for those partitions that partition a constant fraction of the blocks in a roughly balanced way. We call such partitions piecewise balanced. This is where the issue of uniform versus non-uniform version of BalancedEdge-Separator arises. (2) For the soundness property, we can only claim that every piecewise balanced partition cuts at least fraction of edges, where any can be chosen in advance. Instead, we write for the simplicity of notation.
Integrality Gap Instance for the Unique Games SDP Relaxation
This has already been described in Theorem 1.4. The graph therein along with the orthonormal basis for every can be used to construct an instance of UniqueGames. For every edge , we have an (unambiguously defined) permutation where for all .
Thus, we have a concrete instance of UniqueGames with optimum at most , and which has an SDP solution with objective value at least . This is what an integrality gap example means: The SDP solution cheats in an unfair way.
Integrality Gap Instance for the Balanced Edge-Separator SDP Relaxation
Now we combine the two modules described above. We take the instance as above and run the PCP reduction on it. This gives us an instance of BalancedEdge-Separator. We show that this is an integrality gap instance in the sense of Definition 1.5.
Since is a NO instance of UniqueGames, i.e., , Theorem 1.6 implies that every (piecewise) balanced partition of must cut at least fraction of the edges. We need to have for this to hold.
On the other hand, we can construct an SDP solution for the BalancedEdge-Separator instance which has an objective value of at most . Note that a typical vertex of is where and . To this vertex, we attach the unit vector (for ), where
This holds because whenever is an edge of , we have (after identifying the indices via the permutation ):
for all and
the Hamming distance between and is about .
Quantitative Parameters
It follows from above discussion (see also Definition 1.5) that the integrality gap for BalancedEdge-Separator is provided that , and . We can choose . Since the size of the graph is at most , we see that the integrality gap is as desired.
Proving the Triangle Inequality
Our proof of the triangle inequality constraints is essentially brute-force. As we mentioned before, more recent works obtain a more intuitive proof.
6 Organization of the Main Body of the Paper
In Section 2.1 we recall important definitions and results about metric spaces. Section 2.2 defines the cut optimization problems we are concerned about: SparsestCut and BalancedEdge-Separator. We also give their SDP relaxations for which we construct integrality gap instances. Section 2.5 presents useful tools from Fourier analysis.
In Section 3 we present the UGC and our integrality gap instance for an SDP relaxation of UniqueGames.
In Section 4 we present our PCP reduction from UniqueGames to BalancedEdge-Separator. The soundness proof this reduction is standard and appears in Appendix A.
We build on the UniqueGames integrality gap instance in Section 3 and the PCP reduction in Section 4 to obtain the integrality gap instance for BalancedEdge-Separator. This is presented in Section 5. This section has two parts: In the first part (Section 5.1) we present the graph and in the second part (Section 5.2) we present the corresponding SDP solution and prove its properties.
Appendix B is where we establish the main technical lemma needed to show that the SDP solutions we construct satisfy the triangle inequality constraint.
Preliminaries
We start with basics of metric embeddings. We are concerned with finite metric spaces which we denote by a pair where is the space and is the metric on its points. We say that a space embeds with distortion at most into another space if there exists a map such that for all
If then is said to isometrically embed in
2 Balanced Edge-Separator, Sparsest Cut and their SDP Relaxations
In this section, we define the BalancedEdge-Separator and the SparsestCut problems and their SDP relaxations. All graphs are complete undirected graphs with non-negative weights or demands associated to its edges. For a graph and , let denote the set of edges with one endpoint in and other in . A cut is called non-trivial if and .
The versions of SparsestCut and BalancedEdge-Separator that we define below are non-uniform versions with demands. The uniform version has all demands equal to i.e., unit demand for every pair of vertices.
For a graph with a weight and a demand associated to each edge the goal is to optimize
For a cut , the ratio above is referred to as its sparsity.
The SDP relaxation for SparsestCut appears in Figure 2. We note that this is indeed a relaxation: Any cut corresponds to a feasible SDP solution by setting the vector to be or depending on whether or and is some fixed vector. The length of is chosen so as to satisfy the last SDP constraint. The SDP objective is then the same as the sparsity of the cut.
For a graph with a weight and a demand associated to each edge let be the total demand. Let a balance parameter be given where . The goal is to find a non-trivial cut that minimizes subject to The cuts that satisfy are called -balanced cuts.
The SDP relaxation for BalancedEdge-Separator appears in Figure 3. We note that this is indeed a relaxation: A -balanced cut corresponds to a feasible SDP solution by setting the vector to be or depending on whether or and is a fixed unit vector.
An integrality gap instance for BalancedEdge-Separator is a concrete instance along with a feasible -balanced SDP solution such that the SDP objective is at most and the integral optimum over -balanced cuts is at least . The integrality gap is . Note that the SDP solution is -balanced (in the sense of the last SDP constraint), but the integral optimum is allowed over -balanced cuts, i.e., over a larger class of cuts than the -balanced cuts.
The integrality gap of the SparsestCut SDP relaxation is at most .
The integrality gap of the BalancedEdge-Separator SDP relaxation is at most .
Suppose is a solution for SDP of Figure 3 with objective value
Proof. The idea is that the good SDP solution as given implies the existence of a cut with low sparsity. If this cut already cuts of the demands, we are done. Otherwise the demands cut are erased (i.e., set to zero) and another sparse cut is found w.r.t. to the new (remaining) demands. This process is repeated until the sum of the demands cut in the sequence of cuts obtained so far is at least . At this point, a random XOR of the cuts obtained so far yields a cut that cuts of the demands, but does not cut too much of the edge weight. Formally, we begin by observing that there is a cut with sparsity at most
If the cut happens to be -balanced, then we are done since the edge weight cut by it is at most the sparsity (which is at most ) times the demands cut (which is at most ). Otherwise the demands cut by is at most . We rename the cut as , set all the demands cut to zero, and repeat the process. This leads to a sequence of cuts . The process stops as soon as either
the cut just obtained cuts at least of the demands or else
the sum of the demands cut over these cuts is at least (since a demand is set to zero as soon as it is cut, each original demand is counted at most once).
Note that prior to every step, at most of the (original) demands has been set to zero, so the SDP solution w.r.t. to the remaining demands still qualifies as being balanced. Thus, at every step, the cut obtained has sparsity at most We are done in the Case (a) as before and so we consider the Case (b).
To summarize, we have a sequence of cuts such that the sum of the demands cut over these cuts is at least . Moreover, the sparsity of each of these cuts is at most and, hence, the total edge weight cut by these cuts is at most (an edge is considered cut if it is cut by at least one of the cuts). Now we obtain our desired balanced partition by taking a random XOR of these cuts: The -th cut is viewed as a -valued function on the vertices and the desired cut is given by the function where is a uniformly random subset. We show that for some choice of the set , we get a cut that cuts at least of the demands and at most of the edge weight. Clearly, the total edge weight cut is irrespective of the set . On the other hand, each demand in the sum total of at least gets cut with probability (this is the property of the random XOR). Thus, the expected demands cut by is at least and this expectation is achieved for some choice of .
The proof above shows that if the integrality gap for SparsestCut is upper bounded by then the gap for BalancedEdge-Separator is bounded by . The same proof implicitly also shows that if there is an approximation algorithm for SparsestCut, then the algorithm can be used iteratively a polynomial number of times to achieve (pseudo-)approximation for BalancedEdge-Separator, see also [45, Chapter 7]. Given an instance of BalancedEdge-Separator that has a -balanced cut that cuts an edge weight and where is the total demand, the algorithm finds a -balanced cut that cuts an edge weight . In the contrapositive, a hardness of approximation result for BalancedEdge-Separator implies an hardness result for SparsestCut.
4 Our Integrality Gap Instance for Balanced Edge-Separator
For , a cut is called -piecewise balanced if
We also assign a unit vector to every vertex in the graph. Let denote the vector assigned to vertex . Our construction of the graph and the vector assignment can be summarized as follows:
Fix any . For every sufficiently small there exists a graph , with a partition , and a vector assignment for every such that
.
Every -piecewise balanced cut must cut fraction of edges, i.e., for any such cut
The unit vectors define a negative type metric, i.e., the following triangle inequality is satisfied:
For each part , the vectors are well-separated, i.e.,
The vector assignment gives a low SDP objective value, i.e.,
Construct an instance of BalancedEdge-Separator as follows. The graph is as in Theorem 2.9. The demands depend on the partition . We let if has both endpoints in the same part for some and otherwise. Clearly, the total demand is .
Now, is an assignment of unit vectors that satisfy the triangle inequality constraints. This is a solution to the SDP of Figure 3. Property (4) of Theorem 2.9 guarantees that
Letting the SDP solution is -balanced and its objective value is at most . Using Lemma 2.6, we get a -balanced cut , such that .
Claim: The cut must be a -piecewise balanced cut.
Proof of Claim. Let The total demand cut by is equal to . This is at least since is -balanced. Hence,
Thus, By Cauchy-Schwarz inequality,
Hence, must be a -piecewise balanced cut. However, Property (2) of Theorem 2.9 says that such a cut must cut at least fraction of edges. This implies that . Theorem 1.2 now follows by noting that is arbitrary and .
5 Fourier Analysis
For any
The proof of this follows from the following sequence of equalities:
where the last equality follows from the orthonormality of the characters with respect to the inner product
We also need to define the so-called Bonami-Beckner operator whose input is a Boolean function and whose output is again a Boolean function (which is supposed to be a smoothened version of ).
The following theorem shows that the Bonami-Beckner operator indeed smoothens : It allows us to upper bound a higher norm of of with a lower norm of under certain conditions.
for all
The last set of preliminaries are important for the PCP reduction in Section 4.
The Long Code over a domain is indexed by all . The Long Code of an element is defined to be for all
Thus, a Long Code is simply a Boolean function that is a dictatorship, i.e., it depends only on one coordinate. In particular, if is the Long Code of , then and all other Fourier coefficients are zero.
The following theorem (quantitatively) shows that if a Boolean function is such that its Fourier mass is concentrated on sets of small size, then it must be close to a junta. In other words, its Fourier mass on sets with small Fourier coefficients is small.
Fix any . Then, there exists a constant such that, for all positive integers , for all and for all Boolean functions
The Integrality Gap Instance for Unique Games
In this section, we present the integrality gap construction for a natural SDP relaxation of the UniqueGames problem. We start with defining the UniqueGames problem, the UGC of Khot along with the related preliminaries towards our construction.
The optimum opt of the UniqueGames instance is defined to be the maximum weight of edges satisfied by any labeling:
We assume w.l.o.g that so that the weights define a probability distribution over edges. A choice of a random edge refers to an edge chosen from this distribution. We also assume that the graph is regular in the sense that the sum of weights of edges incident on a vertex is the same for all vertices. A choice of a random edge incident on a vertex refers to a choice of a random edge conditional on having one endpoint as .
For every pair of constants , there exists a sufficiently large constant such that given a UniqueGames instance , it is NP-hard to distinguish whether:
Consider a UniqueGames instance Khot proposed the SDP relaxation in Figure 4 (inspired by a paper of Feige and Lovász ). Here, for every we associate a set of orthogonal vectors . The intention is that if is a label for vertex , then and for all . Here, is some fixed unit vector and is the zero-vector. However, once we take the SDP relaxation, this may no longer be true and could be any set of orthogonal vectors.
The Noisy Hypercube and an Overview of the Integrality Gap Instance
The idea of the label extended graph and the implication that the small set expansion in the label extended graph implies low optimum for the UniqueGames instance were implicit in the conference version of this paper . We choose to make this more explicit here for the ease of presentation as well as in light of recent works that we briefly mention. Raghavendra and Steurer recently proposed the Small Set Expansion Conjecture and showed that it implies the UGC. The former states that for every constant , there exists a constant such that given an -vertex graph that has a small non-expanding set, i.e., of size and with edge expansion at most , it is NP-hard to find a set of size (roughly) that is even somewhat non-expanding, i.e., with expansion at most . The SSE Conjecture has led to many interesting works including a new algorithm for UniqueGames by Arora, Barak and Steurer and the construction of the short code .
Given a UniqueGames instance the corresponding label extended graph is defined as follows:
, we let and .
Note that .
It is helpful to view the label extended graph as being obtained from the UniqueGames graph by replacing every vertex by a group of vertices representing labels to and replacing every edge by an edge-bundle of edges that form a perfect matching between the two groups and capture the bijective constraint .
The expansion of a set in the label extended graph is defined to be the probability of leaving when a random vertex in and then a random edge leaving that vertex (w.r.t. the weights ) is chosen. Note that . Any labeling to a UniqueGames instance corresponds to the set as follows:
An easy observation is that the (weighted) fraction of edges satisfied by a labeling is related to the expansion of the set :
Here is a quick proof of the above equality. Pick a random vertex in by choosing a random vertex . Choosing a random edge incident on (w.r.t. ) amounts to choosing a random edge incident on (w.r.t. ) and outputting . The expansion of is now related to the event that which is same as the event that which is same as the event that satisfies the edge .
As remarked before, our construction starts with the noisy hypercube graph and uses the fact that the graph is a small set expander. A natural way to describe this graph is by describing one step of the random walk on it (which then naturally leads to edge-weights with unit total weight).
The noisy hypercube graph with parameters and has
the vertex set with uniform distribution and
for any vertex , choosing a random edge incident on amounts to flipping every bit of with probability independently and letting to be the string so obtained.
Let be the noisy hypercube with parameters and and be a set of relative size . Then .
Proof. Let be the indicator function of the set so that for any . An application of Bonami-Beckner inequality gives (the probability is taken over choice of a random vertex and a random edge incident on it)
Call an edge of the noisy hypercube typical if the Hamming distance between and is close to , say between and . By the Chernoff bound, the (weighted) fraction of edges which are not typical is at most which is negligible in our context. We delete all these edges (mainly for the ease of presentation) and observe that the conclusion of Lemma 3.6 still holds with the bound . The weights of the edges change slightly, due to a re-normalization to preserve the unit total weight, but we ignore this issue.
We are now ready to construct an integrality gap instance for the SDP in Figure 4. To be precise, for parameters and , we construct an instance of UniqueGames such that
(Soundness) and
(Completeness) There is an SDP solution with objective value at least .
This construction is used later to construct integrality gap instances for cut problems. As mentioned earlier, the UniqueGames instance is constructed precisely so that the noisy hypercube graph happens to be its label extended graph and then the soundness guarantee follows from Lemma 3.6. The vertex set of the noisy hypercube graph is where . It is convenient for us to identify a point in as a Boolean function . We describe the construction formally now.
2 The Integrality Gap Instance
Let denote the family of all Boolean functions on For define the product as
Consider the equivalence relation on defined to be if and only if there is an such that (recall that is the Fourier character function). This relation partitions into equivalence classes , each class containing exactly functions. We denote by one arbitrarily chosen function in as its representative. Thus, by definition,
It follows from the orthogonality of the characters , that all the functions in any class are also mutually orthogonal. Further, for a function let denote the class in which belongs.
Let denote a random perturbation function on where for every independently, with probability and with probability Let be the noisy hypercube graph: It is a graph with vertex set and for Boolean functions the weight of the edge is defined as follows:
where is a uniformly random function and is a random perturbation function. Note that the sum of weights over all (undirected) edges is . Moreover, for any we have We delete all edges such that the Hamming distance between and is outside the range without really affecting anything as observed before.
The UniqueGames instance is now obtained by taking the noisy hypercube graph as above with a grouping of its vertices into classes . The edges of are grouped neatly into edge-bundles: A typical bundle is a set of edges between and , all with the same weight, and forming a perfect matching between the vertices in each group. With this grouping in mind, the graph can now be naturally thought of as a label extended graph. The UniqueGames instance is obtained by thinking of each class as a (super-)vertex, each function as a potential label to it, and the edge bundle between as defining the bijective constraint between them. Here is a formal (somewhat tedious) description.
The UniqueGames graph is defined as follows. The set of vertices is as above. For every with Hamming distance in the range , there is an edge in between the vertices and with weight
(the factor of reflects the fact that there are pairs of functions that define the same edge). The set of labels for the UniqueGames instance is , i.e., the set of labels is identified with the set (and by design ). Note that and for some sets . The bijection for the edge , can now be defined:
Here, is the symmetric difference operator on sets. Note that is a permutation on the set of allowed labels. An alternate view is that the potential labels to class are really the functions in that class and for the edge defined by a pair and as above, designates as a matching pairs of labels for all . We emphasize that every matching pair of labels corresponds to a pair of functions with Hamming distance in .
Soundness: No Good Labeling
Using Lemma 3.6 and Equation (15), i.e., the connection between the optimum of UniqueGames and the small set expansion of the label extended graph, it follows immediately that any labeling to the UniqueGames instance described above achieves an objective of at most
Completeness: A Good SDP Solution
Recall that in the SDP relaxation of UniqueGames (Figure 4), for every vertex in we need to assign a set of orthogonal vectors. For every vertex , we choose a function arbitrarily, and with we associate the set of vectors The following facts are easily verified:
For
For and
For for
Hence, all the conditions (11)-(14) of the SDP are satisfied. Next, we show that this vector assignment has an objective at least Consider any UniqueGames edge defined by a pair with Hamming distance in the range . For any , note that the same edge is defined by the pair with the same Hamming distance and
Since the pairs are precisely the matching pairs of labels for the UniqueGames constraint, it follows that the objective of this SDP solution is at least (accounting possibly for the non-typical pairs with Hamming distance outside of range that were deleted and ignored throughout). Finally, note that since all the vectors have coordinates either or (up to a normalization factor), any three vectors among those described above satisfy the triangle inequality:
Summarizing and Abstracting the Unique Games Instance
For any and any integer that is a power of , there is a UniqueGames instance along with a set of vectors for every vertex such that:
A PCP Reduction from Unique Games to Balanced Edge-Separator
This section presents the reduction from UniqueGames to non-uniform BalancedEdge-Separator which underlies the proof of Theorem 1.3. Remark 2.7 implies that if non-uniform BalancedEdge-Separator is hard to approximate within a factor of then so is non-uniform SparsestCut up to a factor . Hence, Theorem 1.3 can be strengthened as follows.
Assuming the UGC, it is NP-hard to approximate (non-uniform versions of) BalancedEdge-Separator and SparsestCut to within any constant factor.
We present the reduction and the proof of this theorem, modulo the soundness proof of the PCP reduction. The soundness proof is (by now) standard and relegated to Appendix A. The reduction underlying the proof of this theorem is used in the construction of the integrality gap for BalancedEdge-Separator presented in Section 5.
The reduction starts with a UniqueGames instance . Each vertex is replaced with a block of vertices The reduction has a parameter which is to be thought of as a small constant. For each edge in a bundle of weighted edges are put between the two corresponding blocks of vertices taking into account the permutation corresponding to that edge. The weight of the edge between and is equal to the product of the weight of the edge and the probability that, if we flip each bit of independently with probability we obtain Here is the reordering of the coordinates of as dictated by ; formally, for all
Note that if we contract the vertices of the two hypercubes after identifying the coordinates according to we obtain exactly the noisy hypercube introduced in Definition 3.5. To complete the reduction, we need to specify the demand pairs. For reasons that will become clear in a bit, any pair of vertices in the same block is set to have demand one and the remaining pairs have demand zero.
Our reduction has the property that if the UniqueGames instance has a good labeling then there is a cut that cuts a constant fraction of the demand pairs and the weight of the edges crossing the cut is small. This is by construction: If the UniqueGames instance has a good labeling, i.e., a which satisfies at least a fraction of the constraints of then we consider the cut in the reduced graph whose one side consists of the vertices such that and the other side with vertices such that It is easy to see that the weight of the edges that cross this cut is Moreover, the number of demand pairs cut is half that of the total demand pairs as the cut described above cuts each hypercube along a coordinate into two equal parts. This is the completeness of the reduction.
For soundness, we show that if every labeling of the UniqueGames instance satisfies a negligible (as a function of ) fraction of the constraints, any cut in the reduced graph that cuts a constant fraction of demand pairs must have about weight of edges crossing it. Since the reduction is local in the sense that it replaces each vertex in by a set of vertices, and each edge in by a bundle of edges between the corresponding sets, the weighted graph obtained by applying this reduction on inherits connectivity properties of For instance, if is disconnected, then there is a cut in the reduced graph which has no edges crossing it. Such a cut, however, puts each hypercube entirely on one side of the cut or the other, thus, cutting no demand pair. Hence, the way we have enforced demands essentially ensures that each cut in the reduced graph that cuts a constant fraction of demand pairs cuts most of the hypercubes into two roughly equal parts. Hence, for each vertex in we can look at the restriction of this cut to the corresponding hypercube and assign to the label corresponding to the dimension of the hypercube which is the most correlated with the cut restricted to that hypercube. Since does not have a good labeling, this strategy of converting a cut in the reduced graph to a labeling for should not be good. Hence, one can deduce that, for any cut that cuts a constant fraction of the demand in the reduced graph, its restrictions to most hypercubes must not be well-correlated to any coordinate cut. This is where Bourgain’s Junta theorem (Theorem 2.14) comes in. It essentially implies that such a cut must be close to a majority cut in most hypercubes. This allows us to deduce that such a cut has at least weight edges crossing it, giving us the hardness of approximation ratio which can be made larger than any constant by choosing small enough.
We now describe the reduction formally. Here, it is instructive to break the reduction into two parts: The first consists of presenting a PCP verifier for UniqueGames and the second step involves translating the PCP verifier into a BalancedEdge-Separator instance. The completeness and the soundness of this verifier give us the proof of Theorem 4.1.
1 The PCP Verifier
For we present a PCP verifier which given a UniqueGames instance decides whether or The verifier expects, as a proof, the Long Code (see Definition 2.13) of the label of every vertex Formally, a proof is where each is the supposed Long Code of the label of The actions of on are as follows.
Pick with probability .
Pick a random and .
Let be the bijection corresponding to Accept if and only if
The completeness of verifier is easy and we provide a proof here.
For every if opt there is a proof such that
Moreover, every table in is balanced, i.e., exactly half of its entries are and the rest are .
Proof. Since opt there is a labeling for which the total weight of the edges satisfied is at least Hence, if we pick an edge with probability with probability at least we have Let the proof consist of Long Codes of the labels assigned by to the vertices. With probability we have Hence, with probability at least
Noting that a Long Code is balanced, this completes the proof.
The soundness of the reduction involves more work and, since , has become standard. We state the result here and the proof appears in Appendix A. We say that a proof is -piecewise balanced if
Here, is the Fourier coefficient corresponding to the empty set of the Boolean function and the expectation is over a uniformly random vertex .
For every , there exists a constant such that the following holds: Let be sufficiently small and let be an instance of UniqueGames with Then, for every -piecewise balanced proof
2 From the PCP Verifier to a Balanced Edge-Separator Instance
The reduction from the PCP verifier to an instance of non-uniform BalancedEdge-Separator is as follows. Replace the bits in the proof by vertices and replace every (-query) PCP test by an edge of the graph. The weight of the edge is equal to the probability that the test is performed by the PCP verifier. Formally, we start with a UniqueGames instance and replace each vertex by a block of vertices for each For an edge there is an edge in between and with weight
This is exactly the probability that picks the edge and decides to look at the -th (resp. -th) coordinate in the Long Code of the label of (resp. ).
The demand function dem is for any edge between vertices in the same block, and otherwise. Let be half of the total demand.
Assuming the UGC, for any , for a sufficiently large , it is NP-hard to determine whether an instance of UniqueGames has or . We choose and so that
when opt there is a (piecewise balanced) proof that the verifier accepts with probability at least and
when opt, the verifier does not accept any -piecewise balanced proof with probability more than
Note that is defined as in the statement of Lemma 4.3.
Suppose that opt() Let be a labeling that achieves the optimum. Consider the partition in such that consists of all vertices with the property that the Long Code of evaluated at is Clearly, the demands cut by this partition is exactly equal to . Moreover, it follows from Lemma 4.2 that this partition cuts edges with weight at most .
Now, suppose that opt() Then, it follows from Lemma 4.3, that any -balanced partition, with cuts at least fraction of the edges. This is due to the following: Any partition in corresponds to a proof in which we let the (supposed) Long Code of the label of to be at the point if and otherwise. Since as in the proof of Theorem 2.9, is -piecewise balanced and we apply Lemma 4.3.
Thus, we get a hardness factor of for BalancedEdge-Separator and, hence, by Remark 2.7, for SparsestCut as well. This completes the proof of Theorem 4.1.
The Integrality Gap Instance for Balanced Edge-Separator
In this section, we describe the integrality gap instance for BalancedEdge-Separator along with its SDP solution and prove Theorem 2.9. As pointed out in Section 2.3, this also implies an integrality gap for non-uniform SparsestCut. The following is, thus, a strengthening of Theorem 1.3.
Non-uniform versions of SparsestCut and BalancedEdge-Separator have an integrality gap of at least where is arbitrary. The integrality gaps hold for standard SDPs with triangle inequality constraints.
We present a proof of this theorem (by proving Theorem 2.9). The fact that our SDP solution satisfies the triangle inequality constraints relies on a technical lemma whose proof is via an extensive case analysis and is not very illuminating, hence, relegated to Appendix B.
The integrality gap instance for non-uniform BalancedEdge-Separator has two parts: A (weighted) graph on vertices along with demand pairs and a unit vector for each vertex The integrality gap instance is parameterized by and denotes the instance. We show that
every cut in that cuts a constant fraction of the demand pairs must have at least fraction of edges crossing it and that
the set of vectors satisfy the constraints in the SDP in Figure 3 and have an objective value thus, giving us an integrality gap of
The smallest value can take turns out to be , giving us the lower bound
For each vertex there is a block of vertices in Thus, we need a unit vector for each A choice for such a vector is
The fact that this is a unit vector is easy to see. Recall that for a typical edge in the basis vectors are -close when matched according to the permutation corresponding to that edge. Further, recall that for an edge between and there must be an edge between and in Moreover, for a typical edge in except with probability the relative Hamming distance between and is at most (after taking into account the permutation between and in ). This easily implies that for a typical edge in
Since the vectors are of unit length, this implies that
This is what dictates the choice of and we obtain that our SDP solution to has an objective value at most To see the well-separatedness of this SDP solution, observe that for each , and are unit vectors in opposite direction.
It remain to prove that the vectors satisfy the triangle inequality. This is the technically hardest part of the paper and is shown via an extensive case analysis that repeatedly uses the fact that the vectors for satisfy the properties they do. In fact, we do not know whether the vectors described above work for this proof. We need to modify the vectors in (16) as follows
While the inner tensor, which goes to from , is a minor modification, it ensures that when we take inner products of the form
and if for all then the contribution of the cross terms is negligible and the inner product remains around This -th tensor also implies the converse: If
then there is a permutation such that for all
This latter property and the outer tensor are crucial in the proof of the triangle inequality.This property has also been key in the results of Arora et al. . This new SDP solution is also easily seen to satisfy the properties satisfied by the previous SDP solution up to a loss of an additional constant factor.
We conclude this overview by giving the reader some idea of why we have the outer tensor. Start by noting that proving the triangle inequality is the same as showing
since all the vectors have unit length. If none of the dot-products has magnitude at least the inequality holds trivially. Thus, we may assume that one of the inner products, say, . This implies that . By the converse property mentioned earlier, it can be deduced that, for some which can be made very close to by picking large enough. This turns out to be convenient towards proving the triangle inequality via a case analysis, see Lemma 5.8.
Unfortunately, we cannot provide much more intuition than this and, as mentioned in the introduction, for a more intuitive proof of the triangle inequality one can refer to the papers . We now present the graph construction and the SDP solution formally and prove the claims above for the SDP solution.
1 The Graph
We recall the following notations which are needed. For a permutation and a vector the vector is defined to be the vector with its -th entry as For the notation means that the vector is a random vector, with each of its bits independently set to with probability and set to with probability
The BalancedEdge-Separator instance has a parameter and we refer to it as We start with the UniqueGames instance of Theorem 3.7. In each vertex is replaced by a block of vertices denoted by . This block consists of vertices for each Thus, the set of vertices for the BalancedEdge-Separator instance is
The edges in the BalancedEdge-Separator instance are defined as follows: For there is an edge in between and with weight
For every , there exists a constant such that the following holds: Let be sufficiently small and let be an instance of UniqueGames with . Let be the corresponding instance of BalancedEdge-Separator as defined above. Let be the partition of its vertices as above. Then, any -piecewise balanced cut in (in the sense of Definition 2.8) satisfies
2 The SDP Solution
Now we present an SDP solution for that satisfies Properties (3), (4) and (5) of Theorem 2.9. This proves Theorem 2.9 and, hence, Theorem 5.1.
Hence, for every and
Next, we show Property (5) in Theorem 2.9 which establishes that the SDP solution has value when
The proof of this theorem uses the following lemma which shows that, if is an edge in the UniqueGames instance so that the corresponding orthonormal bases are -close (via the permutation ), then and are also close if and are close.
Let and assume that for and Let be defined to be . Then,
Lower Bound:
Upper Bound:
Here, denotes the fraction of points where and differ.
We first show how Lemma 5.4 implies Theorem 5.3.
Proof. [of Theorem 5.3] It is sufficient to prove that for an edge picked with probability (from the UniqueGames instance ), and
Since is an edge of we know from the Closeness Property of Theorem 3.7, that there are such that Moreover, . Further, it follows from a simple Chernoff Bound argument that, except with probability , Thus, using the lower bound estimate from Lemma 5.4, we get that
Now, is at least
The first term in both these expressions is
The second term is bounded by as seen above. This completes the proof of the lemma.
The well-separatedness of the SDP solution, or Property (4) in Theorem 2.9, follows from the following lemma.
The last equality follows from the fact that the contribution of to the expectation is canceled by that of
Finally, the following theorem establishes that our SDP solution satisfies the triangle inequality, Property (3) of Theorem 2.9.
For the set of vectors give rise to a negative-type metric.
Theorem 5.6 requires proving that any three vectors , and satisfy
We can assume that at least one of the dot-products has magnitude at least ; otherwise, the inequality holds trivially. Assume, w.l.o.g., that
This implies that and therefore,
for some . It follows that, for some for some We give a quick proof of this. Let be and Then,
By the Matching Property, for all Hence,
Moreover, by orthonormality, for all
giving us the claimed upper bound on By relabeling, if necessary, we may assume that
Note that (19) is equivalent to showing that
The following elementary lemma, whose proof appears at the end of this section, implies that it is sufficient to prove that
Let such that . Then, for every odd integer .
As noted before, we may assume that and, hence, by the Matching Property,
Let We may assume, w.l.o.g., that the maximum is achieved for and again by the Matching Property,
Now, Theorem 5.6 follows from the following lemma.
where Let for . Define unit vectors
Then, the vectors satisfy the triangle inequality i.e.,
Note that we only have but we can remove the absolute value and use this lemma as it holds for all sign patterns The proof of this lemma is very technical and appears in Appendix B. We conclude with a proof of Lemma 5.7.
Proof. [of Lemma 5.7] First, we notice that it is sufficient to prove this inequality when Suppose that and then Hence, without loss of generality assume that If and then If and by hypothesis, which is the same as and proving is equivalent to proving Hence, we may assume that If then Hence, we may assume that
Further, we may assume that Since, if then implies that Notice that both sides of this inequality are positive. It follows from the fact that that Multiplying these two inequalities, we obtain which implies that This completes the proof.
We would like to thank Assaf Naor and James Lee for ruling out some of our initial approaches. Many thanks to Sanjeev Arora, Moses Charikar, Umesh Vazirani, Ryan O’Donnell and Elchanan Mossel for insightful discussions at various junctures.
References
Appendix A Proof of Soundness of the PCP Reduction
For every , there exists a constant such that the following holds: Let be sufficiently small and let be an instance of UniqueGames with Then, for every -piecewise balanced proof
Proof. The proof is by contradiction: We assume that there is a -piecewise balanced proof which the verifier accepts with probability at least and deduce that We let where is the constant in Bourgain’s Junta theorem.
The probability of acceptance of the verifier is
Using the Fourier expansion and and the orthonormality of characters, we get that this probability is
Here Hence, the acceptance probability is
If this acceptance probability is at least then,
Hence, over the choice of , with probability at least
Call such vertices good. Fix a good vertex Using the Cauchy-Schwarz inequality we get,
Combining Jensen’s inequality and Parseval’s identity, we get that
Now we combine Parseval’s identity with the fact that to obtain
Call good if is nonempty, and
Bounding the contribution due to large sets.
Using the Cauchy-Schwarz inequality, Parseval’s identity and Jensen’s inequality, we get
We can choose to be small enough so that the last term above is less than
Bounding the contribution due to small Fourier coefficients.
Similarly, we use and get
Bounding the contribution due to the empty set.
Lower bound for a very good vertex with good sets.
Now we define a labeling for the UniqueGames instance as follows: For a vertex , pick with probability pick a random element of and define it to be the label of
Let be a very good vertex. It follows that the weight of the edges adjacent to satisfied by this labeling is at least
It follows from the Cauchy-Schwarz inequality and Parseval’s identity that this is at least
Using Jensen’s inequality, we get that this is at least
Here, the last inequality follows from our estimate in Equation (21). Since, with probability at least over the choice of is very good, our labeling satisfies edges with total weight at least This completes the proof of the lemma.
Appendix B Proof of Lemma 5.8 (Triangle Inequality Constraint)
where Let for . Define unit vectors
Then, the vectors satisfy the triangle inequality i.e.,
Proof. It suffices to show that for every ,
We consider four cases depending on value of .
(Case 1) : Since , and we have
Also, . Moreover, for any , by the triangle inequality,
Therefore, . Thus, it suffices to prove that
(Case 2) : We show that
(Subcase i) : In this case it suffices to show that
Again, as before, we have that for every
This also holds when .
(Subcase ii) : We need to prove (28). It suffices to show that
where . Clearly,
Here, we used the assumption that satisfy the triangle inequality. Note also that and . Let and . We have,
Lemma B.2, which appears after this proof, implies that the summation on the last line above is bounded by
This is true if This is true if which holds when Note that we used the fact that
(Case 3) : We have , This implies that where by the triangle inequality
Thus, to prove (27), it suffices to show that
Depending on signs , this reduces to proving one of the three cases:
We prove the first case, and the remaining two are proved in a similar fashion. We have that
provided that Thus, it suffices to have
This is clearly true if are within a quadratic factor of each other, and . On the contrary if since we already have from the triangle inequality, it reduces to Case (2) by setting to and setting to
(Case 4) : This is essentially same as Case (2). Just interchange with and interchange for every . This completes the proof of the lemma.
Let and be non-negative reals, such that and for all Then
Proof. Clearly, .