The Unique Games Conjecture, Integrality Gap for Cut Problems and Embeddability of Negative Type Metrics into $\ell_1$

Subhash A. Khot, Nisheeth K. Vishnoi

Introduction

In recent years, the theory of metric embeddings has played an increasing role in algorithm design. The best approximation algorithms for several NP-hard problems rely on techniques (and theorems) used to embed one metric space into another while preserving all pairwise distances up to a certain not too large factor, known as the distortion of the embedding.

Perhaps, the most well-known application of this paradigm is the SparsestCut problem. Given an nn-vertex graph along with a set of demand pairs, one seeks to find a non-trivial partition of the graph that minimizes the sparsity, i.e., the ratio of the number of edges cut to the number of demand pairs cut. Strictly speaking, the problem thus defined is the non-uniform version of SparsestCut and in the absence of a qualification, we always mean the non-uniform version. In contrast, the uniform version refers to the special case when the set of demand pairs consists of all possible (n2)\binom{n}{2} vertex pairs. In the uniform version, the sparsity is the same (up to a factor 22 and a normalization factor of nn) as the ratio of the number of edges cut to the size of the smaller side of the partition. A closely related problem is the BalancedEdge-Separator problem where one desires a partition that cuts a constant fraction of demand pairs and minimizes the number of the edges cut. In its uniform version, one desires a balanced partition, say a (\nicefrac13,\nicefrac23)(\nicefrac{{1}}{{3}},\nicefrac{{2}}{{3}})-partition,In the uniform case, for a parameter b∈(0,\nicefrac12],b\in(0,\nicefrac{{1}}{{2}}], a partition of the vertex set is said to be a (b,1−b)(b,1-b) partition if each side of the partition contains at least bb fraction of the vertices. that minimizes the number of the edges cut.

2 Our Contribution

Non-uniform BalancedEdge-Separator has an integrality gap of at least (log⁡log⁡n)\nicefrac16−δ,(\log\log n)^{\nicefrac{{1}}{{6}}-\delta}, where δ>0\delta>0 is an arbitrarily small constant. The integrality gap holds for a standard SDP relaxation with the triangle inequality constraints.

A surprising aspect of our integrality gap construction is that it proceeds via the Unique Games Conjecture (UGC) of Khot (see Section 3 for the statement of the conjecture). We first prove that the UGC implies a super-constant hardness result for non-uniform BalancedEdge-Separator.

Assuming the Unique Games Conjecture, non-uniform BalancedEdge-Separator is NP-hard to approximate within any constant factor.

The integrality gap instance for the UniqueGames SDP relaxation (see Figure 4) is stated below and is one of our main contributions. Here, we choose to provide an informal description of this construction (the reader should be able to understand this construction without even looking at the SDP relaxation).

For every edge e{u,v}∈Ee\{u,v\}\in E, the sets of vectors B(u)B(u) and B(v)B(v) are almost the same up to some small perturbation. To be precise, there is a permutation πe:[N]↦[N],\pi_{e}:[N]\mapsto[N], such that ∀ 1≤i≤N\forall\ 1\leq i\leq N,  ⟨uπe(i),vi⟩≥1−η\ \langle{u}_{\pi_{e}(i)},{v}_{i}\rangle\geq 1-\eta. In other words, for every edge (u,v)∈E(u,v)\in E, the basis B(u)B(u) moves smoothly/continuously to the basis B(v)B(v).

For any labeling λ:V↦[N]\lambda:V\mapsto[N], i.e., assignment of an integer λ(u)∈[N]\lambda(u)\in[N] to every u∈Vu\in V, for at least 1−\nicefrac1Nη1-\nicefrac{{1}}{{N^{\eta}}} fraction of the edges e{u,v}∈Ee\{u,v\}\in E, we have λ(u)≠πe(λ(v))\lambda(u)\not=\pi_{e}(\lambda(v)). In other words, no matter how we choose to assign a vector uλ(u)∈B(u){u}_{\lambda(u)}\in B(u) for every vertex u∈Vu\in V, the movement from uλ(u){u}_{\lambda(u)} to vλ(v){v}_{\lambda(v)} is discontinuous for almost all edges e{u,v}∈Ee\{u,v\}\in E.

All vectors in ∪u∈VB(u)\cup_{u\in V}B(u) have coordinates in the set {\nicefrac1N,\nicefrac−1N}\{\nicefrac{{1}}{{\sqrt{N}}},\nicefrac{{-1}}{{\sqrt{N}}}\} and, hence, any three of them satisfy the triangle inequality constraint.

This UniqueGames integrality gap instance construction is rather non-intuitive (at least to the authors when this paper was first written): One can walk on the graph GG by changing the basis B(u)B(u) continuously, but as soon as one picks a representative vector for each basis, the motion becomes discontinuous almost everywhere. Of course, one can pick these representatives in a continuous fashion for any small enough local sub-graph of GG, but there is no way to pick representatives in a global fashion.

Before we present a high-level overview of our proofs and discuss the difficulties involved, we give a brief overview of related and subsequent works since the publication of our paper in 2005.

3 Subsequent Works

For non-uniform BalancedEdge-Separator and, hence, non-uniform SparsestCut, our lower bound was improved to Ω(log⁡log⁡n)\Omega(\log\log n) by Krauthgamer and Rabani and then to (log⁡n)Ω(1)(\log n)^{\Omega(1)} in a sequence of papers by Lee and Naor and Cheeger, Kleiner and Naor . For the uniform case, Devanur et al. obtained the first super-constant lower bound of Ω(log⁡log⁡n)\Omega(\log\log n), thus, disproving the ARV conjecture as well. This latter bound has been recently improved to 2Ω(log⁡log⁡n)2^{\Omega(\sqrt{\log\log n})} by Kane and Meka , building on the short code construction of Barak et al. . At a high level, the constructions in are in the same spirit as oursBoth and use a result of Kahn, Kalai and Linial instead of Bourgain (Theorem 2.14) as in our paper. whereas the constructions in are entirely different, based on the geometry of Heisenberg group.

In hindsight, our paper may be best viewed as a scheme that translates a UGC-based hardness result into an integrality gap for a SDP relaxation with triangle inequality constraints. In the conference version of our paper , we applied this scheme to the MaxCut and MinUncut problems as well. In particular, for MaxCut, we showed that the integrality gap for the Goemans and Williamson’s SDP relaxation remains unchanged even after adding triangle inequality constraints. Subsequent works of Raghavendra and Steurer and Khot and Saket cited above extend this paradigm in two directions: Firstly, their SDP solution satisfies additional constraints given by a super-constant number of rounds of the so-called Sherali-Adams LP hierarchy and secondly, they demonstrate that the paradigm holds for every constraint satisfaction problem (CSP). Since these two works already present more general results and in a more intuitive manner, we omit our results for MaxCut and MinUncut from this paper and keep the overall presentation cleaner by restricting only to SparsestCut.

Further, a result of Raghavendra shows that the integrality gap for a certain canonical SDP relaxation can be translated into a UGC-based hardness result with the same gap (this is a translation in the opposite direction as ours). Combined with the results in , one concludes that the integrality gap for the basic SDP relaxation remains unchanged even after adding a super-constant number of rounds of the Sherali-Adams LP relaxation. Finally, our techniques have inspired integrality gap for problems that are strictly speaking not CSPs, e.g., integrality gap for the QuadraticProgramming problem in and some new non-embeddability results, e.g., for the edit distance .

Rest of the Introduction

The overall construction can be divided into three steps:

A PCP reduction from UniqueGames to BalancedEdge-Separator.

Constructing an integrality gap instance for a natural SDP relaxation of UniqueGames.

We present an overview of each of these steps in three separate sections. Before we do that, let us summarize the precise notion of an integrality gap instance of BalancedEdge-Separator. To keep things simple in this exposition, we pretend as if our construction works for the uniform version of BalancedEdge-Separator as well. (Actually it does not; we have to work with the non-uniform version which complicates things a little.)

Given a graph G′(V′,E′)G^{\prime}(V^{\prime},E^{\prime}), BalancedEdge-Separator asks for a (\nicefrac12,\nicefrac12)(\nicefrac{{1}}{{2}},\nicefrac{{1}}{{2}})-partition of V′V^{\prime} that cuts as few edges as possible (however, the algorithm is allowed to output a roughly balanced partition, say (\nicefrac14,\nicefrac34)(\nicefrac{{1}}{{4}},\nicefrac{{3}}{{4}})-partition). We denote an edge ee between vertices i,ji,j by e{i,j}.e\{i,j\}. The SDP relaxation of BalancedEdge-Separator appears in Figure 1.

Note that a {+1,−1}\{+1,-1\}-valued solution represents a true partition and, hence, this is an SDP relaxation. Constraint (4) is the triangle inequality constraint and Constraint (5) stipulates that the partition be balanced.Notice that if a set of vectors {vi:i∈V′}\{v_{i}:i\in V^{\prime}\} is such that for every vector in the set, its antipode is also in the set, then constraint (5) is automatically satisfied. Our construction obeys this property. The notion of integrality gap is summarized in the following definition:

An integrality gap instance of BalancedEdge-Separator is a graph G′(V′,E′)G^{\prime}(V^{\prime},E^{\prime}) and an assignment of unit vectors i↦vii\mapsto{v}_{i} to its vertices such that:

Every balanced partition (say (\nicefrac14,\nicefrac34)(\nicefrac{{1}}{{4}},\nicefrac{{3}}{{4}})-partition, this choice is arbitrary) of V′V^{\prime} cuts at least α\alpha fraction of edges.

The set of vectors {vi∣ i∈V′}\{{v}_{i}|\ i\in V^{\prime}\} satisfy (3)-(5), and the SDP objective value in Equation (2) is at most γ\gamma.

The integrality gap is defined to be \nicefracαγ\nicefrac{{\alpha}}{{\gamma}} (thus, we desire that γ≪α\gamma\ll\alpha).

The PCP Reduction from Unique Games to Balanced Edge-Separator

An instance  U=(G(V,E),[N],{πe}e∈E)\ {\mathcal{U}}=(G(V,E),[N],\{\pi_{e}\}_{e\in E}) of UniqueGames consists of a graph G(V,E)G(V,E) and permutations πe:[N]↦[N]\pi_{e}:[N]\mapsto[N] for every edge e{u,v}∈Ee\{u,v\}\in E. The goal is to find a labeling λ:V↦[N]\lambda:V\mapsto[N] that satisfies as many edges as possible. An edge e{u,v}e\{u,v\} is satisfied if λ(u)=πe(λ(v))\lambda(u)=\pi_{e}(\lambda(v)). Let opt(U){\rm opt}({\mathcal{U}}) denote the maximum fraction of edges satisfied by any labeling.

UGC (Informal Statement): It is NP-hard to decide whether an instance U{\mathcal{U}} of UniqueGames has opt(U)≥1−η{\rm opt}({\mathcal{U}})\geq 1-\eta (YES instance) or opt(U)≤ζ{\rm opt}({\mathcal{U}})\leq\zeta (NO instance), where η,ζ>0\eta,\zeta>0 can be made arbitrarily small by choosing NN to be a sufficiently large constant.

It is possible to construct an instance of BalancedEdge-Separator Gε′(V′,E′)G^{\prime}_{\varepsilon}(V^{\prime},E^{\prime}) from an instance of UniqueGames. We describe only the high level idea here. The construction is parameterized by ε>0\varepsilon>0. The graph Gε′G^{\prime}_{\varepsilon} has a block of 2N2^{N} vertices for every u∈Vu\in V. This block contains one vertex for every point in the Boolean hypercube {−1,1}N\{-1,1\}^{N}. Denote the set of these vertices by V′[u].V^{\prime}[u]. More precisely,

We let V′=def∪u∈VV′[u]V^{\prime}\stackrel{{\scriptstyle\textup{def}}}{{=}}\cup_{u\in V}V^{\prime}[u]. For every edge e{u,v}∈Ee\{u,v\}\in E, the graph Gε′G^{\prime}_{\varepsilon} has edges between the blocks V′[u]V^{\prime}[u] and V′[v]V^{\prime}[v]. These edges are supposed to capture the constraint that the labels of uu and vv are consistent, i.e., λ(u)=πe(λ(v))\lambda(u)=\pi_{e}(\lambda(v)). Roughly speaking, a vertex (u,x)∈V′[u](u,x)\in V^{\prime}[u] is connected to a vertex (v,y)∈V′[v](v,y)\in V^{\prime}[v] if and only if, after identifying the coordinates in [N][N] via the permutation πe\pi_{e}, the Hamming distance between the bit-strings xx and yy is about εN\varepsilon N. This reduction has the following two properties:

(Completeness/YES case): If opt(U)≥1−η{\rm opt}({\mathcal{U}})\geq 1-\eta, then the graph Gε′G^{\prime}_{\varepsilon} has a (\nicefrac12,\nicefrac12)(\nicefrac{{1}}{{2}},\nicefrac{{1}}{{2}})-partition that cuts at most η+ε\eta+\varepsilon fraction of its edges.

(Soundness/NO Case): If opt(U)≤2−O(\nicefrac1ε2){\rm opt}({\mathcal{U}})\leq 2^{-O(\nicefrac{{1}}{{\varepsilon^{2}}})}, then every (\nicefrac14,\nicefrac34)(\nicefrac{{1}}{{4}},\nicefrac{{3}}{{4}})-partition of Gε′G^{\prime}_{\varepsilon} cuts at least ε\sqrt{\varepsilon} fraction of its edges.

We were imprecise on two counts: (1) The soundness property holds only for those partitions that partition a constant fraction of the blocks V′[u]V^{\prime}[u] in a roughly balanced way. We call such partitions piecewise balanced. This is where the issue of uniform versus non-uniform version of BalancedEdge-Separator arises. (2) For the soundness property, we can only claim that every piecewise balanced partition cuts at least εt\varepsilon^{t} fraction of edges, where any t>\nicefrac12t>\nicefrac{{1}}{{2}} can be chosen in advance. Instead, we write ε\sqrt{\varepsilon} for the simplicity of notation.

Integrality Gap Instance for the Unique Games SDP Relaxation

This has already been described in Theorem 1.4. The graph G(V,E)G(V,E) therein along with the orthonormal basis B(u),B(u), for every u∈V,u\in V, can be used to construct an instance U=(G(V,E),[N],{πe}e∈E){\mathcal{U}}=(G(V,E),[N],\{\pi_{e}\}_{e\in E}) of UniqueGames. For every edge e{u,v}∈Ee\{u,v\}\in E, we have an (unambiguously defined) permutation πe:[N]↦[N],\pi_{e}:[N]\mapsto[N], where  ⟨uπe(i),vi⟩≥1−η,\ \langle{u}_{\pi_{e}(i)},{v}_{i}\rangle\geq 1-\eta, for all 1≤i≤N1\leq i\leq N.

Thus, we have a concrete instance of UniqueGames with optimum at most \nicefrac1Nη=o(1)\nicefrac{{1}}{{N^{\eta}}}=o(1), and which has an SDP solution with objective value at least 1−η1-\eta. This is what an integrality gap example means: The SDP solution cheats in an unfair way.

Integrality Gap Instance for the Balanced Edge-Separator SDP Relaxation

Now we combine the two modules described above. We take the instance U=(G(V,E),[N],{πe}e∈E){\mathcal{U}}=(G(V,E),[N],\{\pi_{e}\}_{e\in E}) as above and run the PCP reduction on it. This gives us an instance G′(V′,E′)G^{\prime}(V^{\prime},E^{\prime}) of BalancedEdge-Separator. We show that this is an integrality gap instance in the sense of Definition 1.5.

Since U{\mathcal{U}} is a NO instance of UniqueGames, i.e., opt(U)=o(1){\rm opt}({\mathcal{U}})=o(1), Theorem 1.6 implies that every (piecewise) balanced partition of G′G^{\prime} must cut at least ε\sqrt{\varepsilon} fraction of the edges. We need to have \nicefrac1Nη≤2−O(\nicefrac1ε2)\nicefrac{{1}}{{N^{\eta}}}\leq 2^{-O(\nicefrac{{1}}{{\varepsilon^{2}}})} for this to hold.

On the other hand, we can construct an SDP solution for the BalancedEdge-Separator instance which has an objective value of at most O(η+ε)O(\eta+\varepsilon). Note that a typical vertex of G′G^{\prime} is (u,x),(u,x), where u∈Vu\in V and x∈{−1,1}Nx\in\{-1,1\}^{N}. To this vertex, we attach the unit vector Vu,x⊗t{\mathbf{V}}_{u,x}^{\otimes t} (for t=2240+1t=2^{240}+1), where

This holds because whenever ((u,x),(v,y))((u,x),(v,y)) is an edge of G′G^{\prime}, we have (after identifying the indices via the permutation πe:[N]↦[N]\pi_{e}:[N]\mapsto[N]):

⟨uπe(i),vi⟩≥1−η\langle{u}_{\pi_{e}(i)},{v}_{i}\rangle\geq 1-\eta for all 1≤i≤N1\leq i\leq N and

the Hamming distance between xx and yy is about εN\varepsilon N.

Quantitative Parameters

It follows from above discussion (see also Definition 1.5) that the integrality gap for BalancedEdge-Separator is Ω(\nicefrac1ε)\Omega(\nicefrac{{1}}{{\sqrt{\varepsilon}}}) provided that η≈ε\eta\approx\varepsilon, and Nη>2O(\nicefrac1ε2)N^{\eta}>2^{O(\nicefrac{{1}}{{\varepsilon^{2}}})}. We can choose η≈ε≈(log⁡N)\nicefrac−13\eta\approx\varepsilon\approx(\log N)^{\nicefrac{{-1}}{{3}}}. Since the size of the graph G′G^{\prime} is at most n=22Nn=2^{2N}, we see that the integrality gap is ≈(log⁡log⁡n)\nicefrac16\approx(\log\log n)^{\nicefrac{{1}}{{6}}} as desired.

Proving the Triangle Inequality

Our proof of the triangle inequality constraints is essentially brute-force. As we mentioned before, more recent works obtain a more intuitive proof.

6 Organization of the Main Body of the Paper

In Section 2.1 we recall important definitions and results about metric spaces. Section 2.2 defines the cut optimization problems we are concerned about: SparsestCut and BalancedEdge-Separator. We also give their SDP relaxations for which we construct integrality gap instances. Section 2.5 presents useful tools from Fourier analysis.

In Section 3 we present the UGC and our integrality gap instance for an SDP relaxation of UniqueGames.

In Section 4 we present our PCP reduction from UniqueGames to BalancedEdge-Separator. The soundness proof this reduction is standard and appears in Appendix A.

We build on the UniqueGames integrality gap instance in Section 3 and the PCP reduction in Section 4 to obtain the integrality gap instance for BalancedEdge-Separator. This is presented in Section 5. This section has two parts: In the first part (Section 5.1) we present the graph and in the second part (Section 5.2) we present the corresponding SDP solution and prove its properties.

Appendix B is where we establish the main technical lemma needed to show that the SDP solutions we construct satisfy the triangle inequality constraint.

Preliminaries

We start with basics of metric embeddings. We are concerned with finite metric spaces which we denote by a pair (X,d),(X,d), where XX is the space and dd is the metric on its points. We say that a space (X1,d1)(X_{1},d_{1}) embeds with distortion at most Γ\Gamma into another space (X2,d2)(X_{2},d_{2}) if there exists a map ϕ:X1↦X2\phi:X_{1}\mapsto X_{2} such that for all x,y∈X1x,y\in X_{1}

If  Γ=1,\ \Gamma=1, then (X1,d1)(X_{1},d_{1}) is said to isometrically embed in (X2,d2).(X_{2},d_{2}).

2 Balanced Edge-Separator, Sparsest Cut and their SDP Relaxations

In this section, we define the BalancedEdge-Separator and the SparsestCut problems and their SDP relaxations. All graphs are complete undirected graphs with non-negative weights or demands associated to its edges. For a graph G(V,E)G(V,E) and S⊆VS\subseteq V, let E(S,S‾)E(S,\overline{S}) denote the set of edges with one endpoint in SS and other in S‾\overline{S}. A cut (S,S‾)(S,\overline{S}) is called non-trivial if S≠∅S\not=\emptyset and S‾≠∅\overline{S}\not=\emptyset.

The versions of SparsestCut and BalancedEdge-Separator that we define below are non-uniform versions with demands. The uniform version has all demands equal to 1,1, i.e., unit demand for every pair of vertices.

For a graph G(V,E)G(V,E) with a weight wt(e){\rm wt}(e) and a demand dem(e){\rm dem}(e) associated to each edge e∈E,e\in E, the goal is to optimize

For a cut (S,S‾)(S,\overline{S}), the ratio above is referred to as its sparsity.

The SDP relaxation for SparsestCut appears in Figure 2. We note that this is indeed a relaxation: Any cut (S,S‾)(S,\overline{S}) corresponds to a feasible SDP solution by setting the vector vx{v}_{x} to be v0{v_{0}} or −v0-{v_{0}} depending on whether x∈Sx\in S or x∈S‾x\in\overline{S} and v0{v_{0}} is some fixed vector. The length of v0{v_{0}} is chosen so as to satisfy the last SDP constraint. The SDP objective is then the same as the sparsity of the cut.

For a graph G(V,E)G(V,E) with a weight wt(e),{\rm wt}(e), and a demand dem(e){\rm dem}(e) associated to each edge e∈E,e\in E, let D=def∑e∈Edem(e)D\stackrel{{\scriptstyle\textup{def}}}{{=}}\sum_{e\in E}{\rm dem}(e) be the total demand. Let a balance parameter BB be given where \nicefracD6≤B≤\nicefracD2\nicefrac{{D}}{{6}}\leq B\leq\nicefrac{{D}}{{2}}. The goal is to find a non-trivial cut (S,S‾)(S,\overline{S}) that minimizes ∑e∈E(S,S‾)wt(e),\sum_{e\in E(S,\overline{S})}{\rm wt}(e), subject to ∑e∈E(S,S‾)dem(e)≥B.\sum_{e\in E(S,\overline{S})}{\rm dem}(e)\geq B. The cuts that satisfy ∑e∈E(S,S‾)dem(e)≥B\sum_{e\in E(S,\overline{S})}{\rm dem}(e)\geq B are called BB-balanced cuts.

The SDP relaxation for BalancedEdge-Separator appears in Figure 3. We note that this is indeed a relaxation: A BB-balanced cut (S,S‾)(S,\overline{S}) corresponds to a feasible SDP solution by setting the vector vx{v}_{x} to be v0{v_{0}} or −v0-{v_{0}} depending on whether x∈Sx\in S or x∈S‾x\in\overline{S} and v0{v_{0}} is a fixed unit vector.

An integrality gap instance for BalancedEdge-Separator is a concrete instance along with a feasible BB-balanced SDP solution such that the SDP objective is at most γ\gamma and the integral optimum over \nicefracB3\nicefrac{{B}}{{3}}-balanced cuts is at least α\alpha. The integrality gap is \nicefracαγ\nicefrac{{\alpha}}{{\gamma}}. Note that the SDP solution is BB-balanced (in the sense of the last SDP constraint), but the integral optimum is allowed over \nicefracB3\nicefrac{{B}}{{3}}-balanced cuts, i.e., over a larger class of cuts than the BB-balanced cuts.

The integrality gap of the SparsestCut SDP relaxation is at most f(n)f(n).

The integrality gap of the BalancedEdge-Separator SDP relaxation is at most O(f(n))O(f(n)).

Suppose x↦vxx\mapsto{v}_{x} is a solution for SDP of Figure 3 with objective value

Proof. The idea is that the good SDP solution as given implies the existence of a cut with low sparsity. If this cut already cuts Ω(B)\Omega(B) of the demands, we are done. Otherwise the demands cut are erased (i.e., set to zero) and another sparse cut is found w.r.t. to the new (remaining) demands. This process is repeated until the sum of the demands cut in the sequence of cuts obtained so far is at least Ω(B)\Omega(B). At this point, a random XOR of the cuts obtained so far yields a cut that cuts Ω(B)\Omega(B) of the demands, but does not cut too much of the edge weight. Formally, we begin by observing that there is a cut (S,S‾)(S,\overline{S}) with sparsity at most f(n)⋅\nicefracεB.f(n)\cdot\nicefrac{{\varepsilon}}{{B}}.

If the cut (S,S‾)(S,\overline{S}) happens to be \nicefracB3\nicefrac{{B}}{{3}}-balanced, then we are done since the edge weight cut by it is at most the sparsity (which is at most f(n)⋅\nicefracεBf(n)\cdot\nicefrac{{\varepsilon}}{{B}}) times the demands cut (which is at most D≤6BD\leq 6B). Otherwise the demands cut by (S,S‾)(S,\overline{S}) is at most \nicefracB3\nicefrac{{B}}{{3}}. We rename the cut as (S1,S‾1)(S_{1},\overline{S}_{1}), set all the demands cut to zero, and repeat the process. This leads to a sequence of cuts (S1,S‾1),…,(Sk,S‾k)(S_{1},\overline{S}_{1}),\ldots,(S_{k},\overline{S}_{k}). The process stops as soon as either

the cut just obtained cuts at least \nicefracB3\nicefrac{{B}}{{3}} of the demands or else

the sum of the demands cut over these kk cuts is at least \nicefrac2B3\nicefrac{{2B}}{{3}} (since a demand is set to zero as soon as it is cut, each original demand is counted at most once).

Note that prior to every step, at most \nicefrac2B3\nicefrac{{2B}}{{3}} of the (original) demands has been set to zero, so the SDP solution w.r.t. to the remaining demands still qualifies as being B−\nicefrac2B3=\nicefracB3B-\nicefrac{{2B}}{{3}}=\nicefrac{{B}}{{3}} balanced. Thus, at every step, the cut obtained has sparsity at most f(n)⋅\nicefracε(\nicefracB3).f(n)\cdot\nicefrac{{\varepsilon}}{{(\nicefrac{{B}}{{3}})}}. We are done in the Case (a) as before and so we consider the Case (b).

To summarize, we have a sequence of cuts (S1,S‾1),…,(Sk,S‾k)(S_{1},\overline{S}_{1}),\ldots,(S_{k},\overline{S}_{k}) such that the sum of the demands cut over these kk cuts is at least \nicefrac2B3\nicefrac{{2B}}{{3}}. Moreover, the sparsity of each of these cuts is at most O(f(n)⋅\nicefracεB)O(f(n)\cdot\nicefrac{{\varepsilon}}{{B}}) and, hence, the total edge weight cut by these cuts is at most O(f(n)ε)O(f(n)\varepsilon) (an edge is considered cut if it is cut by at least one of the kk cuts). Now we obtain our desired balanced partition by taking a random XOR of these cuts: The ii-th cut is viewed as a {0,1}\{0,1\}-valued function ϕi\phi_{i} on the vertices and the desired cut is given by the function ϕA=def⊕i∈Aϕi\phi_{A}\stackrel{{\scriptstyle\textup{def}}}{{=}}\oplus_{i\in A}\phi_{i} where A⊆[k]A\subseteq[k] is a uniformly random subset. We show that for some choice of the set AA, we get a cut ϕA\phi_{A} that cuts at least \nicefracB3\nicefrac{{B}}{{3}} of the demands and at most O(f(n)ε)O(f(n)\varepsilon) of the edge weight. Clearly, the total edge weight cut is O(f(n)ε)O(f(n)\varepsilon) irrespective of the set AA. On the other hand, each demand in the sum total of at least \nicefrac2B3\nicefrac{{2B}}{{3}} gets cut with probability \nicefrac12\nicefrac{{1}}{{2}} (this is the property of the random XOR). Thus, the expected demands cut by ϕA\phi_{A} is at least \nicefracB3\nicefrac{{B}}{{3}} and this expectation is achieved for some choice of AA.

The proof above shows that if the integrality gap for SparsestCut is upper bounded by f(n)f(n) then the gap for BalancedEdge-Separator is bounded by O(f(n))O(f(n)). The same proof implicitly also shows that if there is an f(n)f(n) approximation algorithm for SparsestCut, then the algorithm can be used iteratively a polynomial number of times to achieve O(f(n))O(f(n)) (pseudo-)approximation for BalancedEdge-Separator, see also [45, Chapter 7]. Given an instance of BalancedEdge-Separator that has a BB-balanced cut that cuts an edge weight α\alpha and B≥\nicefracD6B\geq\nicefrac{{D}}{{6}} where DD is the total demand, the algorithm finds a \nicefracB3\nicefrac{{B}}{{3}}-balanced cut that cuts an edge weight O(f(n)α)O(f(n)\alpha). In the contrapositive, a g(n)g(n) hardness of approximation result for BalancedEdge-Separator implies an Ω(g(n))\Omega(g(n)) hardness result for SparsestCut.

4 Our Integrality Gap Instance for Balanced Edge-Separator

For  0≤θ≤1\ 0\leq\theta\leq 1, a cut A:V↦{−1,1}A:V\mapsto\{-1,1\} is called θ\theta-piecewise balanced if

We also assign a unit vector to every vertex in the graph. Let vx{v}_{x} denote the vector assigned to vertex xx. Our construction of the graph G(V,wt)G(V,{\rm wt}) and the vector assignment x↦vxx\mapsto{v}_{x} can be summarized as follows:

Fix any \nicefrac12<t<1\nicefrac{{1}}{{2}}<t<1. For every sufficiently small ε>0,\varepsilon>0, there exists a graph G(V,wt)G(V,{\rm wt}), with a partition V=∪i=1rViV=\cup_{i=1}^{r}V_{i}, and a vector assignment x↦vxx\mapsto{v}_{x} for every x∈V,x\in V, such that

∣V∣≤22O(\nicefrac1ε3)|V|\leq 2^{2^{O(\nicefrac{{1}}{{\varepsilon^{3}}})}}.

Every \nicefrac56\nicefrac{{5}}{{6}}-piecewise balanced cut AA must cut εt\varepsilon^{t} fraction of edges, i.e., for any such cut

The unit vectors {vx ∣ x∈V}\{{v}_{x}\ |\ x\in V\} define a negative type metric, i.e., the following triangle inequality is satisfied:

For each part ViV_{i}, the vectors {vx ∣ x∈Vi}\{{v}_{x}\ |\ x\in V_{i}\} are well-separated, i.e.,

The vector assignment gives a low SDP objective value, i.e.,

Construct an instance of BalancedEdge-Separator as follows. The graph G(V,wt)G(V,{\rm wt}) is as in Theorem 2.9. The demands dem(e){\rm dem}(e) depend on the partition V=∪i=1rViV=\cup_{i=1}^{r}V_{i}. We let dem(e)=1{\rm dem}(e)=1 if ee has both endpoints in the same part ViV_{i} for some 1≤i≤r1\leq i\leq r and dem(e)=0{\rm dem}(e)=0 otherwise. Clearly, the total demand is D=def∑edem(e)=r⋅(\nicefrac∣V∣r2)D\stackrel{{\scriptstyle\textup{def}}}{{=}}\sum_{e}{\rm dem}(e)=r\cdot\binom{\nicefrac{{|V|}}{{r}}}{2}.

Now, x↦vxx\mapsto{v}_{x} is an assignment of unit vectors that satisfy the triangle inequality constraints. This is a solution to the SDP of Figure 3. Property (4) of Theorem 2.9 guarantees that

Letting B=def\nicefracD2,B\stackrel{{\scriptstyle\textup{def}}}{{=}}\nicefrac{{D}}{{2}}, the SDP solution is BB-balanced and its objective value is at most ε\varepsilon. Using Lemma 2.6, we get a B′B^{\prime}-balanced cut (A,A‾)(A,\overline{A}), B′≥\nicefracB3B^{\prime}\geq\nicefrac{{B}}{{3}} such that ∑e∈E(A,A‾)wt(e)≤O(Γ⋅ε)\sum_{e\in E(A,\overline{A})}{\rm wt}(e)\leq O(\Gamma\cdot\varepsilon).

Claim: The cut (A,A‾)(A,\overline{A}) must be a \nicefrac56\nicefrac{{5}}{{6}}-piecewise balanced cut.

Proof of Claim. Let pi=defPr⁡x∈Vi[A(x)=1].p_{i}\stackrel{{\scriptstyle\textup{def}}}{{=}}{\Pr}_{x\in V_{i}}[A(x)=1]. The total demand cut by (A,A‾)(A,\overline{A}) is equal to ∑i=1rpi(1−pi)∣Vi∣2\sum_{i=1}^{r}p_{i}(1-p_{i})|V_{i}|^{2}. This is at least B′≥\nicefracB3B^{\prime}\geq\nicefrac{{B}}{{3}} since (A,A‾)(A,\overline{A}) is B′B^{\prime}-balanced. Hence,

Thus, ∑i=1rpi(1−pi)≥\nicefracr12.\sum_{i=1}^{r}p_{i}(1-p_{i})\geq\nicefrac{{r}}{{12}}. By Cauchy-Schwarz inequality,

Hence, (A,A‾)(A,\overline{A}) must be a \nicefrac56\nicefrac{{5}}{{6}}-piecewise balanced cut. However, Property (2) of Theorem 2.9 says that such a cut must cut at least εt\varepsilon^{t} fraction of edges. This implies that Γ=Ω(\nicefrac1ε1−t)\Gamma=\Omega(\nicefrac{{1}}{{\varepsilon^{1-t}}}). Theorem 1.2 now follows by noting that t>\nicefrac12t>\nicefrac{{1}}{{2}} is arbitrary and n=∣V∣≤22O(\nicefrac1ε3)n=|V|\leq 2^{2^{O(\nicefrac{{1}}{{\varepsilon^{3}}})}}.

5 Fourier Analysis

For any f:{−1,1}n↦{−1,1},f:\{-1,1\}^{n}\mapsto\{-1,1\}, ∑S⊆[n]f^S2=1.\sum_{S\subseteq[n]}\widehat{f}_{S}^{2}=1.

The proof of this follows from the following sequence of equalities:

where the last equality follows from the orthonormality of the characters {χS}S⊆[n]\{\chi_{S}\}_{S\subseteq[n]} with respect to the inner product ⟨⋅,⋅⟩2.\langle\cdot,\cdot\rangle_{2}.

We also need to define the so-called Bonami-Beckner operator whose input is a Boolean function ff and whose output is again a Boolean function (which is supposed to be a smoothened version of ff).

The following theorem shows that the Bonami-Beckner operator indeed smoothens ff: It allows us to upper bound a higher norm of Tρ[f]T_{\rho}[f] of ff with a lower norm of ff under certain conditions.

for all 0≤ρ≤(p−1q−1)\nicefrac12.0\leq\rho\leq\left(\frac{p-1}{q-1}\right)^{\nicefrac{{1}}{{2}}}.

The last set of preliminaries are important for the PCP reduction in Section 4.

The Long Code over a domain [N][N] is indexed by all x∈{−1,1}Nx\in\{-1,1\}^{N}. The Long Code ff of an element j∈[N]j\in[N] is defined to be f(x)=defχ{j}(x)=xj,f(x)\stackrel{{\scriptstyle\textup{def}}}{{=}}\chi_{\{j\}}(x)=x_{j}, for all x=(x1,…,xN) ∈ {−1,1}N.x=(x_{1},\ldots,x_{N})\ \in\ \{-1,1\}^{N}.

Thus, a Long Code is simply a Boolean function that is a dictatorship, i.e., it depends only on one coordinate. In particular, if ff is the Long Code of j∈[N]j\in[N], then f^{j}=1\widehat{f}_{\{j\}}=1 and all other Fourier coefficients are zero.

The following theorem (quantitatively) shows that if a Boolean function is such that its Fourier mass is concentrated on sets of small size, then it must be close to a junta. In other words, its Fourier mass on sets with small Fourier coefficients is small.

Fix any \nicefrac12<t<1\nicefrac{{1}}{{2}}<t<1. Then, there exists a constant ct>0,c_{t}>0, such that, for all positive integers kk, for all γ>0\gamma>0 and for all Boolean functions f:{−1,1}n↦{−1,1},f:\{-1,1\}^{n}\mapsto\{-1,1\},

The Integrality Gap Instance for Unique Games

In this section, we present the integrality gap construction for a natural SDP relaxation of the UniqueGames problem. We start with defining the UniqueGames problem, the UGC of Khot along with the related preliminaries towards our construction.

The optimum opt(U)({\mathcal{U}}) of the UniqueGames instance is defined to be the maximum weight of edges satisfied by any labeling:

We assume w.l.o.g that ∑e∈Ewt(e)=1\sum_{e\in E}{\rm wt}(e)=1 so that the weights define a probability distribution over edges. A choice of a random edge refers to an edge chosen from this distribution. We also assume that the graph is regular in the sense that the sum of weights of edges incident on a vertex is the same for all vertices. A choice of a random edge incident on a vertex vv refers to a choice of a random edge conditional on having one endpoint as vv.

For every pair of constants η,ζ>0\eta,\zeta>0, there exists a sufficiently large constant N=N(η,ζ)N=N(\eta,\zeta) such that given a UniqueGames instance   U=(G(V,E),[N],{πe}e∈E,wt)\;{\mathcal{U}}=\left(G(V,E),[N],\{\pi_{e}\}_{e\in E},{\rm wt}\right), it is NP-hard to distinguish whether:

Consider a UniqueGames instance U=(G(V,E),[N],{πe}e∈E,wt).{\mathcal{U}}=\left(G(V,E),[N],\{\pi_{e}\}_{e\in E},{\rm wt}\right). Khot proposed the SDP relaxation in Figure 4 (inspired by a paper of Feige and Lovász ). Here, for every v∈V,v\in V, we associate a set of NN orthogonal vectors {v1,…,vN}\{{v}_{1},\ldots,{v}_{N}\}. The intention is that if i0∈[N]i_{0}\in[N] is a label for vertex v∈Vv\in V, then vi0=N1,{v}_{i_{0}}=\sqrt{N}{\bf 1}, and vi=0{v}_{i}={\bf 0} for all i≠i0i\not=i_{0}. Here, 1{\bf 1} is some fixed unit vector and 0{\bf 0} is the zero-vector. However, once we take the SDP relaxation, this may no longer be true and {v1,v2,…,vN}\{{v}_{1},{v}_{2},\ldots,{v}_{N}\} could be any set of orthogonal vectors.

The Noisy Hypercube and an Overview of the Integrality Gap Instance

The idea of the label extended graph and the implication that the small set expansion in the label extended graph implies low optimum for the UniqueGames instance were implicit in the conference version of this paper . We choose to make this more explicit here for the ease of presentation as well as in light of recent works that we briefly mention. Raghavendra and Steurer recently proposed the Small Set Expansion Conjecture and showed that it implies the UGC. The former states that for every constant ε>0\varepsilon>0, there exists a constant δ>0\delta>0 such that given an nn-vertex graph that has a small non-expanding set, i.e., of size δn\delta n and with edge expansion at most ε\varepsilon, it is NP-hard to find a set of size (roughly) δn\delta n that is even somewhat non-expanding, i.e., with expansion at most 1−ε1-\varepsilon. The SSE Conjecture has led to many interesting works including a new algorithm for UniqueGames by Arora, Barak and Steurer and the construction of the short code .

Given a UniqueGames instance U=(G(V,E),[N],{πe}e∈E,wt),{\mathcal{U}}=\left(G(V,E),[N],\{\pi_{e}\}_{e\in E},{\rm wt}\right), the corresponding label extended graph G′(V′,E′,wt′)G^{\prime}(V^{\prime},E^{\prime},{\rm wt}^{\prime}) is defined as follows:

∀e{v,w}∈E,i∈[N]\forall e\{v,w\}\in E,i\in[N], we let e′{(v,πe(i)),(w,i)}∈E′e^{\prime}\{(v,\pi_{e}(i)),(w,i)\}\in E^{\prime} and wt′(e′)=wt(e){\rm wt}^{\prime}(e^{\prime})={\rm wt}(e).

Note that ∑e′∈E′wt′(e′)=N\sum_{e^{\prime}\in E^{\prime}}{\rm wt}^{\prime}(e^{\prime})=N.

It is helpful to view the label extended graph as being obtained from the UniqueGames graph by replacing every vertex vv by a group of NN vertices representing labels to vv and replacing every edge e{v,w}e\{v,w\} by an edge-bundle of NN edges that form a perfect matching between the two groups and capture the bijective constraint πe\pi_{e}.

The expansion Φ(S′)\Phi(S^{\prime}) of a set S′⊆V′S^{\prime}\subseteq V^{\prime} in the label extended graph is defined to be the probability of leaving S′S^{\prime} when a random vertex in S′S^{\prime} and then a random edge leaving that vertex (w.r.t. the weights wt′{\rm wt}^{\prime}) is chosen. Note that Φ(S′)∈\Phi(S^{\prime})\in. Any labeling λ:V↦[N]\lambda:V\mapsto[N] to a UniqueGames instance corresponds to the set Sλ′⊆V′S^{\prime}_{\lambda}\subseteq V^{\prime} as follows:

An easy observation is that the (weighted) fraction of edges satisfied by a labeling λ\lambda is related to the expansion of the set Sλ′S^{\prime}_{\lambda}:

Here is a quick proof of the above equality. Pick a random vertex (v,λ(v))(v,\lambda(v)) in Sλ′S^{\prime}_{\lambda} by choosing a random vertex v∈Vv\in V. Choosing a random edge incident on (v,λ(v))(v,\lambda(v)) (w.r.t. wt′{\rm wt}^{\prime}) amounts to choosing a random edge e{v,w}e\{v,w\} incident on vv (w.r.t. wt{\rm wt}) and outputting {(v,λ(v)),(w,πe−1(λ(v)))}\{(v,\lambda(v)),(w,\pi_{e}^{-1}(\lambda(v)))\}. The expansion of Sλ′S^{\prime}_{\lambda} is now related to the event that (w,πe−1(λ(v)))∈Sλ′(w,\pi_{e}^{-1}(\lambda(v)))\in S^{\prime}_{\lambda} which is same as the event that πe−1(λ(v))=λ(w)\pi_{e}^{-1}(\lambda(v))=\lambda(w) which is same as the event that λ\lambda satisfies the edge e{v,w}e\{v,w\}.

As remarked before, our construction starts with the noisy hypercube graph and uses the fact that the graph is a small set expander. A natural way to describe this graph is by describing one step of the random walk on it (which then naturally leads to edge-weights with unit total weight).

The noisy hypercube graph HH with parameters NN and 0<η<\nicefrac120<\eta<\nicefrac{{1}}{{2}} has

the vertex set {−1,1}N\{-1,1\}^{N} with uniform distribution and

for any vertex x∈{−1,1}N{x}\in\{-1,1\}^{N}, choosing a random edge (x,y)({x},{y}) incident on x{x} amounts to flipping every bit of x{x} with probability η\eta independently and letting y{y} to be the string so obtained.

Let HH be the noisy hypercube with parameters NN and η\eta and S⊆{−1,1}NS\subseteq\{-1,1\}^{N} be a set of relative size \nicefrac1N\nicefrac{{1}}{{N}}. Then 1−Φ(S)≤\nicefrac1Nη+η21-\Phi(S)\leq\nicefrac{{1}}{{N^{\eta+\eta^{2}}}}.

Proof. Let f:{−1,1}N↦{0,1}f:\{-1,1\}^{N}\mapsto\{0,1\} be the indicator function of the set SS so that ∥f∥pp=\nicefrac1N\|f\|_{p}^{p}=\nicefrac{{1}}{{N}} for any 1≤p<∞1\leq p<\infty. An application of Bonami-Beckner inequality gives (the probability is taken over choice of a random vertex x{x} and a random edge (x,y)({x},{y}) incident on it)

Call an edge (x,y)({x},{y}) of the noisy hypercube typical if the Hamming distance between x{x} and y{y} is close to ηN\eta N, say between η2N\frac{\eta}{2}N and 2ηN2\eta N. By the Chernoff bound, the (weighted) fraction of edges which are not typical is at most 2−Ω(ηN)2^{-\Omega(\eta N)} which is negligible in our context. We delete all these edges (mainly for the ease of presentation) and observe that the conclusion of Lemma 3.6 still holds with the bound 1−Φ(S)≤\nicefrac1Nη1-\Phi(S)\leq\nicefrac{{1}}{{N^{\eta}}}. The weights of the edges change slightly, due to a re-normalization to preserve the unit total weight, but we ignore this issue.

We are now ready to construct an integrality gap instance for the SDP in Figure 4. To be precise, for parameters NN and η\eta, we construct an instance U=(G(V,E),[N],{πe}e∈E,wt){\mathcal{U}}=\left(G(V,E),[N],\{\pi_{e}\}_{e\in E},{\rm wt}\right) of UniqueGames such that

(Soundness) opt(U)≤\nicefrac1Nη{\rm opt}({\mathcal{U}})\leq\nicefrac{{1}}{{N^{\eta}}} and

(Completeness) There is an SDP solution with objective value at least 1−9η1-9\eta.

This construction is used later to construct integrality gap instances for cut problems. As mentioned earlier, the UniqueGames instance is constructed precisely so that the noisy hypercube graph happens to be its label extended graph and then the soundness guarantee follows from Lemma 3.6. The vertex set of the noisy hypercube graph is {−1,1}N\{-1,1\}^{N} where N=2kN=2^{k}. It is convenient for us to identify a point in {−1,1}N\{-1,1\}^{N} as a Boolean function f:{−1,1}k↦{−1,1}f:\{-1,1\}^{k}\mapsto\{-1,1\}. We describe the construction formally now.

2 The Integrality Gap Instance

Let F{\mathcal{F}} denote the family of all Boolean functions on {−1,1}k.\{-1,1\}^{k}. For f,g∈F,f,g\in{\mathcal{F}}, define the product fgfg as

Consider the equivalence relation ≡\equiv on F{\mathcal{F}} defined to be f≡gf\equiv g if and only if there is an S⊆[k],S\subseteq[k], such that f=gχSf=g\chi_{S} (recall that χS\chi_{S} is the Fourier character function). This relation partitions F{\mathcal{F}} into equivalence classes P1,…,Pm{\mathcal{P}}_{1},\ldots,{\mathcal{P}}_{m}, each class containing exactly N=2kN=2^{k} functions. We denote by [Pi][{\mathcal{P}}_{i}] one arbitrarily chosen function in Pi{\mathcal{P}}_{i} as its representative. Thus, by definition,

It follows from the orthogonality of the characters {χS}S⊆[k]\{\chi_{S}\}_{S\subseteq[k]}, that all the functions in any class are also mutually orthogonal. Further, for a function f∈F,f\in{\mathcal{F}}, let P(f){\mathcal{P}}(f) denote the class Pi{\mathcal{P}}_{i} in which ff belongs.

Let μ∈ηF{\mu}\in_{\eta}{\mathcal{F}} denote a random perturbation function on {−1,1}k\{-1,1\}^{k} where for every x∈{−1,1}k,x\in\{-1,1\}^{k}, independently, μ(x)=1{\mu}(x)=1 with probability 1−η,1-\eta, and −1-1 with probability η.\eta. Let HH be the noisy hypercube graph: It is a graph with vertex set F{\mathcal{F}} and for Boolean functions f,g∈F,f,g\in{\mathcal{F}}, the weight of the edge {f,g}\{f,g\} is defined as follows:

where hh is a uniformly random function and μ{\mu} is a random perturbation function. Note that the sum of weights over all (undirected) edges is 11. Moreover, for any S⊆[k],S\subseteq[k], we have wt′({f,g})=wt′({fχS,gχS}).{\rm wt}^{\prime}(\{f,g\})={\rm wt}^{\prime}(\{f\chi_{S},g\chi_{S}\}). We delete all edges {f,g}\{f,g\} such that the Hamming distance between ff and gg is outside the range [η2N,2ηN][\frac{\eta}{2}N,2\eta N] without really affecting anything as observed before.

The UniqueGames instance U=(G(V,E),[N],{πe}e∈E,wt){\mathcal{U}}=\left(G(V,E),[N],\{\pi_{e}\}_{e\in E},{\rm wt}\right) is now obtained by taking the noisy hypercube graph HH as above with a grouping of its vertices into classes P1,…,Pm{\mathcal{P}}_{1},\ldots,{\mathcal{P}}_{m}. The edges of HH are grouped neatly into edge-bundles: A typical bundle is a set of NN edges between Pi{\mathcal{P}}_{i} and Pj{\mathcal{P}}_{j}, all with the same weight, and forming a perfect matching between the NN vertices in each group. With this grouping in mind, the graph can now be naturally thought of as a label extended graph. The UniqueGames instance is obtained by thinking of each class Pi{\mathcal{P}}_{i} as a (super-)vertex, each function f∈Pif\in{\mathcal{P}}_{i} as a potential label to it, and the edge bundle between Pi,Pj{\mathcal{P}}_{i},{\mathcal{P}}_{j} as defining the bijective constraint between them. Here is a formal (somewhat tedious) description.

The UniqueGames graph G(V,E)G(V,E) is defined as follows. The set of vertices is V=def{P1,…,Pm}V\stackrel{{\scriptstyle\textup{def}}}{{=}}\{{\mathcal{P}}_{1},\ldots,{\mathcal{P}}_{m}\} as above. For every f,g∈Ff,g\in{\mathcal{F}} with Hamming distance in the range [η2N,2ηN][\frac{\eta}{2}N,2\eta N], there is an edge in EE between the vertices P(f){\mathcal{P}}(f) and P(g){\mathcal{P}}(g) with weight

(the factor of NN reflects the fact that there are NN pairs of functions that define the same edge). The set of labels for the UniqueGames instance is 2[k]=def{S:S⊆[k]}2^{[k]}\stackrel{{\scriptstyle\textup{def}}}{{=}}\{S:S\subseteq[k]\}, i.e., the set of labels [N][N] is identified with the set 2[k]2^{[k]} (and by design N=2kN=2^{k}). Note that f=[Pi]χSf=[{\mathcal{P}}_{i}]\chi_{S} and g=[Pj]χTg=[{\mathcal{P}}_{j}]\chi_{T} for some sets S,T⊆[k]S,T\subseteq[k]. The bijection πe,\pi_{e}, for the edge e{Pi,Pj}e\{{\mathcal{P}}_{i},{\mathcal{P}}_{j}\}, can now be defined:

Here, ⋆\star is the symmetric difference operator on sets. Note that πe:2[k]↦2[k]\pi_{e}:2^{[k]}\mapsto 2^{[k]} is a permutation on the set of allowed labels. An alternate view is that the potential labels to class Pi{\mathcal{P}}_{i} are really the functions in that class and for the edge defined by a pair f∈Pif\in{\mathcal{P}}_{i} and g∈Pjg\in{\mathcal{P}}_{j} as above, πe\pi_{e} designates (fχU,gχU)(f\chi_{U},g\chi_{U}) as a matching pairs of labels for all U⊆[k]U\subseteq[k]. We emphasize that every matching pair of labels corresponds to a pair of functions with Hamming distance in [η2N,2ηN][\frac{\eta}{2}N,2\eta N].

Soundness: No Good Labeling

Using Lemma 3.6 and Equation (15), i.e., the connection between the optimum of UniqueGames and the small set expansion of the label extended graph, it follows immediately that any labeling to the UniqueGames instance described above achieves an objective of at most \nicefrac1Nη.\nicefrac{{1}}{{N^{\eta}}}.

Completeness: A Good SDP Solution

Recall that in the SDP relaxation of UniqueGames (Figure 4), for every vertex in V,V, we need to assign a set of orthogonal vectors. For every vertex Pi∈V{\mathcal{P}}_{i}\in V, we choose a function f∈Pif\in{\mathcal{P}}_{i} arbitrarily, and with Pi,{\mathcal{P}}_{i}, we associate the set of vectors {ufχS⊗2}S⊆[k].\left\{{u}_{f\chi_{S}}^{\otimes 2}\right\}_{S\subseteq[k]}. The following facts are easily verified:

∑S⊆[k]⟨ufχS⊗2,ufχS⊗2⟩=∑S⊆[k]⟨ufχS,ufχS⟩2=N.\sum_{S\subseteq[k]}\left\langle{u}_{f\chi_{S}}^{\otimes 2},{u}_{f\chi_{S}}^{\otimes 2}\right\rangle=\sum_{S\subseteq[k]}\left\langle{u}_{f\chi_{S}},{u}_{f\chi_{S}}\right\rangle^{2}=N.

For S≠T⊆[k],S\neq T\subseteq[k], ⟨ufχS⊗2,ufχT⊗2⟩=⟨ufχS,ufχT⟩2=⟨uχS,uχT⟩2=0.\left\langle{u}_{f\chi_{S}}^{\otimes 2},{u}_{f\chi_{T}}^{\otimes 2}\right\rangle=\left\langle{u}_{f\chi_{S}},{u}_{f\chi_{T}}\right\rangle^{2}=\left\langle{u}_{\chi_{S}},{u}_{\chi_{T}}\right\rangle^{2}=0.

For f,g∈Ff,g\in{\mathcal{F}} and S,T⊆[k],S,T\subseteq[k], ⟨ufχS⊗2,ugχT⊗2⟩=⟨ufχS,ugχT⟩2≥0.\left\langle{u}_{f\chi_{S}}^{\otimes 2},{u}_{g\chi_{T}}^{\otimes 2}\right\rangle=\left\langle{u}_{f\chi_{S}},{u}_{g\chi_{T}}\right\rangle^{2}\geq 0.

For f∈Pi,f\in{\mathcal{P}}_{i}, g∈Pjg\in{\mathcal{P}}_{j} for i≠j,i\neq j,

Hence, all the conditions (11)-(14) of the SDP are satisfied. Next, we show that this vector assignment has an objective at least 1−9η.1-9\eta. Consider any UniqueGames edge defined by a pair f,gf,g with Hamming distance in the range [η2N,2ηN][\frac{\eta}{2}N,2\eta N]. For any S⊆[k]S\subseteq[k], note that the same edge is defined by the pair fχS,gχSf\chi_{S},g\chi_{S} with the same Hamming distance and

Since the pairs (fχS,gχS)(f\chi_{S},g\chi_{S}) are precisely the matching pairs of labels for the UniqueGames constraint, it follows that the objective of this SDP solution is at least 1−9η1-9\eta (accounting possibly for the non-typical pairs f,gf,g with Hamming distance outside of range [η2N,2ηN][\frac{\eta}{2}N,2\eta N] that were deleted and ignored throughout). Finally, note that since all the vectors have coordinates either 11 or −1-1 (up to a normalization factor), any three vectors u,v,wu,v,w among those described above satisfy the triangle inequality:

Summarizing and Abstracting the Unique Games Instance

For any 0<η<\nicefrac120<\eta<\nicefrac{{1}}{{2}} and any integer NN that is a power of 22, there is a UniqueGames instance Uη=(G(V,E),[N],{πe}e∈E,wt){\mathcal{U}}_{\eta}=\left(G(V,E),[N],\{\pi_{e}\}_{e\in E},{\rm wt}\right) along with a set of vectors {vi⊗2}i∈[N]\{{v}_{i}^{\otimes 2}\}_{i\in[N]} for every vertex such that:

A PCP Reduction from Unique Games to Balanced Edge-Separator

This section presents the reduction from UniqueGames to non-uniform BalancedEdge-Separator which underlies the proof of Theorem 1.3. Remark 2.7 implies that if non-uniform BalancedEdge-Separator is hard to approximate within a factor of C,C, then so is non-uniform SparsestCut up to a factor Ω(C)\Omega(C). Hence, Theorem 1.3 can be strengthened as follows.

Assuming the UGC, it is NP-hard to approximate (non-uniform versions of) BalancedEdge-Separator and SparsestCut to within any constant factor.

We present the reduction and the proof of this theorem, modulo the soundness proof of the PCP reduction. The soundness proof is (by now) standard and relegated to Appendix A. The reduction underlying the proof of this theorem is used in the construction of the integrality gap for BalancedEdge-Separator presented in Section 5.

The reduction starts with a UniqueGames instance U=(G(V,E),[N],{πe}e∈E,wt){\mathcal{U}}=\left(G(V,E),[N],\{\pi_{e}\}_{e\in E},{\rm wt}\right). Each vertex v∈Vv\in V is replaced with a block of vertices {(v,x):x∈{−1,1}N}.\{(v,x):x\in\{-1,1\}^{N}\}. The reduction has a parameter ε\varepsilon which is to be thought of as a small constant. For each edge e{v,w}e\{v,w\} in U,{\mathcal{U}}, a bundle of weighted edges are put between the two corresponding blocks of vertices taking into account the permutation πe\pi_{e} corresponding to that edge. The weight of the edge between (v,x)(v,x) and (w,y)(w,y) is equal to the product of the weight of the edge e{v,w}e\{v,w\} and the probability that, if we flip each bit of xx independently with probability ε,\varepsilon, we obtain y∘πe.y\circ\pi_{e}. Here y∘πey\circ\pi_{e} is the reordering of the coordinates of yy as dictated by πe\pi_{e}; formally, (y∘πe)i=yπe(i)(y\circ\pi_{e})_{i}=y_{\pi_{e}(i)} for all i∈[N].i\in[N].

Note that if we contract the vertices of the two hypercubes after identifying the coordinates according to πe,\pi_{e}, we obtain exactly the noisy hypercube introduced in Definition 3.5. To complete the reduction, we need to specify the demand pairs. For reasons that will become clear in a bit, any pair of vertices in the same block is set to have demand one and the remaining pairs have demand zero.

Our reduction has the property that if the UniqueGames instance has a good labeling then there is a cut that cuts a constant fraction of the demand pairs and the weight of the edges crossing the cut is small. This is by construction: If the UniqueGames instance U{\mathcal{U}} has a good labeling, i.e., a λ:V↦[N]\lambda:V\mapsto[N] which satisfies at least a 1−ε1-\varepsilon fraction of the constraints of U,{\mathcal{U}}, then we consider the cut in the reduced graph whose one side consists of the vertices (v,x)(v,x) such that xλ(v)=1x_{\lambda(v)}=1 and the other side with vertices (v,x)(v,x) such that xλ(v)=−1.x_{\lambda(v)}=-1. It is easy to see that the weight of the edges that cross this cut is 1−(1−ε)(1−ε)=O(ε).1-(1-\varepsilon)(1-\varepsilon)=O(\varepsilon). Moreover, the number of demand pairs cut is half that of the total demand pairs as the cut described above cuts each hypercube along a coordinate into two equal parts. This is the completeness of the reduction.

For soundness, we show that if every labeling of the UniqueGames instance satisfies a negligible (as a function of ε\varepsilon) fraction of the constraints, any cut in the reduced graph that cuts a constant fraction of demand pairs must have about ε≫ε\sqrt{\varepsilon}\gg\varepsilon weight of edges crossing it. Since the reduction is local in the sense that it replaces each vertex in U{\mathcal{U}} by a set of vertices, and each edge in U{\mathcal{U}} by a bundle of edges between the corresponding sets, the weighted graph obtained by applying this reduction on U{\mathcal{U}} inherits connectivity properties of U.{\mathcal{U}}. For instance, if U{\mathcal{U}} is disconnected, then there is a cut in the reduced graph which has no edges crossing it. Such a cut, however, puts each hypercube entirely on one side of the cut or the other, thus, cutting no demand pair. Hence, the way we have enforced demands essentially ensures that each cut in the reduced graph that cuts a constant fraction of demand pairs cuts most of the hypercubes into two roughly equal parts. Hence, for each vertex vv in U{\mathcal{U}} we can look at the restriction of this cut to the corresponding hypercube and assign to vv the label corresponding to the dimension of the hypercube which is the most correlated with the cut restricted to that hypercube. Since U{\mathcal{U}} does not have a good labeling, this strategy of converting a cut in the reduced graph to a labeling for U{\mathcal{U}} should not be good. Hence, one can deduce that, for any cut that cuts a constant fraction of the demand in the reduced graph, its restrictions to most hypercubes must not be well-correlated to any coordinate cut. This is where Bourgain’s Junta theorem (Theorem 2.14) comes in. It essentially implies that such a cut must be close to a majority cut in most hypercubes. This allows us to deduce that such a cut has at least ε\sqrt{\varepsilon} weight edges crossing it, giving us the hardness of approximation ratio ≈\nicefracεε\approx\nicefrac{{\sqrt{\varepsilon}}}{{\varepsilon}} which can be made larger than any constant by choosing ε\varepsilon small enough.

We now describe the reduction formally. Here, it is instructive to break the reduction into two parts: The first consists of presenting a PCP verifier for UniqueGames and the second step involves translating the PCP verifier into a BalancedEdge-Separator instance. The completeness and the soundness of this verifier give us the proof of Theorem 4.1.

1 The PCP Verifier

For ε∈(0,1),\varepsilon\in(0,1), we present a PCP verifier which given a UniqueGames instance  U=(G(V,E),[N],{πe}e∈E)\ {{\mathcal{U}}}=(G(V,E),[N],\{\pi_{e}\}_{e\in E}) decides whether opt(U)∼1{\rm opt}({\mathcal{U}})\sim 1 or opt(U)∼0.{\rm opt}({\mathcal{U}})\sim 0. The verifier VεV_{\varepsilon} expects, as a proof, the Long Code (see Definition 2.13) of the label of every vertex v∈V.v\in V. Formally, a proof Π\Pi is {Av}v∈V,\{A^{v}\}_{v\in V}, where each Av:{−1,1}N↦{−1,1}A^{v}:\{-1,1\}^{N}\mapsto\{-1,1\} is the supposed Long Code of the label of v.v. The actions of VεV_{\varepsilon} on Π\Pi are as follows.

Pick e{v,w}∈Ee\{v,w\}\in E with probability wt(e){\rm wt}(e).

Pick a random x∈\nicefrac12{−1,1}Nx\in_{\nicefrac{{1}}{{2}}}\{-1,1\}^{N} and μ∈ε{−1,1}N{\mu}\in_{\varepsilon}\{-1,1\}^{N}.

Let πe:[N]↦[N]\pi_{e}:[N]\mapsto[N] be the bijection corresponding to e{v,w}.e\{v,w\}. Accept if and only if

The completeness of verifier is easy and we provide a proof here.

For every ε∈(0,1),\varepsilon\in(0,1), if opt(U)≥1−η,({\mathcal{U}})\geq 1-\eta, there is a proof   Π\;\Pi such that

Moreover, every table AvA^{v} in Π\Pi is balanced, i.e., exactly half of its entries are +1+1 and the rest are −1-1.

Proof. Since opt(U)≥1−η,({\mathcal{U}})\geq 1-\eta, there is a labeling λ\lambda for which the total weight of the edges satisfied is at least 1−η.1-\eta. Hence, if we pick an edge e{v,w}e\{v,w\} with probability wt(e),{\rm wt}(e), with probability at least 1−η,1-\eta, we have λ(v)=πe(λ(w)).\lambda(v)=\pi_{e}(\lambda(w)). Let the proof consist of Long Codes of the labels assigned by λ\lambda to the vertices. With probability 1−ε,1-\varepsilon, we have μλ(v)=1.{\mu}_{\lambda(v)}=1. Hence, with probability at least (1−η)(1−ε),(1-\eta)(1-\varepsilon),

Noting that a Long Code is balanced, this completes the proof.

The soundness of the reduction involves more work and, since , has become standard. We state the result here and the proof appears in Appendix A. We say that a proof Π={Av}v∈V\Pi=\{A^{v}\}_{v\in V} is θ\theta-piecewise balanced if

Here, A^∅v\widehat{A}_{\emptyset}^{v} is the Fourier coefficient corresponding to the empty set of the Boolean function AvA^{v} and the expectation is over a uniformly random vertex v∈Vv\in V.

For every t∈(\nicefrac12,1)t\in(\nicefrac{{1}}{{2}},1), there exists a constant bt>0b_{t}>0 such that the following holds: Let ε>0\varepsilon>0 be sufficiently small and let  U\>{\mathcal{U}} be an instance of UniqueGames with opt(U)<2−O(\nicefrac1ε2).{\rm opt}({\mathcal{U}})<2^{-O(\nicefrac{{1}}{{\varepsilon^{2}}})}. Then, for every \nicefrac56\nicefrac{{5}}{{6}}-piecewise balanced proof Π,\Pi,

2 From the PCP Verifier to a Balanced Edge-Separator Instance

The reduction from the PCP verifier to an instance Iε{\mathcal{I}}_{\varepsilon} of non-uniform BalancedEdge-Separator is as follows. Replace the bits in the proof by vertices and replace every (22-query) PCP test by an edge of the graph. The weight of the edge is equal to the probability that the test is performed by the PCP verifier. Formally, we start with a UniqueGames instance U=(G(V,E),[N],{πe}e∈E,wt),{\mathcal{U}}=\left(G(V,E),[N],\{\pi_{e}\}_{e\in E},{\rm wt}\right), and replace each vertex v∈Vv\in V by a block of vertices (v,x)(v,x) for each x∈{−1,1}N.x\in\{-1,1\}^{N}. For an edge e{v,w}∈E,e\{v,w\}\in E, there is an edge in Iε{\mathcal{I}}_{\varepsilon} between (v,x)(v,x) and (w,y),(w,y), with weight

This is exactly the probability that VεV_{\varepsilon} picks the edge e{v,w},e\{v,w\}, and decides to look at the xx-th (resp. yy-th) coordinate in the Long Code of the label of vv (resp. ww).

The demand function dem(⋅)(\cdot) is 11 for any edge between vertices in the same block, and otherwise. Let B=def12⋅∣V∣⋅(2N2)B\stackrel{{\scriptstyle\textup{def}}}{{=}}\frac{1}{2}\cdot|V|\cdot\binom{2^{N}}{2} be half of the total demand.

Assuming the UGC, for any η,ζ>0\eta,\zeta>0, for a sufficiently large NN, it is NP-hard to determine whether an instance U{\mathcal{U}} of UniqueGames has opt(U)≥1−η{\rm opt}({\mathcal{U}})\geq 1-\eta or opt(U)≤ζ{\rm opt}({\mathcal{U}})\leq\zeta. We choose η=ε\eta=\varepsilon and ζ≤2−O(\nicefrac1ε2)\zeta\leq 2^{-O(\nicefrac{{1}}{{\varepsilon^{2}}})} so that

when opt(U)≥1−η,({\mathcal{U}})\geq 1-\eta, there is a (piecewise balanced) proof that the verifier accepts with probability at least 1−2ε1-2\varepsilon and

when opt(U)≤ζ({\mathcal{U}})\leq\zeta, the verifier does not accept any \nicefrac56\nicefrac{{5}}{{6}}-piecewise balanced proof with probability more than 1−btεt.1-b_{t}\varepsilon^{t}.

Note that btb_{t} is defined as in the statement of Lemma 4.3.

Suppose that opt(U{\mathcal{U}}) ≥1−η.\geq 1-\eta. Let λ\lambda be a labeling that achieves the optimum. Consider the partition (S,S‾)(S,\overline{S}) in Iε{\mathcal{I}}_{\varepsilon} such that SS consists of all vertices (v,x)(v,x) with the property that the Long Code of λ(v)\lambda(v) evaluated at xx is +1.+1. Clearly, the demands cut by this partition is exactly equal to BB. Moreover, it follows from Lemma 4.2 that this partition cuts edges with weight at most η+ε=2ε\eta+\varepsilon=2\varepsilon.

Now, suppose that opt(U{\mathcal{U}}) ≤ζ.\leq\zeta. Then, it follows from Lemma 4.3, that any B′B^{\prime}-balanced partition, with B′≥\nicefracB3,B^{\prime}\geq\nicefrac{{B}}{{3}}, cuts at least btεtb_{t}\varepsilon^{t} fraction of the edges. This is due to the following: Any partition (S,S‾)(S,\overline{S}) in Iε{\mathcal{I}}_{\varepsilon} corresponds to a proof Π\Pi in which we let the (supposed) Long Code of the label of vv to be +1+1 at the point xx if (v,x)∈S,(v,x)\in S, and −1-1 otherwise. Since B′≥\nicefracB3,B^{\prime}\geq\nicefrac{{B}}{{3}}, as in the proof of Theorem 2.9, Π\Pi is \nicefrac56\nicefrac{{5}}{{6}}-piecewise balanced and we apply Lemma 4.3.

Thus, we get a hardness factor of Ω(\nicefrac1ε1−t)\Omega\left(\nicefrac{{1}}{{\varepsilon}}^{1-t}\right) for BalancedEdge-Separator and, hence, by Remark 2.7, for SparsestCut as well. This completes the proof of Theorem 4.1.

The Integrality Gap Instance for Balanced Edge-Separator

In this section, we describe the integrality gap instance for BalancedEdge-Separator along with its SDP solution and prove Theorem 2.9. As pointed out in Section 2.3, this also implies an integrality gap for non-uniform SparsestCut. The following is, thus, a strengthening of Theorem 1.3.

Non-uniform versions of SparsestCut and BalancedEdge-Separator have an integrality gap of at least (log⁡log⁡n)\nicefrac16−δ,(\log\log n)^{\nicefrac{{1}}{{6}}-\delta}, where δ>0\delta>0 is arbitrary. The integrality gaps hold for standard SDPs with triangle inequality constraints.

We present a proof of this theorem (by proving Theorem 2.9). The fact that our SDP solution satisfies the triangle inequality constraints relies on a technical lemma whose proof is via an extensive case analysis and is not very illuminating, hence, relegated to Appendix B.

The integrality gap instance for non-uniform BalancedEdge-Separator has two parts: A (weighted) graph (V∗,E∗)(V^{*},E^{*}) on nn vertices along with demand pairs and a unit vector Vu{\mathbf{V}}_{u} for each vertex u∈V∗.u\in V^{*}. The integrality gap instance is parameterized by ε>0\varepsilon>0 and Iε\mathcal{I}_{\varepsilon} denotes the instance. We show that

every cut in V∗V^{*} that cuts a constant fraction of the demand pairs must have at least ε\sqrt{\varepsilon} fraction of edges crossing it and that

the set of vectors {Vu}u∈V∗\{{\mathbf{V}}_{u}\}_{u\in V^{*}} satisfy the constraints in the SDP in Figure 3 and have an objective value O(ε),O(\varepsilon), thus, giving us an integrality gap of Ω(ε).\Omega(\sqrt{\varepsilon}).

The smallest value ε\varepsilon can take turns out to be (log⁡log⁡n)\nicefrac−13(\log\log n)^{\nicefrac{{-1}}{{3}}}, giving us the lower bound Ω((log⁡log⁡n)\nicefrac−16).\Omega((\log\log n)^{\nicefrac{{-1}}{{6}}}).

For each vertex v∈Vv\in V there is a block of vertices {(v,x):x∈{−1,1}N}\{(v,x):x\in\{-1,1\}^{N}\} in V∗.V^{*}. Thus, we need a unit vector for each (v,x).(v,x). A choice for such a vector is

The fact that this is a unit vector is easy to see. Recall that for a typical edge in Uη,{\mathcal{U}}_{\eta}, the basis vectors are η\eta-close when matched according to the permutation corresponding to that edge. Further, recall that for an edge between (v,x)(v,x) and (w,y),(w,y), there must be an edge between vv and ww in Uη.{\mathcal{U}}_{\eta}. Moreover, for a typical edge in Iε,\mathcal{I}_{\varepsilon}, except with probability ε,\varepsilon, the relative Hamming distance between xx and yy is at most 2ε2\varepsilon (after taking into account the permutation between vv and ww in Uη{\mathcal{U}}_{\eta}). This easily implies that for a typical edge in Iε,\mathcal{I}_{\varepsilon},

Since the vectors are of unit length, this implies that

This is what dictates the choice of η=ε\eta=\varepsilon and we obtain that our SDP solution to Iε\mathcal{I}_{\varepsilon} has an objective value at most O(ε).O(\varepsilon). To see the well-separatedness of this SDP solution, observe that for each v∈Vv\in V, V(v,x){\mathbf{V}}_{(v,x)} and V(v,−x){\mathbf{V}}_{(v,-x)} are unit vectors in opposite direction.

It remain to prove that the vectors {V(v,x)}\left\{{\mathbf{V}}_{(v,x)}\right\} satisfy the triangle inequality. This is the technically hardest part of the paper and is shown via an extensive case analysis that repeatedly uses the fact that the vectors for Uη{\mathcal{U}}_{\eta} satisfy the properties they do. In fact, we do not know whether the vectors described above work for this proof. We need to modify the vectors in (16) as follows

While the inner tensor, which goes to 88 from 22, is a minor modification, it ensures that when we take inner products of the form

and if ⟨vi,wi⟩≈1−η\langle v_{i},w_{i}\rangle\approx 1-\eta for all i∈[N],i\in[N], then the contribution of the cross terms is negligible and the inner product remains around 1−η.1-\eta. This 88-th tensor also implies the converse: If

then there is a permutation π:[N]↦[N]\pi:[N]\mapsto[N] such that for all i∈[N],i\in[N],

This latter property and the outer tensor are crucial in the proof of the triangle inequality.This property has also been key in the results of Arora et al. . This new SDP solution is also easily seen to satisfy the properties satisfied by the previous SDP solution up to a loss of an additional constant factor.

We conclude this overview by giving the reader some idea of why we have the outer tensor. Start by noting that proving the triangle inequality is the same as showing

since all the vectors have unit length. If none of the dot-products has magnitude at least \nicefrac13\nicefrac{{1}}{{3}} the inequality holds trivially. Thus, we may assume that one of the inner products, say, ∣⟨Vv,y,Vw,z⟩∣t≥\nicefrac13|\langle{\mathbf{V}}_{v,y},{\mathbf{V}}_{w,z}\rangle|^{t}\geq\nicefrac{{1}}{{3}}. This implies that ∣⟨Vv,y,Vw,z⟩∣=1−O(\nicefrac1t)|\langle{\mathbf{V}}_{v,y},{\mathbf{V}}_{w,z}\rangle|=1-O(\nicefrac{{1}}{{t}}). By the converse property mentioned earlier, it can be deduced that, for some i0,j0∈[N],i_{0},j_{0}\in[N], ∣⟨vi0,wj0⟩∣=1−O(\nicefrac1t)|\langle{v}_{i_{0}},{w}_{j_{0}}\rangle|=1-O(\nicefrac{{1}}{{t}}) which can be made very close to 11 by picking tt large enough. This turns out to be convenient towards proving the triangle inequality via a case analysis, see Lemma 5.8.

Unfortunately, we cannot provide much more intuition than this and, as mentioned in the introduction, for a more intuitive proof of the triangle inequality one can refer to the papers . We now present the graph construction and the SDP solution formally and prove the claims above for the SDP solution.

1 The Graph

We recall the following notations which are needed. For a permutation π:[N]↦[N]\pi:[N]\mapsto[N] and a vector x∈{−1,1}N,x\in\{-1,1\}^{N}, the vector x∘πx\circ\pi is defined to be the vector with its jj-th entry as (x∘π)j=defxπ(j).(x\circ\pi)_{j}\stackrel{{\scriptstyle\textup{def}}}{{=}}x_{\pi(j)}. For ε>0,\varepsilon>0, the notation x∈ε{−1,1}Nx\in_{\varepsilon}\{-1,1\}^{N} means that the vector xx is a random {−1,1}N\{-1,1\}^{N} vector, with each of its bits independently set to −1-1 with probability ε,\varepsilon, and set to 11 with probability 1−ε.1-\varepsilon.

The BalancedEdge-Separator instance has a parameter ε>0\varepsilon>0 and we refer to it as Iε(V∗,E∗).{\mathcal{I}}_{\varepsilon}(V^{*},E^{*}). We start with the UniqueGames instance Uη=(G(V,E),[N],{πe}e∈E,wt){\mathcal{U}}_{\eta}=\left(G(V,E),[N],\{\pi_{e}\}_{e\in E},{\rm wt}\right) of Theorem 3.7. In Iε,{\mathcal{I}}_{\varepsilon}, each vertex v∈Vv\in V is replaced by a block of vertices denoted by V∗[v]V^{*}[v]. This block consists of vertices (v,x)(v,x) for each x∈{−1,1}N.x\in\{-1,1\}^{N}. Thus, the set of vertices for the BalancedEdge-Separator instance is

The edges in the BalancedEdge-Separator instance are defined as follows: For e{v,w}∈E,e\{v,w\}\in E, there is an edge e∗e^{*} in Iε{\mathcal{I}}_{\varepsilon} between (v,x)(v,x) and (w,y),(w,y), with weight

For every t∈(\nicefrac12,1)t\in(\nicefrac{{1}}{{2}},1), there exists a constant ct>0c_{t}>0 such that the following holds: Let ε>0\varepsilon>0 be sufficiently small and let  Uη(G(V,E),[N],{πe}e∈E,wt)\>{\mathcal{U}}_{\eta}\left(G(V,E),[N],\{\pi_{e}\}_{e\in E},{\rm wt}\right) be an instance of UniqueGames with opt(Uη)<2−O(\nicefrac1ε2){\rm opt}({\mathcal{U}}_{\eta})<2^{-O(\nicefrac{{1}}{{\varepsilon^{2}}})}. Let Iε{\mathcal{I}}_{\varepsilon} be the corresponding instance of BalancedEdge-Separator as defined above. Let V∗=∪v∈VV∗[v]V^{*}=\cup_{v\in V}V^{*}[v] be the partition of its vertices as above. Then, any \nicefrac56\nicefrac{{5}}{{6}}-piecewise balanced cut (A,A‾)(A,\overline{A}) in Iε{\mathcal{I}}_{\varepsilon} (in the sense of Definition 2.8) satisfies

2 The SDP Solution

Now we present an SDP solution for Iε(V∗,E∗,wtBS){\mathcal{I}}_{\varepsilon}(V^{*},E^{*},{\rm wt}_{\rm BS}) that satisfies Properties (3), (4) and (5) of Theorem 2.9. This proves Theorem 2.9 and, hence, Theorem 5.1.

Hence, for every v∈Vv\in V and x∈{−1,1}N,x\in{\{-1,1\}^{N}},

Next, we show Property (5) in Theorem 2.9 which establishes that the SDP solution has value O(ε)O(\varepsilon) when η=ε.\eta=\varepsilon.

∑e∗{(v,x),(w,y)}∈E∗wtBS(e∗)∥Vv,x⊗t−Vw,y⊗t∥2≤O(η+ε).\sum_{e^{*}\{(v,x),(w,y)\}\in E^{*}}{\rm wt}_{\rm BS}(e^{*})\|{\mathbf{V}}_{v,x}^{\otimes t}-{\mathbf{V}}_{w,y}^{\otimes t}\|^{2}\leq O(\eta+\varepsilon).

The proof of this theorem uses the following lemma which shows that, if e{v,w}e\{v,w\} is an edge in the UniqueGames instance Uη{\mathcal{U}}_{\eta} so that the corresponding orthonormal bases are η\eta-close (via the permutation π\pi), then Vv,x{\mathbf{V}}_{v,x} and Vw,y{\mathbf{V}}_{w,y} are also close if x∘πx\circ\pi and yy are close.

Let 0<η<\nicefrac120<\eta<\nicefrac{{1}}{{2}} and assume that for v,w∈Vv,w\in V and i0,j0∈[N],i_{0},j_{0}\in[N], ⟨vi0,wj0⟩=1−η.\langle{v}_{i_{0}},{w}_{j_{0}}\rangle=1-\eta. Let π:[N]↦[N]\pi:[N]\mapsto[N] be defined to be π(j0⊕j)=defi0⊕j ∀ j∈[N]\pi(j_{0}\oplus j)\stackrel{{\scriptstyle\textup{def}}}{{=}}i_{0}\oplus j\ \forall\ j\in[N]. Then,

Lower Bound: (1−η)8(1−2Δ(x∘π,y))−(2η)4≤⟨Vv,x,Vw,y⟩.(1-\eta)^{8}(1-2{\Delta}(x\circ\pi,y))-(2\eta)^{4}\leq\langle{\mathbf{V}}_{v,x},{\mathbf{V}}_{w,y}\rangle.

Upper Bound: ⟨Vv,x,Vw,y⟩≤(1−η)8(1−2Δ(x∘π,y))+(2η)4.\langle{\mathbf{V}}_{v,x},{\mathbf{V}}_{w,y}\rangle\leq(1-\eta)^{8}(1-2{\Delta}(x\circ\pi,y))+(2\eta)^{4}.

Here, Δ(x,y){\Delta}(x,y) denotes the fraction of points where xx and yy differ.

We first show how Lemma 5.4 implies Theorem 5.3.

Proof. [of Theorem 5.3] It is sufficient to prove that for an edge e{v,w}∈Ee\{v,w\}\in E picked with probability wt(e){\rm wt}(e) (from the UniqueGames instance Uη{\mathcal{U}}_{\eta}), x∈\nicefrac12{−1,1}N,x\in_{\nicefrac{{1}}{{2}}}\{-1,1\}^{N}, and μ∈ε{−1,1}N,{\mu}\in_{\varepsilon}\{-1,1\}^{N},

Since e{v,w}e\{v,w\} is an edge of Uη,{\mathcal{U}}_{\eta}, we know from the Closeness Property of Theorem 3.7, that there are i0,j0∈[N]i_{0},j_{0}\in[N] such that ⟨vi0,wj0⟩≥1−O(η).\langle{v}_{i_{0}},{w}_{j_{0}}\rangle\geq 1-O(\eta). Moreover, πe(j0⊕j)=i0⊕j, ∀ j∈[N]\pi_{e}(j_{0}\oplus j)=i_{0}\oplus j,\ \forall\ j\in[N]. Further, it follows from a simple Chernoff Bound argument that, except with probability ε\varepsilon, Δ(x,xμ)≤2ε.{\Delta}(x,x{\mu})\leq 2\varepsilon. Thus, using the lower bound estimate from Lemma 5.4, we get that

Now, ⟨Vv,x,Vw,y⟩\langle{\mathbf{V}}_{v,x},{\mathbf{V}}_{w,y}\rangle is at least

The first term in both these expressions is

The second term is bounded by (2η)4(2\eta)^{4} as seen above. This completes the proof of the lemma.

The well-separatedness of the SDP solution, or Property (4) in Theorem 2.9, follows from the following lemma.

The last equality follows from the fact that the contribution of (x,y)(x,y) to the expectation is canceled by that of (x,−y).(x,-y).

Finally, the following theorem establishes that our SDP solution satisfies the triangle inequality, Property (3) of Theorem 2.9.

For t=2240+1,t=2^{240}+1, the set of vectors {Vv,x⊗t}v∈V,x∈{−1,1}N\{{\mathbf{V}}_{v,x}^{\otimes t}\}_{v\in V,x\in{\{-1,1\}^{N}}} give rise to a negative-type metric.

Theorem 5.6 requires proving that any three vectors Vu,x⊗t{\mathbf{V}}_{u,x}^{\otimes t}, Vv,y⊗t{\mathbf{V}}_{v,y}^{\otimes t} and Vw,z⊗t{\mathbf{V}}_{w,z}^{\otimes t} satisfy

We can assume that at least one of the dot-products has magnitude at least \nicefrac13\nicefrac{{1}}{{3}}; otherwise, the inequality holds trivially. Assume, w.l.o.g., that

This implies that ∣⟨Vv,y,Vw,z⟩∣t≥\nicefrac13,|\langle{\mathbf{V}}_{v,y},{\mathbf{V}}_{w,z}\rangle|^{t}\geq\nicefrac{{1}}{{3}}, and therefore,

for some η′=O(\nicefrac1t)\eta^{\prime}=O(\nicefrac{{1}}{{t}}). It follows that, for some i,j∈[N],i,j\in[N], ∣⟨vi,wj⟩∣=1−β|\langle{v}_{i},{w}_{j}\rangle|=1-\beta for some β≤2−160.\beta\leq 2^{-160}. We give a quick proof of this. Let i0,j0i_{0},j_{0} be arg⁡max⁡i,j∣⟨vi,wj⟩∣\arg\max_{i,j}|\langle v_{i},w_{j}\rangle| and 1−β=∣⟨vi0,wj0⟩∣.1-\beta=|\langle v_{i_{0}},w_{j_{0}}\rangle|. Then,

By the Matching Property, ⟨vi0⊕i,wj0⊕i⟩=⟨vi0,wj0⟩\langle v_{i_{0}\oplus i},w_{j_{0}\oplus i}\rangle=\langle v_{i_{0}},w_{j_{0}}\rangle for all i∈[N].i\in[N]. Hence,

Moreover, by orthonormality, for all i∈[N],i\in[N],

giving us the claimed upper bound on β.\beta. By relabeling, if necessary, we may assume that ∣⟨v1,w1⟩∣=1−β.|\langle{v}_{1},{w}_{1}\rangle|=1-\beta.

Note that (19) is equivalent to showing that

The following elementary lemma, whose proof appears at the end of this section, implies that it is sufficient to prove that

Let a,b,c∈a,b,c\in such that 1+a≥b+c1+a\geq b+c. Then, 1+at≥bt+ct1+a^{t}\geq b^{t}+c^{t} for every odd integer t≥1t\geq 1.

As noted before, we may assume that ∣⟨v1,w1⟩∣=1−β|\langle{v}_{1},{w}_{1}\rangle|=1-\beta and, hence, by the Matching Property,

Let λ=defmax⁡1≤i,j≤N∣⟨ui,wj⟩∣.\lambda\stackrel{{\scriptstyle\textup{def}}}{{=}}\max_{1\leq i,j\leq N}|\langle{u}_{i},{w}_{j}\rangle|. We may assume, w.l.o.g., that the maximum is achieved for u1,w1,{u}_{1},{w}_{1}, and again by the Matching Property,

Now, Theorem 5.6 follows from the following lemma.

where 0≤β≤2−160.0\leq\beta\leq 2^{-160}. Let xi,yi,zi∈{−1,1}x_{i},y_{i},z_{i}\in\{-1,1\} for 1≤i≤N1\leq i\leq N. Define unit vectors

Then, the vectors u,v,w{u},{v},{w} satisfy the triangle inequality 1+⟨u,v⟩≥⟨u,w⟩+⟨v,w⟩,1+\langle{u},{v}\rangle\geq\langle{u},{w}\rangle+\langle{v},{w}\rangle, i.e.,

Note that we only have ∣⟨v1,w1⟩∣=1−β|\langle v_{1},w_{1}\rangle|=1-\beta but we can remove the absolute value and use this lemma as it holds for all sign patterns xi,yi,zi.x_{i},y_{i},z_{i}. The proof of this lemma is very technical and appears in Appendix B. We conclude with a proof of Lemma 5.7.

Proof. [of Lemma 5.7] First, we notice that it is sufficient to prove this inequality when 0≤a,b,c≤1.0\leq a,b,c\leq 1. Suppose that b<0b<0 and c<0,c<0, then bt+ct<0≤1+at.b^{t}+c^{t}<0\leq 1+a^{t}. Hence, without loss of generality assume that b≥0.b\geq 0. If c<0c<0 and a≥0,a\geq 0, then bt+ct<bt≤1+at.b^{t}+c^{t}<b^{t}\leq 1+a^{t}. If c<0c<0 and a<0,a<0, by hypothesis, 1−c≥b−a,1-c\geq b-a, which is the same as 1+∣c∣≥b+∣a∣,1+|c|\geq b+|a|, and proving 1+at≥bt+ct1+a^{t}\geq b^{t}+c^{t} is equivalent to proving 1+∣c∣t≥bt+∣a∣t.1+|c|^{t}\geq b^{t}+|a|^{t}. Hence, we may assume that c≥0.c\geq 0. If a<0,a<0, then 1+at=1−∣a∣t≥1−∣a∣=1+a≥b+c≥bt+ct.1+a^{t}=1-|a|^{t}\geq 1-|a|=1+a\geq b+c\geq b^{t}+c^{t}. Hence, we may assume that 0≤a,b,c≤1.0\leq a,b,c\leq 1.

Further, we may assume that a<b≤c.a<b\leq c. Since, if a≥b,a\geq b, then 1+at≥ct+bt.1+a^{t}\geq c^{t}+b^{t}. 1+a≥b+c1+a\geq b+c implies that 1−c≥b−a.1-c\geq b-a. Notice that both sides of this inequality are positive. It follows from the fact that 0≤a<b≤c≤1,0\leq a<b\leq c\leq 1, that ∑i=0t−1ci≥∑i=0t−1aibt−1−i.\sum_{i=0}^{t-1}c^{i}\geq\sum_{i=0}^{t-1}a^{i}b^{t-1-i}. Multiplying these two inequalities, we obtain 1−ct≥bt−at,1-c^{t}\geq b^{t}-a^{t}, which implies that 1+at≥bt+ct.1+a^{t}\geq b^{t}+c^{t}. This completes the proof.

We would like to thank Assaf Naor and James Lee for ruling out some of our initial approaches. Many thanks to Sanjeev Arora, Moses Charikar, Umesh Vazirani, Ryan O’Donnell and Elchanan Mossel for insightful discussions at various junctures.

References

Appendix A Proof of Soundness of the PCP Reduction

For every t∈(\nicefrac12,1)t\in(\nicefrac{{1}}{{2}},1), there exists a constant bt>0b_{t}>0 such that the following holds: Let ε>0\varepsilon>0 be sufficiently small and let  U\>{\mathcal{U}} be an instance of UniqueGames with opt(U)<2−O(\nicefrac1ε2).{\rm opt}({\mathcal{U}})<2^{-O(\nicefrac{{1}}{{\varepsilon^{2}}})}. Then, for every \nicefrac56\nicefrac{{5}}{{6}}-piecewise balanced proof Π,\Pi,

Proof. The proof is by contradiction: We assume that there is a \nicefrac56\nicefrac{{5}}{{6}}-piecewise balanced proof Π,\Pi, which the verifier accepts with probability at least 1−btεt,1-b_{t}\varepsilon^{t}, and deduce that opt(U)≥2−O(\nicefrac1ε2).{\rm opt}({\mathcal{U}})\geq 2^{-O(\nicefrac{{1}}{{\varepsilon^{2}}})}. We let bt=def1−e−296ct,b_{t}\stackrel{{\scriptstyle\textup{def}}}{{=}}\frac{1-e^{-2}}{96}c_{t}, where ctc_{t} is the constant in Bourgain’s Junta theorem.

The probability of acceptance of the verifier is

Using the Fourier expansion Av=∑αA^αvχαA^{v}=\sum_{\alpha}\widehat{A}^{v}_{\alpha}\chi_{\alpha} and Aw=∑βA^βwχβ,A^{w}=\sum_{\beta}\widehat{A}^{w}_{\beta}\chi_{\beta}, and the orthonormality of characters, we get that this probability is

Here α⊆[N].\alpha\subseteq[N]. Hence, the acceptance probability is

If this acceptance probability is at least 1−btεt,1-b_{t}\varepsilon^{t}, then,

Hence, over the choice of vv, with probability at least \nicefrac2324,\nicefrac{{23}}{{24}},

Call such vertices v∈Vv\in V good. Fix a good vertex v.v. Using the Cauchy-Schwarz inequality we get,

Combining Jensen’s inequality and Parseval’s identity, we get that

Now we combine Parseval’s identity with the fact that 1−x≤e−x1-x\leq e^{-x} to obtain

Call α\alpha good if α⊆[N]\alpha\subseteq[N] is nonempty, ∣α∣≤ε−1|\alpha|\leq\varepsilon^{-1} and ∣A^αv∣≥1504\nicefrac−1ε2.|\widehat{A}^{v}_{\alpha}|\geq\frac{1}{50}4^{\nicefrac{{-1}}{{\varepsilon^{2}}}}.

Bounding the contribution due to large sets.

Using the Cauchy-Schwarz inequality, Parseval’s identity and Jensen’s inequality, we get

We can choose ε\varepsilon to be small enough so that the last term above is less than \nicefrac150.\nicefrac{{1}}{{50}}.

Bounding the contribution due to small Fourier coefficients.

Similarly, we use ∑α : ∣A^αv∣≤1504\nicefrac−1ε2(A^αv)2≤\nicefrac12500,\sum_{\alpha\ :\ |\widehat{A}^{v}_{\alpha}|\leq\frac{1}{50}4^{\nicefrac{{-1}}{{\varepsilon^{2}}}}}\left(\widehat{A}^{v}_{\alpha}\right)^{2}\leq\nicefrac{{1}}{{2500}}, and get

Bounding the contribution due to the empty set.

Lower bound for a very good vertex with good sets.

Now we define a labeling for the UniqueGames instance U{\mathcal{U}} as follows: For a vertex v∈Vv\in V, pick α\alpha with probability (A^αv)2,\left(\widehat{A}^{v}_{\alpha}\right)^{2}, pick a random element of α\alpha and define it to be the label of v.v.

Let vv be a very good vertex. It follows that the weight of the edges adjacent to vv satisfied by this labeling is at least

It follows from the Cauchy-Schwarz inequality and Parseval’s identity that this is at least

Using Jensen’s inequality, we get that this is at least

Here, the last inequality follows from our estimate in Equation (21). Since, with probability at least \nicefrac124\nicefrac{{1}}{{24}} over the choice of v,v, vv is very good, our labeling satisfies edges with total weight at least Ω(ε 4\nicefrac−2ε2).\Omega\left(\varepsilon\ 4^{\nicefrac{{-2}}{{\varepsilon^{2}}}}\right). This completes the proof of the lemma.

Appendix B Proof of Lemma 5.8 (Triangle Inequality Constraint)

where 0≤η≤2−160.0\leq\eta\leq 2^{-160}. Let si,ti,ri∈{−1,1}s_{i},t_{i},r_{i}\in\{-1,1\} for 1≤i≤N1\leq i\leq N. Define unit vectors

Then, the vectors u,v,w{u},{v},{w} satisfy the triangle inequality 1+⟨u,v⟩≥⟨u,w⟩+⟨v,w⟩,1+\langle{u},{v}\rangle\geq\langle{u},{w}\rangle+\langle{v},{w}\rangle, i.e.,

Proof. It suffices to show that for every 1≤j≤N1\leq j\leq N,

We consider four cases depending on value of λ\lambda.

(Case 1) λ≤η\lambda\leq\eta : Since ⟨vj,wj⟩=1−η\langle{v}_{j},{w}_{j}\rangle=1-\eta, and ∑1≤i≤N⟨vi,wj⟩2=1,\sum_{1\leq i\leq N}\langle{v}_{i},{w}_{j}\rangle^{2}=1, we have

Also, ∑i=1N⟨ui,wj⟩8≤λ6≤η6\sum_{i=1}^{N}\langle{u}_{i},{w}_{j}\rangle^{8}\leq\lambda^{6}\leq\eta^{6}. Moreover, for any 1≤i≤N1\leq i\leq N, by the triangle inequality,

Therefore, ∑i=1N⟨ui,vj⟩8≤(2η)6\sum_{i=1}^{N}\langle{u}_{i},{v}_{j}\rangle^{8}\leq(2\eta)^{6}. Thus, it suffices to prove that

(Case 2) η≤λ≤1−η\eta\leq\lambda\leq 1-\sqrt{\eta} : We show that

(Subcase i) tj≠rjt_{j}\not=r_{j} : In this case it suffices to show that

Again, as before, we have that for every 1≤i≤N,1\leq i\leq N,

This also holds when  η≤2−160\ \eta\leq 2^{-160}.

(Subcase ii) tj=rjt_{j}=r_{j} : We need to prove (28). It suffices to show that

where θi=def∣⟨ui,wj⟩∣,  μi=def∣⟨ui,vj⟩∣\theta_{i}\stackrel{{\scriptstyle\textup{def}}}{{=}}|\langle{u}_{i},{w}_{j}\rangle|,\ \ \mu_{i}\stackrel{{\scriptstyle\textup{def}}}{{=}}|\langle{u}_{i},{v}_{j}\rangle|. Clearly,

Here, we used the assumption that (ui,vj,wj)({u}_{i},{v}_{j},{w}_{j}) satisfy the triangle inequality. Note also that max⁡1≤i≤Nθi=λ\max_{1\leq i\leq N}\theta_{i}=\lambda and ∑i=1Nθi2=1\sum_{i=1}^{N}\theta_{i}^{2}=1. Let J=def{i ∣ θi≤η}J\stackrel{{\scriptstyle\textup{def}}}{{=}}\{i\ |\ \theta_{i}\leq\eta\} and I=def{i ∣ θi≥η}I\stackrel{{\scriptstyle\textup{def}}}{{=}}\{i\ |\ \theta_{i}\geq\eta\}. We have,

Lemma B.2, which appears after this proof, implies that the summation on the last line above is bounded by

This is true if 8η(1−λ5)≥η2(28+28+1+48).8\eta(1-\lambda^{5})\geq\eta^{2}(2^{8}+2^{8}+1+4^{8}). This is true if 8ηη≥η2⋅49,8\eta\sqrt{\eta}\geq\eta^{2}\cdot 4^{9}, which holds when  η≤2−160.\ \eta\leq 2^{-160}. Note that we used the fact that λ≤1−η.\lambda\leq 1-\sqrt{\eta}.

(Case 3) 1−η≤λ≤1−η21-\sqrt{\eta}\leq\lambda\leq 1-\eta^{2} : We have ⟨vj,wj⟩=1−η\langle{v}_{j},{w}_{j}\rangle=1-\eta, ⟨uj,wj⟩=λ=:1−ζ.\langle{u}_{j},{w}_{j}\rangle=\lambda=:1-\zeta. This implies that ⟨uj,vj⟩=1−δ,\langle{u}_{j},{v}_{j}\rangle=1-\delta, where by the triangle inequality

Thus, to prove (27), it suffices to show that

Depending on signs sj,tj,rjs_{j},t_{j},r_{j}, this reduces to proving one of the three cases:

We prove the first case, and the remaining two are proved in a similar fashion. We have that

provided that 232max⁡{ζ,η,δ}≤1.2^{32}\max\{\zeta,\eta,\delta\}\leq 1. Thus, it suffices to have

This is clearly true if ζ,η,δ\zeta,\eta,\delta are within a quadratic factor of each other, and η≤2−160\eta\leq 2^{-160}. On the contrary if δ<η2,\delta<\eta^{2}, since we already have δ≤η+ζ\delta\leq\eta+\zeta from the triangle inequality, it reduces to Case (2) by setting η\eta to δ\delta and setting λ\lambda to 1−η.1-\eta.

(Case 4) 1−η2≤λ1-\eta^{2}\leq\lambda : This is essentially same as Case (2). Just interchange 1−η1-\eta with λ\lambda and interchange ui,vi{u}_{i},{v}_{i} for every ii. This completes the proof of the lemma.

Let η,λ\eta,\lambda and {θi}i=1N\{\theta_{i}\}_{i=1}^{N} be non-negative reals, such that ∑i=1Nθi2≤1,\sum_{i=1}^{N}\theta_{i}^{2}\leq 1, and for all i,i, η≤θi≤λ.\eta\leq\theta_{i}\leq\lambda. Then

Proof. Clearly, N≤\nicefrac1η2N\leq\nicefrac{{1}}{{\eta^{2}}}.