Given a Boolean formula in conjunctive normal form (i.e., expressed as an and of ors), a not-all-equal-sat (nae-sat) solution is an assignment x of literals to variables such that both x and its negation ¬x evaluate to true. A k-nae-sat problem is one in which each clause involves exactly k literals.
The k-nae-sat problem is a symmetrized version of k-sat. A major direction of research has concerned the large-system limit of random problem instances, seeking to establish typical behavior and phase transitions. In particular, much effort has been directed towards locating the satisfiability transition: the critical density α⋆ where solutions cease to exist .
In this paper we consider random d-regular k-nae-sat, in which each variable is involved in exactly d clauses, and clause literals are chosen uniformly at random. We establish the following sharp satisfiability threshold, the first of its kind among this class of csps:
For k≥k0 there is a threshold d⋆≡d⋆(k), given by the largest zero of the explicit function (1), such that the probability for a random d-regular k-nae-sat instance to be solvable tends to one for d<d⋆, and tends to zero for d>d⋆.
The threshold d⋆ is given by the largest zero of the function
where q=q(d) is the unique solution in the interval [1−2−k,1] of
We will find (see Propn. 3.11) that ⋆Φ is decreasing with a unique zero on the interval (2k−1−2)klog2≤d≤2k−1klog2.
As the threshold is given by the root of an equation, it is possible for d⋆ to be integer-valued, though we have no reason to believe that this ever occurs. Nevertheless, we also address this hypothetical possibility by showing that if d=d⋆ then the probability for the nae-sat instance to be solvable is asymptotically bounded away from both zero and one. This completes the characterization of the satisfiability transition.
The methods developed in this paper offer a new approach to tackling other problems in the same class and establishing exact thresholds. Indeed, in a companion paper we consider the maximum independent set problem on random regular graphs, where we determine the explicit threshold, and furthermore show tight concentration of the maximum independent set size about the threshold value.
Previous work on the satisfiability transition has identified sharp thresholds in models not exhibiting condensation, e.g. xor-sat . The 2-sat satisfiability transition is also much simpler, and can be identified by a branching process argument . See also for detailed discussions of these problems. Previous work on nae-sat has centered on the Erdős–Rényi version in which variables are included in clauses independently at random, with a series of improving bounds on the satisfiability transition .
Shortly prior to the posting of this paper, A. Coja-Oghlan posted a paper on a different symmetrization of regular k-sat in which a 2-clause joins each consecutive pair of variables, forcing them to take opposite literals. While not establishing a satisfiability threshold, his paper establishes a 1rsb-type formula for the existence of solutions that satisfy all but o(n) clauses. His approach of modeling clusters of configurations is similar to our own.
We hereafter write G≡Gn,d,k to indicate that G is chosen according to the configuration model for uniformly random (d,k)-regular bipartite (multi-)graphs with n degree-d vertices, with L a uniformly random literal assignment.
2. Outline of proof
It is most natural to apply the moment method with the nae-sat partition function
For fixed k the rate function Φk(d) is clearly decreasing in d, with unique zero at
In §2 we will see that a rather straightforward application of the second moment method on Z gives the following
We establish this by the second moment method applied to the partition function Z of the frozen configurations. In §3-5 we prove
The proof of Thm. 2 comprises a large portion of the present paper. The first moment is addressed in §3, where we identify the exact local neighborhood profile that gives the maximal contribution to the expectation. This is done by a Bethe variational principle which relates stationary points of the rate function to fixed points of certain tree recursions. A major technical difficulty is the high dimensionality of the maximization problem, and the possibility of multiple stationary points which must be ruled out. This is done by delicate a priori estimates which allow us to reduce the dimensionality by certain symmetry conditions.
The second moment can be understood in the same framework by regarding it as the first moment of the pair model, but clearly the dimensionality is substantially increased. We show in §4 that the dominant contribution comes from two local maximizers: one corresponding to pairs whose overlap distribution looks like a product measure, and the other corresponding to pairs which are perfectly correlated — in each case, with both marginals given by the first moment maximizer. The results of §3 and 4 control the moments up to polynomial prefactors, which are determined in §5 by establishing negative-definiteness of the Hessians for the first- and second-moment rate functions at their maximizers.
Thm. 3 is proved in §6 by a variance reduction argument. This issue occurs commonly in applications of the second moment method, and is often dealt with by a somewhat standard machinery known as the subgraph conditioning method (see ) which “explains” the variance in terms of the short cycles in the graph. Applying this method is technically demanding, and seems to us intractable in our models due to the large number of variables.
We develop instead a novel approach of taking a certain log-transform of the partition function, and bounding the incremental fluctuations of its Doob martingale with respect to the edge-revealing filtration; each increment amounts to the effect of adding a clause. We control the variance by discrete Fourier analysis applied on the spins at the boundary of a large local neighborhood of the added clause, and we show that the main contribution comes from the degree-two Fourier coefficients which correspond to the formation of short cycles in the graph.
3. Notation
Acknowledgements
We thank Amir Dembo, Elchanan Mossel, Andrea Montanari, and David Wilson for helpful conversations.
Satisfying assignments
where γ0≡γ0(α)≡1−αk−(1−α)k. Thus we conclude
For fixed α, a is strictly concave in γ with second derivative −[γ(1−γ)]−1≤−4, and is uniquely maximized at γ⋆(α)=γ0(1−ϑ)/(1−ϑγ0) with optimal value
It is straightforward to calculate that for k−1(logk)2≤α≤1−k−1(logk)2,
so clearly α=\nicefrac12 is the unique maximizer on this interval. For 0≤α≤\nicefrac12, H(α) is increasing while αk+(1−α)k is decreasing, and we use this to bound
For α≤k−3/2 we have (1−α)k=1−kα+O(k1/2α), therefore
Lastly, recalling H(x)+xlogc≤log(1+c)≤c gives
where the inner sum is taken over probability measures ν on {0,…,k} such that mν is integer-valued. By Stirling’s approximation,
where b(α,ν)≡H(α)−(d/k)∑jνjlog[νj/pj(α)] is strictly concave in (α,ν), and the correction term P(α,ν) is nO(1) in general, and is ≍kn(k+1)/2 for ν satisfying maxj1/νj≲k1. It is easily seen that this is indeed satisfied by argmaxνb(α,ν) for \nicefrac14≤α≤\nicefrac34, so it follows using the strict concavity of b that
2. Coarsening algorithm and frozen model
In view of Propn. 1.2 we hereafter assume unless indicated otherwise that k≥k0 large,
We simulate the coarsening algorithm as follows: of the nd half-edges incident to variables, choose e1,…,em uniformly at random (with random ordering) to be potentially forcing. Edge ea corresponds to clause a, though here the clauses are not explicitly formed. Conditioned on x being a valid solution, each clause independently has probability ϑ≡\nicefrac2k(2k−2) to be x-forcing (cf. Defn. 2.1): therefore set each ea to be initially forcing with probability ϑ, independently over a. Then, for each t≥0, if there exists v∈V which is incident to no (remaining) initially forcing half-edge, then take the first such v and
Delete all dvt remaining potentially forcing half-edges incident to v; and
Delete the first d−dvt potentially forcing half-edges among all those remaining.
The interpretation is that the coarsening algorithm sets v to be a free variable at stage t. Thus the d−dvt clauses incident to v and potentially forcing to other variables can no longer be forcing, so we remove these clauses from consideration (step (ii)).Step (i) does not delete any initially forcing half-edges, but step (ii) can.
First moment of frozen model
We shall specify a Gibbs measure ν on Td,k by defining a consistent family of finite-dimensional distributions νt on the depth-t subtrees Td,k(t). A typical manner of specifying νt is to specify a “boundary law” on the configuration on the depth-t vertices, and then to define νt as an appropriate finite-volume Gibbs measure on Td,k(t) conditioned on the boundary configuration.
In our setting some difficulty is imposed by the fact that the frozen model is not a factor model (or Markov random field) in the conventional sense that η∣A and η∣B are conditionally independent given the configuration η∣C on any subset C separating A from B — in particular, given the variable spins at level 2t of Td,k, whether a variable at level 2(t−1) is permitted to take spin f depends on whether its neighboring 0’s and 1’s in level 2t are forced by clauses in level 2t+1.
The message-passing rules for our frozen model are as follows:
provided η↑ completes leads to a valid message configuration (no unsat messages) on Td,k(t) with respect to literals L(t). The root marginal is then given by
If 1−q≲2−k then vk−1(q)=1−\nicefrac22k+O(\nicefrack4k), therefore vk−1(q)d−1=2−k+O(\nicefrack24k) and qd−1∘vk−1(q)=1−2−k−1+O(\nicefrack24k). In this regime we also calculate
thus (qd−1∘vk−1)′≍\nicefrack22k so in this regime (10) must have the unique solution as claimed. ∎
2. Auxiliary model
In the auxiliary model, each configuration σ∈ME receives the factor model weight
3. Bethe variational principle
We regard h≡(h˙,h^) as a vector indexed by suppφ≡(suppφ˙,suppφ^). For σ∈M and σ˙∈suppφ˙ let H˙σ,σ˙ denote the number of appearances of σ in σ˙, and similarly write H^σ,σ^ for the number of appearances of σ in σ^. For h to correspond to a valid configuration σ, the variable and clause empirical measures must give rise to the same edge marginals
Given φ≡(φ˙,φ^) let Δ denote the space of probability measures h≡(h˙,h^) on suppφ (that is, h˙ is a probability measure on suppφ˙ while h^ is a probability measure on suppφ^) such that
(h˙,kdh^) lies in the kernel of matrix HΔ≡(H˙−H^), and
Let s˙≡∣suppφ˙∣, s^≡∣suppφ^∣, and sˉ≡∣suppφ^∣=∣M∣: we shall show (Lem. 6.4) that HΔ is surjective, therefore Δ is an (s˙+s^−sˉ−1)-dimensional space.
The expected number of auxiliary configurations on Gn,d,k with empirical measure h is
If further minh≳k1 as n→∞, then
If ⋆h lies in the interior Δ∘ of Δ then it must be a stationary point for Φ. Such points correspond to a generalization of the tree Gibbs measures considered in §3.1, where the boundary conditions are specified by a law on incoming and outgoing messages, as follows: first sample uniformly random literals L(t) on Td,k(t) as before. If σ(t) is a message configuration on the edges of Td,k(t) — including the edges E(t−1,t) joining levels t−1 and t — then let Ψt(L(t),σ(t)) denote the product of the factor weights φ˙(σ˙v), φ^a(σ^a) over all v,a∈Td,k(t−1). For probability measures h˙,h^ on M we define the measures
with Zt the normalizing constant which makes νt a probability measure. This generalizes the definition of νt in (8) by taking h˙ηη′ proportional to q˙η and h^ηη′ proportional to q^η′, i.e.
The family (νt)t is consistent if and only if h≡(h˙,h^) satisfies the Bethe recursions
(with z˙h,z^h the normalizing constants); these generalize the frozen model recursions (9), as we shall see explicitly below. Thus a solution h of (18) specifies a Gibbs measure ν for the auxiliary model on Td,k which generalizes the measures ν described in §3.1.
This proves our claim that the measures ν generalize the measures ν of §3.1.
The connection between these Gibbs measures and the rate function Φ is given by the following variational principle:
If φ≡(φ˙,φ^) is such that both H˙ and H^ are surjective, then any stationary point h of Φ belonging to Δ∘ corresponds to a Bethe fixed point solving (18) via
with z˙h,z^h,zˉh normalizing constants satisfying zˉh=z˙h/z˙h=z^h/z^h for z˙h,z^h as in (18).
At an interior stationary point h, consider differentiating Φ in direction δ≡(δ˙,0) with H˙δ˙=0, so that h+sδ∈Δ∘ for ∣s∣ small. Writing a˙≡log[φ˙(σ˙)/h˙(σ˙)],
We claim it is possible to choose λ˙ such that ε˙ has marginals εˉ≡0: in vector notation ε˙=a˙+H˙tλ˙, so this amounts to solving H˙a˙+H˙H˙tλ˙=0, which has a unique solution λ˙ by surjectivity of H˙. Taking δ˙=ε˙ with this value of λ˙ in the above derivative gives
Now differentiate in the direction of general δ with d1H˙δ˙=δˉ=k1H^δ^, so h+sδ∈Δ for small ∣s∣. Applying (22) and simplifying gives
By surjectivity we may choose δ with δˉ(σ)=ρˉ(σ)−∣M∣−1∑σ′ρˉ(σ′), and then substituting into the above we find that loghˉ−λ˙−λ^ is a constant function of σ, that is,
On the other hand, the marginal of (22) reads
Comparing the expressions for hˉ(σ) shows that the probability measures h˙ and h^ on M obtained by normalizing respectively eλ^(σ) and eλ˙(σ) must solve the Bethe recursions (18). Lastly (22) shows that h corresponds to h≡(h˙,h^) via (21), concluding the proof. ∎
In view of Lem. 3.6 and our preceding discussion of Gibbs measures, Thm. 3.7 will follow by showing
Any global maximizer h of Φ on Δ must lie in the interior Δ∘, and so corresponds via (21) to a solution h of the Bethe recursions (18). (For the required surjectivity of H˙,H^ see Lem. 6.4.)
Any such Bethe solution h satisfies the symmetries (18), therefore reduces to a solution q of the frozen model recursions (9). Further q is in the regime of Lem. 3.1, which uniquely identifies h=⋆h.
4. Boundary maximizers
In this section we verify (by a priori estimates) that Φ has no maximizers on the boundary of Δ. By Rmk. 3.3 we may work interchangeably with the frozen and auxiliary models.
Recall that Znβ denotes the contribution to the frozen model partition function from configurations with nβ free variables.
The above is optimized at νj=pjuj/c where c≡∑jpjuj and u is chosen such that kβ matches ∑jjνj=(∑jjpjuj)/(∑jpjuj). The latter is increasing in u, and it is straightforward to check that it has a unique solution u=1+\nicefrac22k+O(\nicefrack4k). This implies c=1−\nicefrac22k+O(\nicefrack28k), thus
with Φ as in (2) (not depending on β).
Bounds with forcing constraints. Suppose we condition on an assignment of edges such that every clause is satisfied, and no f-variables are illegally forced. Each of the mν0 fully rigid clauses is forcing with probability ϑ≡\nicefrac2k(2k−2), and mν0 is clearly sandwiched between m and mˊ≡m(1−kβ), therefore
For α=[1+O(2−k/3)]ϑ we have
the same estimate holds with mˊ,yˊ in place of m,y. Applying Lem. 3.8 then gives
This is clearly optimized with 2k+1β≈1, and estimating the second derivative of the exponent with respect to β implies the result. ∎
Lem. 3.9 shows that the maximum cannot be obtained on the boundary β=βmax, so it remains to show that the maximizer must be a strictly positive measure on suppφ. For δ≡(δ˙,δ^) such that h+tδ lies in Δ for t≥0 small, consider
To show that h∈Δ is not a maximizer it suffices to exhibit TΦ(h;δ)>0 for some δ. In particular, it follows by convexity that for any h∈Δ, h+t(⋆h−h)∈Δ∘ for t>0 small and ⋆h as in the statement of Thm. 3.7. Therefore, if h is a maximizer such that the edge marginal has full support supphˉ=M, then necessarily supph=suppφ, since otherwise TΦ(h;⋆h−h)>0.
Clearly the same argument applies replacing 0 with 1. In each case the conclusion contradicts the assumption that h is a maximizer, concluding the proof.In our setting we have checked supphˉ=M in a rather ad hoc manner. A simpler argument applies generally to any specification φ which is everywhere positive on Md, Mk: if σ∈/supphˉ then take σˊ∈supphˉ, and observe that TΦ(h;δ)>0 for δ defined by δ˙=1(σ,σˊd−1)−1(σˊd), (\nicefracdk)δ^=1(σ,σˊk−1)−1(σˊk). ∎
5. Bethe recursion symmetries
Suppose h is an interior maximizer for Φ on Δ, and so corresponds to a Bethe solution h. Let Tˊd,k denote Td,k with a subtree incident to the root removed, leaving an unmatched half-edge eˊ incident to o (Fig. 2). Consider defining a Gibbs measure on Tˊd,k in the manner of (16), with boundary law given by the Bethe solution h. Then the marginal law of σeˊ will be h˙, and the marginal law of the tuple of spins incident to any given vertex will be h˙ if the vertex is a variable, h^ if it is a clause. Further, the Gibbs measure on Tˊd,k can be generated in Markovian fashion, starting with spin σeˊ distributed according to h˙, generating the messages on the other d−1 edges incident to o according to the conditional measure h˙(σ˙∣σ1=σeˊ), and continuing iteratively down the tree.
The effect of changing uˊυˋ from ff to f0 can only propagate through clauses in which the parent variable and exactly one descendant variable send message f, and the evaluation of the remaining k−2 messages under the clause literals is identically 0 or 1. The vertex-preceding edges of Tˊd,k whose spins will be affected by changing υˋ from f to 0 form a branching process with mean
where the intermediate step follows from (21). Similarly, the effect of changing uˊυˋ from f0 to ff can only propagate through clauses in which exactly one descendant variable sends message f, and the evaluation of the remaining k−1 messages under the clause literals is identically 0 or 1. This forms a branching process with mean
6. Explicit form of first moment exponent
We conclude this section by giving the explicit form of ⋆Φ≡⋆Φk(d).
with d□ the first moment threshold of the original nae-sat partition function (3).
Let us now see that ⋆Φ is strictly decreasing in d. Recalling (30) that v=Q/(1−Q), we find
and rearranging gives (27). This can be expressed as a function of q alone by taking Q=Q(q) as in (30) and d=d(q) as in (28). With Dq denoting differentiation in q, we calculate
The total derivative of ⋆Φ≡⋆Φ(d(q)) with respect to q is then straightforward to calculate: the main contribution comes from
Second moment of auxiliary model
In this subsection we complete our analysis of the near-independent regime 2⋆Δ to prove
The unique global maximizer of the restriction of 2Φ to 2⋆Δ is 2⋆h.
Note that H(π) is maximized at α=\nicefrac12, therefore
From the above estimates on the νj we find
Combining these estimates and recalling Φ=log2+(\nicefracdk)log(1−\nicefrac22k) from (2) gives
Recalling (23) gives the two upper bounds
Any global maximizer of 2Φ on 2⋆Δ must be an interior stationary point.
It follows by symmetry considerations that supphˉ=M2, hence any maximizer h of 2Φ must be positive on suppφ since otherwise T2Φ(h;2⋆h−h) would be positive. ∎
The variable recursions are (with c˙ the normalizing constant)
Writing Q≡(q/2)k−1, Qˊ≡(qˊ/2)k−1, and Q⋆≡(q˙⋆/2)k−1, we have
By assumption, x≡2k(∣q−q˙⋆∣+∣qˊ−q˙⋆∣)≲1, so Q+O(x4kk)=Q⋆=Qˊ+O(x4kk) and consequently Wd−1[1+O(x4kdk)]=(W⋆)d−1. It follows that
implying that the recursion contracts to x=0, q=qˊ=q˙⋆ as claimed. ∎
Estimates on messages. The number of clauses incident to any variable which are free in either coordinate is ≲m2kk, while an easy a priori estimate implies that the number of fully-rigid clauses which are non-forcing is ≍m. Recalling (21) then gives
where the last inequality follows because all the φ^2 factor weights involved in the application of (21) are 1−O(2kk).
where the last step uses the assumption that h lies in 2⋆Δ.
2. A priori rigidity estimate
Recalling Lem. 4.2, let 2⋅⋅Z denote the contribution to Z2 from the near-identical regime h∈2⋅⋅Δ. In this subsection we prove
(where 0<α<1 may be arbitrarily chosen). We therefore bound
where we have used the trivial inequality H(x)+xlogc≤log(1+c)≤c. Recall ε≲2−k/2 by assumption, and γ≤k2/2k/2 by the restriction to ΩB, therefore
Crudely bounding av≤d, there exists a uniform constant C such that
Again recalling H(x)+xlogc≤log(1+c)≤c we bound
Follows by combining Propns. 4.3 and 4.7. ∎
Negative-definiteness of free energy Hessians
The Hessians HΦ(⋆h) and H2Φ(2⋆h) are negative-definite.
Let h∈Δ∘ with h˙ and h^ both symmetric, and let δ be any signed measure on suppφ (not necessarily symmetric) with h+sδ∈Δ∘ for sufficiently small ∣s∣. Then
where a/b denotes the vector given by coordinate-wise division of a by b, and ⟨⋅⟩h denotes integration with respect to measure h, e.g. ⟨(δˉ/hˉ)2⟩hˉ=∑σδ(σ)2/hˉ(σ).
Given fixed marginals δˉ, ⟨(δ˙/h˙)2⟩h˙ is minimized by δ˙(σ˙)=h˙(σ˙)d1∑i=1dχ˙σi with χ˙ chosen to satisfy the margin constraint — which, after a little algebra, becomes the vector equation Hˉ−1δˉ=d−1[I+(d−1)M˙]χ˙ where Hˉ≡diag(hˉ) and M˙ denotes the stochastic matrix
If such χ˙ exists, then the minimal value of ⟨(δ˙/h˙)2⟩h˙ subject to marginals δˉ is ⟨δˉ,χ˙⟩. Define analogously the stochastic matrix M^ corresponding to h^: if both L˙≡I+(d−1)M˙ and L^≡I+(k−1)M^ are non-singular, then the maximum of k∂η2Φ(h+ηδ)∣η=0 over all δ with marginal δˉ is given by
where F≡(Hˉ1/2L˙Hˉ−1/2)−1+(Hˉ1/2L^Hˉ−1/2)−1−I. It is clear from (37) that M˙ and M^ are hˉ-reversible, therefore F is symmetric. Since ∑σδˉ(σ)=0 we consider only the action F′ of F on the space of vectors orthogonal to hˉ1/2. At a global maximizer we know F′ to be negative-semidefinite, so if detF=0 then it is in fact negative-definite. Thus let M˙, M^, M˙2, M^2 denote the Markov transition matrices corresponding (via (37)) to ⋆h˙, ⋆h^, 2⋆h˙, 2⋆h^ respectively. In §5.2 we will prove that the matrices
are all non-singular. Propn. 5.1 then follows by noting that F=Hˉ1/2L˙−1LL^−1Hˉ−1/2.
2. Calculation of transition matrices
The eigenvalues of M˙ counted with geometric multiplicity are
The matrix M˙2 is given by M˙⊗M˙; consequently both L˙ and L˙2 are non-singular.
which has eigen(m˙)=(1,ab1/2,−ab1/2). Thus eigen(M˙)=(1,eigen(m˙),eigen(m˙)) is as stated above. Since 2⋆h=⋆h⊗⋆h, clearly M˙2=M˙⊗M˙, so the lemma is proved. ∎
The matrices L and L2 are non-singular.
For A⊆M write hˉA≡(hˉ1A)/hˉ(A), the stationary distribution hˉ conditioned on A. The vectors
therefore ∥w2tS˙S^∥/∥w2∥=∥(u2tM˙M^)/hˉ1/2∥/∥w2∥≍2−k/2. It follows that M˙M^ (equivalently S˙S^) can have no eigenvalue with absolute value ≍1/(dk), hence L is non-singular.
For 1≤i,j≤3 let wij≡wi⊗wj, and note that if w is orthogonal to the span of (w11,w12,w21) then ∥wtS˙2S^2∥=O(2−3k/2)∥w∥. Next note that
so ∥w12tS˙2S^2∥/∥w12∥=∥w2tS^∥/∥w2∥≍2−k/2. Since w12S˙2S^2 and w21S˙2S^2 are orthogonal,
As shown in §5.1 the result follows by verifying that the matrices defined in (38) are non-singular, which is done by the lemmas of §5.2. ∎
In the pair partition function Z2, let 2⋆Z denote the contribution from (non-normalized) measures 2g within euclidean distance n1/2logn of the independent-copies local maximizer 2⋆g=⋆g⊗⋆g. Recall from the statement of Lem. 4.2 that 2⋅⋅Z denotes the contribution to Z2 from the near-identical measures 2⋅⋅Δ. Decompose
From constant to high probability
As in the proof of Thm. 2, ⋆Z denotes the contribution to the auxiliary model partition function on (G,L) from configurations whose non-normalized empirical measure g≡(nh˙,mh^) lies within euclidean distance n1/2logn of ⋆g. The main result of this section is the following
The proposition easily implies the following strengthened statement of Thm. 3a:
Taking n→∞ followed by ε↓0 proves the theorem. ∎
Consider forming the graph G by beginning with n vertices each incident to d half-edges, and choosing, for 1≤i≤m, a random set of k unmatched half-edges to be joined into the i-th clause ai (every clause comes with literals). Let F≡(Fi)0≤i≤m denote the associated filtration; to prove Propn. 6.1 we will control the increments of the Doob martingale of Lε with respect to F:
Note the term i=m is zero, since there is no randomness left when only two unmatched half-edges remain. Since a maximum of k clauses will use any subset of the half-edges of size k, the random graph G∣Fi can be coupled with G∣Fi−1 such that the graphs differ only in the placement of clauses on k2 half-edges. Therefore
Let i be fixed, and note that since (a−b)/a≤log(a/b)≤(a−b)/b for any a,b>0,
Consider the graph G∘, with its unmatched half-edges partitioned into disjoint subsets K and W. We shall define a certain local neighborhood T of the half-edges in K, such that G∂≡G∘\T is a graph with unmatched half-edges in disjoint sets W (as before) and U (leaves of T without W); see Fig. 3.Each unmatched half-edge is incident to a variable, and does not include a clause. Then, writing Y≡U∪W, we decompose
where ΨW is the partition function on W, ⋆Z∂[σY] is the partition function on G∂ given boundary conditions σY, κ(σU)≡κT(σU∣σW) is the partition function on T∪A given boundary conditions σY, and κˊ(σU)≡κˊT(σU∣σW) is the partition function on T∪Aˊ given boundary conditions σY. Averaging over W and squaring gives
W can only intersect T in its leaves; and we shall let U denote the leaves of T without W.
so we shall bound (45) by projection onto a Fourier basis for L2(M2U,p): take (b1,…,b∣M∣) to be an orthonormal basis for L2(M,h˙) with b1≡1. Then the functions bs(σU)≡∏u∈Ubs(u)(σu) (s∈[∣M∣]U) form an orthonormal basis for L2(MU,p), and the functions bs1,s2(τU)≡bs1(σU1)bs2(σU1) form an orthonormal basis for L2(M2U,p). By Plancherel’s identity,
where ∧ indicates the Fourier transform with respect to the basis b, and
2. Expansion of partition function
On the graph G∂ we now analyze the partition function ⋆Z∂[σY] and its marginals
It is more convenient here to work with the non-normalized tuple empirical measures g≡(g˙,g^)≡(nh˙,mh^). The associated non-normalized marginal edge counts are given by H˙g˙ and H^g^ where H˙, H^ are the marginalization matrices corresponding to φ˙, φ^ as defined in §3.3. The pair g≡(g˙,g^) can contribute to ⋆Z∂[σY] only if
where ⟨g˙,1⟩ indicates the total mass of g˙, and HˉσY denotes the non-normalized edge empirical measure associated to σY. The contribution from such g is given by
where we adopt the shorthand φ˙δ˙≡∏σ˙φ˙(σ˙)δ˙(σ˙), g˙!≡∏σ˙g˙(σ˙)!, etc.
The following lemma estimates the contribution in expectation from ⋆Z∂[σY] to ⋆Z∂.
Suppose there exist measures δσY (non-zero only on the support of φ) satisfying H^δ^σY=H˙δ˙σY+HˉσY for all σY, with (⟨δ˙σY,1⟩,⟨δ^σY,1⟩)=(ν,μ) constant in σY. Then
where ∥δ∥1≡∑σ˙∣δ˙(σ˙)∣+∑σ^∣δ^(σ^)∣.
G∂ has n∂ variables, m∂ clauses, and ∣Y∣ unmatched edges incident to variables, so n∂d=m∂k+∣Y∣. Fix σY and abbreviate δ≡δσY; note from the assumptions that νd=μk−∣Y∣. Thus n′d=m′k for n′≡n∂+ν and m′≡m∂+μ, so we may compare ⋆Z∂ with the partition function ⋆Z′ on a full bipartite (d,k)-regular graph with n′ variables and m′ clauses. Away from the simplex boundary, empirical measures contributing to ⋆Z∂[σY] can be parametrized as g−δ where g runs over the empirical measures contributing to ⋆Z′. Writing (a)b for the falling factorial a!/(a−b)!, we have
The factor c=c[1+Ok(∥δ∥12/n)] is a proportionality constant not depending on (g,δ). For ∥g−⋆g∥≤n1/2logn, we find eg,δ∼1 while rg,δ gives the main dependence on σY:
(using (21) to calculate r). Recalling Propn. 5.1 we have (with δ≡δσY)
Lem. 6.3 applies for any factor model with free energy attaining a local maximum at ⋆g with negative-definite Hessian. In particular, it applies to both the first- and second-moment versions of the auxiliary model. We now show how to construct the required measures δτY for the pair auxiliary model (the construction for the first-moment version being similar but simpler). The construction is based on the following
For any τ,τ′∈M2 there exists a signed integer measure δ=δτ−τ′=(δ˙,δ^) with suppδ⊆suppφ2 such that
The remaining cases follow by symmetry. ∎
clearly this satisfies the conditions of Lem. 6.3. Applying Lem. 6.3 with this choice of δ for n′=n and m′=m gives
(a) Write ν≡n−n∂, μ≡m−m∂. The calculation of Lem. 6.3 applied to the auxiliary model gives
with Z the partition function on a full bipartite (d,k)-regular graph on n variables, and with proportionality constant c≡exp{ν⋆Φ}⋅z^∣Y∣/k where z^ is the normalizing constant for ⋆h^ as defined by (21). The corresponding normalizing constant for 2⋆h^ is z^2, so we see that the proportionality constant corresponding to the pair auxiliary model is simply c2. Thus, applying (52) in the pair auxiliary model gives
(b) Substituting the result of (a) into (45) gives
The method of Lem. 6.3 can also be applied to estimate the dependence on τU fixing τY:
If T is such that k divides ∣U∣, then there are coefficients ξ, (ξj)j≤C with ∥ξ∥∞≲kn−1/2logn, C≲k1 and ∥ξj∥∞≲kn−1/2 such that
In the special case that ∣U∣ is divisible by k, we may simply take nT=0 and mT=∣U∣/k, so δ can be expressed as a linear function of the U-marginal:
Assume for simplicity that δ˙τ=0 for all τ: writing a^≡(g^−g^⋆)/g^⋆, we estimate
We then simplify ⟨δ^τU,A^⟩=⟨HˉτU,ξ⟩ and δ^τU(τ^)2B^(τ^)=⟨HˉτU,ξτ^⟩2 where ξ(τ)≡⟨δ^τ,A^⟩ and ξτ^(τ)≡B^1/2(τ^)δ^τ(τ^). Relabelling gives (54) in the case that δ˙τ=0 for all τ. The result in general follows by an easy generalization of the above calculation. ∎
satisfies R∅,∅≍1 and ∣Rs1,s2∣≲k,tn−1/2logn for ∣s1s2∣≥1, consequently
If further T is disjoint from W with ∣U∣ divisible by k, then ∣Rs1,s2∣≲kn−1 for ∣s1s2∣≥2, and ∣Rs1,s2∣≲k,tn−3/2(logn)6 for ∣s1s2∣≥3. All estimates hold uniformly in τW.
The estimates on R follow straightforwardly from Lem. 6.6. To see (55), we calculate
where the first step uses Cor. 6.5a and the second step uses (53) together with the trivial bound ∣κs∧∣≤∥bs∥∞κ∅∧≲k,tκ∅∧, since the orthogonality relation ∥bs∥q˙=1 implies ∥bs∥∞≤(minσh˙σ)−∣s∣/2≲k,t1. ∎
3. Local neighborhood Fourier coefficients
Let us recall again the definition (44) of the local neighborhood T of the unmatched K in G∘ (equipped with random literals), with leaves joining T to the graph G∂ considered in §6.2. Recall also that A, Aˊ are arbitrary choices of clauses (with literals) to place on K, and we write κ(σU) (resp. κˊ(σU)) for the partition function on T∪A (resp. T∪Aˊ) given boundary configuration σY. In this subsection we control the Fourier coefficients ϖ∧=(κ−κˊ)∧ appearing in (46).
Let T denote the event that T consists of ∣K∣ tree components with T∩W=∅. Let C∘ denote the event that T either contains a single cycle or has a single intersection with W (but not both), but still consists of ∣K∣ components.
For T∈T, ϖs∧=0 for all ∣s∣≤1; and κ∅∧∣T takes a constant value κ∅∧, which does not depend on the literals on T or on the clauses A. For T∈C∘, ϖ∅∧=0.
On the event T∪C∘, the graphs T∪A and T∪Aˊ are isomorphic ignoring the literals. If ∣s∣≤1 then bs depends at most on the spin of a single edge e∈U. For T∈T, using the symmetry of nae-sat one can produce an involution ι:σU↦σˊU on MU which keeps σe fixed, is measure-preserving with respect to p, and satisfies κ(σU)=κˊ(σˊU): set σˊu to be σu or ¬σu depending on whether the sum of literals along the unique path joining e to u in T∪A differs in parity from the corresponding sum in T∪A. Then
proving our claim on T. A similar argument proves ϖ∅∧=0 on C∘. ∎
For T∈T, ϖs∧≲kκ∅∧/[4(k−4)t] for all ∣s∣=2.
Since ∣s∣=2 we may write bs(σU)=f(σu)g(σw) for f≡bs(u) and g≡bs(w). If u,w belong in the same connected component of T, arguing as in the proof of Lem. 6.8 gives ϖs∧=0, so assume they belong to different components. Since T∈T we may define the random measure μT(σU)≡p(σU)κ(σU)/κ∅∧, and similarly μˊT. Then
since Lem. 6.8 implies f has the same expectation with respect to μ or μˊ (and likewise g). Let γu denote the (unique) path joining u to K in T, and likewise γw. Let N denote the event that on the path γ≡γu∪γw there exists a clause a such that, among the k−2 variables in (∂a)\γ, there exist two variables v′,v′′ with
since the relation ∥bs∥q˙2=1 implies ∥bs∥∞2≤(minσ∈Mq˙σ)−1≲k1. ∎
Consider (46) for T∈T: by Lem. 6.8 there is no contribution from terms ∣si∣≤1. The number of pairs (s1,s2) with ∣s1∣=∣s2∣=∣s1s2∣=2 is at most [∣M∣∣K∣(dk)t]2≲k(k54k)t, and combining Cor. 6.7 and Lem. 6.9 we see that the dominant contribution to (46) comes from these pairs: for T∈T,
Lastly we consider the event Ct′ that B2t′−2∘(K) has ∣K∣ components, but T=B2t′∘(K) has ∣K∣−1 components (cf. (44)) and is disjoint from W. On this event we again decompose into contributions from the different local maxima, but differently than in (43):
where ⋆Z∅ is the leading term in the Fourier expansion of ⋆Z:
If T∈Ct′ then κ∅∧≍κˊ∅∧ and ∣ϖ∅∧∣≲k4−(k−4)t′[κ∅∧∧κˊ∅∧].
Let κ∘(σU,σK) denote the partition function on T given boundary conditions (σU,σK), and define the random measure
If ι(σK) is the indicator that σK is valid for clauses A (likewise ιˊ for clauses Aˊ) then
By definition of the event Ct′,
where {e′,e′′} is the unique pair of edges in K such that B2t′∘(e′) and B2t′∘(e′′) intersect. The graph T (without A or A′) contains no cycles, so it follows from the symmetry argument of Lem. 6.8 that the marginal of μ∘ on each e∈K does not depend on the literals on T; further each marginal must simply be p from the Bethe recursions. It remains to note (arguing as in the proof of Lem. 6.9) that ∣μ∘(σe′,σe′′)−μ∘(σe′)μ∘(σe′′)∣≲4−(k−4)t′, from which we conclude
(where ⟨p,ι⟩=⟨p,ιˊ⟩ again by symmetry). ∎
Writing C≡⋃t′≤tCt′, we have
4. Variance bound for general factor models
We summarize the result of this section by abstracting a variance bound (Cor. 6.11 below) which applies to a general class of factor specifications φ on (d,k)-regular graphs.
Let U denote the leaves of T without W, and Y the disjoint union of U and W.
Let A,Aˊ be two arbitrary ways to form k clauses on U. Let κ(σU) denote the partition function on T∪A subject to boundary conditions σU, and let κ∅∧≡∑σUp(σU)κ(σU). Define similarly κˊ(σU) and κˊ∅∧ with respect to Aˊ in place of A. Let φ(σW) denote the probability that σW is valid with respect to a random formation of clauses on W.
Suppose φ≡(φ˙,φ^) specifies a factor model on (d,k)-regular bipartite factor graphs such that which the following hold:
(Factor support) The space M of spins is connected by measures δσ−σ′ on the support of φ (in the sense of Lem. 6.4); likewise the space M2 of pair spins is connected by measures δτ−τ′ on the support of the second-moment factors φ2.
(Moment conditions) The first-moment rate function Φ has negative-definite Hessian at its global maximizer ⋆h, and the second-moment rate function 2Φ has a local maximum at 2⋆h≡⋆h⊗⋆h with negative-definite Hessian.
(Tree isomorphisms) On the event T that T consists of ∣K∣ tree components with T∩W=∅, or the event C∘ that T either contains a single cycle or has a single intersection with W (but not both), κ∅∧=κˊ∅∧. Further κ∅∧∣T takes a constant value κ∅∧ not depending on A, and Covp(κ−κˊ,f)=0 for any function f depending only on a single spin σe, e∈U.Note that this property is not immediate in the nae-sat setting because A and Aˊ may have different literals, but in a model with non-random factors (e.g. the hard-core model) it follows immediately from the isomorphism between T∪A and T∪Aˊ.
(Correlation decay) The tree Gibbs measure ν corresponding to ⋆h has correlation decay at rate faster than the square root of the tree’s branching rate: for variables u,v are separated by t clauses, ∣Covν(f(σu),g(σv))∣≲k∥fg∥∞[c(d−1)(k−1)]−t/2 for c>1.
Let r>0 such that 2⋆Φ(h)<2⋆Φ(2⋆h) for all h=2⋆h within distance 2r of 2⋆h, and let 2⋅⋅Z∂ refer to the contribution to the pair partition function on G∂≡G∘\T from empirical measures at distance more than r from 2⋆h. For m−m′≲klogn and m′≤i≤m−k define
If ⋆Z denotes the contribution to the partition function from empirical measures within distance n−1/2logn of ⋆h, then for t=t(k,ε)=4logc(1/ε) we have
The original nae-sat model can also be regarded as a factor model in the sense of Cor. 6.11, with factors φ˙(σ˙) and φ^a(σ^a)≡φ^∘(σ^a⊕La) where (compare (12))
From clusters to assignments
Let G♯≡G♯(G,L,σ) denote the subgraph of G induced by the free variables together with the clauses F♯. We claim that σ has a valid completion to an nae-sat solution provided each connected component of G♯ contains at most one cycle. Indeed, in a tree component of G♯ one may choose an arbitrary root vertex and assign it an arbitrary value — this may cause a chain of forcings, but no conflict results since there is no cycle. In a unicyclic component C with cycle v0,a0,v1,…,an−1,vn (with indices taken modulo n so v0=vn), setting xvi=¬Laivi⊕ξai ensures that all clauses along the cycle are satisfied. Then, by the preceding argument for tree components, there exists a valid completion of x to the remainder of C, proving our claim.
As for the marginal bias, note that the increased chance for ov′ to be free compared with ou comes from the fact that v receives only d−2 incoming messages from the rest of the graph: thus σv→b is slightly biased towards f, and this effect can percolate through the chain σb→w, σw→b′, σb′→v′ to affect ov′. However the initial bias on σv→b is ≲4−k, and the effect decreases by a factor 2k passing through each step in the chain, so the overall bias is ≲2−6k. Combining these estimates proves (61).
The result follows from (61) and (62) by noting that in a clause with k random incoming messages which are mutually independent except for possible correlation among the first two, the probability for the clause to be satisfied decreases if the probability for the first two messages to be both rigid increases. ∎