Satisfiability threshold for random regular NAE-SAT

Jian Ding, Allan Sly, Nike Sun

Introduction

Given a Boolean formula in conjunctive normal form (i.e., expressed as an and of ors), a not-all-equal-sat (nae-sat) solution is an assignment x‾\underline{\smash{x}} of literals to variables such that both x‾\underline{\smash{x}} and its negation ¬x‾\neg\underline{\smash{x}} evaluate to true. A kk-nae-sat problem is one in which each clause involves exactly kk literals.

The kk-nae-sat problem is a symmetrized version of kk-sat. A major direction of research has concerned the large-system limit of random problem instances, seeking to establish typical behavior and phase transitions. In particular, much effort has been directed towards locating the satisfiability transition: the critical density α⋆\alpha_{\star} where solutions cease to exist .

In this paper we consider random dd-regular kk-nae-sat, in which each variable is involved in exactly dd clauses, and clause literals are chosen uniformly at random. We establish the following sharp satisfiability threshold, the first of its kind among this class of csps:

For k≥k0k\geq k_{0} there is a threshold d⋆≡d⋆(k)d_{\star}\equiv d_{\star}(k), given by the largest zero of the explicit function (1), such that the probability for a random dd-regular kk-nae-sat instance to be solvable tends to one for d<d⋆d<d_{\star}, and tends to zero for d>d⋆d>d_{\star}.

The threshold d⋆d_{\star} is given by the largest zero of the function

where q=q(d)q=q(d) is the unique solution in the interval [1−2−k,1][1-2^{-k},1] of

We will find (see Propn. 3.11) that ⋆Φ{}^{\star}\bm{\Phi} is decreasing with a unique zero on the interval (2k−1−2)klog⁡2≤d≤2k−1klog⁡2(2^{k-1}-2)k\log 2\leq d\leq 2^{k-1}k\log 2.

As the threshold is given by the root of an equation, it is possible for d⋆d_{\star} to be integer-valued, though we have no reason to believe that this ever occurs. Nevertheless, we also address this hypothetical possibility by showing that if d=d⋆d=d_{\star} then the probability for the nae-sat instance to be solvable is asymptotically bounded away from both zero and one. This completes the characterization of the satisfiability transition.

The methods developed in this paper offer a new approach to tackling other problems in the same class and establishing exact thresholds. Indeed, in a companion paper we consider the maximum independent set problem on random regular graphs, where we determine the explicit threshold, and furthermore show tight concentration of the maximum independent set size about the threshold value.

Previous work on the satisfiability transition has identified sharp thresholds in models not exhibiting condensation, e.g. xor-sat . The 22-sat satisfiability transition is also much simpler, and can be identified by a branching process argument . See also for detailed discussions of these problems. Previous work on nae-sat has centered on the Erdős–Rényi version in which variables are included in clauses independently at random, with a series of improving bounds on the satisfiability transition .

Shortly prior to the posting of this paper, A. Coja-Oghlan posted a paper on a different symmetrization of regular kk-sat in which a 22-clause joins each consecutive pair of variables, forcing them to take opposite literals. While not establishing a satisfiability threshold, his paper establishes a 1rsb-type formula for the existence of solutions that satisfy all but o(n)o(n) clauses. His approach of modeling clusters of configurations is similar to our own.

We hereafter write G≡Gn,d,kG\equiv\mathcal{G}_{n,d,k} to indicate that GG is chosen according to the configuration model for uniformly random (d,k)(d,k)-regular bipartite (multi-)graphs with nn degree-dd vertices, with L‾\underline{\smash{L}} a uniformly random literal assignment.

2. Outline of proof

It is most natural to apply the moment method with the nae-sat partition function

For fixed kk the rate function Φk(d)\Phi_{k}(d) is clearly decreasing in dd, with unique zero at

In §2 we will see that a rather straightforward application of the second moment method on ZZ gives the following

We establish this by the second moment method applied to the partition function Z\bm{Z} of the frozen configurations. In §3-5 we prove

The proof of Thm. 2 comprises a large portion of the present paper. The first moment is addressed in §3, where we identify the exact local neighborhood profile that gives the maximal contribution to the expectation. This is done by a Bethe variational principle which relates stationary points of the rate function to fixed points of certain tree recursions. A major technical difficulty is the high dimensionality of the maximization problem, and the possibility of multiple stationary points which must be ruled out. This is done by delicate a priori estimates which allow us to reduce the dimensionality by certain symmetry conditions.

The second moment can be understood in the same framework by regarding it as the first moment of the pair model, but clearly the dimensionality is substantially increased. We show in §4 that the dominant contribution comes from two local maximizers: one corresponding to pairs whose overlap distribution looks like a product measure, and the other corresponding to pairs which are perfectly correlated — in each case, with both marginals given by the first moment maximizer. The results of §3 and 4 control the moments up to polynomial prefactors, which are determined in §5 by establishing negative-definiteness of the Hessians for the first- and second-moment rate functions at their maximizers.

Thm. 3 is proved in §6 by a variance reduction argument. This issue occurs commonly in applications of the second moment method, and is often dealt with by a somewhat standard machinery known as the subgraph conditioning method (see ) which “explains” the variance in terms of the short cycles in the graph. Applying this method is technically demanding, and seems to us intractable in our models due to the large number of variables.

We develop instead a novel approach of taking a certain log-transform of the partition function, and bounding the incremental fluctuations of its Doob martingale with respect to the edge-revealing filtration; each increment amounts to the effect of adding a clause. We control the variance by discrete Fourier analysis applied on the spins at the boundary of a large local neighborhood of the added clause, and we show that the main contribution comes from the degree-two Fourier coefficients which correspond to the formation of short cycles in the graph.

3. Notation

Acknowledgements

We thank Amir Dembo, Elchanan Mossel, Andrea Montanari, and David Wilson for helpful conversations.

Satisfying assignments

where γ0≡γ0(α)≡1−αk−(1−α)k\gamma_{0}\equiv\gamma_{0}(\alpha)\equiv 1-\alpha^{k}-(1-\alpha)^{k}. Thus we conclude

For fixed α\alpha, a\mathbf{a} is strictly concave in γ\gamma with second derivative −[γ(1−γ)]−1≤−4-[\gamma(1-\gamma)]^{-1}\leq-4, and is uniquely maximized at γ⋆(α)=γ0(1−ϑ)/(1−ϑγ0)\gamma^{\star}(\alpha)=\gamma_{0}(1-\vartheta)/(1-\vartheta\gamma_{0}) with optimal value

It is straightforward to calculate that for k−1(log⁡k)2≤α≤1−k−1(log⁡k)2k^{-1}(\log k)^{2}\leq\alpha\leq 1-k^{-1}(\log k)^{2},

so clearly α=\nicefrac12\alpha=\mathchoice{\nicefrac{{1}}{{2}}}{\smash{\nicefrac{{1}}{{2}}}}{\nicefrac{{1}}{{2}}}{\nicefrac{{1}}{{2}}} is the unique maximizer on this interval. For 0≤α≤\nicefrac120\leq\alpha\leq\mathchoice{\nicefrac{{1}}{{2}}}{\smash{\nicefrac{{1}}{{2}}}}{\nicefrac{{1}}{{2}}}{\nicefrac{{1}}{{2}}}, H(α)H(\alpha) is increasing while αk+(1−α)k\alpha^{k}+(1-\alpha)^{k} is decreasing, and we use this to bound

For α≤k−3/2\alpha\leq k^{-3/2} we have (1−α)k=1−kα+O(k1/2α)(1-\alpha)^{k}=1-k\alpha+O(k^{1/2}\alpha), therefore

Lastly, recalling H(x)+xlog⁡c≤log⁡(1+c)≤cH(x)+x\log c\leq\log(1+c)\leq c gives

where the inner sum is taken over probability measures ν\nu on {0,…,k}\{0,\ldots,k\} such that mνm\nu is integer-valued. By Stirling’s approximation,

where b(α,ν)≡H(α)−(d/k)∑jνjlog⁡[νj/pj(α)]\mathbf{b}(\alpha,\nu)\equiv H(\alpha)-(d/k)\sum_{j}\nu_{j}\log[\nu_{j}/p_{j}(\alpha)] is strictly concave in (α,ν)(\alpha,\nu), and the correction term P(α,ν)\mathscr{P}(\alpha,\nu) is nO(1)n^{O(1)} in general, and is ≍kn(k+1)/2\asymp_{k}n^{(k+1)/2} for ν\nu satisfying max⁡j1/νj≲k1\max_{j}1/\nu_{j}\lesssim_{k}1. It is easily seen that this is indeed satisfied by arg max⁡νb(α,ν)\operatorname{arg\,max}_{\nu}\mathbf{b}(\alpha,\nu) for \nicefrac14≤α≤\nicefrac34\mathchoice{\nicefrac{{1}}{{4}}}{\smash{\nicefrac{{1}}{{4}}}}{\nicefrac{{1}}{{4}}}{\nicefrac{{1}}{{4}}}\leq\alpha\leq\mathchoice{\nicefrac{{3}}{{4}}}{\smash{\nicefrac{{3}}{{4}}}}{\nicefrac{{3}}{{4}}}{\nicefrac{{3}}{{4}}}, so it follows using the strict concavity of b\mathbf{b} that

2. Coarsening algorithm and frozen model

In view of Propn. 1.2 we hereafter assume unless indicated otherwise that k≥k0k\geq k_{0} large,

We simulate the coarsening algorithm as follows: of the ndnd half-edges incident to variables, choose e1,…,eme_{1},\ldots,e_{m} uniformly at random (with random ordering) to be potentially forcing. Edge eae_{a} corresponds to clause aa, though here the clauses are not explicitly formed. Conditioned on x‾\underline{\smash{x}} being a valid solution, each clause independently has probability ϑ≡\nicefrac2k(2k−2)\vartheta\equiv\mathchoice{\nicefrac{{2k}}{{(2^{k}-2)}}}{\smash{\nicefrac{{2k}}{{(2^{k}-2)}}}}{\nicefrac{{2k}}{{(2^{k}-2)}}}{\nicefrac{{2k}}{{(2^{k}-2)}}} to be x‾\underline{\smash{x}}-forcing (cf. Defn. 2.1): therefore set each eae_{a} to be initially forcing with probability ϑ\vartheta, independently over aa. Then, for each t≥0t\geq 0, if there exists v∈Vv\in V which is incident to no (remaining) initially forcing half-edge, then take the first such vv and

Delete all dvtd^{t}_{v} remaining potentially forcing half-edges incident to vv; and

Delete the first d−dvtd-d^{t}_{v} potentially forcing half-edges among all those remaining.

The interpretation is that the coarsening algorithm sets vv to be a free variable at stage tt. Thus the d−dvtd-d^{t}_{v} clauses incident to vv and potentially forcing to other variables can no longer be forcing, so we remove these clauses from consideration (step (ii)).Step (i) does not delete any initially forcing half-edges, but step (ii) can.

First moment of frozen model

We shall specify a Gibbs measure ν\nu on Td,kT_{d,k} by defining a consistent family of finite-dimensional distributions νt\nu_{t} on the depth-tt subtrees Td,k(t)T_{d,k}(t). A typical manner of specifying νt\nu_{t} is to specify a “boundary law” on the configuration on the depth-tt vertices, and then to define νt\nu_{t} as an appropriate finite-volume Gibbs measure on Td,k(t)T_{d,k}(t) conditioned on the boundary configuration.

In our setting some difficulty is imposed by the fact that the frozen model is not a factor model (or Markov random field) in the conventional sense that η‾∣A\underline{\smash{\eta}}|_{A} and η‾∣B\underline{\smash{\eta}}|_{B} are conditionally independent given the configuration η‾∣C\underline{\smash{\eta}}|_{C} on any subset CC separating AA from BB — in particular, given the variable spins at level 2t2t of Td,kT_{d,k}, whether a variable at level 2(t−1)2(t-1) is permitted to take spin f depends on whether its neighboring 0’s and 1’s in level 2t2t are forced by clauses in level 2t+12t+1.

The message-passing rules for our frozen model are as follows:

provided η‾↑\underline{\smash{\eta}}^{\uparrow} completes leads to a valid message configuration (no unsat messages) on Td,k(t)T_{d,k}(t) with respect to literals L‾(t)\underline{\smash{L}}(t). The root marginal is then given by

If 1−q≲2−k1-q\lesssim 2^{-k} then vk−1(q)=1−\nicefrac22k+O(\nicefrack4k)v_{k-1}(q)=1-\mathchoice{\nicefrac{{2}}{{2^{k}}}}{\smash{\nicefrac{{2}}{{2^{k}}}}}{\nicefrac{{2}}{{2^{k}}}}{\nicefrac{{2}}{{2^{k}}}}+O(\mathchoice{\nicefrac{{k}}{{4^{k}}}}{\smash{\nicefrac{{k}}{{4^{k}}}}}{\nicefrac{{k}}{{4^{k}}}}{\nicefrac{{k}}{{4^{k}}}}), therefore vk−1(q)d−1=2−k+O(\nicefrack24k)v_{k-1}(q)^{d-1}=2^{-k}+O(\mathchoice{\nicefrac{{k^{2}}}{{4^{k}}}}{\smash{\nicefrac{{k^{2}}}{{4^{k}}}}}{\nicefrac{{k^{2}}}{{4^{k}}}}{\nicefrac{{k^{2}}}{{4^{k}}}}) and qd−1∘vk−1(q)=1−2−k−1+O(\nicefrack24k)q_{d-1}\circ v_{k-1}(q)=1-2^{-k-1}+O(\mathchoice{\nicefrac{{k^{2}}}{{4^{k}}}}{\smash{\nicefrac{{k^{2}}}{{4^{k}}}}}{\nicefrac{{k^{2}}}{{4^{k}}}}{\nicefrac{{k^{2}}}{{4^{k}}}}). In this regime we also calculate

thus (qd−1∘vk−1)′≍\nicefrack22k(q_{d-1}\circ v_{k-1})^{\prime}\asymp\mathchoice{\nicefrac{{k^{2}}}{{2^{k}}}}{\smash{\nicefrac{{k^{2}}}{{2^{k}}}}}{\nicefrac{{k^{2}}}{{2^{k}}}}{\nicefrac{{k^{2}}}{{2^{k}}}} so in this regime (10) must have the unique solution as claimed. ∎

2. Auxiliary model

In the auxiliary model, each configuration σ‾∈ME{\underline{\smash{\sigma}}}\in\mathscr{M}^{E} receives the factor model weight

3. Bethe variational principle

We regard h≡(h˙,h^)\bm{h}\equiv(\bm{\mathchoice{\dot{h}}{\smash{\dot{h}}}{\dot{h}}{\dot{h}}},\bm{\mathchoice{\hat{h}}{\smash{\hat{h}}}{\hat{h}}{\hat{h}}}) as a vector indexed by supp⁡φ≡(supp⁡φ˙,supp⁡φ^)\operatorname{supp}\varphi\equiv(\operatorname{supp}\mathchoice{\dot{\varphi}}{\smash{\dot{\varphi}}}{\dot{\varphi}}{\dot{\varphi}},\operatorname{supp}\mathchoice{\hat{\varphi}}{\smash{\hat{\varphi}}}{\hat{\varphi}}{\hat{\varphi}}). For σ∈M\sigma\in\mathscr{M} and σ˙‾∈supp⁡φ˙\underline{\smash{\mathchoice{\dot{\sigma}}{\smash{\dot{\sigma}}}{\dot{\sigma}}{\dot{\sigma}}}}\in\operatorname{supp}\mathchoice{\dot{\varphi}}{\smash{\dot{\varphi}}}{\dot{\varphi}}{\dot{\varphi}} let H˙σ,σ˙‾\mathchoice{\dot{H}}{\smash{\dot{H}}}{\dot{H}}{\dot{H}}_{\sigma,\underline{\smash{\mathchoice{\dot{\sigma}}{\smash{\dot{\sigma}}}{\dot{\sigma}}{\dot{\sigma}}}}} denote the number of appearances of σ\sigma in σ˙‾\underline{\smash{\mathchoice{\dot{\sigma}}{\smash{\dot{\sigma}}}{\dot{\sigma}}{\dot{\sigma}}}}, and similarly write H^σ,σ^‾\mathchoice{\hat{H}}{\smash{\hat{H}}}{\hat{H}}{\hat{H}}_{\sigma,\underline{\smash{\mathchoice{\hat{\sigma}}{\smash{\hat{\sigma}}}{\hat{\sigma}}{\hat{\sigma}}}}} for the number of appearances of σ\sigma in σ^‾\underline{\smash{\mathchoice{\hat{\sigma}}{\smash{\hat{\sigma}}}{\hat{\sigma}}{\hat{\sigma}}}}. For h\bm{h} to correspond to a valid configuration σ‾{\underline{\smash{\sigma}}}, the variable and clause empirical measures must give rise to the same edge marginals

Given φ≡(φ˙,φ^)\varphi\equiv(\mathchoice{\dot{\varphi}}{\smash{\dot{\varphi}}}{\dot{\varphi}}{\dot{\varphi}},\mathchoice{\hat{\varphi}}{\smash{\hat{\varphi}}}{\hat{\varphi}}{\hat{\varphi}}) let Δ\bm{\Delta} denote the space of probability measures h≡(h˙,h^)\bm{h}\equiv(\bm{\mathchoice{\dot{h}}{\smash{\dot{h}}}{\dot{h}}{\dot{h}}},\bm{\mathchoice{\hat{h}}{\smash{\hat{h}}}{\hat{h}}{\hat{h}}}) on supp⁡φ\operatorname{supp}\varphi (that is, h˙\bm{\mathchoice{\dot{h}}{\smash{\dot{h}}}{\dot{h}}{\dot{h}}} is a probability measure on supp⁡φ˙\operatorname{supp}\mathchoice{\dot{\varphi}}{\smash{\dot{\varphi}}}{\dot{\varphi}}{\dot{\varphi}} while h^\bm{\mathchoice{\hat{h}}{\smash{\hat{h}}}{\hat{h}}{\hat{h}}} is a probability measure on supp⁡φ^\operatorname{supp}\mathchoice{\hat{\varphi}}{\smash{\hat{\varphi}}}{\hat{\varphi}}{\hat{\varphi}}) such that

(h˙,dkh^)(\bm{\mathchoice{\dot{h}}{\smash{\dot{h}}}{\dot{h}}{\dot{h}}},\mathchoice{\tfrac{d}{k}}{\smash{\tfrac{d}{k}}}{\tfrac{d}{k}}{\tfrac{d}{k}}\bm{\mathchoice{\hat{h}}{\smash{\hat{h}}}{\hat{h}}{\hat{h}}}) lies in the kernel of matrix HΔ≡(H˙−H^)H_{\bm{\Delta}}\equiv\begin{pmatrix}\mathchoice{\dot{H}}{\smash{\dot{H}}}{\dot{H}}{\dot{H}}&-\mathchoice{\hat{H}}{\smash{\hat{H}}}{\hat{H}}{\hat{H}}\end{pmatrix}, and

Let s˙≡∣supp⁡φ˙∣\bm{\mathchoice{\dot{s}}{\smash{\dot{s}}}{\dot{s}}{\dot{s}}}\equiv|\operatorname{supp}\mathchoice{\dot{\varphi}}{\smash{\dot{\varphi}}}{\dot{\varphi}}{\dot{\varphi}}|, s^≡∣supp⁡φ^∣\bm{\mathchoice{\hat{s}}{\smash{\hat{s}}}{\hat{s}}{\hat{s}}}\equiv|\operatorname{supp}\mathchoice{\hat{\varphi}}{\smash{\hat{\varphi}}}{\hat{\varphi}}{\hat{\varphi}}|, and sˉ≡∣supp⁡φ^∣=∣M∣\bar{s}\equiv|\operatorname{supp}\mathchoice{\hat{\varphi}}{\smash{\hat{\varphi}}}{\hat{\varphi}}{\hat{\varphi}}|=|\mathscr{M}|: we shall show (Lem. 6.4) that HΔH_{\bm{\Delta}} is surjective, therefore Δ\bm{\Delta} is an (s˙+s^−sˉ−1)(\bm{\mathchoice{\dot{s}}{\smash{\dot{s}}}{\dot{s}}{\dot{s}}}+\bm{\mathchoice{\hat{s}}{\smash{\hat{s}}}{\hat{s}}{\hat{s}}}-\bar{s}-1)-dimensional space.

The expected number of auxiliary configurations on Gn,d,k\mathcal{G}_{n,d,k} with empirical measure h\bm{h} is

If further min⁡h≳k1\min\bm{h}\gtrsim_{k}1 as n→∞n\to\infty, then

If ⋆h{}^{\star}\bm{h} lies in the interior Δ∘\bm{\Delta}^{\circ} of Δ\bm{\Delta} then it must be a stationary point for Φ\bm{\Phi}. Such points correspond to a generalization of the tree Gibbs measures considered in §3.1, where the boundary conditions are specified by a law on incoming and outgoing messages, as follows: first sample uniformly random literals L‾(t)\underline{\smash{L}}(t) on Td,k(t)T_{d,k}(t) as before. If σ‾(t){\underline{\smash{\sigma}}}(t) is a message configuration on the edges of Td,k(t)T_{d,k}(t) — including the edges E(t−1,t)E(t-1,t) joining levels t−1t-1 and tt — then let Ψt(L‾(t),σ‾(t))\Psi_{t}(\underline{\smash{L}}(t),{\underline{\smash{\sigma}}}(t)) denote the product of the factor weights φ˙(σ˙‾v)\mathchoice{\dot{\varphi}}{\smash{\dot{\varphi}}}{\dot{\varphi}}{\dot{\varphi}}(\underline{\smash{\mathchoice{\dot{\sigma}}{\smash{\dot{\sigma}}}{\dot{\sigma}}{\dot{\sigma}}}}_{v}), φ^a(σ^‾a)\mathchoice{\hat{\varphi}}{\smash{\hat{\varphi}}}{\hat{\varphi}}{\hat{\varphi}}^{a}(\underline{\smash{\mathchoice{\hat{\sigma}}{\smash{\hat{\sigma}}}{\hat{\sigma}}{\hat{\sigma}}}}_{a}) over all v,a∈Td,k(t−1)v,a\in T_{d,k}(t-1). For probability measures h˙,h^\mathchoice{\dot{h}}{\smash{\dot{h}}}{\dot{h}}{\dot{h}},\mathchoice{\hat{h}}{\smash{\hat{h}}}{\hat{h}}{\hat{h}} on M\mathscr{M} we define the measures

with ZtZ_{t} the normalizing constant which makes νt\bm{\nu}_{t} a probability measure. This generalizes the definition of νt\nu_{t} in (8) by taking h˙ηη′\mathchoice{\dot{h}}{\smash{\dot{h}}}{\dot{h}}{\dot{h}}_{\eta\eta^{\prime}} proportional to q˙η\mathchoice{\dot{q}}{\smash{\dot{q}}}{\dot{q}}{\dot{q}}_{\eta} and h^ηη′\mathchoice{\hat{h}}{\smash{\hat{h}}}{\hat{h}}{\hat{h}}_{\eta\eta^{\prime}} proportional to q^η′\mathchoice{\hat{q}}{\smash{\hat{q}}}{\hat{q}}{\hat{q}}_{\eta^{\prime}}, i.e.

The family (νt)t(\bm{\nu}_{t})_{t} is consistent if and only if h≡(h˙,h^)h\equiv(\mathchoice{\dot{h}}{\smash{\dot{h}}}{\dot{h}}{\dot{h}},\mathchoice{\hat{h}}{\smash{\hat{h}}}{\hat{h}}{\hat{h}}) satisfies the Bethe recursions

(with z˙h,z^h\mathchoice{\dot{z}}{\smash{\dot{z}}}{\dot{z}}{\dot{z}}_{h},\mathchoice{\hat{z}}{\smash{\hat{z}}}{\hat{z}}{\hat{z}}_{h} the normalizing constants); these generalize the frozen model recursions (9), as we shall see explicitly below. Thus a solution hh of (18) specifies a Gibbs measure ν\bm{\nu} for the auxiliary model on Td,kT_{d,k} which generalizes the measures ν\nu described in §3.1.

This proves our claim that the measures ν\bm{\nu} generalize the measures ν\nu of §3.1.

The connection between these Gibbs measures and the rate function Φ\bm{\Phi} is given by the following variational principle:

If φ≡(φ˙,φ^)\varphi\equiv(\mathchoice{\dot{\varphi}}{\smash{\dot{\varphi}}}{\dot{\varphi}}{\dot{\varphi}},\mathchoice{\hat{\varphi}}{\smash{\hat{\varphi}}}{\hat{\varphi}}{\hat{\varphi}}) is such that both H˙\mathchoice{\dot{H}}{\smash{\dot{H}}}{\dot{H}}{\dot{H}} and H^\mathchoice{\hat{H}}{\smash{\hat{H}}}{\hat{H}}{\hat{H}} are surjective, then any stationary point h\bm{h} of Φ\bm{\Phi} belonging to Δ∘\bm{\Delta}^{\circ} corresponds to a Bethe fixed point solving (18) via

with z˙h,z^h,zˉh\bm{\mathchoice{\dot{z}}{\smash{\dot{z}}}{\dot{z}}{\dot{z}}}_{h},\bm{\mathchoice{\hat{z}}{\smash{\hat{z}}}{\hat{z}}{\hat{z}}}_{h},\mathchoice{\bar{z}}{\smash{\bar{z}}}{\bar{z}}{\bar{z}}_{h} normalizing constants satisfying zˉh=z˙h/z˙h=z^h/z^h\mathchoice{\bar{z}}{\smash{\bar{z}}}{\bar{z}}{\bar{z}}_{h}=\bm{\mathchoice{\dot{z}}{\smash{\dot{z}}}{\dot{z}}{\dot{z}}}_{h}/\mathchoice{\dot{z}}{\smash{\dot{z}}}{\dot{z}}{\dot{z}}_{h}=\bm{\mathchoice{\hat{z}}{\smash{\hat{z}}}{\hat{z}}{\hat{z}}}_{h}/\mathchoice{\hat{z}}{\smash{\hat{z}}}{\hat{z}}{\hat{z}}_{h} for z˙h,z^h\mathchoice{\dot{z}}{\smash{\dot{z}}}{\dot{z}}{\dot{z}}_{h},\mathchoice{\hat{z}}{\smash{\hat{z}}}{\hat{z}}{\hat{z}}_{h} as in (18).

At an interior stationary point h\bm{h}, consider differentiating Φ\bm{\Phi} in direction δ≡(δ˙,0)\bm{\delta}\equiv(\bm{\mathchoice{\dot{\delta}}{\smash{\dot{\delta}}}{\dot{\delta}}{\dot{\delta}}},0) with H˙δ˙=0\mathchoice{\dot{H}}{\smash{\dot{H}}}{\dot{H}}{\dot{H}}\bm{\mathchoice{\dot{\delta}}{\smash{\dot{\delta}}}{\dot{\delta}}{\dot{\delta}}}=0, so that h+sδ∈Δ∘\bm{h}+s\bm{\delta}\in\bm{\Delta}^{\circ} for ∣s∣|s| small. Writing a˙≡log⁡[φ˙(σ˙‾)/h˙(σ˙‾)]\bm{\mathchoice{\dot{a}}{\smash{\dot{a}}}{\dot{a}}{\dot{a}}}\equiv\log[\mathchoice{\dot{\varphi}}{\smash{\dot{\varphi}}}{\dot{\varphi}}{\dot{\varphi}}(\underline{\smash{\mathchoice{\dot{\sigma}}{\smash{\dot{\sigma}}}{\dot{\sigma}}{\dot{\sigma}}}})/\bm{\mathchoice{\dot{h}}{\smash{\dot{h}}}{\dot{h}}{\dot{h}}}(\underline{\smash{\mathchoice{\dot{\sigma}}{\smash{\dot{\sigma}}}{\dot{\sigma}}{\dot{\sigma}}}})],

We claim it is possible to choose λ˙\mathchoice{\dot{\lambda}}{\smash{\dot{\lambda}}}{\dot{\lambda}}{\dot{\lambda}} such that ε˙\bm{\mathchoice{\dot{\varepsilon}}{\smash{\dot{\varepsilon}}}{\dot{\varepsilon}}{\dot{\varepsilon}}} has marginals εˉ≡0\bar{\varepsilon}\equiv 0: in vector notation ε˙=a˙+H˙tλ˙\bm{\mathchoice{\dot{\varepsilon}}{\smash{\dot{\varepsilon}}}{\dot{\varepsilon}}{\dot{\varepsilon}}}=\bm{\mathchoice{\dot{a}}{\smash{\dot{a}}}{\dot{a}}{\dot{a}}}+\mathchoice{\dot{H}}{\smash{\dot{H}}}{\dot{H}}{\dot{H}}^{t}\mathchoice{\dot{\lambda}}{\smash{\dot{\lambda}}}{\dot{\lambda}}{\dot{\lambda}}, so this amounts to solving H˙a˙+H˙H˙tλ˙=0\mathchoice{\dot{H}}{\smash{\dot{H}}}{\dot{H}}{\dot{H}}\bm{\mathchoice{\dot{a}}{\smash{\dot{a}}}{\dot{a}}{\dot{a}}}+\mathchoice{\dot{H}}{\smash{\dot{H}}}{\dot{H}}{\dot{H}}\mathchoice{\dot{H}}{\smash{\dot{H}}}{\dot{H}}{\dot{H}}^{t}\mathchoice{\dot{\lambda}}{\smash{\dot{\lambda}}}{\dot{\lambda}}{\dot{\lambda}}=0, which has a unique solution λ˙\mathchoice{\dot{\lambda}}{\smash{\dot{\lambda}}}{\dot{\lambda}}{\dot{\lambda}} by surjectivity of H˙\mathchoice{\dot{H}}{\smash{\dot{H}}}{\dot{H}}{\dot{H}}. Taking δ˙=ε˙\bm{\mathchoice{\dot{\delta}}{\smash{\dot{\delta}}}{\dot{\delta}}{\dot{\delta}}}=\bm{\mathchoice{\dot{\varepsilon}}{\smash{\dot{\varepsilon}}}{\dot{\varepsilon}}{\dot{\varepsilon}}} with this value of λ˙\mathchoice{\dot{\lambda}}{\smash{\dot{\lambda}}}{\dot{\lambda}}{\dot{\lambda}} in the above derivative gives

Now differentiate in the direction of general δ\bm{\delta} with 1dH˙δ˙=δˉ=1kH^δ^\mathchoice{\tfrac{1}{d}}{\smash{\tfrac{1}{d}}}{\tfrac{1}{d}}{\tfrac{1}{d}}\mathchoice{\dot{H}}{\smash{\dot{H}}}{\dot{H}}{\dot{H}}\bm{\mathchoice{\dot{\delta}}{\smash{\dot{\delta}}}{\dot{\delta}}{\dot{\delta}}}=\mathchoice{\bar{\delta}}{\smash{\bar{\delta}}}{\bar{\delta}}{\bar{\delta}}=\mathchoice{\tfrac{1}{k}}{\smash{\tfrac{1}{k}}}{\tfrac{1}{k}}{\tfrac{1}{k}}\mathchoice{\hat{H}}{\smash{\hat{H}}}{\hat{H}}{\hat{H}}\bm{\mathchoice{\hat{\delta}}{\smash{\hat{\delta}}}{\hat{\delta}}{\hat{\delta}}}, so h+sδ∈Δ\bm{h}+s\bm{\delta}\in\bm{\Delta} for small ∣s∣|s|. Applying (22) and simplifying gives

By surjectivity we may choose δ\bm{\delta} with δˉ(σ)=ρˉ(σ)−∣M∣−1∑σ′ρˉ(σ′)\mathchoice{\bar{\delta}}{\smash{\bar{\delta}}}{\bar{\delta}}{\bar{\delta}}(\sigma)=\bar{\rho}(\sigma)-|\mathscr{M}|^{-1}\sum_{\sigma^{\prime}}\bar{\rho}(\sigma^{\prime}), and then substituting into the above we find that log⁡hˉ−λ˙−λ^\log\mathchoice{\bar{h}}{\smash{\bar{h}}}{\bar{h}}{\bar{h}}-\mathchoice{\dot{\lambda}}{\smash{\dot{\lambda}}}{\dot{\lambda}}{\dot{\lambda}}-{\mathchoice{\hat{\lambda}}{\smash{\hat{\lambda}}}{\hat{\lambda}}{\hat{\lambda}}} is a constant function of σ\sigma, that is,

On the other hand, the marginal of (22) reads

Comparing the expressions for hˉ(σ)\mathchoice{\bar{h}}{\smash{\bar{h}}}{\bar{h}}{\bar{h}}(\sigma) shows that the probability measures h˙\mathchoice{\dot{h}}{\smash{\dot{h}}}{\dot{h}}{\dot{h}} and h^\mathchoice{\hat{h}}{\smash{\hat{h}}}{\hat{h}}{\hat{h}} on M\mathscr{M} obtained by normalizing respectively eλ^(σ)\smash{e^{{\mathchoice{\hat{\lambda}}{\smash{\hat{\lambda}}}{\hat{\lambda}}{\hat{\lambda}}}(\sigma)}} and eλ˙(σ)\smash{e^{\mathchoice{\dot{\lambda}}{\smash{\dot{\lambda}}}{\dot{\lambda}}{\dot{\lambda}}(\sigma)}} must solve the Bethe recursions (18). Lastly (22) shows that h\bm{h} corresponds to h≡(h˙,h^)h\equiv(\mathchoice{\dot{h}}{\smash{\dot{h}}}{\dot{h}}{\dot{h}},\mathchoice{\hat{h}}{\smash{\hat{h}}}{\hat{h}}{\hat{h}}) via (21), concluding the proof. ∎

In view of Lem. 3.6 and our preceding discussion of Gibbs measures, Thm. 3.7 will follow by showing

Any global maximizer h\bm{h} of Φ\bm{\Phi} on Δ\bm{\Delta} must lie in the interior Δ∘\bm{\Delta}^{\circ}, and so corresponds via (21) to a solution hh of the Bethe recursions (18). (For the required surjectivity of H˙,H^\mathchoice{\dot{H}}{\smash{\dot{H}}}{\dot{H}}{\dot{H}},\mathchoice{\hat{H}}{\smash{\hat{H}}}{\hat{H}}{\hat{H}} see Lem. 6.4.)

Any such Bethe solution hh satisfies the symmetries (18), therefore reduces to a solution qq of the frozen model recursions (9). Further qq is in the regime of Lem. 3.1, which uniquely identifies h=⋆h\bm{h}={}^{\star}\bm{h}.

4. Boundary maximizers

In this section we verify (by a priori estimates) that Φ\bm{\Phi} has no maximizers on the boundary of Δ\bm{\Delta}. By Rmk. 3.3 we may work interchangeably with the frozen and auxiliary models.

Recall that Znβ\bm{Z}_{n\beta} denotes the contribution to the frozen model partition function from configurations with nβn\beta free variables.

The above is optimized at νj=pjuj/c\nu_{j}=p_{j}u^{j}/c where c≡∑jpjujc\equiv\sum_{j}p_{j}u^{j} and uu is chosen such that kβk\beta matches ∑jjνj=(∑jjpjuj)/(∑jpjuj)\smash{\sum_{j}j\nu_{j}=(\sum_{j}jp_{j}u^{j})/(\sum_{j}p_{j}u^{j})}. The latter is increasing in uu, and it is straightforward to check that it has a unique solution u=1+\nicefrac22k+O(\nicefrack4k)u=1+\mathchoice{\nicefrac{{2}}{{2^{k}}}}{\smash{\nicefrac{{2}}{{2^{k}}}}}{\nicefrac{{2}}{{2^{k}}}}{\nicefrac{{2}}{{2^{k}}}}+O(\mathchoice{\nicefrac{{k}}{{4^{k}}}}{\smash{\nicefrac{{k}}{{4^{k}}}}}{\nicefrac{{k}}{{4^{k}}}}{\nicefrac{{k}}{{4^{k}}}}). This implies c=1−\nicefrac22k+O(\nicefrack28k)c=1-\mathchoice{\nicefrac{{2}}{{2^{k}}}}{\smash{\nicefrac{{2}}{{2^{k}}}}}{\nicefrac{{2}}{{2^{k}}}}{\nicefrac{{2}}{{2^{k}}}}+O(\mathchoice{\nicefrac{{k^{2}}}{{8^{k}}}}{\smash{\nicefrac{{k^{2}}}{{8^{k}}}}}{\nicefrac{{k^{2}}}{{8^{k}}}}{\nicefrac{{k^{2}}}{{8^{k}}}}), thus

with Φ\Phi as in (2) (not depending on β\beta).

Bounds with forcing constraints. Suppose we condition on an assignment of edges such that every clause is satisfied, and no f-variables are illegally forced. Each of the mν0m\nu_{0} fully rigid clauses is forcing with probability ϑ≡\nicefrac2k(2k−2)\vartheta\equiv\mathchoice{\nicefrac{{2k}}{{(2^{k}-2)}}}{\smash{\nicefrac{{2k}}{{(2^{k}-2)}}}}{\nicefrac{{2k}}{{(2^{k}-2)}}}{\nicefrac{{2k}}{{(2^{k}-2)}}}, and mν0m\nu_{0} is clearly sandwiched between mm and mˊ≡m(1−kβ)\acute{m}\equiv m(1-k\beta), therefore

For α=[1+O(2−k/3)] ϑ\alpha=[1+O(2^{-k/3})]\,\vartheta we have

the same estimate holds with mˊ,yˊ\acute{m},\acute{y} in place of m,ym,y. Applying Lem. 3.8 then gives

This is clearly optimized with 2k+1β≈12^{k+1}\beta\approx 1, and estimating the second derivative of the exponent with respect to β\beta implies the result. ∎

Lem. 3.9 shows that the maximum cannot be obtained on the boundary β=βmax⁡\beta=\beta_{\max}, so it remains to show that the maximizer must be a strictly positive measure on supp⁡φ\operatorname{supp}\varphi. For δ≡(δ˙,δ^)\bm{\delta}\equiv(\bm{\mathchoice{\dot{\delta}}{\smash{\dot{\delta}}}{\dot{\delta}}{\dot{\delta}}},\bm{\mathchoice{\hat{\delta}}{\smash{\hat{\delta}}}{\hat{\delta}}{\hat{\delta}}}) such that h+tδ\bm{h}+t\bm{\delta} lies in Δ\bm{\Delta} for t≥0t\geq 0 small, consider

To show that h∈Δ\bm{h}\in\bm{\Delta} is not a maximizer it suffices to exhibit TΦ(h;δ)>0\mathbf{T}\bm{\Phi}(\bm{h};\bm{\delta})>0 for some δ\bm{\delta}. In particular, it follows by convexity that for any h∈Δ\bm{h}\in\bm{\Delta}, h+t(⋆h−h)∈Δ∘\bm{h}+t({}^{\star}\bm{h}-\bm{h})\in\bm{\Delta}^{\circ} for t>0t>0 small and ⋆h{}^{\star}\bm{h} as in the statement of Thm. 3.7. Therefore, if h\bm{h} is a maximizer such that the edge marginal has full support supp⁡hˉ=M\operatorname{supp}\mathchoice{\bar{h}}{\smash{\bar{h}}}{\bar{h}}{\bar{h}}=\mathscr{M}, then necessarily supp⁡h=supp⁡φ\operatorname{supp}\bm{h}=\operatorname{supp}\varphi, since otherwise TΦ(h;⋆h−h)>0\mathbf{T}\bm{\Phi}(\bm{h};{}^{\star}\bm{h}-\bm{h})>0.

Clearly the same argument applies replacing 0 with 1. In each case the conclusion contradicts the assumption that h\bm{h} is a maximizer, concluding the proof.In our setting we have checked supp⁡hˉ=M\operatorname{supp}\mathchoice{\bar{h}}{\smash{\bar{h}}}{\bar{h}}{\bar{h}}=\mathscr{M} in a rather ad hoc manner. A simpler argument applies generally to any specification φ\varphi which is everywhere positive on Md\mathscr{M}^{d}, Mk\mathscr{M}^{k}: if σ∉supp⁡hˉ\sigma\notin\operatorname{supp}\mathchoice{\bar{h}}{\smash{\bar{h}}}{\bar{h}}{\bar{h}} then take σˊ∈supp⁡hˉ\acute{\sigma}\in\operatorname{supp}\mathchoice{\bar{h}}{\smash{\bar{h}}}{\bar{h}}{\bar{h}}, and observe that TΦ(h;δ)>0\mathbf{T}\bm{\Phi}(\bm{h};\bm{\delta})>0 for δ\bm{\delta} defined by δ˙=1(σ,σˊd−1)−1(σˊd)\bm{\mathchoice{\dot{\delta}}{\smash{\dot{\delta}}}{\dot{\delta}}{\dot{\delta}}}=\mathbf{1}_{(\sigma,\acute{\sigma}^{d-1})}-\mathbf{1}_{(\acute{\sigma}^{d})}, (\nicefracdk)δ^=1(σ,σˊk−1)−1(σˊk)(\mathchoice{\nicefrac{{d}}{{k}}}{\smash{\nicefrac{{d}}{{k}}}}{\nicefrac{{d}}{{k}}}{\nicefrac{{d}}{{k}}})\bm{\mathchoice{\hat{\delta}}{\smash{\hat{\delta}}}{\hat{\delta}}{\hat{\delta}}}=\mathbf{1}_{(\sigma,\acute{\sigma}^{k-1})}-\mathbf{1}_{(\acute{\sigma}^{k})}. ∎

5. Bethe recursion symmetries

Suppose h\bm{h} is an interior maximizer for Φ\bm{\Phi} on Δ\bm{\Delta}, and so corresponds to a Bethe solution hh. Let Tˊd,k\acute{T}_{d,k} denote Td,kT_{d,k} with a subtree incident to the root removed, leaving an unmatched half-edge eˊ\acute{e} incident to oo (Fig. 2). Consider defining a Gibbs measure on Tˊd,k\acute{T}_{d,k} in the manner of (16), with boundary law given by the Bethe solution hh. Then the marginal law of σeˊ\sigma_{\acute{e}} will be h˙\mathchoice{\dot{h}}{\smash{\dot{h}}}{\dot{h}}{\dot{h}}, and the marginal law of the tuple of spins incident to any given vertex will be h˙\bm{\mathchoice{\dot{h}}{\smash{\dot{h}}}{\dot{h}}{\dot{h}}} if the vertex is a variable, h^\bm{\mathchoice{\hat{h}}{\smash{\hat{h}}}{\hat{h}}{\hat{h}}} if it is a clause. Further, the Gibbs measure on Tˊd,k\acute{T}_{d,k} can be generated in Markovian fashion, starting with spin σeˊ\sigma_{\acute{e}} distributed according to h˙\mathchoice{\dot{h}}{\smash{\dot{h}}}{\dot{h}}{\dot{h}}, generating the messages on the other d−1d-1 edges incident to oo according to the conditional measure h˙(σ˙‾ ∣ σ1=σeˊ)\bm{\mathchoice{\dot{h}}{\smash{\dot{h}}}{\dot{h}}{\dot{h}}}(\underline{\smash{\mathchoice{\dot{\sigma}}{\smash{\dot{\sigma}}}{\dot{\sigma}}{\dot{\sigma}}}}\,|\,\sigma_{1}=\sigma_{\acute{e}}), and continuing iteratively down the tree.

The effect of changing uˊυˋ\smash{\acute{\bm{u}}}\smash{\grave{\bm{\upsilon}}} from ff to f0 can only propagate through clauses in which the parent variable and exactly one descendant variable send message f, and the evaluation of the remaining k−2k-2 messages under the clause literals is identically 0 or 1. The vertex-preceding edges of Tˊd,k\acute{T}_{d,k} whose spins will be affected by changing υˋ\smash{\grave{\bm{\upsilon}}} from f to 0 form a branching process with mean

where the intermediate step follows from (21). Similarly, the effect of changing uˊυˋ\smash{\acute{\bm{u}}}\smash{\grave{\bm{\upsilon}}} from f0 to ff can only propagate through clauses in which exactly one descendant variable sends message f, and the evaluation of the remaining k−1k-1 messages under the clause literals is identically 0 or 1. This forms a branching process with mean

6. Explicit form of first moment exponent

We conclude this section by giving the explicit form of ⋆Φ≡⋆Φk(d){}^{\star}\bm{\Phi}\equiv{}^{\star}\bm{\Phi}_{k}(d).

with d□d_{\square} the first moment threshold of the original nae-sat partition function (3).

Let us now see that ⋆Φ{}^{\star}\bm{\Phi} is strictly decreasing in dd. Recalling (30) that v=Q/(1−Q)v=Q/(1-Q), we find

and rearranging gives (27). This can be expressed as a function of qq alone by taking Q=Q(q)Q=Q(q) as in (30) and d=d(q)d=d(q) as in (28). With DqD_{q} denoting differentiation in qq, we calculate

The total derivative of ⋆Φ≡⋆Φ(d(q)){}^{\star}\bm{\Phi}\equiv{}^{\star}\bm{\Phi}(d(q)) with respect to qq is then straightforward to calculate: the main contribution comes from

Second moment of auxiliary model

In this subsection we complete our analysis of the near-independent regime 2⋆Δ{}^{\star}_{2}\bm{\Delta} to prove

The unique global maximizer of the restriction of 2Φ{}_{2}\bm{\Phi} to 2⋆Δ{}^{\star}_{2}\bm{\Delta} is 2⋆h{}^{\star}_{2}\bm{h}.

Note that H(π)H(\pi) is maximized at α=\nicefrac12\alpha=\mathchoice{\nicefrac{{1}}{{2}}}{\smash{\nicefrac{{1}}{{2}}}}{\nicefrac{{1}}{{2}}}{\nicefrac{{1}}{{2}}}, therefore

From the above estimates on the ν‾j\overline{\nu}_{j} we find

Combining these estimates and recalling Φ=log⁡2+(\nicefracdk)log⁡(1−\nicefrac22k)\Phi=\log 2+(\mathchoice{\nicefrac{{d}}{{k}}}{\smash{\nicefrac{{d}}{{k}}}}{\nicefrac{{d}}{{k}}}{\nicefrac{{d}}{{k}}})\log(1-\mathchoice{\nicefrac{{2}}{{2^{k}}}}{\smash{\nicefrac{{2}}{{2^{k}}}}}{\nicefrac{{2}}{{2^{k}}}}{\nicefrac{{2}}{{2^{k}}}}) from (2) gives

Recalling (23) gives the two upper bounds

Any global maximizer of 2Φ{}_{2}\bm{\Phi} on 2⋆Δ{}^{\star}_{2}\bm{\Delta} must be an interior stationary point.

It follows by symmetry considerations that supp⁡hˉ=M2\operatorname{supp}\mathchoice{\bar{h}}{\smash{\bar{h}}}{\bar{h}}{\bar{h}}=\mathscr{M}^{2}, hence any maximizer h\bm{h} of 2Φ{}_{2}\bm{\Phi} must be positive on supp⁡φ\operatorname{supp}\varphi since otherwise T2Φ(h;2⋆h−h)\mathbf{T}_{2}\bm{\Phi}(\bm{h};{}^{\star}_{2}\bm{h}-\bm{h}) would be positive. ∎

The variable recursions are (with c˙\mathchoice{\dot{c}}{\smash{\dot{c}}}{\dot{c}}{\dot{c}} the normalizing constant)

Writing Q≡(q/2)k−1Q\equiv(q/2)^{k-1}, Qˊ≡(qˊ/2)k−1\acute{Q}\equiv(\acute{q}/2)^{k-1}, and Q⋆≡(q˙⋆/2)k−1Q^{\star}\equiv(\mathchoice{\dot{q}}{\smash{\dot{q}}}{\dot{q}}{\dot{q}}^{\star}/2)^{k-1}, we have

By assumption, x≡2k(∣q−q˙⋆∣+∣qˊ−q˙⋆∣)≲1x\equiv 2^{k}(|q-\mathchoice{\dot{q}}{\smash{\dot{q}}}{\dot{q}}{\dot{q}}^{\star}|+|\acute{q}-\mathchoice{\dot{q}}{\smash{\dot{q}}}{\dot{q}}{\dot{q}}^{\star}|)\lesssim 1, so Q+O(xk4k)=Q⋆=Qˊ+O(xk4k)Q+O(x\mathchoice{\tfrac{k}{4^{k}}}{\smash{\tfrac{k}{4^{k}}}}{\tfrac{k}{4^{k}}}{\tfrac{k}{4^{k}}})=Q^{\star}=\acute{Q}+O(x\mathchoice{\tfrac{k}{4^{k}}}{\smash{\tfrac{k}{4^{k}}}}{\tfrac{k}{4^{k}}}{\tfrac{k}{4^{k}}}) and consequently Wd−1[1+O(xdk4k)]=(W⋆)d−1W^{d-1}[1+O(x\mathchoice{\tfrac{dk}{4^{k}}}{\smash{\tfrac{dk}{4^{k}}}}{\tfrac{dk}{4^{k}}}{\tfrac{dk}{4^{k}}})]=(W^{\star})^{d-1}. It follows that

implying that the recursion contracts to x=0x=0, q=qˊ=q˙⋆q=\acute{q}=\mathchoice{\dot{q}}{\smash{\dot{q}}}{\dot{q}}{\dot{q}}^{\star} as claimed. ∎

Estimates on messages. The number of clauses incident to any variable which are free in either coordinate is ≲mk2k\lesssim m\mathchoice{\tfrac{k}{2^{k}}}{\smash{\tfrac{k}{2^{k}}}}{\tfrac{k}{2^{k}}}{\tfrac{k}{2^{k}}}, while an easy a priori estimate implies that the number of fully-rigid clauses which are non-forcing is ≍m\asymp m. Recalling (21) then gives

where the last inequality follows because all the φ^2\mathchoice{\hat{\varphi}}{\smash{\hat{\varphi}}}{\hat{\varphi}}{\hat{\varphi}}_{2} factor weights involved in the application of (21) are 1−O(k2k)1-O(\mathchoice{\tfrac{k}{2^{k}}}{\smash{\tfrac{k}{2^{k}}}}{\tfrac{k}{2^{k}}}{\tfrac{k}{2^{k}}}).

where the last step uses the assumption that h\bm{h} lies in 2⋆Δ{}^{\star}_{2}\bm{\Delta}.

2. A priori rigidity estimate

Recalling Lem. 4.2, let 2⋅⋅Z{}^{\cdot\cdot}_{2}\bm{Z} denote the contribution to Z2\bm{Z}^{2} from the near-identical regime h∈2⋅⋅Δ\bm{h}\in{}^{\cdot\cdot}_{2}\bm{\Delta}. In this subsection we prove

(where 0<α<10<\alpha<1 may be arbitrarily chosen). We therefore bound

where we have used the trivial inequality H(x)+xlog⁡c≤log⁡(1+c)≤cH(x)+x\log c\leq\log(1+c)\leq c. Recall ε≲2−k/2\varepsilon\lesssim 2^{-k/2} by assumption, and γ≤k2/2k/2\gamma\leq k^{2}/2^{k/2} by the restriction to ΩB\Omega_{B}, therefore

Crudely bounding a~v≤d\widetilde{\text{{a}}}_{v}\leq d, there exists a uniform constant CC such that

Again recalling H(x)+xlog⁡c≤log⁡(1+c)≤cH(x)+x\log c\leq\log(1+c)\leq c we bound

Follows by combining Propns. 4.3 and 4.7. ∎

Negative-definiteness of free energy Hessians

The Hessians HΦ(⋆h)H\bm{\Phi}({}^{\star}\bm{h}) and H2Φ(2⋆h)H_{2}\bm{\Phi}({}^{\star}_{2}\bm{h}) are negative-definite.

Let h∈Δ∘\bm{h}\in\bm{\Delta}^{\circ} with h˙\bm{\mathchoice{\dot{h}}{\smash{\dot{h}}}{\dot{h}}{\dot{h}}} and h^\bm{\mathchoice{\hat{h}}{\smash{\hat{h}}}{\hat{h}}{\hat{h}}} both symmetric, and let δ\bm{\delta} be any signed measure on supp⁡φ\operatorname{supp}\varphi (not necessarily symmetric) with h+sδ∈Δ∘\bm{h}+s\bm{\delta}\in\bm{\Delta}^{\circ} for sufficiently small ∣s∣|s|. Then

where a/ba/b denotes the vector given by coordinate-wise division of aa by bb, and ⟨⋅⟩h\langle\cdot\rangle_{h} denotes integration with respect to measure hh, e.g. ⟨(δˉ/hˉ)2⟩hˉ=∑σδ(σ)2/hˉ(σ)\langle(\mathchoice{\bar{\delta}}{\smash{\bar{\delta}}}{\bar{\delta}}{\bar{\delta}}/\mathchoice{\bar{h}}{\smash{\bar{h}}}{\bar{h}}{\bar{h}})^{2}\rangle_{\mathchoice{\bar{h}}{\smash{\bar{h}}}{\bar{h}}{\bar{h}}}=\sum_{\sigma}\bm{\delta}(\sigma)^{2}/\mathchoice{\bar{h}}{\smash{\bar{h}}}{\bar{h}}{\bar{h}}(\sigma).

Given fixed marginals δˉ\mathchoice{\bar{\delta}}{\smash{\bar{\delta}}}{\bar{\delta}}{\bar{\delta}}, ⟨(δ˙/h˙)2⟩h˙\langle(\bm{\mathchoice{\dot{\delta}}{\smash{\dot{\delta}}}{\dot{\delta}}{\dot{\delta}}}/\bm{\mathchoice{\dot{h}}{\smash{\dot{h}}}{\dot{h}}{\dot{h}}})^{2}\rangle_{\bm{\mathchoice{\dot{h}}{\smash{\dot{h}}}{\dot{h}}{\dot{h}}}} is minimized by δ˙(σ˙‾)=h˙(σ˙‾)1d∑i=1dχ˙σi\bm{\mathchoice{\dot{\delta}}{\smash{\dot{\delta}}}{\dot{\delta}}{\dot{\delta}}}(\underline{\smash{\mathchoice{\dot{\sigma}}{\smash{\dot{\sigma}}}{\dot{\sigma}}{\dot{\sigma}}}})=\bm{\mathchoice{\dot{h}}{\smash{\dot{h}}}{\dot{h}}{\dot{h}}}(\underline{\smash{\mathchoice{\dot{\sigma}}{\smash{\dot{\sigma}}}{\dot{\sigma}}{\dot{\sigma}}}})\mathchoice{\tfrac{1}{d}}{\smash{\tfrac{1}{d}}}{\tfrac{1}{d}}{\tfrac{1}{d}}\sum_{i=1}^{d}\mathchoice{\dot{\chi}}{\smash{\dot{\chi}}}{\dot{\chi}}{\dot{\chi}}_{\sigma_{i}} with χ˙\mathchoice{\dot{\chi}}{\smash{\dot{\chi}}}{\dot{\chi}}{\dot{\chi}} chosen to satisfy the margin constraint — which, after a little algebra, becomes the vector equation Hˉ−1δˉ=d−1[I+(d−1)M˙]χ˙\mathchoice{\bar{H}}{\smash{\bar{H}}}{\bar{H}}{\bar{H}}^{-1}\mathchoice{\bar{\delta}}{\smash{\bar{\delta}}}{\bar{\delta}}{\bar{\delta}}=d^{-1}[I+(d-1)\mathchoice{\dot{M}}{\smash{\dot{M}}}{\dot{M}}{\dot{M}}]\mathchoice{\dot{\chi}}{\smash{\dot{\chi}}}{\dot{\chi}}{\dot{\chi}} where Hˉ≡diag⁡(hˉ)\mathchoice{\bar{H}}{\smash{\bar{H}}}{\bar{H}}{\bar{H}}\equiv\operatorname{diag}(\mathchoice{\bar{h}}{\smash{\bar{h}}}{\bar{h}}{\bar{h}}) and M˙\mathchoice{\dot{M}}{\smash{\dot{M}}}{\dot{M}}{\dot{M}} denotes the stochastic matrix

If such χ˙\mathchoice{\dot{\chi}}{\smash{\dot{\chi}}}{\dot{\chi}}{\dot{\chi}} exists, then the minimal value of ⟨(δ˙/h˙)2⟩h˙\langle(\bm{\mathchoice{\dot{\delta}}{\smash{\dot{\delta}}}{\dot{\delta}}{\dot{\delta}}}/\bm{\mathchoice{\dot{h}}{\smash{\dot{h}}}{\dot{h}}{\dot{h}}})^{2}\rangle_{\bm{\mathchoice{\dot{h}}{\smash{\dot{h}}}{\dot{h}}{\dot{h}}}} subject to marginals δˉ\mathchoice{\bar{\delta}}{\smash{\bar{\delta}}}{\bar{\delta}}{\bar{\delta}} is ⟨δˉ,χ˙⟩\langle\mathchoice{\bar{\delta}}{\smash{\bar{\delta}}}{\bar{\delta}}{\bar{\delta}},\mathchoice{\dot{\chi}}{\smash{\dot{\chi}}}{\dot{\chi}}{\dot{\chi}}\rangle. Define analogously the stochastic matrix M^\mathchoice{\hat{M}}{\smash{\hat{M}}}{\hat{M}}{\hat{M}} corresponding to h^\bm{\mathchoice{\hat{h}}{\smash{\hat{h}}}{\hat{h}}{\hat{h}}}: if both L˙≡I+(d−1)M˙\mathchoice{\dot{L}}{\smash{\dot{L}}}{\dot{L}}{\dot{L}}\equiv I+(d-1)\mathchoice{\dot{M}}{\smash{\dot{M}}}{\dot{M}}{\dot{M}} and L^≡I+(k−1)M^\mathchoice{\hat{L}}{\smash{\hat{L}}}{\hat{L}}{\hat{L}}\equiv I+(k-1)\mathchoice{\hat{M}}{\smash{\hat{M}}}{\hat{M}}{\hat{M}} are non-singular, then the maximum of k ∂η2Φ(h+ηδ)∣η=0k\,\partial_{\eta}^{2}\bm{\Phi}(\bm{h}+\eta\bm{\delta})|_{\eta=0} over all δ\bm{\delta} with marginal δˉ\mathchoice{\bar{\delta}}{\smash{\bar{\delta}}}{\bar{\delta}}{\bar{\delta}} is given by

where F≡(Hˉ1/2L˙Hˉ−1/2)−1+(Hˉ1/2L^Hˉ−1/2)−1−IF\equiv(\mathchoice{\bar{H}}{\smash{\bar{H}}}{\bar{H}}{\bar{H}}^{1/2}\mathchoice{\dot{L}}{\smash{\dot{L}}}{\dot{L}}{\dot{L}}\mathchoice{\bar{H}}{\smash{\bar{H}}}{\bar{H}}{\bar{H}}^{-1/2})^{-1}+(\mathchoice{\bar{H}}{\smash{\bar{H}}}{\bar{H}}{\bar{H}}^{1/2}\mathchoice{\hat{L}}{\smash{\hat{L}}}{\hat{L}}{\hat{L}}\mathchoice{\bar{H}}{\smash{\bar{H}}}{\bar{H}}{\bar{H}}^{-1/2})^{-1}-I. It is clear from (37) that M˙\mathchoice{\dot{M}}{\smash{\dot{M}}}{\dot{M}}{\dot{M}} and M^\mathchoice{\hat{M}}{\smash{\hat{M}}}{\hat{M}}{\hat{M}} are hˉ\mathchoice{\bar{h}}{\smash{\bar{h}}}{\bar{h}}{\bar{h}}-reversible, therefore FF is symmetric. Since ∑σδˉ(σ)=0\sum_{\sigma}\mathchoice{\bar{\delta}}{\smash{\bar{\delta}}}{\bar{\delta}}{\bar{\delta}}(\sigma)=0 we consider only the action F′F^{\prime} of FF on the space of vectors orthogonal to hˉ1/2\mathchoice{\bar{h}}{\smash{\bar{h}}}{\bar{h}}{\bar{h}}^{1/2}. At a global maximizer we know F′F^{\prime} to be negative-semidefinite, so if det⁡F≠0\det F\neq 0 then it is in fact negative-definite. Thus let M˙\mathchoice{\dot{M}}{\smash{\dot{M}}}{\dot{M}}{\dot{M}}, M^\mathchoice{\hat{M}}{\smash{\hat{M}}}{\hat{M}}{\hat{M}}, M˙2\mathchoice{\dot{M}}{\smash{\dot{M}}}{\dot{M}}{\dot{M}}_{2}, M^2\mathchoice{\hat{M}}{\smash{\hat{M}}}{\hat{M}}{\hat{M}}_{2} denote the Markov transition matrices corresponding (via (37)) to ⋆h˙{}^{\star}\bm{\mathchoice{\dot{h}}{\smash{\dot{h}}}{\dot{h}}{\dot{h}}}, ⋆h^{}^{\star}\bm{\mathchoice{\hat{h}}{\smash{\hat{h}}}{\hat{h}}{\hat{h}}}, 2⋆h˙{}^{\star}_{2}\bm{\mathchoice{\dot{h}}{\smash{\dot{h}}}{\dot{h}}{\dot{h}}}, 2⋆h^{}^{\star}_{2}\bm{\mathchoice{\hat{h}}{\smash{\hat{h}}}{\hat{h}}{\hat{h}}} respectively. In §5.2 we will prove that the matrices

are all non-singular. Propn. 5.1 then follows by noting that F=Hˉ1/2L˙−1LL^−1Hˉ−1/2F=\mathchoice{\bar{H}}{\smash{\bar{H}}}{\bar{H}}{\bar{H}}^{1/2}\mathchoice{\dot{L}}{\smash{\dot{L}}}{\dot{L}}{\dot{L}}^{-1}L\mathchoice{\hat{L}}{\smash{\hat{L}}}{\hat{L}}{\hat{L}}^{-1}\mathchoice{\bar{H}}{\smash{\bar{H}}}{\bar{H}}{\bar{H}}^{-1/2}.

2. Calculation of transition matrices

The eigenvalues of M˙\mathchoice{\dot{M}}{\smash{\dot{M}}}{\dot{M}}{\dot{M}} counted with geometric multiplicity are

The matrix M˙2\mathchoice{\dot{M}}{\smash{\dot{M}}}{\dot{M}}{\dot{M}}_{2} is given by M˙⊗M˙\mathchoice{\dot{M}}{\smash{\dot{M}}}{\dot{M}}{\dot{M}}\otimes\mathchoice{\dot{M}}{\smash{\dot{M}}}{\dot{M}}{\dot{M}}; consequently both L˙\mathchoice{\dot{L}}{\smash{\dot{L}}}{\dot{L}}{\dot{L}} and L˙2\mathchoice{\dot{L}}{\smash{\dot{L}}}{\dot{L}}{\dot{L}}_{2} are non-singular.

which has eigen(m˙)=(1,ab1/2,−ab1/2)\text{{{eigen}}}(\mathchoice{\dot{\mathfrak{m}}}{\smash{\dot{\mathfrak{m}}}}{\dot{\mathfrak{m}}}{\dot{\mathfrak{m}}})=(1,ab^{1/2},-ab^{1/2}). Thus eigen(M˙)=(1,eigen(m˙),eigen(m˙))\text{{{eigen}}}(\mathchoice{\dot{M}}{\smash{\dot{M}}}{\dot{M}}{\dot{M}})=(1,\text{{{eigen}}}(\mathchoice{\dot{\mathfrak{m}}}{\smash{\dot{\mathfrak{m}}}}{\dot{\mathfrak{m}}}{\dot{\mathfrak{m}}}),\text{{{eigen}}}(\mathchoice{\dot{\mathfrak{m}}}{\smash{\dot{\mathfrak{m}}}}{\dot{\mathfrak{m}}}{\dot{\mathfrak{m}}})) is as stated above. Since 2⋆h=⋆h⊗⋆h{}^{\star}_{2}\bm{h}={}^{\star}\bm{h}\otimes{}^{\star}\bm{h}, clearly M˙2=M˙⊗M˙\mathchoice{\dot{M}}{\smash{\dot{M}}}{\dot{M}}{\dot{M}}_{2}=\mathchoice{\dot{M}}{\smash{\dot{M}}}{\dot{M}}{\dot{M}}\otimes\mathchoice{\dot{M}}{\smash{\dot{M}}}{\dot{M}}{\dot{M}}, so the lemma is proved. ∎

The matrices LL and L2L_{2} are non-singular.

For A⊆MA\subseteq\mathscr{M} write hˉA≡(hˉ1A)/hˉ(A)\mathchoice{\bar{h}}{\smash{\bar{h}}}{\bar{h}}{\bar{h}}_{A}\equiv(\mathchoice{\bar{h}}{\smash{\bar{h}}}{\bar{h}}{\bar{h}}\mathbf{1}_{A})/\mathchoice{\bar{h}}{\smash{\bar{h}}}{\bar{h}}{\bar{h}}(A), the stationary distribution hˉ\mathchoice{\bar{h}}{\smash{\bar{h}}}{\bar{h}}{\bar{h}} conditioned on AA. The vectors

therefore ∥w2tS˙S^∥/∥w2∥=∥(u2tM˙M^)/hˉ1/2∥/∥w2∥≍2−k/2\|w_{2}^{t}\mathchoice{\dot{S}}{\smash{\dot{S}}}{\dot{S}}{\dot{S}}\mathchoice{\hat{S}}{\smash{\hat{S}}}{\hat{S}}{\hat{S}}\|/\|w_{2}\|=\|(u_{2}^{t}\mathchoice{\dot{M}}{\smash{\dot{M}}}{\dot{M}}{\dot{M}}\mathchoice{\hat{M}}{\smash{\hat{M}}}{\hat{M}}{\hat{M}})/\mathchoice{\bar{h}}{\smash{\bar{h}}}{\bar{h}}{\bar{h}}^{1/2}\|/\|w_{2}\|\asymp 2^{-k/2}. It follows that M˙M^\mathchoice{\dot{M}}{\smash{\dot{M}}}{\dot{M}}{\dot{M}}\mathchoice{\hat{M}}{\smash{\hat{M}}}{\hat{M}}{\hat{M}} (equivalently S˙S^\mathchoice{\dot{S}}{\smash{\dot{S}}}{\dot{S}}{\dot{S}}\mathchoice{\hat{S}}{\smash{\hat{S}}}{\hat{S}}{\hat{S}}) can have no eigenvalue with absolute value ≍1/(dk)\asymp 1/(dk), hence LL is non-singular.

For 1≤i,j≤31\leq i,j\leq 3 let wij≡wi⊗wjw_{ij}\equiv w_{i}\otimes w_{j}, and note that if ww is orthogonal to the span of (w11,w12,w21)(w_{11},w_{12},w_{21}) then ∥wtS˙2S^2∥=O(2−3k/2)∥w∥\|w^{t}\mathchoice{\dot{S}}{\smash{\dot{S}}}{\dot{S}}{\dot{S}}_{2}\mathchoice{\hat{S}}{\smash{\hat{S}}}{\hat{S}}{\hat{S}}_{2}\|=O(2^{-3k/2})\|w\|. Next note that

so ∥w12tS˙2S^2∥/∥w12∥=∥w2tS^∥/∥w2∥≍2−k/2\|w_{12}^{t}\mathchoice{\dot{S}}{\smash{\dot{S}}}{\dot{S}}{\dot{S}}_{2}\mathchoice{\hat{S}}{\smash{\hat{S}}}{\hat{S}}{\hat{S}}_{2}\|/\|w_{12}\|=\|w_{2}^{t}\mathchoice{\hat{S}}{\smash{\hat{S}}}{\hat{S}}{\hat{S}}\|/\|w_{2}\|\asymp 2^{-k/2}. Since w12S˙2S^2w_{12}\mathchoice{\dot{S}}{\smash{\dot{S}}}{\dot{S}}{\dot{S}}_{2}\mathchoice{\hat{S}}{\smash{\hat{S}}}{\hat{S}}{\hat{S}}_{2} and w21S˙2S^2w_{21}\mathchoice{\dot{S}}{\smash{\dot{S}}}{\dot{S}}{\dot{S}}_{2}\mathchoice{\hat{S}}{\smash{\hat{S}}}{\hat{S}}{\hat{S}}_{2} are orthogonal,

As shown in §5.1 the result follows by verifying that the matrices defined in (38) are non-singular, which is done by the lemmas of §5.2. ∎

In the pair partition function Z2\bm{Z}^{2}, let 2⋆Z{}^{\star}_{2}\bm{Z} denote the contribution from (non-normalized) measures 2g{}_{2}\bm{g} within euclidean distance n1/2log⁡n\smash{n^{1/2}\log n} of the independent-copies local maximizer 2⋆g=⋆g⊗⋆g{}^{\star}_{2}{\bm{g}}={}^{\star}{\bm{g}}\otimes{}^{\star}{\bm{g}}. Recall from the statement of Lem. 4.2 that 2⋅⋅Z{}^{\cdot\cdot}_{2}\bm{Z} denotes the contribution to Z2\bm{Z}^{2} from the near-identical measures 2⋅⋅Δ{}^{\cdot\cdot}_{2}\bm{\Delta}. Decompose

From constant to high probability

As in the proof of Thm. 2, ⋆Z{}^{\star}\bm{Z} denotes the contribution to the auxiliary model partition function on (G,L‾)(G,\underline{\smash{L}}) from configurations whose non-normalized empirical measure g≡(nh˙,mh^){\bm{g}}\equiv(n\bm{\mathchoice{\dot{h}}{\smash{\dot{h}}}{\dot{h}}{\dot{h}}},m\bm{\mathchoice{\hat{h}}{\smash{\hat{h}}}{\hat{h}}{\hat{h}}}) lies within euclidean distance n1/2log⁡nn^{1/2}\log n of ⋆g{}^{\star}{\bm{g}}. The main result of this section is the following

The proposition easily implies the following strengthened statement of Thm. 3a:

Taking n→∞n\to\infty followed by ε↓0\varepsilon\downarrow 0 proves the theorem. ∎

Consider forming the graph GG by beginning with nn vertices each incident to dd half-edges, and choosing, for 1≤i≤m1\leq i\leq m, a random set of kk unmatched half-edges to be joined into the ii-th clause aia_{i} (every clause comes with literals). Let F≡(Fi)0≤i≤m\mathscr{F}\equiv(\mathscr{F}_{i})_{0\leq i\leq m} denote the associated filtration; to prove Propn. 6.1 we will control the increments of the Doob martingale of Lε\mathbf{L}^{\varepsilon} with respect to F\mathscr{F}:

Note the term i=mi=m is zero, since there is no randomness left when only two unmatched half-edges remain. Since a maximum of kk clauses will use any subset of the half-edges of size kk, the random graph G ∣ FiG\,|\,\mathscr{F}_{i} can be coupled with G ∣ Fi−1G\,|\,\mathscr{F}_{i-1} such that the graphs differ only in the placement of clauses on k2k^{2} half-edges. Therefore

Let ii be fixed, and note that since (a−b)/a≤log⁡(a/b)≤(a−b)/b(a-b)/a\leq\log(a/b)\leq(a-b)/b for any a,b>0a,b>0,

Consider the graph G∘G^{\circ}, with its unmatched half-edges partitioned into disjoint subsets K\mathscr{K} and W\mathscr{W}. We shall define a certain local neighborhood TT of the half-edges in K\mathscr{K}, such that G∂≡G∘\TG^{\partial}\equiv G^{\circ}\backslash T is a graph with unmatched half-edges in disjoint sets W\mathscr{W} (as before) and U\mathscr{U} (leaves of TT without W\mathscr{W}); see Fig. 3.Each unmatched half-edge is incident to a variable, and does not include a clause. Then, writing Y≡U∪W\mathscr{Y}\equiv\mathscr{U}\cup\mathscr{W}, we decompose

where ΨW\Psi_{W} is the partition function on WW, ⋆Z∂[σ‾Y]{}^{\star}\bm{Z}^{\partial}[{\underline{\smash{\sigma}}}_{\mathscr{Y}}] is the partition function on G∂G^{\partial} given boundary conditions σ‾Y{\underline{\smash{\sigma}}}_{\mathscr{Y}}, κ(σ‾U)≡κT(σ‾U∣σ‾W)\kappa({\underline{\smash{\sigma}}}_{\mathscr{U}})\equiv\kappa_{T}({\underline{\smash{\sigma}}}_{\mathscr{U}}|{\underline{\smash{\sigma}}}_{\mathscr{W}}) is the partition function on T∪AT\cup A given boundary conditions σ‾Y{\underline{\smash{\sigma}}}_{\mathscr{Y}}, and κˊ(σ‾U)≡κˊT(σ‾U∣σ‾W)\smash{\acute{\kappa}({\underline{\smash{\sigma}}}_{\mathscr{U}})\equiv\acute{\kappa}_{T}({\underline{\smash{\sigma}}}_{\mathscr{U}}|{\underline{\smash{\sigma}}}_{\mathscr{W}})} is the partition function on T∪AˊT\cup\acute{A} given boundary conditions σ‾Y{\underline{\smash{\sigma}}}_{\mathscr{Y}}. Averaging over WW and squaring gives

W\mathscr{W} can only intersect TT in its leaves; and we shall let U\mathscr{U} denote the leaves of TT without W\mathscr{W}.

so we shall bound (45) by projection onto a Fourier basis for L2(M2U,p)L^{2}(\mathscr{M}^{2\mathscr{U}},\bm{p}): take (b1,…,b∣M∣)(\bm{b}_{1},\ldots,\bm{b}_{|\mathscr{M}|}) to be an orthonormal basis for L2(M,h˙)L^{2}(\mathscr{M},\mathchoice{\dot{h}}{\smash{\dot{h}}}{\dot{h}}{\dot{h}}) with b1≡1\bm{b}_{1}\equiv 1. Then the functions bs‾(σ‾U)≡∏u∈Ubs(u)(σu)\bm{b}_{\underline{\smash{s}}}({\underline{\smash{\sigma}}}_{\mathscr{U}})\equiv\prod_{u\in\mathscr{U}}\bm{b}_{s(u)}(\sigma_{u}) (s‾∈[∣M∣]U\underline{\smash{s}}\in[|\mathscr{M}|]^{\mathscr{U}}) form an orthonormal basis for L2(MU,p)L^{2}(\mathscr{M}^{\mathscr{U}},\bm{p}), and the functions bs‾1,s‾2(τ‾U)≡bs‾1(σ‾U1)bs‾2(σ‾U1)\bm{b}_{\underline{\smash{s}}^{1},\underline{\smash{s}}^{2}}({\underline{\smash{\tau}}}_{\mathscr{U}})\equiv\bm{b}_{\underline{\smash{s}}^{1}}({\underline{\smash{\sigma}}}^{1}_{\mathscr{U}})\bm{b}_{\underline{\smash{s}}^{2}}({\underline{\smash{\sigma}}}^{1}_{\mathscr{U}}) form an orthonormal basis for L2(M2U,p)L^{2}(\mathscr{M}^{2\mathscr{U}},\bm{p}). By Plancherel’s identity,

where ∧ indicates the Fourier transform with respect to the basis b\bm{b}, and

2. Expansion of partition function

On the graph G∂G^{\partial} we now analyze the partition function ⋆Z∂[σ‾Y]{}^{\star}\bm{Z}^{\partial}[{\underline{\smash{\sigma}}}_{\mathscr{Y}}] and its marginals

It is more convenient here to work with the non-normalized tuple empirical measures g≡(g˙,g^)≡(nh˙,mh^){\bm{g}}\equiv(\bm{\mathchoice{\dot{g}}{\smash{\dot{g}}}{\dot{g}}{\dot{g}}},\bm{\mathchoice{\hat{g}}{\smash{\hat{g}}}{\hat{g}}{\hat{g}}})\equiv(n\bm{\mathchoice{\dot{h}}{\smash{\dot{h}}}{\dot{h}}{\dot{h}}},m\bm{\mathchoice{\hat{h}}{\smash{\hat{h}}}{\hat{h}}{\hat{h}}}). The associated non-normalized marginal edge counts are given by H˙g˙\mathchoice{\dot{H}}{\smash{\dot{H}}}{\dot{H}}{\dot{H}}\bm{\mathchoice{\dot{g}}{\smash{\dot{g}}}{\dot{g}}{\dot{g}}} and H^g^\mathchoice{\hat{H}}{\smash{\hat{H}}}{\hat{H}}{\hat{H}}\bm{\mathchoice{\hat{g}}{\smash{\hat{g}}}{\hat{g}}{\hat{g}}} where H˙\mathchoice{\dot{H}}{\smash{\dot{H}}}{\dot{H}}{\dot{H}}, H^\mathchoice{\hat{H}}{\smash{\hat{H}}}{\hat{H}}{\hat{H}} are the marginalization matrices corresponding to φ˙\mathchoice{\dot{\varphi}}{\smash{\dot{\varphi}}}{\dot{\varphi}}{\dot{\varphi}}, φ^\mathchoice{\hat{\varphi}}{\smash{\hat{\varphi}}}{\hat{\varphi}}{\hat{\varphi}} as defined in §3.3. The pair g≡(g˙,g^){\bm{g}}\equiv(\bm{\mathchoice{\dot{g}}{\smash{\dot{g}}}{\dot{g}}{\dot{g}}},\bm{\mathchoice{\hat{g}}{\smash{\hat{g}}}{\hat{g}}{\hat{g}}}) can contribute to ⋆Z∂[σ‾Y]{}^{\star}\bm{Z}^{\partial}[{\underline{\smash{\sigma}}}_{\mathscr{Y}}] only if

where ⟨g˙,1⟩\langle\bm{\mathchoice{\dot{g}}{\smash{\dot{g}}}{\dot{g}}{\dot{g}}},1\rangle indicates the total mass of g˙\bm{\mathchoice{\dot{g}}{\smash{\dot{g}}}{\dot{g}}{\dot{g}}}, and Hˉσ‾Y\mathchoice{\bar{H}}{\smash{\bar{H}}}{\bar{H}}{\bar{H}}_{{\underline{\smash{\sigma}}}_{\mathscr{Y}}} denotes the non-normalized edge empirical measure associated to σ‾Y{\underline{\smash{\sigma}}}_{\mathscr{Y}}. The contribution from such g{\bm{g}} is given by

where we adopt the shorthand φ˙δ˙≡∏σ˙‾φ˙(σ˙‾)δ˙(σ˙‾)\mathchoice{\dot{\varphi}}{\smash{\dot{\varphi}}}{\dot{\varphi}}{\dot{\varphi}}^{\bm{\mathchoice{\dot{\delta}}{\smash{\dot{\delta}}}{\dot{\delta}}{\dot{\delta}}}}\equiv\prod_{\underline{\smash{\mathchoice{\dot{\sigma}}{\smash{\dot{\sigma}}}{\dot{\sigma}}{\dot{\sigma}}}}}\mathchoice{\dot{\varphi}}{\smash{\dot{\varphi}}}{\dot{\varphi}}{\dot{\varphi}}(\underline{\smash{\mathchoice{\dot{\sigma}}{\smash{\dot{\sigma}}}{\dot{\sigma}}{\dot{\sigma}}}})^{\bm{\mathchoice{\dot{\delta}}{\smash{\dot{\delta}}}{\dot{\delta}}{\dot{\delta}}}(\underline{\smash{\mathchoice{\dot{\sigma}}{\smash{\dot{\sigma}}}{\dot{\sigma}}{\dot{\sigma}}}})}, g˙!≡∏σ˙‾g˙(σ˙‾)!\bm{\mathchoice{\dot{g}}{\smash{\dot{g}}}{\dot{g}}{\dot{g}}}!\equiv\prod_{\underline{\smash{\mathchoice{\dot{\sigma}}{\smash{\dot{\sigma}}}{\dot{\sigma}}{\dot{\sigma}}}}}\bm{\mathchoice{\dot{g}}{\smash{\dot{g}}}{\dot{g}}{\dot{g}}}(\underline{\smash{\mathchoice{\dot{\sigma}}{\smash{\dot{\sigma}}}{\dot{\sigma}}{\dot{\sigma}}}})!, etc.

The following lemma estimates the contribution in expectation from ⋆Z∂[σ‾Y]{}^{\star}\bm{Z}^{\partial}[{\underline{\smash{\sigma}}}_{\mathscr{Y}}] to ⋆Z∂{}^{\star}\bm{Z}^{\partial}.

Suppose there exist measures δσ‾Y\bm{\delta}^{{\underline{\smash{\sigma}}}_{\mathscr{Y}}} (non-zero only on the support of φ\varphi) satisfying H^δ^σ‾Y=H˙δ˙σ‾Y+Hˉσ‾Y\mathchoice{\hat{H}}{\smash{\hat{H}}}{\hat{H}}{\hat{H}}\bm{\mathchoice{\hat{\delta}}{\smash{\hat{\delta}}}{\hat{\delta}}{\hat{\delta}}}^{{\underline{\smash{\sigma}}}_{\mathscr{Y}}}=\mathchoice{\dot{H}}{\smash{\dot{H}}}{\dot{H}}{\dot{H}}\bm{\mathchoice{\dot{\delta}}{\smash{\dot{\delta}}}{\dot{\delta}}{\dot{\delta}}}^{{\underline{\smash{\sigma}}}_{\mathscr{Y}}}+\mathchoice{\bar{H}}{\smash{\bar{H}}}{\bar{H}}{\bar{H}}_{{\underline{\smash{\sigma}}}_{\mathscr{Y}}} for all σ‾Y{\underline{\smash{\sigma}}}_{\mathscr{Y}}, with (⟨δ˙σ‾Y,1⟩,⟨δ^σ‾Y,1⟩)=(ν,μ)(\langle\bm{\mathchoice{\dot{\delta}}{\smash{\dot{\delta}}}{\dot{\delta}}{\dot{\delta}}}^{{\underline{\smash{\sigma}}}_{\mathscr{Y}}},1\rangle,\langle\bm{\mathchoice{\hat{\delta}}{\smash{\hat{\delta}}}{\hat{\delta}}{\hat{\delta}}}^{{\underline{\smash{\sigma}}}_{\mathscr{Y}}},1\rangle)=(\nu,\mu) constant in σ‾Y{\underline{\smash{\sigma}}}_{\mathscr{Y}}. Then

where ∥δ∥1≡∑σ˙‾∣δ˙(σ˙‾)∣+∑σ^‾∣δ^(σ^‾)∣\|\bm{\delta}\|_{1}\equiv\sum_{\underline{\smash{\mathchoice{\dot{\sigma}}{\smash{\dot{\sigma}}}{\dot{\sigma}}{\dot{\sigma}}}}}|\bm{\mathchoice{\dot{\delta}}{\smash{\dot{\delta}}}{\dot{\delta}}{\dot{\delta}}}(\underline{\smash{\mathchoice{\dot{\sigma}}{\smash{\dot{\sigma}}}{\dot{\sigma}}{\dot{\sigma}}}})|+\sum_{\underline{\smash{\mathchoice{\hat{\sigma}}{\smash{\hat{\sigma}}}{\hat{\sigma}}{\hat{\sigma}}}}}|\bm{\mathchoice{\hat{\delta}}{\smash{\hat{\delta}}}{\hat{\delta}}{\hat{\delta}}}(\underline{\smash{\mathchoice{\hat{\sigma}}{\smash{\hat{\sigma}}}{\hat{\sigma}}{\hat{\sigma}}}})|.

G∂G^{\partial} has n∂n^{\partial} variables, m∂m^{\partial} clauses, and ∣Y∣|\mathscr{Y}| unmatched edges incident to variables, so n∂d=m∂k+∣Y∣n^{\partial}d=m^{\partial}k+|\mathscr{Y}|. Fix σ‾Y{\underline{\smash{\sigma}}}_{\mathscr{Y}} and abbreviate δ≡δσ‾Y\bm{\delta}\equiv\bm{\delta}^{{\underline{\smash{\sigma}}}_{\mathscr{Y}}}; note from the assumptions that νd=μk−∣Y∣\nu d=\mu k-|\mathscr{Y}|. Thus n′d=m′kn^{\prime}d=m^{\prime}k for n′≡n∂+νn^{\prime}\equiv n^{\partial}+\nu and m′≡m∂+μm^{\prime}\equiv m^{\partial}+\mu, so we may compare ⋆Z∂{}^{\star}\bm{Z}^{\partial} with the partition function ⋆Z′{}^{\star}\bm{Z}^{\prime} on a full bipartite (d,k)(d,k)-regular graph with n′n^{\prime} variables and m′m^{\prime} clauses. Away from the simplex boundary, empirical measures contributing to ⋆Z∂[σ‾Y]{}^{\star}\bm{Z}^{\partial}[{\underline{\smash{\sigma}}}_{\mathscr{Y}}] can be parametrized as g−δ{\bm{g}}-\bm{\delta} where g{\bm{g}} runs over the empirical measures contributing to ⋆Z′{}^{\star}\bm{Z}^{\prime}. Writing (a)b(a)_{b} for the falling factorial a!/(a−b)!a!/(a-b)!, we have

The factor c~=c[1+Ok(∥δ∥12/n)]\widetilde{\bm{c}}=\bm{c}[1+O_{k}(\|\bm{\delta}\|^{2}_{1}/n)] is a proportionality constant not depending on (g,δ)({\bm{g}},\bm{\delta}). For ∥g−⋆g∥≤n1/2log⁡n\|{\bm{g}}-{}^{\star}{\bm{g}}\|\leq n^{1/2}\log n, we find eg,δ∼1\bm{e}_{{\bm{g}},\bm{\delta}}\sim 1 while rg,δ\bm{r}_{{\bm{g}},\bm{\delta}} gives the main dependence on σ‾Y{\underline{\smash{\sigma}}}_{\mathscr{Y}}:

(using (21) to calculate r\bm{r}). Recalling Propn. 5.1 we have (with δ≡δσ‾Y\bm{\delta}\equiv\bm{\delta}^{{\underline{\smash{\sigma}}}_{\mathscr{Y}}})

Lem. 6.3 applies for any factor model with free energy attaining a local maximum at ⋆g{}^{\star}{\bm{g}} with negative-definite Hessian. In particular, it applies to both the first- and second-moment versions of the auxiliary model. We now show how to construct the required measures δτ‾Y\bm{\delta}^{{\underline{\smash{\tau}}}_{\mathscr{Y}}} for the pair auxiliary model (the construction for the first-moment version being similar but simpler). The construction is based on the following

For any τ,τ′∈M2\tau,\tau^{\prime}\in\mathscr{M}^{2} there exists a signed integer measure δ=δτ−τ′=(δ˙,δ^)\bm{\delta}=\bm{\delta}_{\tau-\tau^{\prime}}=(\bm{\mathchoice{\dot{\delta}}{\smash{\dot{\delta}}}{\dot{\delta}}{\dot{\delta}}},\bm{\mathchoice{\hat{\delta}}{\smash{\hat{\delta}}}{\hat{\delta}}{\hat{\delta}}}) with supp⁡δ⊆supp⁡φ2\operatorname{supp}\bm{\delta}\subseteq\operatorname{supp}\varphi_{2} such that

The remaining cases follow by symmetry. ∎

clearly this satisfies the conditions of Lem. 6.3. Applying Lem. 6.3 with this choice of δ\bm{\delta} for n′=nn^{\prime}=n and m′=mm^{\prime}=m gives

(a) Write ν≡n−n∂\nu\equiv n-n^{\partial}, μ≡m−m∂\mu\equiv m-m^{\partial}. The calculation of Lem. 6.3 applied to the auxiliary model gives

with Z\bm{Z} the partition function on a full bipartite (d,k)(d,k)-regular graph on nn variables, and with proportionality constant c≡exp⁡{ν⋆Φ}⋅z^∣Y∣/k\bm{c}\equiv\exp\{\nu{}^{\star}\bm{\Phi}\}\cdot\bm{\mathchoice{\hat{z}}{\smash{\hat{z}}}{\hat{z}}{\hat{z}}}^{|\mathscr{Y}|/k} where z^\bm{\mathchoice{\hat{z}}{\smash{\hat{z}}}{\hat{z}}{\hat{z}}} is the normalizing constant for ⋆h^{}^{\star}\bm{\mathchoice{\hat{h}}{\smash{\hat{h}}}{\hat{h}}{\hat{h}}} as defined by (21). The corresponding normalizing constant for 2⋆h^{}^{\star}_{2}\bm{\mathchoice{\hat{h}}{\smash{\hat{h}}}{\hat{h}}{\hat{h}}} is z^2\bm{\mathchoice{\hat{z}}{\smash{\hat{z}}}{\hat{z}}{\hat{z}}}^{2}, so we see that the proportionality constant corresponding to the pair auxiliary model is simply c2\bm{c}^{2}. Thus, applying (52) in the pair auxiliary model gives

(b) Substituting the result of (a) into (45) gives

The method of Lem. 6.3 can also be applied to estimate the dependence on τ‾U{\underline{\smash{\tau}}}_{\mathscr{U}} fixing τ‾Y{\underline{\smash{\tau}}}_{\mathscr{Y}}:

If TT is such that kk divides ∣U∣|\mathscr{U}|, then there are coefficients ξ\xi, (ξj)j≤C(\xi_{j})_{j\leq C} with ∥ξ∥∞≲kn−1/2log⁡n\|\xi\|_{\infty}\lesssim_{k}n^{-1/2}\log n, C≲k1C\lesssim_{k}1 and ∥ξj∥∞≲kn−1/2\|\xi_{j}\|_{\infty}\lesssim_{k}n^{-1/2} such that

In the special case that ∣U∣|\mathscr{U}| is divisible by kk, we may simply take nT=0n_{T}=0 and mT=∣U∣/km_{T}=|\mathscr{U}|/k, so δ\bm{\delta} can be expressed as a linear function of the U\mathscr{U}-marginal:

Assume for simplicity that δ˙τ=0\bm{\mathchoice{\dot{\delta}}{\smash{\dot{\delta}}}{\dot{\delta}}{\dot{\delta}}}^{\tau}=0 for all τ\tau: writing a^≡(g^−g^⋆)/g^⋆\bm{\mathchoice{\hat{a}}{\smash{\hat{a}}}{\hat{a}}{\hat{a}}}\equiv(\bm{\mathchoice{\hat{g}}{\smash{\hat{g}}}{\hat{g}}{\hat{g}}}-\bm{\mathchoice{\hat{g}}{\smash{\hat{g}}}{\hat{g}}{\hat{g}}}^{\star})/\bm{\mathchoice{\hat{g}}{\smash{\hat{g}}}{\hat{g}}{\hat{g}}}^{\star}, we estimate

We then simplify ⟨δ^τ‾U,A^⟩=⟨Hˉτ‾U,ξ⟩\langle\bm{\mathchoice{\hat{\delta}}{\smash{\hat{\delta}}}{\hat{\delta}}{\hat{\delta}}}^{{\underline{\smash{\tau}}}_{\mathscr{U}}},\bm{\mathchoice{\hat{A}}{\smash{\hat{A}}}{\hat{A}}{\hat{A}}}\rangle=\langle\mathchoice{\bar{H}}{\smash{\bar{H}}}{\bar{H}}{\bar{H}}_{{\underline{\smash{\tau}}}_{\mathscr{U}}},\xi\rangle and δ^τ‾U(τ^‾)2B^(τ^‾)=⟨Hˉτ‾U,ξτ^‾⟩2\bm{\mathchoice{\hat{\delta}}{\smash{\hat{\delta}}}{\hat{\delta}}{\hat{\delta}}}^{{\underline{\smash{\tau}}}_{\mathscr{U}}}(\underline{\smash{\mathchoice{\hat{\tau}}{\smash{\hat{\tau}}}{\hat{\tau}}{\hat{\tau}}}})^{2}\bm{\mathchoice{\hat{B}}{\smash{\hat{B}}}{\hat{B}}{\hat{B}}}(\underline{\smash{\mathchoice{\hat{\tau}}{\smash{\hat{\tau}}}{\hat{\tau}}{\hat{\tau}}}})=\langle\mathchoice{\bar{H}}{\smash{\bar{H}}}{\bar{H}}{\bar{H}}_{{\underline{\smash{\tau}}}_{\mathscr{U}}},\xi_{\underline{\smash{\mathchoice{\hat{\tau}}{\smash{\hat{\tau}}}{\hat{\tau}}{\hat{\tau}}}}}\rangle^{2} where ξ(τ)≡⟨δ^τ,A^⟩\xi(\tau)\equiv\langle\bm{\mathchoice{\hat{\delta}}{\smash{\hat{\delta}}}{\hat{\delta}}{\hat{\delta}}}^{\tau},\bm{\mathchoice{\hat{A}}{\smash{\hat{A}}}{\hat{A}}{\hat{A}}}\rangle and ξτ^‾(τ)≡B^1/2(τ^‾)δ^τ(τ^‾)\xi_{\underline{\smash{\mathchoice{\hat{\tau}}{\smash{\hat{\tau}}}{\hat{\tau}}{\hat{\tau}}}}}(\tau)\equiv\bm{\mathchoice{\hat{B}}{\smash{\hat{B}}}{\hat{B}}{\hat{B}}}^{1/2}(\underline{\smash{\mathchoice{\hat{\tau}}{\smash{\hat{\tau}}}{\hat{\tau}}{\hat{\tau}}}})\bm{\mathchoice{\hat{\delta}}{\smash{\hat{\delta}}}{\hat{\delta}}{\hat{\delta}}}^{\tau}(\underline{\smash{\mathchoice{\hat{\tau}}{\smash{\hat{\tau}}}{\hat{\tau}}{\hat{\tau}}}}). Relabelling gives (54) in the case that δ˙τ=0\bm{\mathchoice{\dot{\delta}}{\smash{\dot{\delta}}}{\dot{\delta}}{\dot{\delta}}}^{\tau}=0 for all τ\tau. The result in general follows by an easy generalization of the above calculation. ∎

satisfies R∅,∅≍1\mathbf{R}_{\varnothing,\varnothing}\asymp 1 and ∣Rs‾1,s‾2∣≲k,tn−1/2log⁡n|\mathbf{R}_{\underline{\smash{s}}^{1},\underline{\smash{s}}^{2}}|\lesssim_{k,t}n^{-1/2}\log n for ∣s‾1s‾2∣≥1|\underline{\smash{s}}^{1}\underline{\smash{s}}^{2}|\geq 1, consequently

If further TT is disjoint from W\mathscr{W} with ∣U∣|\mathscr{U}| divisible by kk, then ∣Rs‾1,s‾2∣≲kn−1|\mathbf{R}_{\underline{\smash{s}}^{1},\underline{\smash{s}}^{2}}|\lesssim_{k}n^{-1} for ∣s‾1s‾2∣≥2|\underline{\smash{s}}^{1}\underline{\smash{s}}^{2}|\geq 2, and ∣Rs‾1,s‾2∣≲k,tn−3/2(log⁡n)6|\mathbf{R}_{\underline{\smash{s}}^{1},\underline{\smash{s}}^{2}}|\lesssim_{k,t}n^{-3/2}(\log n)^{6} for ∣s‾1s‾2∣≥3|\underline{\smash{s}}^{1}\underline{\smash{s}}^{2}|\geq 3. All estimates hold uniformly in τ‾W{\underline{\smash{\tau}}}_{\mathscr{W}}.

The estimates on R\mathbf{R} follow straightforwardly from Lem. 6.6. To see (55), we calculate

where the first step uses Cor. 6.5a and the second step uses (53) together with the trivial bound ∣κs‾∧∣≤∥bs‾∥∞κ∅∧≲k,tκ∅∧|\kappa^{\wedge}_{\underline{\smash{s}}}|\leq\|\bm{b}_{\underline{\smash{s}}}\|_{\infty}\kappa^{\wedge}_{\varnothing}\lesssim_{k,t}\kappa^{\wedge}_{\varnothing}, since the orthogonality relation ∥bs∥q˙=1\|\bm{b}_{s}\|_{\mathchoice{\dot{q}}{\smash{\dot{q}}}{\dot{q}}{\dot{q}}}=1 implies ∥bs‾∥∞≤(min⁡σh˙σ)−∣s‾∣/2≲k,t1\|\bm{b}_{\underline{\smash{s}}}\|_{\infty}\leq(\min_{\sigma}\mathchoice{\dot{h}}{\smash{\dot{h}}}{\dot{h}}{\dot{h}}_{\sigma})^{-|\underline{\smash{s}}|/2}\lesssim_{k,t}1. ∎

3. Local neighborhood Fourier coefficients

Let us recall again the definition (44) of the local neighborhood TT of the unmatched K\mathscr{K} in G∘G^{\circ} (equipped with random literals), with leaves joining TT to the graph G∂G^{\partial} considered in §6.2. Recall also that AA, Aˊ\acute{A} are arbitrary choices of clauses (with literals) to place on K\mathscr{K}, and we write κ(σ‾U)\kappa({\underline{\smash{\sigma}}}_{\mathscr{U}}) (resp. κˊ(σ‾U)\acute{\kappa}({\underline{\smash{\sigma}}}_{\mathscr{U}})) for the partition function on T∪AT\cup A (resp. T∪AˊT\cup\acute{A}) given boundary configuration σ‾Y{\underline{\smash{\sigma}}}_{\mathscr{Y}}. In this subsection we control the Fourier coefficients ϖ∧=(κ−κˊ)∧\varpi^{\wedge}=(\kappa-\acute{\kappa})^{\wedge} appearing in (46).

Let T\mathbf{T} denote the event that TT consists of ∣K∣|\mathscr{K}| tree components with T∩W=∅T\cap\mathscr{W}=\varnothing. Let C∘\mathbf{C}^{\circ} denote the event that TT either contains a single cycle or has a single intersection with W\mathscr{W} (but not both), but still consists of ∣K∣|\mathscr{K}| components.

For T∈TT\in\mathbf{T}, ϖs‾∧=0\varpi^{\wedge}_{\underline{\smash{s}}}=0 for all ∣s‾∣≤1|\underline{\smash{s}}|\leq 1; and κ∅∧∣T\kappa^{\wedge}_{\varnothing}|_{\mathbf{T}} takes a constant value κ‾∅∧\overline{\kappa}^{\wedge}_{\varnothing}, which does not depend on the literals on TT or on the clauses AA. For T∈C∘T\in\mathbf{C}^{\circ}, ϖ∅∧=0\varpi^{\wedge}_{\varnothing}=0.

On the event T∪C∘\mathbf{T}\cup\mathbf{C}^{\circ}, the graphs T∪AT\cup A and T∪AˊT\cup\acute{A} are isomorphic ignoring the literals. If ∣s‾∣≤1|\underline{\smash{s}}|\leq 1 then bs‾\bm{b}_{\underline{\smash{s}}} depends at most on the spin of a single edge e∈Ue\in\mathscr{U}. For T∈TT\in\mathbf{T}, using the symmetry of nae-sat one can produce an involution ι:σ‾U↦σ‾ˊU\iota:{\underline{\smash{\sigma}}}_{\mathscr{U}}\mapsto\acute{\underline{\smash{\sigma}}}_{\mathscr{U}} on MU\mathscr{M}^{\mathscr{U}} which keeps σe\sigma_{e} fixed, is measure-preserving with respect to p\bm{p}, and satisfies κ(σ‾U)=κˊ(σ‾ˊU)\kappa({\underline{\smash{\sigma}}}_{\mathscr{U}})=\acute{\kappa}(\acute{\underline{\smash{\sigma}}}_{\mathscr{U}}): set σˊu\acute{\sigma}_{u} to be σu\sigma_{u} or ¬σu\neg\sigma_{u} depending on whether the sum of literals along the unique path joining ee to uu in T∪AT\cup A differs in parity from the corresponding sum in T∪AT\cup A. Then

proving our claim on T\mathbf{T}. A similar argument proves ϖ∅∧=0\varpi^{\wedge}_{\varnothing}=0 on C∘\mathbf{C}^{\circ}. ∎

For T∈TT\in\mathbf{T}, ϖs‾∧≲kκ‾∅∧/[4(k−4)t]\varpi^{\wedge}_{\underline{\smash{s}}}\lesssim_{k}\overline{\kappa}^{\wedge}_{\varnothing}/[4^{(k-4)t}] for all ∣s‾∣=2|\underline{\smash{s}}|=2.

Since ∣s‾∣=2|\underline{\smash{s}}|=2 we may write bs‾(σ‾U)=f(σu)g(σw)\bm{b}_{\underline{\smash{s}}}({\underline{\smash{\sigma}}}_{\mathscr{U}})=f(\sigma_{u})g(\sigma_{w}) for f≡bs(u)f\equiv\bm{b}_{s(u)} and g≡bs(w)g\equiv\bm{b}_{s(w)}. If u,wu,w belong in the same connected component of TT, arguing as in the proof of Lem. 6.8 gives ϖs‾∧=0\varpi^{\wedge}_{\underline{\smash{s}}}=0, so assume they belong to different components. Since T∈TT\in\mathbf{T} we may define the random measure μT(σ‾U)≡p(σ‾U)κ(σ‾U)/κ‾∅∧\mu_{T}({\underline{\smash{\sigma}}}_{\mathscr{U}})\equiv\bm{p}({\underline{\smash{\sigma}}}_{\mathscr{U}})\kappa({\underline{\smash{\sigma}}}_{\mathscr{U}})/\overline{\kappa}^{\wedge}_{\varnothing}, and similarly μˊT\acute{\mu}_{T}. Then

since Lem. 6.8 implies ff has the same expectation with respect to μ\mu or μˊ\acute{\mu} (and likewise gg). Let γu\gamma_{u} denote the (unique) path joining uu to K\mathscr{K} in TT, and likewise γw\gamma_{w}. Let NN denote the event that on the path γ≡γu∪γw\gamma\equiv\gamma_{u}\cup\gamma_{w} there exists a clause aa such that, among the k−2k-2 variables in (∂a)\γ(\partial a)\backslash\gamma, there exist two variables v′,v′′v^{\prime},v^{\prime\prime} with

since the relation ∥bs∥q˙2=1\|\bm{b}_{s}\|^{2}_{\mathchoice{\dot{q}}{\smash{\dot{q}}}{\dot{q}}{\dot{q}}}=1 implies ∥bs∥∞2≤(min⁡σ∈Mq˙σ)−1≲k1\|\bm{b}_{s}\|_{\infty}^{2}\leq(\min_{\sigma\in\mathscr{M}}\mathchoice{\dot{q}}{\smash{\dot{q}}}{\dot{q}}{\dot{q}}_{\sigma})^{-1}\lesssim_{k}1. ∎

Consider (46) for T∈TT\in\mathbf{T}: by Lem. 6.8 there is no contribution from terms ∣s‾i∣≤1|\underline{\smash{s}}^{i}|\leq 1. The number of pairs (s‾1,s‾2)(\underline{\smash{s}}^{1},\underline{\smash{s}}^{2}) with ∣s‾1∣=∣s‾2∣=∣s‾1s‾2∣=2|\underline{\smash{s}}^{1}|=|\underline{\smash{s}}^{2}|=|\underline{\smash{s}}^{1}\underline{\smash{s}}^{2}|=2 is at most [∣M∣∣K∣(dk)t]2≲k(k54k)t[|\mathscr{M}||\mathscr{K}|(dk)^{t}]^{2}\lesssim_{k}(k^{5}4^{k})^{t}, and combining Cor. 6.7 and Lem. 6.9 we see that the dominant contribution to (46) comes from these pairs: for T∈TT\in\mathbf{T},

Lastly we consider the event Ct′\mathbf{C}_{t^{\prime}} that B2t′−2∘(K)B^{\circ}_{2t^{\prime}-2}(\mathscr{K}) has ∣K∣|\mathscr{K}| components, but T=B2t′∘(K)T=B^{\circ}_{2t^{\prime}}(\mathscr{K}) has ∣K∣−1|\mathscr{K}|-1 components (cf. (44)) and is disjoint from W\mathscr{W}. On this event we again decompose into contributions from the different local maxima, but differently than in (43):

where ⋆Z∅{}^{\star}\bm{Z}_{\varnothing} is the leading term in the Fourier expansion of ⋆Z{}^{\star}\bm{Z}:

If T∈Ct′T\in\mathbf{C}_{t^{\prime}} then κ∅∧≍κˊ∅∧\kappa^{\wedge}_{\varnothing}\asymp\acute{\kappa}^{\wedge}_{\varnothing} and ∣ϖ∅∧∣≲k4−(k−4)t′[κ∅∧∧κˊ∅∧]|\varpi^{\wedge}_{\varnothing}|\lesssim_{k}4^{-(k-4)t^{\prime}}[\kappa^{\wedge}_{\varnothing}\wedge\acute{\kappa}^{\wedge}_{\varnothing}].

Let κ∘(σ‾U,σ‾K)\kappa^{\circ}({\underline{\smash{\sigma}}}_{\mathscr{U}},{\underline{\smash{\sigma}}}_{\mathscr{K}}) denote the partition function on TT given boundary conditions (σ‾U,σ‾K)({\underline{\smash{\sigma}}}_{\mathscr{U}},{\underline{\smash{\sigma}}}_{\mathscr{K}}), and define the random measure

If ι(σ‾K)\iota({\underline{\smash{\sigma}}}_{\mathscr{K}}) is the indicator that σ‾K{\underline{\smash{\sigma}}}_{\mathscr{K}} is valid for clauses AA (likewise ιˊ\acute{\iota} for clauses Aˊ\acute{A}) then

By definition of the event Ct′\mathbf{C}_{t^{\prime}},

where {e′,e′′}\{e^{\prime},e^{\prime\prime}\} is the unique pair of edges in K\mathscr{K} such that B2t′∘(e′)B^{\circ}_{2t^{\prime}}(e^{\prime}) and B2t′∘(e′′)B^{\circ}_{2t^{\prime}}(e^{\prime\prime}) intersect. The graph TT (without AA or A′A^{\prime}) contains no cycles, so it follows from the symmetry argument of Lem. 6.8 that the marginal of μ∘\mu^{\circ} on each e∈Ke\in\mathscr{K} does not depend on the literals on TT; further each marginal must simply be p\bm{p} from the Bethe recursions. It remains to note (arguing as in the proof of Lem. 6.9) that ∣μ∘(σe′,σe′′)−μ∘(σe′)μ∘(σe′′)∣≲4−(k−4)t′|\mu^{\circ}(\sigma_{e^{\prime}},\sigma_{e^{\prime\prime}})-\mu^{\circ}(\sigma_{e^{\prime}})\mu^{\circ}(\sigma_{e^{\prime\prime}})|\lesssim 4^{-(k-4)t^{\prime}}, from which we conclude

(where ⟨p,ι⟩=⟨p,ιˊ⟩\langle\bm{p},\iota\rangle=\langle\bm{p},\acute{\iota}\rangle again by symmetry). ∎

Writing C≡⋃t′≤tCt′\mathbf{C}\equiv\bigcup_{t^{\prime}\leq t}\mathbf{C}_{t^{\prime}}, we have

4. Variance bound for general factor models

We summarize the result of this section by abstracting a variance bound (Cor. 6.11 below) which applies to a general class of factor specifications φ\varphi on (d,k)(d,k)-regular graphs.

Let U\mathscr{U} denote the leaves of TT without W\mathscr{W}, and Y\mathscr{Y} the disjoint union of U\mathscr{U} and W\mathscr{W}.

Let A,AˊA,\acute{A} be two arbitrary ways to form kk clauses on U\mathscr{U}. Let κ(σ‾U)\kappa({\underline{\smash{\sigma}}}_{\mathscr{U}}) denote the partition function on T∪AT\cup A subject to boundary conditions σ‾U{\underline{\smash{\sigma}}}_{\mathscr{U}}, and let κ∅∧≡∑σ‾Up(σ‾U)κ(σ‾U)\kappa^{\wedge}_{\varnothing}\equiv\sum_{{\underline{\smash{\sigma}}}_{\mathscr{U}}}\bm{p}({\underline{\smash{\sigma}}}_{\mathscr{U}})\kappa({\underline{\smash{\sigma}}}_{\mathscr{U}}). Define similarly κˊ(σ‾U)\acute{\kappa}({\underline{\smash{\sigma}}}_{\mathscr{U}}) and κˊ∅∧\acute{\kappa}^{\wedge}_{\varnothing} with respect to Aˊ\acute{A} in place of AA. Let φ‾(σ‾W)\overline{\varphi}({\underline{\smash{\sigma}}}_{\mathscr{W}}) denote the probability that σ‾W{\underline{\smash{\sigma}}}_{\mathscr{W}} is valid with respect to a random formation of clauses on W\mathscr{W}.

Suppose φ≡(φ˙,φ^)\varphi\equiv(\mathchoice{\dot{\varphi}}{\smash{\dot{\varphi}}}{\dot{\varphi}}{\dot{\varphi}},\mathchoice{\hat{\varphi}}{\smash{\hat{\varphi}}}{\hat{\varphi}}{\hat{\varphi}}) specifies a factor model on (d,k)(d,k)-regular bipartite factor graphs such that which the following hold:

(Factor support) The space M\mathscr{M} of spins is connected by measures δσ−σ′\bm{\delta}_{\sigma-\sigma^{\prime}} on the support of φ\varphi (in the sense of Lem. 6.4); likewise the space M2\mathscr{M}^{2} of pair spins is connected by measures δτ−τ′\bm{\delta}_{\tau-\tau^{\prime}} on the support of the second-moment factors φ2\varphi_{2}.

(Moment conditions) The first-moment rate function Φ\bm{\Phi} has negative-definite Hessian at its global maximizer ⋆h{}^{\star}\bm{h}, and the second-moment rate function 2Φ{}_{2}\bm{\Phi} has a local maximum at 2⋆h≡⋆h⊗⋆h{}^{\star}_{2}\bm{h}\equiv{}^{\star}\bm{h}\otimes{}^{\star}\bm{h} with negative-definite Hessian.

(Tree isomorphisms) On the event T\mathbf{T} that TT consists of ∣K∣|\mathscr{K}| tree components with T∩W=∅T\cap\mathscr{W}=\varnothing, or the event C∘\mathbf{C}^{\circ} that TT either contains a single cycle or has a single intersection with W\mathscr{W} (but not both), κ∅∧=κˊ∅∧\kappa^{\wedge}_{\varnothing}=\acute{\kappa}^{\wedge}_{\varnothing}. Further κ∅∧∣T\kappa^{\wedge}_{\varnothing}|_{\mathbf{T}} takes a constant value κ‾∅∧\overline{\kappa}^{\wedge}_{\varnothing} not depending on AA, and Cov⁡p(κ−κˊ,f)=0\operatorname{Cov}_{\bm{p}}(\kappa-\acute{\kappa},f)=0 for any function ff depending only on a single spin σe\sigma_{e}, e∈Ue\in\mathscr{U}.Note that this property is not immediate in the nae-sat setting because AA and Aˊ\acute{A} may have different literals, but in a model with non-random factors (e.g. the hard-core model) it follows immediately from the isomorphism between T∪AT\cup A and T∪AˊT\cup\acute{A}.

(Correlation decay) The tree Gibbs measure ν\nu corresponding to ⋆h{}^{\star}\bm{h} has correlation decay at rate faster than the square root of the tree’s branching rate: for variables u,vu,v are separated by tt clauses, ∣Cov⁡ν(f(σu),g(σv))∣≲k∥fg∥∞[c(d−1)(k−1)]−t/2|\operatorname{Cov}_{\nu}(f(\sigma_{u}),g(\sigma_{v}))|\lesssim_{k}\|fg\|_{\infty}[c(d-1)(k-1)]^{-t/2} for c>1c>1.

Let r>0r>0 such that 2⋆Φ(h)<2⋆Φ(2⋆h){}^{\star}_{2}\bm{\Phi}(\bm{h})<{}^{\star}_{2}\bm{\Phi}({}^{\star}_{2}\bm{h}) for all h≠2⋆h\bm{h}\neq{}^{\star}_{2}\bm{h} within distance 2r2r of 2⋆h{}^{\star}_{2}\bm{h}, and let 2⋅⋅Z∂{}^{\cdot\cdot}_{2}\bm{Z}^{\partial} refer to the contribution to the pair partition function on G∂≡G∘\TG^{\partial}\equiv G^{\circ}\backslash T from empirical measures at distance more than rr from 2⋆h{}^{\star}_{2}\bm{h}. For m−m′≲klog⁡nm-m^{\prime}\lesssim_{k}\log n and m′≤i≤m−km^{\prime}\leq i\leq m-k define

If ⋆Z{}^{\star}\bm{Z} denotes the contribution to the partition function from empirical measures within distance n−1/2log⁡nn^{-1/2}\log n of ⋆h{}^{\star}\bm{h}, then for t=t(k,ε)=4log⁡c(1/ε)t=t(k,\varepsilon)=4\log_{c}(1/\varepsilon) we have

The original nae-sat model can also be regarded as a factor model in the sense of Cor. 6.11, with factors φ˙(σ˙‾)\mathchoice{\dot{\varphi}}{\smash{\dot{\varphi}}}{\dot{\varphi}}{\dot{\varphi}}(\underline{\smash{\mathchoice{\dot{\sigma}}{\smash{\dot{\sigma}}}{\dot{\sigma}}{\dot{\sigma}}}}) and φ^a(σ^‾a)≡φ^∘(σ^‾a⊕L‾a)\mathchoice{\hat{\varphi}}{\smash{\hat{\varphi}}}{\hat{\varphi}}{\hat{\varphi}}_{a}(\underline{\smash{\mathchoice{\hat{\sigma}}{\smash{\hat{\sigma}}}{\hat{\sigma}}{\hat{\sigma}}}}_{a})\equiv\mathchoice{\hat{\varphi}}{\smash{\hat{\varphi}}}{\hat{\varphi}}{\hat{\varphi}}^{\circ}(\underline{\smash{\mathchoice{\hat{\sigma}}{\smash{\hat{\sigma}}}{\hat{\sigma}}{\hat{\sigma}}}}_{a}\oplus\underline{\smash{L}}_{a}) where (compare (12))

From clusters to assignments

Let G♯≡G♯(G,L‾,σ‾)G^{\sharp}\equiv G^{\sharp}(G,\underline{\smash{L}},{\underline{\smash{\sigma}}}) denote the subgraph of GG induced by the free variables together with the clauses F♯F^{\sharp}. We claim that σ‾{\underline{\smash{\sigma}}} has a valid completion to an nae-sat solution provided each connected component of G♯G^{\sharp} contains at most one cycle. Indeed, in a tree component of G♯G^{\sharp} one may choose an arbitrary root vertex and assign it an arbitrary value — this may cause a chain of forcings, but no conflict results since there is no cycle. In a unicyclic component CC with cycle v0,a0,v1,…,an−1,vnv_{0},a_{0},v_{1},\ldots,a_{n-1},v_{n} (with indices taken modulo nn so v0=vnv_{0}=v_{n}), setting xvi=¬Laivi⊕ξaix_{v_{i}}=\neg L_{a_{i}v_{i}}\oplus\xi_{a_{i}} ensures that all clauses along the cycle are satisfied. Then, by the preceding argument for tree components, there exists a valid completion of x‾\underline{\smash{x}} to the remainder of CC, proving our claim.

As for the marginal bias, note that the increased chance for ov′\bm{o}_{v^{\prime}} to be free compared with ou\bm{o}_{u} comes from the fact that vv receives only d−2d-2 incoming messages from the rest of the graph: thus σv→b\sigma_{v\to b} is slightly biased towards f, and this effect can percolate through the chain σb→w\sigma_{b\to w}, σw→b′\sigma_{w\to b^{\prime}}, σb′→v′\sigma_{b^{\prime}\to v^{\prime}} to affect ov′\bm{o}_{v^{\prime}}. However the initial bias on σv→b\sigma_{v\to b} is ≲4−k\lesssim 4^{-k}, and the effect decreases by a factor 2k2^{k} passing through each step in the chain, so the overall bias is ≲2−6k\lesssim 2^{-6k}. Combining these estimates proves (61).

The result follows from (61) and (62) by noting that in a clause with kk random incoming messages which are mutually independent except for possible correlation among the first two, the probability for the clause to be satisfied decreases if the probability for the first two messages to be both rigid increases. ∎

References