Zero-free regions of partition functions with applications to algorithms and graph limits
Guus Regts
Introduction
In a series of papers Barvinok and Barvinok and Soberón developed a technique that yields quasi-polynomial time approximation schemes for several hard counting problems such as computing the permanent of a matrix and computing the number of (edge-colored) graph homomorphisms into a fixed graph. Their technique is essentially based on two things. First the counting problem is cast as the evaluation of some polynomial and they identify a region where this polynomial is nonzero. Secondly, they prove that in this zero-free region the logarithm of the polynomial is well-approximated by a low order Taylor approximation, which they prove to be computable in quasi-polynomial time.
In this paper we will apply this method to partition functions of edge-coloring models and more generally to Holant counting problems and contractions of tensor networks. That is, fixing a degree bound , we will identify edge-coloring models for which the partition function does not vanish on graphs with maximum degree at most and consequently show how to approximately compute the partition function in quasi-polynomial time. We moreover show that the normalised logarithm of the partition function is continuous with respect to the Benjamini-Schramm topology for these models, and we give give quasi-polynomial time algorithms for approximately evaluating a large class of graph polynomials, including the Tutte polynomial and the matching polynomial, on bounded degree graphs.
Below we will introduce and describe these concepts in a bit more detail and state our results.
If is the all-ones vector and is the adjacency matrix of some graph , then is equal to the number of graph homomorphisms from to .
Partition functions of edge-coloring models include partition function of vertex-coloring models, as has been shown by Szegedy , cf. Lemma 5 in Section 2.1. But they form a much bigger class of graph invariants, cf. . For example, the number of matchings is not equal to the partition function of any vertex-coloring model. Partition functions of edge-coloring models have been characterised in and based on invariant theory of the orthogonal group and the Nullstellensatz.
In many cases it is NP-hard to determine whether or not the partition function of an edge- or vertex-coloring model vanishes on general graphs. However, when restricted to bounded degree graphs things may become easier. In particular, Barvinok and Soberón proved that when is the all ones vector and is sufficiently close to the all ones matrix, then
Based on the technique of Barvinok and Barvinok and Soberón we will prove in Section 3 a similar result for partition functions of edge-coloring models:
In fact, we will state and prove in Section 3 a slightly more general version of Theorem 1 that also applies to tensor networks. The definition of tensor networks will be given in Section 2.
While every partition function of a vertex-coloring model is equal to the partition function of some edge-coloring model, the exact relation between Theorem 1 and (3) is presently not clear. It is possible though to derive a qualitative version of (3) from Theorem 1 (even valid for vertex vertex-coloring models with vertex weights close to ). We will however not do this here. Instead, in Section 3 we will present an example of a vertex-coloring model to which the result of Barvinok and Soberón does not apply, while from our results it follows that its partition function does not evaluate to zero on bounded degree graphs, cf. Example 2.
2 Computing partition functions
Exact computation Computing partition functions is in many cases P-hard. There is a line of work by Dyer and Greenhill , Bulatov and Grohe , Cai, Chen and Lu , where dichotomy theorems have been proved for the complexity of computing partition functions of vertex-coloring models. Roughly they proved that if the model has a very special structure, its partition function can be computed in polynomial time and it is P-hard to compute otherwise. In a sequence of papers Cai Lu and Xia , Cai, Huang and Li , and Cai, Guo and Williams have proved similar results for partition functions of edge-coloring models with colors. In fact, in these papers they consider Holant counting problems, but they include partition functions of edge-coloring models. These Holant counting problems may be seen as tensor network contractions and we will define these in Section 2.2. Approximate computation Since computing partition functions is in many case P-hard, people have started looking at approximation algorithms. Let us consider the case of counting weighted independent sets. For a graph and , denote by the sum over all independent sets of , where an independent set is counted with weight . Note that p_{{\color[rgb]{0,0,0}\lambda}}(G) may be viewed as the partition function of a=({\color[rgb]{0,0,0}\lambda},1) and B=\left(\begin{array}[]{cc}0&1\\ 1&1\end{array}\right). A surprising threshold phenomenon has been found for the complexity of approximating : for there exists a fully-polynomial time approximation scheme (FPTAS) for graphs of maximum degree at most , discovered by Weitz ; for there does not exist a fully-polynomial time randomised approximation scheme (FPRAS) for -regular graphs (with ), unless NP=RP, as has been proved by Sly and Sun . The threshold is the critical point for the (infinite) -regular tree to have a unique Gibbs measure. This phenomenon suggests an intimate connection between phase transitions in statistical physics and computational complexity. The ideas of Weitz have been applied and extended to other types of counting problems and partition functions; see e.g. . Other interesting approximation algorithms and hardness results have been found for partition functions of vertex-coloring models an planar graphs . Our contribution In Section 4 of this paper we apply Theorem 1 to obtain a quasi-polynomial time approximation scheme (QPTAS) for the computation of partition functions of a large class of edge-coloring models on bounded degree graphs, based on a technique developed by Barvinok . This technique was used by Barvinok and Soberón to obtain a QPTAS for the computation of partition function of vertex-coloring models on bounded degree graphs (with equal to the all ones vector).
The main idea is to rewrite the partition function as the evaluation of a univariate polynomial at and then use a low order Taylor approximation to . The approximation turns out to be good when the roots of have absolute value at least for some fixed constant . Theorem 1 is used to guarantee the existence of this constant . From the perspective of the Lee-Yang approach to phase transition in statistical physics , one may view zero-free regions of the partition function as regions far away from a phase transition. So this approach also indicates a connection between statistical physics and computational complexity.
We need one definition to state our result.
We prove the following result in Section 4:
Theorem 2 also applies to contractions of tensor networks and Holant counting problems. See Section 4 for the exact details.
3 Evaluating graph polynomials
It turns out that the technique of Barvinok can also be applied to graph polynomials of exponential type. This is a class of graph polynomials introduced by Csikvári and Frenkel , which includes many important polynomials such as the Tutte polynomial, the matching polynomial and many more. We will define these polynomials in Section 4.3, where we obtain a QPTAS for computing certain evaluations of these polynomials on bounded degree graphs, cf. Theorem 14. Let us for now specialise these results to the Tutte polynomial.
For a graph the random cluster model formulation of the Tutte polynomial Z(G)({\color[rgb]{0,0,0}q},v), is defined as follows:
where denotes the number of connected components of the graph . We will consider the Tutte polynomial for fixed as a polynomial in {\color[rgb]{0,0,0}q}.
In Goldberg and Jerrum showed that approximating Z(G)({\color[rgb]{0,0,0}q},v) for general graphs and for {\color[rgb]{0,0,0}q}>2 and is as hard as counting independent sets in bipartite graphs (#BIS). The present results may be an indication that this is not the case for bounded degree graphs. See for related algorithmic results for the Potts model and for hardness results for the Potts model on bounded degree graphs.
4 Sparse graph limits
In 2001, Benjamini and Schramm defined a convergence notion for finite bounded degree planar graphs, which can also be extended to general bounded degree graphs and is often referred to as Benjamini-Schramm convergence, local convergence or weak convergence. This convergence notion has many equivalent definitions (see the book by Lovász [29, Proposition 5.6]) and we choose one which is most suitable for our purposes. Fix a degree bound and let be a sequence of simple graphs, each of maximum degree at most . We call the sequence locally convergent if goes to infinity, as and if for each connected simple graph the quantity
is a convergent sequence of real numbers, where in (5) denotes the number of induced subgraphs of that are isomorphic to . As an example let be the cycle of length . Then is locally convergent. See for possible representations of limit objects.
where is a graph. This normalisation is motivated by statistical physics, where this quantity is known as the entropy per vertex. Note from the perspective of estimability it does not matter to take the absolute value of before applying the logarithm. For if we fix a some branch of the (complex) logarithm, then the imaginary part is bounded, and dividing it by will make it disappear in the limit.
Borgs, Chayes, Kahn and Lovász showed that if one in (6) replaces by for appropriate this parameter is estimable; see also . In Csikvári and Frenkel showed that if one replaces by in (6), where is a graph polynomial of bounded exponential type and is large enough, then this parameter is estimable. This extends work of Abért and Hubai who showed that this holds for the chromatic polynomial.
Utilising Theorem 1 and building on a result of Csikvári and Frenkel , we will prove that the normalised partition function of an edge-coloring model that is sufficiently close to the all ones edge-coloring model is also estimable.
5 Organisation of the paper
In the next section we collect some preliminaries and set up some notation. In particular, we introduce tensor networks. In Section 3 we will prove a slight generalisation of Theorem 1 valid for tensor networks. In Section 4 we will discuss the technique of Barvinok mentioned earlier and prove Theorems 2 and 3. In Section 5 we will give a proof of Theorem 4. Finally, in Section 6 we will conclude with a few remarks. Sections 4 and 5 may be read independently of each other.
Preliminaries
We will setup some basic notation and give some definitions here that are used throughout the paper.
Whenever we talk about an edge-coloring model we will always assume it has colors, where is some fixed natural number. In particular, in algorithmic statements we will consider as a constant and moreover assume that it is at least , for else computing the partition function is trivial.
2 Tensor networks
As mentioned in the introduction, Theorem 1 not only applies to edge-coloring models but also to tensor networks. We will introduce tensor networks here.
Let . We call the pair a tensor network. The contraction of the tensor network is defined as follows:
Contractions of tensor networks have been used to simulate quantum computing by Markov and Shi in , where they gave a polynomial time algorithm for contracting tensor networks on bounded degree graphs of bounded treewidth. In Arad and Landau use quantum algorithms to compute additive approximations to tensor network contractions. We refer to both and and the references in there for more details concerning the connection of tensor networks and quantum information theory. Contractions of tensor networks can also be used to model Holant counting problems (see ).
3 The orthogonal group
For edge-coloring models this is proved in and the same proof also works for contractions of tensor networks.
Absence of roots for tensor network contractions
Let be a graph and let . For any fix and let . Then for each , . In particular, .
We will prove Theorem 6 in the next section, but we will first state some consequence.
Then . We have the following corollary, which implies Theorem 1.
Let us first consider the case where for all . Let . A simple computation shows that {\color[rgb]{0,0,0}\beta^{*}=\eta x^{*}}. Clearly, . So if we let , then each and hence (10), with for each , follows from Theorem 6.
In the general case let for each and . Then for each and , . So (10), with for each , holds for . Since , (10) now follows. ∎
Corollary 6b is roughly saying that if the tensors are close enough to the rank one tensor , then the tensor network contraction is not equal to zero.
We will now give an example illustrating the power and weakness of our results.
For we can view as a polynomial in , which for -regular graphs coincides with the independence polynomial of evaluated at . Scott and Sokal proved that, if , then on any -regular graph . They moreover showed that this bound is tight. As this bound behaves roughly like , while the result we obtain is of the order , showing that our results are not optimal.
Our proof of Theorem 6 is based on a method of Barvinok and Barvinok and Soberón . Following Barvinok we can say that although the method of proof is similar to the methods considered in it does require some effort and new ideas.
We will first state and prove several lemmas. The first lemma about angles between vectors is due to Boris Bukh see . We refer to for a proof.
For and define
So is a polynomial and we can evaluate this at . In particular, if , then just coincides with the ordinary tensor network contraction .
In the two lemmas below we assume that we have fixed some graph and . Moreover, for we let be the set of edges incident with and the set of neighbours of .
Let , let , let and let . If for all and for each extending we have and moreover for each :
then the angle of and for any extending is at most
Note that (14) equals zero if is not -compatible with . Then for each we obtain by (12) that
Let . Let and let with . Let . Suppose that for each , all and all maps extending , we have and that the angle between and is at most . Then for each and all we have
we obtain that for any ,
where the first inequality in (18) is due to Lemma 7, since by assumption for each and any we have that the angles between and differ by no more than , the second inequality is obvious and the equality in (18) is due to (17). This proves the lemma. ∎
Fix a graph and . If we plug in in (13), then by assumption we have that (13) is at most . We will first show that the following three statements hold:
Note that (19) (i) for already implies that for all .
We will now prove that (19) (i), (ii) and (iii) hold for all sets by induction on . If , then (i) holds since is just the product of nonzero numbers. Clearly, (ii) also holds. Moreover, (iii) also holds since for each ,
and the sum in this equation consists of only one term.
Let now be a subset of of size strictly smaller than . Let . If , then (ii) is clearly true. So we may assume that \delta(u){\color[rgb]{0,0,0}\nsubseteq}F. Let and let be maps that extend . Then by induction from (i) and (iii) (since ) we know that the conditions of Lemma 8 are satisfied with . This implies that (ii) holds for the set .
To prove that (i) holds for , fix such that \delta(v){\color[rgb]{0,0,0}\nsubseteq}F. Then
As by induction the are nonzero and by (ii) we know that their angles differ by at most , Lemma 7 implies that is nonzero for any .
Finally, take such that . If no such exists there is nothing to prove for (iii). Fix . Since the sum in (16) has only one contributing factor if , we may assume that \delta(v){\color[rgb]{0,0,0}\nsubseteq}F. By induction, from (ii) we know that the angle between and for any extending is at most , as . So Lemma 9 implies that (iii) holds for . So by induction we conclude that (19) holds for all sets .
To finish the proof write and let . For let . We claim that for each , and we have
Indeed, for this is clearly true. Next, pick any and . Then
where the first inequality follows from (19) (ii), and the second by induction. This shows (20) and finishes the proof. ∎
Approximation algorithms
In this section we will consider algorithms for computing tensor network contractions and evaluations of graph polynomials. Both algorithms are based on a method of Barvinok (which has also been used by Barvinok and Barvinok and Soberón ), which we describe first.
Note that (22) only depends on the values of for . (Where we agree that the derivative is just the function itself.) To see this note that , that is, . So for we have
This implies that if we can compute the values of for , then (23) provides a nondegenerate (as ) triangular system of equations to compute for , which can be done in time . To summarise:
If the values \frac{d^{m}}{dz^{m}}{\color[rgb]{0,0,0}p}|_{z=0} are given for , then can be computed in time for each .
The quality of the approximation (22) depends on the complex roots of .
The proof of (26) is quite similar to the proof of Lemma 1.2 from , but for completeness we will give it here.
for any such that . Using the standard Taylor expansion for the principal branch of the logarithm, we obtain
(26) now follows by combining (28) with (29) and using the bound on .
Take (where C\geq(\ln{\color[rgb]{0,0,0}1/}q)^{-1} is large enough so that ). Then the right-hand side of (26) is at most . Write . Then we have and similarly . (This follows form the fact that for a complex number , we have and .) Moreover, the angle between and is bounded by . This shows (25).
To see (24), take such that the right-hand side of (26) at most . Then we have and |e^{f(t)}|\leq|e^{{\color[rgb]{0,0,0}z}}|e^{d\varepsilon}, which is equivalent to (24). ∎
2 Approximating tensor network contractions
In this section we will combine Theorem 6 with Lemmas 10 and 11 to give a quasi-polynomial time algorithm for the computation of tensor network contractions for a large class of tensor networks. In particular, Theorem 2 will be proved here.
Consider a graph and . Suppose that satisfies
Note that . So we are interested in computing the value of at . By Corollary 6a we have that for any , . So by Lemma 11 we can compute a fast -approximation to provided we can compute the th derivative of at efficiently. This can be done in time for each . Indeed, for any ,
Let us denote by the edges in that are incident with some vertex of for . Then (32) is equal to
and hence can be computed in time . By Lemmas 10 and 11, we have the following result, which clearly implies Theorem 2.
Theorem 12 of course also applies to tensor networks that strictly satisfy the conditions of Corollaries 6a and b, but we leave the details to the reader.
3 Approximating evaluations of graph polynomials
In this section we will combine a result of Csikvári and Frenkel with Lemma 10 and Lemma 11 to give a quasi-polynomial approximation scheme for evaluating a large class of graph polynomials, including the Tutte polynomial.
(here is the subgraph of induced by ). So is a polynomial of degree at most with zero constant term and the coefficient of is equal to . If , then the degree of is equal to . Csikvári and Frenkel call graph polynomials that arise this way graph polynomials of exponential type. (In fact, they give a different definition, but show that the definition above is equivalent to it.)
Csikvári and Frenkel proved that these polynomials have bounded roots on :
Let us write and define for , to be the set of partitions of into exactly nonempty sets. Then
For the contribution will be zero. So (35) is equal to
No more than sets in can have size greater than or equal to . So to enumerate , we first select a set of vertices and then find all partitions into exactly sets of the remaining vertices. This gives a total of steps. Since is efficient, the sum (36) can be computed in time .
Let now . Then . Lemmas 10 and 11 then imply that we can compute numbers in time such that and such that the angle between and is at most , and in time such that . Then is a multiplicative -approximation to and is an additive -approximation to . This finishes the proof. ∎
Sparse graph limits and edge-coloring models
In this section we will prove Theorem 4. To do this we will use the framework of Csikvári and Frenkel .
Recall that ; see Section 3. Now fix some small constant and fix . Consider the following two graph polynomials:
Observe that and that is monic.
For a graph we define to be the uniform distribution on the roots of . Note that for all graphs the measures are all supported on . We have the following result:
converges locally uniformly in to a harmonic function on .
We will prove Theorem 15 below. Let us first note that it implies Theorem 4 by proving the following more concrete result.
converges. Now note that (38) is equal to
Now we just need to observe that since is locally convergent, we have that converges. So (39) implies that the sequence is convergent, proving the theorem. ∎
Theorem 16 is stated only for edge-coloring models that are close to the all-ones model. Of course it also applies to edge-coloring models that strictly satisfy the conditions of Corollaries 6a and b. In particular, in view of Remark 1, the result gives a qualitative version of a result of Borgs, Chayes, Kahn and Lovász on ‘right convergence’; see also . We however leave the details to the reader.
We will show that for any graph on vertices the coefficients of of can be expressed as a linear combination, over graphs of at most vertices, of the parameters . Since , by (37), this is clearly equivalent to the statement about the coefficients of .
So we only need to show that we can express
as a linear combination of the parameters for each .
We need the concept of a fragment, which is a pair , where is a graph and where is a map . We think of as a number of half edges sticking out of . For we let be the fragment where is equal to the number of edges that connect with . Clearly, for each of size the second sum on the right in (40) only depends on the isomorphism class of the fragment . (An isomorphism from a fragment to a fragment is an isomorphism of the underlying graphs such that for each , .) For a fragment let denote the set of edges of including half edges. Then define for an edge-coloring model ,
where the sum runs over fragments and where denotes the number of sets of size such that is isomorphic to .
So to show that (42) can be written as a linear combination of the parameters for certain graphs , it suffices to show that we can do this for for any fragment . To see this, note first that we can write
Next, say that for two maps if for all . This defines a partial order on . Let be the associated zeta matrix; that is, is the matrix defined by,
Concluding remarks
In this paper we built on ideas of Barvinok and Soberón to find regions where the partition functions of an edge-coloring models does not evaluate to zero. We moreover used a technique of Barvinok to transform these zero-free regions into quasi-polynomial time approximation algorithms for computing partition functions, as well as for evaluating graph polynomials. This work leads to some questions:
As is indicated by Example 2, our results are not optimal. Can one determine more precisely the region where the partition functions does not evaluate to zero on bounded degree graphs? Recent work of Barvinok indicates that also zero-free regions that are not shaped like a ball are interesting. In he used a strip argument to find a quasi polynomial time algorithm to approximate the permanent of a real matrix for which for some fixed .
Can zero-free regions be used in any way to yield (randomized) polynomial time approximation algorithms?
I thank Alexander Barvinok for useful suggestions for the proof of Theorem 6. I am also grateful to Bart Litjens, Sven Polak, Lex Schrijver and Bart Sevenster for their comments. Moreover, I am grateful for useful comments of the anonymous referees.
The research leading to these results has received funding from the European Research Council under the European Union’s Seventh Framework Programme (FP7/2007-2013) / ERC grant agreement n 339109 as well as from a personal NWO VENI grant.