Derandomizing the Isolation Lemma and Lower Bounds for Circuit Size
V. Arvind, Partha Mukhopadhyay
Introduction
[MVV87] Let be an universe of size and be any family of subsets of . Let denote a weight assignment function to elements of . Then,
where the weight function is picked uniformly at random.
In the seminal paper [MVV87] Mulmuley et al apply the isolation lemma to give a randomized NC algorithm for computing maximum cardinality matchings for general graphs (also see [ARZ99]). Since then the isolation lemma has found several other applications. For example, it is crucially used in the proof of the result that [AR00] and in designing randomized NC algorithms for linear representable matroid problems [NSV94]. It is also known that the isolation lemma can be used to prove the Valiant-Vazirani lemma that SAT is many-one reducible via randomized reductions to USAT.
Whether the matching problem is in deterministic NC, and whether are outstanding open problems. Thus, the question whether the isolation lemma can be derandomized is clearly important.
As noted in [Agr07], it is easy to see by a counting argument that the isolation lemma can not be derandomized, in general, because there are set systems . More formally, the following is observed in [Agr07].
[Agr07] The Isolation Lemma can not be fully derandomized if we allow weight functions for a constant (i.e. weight functions with a polynomial range). More precisely, for any polynomially bounded collection of weight assignments with weight range , there exists a family of such that for all , there exists two minimal weight subsets with respect to .
However that does not rule out the derandomization of any special usage of the isolation lemma. Indeed, for all applications of the isolation lemma (mentioned above, for instance) we are interested only in exponentially many set systems .
We make the setting more precise by giving a general framework. Fix the universe and consider an -input boolean circuit where . The set of all subsets of is in a natural - correspondence with the length -binary strings : each subset corresponds to its characteristic binary string whose bit is iff . Thus the -input boolean circuit implicitly defines the set system
As an easy consequence of Lemma 1.1 we have the following.
Let be an universe of size and be an -input boolean circuit of size . Let be the family of subsets of defined by circuit . Let denote a weight assignment function to elements of . Then,
where the weight function is picked uniformly at random. Furthermore, there is a collection of weight functions , where is a fixed polynomial, such that for each there is a weight function w.r.t. which there is a unique minimum weight set in .
Lemma 1.3 allows us to formulate two natural and reasonable derandomization hypotheses for the isolation lemma.
Hypothesis 1. There is a deterministic algorithm that takes as input , where is an -input boolean circuit, and outputs a collection of weight functions such that , with the property that for some there is a unique minimum weight set in the set system . Furthermore, runs in time subexponential in .
Hypothesis 2. There is a deterministic algorithm that takes as input in unary and outputs a collection of weight functions such that , with the property that for each size boolean circuit with inputs there is some weight function w.r.t. which has a unique minimum weight set. Furthermore, runs in time polynomial in .
Clearly, Hypothesis 2 is stronger than Hypothesis 1. It demands a “black-box” derandomization in the sense that efficiently computes a collection of weight functions that will work for any set system in specified by a boolean circuit of size .
Notice that a random collection of weight functions will fulfil the required property of either hypotheses with high probability. Thus, the derandomization hypotheses are plausible. Indeed, it is not hard to see that suitable standard hardness assumptions that yield pseudorandom generators for derandomizing BPP would imply these hypotheses. We do not elaborate on this here. In this paper we show the following consequences of Hypotheses 1 and 2.
Hypothesis 1 implies that either or the Permanent does not have polynomial size noncommutative arithmetic circuits.
These two results are a consequence of an identity testing algorithm for noncommutative circuits that is based on the isolation lemma. This algorithm is based on ideas from [AMS08] where we used automata theory to pick matrices from a suitable matrix ring and evaluate the given arithmetic circuit on these matrices. In the next section, we describe the background and then give the identity test in the following section.
Notice that derandomizing the isolation lemma in specific applications like the algorithm for matchings [MVV87] and the containment [AR00] might still be possible without implying such circuit size lower bounds.
Our result in this paper is similar in flavor to the Impagliazzo-Kabanets result [KI03], where for commutative polynomial identity testing they show that derandomizing polynomial identity testing implies circuit lower bounds. Specifically, it implies that either or the integer Permanent does not have polynomial-size arithmetic circuits.
In [AMS08] we have observed that an analogous result also holds in the noncommutative setting. I.e., if noncommutative PIT has a deterministic polynomial-time algorithm then either or the noncommutative Permanent function does not have polynomial-size noncommutative circuits.
The connection that we show here between derandomizing the isolation lemma and noncommutative circuit size lower bounds is based on the above observation and our noncommutative polynomial identity test based on the isolation lemma.
Klivans and Spielman [KS01] apply a more general form of the isolation lemma to obtain a polynomial identity test (in the commutative) case. This lemma is stated below.
[KS01, Lemma 4] Let be any collection of linear forms over variables with integer coefficients in the range . If each is picked independently and uniformly at random from then with probability at least there is a unique linear form from that attains minimum value at .
We can formulate a restricted version of this lemma similar to Lemma 1.3 that will apply only to sets of linear forms accepted by a boolean circuit . More precisely, an integer vector such that is in if and only if is accepted by the boolean circuit .
Thus, for this form of the isolation lemma we can formulate another derandomization hypothesis analogous to Hypothesis 1 as follows.
Hypothesis 3. There is a deterministic algorithm that takes as input , where is a boolean circuit that takes as input such that , and outputs a collection of weight functions such that , with the property that for some weight vector there is a unique linear form accepted by which attains the minimum value . Furthermore, runs in time subexponential in .
Automata Theory background
For a string we define to be the matrix product . If is the empty string, define to be the identity matrix of dimension . Let denote the natural extension of the transition function to ; if is the empty string, is simply the identity function. We have
Thus, is also a matrix of zeros and ones for any string . Also, if and only if is accepted by the automaton .
This subsection is reproduced from [AMS08] to make this paper self-contained.
We observe the following property: the matrix output of on is determined completely by the polynomial computed by ; the structure of the circuit is otherwise irrelevant. This is important for us, since we are only interested in . In particular, the output is always when .
Proof. The proof is an easy consequence of the definitions and the properties of the matrices stated in Section 2. Note that . But , where is the binary string representing monomial . By Equation 1, we know that is if is accepted by , and otherwise. Adding up, we obtain the result.
We now explain the role of the automaton in testing if the polynomial computed by is identically zero. Our basic idea is to design an automaton that accepts exactly one word from among all the words that correspond to the nonzero terms in . This would ensure that is the nonzero coefficient of the monomial filtered out. More precisely, we will use the above theorem primarily in the following form, which we state as a corollary.
If rejects every string corresponding to a monomial in , then .
If accepts exactly one string corresponding to a monomial in , then is the nonzero coefficient of that monomial in .
Moreover, can be computed in time .
Proof. Both points () and () are immediate consequences of the above theorem. The complexity of computing easily follows from its definition.
Another interesting corollary to the above theorem is the following.
Proof. Apply Corollary 2.2 with being any standard automaton that accepts the string corresponding to monomial and rejects every other string. Clearly, can be chosen so that has a unique accepting state and .
Noncommutative identity test based on isolation lemma
We now describe a new identity test for noncommutative circuits based on the isolation lemma. It is directly based on the results from [AMS08]. This is conceptually quite different from the randomized identity test of Bogdanov and Wee [BW05].
Proof. Let and . Consider the set of tuples . Let be a nonzero monomial of . Then the monomial can be identified with the following subset of :
Let denotes the family of subsets of corresponding to the nonzero monomials of i.e,
By the Isolation Lemma we know that if we assign random weights from to the elements of , with probability at least , there is a unique minimum weight set in . Our aim will be to construct a family of small size automatons which are indexed by weights and , such that the automata will precisely accept all the strings (corresponding to the monomials) of length , such that the weight of is . Then from the isolation lemma we will argue that the automata corresponding to the minimum weight will precisely accept only one string (monomial). Now for , and , we describe the construction of the automaton as follows: , , and . We define the transition function ,
where is the random weight assign to . Our automata family is simply,
Now for each of the automaton , we mimic the run of the automaton on the circuit as described in Section 2. If the output matrix corresponding to any of the automaton is nonzero, our algorithm declares , otherwise declares .
Noncommutative identity testing and circuit lower bounds
For commutative circuits, Impagliazzo and Kabanets [KI03] have shown that derandomizing PIT implies circuit lower bounds. It implies that either or the integer Permanent does not have polynomial-size arithmetic circuits.
In [AMS08] we have observed that this also holds in the noncommutative setting. I.e., if noncommutative PIT has a deterministic polynomial-time algorithm then either or the noncommutative Permanent function does not have polynomial-size noncommutative circuits. We note here that noncommutative circuit lower bounds are sometimes easier to prove than for commutative circuits. E.g. Nisan [N91] has shown exponential-size lower bounds for noncommutative formula size and further results are known for pure noncommutative circuits [N91, RS05]. However, proving superpolynomial size lower bounds for general noncommutative circuits computing the Permanent has remained an open problem.
To keep this paper self contained, we briefly recall the discussion from [AMS08].
The noncommutative Permanent function is defined as
Let SUBEXP denote and NSUBEXP denote .
The Results
We are now ready to prove our first result. Suppose the derandomization Hypothesis 1 holds (as stated in the introduction): i.e. suppose there is a deterministic algorithm that takes as input where is an -input boolean circuit and in subexponential time computes a set of weight functions , such that the set system defined by the circuit has a unique minimum weight set w.r.t. at least one of the weight functions .
Let be a noncommutative arithmetic circuit of degree bounded by a polynomial in . By Corollary 2.3, there is a deterministic polynomial-time algorithm that takes as input and a monomial of degree at most and accepts if and only if the monomial has nonzero coefficient in the polynomial computed by . Thus, we have a boolean circuit of size polynomial in that accepts only the (binary encodings of) monomials , that have nonzero coefficients in the polynomial computed by . Now, as a consequence of Theorem 3.1 and its proof we have a deterministic subexponential algorithm for checking if , assuming algorithm exists. Namely, we compute the boolean circuit from in polynomial time. Then, invoking algorithm with as input we compute at most subexponentially many weight functions . Then, following the proof of Theorem 3.1 we construct the automata corresponding to these weight functions and evaluate on the matrices that each of these automata define in the prescribed manner. By assumption about algorithm , if then one of these will give matrix inputs for the variables on which evaluates to a nonzero matrix. We can now show the following theorem.
If the subexponential time algorithm satisfying Hypothesis 1 exists then noncommutative identity testing is in SUBEXP which implies that either or the Permanent does not have polynomial size noncommutative circuits.
Proof. The result is a direct consequence of the discussion preceding the theorem statement and Theorem 4.1.
We now turn to the result under the stronger derandomization Hypothesis 2 (stated in the introduction). More precisely, suppose there is a deterministic algorithm that takes as input and in time polynomial in computes a set of weight functions , such that for each -input boolean circuit of size , the set system defined by the circuit has a unique minimum weight set w.r.t. at least one of the weight functions . We show that there is an explicit polynomialBy explicit we mean that the coefficients of are computable in time exponential in . in noncommuting variables that does not have subexponential size noncommutative circuits.
Proof. Let denote the set of all sequences , for , . For each such sequence let denote the monomial . Now, we write
where we will pick the scalars appropriately so that the polynomial has the claimed property. Suppose runs in time for constant , where denotes the size bound of the boolean circuit defining set system . Notice that the number of weight functions is bounded by . As explained in Theorem 3.1, each weight function will give rise to a collection of automata , each of which will prescribe matrices of dimension at most to be assigned for the input variables . Call these matrices . For each weight function write down linear equations for each .
This will actually give us a system of at most linear equations in the unknown scalars . Since there are weight functions in all, all the linear constraints put together give us a system of at most linear equations. Now, the number of distinct (noncommuting) monomials is which asymptotically exceeds for , since is polynomially bounded. Thus, the system of linear equations has a nontrivial solution in the ’s that can be computed using Gaussian elimination in time exponential in .
Notice that the polynomial , defined by the solution to the ’s, is a nonzero polynomial. We claim that cannot have a noncommutative circuit of size . Assume to the contrary that is a noncommutative circuit of size for . Then, by Corollary 2.3 there is an -input boolean circuit of size that accepts precisely the (binary encodings) of those monomials that are nonzero in . Let be the weight functions output by for input . By Hypothesis 2, for some weight function and some the circuit must be nonzero on matrices . However, evaluates to zero, by construction, on the matrix inputs prescribed by all the weight functions . This is a contradiction to the assumption and it completes the proof.
We can formulate both Hypothesis 1 and Hypothesis 2 more generally by letting the running time of algorithms and be a function . We will then obtain suitably quantified circuit lower bound results as consequence.
We now show that under the derandomization Hypothesis 3 (stated in the introduction) we can obtain a stronger consequence than Theorem 5.1.
Coming to the proof of this theorem, if then we are done. So, suppose . Notice that given any monomial of total degree bounded by we can test if it is a nonzero monomial of in exponential time ( explicitly listing down the monomials of the polynomial computed by ). Therefore, since there is a polynomial-size boolean circuit that accepts the vector iff is a nonzero monomial in the given polynomial (as required for application of Hypothesis 3).
Now, we invoke the derandomization Hypothesis 3. We can apply the Klivans-Spielman polynomial identity test, explained above, to the arithmetic circuit for each of the weight vectors generated by algorithm to obtain a subexponential deterministic identity test for the circuit by the properties of . Now, following the argument of Impagliazzo-Kabanets [KI03] it is easy to derive that the integer Permanent does not have polynomial size arithmetic circuits.
We formulate a stronger version of Hypothesis 3 to obtain a conclusion similar to Theorem 5.2 for commutative circuits. For example we can formulate the hypothesis:
There is a deterministic algorithm that takes as input and outputs a collection of weight functions such that , with the property that for each size , -input oracle boolean circuit (where is EXP-complete) that takes as input such that , there is some weight vector for which there is a unique linear form accepted by which attains the minimum value . Furthermore, runs in time polynomial in .
It is easy to see that, similar to Theorem 5.2, as a consequence of this hypothesis there is some explicit polynomial (i.e. computable in EXP) which does not have commutative circuits of subexponential size.
Discussion
An interesting open question is whether derandomizing similar restricted versions of the Valiant-Vazirani lemma also implies circuit lower bounds. We recall the Valiant-Vazirani lemma as stated in the original paper [VV86].
Let . Suppose are picked uniformly at random from . For each , let and let be the probability that for some . Then .
Analogous to our discussion in Section 1, here too we can consider the restricted version where we consider to be the set of -bit vectors accepted by a boolean circuit of size . We can similarly formulate derandomization hypotheses similar to Hypotheses 1 and 2.
Acknowledgements. We are grateful to Manindra Agrawal for interesting discussions and his suggestion that Theorem 5.2 can be obtained from the stronger hypothesis. We also thank Srikanth Srinivasan for discussions.