Derandomizing the Isolation Lemma and Lower Bounds for Circuit Size

V. Arvind, Partha Mukhopadhyay

Introduction

[MVV87] Let UU be an universe of size nn and F\mathcal{F} be any family of subsets of UU. Let w:U→[2n]w:U\rightarrow[2n] denote a weight assignment function to elements of UU. Then,

where the weight function ww is picked uniformly at random.

In the seminal paper [MVV87] Mulmuley et al apply the isolation lemma to give a randomized NC algorithm for computing maximum cardinality matchings for general graphs (also see [ARZ99]). Since then the isolation lemma has found several other applications. For example, it is crucially used in the proof of the result that \mboxNL⊂\mboxUL/\mboxpoly\mbox{\rm NL}\subset\mbox{\rm UL}/\mbox{\rm poly} [AR00] and in designing randomized NC algorithms for linear representable matroid problems [NSV94]. It is also known that the isolation lemma can be used to prove the Valiant-Vazirani lemma that SAT is many-one reducible via randomized reductions to USAT.

Whether the matching problem is in deterministic NC, and whether \mboxNL⊆\mboxUL\mbox{\rm NL}\subseteq\mbox{\rm UL} are outstanding open problems. Thus, the question whether the isolation lemma can be derandomized is clearly important.

As noted in [Agr07], it is easy to see by a counting argument that the isolation lemma can not be derandomized, in general, because there are 22n2^{2^{n}} set systems F\mathcal{F}. More formally, the following is observed in [Agr07].

[Agr07] The Isolation Lemma can not be fully derandomized if we allow weight functions w:U→[nc]w:U\rightarrow[n^{c}] for a constant cc (i.e. weight functions with a polynomial range). More precisely, for any polynomially bounded collection of weight assignments {wi}i∈[nc1]\{w_{i}\}_{i\in[n^{c_{1}}]} with weight range [nc][n^{c}], there exists a family F\mathcal{F} of [n][n] such that for all j∈[nc1]j\in[n^{c_{1}}], there exists two minimal weight subsets with respect to wjw_{j}.

However that does not rule out the derandomization of any special usage of the isolation lemma. Indeed, for all applications of the isolation lemma (mentioned above, for instance) we are interested only in exponentially many set systems F⊆2U\mathcal{F}\subseteq 2^{U}.

We make the setting more precise by giving a general framework. Fix the universe U=[n]U=[n] and consider an nn-input boolean circuit CC where size(C)=m\it size(C)=m. The set 2U2^{U} of all subsets of UU is in a natural 11-11 correspondence with the length nn-binary strings {0,1}n\{0,1\}^{n}: each subset S⊆US\subseteq U corresponds to its characteristic binary string χS∈{0,1}n\chi_{S}\in\{0,1\}^{n} whose ithi^{th} bit is 11 iff i∈Si\in S. Thus the nn-input boolean circuit CC implicitly defines the set system

As an easy consequence of Lemma 1.1 we have the following.

Let UU be an universe of size nn and CC be an nn-input boolean circuit of size mm. Let FC⊆2U\mathcal{F}_{C}\subseteq 2^{U} be the family of subsets of UU defined by circuit CC. Let w:U→[2n]w:U\rightarrow[2n] denote a weight assignment function to elements of UU. Then,

where the weight function ww is picked uniformly at random. Furthermore, there is a collection of weight functions {wi}1≤i≤p(m,n)\{w_{i}\}_{1\leq i\leq p(m,n)}, where p(m,n)p(m,n) is a fixed polynomial, such that for each FC\mathcal{F}_{C} there is a weight function wiw_{i} w.r.t. which there is a unique minimum weight set in FC\mathcal{F}_{C}.

Lemma 1.3 allows us to formulate two natural and reasonable derandomization hypotheses for the isolation lemma.

Hypothesis 1. There is a deterministic algorithm A1\mathcal{A}_{1} that takes as input (C,n)(C,n), where CC is an nn-input boolean circuit, and outputs a collection of weight functions w1,w2,⋯ ,wtw_{1},w_{2},\cdots,w_{t} such that wi:[n]→[2n]w_{i}:[n]\rightarrow[2n], with the property that for some wiw_{i} there is a unique minimum weight set in the set system FC\mathcal{F}_{C}. Furthermore, A1\mathcal{A}_{1} runs in time subexponential in size(C)\it size(C).

Hypothesis 2. There is a deterministic algorithm A2\mathcal{A}_{2} that takes as input (m,n)(m,n) in unary and outputs a collection of weight functions w1,w2,⋯ ,wtw_{1},w_{2},\cdots,w_{t} such that wi:[n]→[2n]w_{i}:[n]\rightarrow[2n], with the property that for each size mm boolean circuit CC with nn inputs there is some weight function wiw_{i} w.r.t. which FC\mathcal{F}_{C} has a unique minimum weight set. Furthermore, A2\mathcal{A}_{2} runs in time polynomial in mm.

Clearly, Hypothesis 2 is stronger than Hypothesis 1. It demands a “black-box” derandomization in the sense that A2\mathcal{A}_{2} efficiently computes a collection of weight functions that will work for any set system in 2U2^{U} specified by a boolean circuit of size mm.

Notice that a random collection w1,⋯ ,wtw_{1},\cdots,w_{t} of weight functions will fulfil the required property of either hypotheses with high probability. Thus, the derandomization hypotheses are plausible. Indeed, it is not hard to see that suitable standard hardness assumptions that yield pseudorandom generators for derandomizing BPP would imply these hypotheses. We do not elaborate on this here. In this paper we show the following consequences of Hypotheses 1 and 2.

Hypothesis 1 implies that either \mboxNEXP⊄\mboxP/\mboxpoly\mbox{\small\rm NEXP}\not\subset\mbox{\rm P}/\mbox{\rm poly} or the Permanent does not have polynomial size noncommutative arithmetic circuits.

These two results are a consequence of an identity testing algorithm for noncommutative circuits that is based on the isolation lemma. This algorithm is based on ideas from [AMS08] where we used automata theory to pick matrices from a suitable matrix ring and evaluate the given arithmetic circuit on these matrices. In the next section, we describe the background and then give the identity test in the following section.

Notice that derandomizing the isolation lemma in specific applications like the RNC\rm RNC algorithm for matchings [MVV87] and the containment \mboxNL⊆\mboxUL/\mboxpoly\mbox{\rm NL}\subseteq\mbox{\rm UL}/\mbox{\rm poly} [AR00] might still be possible without implying such circuit size lower bounds.

Our result in this paper is similar in flavor to the Impagliazzo-Kabanets result [KI03], where for commutative polynomial identity testing they show that derandomizing polynomial identity testing implies circuit lower bounds. Specifically, it implies that either \mboxNEXP⊄\mboxP/poly\mbox{\small\rm NEXP}\not\subset\mbox{\rm P/poly} or the integer Permanent does not have polynomial-size arithmetic circuits.

In [AMS08] we have observed that an analogous result also holds in the noncommutative setting. I.e., if noncommutative PIT has a deterministic polynomial-time algorithm then either \mboxNEXP⊄\mboxP/poly\mbox{\small\rm NEXP}\not\subset\mbox{\rm P/poly} or the noncommutative Permanent function does not have polynomial-size noncommutative circuits.

The connection that we show here between derandomizing the isolation lemma and noncommutative circuit size lower bounds is based on the above observation and our noncommutative polynomial identity test based on the isolation lemma.

Klivans and Spielman [KS01] apply a more general form of the isolation lemma to obtain a polynomial identity test (in the commutative) case. This lemma is stated below.

[KS01, Lemma 4] Let LL be any collection of linear forms over variables z1,z2,⋯ ,znz_{1},z_{2},\cdots,z_{n} with integer coefficients in the range {0,1,⋯ ,K}\{0,1,\cdots,K\}. If each ziz_{i} is picked independently and uniformly at random from {0,1,⋯ ,2Kn}\{0,1,\cdots,2Kn\} then with probability at least 1/21/2 there is a unique linear form from CC that attains minimum value at (z1,⋯ ,zn)(z_{1},\cdots,z_{n}).

We can formulate a restricted version of this lemma similar to Lemma 1.3 that will apply only to sets of linear forms LL accepted by a boolean circuit CC. More precisely, an integer vector (α1,⋯ ,αn)(\alpha_{1},\cdots,\alpha_{n}) such that αi∈{0,⋯ ,K}\alpha_{i}\in\{0,\cdots,K\} is in LL if and only if (α1,⋯ ,αn)(\alpha_{1},\cdots,\alpha_{n}) is accepted by the boolean circuit CC.

Thus, for this form of the isolation lemma we can formulate another derandomization hypothesis analogous to Hypothesis 1 as follows.

Hypothesis 3. There is a deterministic algorithm A3\mathcal{A}_{3} that takes as input (C,n,K)(C,n,K), where CC is a boolean circuit that takes as input (α1,⋯ ,αn)(\alpha_{1},\cdots,\alpha_{n}) such that αi∈{0,⋯ ,K}\alpha_{i}\in\{0,\cdots,K\}, and outputs a collection of weight functions w1,w2,⋯ ,wtw_{1},w_{2},\cdots,w_{t} such that wi:[n]→[2Kn]w_{i}:[n]\rightarrow[2Kn], with the property that for some weight vector wiw_{i} there is a unique linear form (α1,⋯ ,αn)(\alpha_{1},\cdots,\alpha_{n}) accepted by CC which attains the minimum value ∑j=1nwi(j)αj\sum_{j=1}^{n}w_{i}(j)\alpha_{j}. Furthermore, A3\mathcal{A}_{3} runs in time subexponential in size(C)\it size(C).

Automata Theory background

For a string w=w1w2⋯wk∈{0,1}∗w=w_{1}w_{2}\cdots w_{k}\in\{0,1\}^{*} we define MwM_{w} to be the matrix product Mw1Mw2⋯MwkM_{w_{1}}M_{w_{2}}\cdots M_{w_{k}}. If ww is the empty string, define MwM_{w} to be the identity matrix of dimension ∣Q∣×∣Q∣|Q|\times|Q|. Let δw\delta_{w} denote the natural extension of the transition function to ww; if ww is the empty string, δw\delta_{w} is simply the identity function. We have

Thus, MwM_{w} is also a matrix of zeros and ones for any string ww. Also, Mw(q0,qf)=1M_{w}(q_{0},q_{f})=1 if and only if ww is accepted by the automaton AA.

This subsection is reproduced from [AMS08] to make this paper self-contained.

We observe the following property: the matrix output MoutM_{out} of CC on AA is determined completely by the polynomial ff computed by CC; the structure of the circuit CC is otherwise irrelevant. This is important for us, since we are only interested in ff. In particular, the output is always when f≡0f\equiv 0.

Proof. The proof is an easy consequence of the definitions and the properties of the matrices MwM_{w} stated in Section 2. Note that Mout=f(Mv1,⋯ ,Mvn)M_{out}=f(M_{v_{1}},\cdots,M_{v_{n}}). But f(Mv1,⋯ ,Mvn)=∑i=1sciMwif(M_{v_{1}},\cdots,M_{v_{n}})=\sum_{i=1}^{s}c_{i}M_{w_{i}}, where wi=vi1⋯vidiw_{i}=v_{i_{1}}\cdots v_{i_{d_{i}}} is the binary string representing monomial mim_{i}. By Equation 1, we know that Mwi(q0,qf)M_{w_{i}}(q_{0},q_{f}) is 11 if wiw_{i} is accepted by AA, and otherwise. Adding up, we obtain the result.

We now explain the role of the automaton AA in testing if the polynomial ff computed by CC is identically zero. Our basic idea is to design an automaton AA that accepts exactly one word from among all the words that correspond to the nonzero terms in ff. This would ensure that Mout(q0,qf)M_{out}(q_{0},q_{f}) is the nonzero coefficient of the monomial filtered out. More precisely, we will use the above theorem primarily in the following form, which we state as a corollary.

If AA rejects every string corresponding to a monomial in ff, then Mout(q0,qf)=0M_{out}(q_{0},q_{f})=0.

If AA accepts exactly one string corresponding to a monomial in ff, then Mout(q0,qf)M_{out}(q_{0},q_{f}) is the nonzero coefficient of that monomial in ff.

Moreover, MoutM_{out} can be computed in time \mboxpoly(∣C∣,∣A∣,n)\mbox{\rm poly}(|C|,|A|,n).

Proof. Both points (11) and (22) are immediate consequences of the above theorem. The complexity of computing MoutM_{out} easily follows from its definition.

Another interesting corollary to the above theorem is the following.

Proof. Apply Corollary 2.2 with AA being any standard automaton that accepts the string corresponding to monomial mm and rejects every other string. Clearly, AA can be chosen so that AA has a unique accepting state and ∣A∣=O(ndm)|A|=O(nd_{m}).

Noncommutative identity test based on isolation lemma

We now describe a new identity test for noncommutative circuits based on the isolation lemma. It is directly based on the results from [AMS08]. This is conceptually quite different from the randomized identity test of Bogdanov and Wee [BW05].

Proof. Let [d]={1,2,⋯ ,d}[d]=\{1,2,\cdots,d\} and [n]={1,2,⋯ ,n}[n]=\{1,2,\cdots,n\}. Consider the set of tuples U=[d]×[n]U=[d]\times[n]. Let v=xi1xi2⋯xitv=x_{i_{1}}x_{i_{2}}\cdots x_{i_{t}} be a nonzero monomial of ff. Then the monomial can be identified with the following subset SvS_{v} of UU :

Let F\mathcal{F} denotes the family of subsets of UU corresponding to the nonzero monomials of ff i.e,

By the Isolation Lemma we know that if we assign random weights from [2dn][2dn] to the elements of UU, with probability at least 1/21/2, there is a unique minimum weight set in F\mathcal{F}. Our aim will be to construct a family of small size automatons which are indexed by weights w∈[2nd2]w\in[2nd^{2}] and t∈[d]t\in[d], such that the automata Aw,tA_{w,t} will precisely accept all the strings (corresponding to the monomials) vv of length tt, such that the weight of SvS_{v} is ww. Then from the isolation lemma we will argue that the automata corresponding to the minimum weight will precisely accept only one string (monomial). Now for w∈[2nd2]w\in[2nd^{2}], and t∈[d]t\in[d], we describe the construction of the automaton Aw,t=(Q,Σ,δ,q0,F)A_{w,t}=(Q,\Sigma,\delta,q_{0},F) as follows: Q=[d]×[2nd2]∪{(0,0)}Q=[d]\times[2nd^{2}]\cup\{(0,0)\}, Σ={x1,x2,⋯ ,xn}\Sigma=\{x_{1},x_{2},\cdots,x_{n}\}, q0={(0,0)}q_{0}=\{(0,0)\} and F={(t,w)}F=\{(t,w)\}. We define the transition function δ:Q×Σ→Q\delta:Q\times\Sigma\rightarrow Q,

where WW is the random weight assign to (i+1,j)(i+1,j). Our automata family A\mathcal{A} is simply,

Now for each of the automaton Aw,t∈AA_{w,t}\in\mathcal{A}, we mimic the run of the automaton Aw,tA_{w,t} on the circuit CC as described in Section 2. If the output matrix corresponding to any of the automaton is nonzero, our algorithm declares f≠0f\neq 0, otherwise declares f≡0f\equiv 0.

Noncommutative identity testing and circuit lower bounds

For commutative circuits, Impagliazzo and Kabanets [KI03] have shown that derandomizing PIT implies circuit lower bounds. It implies that either \mboxNEXP⊄\mboxP/poly\mbox{\small\rm NEXP}\not\subset\mbox{\rm P/poly} or the integer Permanent does not have polynomial-size arithmetic circuits.

In [AMS08] we have observed that this also holds in the noncommutative setting. I.e., if noncommutative PIT has a deterministic polynomial-time algorithm then either \mboxNEXP⊄\mboxP/poly\mbox{\small\rm NEXP}\not\subset\mbox{\rm P/poly} or the noncommutative Permanent function does not have polynomial-size noncommutative circuits. We note here that noncommutative circuit lower bounds are sometimes easier to prove than for commutative circuits. E.g. Nisan [N91] has shown exponential-size lower bounds for noncommutative formula size and further results are known for pure noncommutative circuits [N91, RS05]. However, proving superpolynomial size lower bounds for general noncommutative circuits computing the Permanent has remained an open problem.

To keep this paper self contained, we briefly recall the discussion from [AMS08].

The noncommutative Permanent function Perm(x1,⋯ ,xn)∈R{x1,⋯ ,xn}Perm(x_{1},\cdots,x_{n})\in R\{x_{1},\cdots,x_{n}\} is defined as

Let SUBEXP denote ∩ϵ>0DTIME(2nϵ)\cap_{\epsilon>0}\rm DTIME(2^{n^{\epsilon}}) and NSUBEXP denote ∩ϵ>0NTIME(2nϵ)\cap_{\epsilon>0}\rm NTIME(2^{n^{\epsilon}}).

The Results

We are now ready to prove our first result. Suppose the derandomization Hypothesis 1 holds (as stated in the introduction): i.e. suppose there is a deterministic algorithm A1\mathcal{A}_{1} that takes as input (C,n)(C,n) where CC is an nn-input boolean circuit and in subexponential time computes a set of weight functions w1,w2,⋯ ,wtw_{1},w_{2},\cdots,w_{t}, wi:[n]→[2n]w_{i}:[n]\rightarrow[2n] such that the set system FC\mathcal{F}_{C} defined by the circuit CC has a unique minimum weight set w.r.t. at least one of the weight functions wiw_{i}.

Let C′(x1,x2,⋯ ,xn)C^{\prime}(x_{1},x_{2},\cdots,x_{n}) be a noncommutative arithmetic circuit of degree dd bounded by a polynomial in size(C′)\it size(C^{\prime}). By Corollary 2.3, there is a deterministic polynomial-time algorithm that takes as input C′C^{\prime} and a monomial mm of degree at most dd and accepts if and only if the monomial mm has nonzero coefficient in the polynomial computed by C′C^{\prime}. Thus, we have a boolean circuit CC of size polynomial in size(C′)\it size(C^{\prime}) that accepts only the (binary encodings of) monomials xi1xi2⋯xikx_{i_{1}}x_{i_{2}}\cdots x_{i_{k}}, k≤dk\leq d that have nonzero coefficients in the polynomial computed by C′C^{\prime}. Now, as a consequence of Theorem 3.1 and its proof we have a deterministic subexponential algorithm for checking if C′≡0C^{\prime}\equiv 0, assuming algorithm A1\mathcal{A}_{1} exists. Namely, we compute the boolean circuit CC from C′C^{\prime} in polynomial time. Then, invoking algorithm A1\mathcal{A}_{1} with CC as input we compute at most subexponentially many weight functions w1,⋯ ,wtw_{1},\cdots,w_{t}. Then, following the proof of Theorem 3.1 we construct the automata corresponding to these weight functions and evaluate C′C^{\prime} on the matrices that each of these automata define in the prescribed manner. By assumption about algorithm A1\mathcal{A}_{1}, if C′≢0C^{\prime}\not\equiv 0 then one of these wiw_{i} will give matrix inputs for the variables xj,1≤j≤nx_{j},1\leq j\leq n on which C′C^{\prime} evaluates to a nonzero matrix. We can now show the following theorem.

If the subexponential time algorithm A1\mathcal{A}_{1} satisfying Hypothesis 1 exists then noncommutative identity testing is in SUBEXP which implies that either \mboxNEXP⊄\mboxP/\mboxpoly\mbox{\small\rm NEXP}\not\subset\mbox{\rm P}/\mbox{\rm poly} or the Permanent does not have polynomial size noncommutative circuits.

Proof. The result is a direct consequence of the discussion preceding the theorem statement and Theorem 4.1.

We now turn to the result under the stronger derandomization Hypothesis 2 (stated in the introduction). More precisely, suppose there is a deterministic algorithm A2\mathcal{A}_{2} that takes as input (m,n)(m,n) and in time polynomial in mm computes a set of weight functions w1,w2,⋯ ,wtw_{1},w_{2},\cdots,w_{t}, wi:[n]→[2n]w_{i}:[n]\rightarrow[2n] such that for each nn-input boolean circuit CC of size mm, the set system FC\mathcal{F}_{C} defined by the circuit CC has a unique minimum weight set w.r.t. at least one of the weight functions wiw_{i}. We show that there is an explicit polynomialBy explicit we mean that the coefficients of ff are computable in time exponential in nn. f(x1,⋯ ,xn)f(x_{1},\cdots,x_{n}) in noncommuting variables xix_{i} that does not have subexponential size noncommutative circuits.

Proof. Let TnT_{n} denote the set of all sequences (i1,i2,⋯ ,in)(i_{1},i_{2},\cdots,i_{n}), for ij∈[n]i_{j}\in[n], 1≤j≤n1\leq j\leq n. For each such sequence α=(i1,i2,⋯ ,in)∈Tn\alpha=(i_{1},i_{2},\cdots,i_{n})\in T_{n} let mαm_{\alpha} denote the monomial xi1xi2⋯xinx_{i_{1}}x_{i_{2}}\cdots x_{i_{n}}. Now, we write

where we will pick the scalars cαc_{\alpha} appropriately so that the polynomial ff has the claimed property. Suppose A2\mathcal{A}_{2} runs in time mcm^{c} for constant c>0c>0, where mm denotes the size bound of the boolean circuit CC defining set system FC\mathcal{F}_{C}. Notice that the number tt of weight functions is bounded by mcm^{c}. As explained in Theorem 3.1, each weight function will give rise to a collection of 2n42n^{4} automata Ak\mathcal{A}_{k}, each of which will prescribe matrices of dimension at most r=\mboxpoly(n)r=\mbox{\rm poly}(n) to be assigned for the input variables xj,1≤j≤nx_{j},1\leq j\leq n. Call these matrices Mi,j(k)M^{(k)}_{i,j}. For each weight function wiw_{i} write down linear equations for each k∈[2n4]k\in[2n^{4}].

This will actually give us a system of at most 2n4r22n^{4}r^{2} linear equations in the unknown scalars cαc_{\alpha}. Since there are t≤mct\leq m^{c} weight functions in all, all the linear constraints put together give us a system of at most 2n4r2mc2n^{4}r^{2}m^{c} linear equations. Now, the number of distinct (noncommuting) monomials mαm_{\alpha} is nn=2nlg⁡nn^{n}=2^{n\lg n} which asymptotically exceeds 2n4r2mc2n^{4}r^{2}m^{c} for m=2o(nlg⁡n)m=2^{o(n\lg n)}, since rr is polynomially bounded. Thus, the system of linear equations has a nontrivial solution in the cαc_{\alpha}’s that can be computed using Gaussian elimination in time exponential in nn.

Notice that the polynomial f(x1,⋯ ,xn)f(x_{1},\cdots,x_{n}), defined by the solution to the cαc_{\alpha}’s, is a nonzero polynomial. We claim that ff cannot have a noncommutative circuit of size 2o(nlg⁡n)2^{o(n\lg n)}. Assume to the contrary that C′(x1,⋯ ,xn)C^{\prime}(x_{1},\cdots,x_{n}) is a noncommutative circuit of size s=2o(nlg⁡n)s=2^{o(n\lg n)} for ff. Then, by Corollary 2.3 there is an n′n^{\prime}-input boolean circuit CC of size m=sO(1)=2o(nlg⁡n)m=s^{O(1)}=2^{o(n\lg n)} that accepts precisely the (binary encodings) of those monomials that are nonzero in C′C^{\prime}. Let w1,⋯ ,wtw_{1},\cdots,w_{t} be the weight functions output by A2\mathcal{A}_{2} for input (m,n′)(m,n^{\prime}). By Hypothesis 2, for some weight function wiw_{i} and some k∈[2n4]k\in[2n^{4}] the circuit C′C^{\prime} must be nonzero on matrices Mi,j(k)M^{(k)}_{i,j}. However, ff evaluates to zero, by construction, on the matrix inputs prescribed by all the weight functions w1,⋯ ,wtw_{1},\cdots,w_{t}. This is a contradiction to the assumption and it completes the proof.

We can formulate both Hypothesis 1 and Hypothesis 2 more generally by letting the running time of algorithms A1\mathcal{A}_{1} and A2\mathcal{A}_{2} be a function t(m,n)t(m,n). We will then obtain suitably quantified circuit lower bound results as consequence.

We now show that under the derandomization Hypothesis 3 (stated in the introduction) we can obtain a stronger consequence than Theorem 5.1.

Coming to the proof of this theorem, if \mboxNEXP⊄\mboxP/\mboxpoly\mbox{\small\rm NEXP}\not\subset\mbox{\rm P}/\mbox{\rm poly} then we are done. So, suppose \mboxNEXP⊂\mboxP/\mboxpoly\mbox{\small\rm NEXP}\subset\mbox{\rm P}/\mbox{\rm poly}. Notice that given any monomial x1d1⋯xndnx_{1}^{d_{1}}\cdots x_{n}^{d_{n}} of total degree bounded by dd we can test if it is a nonzero monomial of C^\hat{C} in exponential time ( explicitly listing down the monomials of the polynomial computed by C^\hat{C}). Therefore, since \mboxNEXP⊂\mboxP/\mboxpoly\mbox{\small\rm NEXP}\subset\mbox{\rm P}/\mbox{\rm poly} there is a polynomial-size boolean circuit CC that accepts the vector (d1,⋯ ,dn)(d_{1},\cdots,d_{n}) iff x1d1⋯xndnx_{1}^{d_{1}}\cdots x_{n}^{d_{n}} is a nonzero monomial in the given polynomial (as required for application of Hypothesis 3).

Now, we invoke the derandomization Hypothesis 3. We can apply the Klivans-Spielman polynomial identity test, explained above, to the arithmetic circuit C^\hat{C} for each of the tt weight vectors w1,⋯ ,wtw_{1},\cdots,w_{t} generated by algorithm A3\mathcal{A}_{3} to obtain a subexponential deterministic identity test for the circuit C^\hat{C} by the properties of A3\mathcal{A}_{3}. Now, following the argument of Impagliazzo-Kabanets [KI03] it is easy to derive that the integer Permanent does not have polynomial size arithmetic circuits.

We formulate a stronger version of Hypothesis 3 to obtain a conclusion similar to Theorem 5.2 for commutative circuits. For example we can formulate the hypothesis:

There is a deterministic algorithm A4\mathcal{A}_{4} that takes as input (m,n,K)(m,n,K) and outputs a collection of weight functions w1,w2,⋯ ,wtw_{1},w_{2},\cdots,w_{t} such that wi:[n]→[2n]w_{i}:[n]\rightarrow[2n], with the property that for each size mm, nn-input oracle boolean circuit CAC^{A} (where AA is EXP-complete) that takes as input (α1,⋯ ,αn)(\alpha_{1},\cdots,\alpha_{n}) such that αi∈{0,⋯ ,K}\alpha_{i}\in\{0,\cdots,K\}, there is some weight vector wiw_{i} for which there is a unique linear form (α1,⋯ ,αn)(\alpha_{1},\cdots,\alpha_{n}) accepted by CAC^{A} which attains the minimum value ∑j=1nwi(j)αj\sum_{j=1}^{n}w_{i}(j)\alpha_{j}. Furthermore, A4\mathcal{A}_{4} runs in time polynomial in mm.

It is easy to see that, similar to Theorem 5.2, as a consequence of this hypothesis there is some explicit polynomial f(x1,⋯ ,xn)f(x_{1},\cdots,x_{n}) (i.e. computable in EXP) which does not have commutative circuits of subexponential size.

Discussion

An interesting open question is whether derandomizing similar restricted versions of the Valiant-Vazirani lemma also implies circuit lower bounds. We recall the Valiant-Vazirani lemma as stated in the original paper [VV86].

Let S⊆{0,1}tS\subseteq\{0,1\}^{t}. Suppose wi,1≤i≤tw_{i},1\leq i\leq t are picked uniformly at random from {0,1}t\{0,1\}^{t}. For each ii, let Si={v∈S∣v.wj=0,1≤j≤i}S_{i}=\{v\in S\mid v.w_{j}=0,1\leq j\leq i\} and let pt(S)p_{t}(S) be the probability that ∣Si∣=1|S_{i}|=1 for some ii. Then pt(S)≥1/4p_{t}(S)\geq 1/4.

Analogous to our discussion in Section 1, here too we can consider the restricted version where we consider SC⊆{0,1}nS_{C}\subseteq\{0,1\}^{n} to be the set of nn-bit vectors accepted by a boolean circuit CC of size mm. We can similarly formulate derandomization hypotheses similar to Hypotheses 1 and 2.

Acknowledgements. We are grateful to Manindra Agrawal for interesting discussions and his suggestion that Theorem 5.2 can be obtained from the stronger hypothesis. We also thank Srikanth Srinivasan for discussions.

References