Decompositions, approximate structure, transference, and the Hahn-Banach theorem

W. T. Gowers

Introduction

This paper has several purposes. One is to provide a survey of some of the major recent developments in the rapidly growing field that has come to be known as additive combinatorics, focusing on three classes of theorems: decomposition theorems, approximate structural theorems and transference principles. (An explanation of these phrases will be given in just a moment.) A second is to show how the Hahn-Banach theorem leads to a simple and flexible method for proving results of these three kinds. A third is to demonstrate this by actually giving simpler proofs of several important results, or parts of results. One of the proofs we shall simplify is the proof of Green and Tao that the primes contain arbitrarily long arithmetic progressions [GT1], which leads to the fourth purpose of this paper: to provide a partial guide to their paper. We shall give a simple proof of a result that is implicit in their paper, and made explicit in a later paper of Tao and Ziegler, and then we shall explain informally how they use this result to prove their famous theorem. A proof along similar lines has been discovered independently by Reingold, Trevisan, Tulsiani and Vadhan [RTTV]. We have tried to design this paper so that the reader who is just interested in the Green-Tao theorem can get away with reading only a small part of it. However, the earlier sections of the paper provide considerable motivation for the later arguments, so such a reader would be well-advised at least to skim the sections that are not strictly speaking necessary.

Now let us describe the classes of theorems that will principally concern us. By a decomposition theorem we mean a statement that tells us that a function ff with certain properties can be decomposed as a sum ∑i=1kgi\sum_{i=1}^{k}g_{i}, where the functions gig_{i} have certain other properties. There are two kinds of decomposition theorem that have been particularly useful. One kind says that ff can be written as ∑i=1kgi+h\sum_{i=1}^{k}g_{i}+h, where the functions gig_{i} have some explicit description and hh, the “error term” is in a useful sense small.

Another kind, which is closely related, brings us to our second class of results. An approximate structure theorem is a result that says that, under appropriate conditions, we can write a function ff as f1+f2f_{1}+f_{2}, where f1f_{1} is “structured” in some sense, and f2f_{2} is “quasirandom”. The rough idea is that the structure of f1f_{1} is strong enough for us to be able to analyse it reasonably explicitly, and the quasirandomness of f2f_{2} is strong enough for many properties of f1f_{1} to be unaffected if we “perturb” it to f1+f2f_{1}+f_{2}. Often, in order to obtain stronger statements about the structure and the quasirandomness, one allows also a small L2L_{2}-error: that is, one writes ff as f1+f2+f3f_{1}+f_{2}+f_{3} with f1f_{1} structured, f2f_{2} quasirandom, and f3f_{3} small in L2L_{2}.

A transference principle is a statement to the effect that a function ff that belongs to some space XX of functions can be approximated by a function gg that belongs to another space YY. Such a statement is useful if the functions in YY are easier to handle than the functions in XX and the approximation is of a kind that preserves the properties that one is interested in. As we shall see later, a transference principle is the fundamental step in the proof of Green and Tao. For now, let us merely note that a transference principle is a particular kind of decomposition theorem: it tells us that ff can be written as g+hg+h, where g∈Yg\in Y and hh is small in an appropriate sense.

As well as the Green-Tao theorem, we shall discuss several other results in additive combinatorics. One is a structure theorem proved by Tao in an important paper [T1] that gives a discretization of Furstenberg’s ergodic-theory proof [Fu] of Szemerédi’s theorem [S1], or more precisely a somewhat different ergodic-theory argument due to Host and Kra [HK05]. We shall give an alternative proof of (a slight generalization of) this theorem, and give some idea of how it can be used to prove other results. Amongst these other results are Roth’s theorem [Rot], which states that every set of integers of positive upper density contains an arithmetic progression of length 3, and Szemerédi’s regularity lemma [S2], a cornerstone of extremal graph theory, which shows that every graph can be approximated by a disjoint union of boundedly many quasirandom graphs (and which is a very good example of an approximate structure theorem).

The remaining sections of this paper are organized as follows. The next section introduces several norms that are used to define quasirandomness. Strictly speaking, it is independent of much of the rest of the paper, since many of our results will be rather general ones about norms that satisfy various hypotheses. However, for the reader who is unfamiliar with the basic concepts of additive combinatorics it may not be obvious that these hypotheses are satisfied except in one or two very special cases: section 2 should convince such a reader that the general results can be applied in many interesting contexts.

In section 3, we introduce our main tool, the finite-dimensional Hahn-Banach theorem, and we give one or two very easy consequences of it. Even these consequences are of interest, as we shall explain—one of them is a non-trivial decomposition theorem of the first kind discussed above—but the method comes into its own when we introduce one or two further ideas in order to obtain conclusions that can be applied much more widely.

One of these ideas is the relatively standard one of polynomial approximations. Often we start with a function ff that takes values in an interval [a,b][a,b], and we want its structured part f1f_{1} to take values in [a,b][a,b] as well. If f1f_{1} is bounded, and if the class of structured functions is closed under composition with polynomials, then we can sometimes achieve this by choosing a polynomial PP such that P(x)P(x) approximates aa when x<ax<a, xx when a≤x≤ba\leq x\leq b, and bb when x>bx>b. Then the function Pf1Pf_{1} takes values in [a,b][a,b] (approximately), and under appropriate circumstances it is possible to argue that it approximates f1f_{1}. In section 4, we shall illustrate this technique by proving two results. The first is a fairly simple transference principle that we shall need later, and the second is a slightly more complicated version of it that is needed for proving the Green-Tao theorem. The latter is essentially the same as the “abstract structure theorem” of Tao and Ziegler [TZ], so called because it is an abstraction of arguments from the paper of Green and Tao. It is this second result that can be regarded as a major step in the proof of the Green-Tao theorem, and which is used to prove their transference principle. We shall end Section 4 with a brief description of the rest of the proof of Green and Tao.

In section 5, we shall prove the structure theorem of Tao mentioned earlier, and show how it leads to a strengthened decomposition theorem. We end the section, and the paper, with an indication of how to use the structure theorem.

Some basic concepts of additive combinatorics.

The Fourier inversion formula (which it is an easy exercise to verify) then tells us that

which gives the expansion of ff as a linear combination of characters.

and the convolution identity states that (f∗g)∧(ψ)=f^(ψ)g^(ψ)(f*g)^{\wedge}(\psi)=\hat{f}(\psi)\hat{g}(\psi) for every ψ∈G^\psi\in\hat{G}. That is, the Fourier transform “converts convolution into pointwise multiplication”. It also does the reverse: the Fourier transform of the pointwise product fgfg is the convolution f^∗g^\hat{f}*\hat{g}, where the latter is defined by the formula

Parseval’s identity is the simple statement that ⟨f,g⟩=⟨f^,g^⟩\langle f,g\rangle=\langle\hat{f},\hat{g}\rangle. It is important to keep in mind that the two inner products are defined differently, one with expectations and the other with sums, just as the convolutions were defined differently in GG and G^\hat{G}. Setting f=gf=g in Parseval’s identity, we deduce that ∥f∥2=∥f^∥2\|f\|_{2}=\|\hat{f}\|_{2}.

2. What is additive combinatorics about?

The central objects of study in additive combinatorics are finite subsets of Abelian groups. For example, one of the main results in the area, Szemerédi’s theorem, can be formulated as follows.

What are the maps of interest between finite subsets of Abelian groups? An initial guess might be that they were restrictions of group homomorphisms, but that turns out to be far too narrow a definition. Instead, they are functions called Freiman homomorphisms. A Freiman homomorphism of order kk between sets AA and BB is a function ϕ:A→B\phi:A\rightarrow B such that

In particular, a Freiman homomorphism of order 2, often just known as a Freiman homomorphism, is a function such that ϕ(a1)+ϕ(a2)=ϕ(a3)+ϕ(a4)\phi(a_{1})+\phi(a_{2})=\phi(a_{3})+\phi(a_{4}) whenever a1+a2=a3+a4a_{1}+a_{2}=a_{3}+a_{4}. This is equivalent to the same definition with minus instead of plus, which is often more convenient.

A Freiman isomorphism of order kk is a Freiman homomorphism of order kk with an inverse that is also a Freiman homomorphism of order kk. The rough idea is that a Freiman homomorphism of order kk preserves all the linear structure of a set AA that can be detected by integer combinations with coefficients adding up to 0 and with absolute values adding up to at most 2k2k. For example, it is an easy exercise to show that if AA is an arithmetic progression and BB is Freiman-isomorphic to AA, then BB is also an arithmetic progression. This is because a sequence (x1,x2,…,xm)(x_{1},x_{2},\dots,x_{m}) is an arithmetic progression, written out in a sensible order, if and only if xi+2−xi+1=xi+1−xix_{i+2}-x_{i+1}=x_{i+1}-x_{i} for every ii. It is also easy to show that if AA and BB are isomorphic, then their sumsets A+AA+A and B+BB+B have the same size.

Thus, a more precise description of the main objects studied by additive combinatorics would be that they are finite subsets of Abelian groups, up to Freiman isomorphisms of various orders.

An important aspect of results such as Szemerédi’s theorem is that they have a certain “robustness”. For instance, combining Szemerédi’s theorem with a simple averaging argument, one can deduce the following corollary (which was first noted by Varnavides [V]).

Thus, it is tempting to revise further our rough definition of additive combinatorics and say that the central objects of study are subsets of Abelian groups, up to Freiman isomorphism and “quasirandom perturbation”. However, it takes some effort to make this idea precise, since the notion of a Freiman homomorphism does not apply as well to functions as it does to sets (because it is insufficiently robust). Also, not every quantity of importance in the area is approximately invariant up to quasirandom perturbations: an example of one that isn’t is the size of the sumset A+AA+A of a set AA of size nn. So we shall content ourselves with the observation that all the results of this paper are approximately invariant.

So that we can say what this means, let us give some examples of norms that measure quasirandomness.

3. Uniformity norms for subsets of finite Abelian groups.

In many respects, a quasirandom set behaves as one would expect a random set to behave, but in by no means all. For example, even if AA is as quasirandom as it is possible for a set to be, it does not follow that

turns out to be at least cδ3c\delta^{3} for some absolute constant c>0c>0. We will not prove this here (a proof can be found in [G3]), but we give the example in order to draw attention to its quadratic nature. It turns out that this feature of the example is necessary, though quite what that means is not obvious, and the proof is even less so. See subsection 2.6 for further discussion of this.

This example shows that the smallness of the U2U^{2}-norm is not sufficient to explain all the typical behaviour of a random function. For this one needs to introduce “higher” uniformity norms, of which the next one is (unsurprisingly) the U3U^{3}-norm. If gg is a function, then ∥g∥U38\|g\|_{U^{3}}^{8} is given by the expression

From this it is easy to guess the definition of the UkU^{k} norm, but for completeness here is a formula for it:

where CC denotes the operation of complex conjugation and ∣ϵ∣|\epsilon| denotes the number of non-zero coordinates of ϵ\epsilon.

Let us call a set uniform of degree k−1k-1 if its UkU^{k}-norm is small. Then the above assertion is that a set of density δ\delta that is sufficiently uniform of degree k−1k-1 contains roughly as many arithmetic progressions (mod NN) of length k+1k+1 as a random set of density δ\delta will (with high probability) contain. In particular, if AA is quadratically uniform (meaning that the U3U^{3}-norm of A−δA-\delta is sufficiently small), then

The arithmetic progression {x,x+d,…,x+(k−1)d}\{x,x+d,\dots,x+(k-1)d\} can be thought of as a collection of kk linear forms in xx and dd. It can be shown that for any collection of linear forms in any number of variables, there exists a kk such that every set AA that is sufficiently uniform of degree kk contains about as many of the corresponding linear configurations as a random set of the same density. This was shown by Green and Tao [GT3], who generalized the argument in [G1]. The question of precisely which UkU^{k} norm is needed is a surprisingly subtle one. It is conjectured in [GW1] that the answer is the smallest kk for which the kkth powers of the linear forms in question are linearly independent. For instance, the configuration {x,x+d,x+2d,x+3d}\{x,x+d,x+2d,x+3d\} needs the U3U^{3}-norm because x−2(x+d)+(x+2d)=x2−3(x+d)2+3(x+2d)2−(x+3d)2=0x-2(x+d)+(x+2d)=x^{2}-3(x+d)^{2}+3(x+2d)^{2}-(x+3d)^{2}=0, but the cubes are linearly independent. A special case of this result is proved in [GW1] using “quadratic Fourier analysis”, which we will discuss in 2.7: to prove the full conjecture would require a theory of higher-degree Fourier analysis that will probably exist in due course but which has not yet been sufficiently developed.

4. Uniformity norms for graphs and hypergraphs.

There are very close and important parallels between uniformity of subsets of finite Abelian groups, and quasirandomness of graphs and hypergraphs. For this reason, even though the relevant parts of graph and hypergraph theory belong to extremal combinatorics, they have become part of additive combinatorics as well: one could call them additive combinatorics without the addition.

The quadruples (x+y,x+y′,x′+y,x′+y′)(x+y,x+y^{\prime},x^{\prime}+y,x^{\prime}+y^{\prime}) are uniformly distributed over all quadruples (a,b,c,d)(a,b,c,d) such that a+d=b+ca+d=b+c. Since the same is true of all quadruples of the form (x,x+a,x+b,x+a+b)(x,x+a,x+b,x+a+b), we see that the right-hand side of the above formula is nothing other than ∥f∥U2\|f\|_{U^{2}}.

A similar argument can be used to relate the higher-degree uniformity norms to notions of quasirandomness for kk-uniform hypergraphs, which are like graphs except that instead of having edges, which are pairs of vertices, one has hyperedges, which are kk-tuples of vertices. The following formula defines a norm on kk-variable functions:

If f(x1,…,xk)f(x_{1},\dots,x_{k}) has the form g(x1+⋯+xk)g(x_{1}+\dots+x_{k}), then ∥f∥HUk=∥g∥Uk\|f\|_{HU^{k}}=\|g\|_{U^{k}}.

A hypergraph HH of density δ\delta behaves in many respects like a random hypergraph of density δ\delta if ∥H−δ∥HUk\|H-\delta\|_{HU^{k}} is small enough. For instance, if k=3k=3, then the simplex density, which is given by the expression

is roughly δ4\delta^{4}, or what it would be in the random case. More generally, if ∥Hi−δ∥HUk\|H_{i}-\delta\|_{HU^{k}} is small for i=1,2,3,4i=1,2,3,4, then

is again roughly δ4\delta^{4}. This assertion, which is proved by repeated use of the Cauchy-Schwarz inequality (see [G2] for a more general result), implies that

These ideas can be developed to give a complete proof of Szemerédi’s theorem: see [NRS], [RS], [G2], [T2].

5. Easy structure theorems for the U2U^{2}-norm.

A great deal of information about the U2U^{2}-norm comes from the following simple observation.

By the convolution identity and Parseval’s identity,

The result follows on taking fourth roots. ∎

Now let us suppose that ∥f∥2≤1\|f\|_{2}\leq 1, and let us fix some small constant η>0\eta>0. Then the number of characters ψ\psi such that ∣f^(ψ)∣≥η|\hat{f}(\psi)|\geq\eta is at most η−2\eta^{-2}, since ∑ψ∣f^(ψ)∣2=∥f^∥22=∥f∥22=1\sum_{\psi}|\hat{f}(\psi)|^{2}=\|\hat{f}\|_{2}^{2}=\|f\|_{2}^{2}=1. Using the inversion formula and this fact, we can split ff into two parts, ∑ψ∈Kf^(ψ)ψ\sum_{\psi\in K}\hat{f}(\psi)\psi and ∑ψ∉Kf^(ψ)ψ\sum_{\psi\notin K}\hat{f}(\psi)\psi, where KK is the set of all ψ\psi such that ∣f^(ψ)∣≥η|\hat{f}(\psi)|\geq\eta. Let us call these two parts gg and hh, respectively. The function gg involves a bounded number of characters, and characters are functions that we can describe completely explicitly. Therefore, it can be thought of as the “structured” part of ff. As for hh, it is quasirandom, since

Unfortunately, this simple decomposition turns out not to be very useful, for reasons that we shall explain later. We mention it in order to put some of our later results in perspective. The same applies to the next result, which shows that one can obtain a much stronger relationship between ∥h∥U2\|h\|_{U^{2}} and the upper bound on the size of KK if one is prepared to tolerate a small L2L_{2}-error as well. This result and its proof are part of the standard folklore of additive combinatorics.

Let N=∣G∣N=|G| and let us enumerate the dual group G^\hat{G} as ψ1,…,ψN\psi_{1},\dots,\psi_{N} in such a way that the absolute values of the Fourier coefficients f^(ψi)\hat{f}(\psi_{i}) are in non-increasing order. Choose an increasing sequence of positive integers m1,m2,…m_{1},m_{2},\dots in such a way that mr+1≥η(mr)−4m_{r+1}\geq\eta(m_{r})^{-4} for every rr.

Now let us choose ii and attempt to prove the result using the decomposition f1=∑i≤mrf^(ψi)ψif_{1}=\sum_{i\leq m_{r}}\hat{f}(\psi_{i})\psi_{i}, f2=∑i>mr+1f^(ψi)ψif_{2}=\sum_{i>m_{r+1}}\hat{f}(\psi_{i})\psi_{i}, and f3=∑mr<i≤mr+1f^(ψi)ψif_{3}=\sum_{m_{r}<i\leq m_{r+1}}\hat{f}(\psi_{i})\psi_{i}. Then f1f_{1} is a linear combination of at most mrm_{r} characters. Since there can be at most mr+1m_{r+1} characters ψ\psi with ∣f^(ψ)∣≥mr+1−1/2|\hat{f}(\psi)|\geq m_{r+1}^{-1/2}, we find that

Therefore, we are done if ∥f3∥2≤ϵ\|f_{3}\|_{2}\leq\epsilon. But the possible functions f3f_{3} (as rr varies) are disjoint parts of the Fourier expansion of ff, so at most ϵ−2\epsilon^{-2} of them can have norm greater than ϵ\epsilon. Therefore, we can find r≤ϵ−2r\leq\epsilon^{-2} such that the proposed decomposition works. ∎

There is nothing to stop us taking m1=1m_{1}=1. The proof then gives us the desired decomposition for some mm that is bounded above by a number that results from starting with 1 and applying the function t↦η(t)−4t\mapsto\eta(t)^{-4} at most ϵ−2\epsilon^{-2} times. Although Proposition 2.5 is still not all that useful, it resembles other results that are, as we shall see in due course. In those results, it is common to require η(m)\eta(m) to be exponentially small: the resulting bound is then of tower type.

6. Inverse theorems.

A remarkable inverse theorem, which lies at the heart of many recent results in additive combinatorics, is a theorem of Freiman [F] (later given a considerably more transparent proof by Ruzsa [Ru]) that characterizes sets that have small sumsets. If AA is a set of nn integers, then it is easy to show that the sumset A+AA+A has size at least 2n−12n-1 and at most n(n+1)/2n(n+1)/2. What can be said about AA if the size of the sumset is close to its minimum, in the sense that ∣A+A∣≤C∣A∣|A+A|\leq C|A| for some fixed constant CC? A simple example of such a set is an arithmetic progression. A slightly less simple example is a set AA that is contained in an arithmetic progression of length at most Cn/2Cn/2. A less simple example altogether is a “two-dimensional arithmetic progression”: that is, a set of the form {x0+rd1+sd2:0≤r<t1,0≤s<t2}\{x_{0}+rd_{1}+sd_{2}:0\leq r<t_{1},0\leq s<t_{2}\}. If AA is such a set, then ∣A+A∣≤4∣A∣|A+A|\leq 4|A|, and more generally if AA is a kk-dimensional arithmetic progression (the definition of which is easy to guess), then ∣A+A∣≤2k∣A∣|A+A|\leq 2^{k}|A|. As in the one-dimensional case, one can pass to large subsets and obtain more examples. Freiman’s theorem states that one has then exhausted all examples.

For every CC there exist kk and KK such that every set AA of nn integers such that the sumset A+AA+A has size at most CnCn is contained in an arithmetic progression of dimension at most kk and cardinality at most KnKn.

Freiman’s theorem has been extremely influential, in large part because of Ruzsa’s proof, which was extremely elegant and conceptual, and gave much better bounds than Freiman’s argument. These bounds have subsequently been improved by Chang [C], who added further interesting ingredients to Ruzsa’s argument. A generalization of Freiman’s theorem to subsets of an arbitrary Abelian group was proved by Green and Ruzsa [GR].

The notion of an inverse theorem makes sense also for functions defined on Abelian groups. For instance, here is a simple inverse theorem about functions with large U2U^{2}-norm.

By Lemma 2.4 and our assumptions about ff,

Conversely, and without any assumption about ∥f∥2\|f\|_{2}, if there exists a character ψ\psi such that ⟨f,ψ⟩≥c\langle f,\psi\rangle\geq c, then ∥f∥U2=∥f∥4≥c1/4\|f\|_{U^{2}}=\|f\|_{4}\geq c^{1/4}. Therefore, correlation with a character “explains” the largeness of the U2U^{2}-norm.

implies easily that ∥f∥U3=1\|f\|_{U^{3}}=1. However, it is also easy to show that ff does not correlate significantly with any character. Therefore, we are forced to consider quadratic functions. If qq is a quadratic function, then let us call the function ωq\omega^{q} a quadratic phase function.

In [G1], the following “weak inverse theorem” was proved for all UkU^{k} norms.

This result was the main step in the proof of Szemerédi’s theorem given in [G1]. The reason that this is a “weak inverse theorem” is that the converse is far from true. The result shows that ff correlates with a function that is made out of many fragments of polynomial phase functions, but it does not provide what one might hope for: correlation with a single generalized polynomial phase function. However, the proof strongly suggested that such a result should be true, and Green and Tao, by adding some important further ingredients, have established a strong inverse theorem in the quadratic case [GT2]. Let us state their result a little imprecisely.

7. Higher Fourier analysis.

However, one can still hope for a structure theorem that resembles Proposition 2.5. We would expect it to say that a function ff can be decomposed into a linear combination of a small number of generalized quadratic phase functions, plus a function with very small U3U^{3}-norm, plus a function that is small in L2L_{2}. Green and Tao deduced such a result from their inverse theorem, and thereby initiated a form of quadratic Fourier analysis. In [GW1], a different method was given for deducing somewhat different decomposition theorems from inverse theorems. The main ingredient of this method was the Hahn-Banach theorem: the proof will be sketched in the next section. This gave an alternative form of quadratic Fourier analysis, which provided much better bounds for the results of that paper (the ones that concerned controlling systems of linear forms with UkU^{k}-norms).

We shall have more to say about higher Fourier analysis later in the paper.

8. Easy structure theorems for graphs.

We have already seen that the U2U^{2}-norm of the one-variable function gg, defined on a finite Abelian group GG, can be regarded as the GU2GU^{2}-norm of the two-variable function f(x,y)=g(x+y)f(x,y)=g(x+y). The relationship does not stop here, however. If ψ\psi is a character, then, for any xx,

This shows that characters are similar to eigenvectors of the symmetric matrix f(x,y)f(x,y), except that they are mapped to multiples of their complex conjugates. However, it is notable that the corresponding “eigenvalues” are the Fourier coefficients of the function gg. This observation suggests, correctly as it turns out, that eigenvalues play a similar role for real symmetric matrices to the role played by Fourier coefficients for functions defined on finite Abelian groups.

The finite-dimensional spectral theorem tells us that a real symmetric matrix f(x,y)f(x,y) has an orthonormal basis of eigenvectors. If these are u1,…,unu_{1},\dots,u_{n} and the corresponding eigenvalues are λ1,…,λn\lambda_{1},\dots,\lambda_{n}, then we can express this by saying that

by the orthonormality (with respect to the L2L_{2}-norm) of the eigenvectors.

Let XX be a finite set and let ff be a symmetric real-valued function defined on X2X^{2}. Let the eigenvalues of ff be λ1,…,λn\lambda_{1},\dots,\lambda_{n}. Then ∥f∥GU24=∑rλr4\|f\|_{GU^{2}}^{4}=\sum_{r}\lambda_{r}^{4}.

All results of this kind are proved by expanding the expression for ∥f∥GU24\|f\|_{GU^{2}}^{4} in terms of the spectral decomposition ∑rλrur⊗ur\sum_{r}\lambda_{r}u_{r}\otimes u_{r} of ff.

A similar but easier proof establishes that ∥f∥22=∑rλr2\|f\|_{2}^{2}=\sum_{r}\lambda_{r}^{2}.

The next result is a direct analogue for symmetric two-variable real functions (and therefore in particular for graphs) of Proposition 2.5

Let N=∣X∣N=|X| and let us enumerate an orthonormal basis (ui)1N(u_{i})_{1}^{N} of eigenvectors of ff in such a way that the absolute values of the eigenvalues λi\lambda_{i} are in non-increasing order. Choose an increasing sequence of positive integers m1,m2,…m_{1},m_{2},\dots in such a way that mr+1≥η(mr)−4m_{r+1}\geq\eta(m_{r})^{-4} for every rr.

Now let us choose ii and attempt to prove the result using the decomposition f1=∑i≤mrλiui⊗uif_{1}=\sum_{i\leq m_{r}}\lambda_{i}u_{i}\otimes u_{i}, f2=∑i>mr+1λiui⊗uif_{2}=\sum_{i>m_{r+1}}\lambda_{i}u_{i}\otimes u_{i}, and f3=∑mr<i≤mr+1λiui⊗uif_{3}=\sum_{m_{r}<i\leq m_{r+1}}\lambda_{i}u_{i}\otimes u_{i}. Then f1f_{1} is a linear combination of at most mrm_{r} eigenvectors, which are orthonormal to each other by the spectral theorem. By the remark above about the sum of the squares of the eigenvalues, there can be at most mr+1m_{r+1} eigenvectors uiu_{i} with ∣λi∣≥mr+1−1/2|\lambda_{i}|\geq m_{r+1}^{-1/2}. Therefore,

Therefore, we are done if ∥f3∥2≤ϵ\|f_{3}\|_{2}\leq\epsilon. But the possible functions f3f_{3} (as rr varies) are disjoint parts of the spectral expansion of ff, so at most ϵ−2\epsilon^{-2} of them can have norm greater than ϵ\epsilon. Therefore, we can find r≤ϵ−2r\leq\epsilon^{-2} such that the proposed decomposition works. ∎

The above result is closely related to a “weak regularity lemma” due to Frieze and Kannan [FK].

The Hahn-Banach theorem and simple applications.

Let us begin by stating the version of the Hahn-Banach theorem that we shall need.

Now let us prove two corollaries, both of which are useful for proving decomposition theorems.

Let KK be the convex body ∑iciKi\sum_{i}c_{i}K_{i}. Our hypothesis is that f∉Kf\notin K. Since KK is closed, it follows that there exists ϵ>0\epsilon>0 such that (1+ϵ)−1f∉K(1+\epsilon)^{-1}f\notin K. Therefore, by Theorem 3.1, there is a constant β\beta and a linear functional ϕ\phi such that (1+ϵ)−1⟨f,ϕ⟩≥β(1+\epsilon)^{-1}\langle f,\phi\rangle\geq\beta and ⟨g,ϕ⟩≤β\langle g,\phi\rangle\leq\beta for every g∈Kg\in K. Again using the fact that KK is closed, we can add a small Euclidean ball BB to KK in such a way that (1+ϵ)−1f∉B+K(1+\epsilon)^{-1}f\notin B+K. Since 0∈K0\in K, it follows that β>0\beta>0. Therefore, we can divide ϕ\phi by β\beta and get β\beta to be 1, with the result that ⟨f,ϕ⟩≥(1+ϵ)β\langle f,\phi\rangle\geq(1+\epsilon)\beta. Since 00 belongs to each KiK_{i}, we can also conclude that ⟨g,ϕ⟩≤1\langle g,\phi\rangle\leq 1 for every g∈ciKig\in c_{i}K_{i}, which completes the proof. ∎

Let KK be the set of all convex combinations c1f1+⋯+crfrc_{1}f_{1}+\dots+c_{r}f_{r} with fi∈Kif_{i}\in K_{i}. Then KK is a closed convex set and ff is not contained in KK. Therefore, there exists ϵ>0\epsilon>0 such that (1+ϵ)−1f∉K(1+\epsilon)^{-1}f\notin K. By Theorem 3.1 there is a functional ϕ\phi and a constant β\beta such that (1+ϵ)−1⟨f,ϕ⟩≥β(1+\epsilon)^{-1}\langle f,\phi\rangle\geq\beta and ⟨g,ϕ⟩≤β\langle g,\phi\rangle\leq\beta whenever gg belongs to KK. In particular, ⟨g,ϕ⟩≤β\langle g,\phi\rangle\leq\beta whenever gg belongs to one of the sets KiK_{i}. As in the proof of the previous corollary, β\beta must be positive and can therefore be assumed to be 1. The result follows. ∎

Then this formula does indeed define a norm, and its dual norm ∥.∥∗\|.\|^{*} is given by the formula

It is a simple exercise to check that the expression does indeed define a norm.

Let us begin by supposing that ∥z∥σ∗≥1\|z\|_{\sigma}^{*}\geq 1 for some σ∈Σ\sigma\in\Sigma. Then there exists x∈Vσx\in V_{\sigma} such that ∥x∥σ≤1\|x\|_{\sigma}\leq 1 and ∣⟨x,z⟩∣≥1|\langle x,z\rangle|\geq 1. But then ∥x∥≤1\|x\|\leq 1 as well, from which it follows that ∥z∥∗≥1\|z\|^{*}\geq 1. Therefore, ∥z∥∗\|z\|^{*} is at least the maximum of the ∥z∥σ∗\|z\|_{\sigma}^{*}.

Now let us suppose that ∥z∥∗>1\|z\|^{*}>1. This means that there exists xx such that ∥x∥≤1\|x\|\leq 1 and ∣⟨x,z⟩∣≥1+ϵ|\langle x,z\rangle|\geq 1+\epsilon for some ϵ>0\epsilon>0. Let us choose x1,…,xkx_{1},\dots,x_{k} such that xi∈Vσix_{i}\in V_{\sigma_{i}} for each ii, x1+⋯+xk=xx_{1}+\dots+x_{k}=x, and ∥x1∥σ1+⋯+∥xk∥σk<1+ϵ\|x_{1}\|_{\sigma_{1}}+\dots+\|x_{k}\|_{\sigma_{k}}<1+\epsilon. Then

so there must exist ii such that ∣⟨xi,z⟩∣>∥xi∥σi|\langle x_{i},z\rangle|>\|x_{i}\|_{\sigma_{i}}, from which it follows that ∥z∥i∗>1\|z\|_{i}^{*}>1. This proves that ∥z∥∗\|z\|^{*} is at most the maximum of the ∥z∥i∗\|z\|_{i}^{*}. ∎

Then this formula does indeed define a norm, and its dual norm ∥.∥∗\|.\|^{*} is defined by the formula ∥f∥∗=max{∣⟨f,σ⟩∣:σ∈Σ}\|f\|^{*}=max\{|\langle f,\sigma\rangle|:\sigma\in\Sigma\}.

We now prove a very simple (and known) decomposition result that illustrates our basic method.

Suppose that the result is false. We shall apply Corollary 3.3 to the function f/∥f∥2f/\|f\|_{2}, with K1K_{1} and K2K_{2} taken to be the unit balls of ∥.∥\|.\| and ∥.∥∗\|.\|^{*}. Our hypothesis is equivalent to the assertion that f/∥f∥2f/\|f\|_{2} is not a convex combination c1g1+c2g2c_{1}g_{1}+c_{2}g_{2} with gi∈Kig_{i}\in K_{i} for i=1,2i=1,2. Therefore, we obtain a functional ϕ\phi such that ⟨f,ϕ⟩>∥f∥2\langle f,\phi\rangle>\|f\|_{2} and ∥ϕ∥∗\|\phi\|^{*} and ∥ϕ∥\|\phi\| are both at most 1. But the first property implies, by the Cauchy-Schwarz inequality, that ∥ϕ∥2>1\|\phi\|_{2}>1, while the second implies that ∥ϕ∥22=⟨ϕ,ϕ⟩≤∥ϕ∥∥ϕ∥∗≤1\|\phi\|_{2}^{2}=\langle\phi,\phi\rangle\leq\|\phi\|\|\phi\|^{*}\leq 1. This is a contradiction. ∎

A simple modification of Proposition 3.6 makes it a little more flexible. Suppose that we wish to write ff as g+hg+h with ∥g∥\|g\| small and ∥h∥∗\|h\|^{*} not too large. If we define a new norm ∣.∣|.| to be ϵ−1∥.∥\epsilon^{-1}\|.\|, then ∣.∣∗=ϵ∥.∥∗|.|^{*}=\epsilon\|.\|^{*}. Applying Proposition 3.6 to these rescaled norms, we find that we can write ff as g+hg+h in such a way that ϵ−1∥g∥+ϵ∥h∥∗≤∥f∥2\epsilon^{-1}\|g\|+\epsilon\|h\|^{*}\leq\|f\|_{2}. In particular, if ∥f∥2=1\|f\|_{2}=1, then ∥g∥≤ϵ\|g\|\leq\epsilon and ∥h∥∗≤ϵ−1\|h\|^{*}\leq\epsilon^{-1}.

The reason such a result might be expected to be useful in additive combinatorics is that, as demonstrated in the previous section, we have a good supply of norms ∥.∥\|.\| that measure quasirandomness. Moreover, their duals, as we shall see later, can be thought of as a sort of measure of structure. Perhaps the simplest example that illustrates this is if we look at functions ff defined on finite Abelian groups, and take ∥f∥\|f\| to be ∥f^∥∞\|\hat{f}\|_{\infty}. If ∥f∥2≤1\|f\|_{2}\leq 1, then

a calculation we have already done. This shows that for functions with bounded L2L_{2}-norm there is a rough equivalence between ∥f∥U2\|f\|_{U^{2}} and ∥f^∥∞\|\hat{f}\|_{\infty}, in the sense that if one is small then so is the other.

Thus, if ∥f∥2≤1\|f\|_{2}\leq 1 then ∥f∥=∥f^∥∞\|f\|=\|\hat{f}\|_{\infty} being small tells us that ff is quasirandom. The dual norm, ∥f∥∗=∥f^∥1\|f\|^{*}=\|\hat{f}\|_{1}, is a sort of measure of structure, since if ∥f^∥1\|\hat{f}\|_{1} is at most CC, then ff is a small multiple of a convex combination of trigonometric functions, which can be approximated in L2L_{2} by a linear combination of a bounded number of such functions. Thus, we recover a result that resembles Proposition 2.5. It is weaker, however, because we have not yet related the quasirandomness constant to the structure constant by means of an arbitrary function. However, this is easily done, again with the help of an L2L_{2} error term, as the next result shows.

In particular, ∥f1∥∗≤Ci\|f_{1}\|^{*}\leq C_{i}, ∥f2∥≤η(Ci)\|f_{2}\|\leq\eta(C_{i}) and ∥f3∥2≤ϵ\|f_{3}\|_{2}\leq\epsilon.

If there is no such decomposition for ii, then by Corollary 3.3 there is a functional ϕi\phi_{i} such that ∥ϕi∥≤Ci−1\|\phi_{i}\|\leq C_{i}^{-1}, ∥ϕi∥∗≤η(Ci)−1\|\phi_{i}\|^{*}\leq\eta(C_{i})^{-1}, ∥ϕi∥2≤ϵ−1\|\phi_{i}\|_{2}\leq\epsilon^{-1}, and ⟨ϕi,f⟩>1\langle\phi_{i},f\rangle>1. If this is true for every i≤ri\leq r then

where the first inequality follows from Cauchy-Schwarz and the assumption that ∥f∥2≤1\|f\|_{2}\leq 1.

the last inequality following from the way we constructed the sequence C1,…,CrC_{1},\dots,C_{r}. Therefore,

This contradicts the previous estimate, since r≥2ϵ−1r\geq 2\epsilon^{-1}. ∎

It is easy to deduce Proposition 2.5 from this result. Of course, this fact on its own is not a very convincing demonstration of the utility of the Hahn-Banach theorem, since for the norm ∥f∥=∥f^∥∞\|f\|=\|\hat{f}\|_{\infty} it is easy to write down an explicit decomposition of ff, as we saw in section 2.5. But there are other important norms where this is certainly not the case. For example, if we take ∥f∥\|f\| to be ∥f∥Uk\|f\|_{U^{k}} for a larger kk, then there is no obvious decomposition of ff from which we can read off three functions f1f_{1}, f2f_{2} and f3f_{3} with the required properties.

2. Deducing decomposition theorems from inverse theorems.

The main result of [GW1] shows that certain linear configurations occur with the “expected” frequency in any set AA for which the balanced function A−δA-\delta (where δ\delta is the density of AA) has sufficiently small U2U^{2}-norm. The interest in the result is that the U2U^{2}-norm suffices for the configurations in question, whereas the natural arguments that generalize the proof that the UkU^{k} norm controls progressions of length k−2k-2 would suggest that the U3U^{3}-norm was needed. In order to prove the result, a form of quadratic Fourier analysis was needed, as we have already mentioned. The approach in [GW1] was to apply directly a result of Green and Tao, which obtains a decomposition of a bounded function ff by constructing an averaging projection PP with the property that f−Pff-Pf has small U3U^{3} norm. However, there was a technicality involved that forced us to use an iterated version of their result that gives rise to very weak bounds. In order to obtain reasonable bounds for the problem, it turned out to be convenient—indeed, as far as we could tell, necessary—to prove a decomposition theorem that could be regarded as a quadratic analogue of Proposition 2.5, with the important difference that the strong dependence of η(m)\eta(m) on mm was not needed. (This was why it was possible to obtain good bounds.)

The argument appears in [GW2], and it can be regarded as a special case of a general principle that can be informally summarized as follows: to each inverse theorem there is a corresponding decomposition theorem. It is possible to give a formal statement, as will be clear from our discussion, but in practice it is much easier to describe a method for deducing decompositions from inverse theorems than it is to state an artificial lemma that declares that the method works. The main reason for this is that when one applies the method, one typically starts with the decomposition one wants to prove and the inverse theorem one can prove, and adjusts the former until it follows from the latter. We shall reflect this in our discussion below: more precisely, we shall assume that a decomposition of a certain general kind does not exist, draw an easy consequence from this, and see when this consequence contradicts any given inverse theorem.

The function ff can be written in the form

where ∑i=1k∣λi∣≤M\sum_{i=1}^{k}|\lambda_{i}|\leq M, each σi\sigma_{i} belongs to Σ\Sigma, and for each j≤rj\leq r we have an inequality of the form ∥gj∥(j)≤ηj\|g_{j}\|_{(j)}\leq\eta_{j}.

Typically, rr will be a very small integer such as 2.

defines a norm, and that the dual of this norm is the norm

Now let us suppose that no decomposition of the kind we are looking for exists. This is equivalent to the assumption that ff has no decomposition of the form g0+g1+⋯+gkg_{0}+g_{1}+\dots+g_{k} with ∥g0∥≤M\|g_{0}\|\leq M and ∥fi∥(i)≤ηi\|f_{i}\|_{(i)}\leq\eta_{i} for every ii. If this is the case, then by Corollary 3.2 there must be a linear functional ϕ\phi such that ⟨f,ϕ⟩>1\langle f,\phi\rangle>1, ∥ϕ∥∗≤M−1\|\phi\|^{*}\leq M^{-1}, and ∥ϕ∥(i)∗≤ηi−1\|\phi\|_{(i)}^{*}\leq\eta_{i}^{-1} for i=1,2,…,ri=1,2,\dots,r.

The statement that ∥ϕ∥∗≤M−1\|\phi\|^{*}\leq M^{-1} tells us that ∣⟨σ,ϕ⟩∣≤M−1|\langle\sigma,\phi\rangle|\leq M^{-1} for every σ∈Σ\sigma\in\Sigma. Thus, what we would like is an inverse theorem that concludes the opposite: that there must be some σ∈Σ\sigma\in\Sigma such that ∣⟨σ,ϕ⟩∣>M−1|\langle\sigma,\phi\rangle|>M^{-1}. Before we think about this, let us list the assumptions that we have at our disposal.

Suppose that there is no decomposition f=∑i=1kλiσi+g1+⋯+grf=\sum_{i=1}^{k}\lambda_{i}\sigma_{i}+g_{1}+\dots+g_{r} such that ∑i=1k∣λi∣≤M\sum_{i=1}^{k}|\lambda_{i}|\leq M, each σi\sigma_{i} belongs to Σ\Sigma, and ∥gj∥(j)≤ηj\|g_{j}\|_{(j)}\leq\eta_{j} for each j≤rj\leq r. Then there exists ϕ\phi such that

(i) ⟨σ,ϕ⟩≤M−1\langle\sigma,\phi\rangle\leq M^{-1} for every σ∈Σ\sigma\in\Sigma;

(iii) ∥ϕ∥(j)∗≤ηj−1\|\phi\|_{(j)}^{*}\leq\eta_{j}^{-1} for j=1,2,…,rj=1,2,\dots,r.

The assumptions of an inverse theorem are typically that ff is not too big in one norm, such as, for instance, the L∞L_{\infty}-norm, but not too small in another, such as the U3U^{3}-norm. The only information we have that could possibly imply a lower bound on any norm of ϕ\phi is the inequality ⟨f,ϕ⟩>1\langle f,\phi\rangle>1, and even that does not help unless we have an upper bound on some norm of ff. (Of course, it is hardly surprising that such a bound would be required for a theorem that allows us to decompose ff into a bounded combination of bounded functions.)

So let us suppose that we have an inverse theorem of the following form. (We have introduced the constant KK to allow us to multiply ϕ\phi by an arbitrary non-zero scalar.)

This will be contradicted under the following circumstances:

(a) the upper bounds ∥ϕ∥(i)∗≤ηi−1\|\phi\|_{(i)}^{*}\leq\eta_{i}^{-1} imply that ∥ϕ∥≤K\|\phi\|\leq K;

(b) the upper bounds on the ∥ϕ∥(i)∗\|\phi\|_{(i)}^{*}, an upper bound on some norm of ff, and the lower bound ⟨f,ϕ⟩>1\langle f,\phi\rangle>1, together imply that ∣∣∣ϕ∣∣∣≥ϵ|||\phi|||\geq\epsilon;

For example, suppose that M−1<Kc(ϵη)M^{-1}<Kc(\epsilon\eta) and we would like a decomposition f=∑i=1kλiσi+g+hf=\sum_{i=1}^{k}\lambda_{i}\sigma_{i}+g+h with ∑i=1k∣λi∣≤M\sum_{i=1}^{k}|\lambda_{i}|\leq M, ∣∣∣g∣∣∣≤ϵ|||g|||\leq\epsilon and ∥h∥∗≤η\|h\|^{*}\leq\eta. If such a decomposition does not exist, then we obtain ϕ\phi such that ⟨σ,ϕ⟩<η−1c(ϵη)\langle\sigma,\phi\rangle<\eta^{-1}c(\epsilon\eta) for every σ∈Σ\sigma\in\Sigma, ∣∣∣ϕ∣∣∣∗≤ϵ−1|||\phi|||^{*}\leq\epsilon^{-1}, ∥ϕ∥≤η−1\|\phi\|\leq\eta^{-1}, and ⟨f,ϕ⟩>1\langle f,\phi\rangle>1. If we also know that ∥f∥2≤1\|f\|_{2}\leq 1, then it follows that ∥ϕ∥2≥1\|\phi\|_{2}\geq 1. But since ∥ϕ∥22≤∣∣∣ϕ∣∣∣.∣∣∣ϕ∣∣∣∗\|\phi\|_{2}^{2}\leq|||\phi|||.|||\phi|||^{*}, it follows that ∣∣∣ϕ∣∣∣≥ϵ|||\phi|||\geq\epsilon. This contradicts the inverse theorem (with K=η−1K=\eta^{-1}).

If we know a little bit more about ff, then we can obtain a correspondingly stronger result. For instance, suppose that we know that ∣∣∣f∣∣∣∗≤ϵ−1|||f|||^{*}\leq\epsilon^{-1}. Then the bound ⟨f,ϕ⟩>1\langle f,\phi\rangle>1 immediately implies that ∣∣∣ϕ∣∣∣>ϵ|||\phi|||>\epsilon, so we do not need the error term gg in the decomposition.

Decomposition results obtained by the simple argument above—just assume that a decomposition doesn’t exist, apply Hahn-Banach, and contradict an inverse theorem—can be very useful. However, in order to use them one has to do a little more work. For example, it is not usually trivial that a sum of the form ∑i=1kλiσi\sum_{i=1}^{k}\lambda_{i}\sigma_{i} is “structured”, even if the sum ∑i=1k∣λi∣\sum_{i=1}^{k}|\lambda_{i}| is smallish and all the individual functions σi\sigma_{i} are highly structured. The difficulty is that kk may be very large, and in order to deal with it one tends to need a principle that says that functions σi\sigma_{i} are either “closely related” or “far apart”. A simple example is when Σ\Sigma is the set of all characters, in which case any two elements of Σ\Sigma are either identical or orthogonal. In [GW2] a lemma was proved to the effect that two generalized quadratic phases were either “linearly related” or “approximately orthogonal”. That made it possible to replace the linear combination by a much smaller linear combination of slightly more general functions.

A second point is that one sometimes wants more information about the “structured function” f1=∑i=1kλiσif_{1}=\sum_{i=1}^{k}\lambda_{i}\sigma_{i}. For instance, if ∥f∥∞≤1\|f\|_{\infty}\leq 1 it can be extremely helpful to know that ∥f1∥∞≤1\|f_{1}\|_{\infty}\leq 1 as well. This does not come directly out of the method above, but it does when we combine that method with methods that we shall discuss in the next section.

with the following property: each σi\sigma_{i} belongs to Σ\Sigma and there is a constant C≤C0C\leq C_{0} such that ∑i=1k∣λi∣≤C\sum_{i=1}^{k}|\lambda_{i}|\leq C, ∥f2∥≤η(C)\|f_{2}\|\leq\eta(C), and ∥f3∥1≤η\|f_{3}\|_{1}\leq\eta.

The positivity and boundedness problems.

In section 5 we shall prove a very general result of this kind. In this section, we shall prove some simpler results that illustrate the method of polynomial approximations; we shall use this method repeatedly later.

To begin with, we need a definition that will pick out the class of norms for which we can prove results. Actually, for now we shall give a definition that is not always broad enough to be useful. In the next section we shall define a broader class of norms to which the method still applies.

We shall use the following simple lemma repeatedly.

For the second part, if ∥f∥∗≤1\|f\|^{*}\leq 1 then ∥fn∥∗≤1\|f^{n}\|^{*}\leq 1 for every nn. It follows that ∥f∥∞≤1\|f\|_{\infty}\leq 1, since otherwise at least one coordinate of fnf_{n} would be unbounded. Therefore, ∥f∥∞≤∥f∥∗\|f\|_{\infty}\leq\|f\|^{*} for every ff. ∎

It is immediate from the definition of ρ(C,δ,J)\rho(C,\delta,J) that for every CC and every δ>0\delta>0 there exists a polynomial PP such that ∣P(x)−J(x)∣≤δ|P(x)-J(x)|\leq\delta for every x∈[−C,C]x\in[-C,C], and such that RP(C)≤ρ(C,δ,J)R_{P}(C)\leq\rho(C,\delta,J).

Suppose that PP is the polynomial P(x)=anxn+⋯+a1x+a0P(x)=a_{n}x^{n}+\dots+a_{1}x+a_{0}. Then, by the triangle inequality and the algebra property of ∥.∥∗\|.\|^{*},

Since the coefficients of RPR_{P} are all non-negative, this is at most RP(C)R_{P}(C), which is at most ρ(C,δ,J)\rho(C,\delta,J), by our choice of PP. ∎

In more qualitative terms, the above lemma tells us that if ϕ\phi is bounded in an algebra norm and we compose it with an arbitrary continuous function JJ, then the resulting function JϕJ\phi can be uniformly approximated by functions that are still bounded in the algebra norm.

The next result is our first transference theorem of the paper. It tells us that if μ\mu and ν\nu are non-negative functions on a set XX and they are sufficiently close in an appropriate norm, then any non-negative function that is dominated by μ\mu can be “transferred to”—that is, approximated by—a non-negative function that is dominated by ν\nu. We shall apply this principle in Section 5. As we shall see later in this section, it is also not hard to generalize the result to obtain a generalized version of the Green-Tao transference theorem.

An equivalent way of stating the conclusion is that f=g+hf=g+h with 0≤g≤ν(1−δ)−10\leq g\leq\nu(1-\delta)^{-1} and ∥h∥≤η\|h\|\leq\eta. Thus, if the result is false then we can find a functional ϕ\phi such that ⟨f,ϕ⟩>1\langle f,\phi\rangle>1, but ⟨g,ϕ⟩≤1\langle g,\phi\rangle\leq 1 for every gg such that 0≤g≤ν(1−δ)−10\leq g\leq\nu(1-\delta)^{-1}, and ∥ϕ∥∗≤η−1\|\phi\|^{*}\leq\eta^{-1}.

The first condition on ϕ\phi is equivalent to the statement that ⟨ν,ϕ+⟩≤1−δ\langle\nu,\phi_{+}\rangle\leq 1-\delta. To see this, note that for any ϕ\phi, the gg that maximizes ⟨g,ϕ⟩\langle g,\phi\rangle takes the value 00 when ϕ(x)<0\phi(x)<0 and ν(x)(1−δ)−1\nu(x)(1-\delta)^{-1} when ϕ(x)≥0\phi(x)\geq 0, in which case ⟨g,ϕ⟩=(1−δ)−1⟨ν,ϕ+⟩\langle g,\phi\rangle=(1-\delta)^{-1}\langle\nu,\phi_{+}\rangle.

Now ϕ+\phi_{+} is equal to JϕJ\phi. Since ∥.∥∗\|.\|^{*} is an algebra norm, we can apply Lemma 4.2 and obtain a polynomial PP such that ∥Pϕ−ϕ+∥∞≤δ/4\|P\phi-\phi_{+}\|_{\infty}\leq\delta/4 and ∥Pϕ∥∗≤RP(C)=ρ(η−1,δ/4,J)\|P\phi\|^{*}\leq R_{P}(C)=\rho(\eta^{-1},\delta/4,J), which we shall abbreviate to ρ\rho.

Since ⟨ν,ϕ+⟩≤1−δ\langle\nu,\phi_{+}\rangle\leq 1-\delta and ∥ν∥1≤1\|\nu\|_{1}\leq 1, it follows that ⟨ν,Pϕ⟩≤1−3δ/4\langle\nu,P\phi\rangle\leq 1-3\delta/4. Since ∥Pϕ∥∗≤ρ\|P\phi\|^{*}\leq\rho and ∥μ−ν∥≤ϵ\|\mu-\nu\|\leq\epsilon, it follows that ⟨μ,Pϕ⟩≤1−3δ/4+ϵρ\langle\mu,P\phi\rangle\leq 1-3\delta/4+\epsilon\rho. Since ∥μ∥1≤1\|\mu\|_{1}\leq 1, it follows that ⟨μ,ϕ+⟩≤1−δ/2+ϵρ\langle\mu,\phi_{+}\rangle\leq 1-\delta/2+\epsilon\rho. Since f≤μf\leq\mu it follows that ⟨f,ϕ+⟩≤1−δ/2+ϵρ\langle f,\phi_{+}\rangle\leq 1-\delta/2+\epsilon\rho, and since f≥0f\geq 0 it follows that ⟨f,ϕ⟩≤1−δ/2+ϵρ\langle f,\phi\rangle\leq 1-\delta/2+\epsilon\rho, which is a contradiction. ∎

2. Approximate duality and algebra-like structures.

As the previous section shows, we can carry out polynomial-approximation arguments when we are looking at a norm ∥.∥\|.\| for which the dual norm ∥.∥∗\|.\|^{*} is an algebra norm. A key insight of Green and Tao (which has received less comment than other aspects of their proof) is that one can carry out polynomial-approximation arguments under hypotheses that are weaker in two respects: one can use pairs of norms that are not precisely dual to each other, and the norm that measures structure can have much weaker properties than those of an algebra norm. It is not hard to generalize the arguments in an appropriate way: the insight was to see that there were important situations in which one could obtain the weaker hypotheses even when the stronger ones were completely false.

To see why this might be, think once again about the one algebra norm we have so far considered, namely ∥f^∥∞\|\hat{f}\|_{\infty}. For bounded functions ff, this is closely related (by Proposition 2.7 and the remark after it) to ∥f^∥4\|\hat{f}\|_{4}, which equals the U2U^{2}-norm, so we can deduce facts related to the U2U^{2}-norm from the fact that ∥f^∥1\|\hat{f}\|_{1} is an algebra norm.

We can regard this argument as carrying out the following procedure. First, we establish an inverse theorem for the U2U^{2}-norm: this is what we did in Proposition 2.7. We then note that the functions that we obtain in the inverse theorem, namely the characters, are closed under pointwise multiplication. And then we make the following observation.

Suppose that f=∑i=1kλifif=\sum_{i=1}^{k}\lambda_{i}f_{i} and g=∑j=1lμjgjg=\sum_{j=1}^{l}\mu_{j}g_{j}, with all fif_{i} and gjg_{j} in XX. Then fg=∑i=1k∑j=1lλiμjfigjfg=\sum_{i=1}^{k}\sum_{j=1}^{l}\lambda_{i}\mu_{j}f_{i}g_{j}. Since XX is closed under pointwise multiplication, each figjf_{i}g_{j} belongs to XX. Moreover, ∑i=1k∑j=1l∣λi∣∣μj∣=∑i=1k∣λi∣∑j=1l∣μj∣\sum_{i=1}^{k}\sum_{j=1}^{l}|\lambda_{i}||\mu_{j}|=\sum_{i=1}^{k}|\lambda_{i}|\sum_{j=1}^{l}|\mu_{j}|. From this the submultiplicativity follows easily. The fact that ∥1∥=1\|\mathbf{1}\|=1 follows from the assumption that 1∈X\mathbf{1}\in X and that all functions in XX have L∞L_{\infty}-norm at most 1. ∎

Now suppose that we want to prove comparable facts about the U3U^{3}-norm. An obvious approach would be to use Theorem 2.9, the inverse theorem for the U3U^{3}-norm. However, the generalized quadratic phase functions that appear in the conclusion of that theorem are not quite closed under pointwise multiplication: associated with them are certain parameters that one wants to be small, which obey rules such as γ(fg)≤γ(f)+γ(g)\gamma(fg)\leq\gamma(f)+\gamma(g).

As we shall see, this is not a serious difficulty, because often one can restrict attention to products of a bounded number of functions that an inverse theorem provides. A more fundamental problem is that for the higher UkU^{k}-norms we do not (yet) have an inverse theorem. Or at least, we do not have an inverse theorem where the function that appears in the conclusion can be explicitly described. What Green and Tao did to get round this difficulty was to define a class of functions that they called basic anti-uniform functions, and to prove a “soft” inverse theorem concerning those functions.

Needless to say, the above definition generalizes straightforwardly to a class of basic anti-uniform functions for the UkU^{k}-norm, for any kk. The same applies to the next proposition.

The way we have stated the result is rather artificial, since the basic anti-uniform function in question is nothing other than Df\mathcal{D}f. Moreover, it is trivial that ⟨f,Df⟩≥ϵ8\langle f,\mathcal{D}f\rangle\geq\epsilon^{8}, since if we expand the left-hand side we obtain the formula for ∥f∥U38\|f\|_{U^{3}}^{8}. ∎

Of course, the price one pays for such a simple proof is that one has far less information about basic anti-uniform functions than one would have about something like a generalized polynomial phase function. In particular, it is not obvious what one can say about products of basic anti-uniform functions.

We remark here that an inequality proved in [G1] implies easily that ⟨g,Df⟩≤∥g∥U3∥f∥U37\langle g,\mathcal{D}f\rangle\leq\|g\|_{U^{3}}\|f\|_{U^{3}}^{7} for every function gg. Thus, ∥Df∥U3∗≤∥f∥U37\|\mathcal{D}f\|_{U^{3}}^{*}\leq\|f\|_{U^{3}}^{7}. Since ⟨f,Df⟩=∥f∥U3∥f∥U37\langle f,\mathcal{D}f\rangle=\|f\|_{U^{3}}\|f\|_{U^{3}}^{7}, we see that Df\mathcal{D}f is a support functional for ff. It is not hard to show that it is unique (up to a scalar multiple). Since every function is a support functional for something, it may seem as though there is something odd about the definition of a basic anti-uniform function. However, it is less all-encompassing than it seems, because we are restricting attention to functions Df\mathcal{D}f for which ff belongs to some specified class of functions XX. (Nevertheless, we shall usually choose XX in such a way that every function is a multiple of a basic anti-uniform function.)

A crucial fact that Green and Tao proved about basic anti-uniform functions is that, for suitable sets XX, their products have (Uk)∗(U^{k})^{*}-norms that can be controlled. To be precise, they proved the following lemma. (It is not stated as a lemma, but rather as the beginning step in the proof of their Lemma 6.3.)

For every positive integer KK there is a constant CKC_{K} such that if Df1,…,DfK\mathcal{D}f_{1},\dots,\mathcal{D}f_{K} are basic anti-uniform functions [with respect to a suitable set XX], then ∥Df1…DfK∥Uk∗≤CK\|\mathcal{D}f_{1}\dots\mathcal{D}f_{K}\|_{U^{k}}^{*}\leq C_{K}.

3. A generalization of the Green-Tao-Ziegler transference theorem.

We shall be more concerned with the form of Lemma 4.6 than with the details of what XX is, since our aim is to describe in an abstract way the important properties of the operator f↦Dff\mapsto\mathcal{D}f. This we do in the next definition, which is meant to capture the idea that the dual of a certain norm somewhat resembles an algebra norm.

(i) ⟨f,Df⟩≤1\langle f,\mathcal{D}f\rangle\leq 1 for every f∈Xf\in X;

(ii) ⟨f,Df⟩≥c(ϵ)\langle f,\mathcal{D}f\rangle\geq c(\epsilon) for every f∈Xf\in X with ∥f∥≥ϵ\|f\|\geq\epsilon;

(iii) ∥Df1…DfK∥∗≤C(K)\|\mathcal{D}f_{1}\dots\mathcal{D}f_{K}\|^{*}\leq C(K) for any functions f1,…,fK∈Xf_{1},\dots,f_{K}\in X.

By Lemma 3.5 the dual of the norm ∥.∥BAC\|.\|_{BAC} is given by the formula

Thus, it measures the ease with which a function can be decomposed into a linear combination of basic anti-uniform functions. In terms of this norm, property (ii) above is telling us that if f∈Xf\in X and ∥f∥≥ϵ\|f\|\geq\epsilon then ∥f∥BAC≥c(ϵ)\|f\|_{BAC}\geq c(\epsilon). This expresses a rough equivalence between the two norms, of a similar kind to the rough equivalence between ∥f∥U2\|f\|_{U^{2}} and ∥f^∥∞\|\hat{f}\|_{\infty} when ∥f∥∞≤1\|f\|_{\infty}\leq 1. It can also be thought of as a soft inverse theorem; property (iii) then tells us that the functions that we obtain from this inverse theorem have products that are not too big.

Now let us briefly see why Theorem 4.3 generalizes easily from preduals of algebra norms to QAP-norms. The following result is not quite the result alluded to in the title of this subsection, but it is an abstract principle that can be used as part of the proof the Green-Tao theorem. As we mentioned in the introduction, the proof given here is much shorter and simpler than the proof given by Green and Tao. (This is not quite trivial to verify as they do not explicitly state the result, but the proof here can be used to simplify Section 6 of their paper slightly, and to replace Sections 7 and 8 completely.)

It is immediate from the definition of ρ′(C1,C2,δ,J)\rho^{\prime}(C_{1},C_{2},\delta,J) that for every C1C_{1}, C2C_{2} and δ\delta there exists a polynomial PP such that ∣P(x)−J(x)∣≤δ|P(x)-J(x)|\leq\delta for every x∈[−C1,C1]x\in[-C_{1},C_{1}], and such that RP′(C2)≤ρ′(C1,C2,δ,J)R_{P}^{\prime}(C_{2})\leq\rho^{\prime}(C_{1},C_{2},\delta,J).

From the formula for ∥ϕ∥BAC∗\|\phi\|_{BAC}^{*} and the fact that this is at most C2C_{2} it follows that for any ϵ>0\epsilon>0 we can write ϕ\phi as a linear combination of basic anti-uniform functions, with the absolute values of the coefficients adding up to at most C2+ϵC_{2}+\epsilon. Therefore, for any ϵ>0\epsilon>0 we can write ϕm\phi^{m} as a linear combination of products of mm basic anti-uniform functions, with the absolute values of the coefficients adding up to at most C2m+ϵC_{2}^{m}+\epsilon. Each of these products has ∥.∥∗\|.\|^{*}-norm at most C(m)C(m), by property (iii) of QAP-norms. Hence, by the triangle inequality, ∥ϕm∥∗≤C(m)C2m\|\phi^{m}\|^{*}\leq C(m)C_{2}^{m}. More generally, if PP is the polynomial P(x)=anxn+⋯+a1x+a0P(x)=a_{n}x^{n}+\dots+a_{1}x+a_{0}, then by the triangle inequality we obtain that

As we remarked at the beginning of the proof, this is at most ρ′(C1,C2,δ,J)\rho^{\prime}(C_{1},C_{2},\delta,J), so the lemma is proved. ∎

An equivalent way of stating the conclusion is that f=g+hf=g+h with 0≤g≤ν(1−δ)−10\leq g\leq\nu(1-\delta)^{-1} and ∥h∥≤η\|h\|\leq\eta. Since such an hh will belong to XX, we know that a sufficient condition for ∥h∥\|h\| to be at most η\eta is that ∥h∥BAC\|h\|_{BAC} is at most c(η)c(\eta) (since cc is strictly decreasing). Thus, if the result is false, then we can find a functional ϕ\phi such that ⟨f,ϕ⟩>1\langle f,\phi\rangle>1, but ⟨g,ϕ⟩≤1\langle g,\phi\rangle\leq 1 for every gg such that 0≤g≤ν(1−δ)−10\leq g\leq\nu(1-\delta)^{-1}, and ∥ϕ∥BAC∗≤c(η)−1\|\phi\|_{BAC}^{*}\leq c(\eta)^{-1}. For the rest of the proof, we shall write C2C_{2} for c(η)−1c(\eta)^{-1}.

As in the proof of Theorem 4.3, the first condition on ϕ\phi is equivalent to the statement that ⟨ν,ϕ+⟩≤1−δ\langle\nu,\phi_{+}\rangle\leq 1-\delta, and we still have that ϕ+=Jϕ\phi_{+}=J\phi. Also, Lemma 4.7 gives us a polynomial PP such that ∥Pϕ−Jϕ∥∞≤δ/4\|P\phi-J\phi\|_{\infty}\leq\delta/4 and ∥Pϕ∥∗≤ρ′=ρ′(C(1)C2,C2,δ/4,J)\|P\phi\|^{*}\leq\rho^{\prime}=\rho^{\prime}(C(1)C_{2},C_{2},\delta/4,J).

Since ⟨ν,ϕ+⟩≤1−δ\langle\nu,\phi_{+}\rangle\leq 1-\delta and ∥ν∥1≤1\|\nu\|_{1}\leq 1, it follows that ⟨ν,Pϕ⟩≤1−3δ/4\langle\nu,P\phi\rangle\leq 1-3\delta/4. Since ∥Pϕ∥∗≤ρ′\|P\phi\|^{*}\leq\rho^{\prime} and ∥μ−ν∥≤ϵ\|\mu-\nu\|\leq\epsilon, it follows that ⟨μ,Pϕ⟩≤1−3δ/4+ϵρ′\langle\mu,P\phi\rangle\leq 1-3\delta/4+\epsilon\rho^{\prime}. Since ∥μ∥1≤1\|\mu\|_{1}\leq 1, it follows that ⟨μ,ϕ+⟩≤1−δ/2+ϵρ′\langle\mu,\phi_{+}\rangle\leq 1-\delta/2+\epsilon\rho^{\prime}. Since f≤μf\leq\mu it follows that ⟨f,ϕ+⟩≤1−δ/2+ϵρ′\langle f,\phi_{+}\rangle\leq 1-\delta/2+\epsilon\rho^{\prime}, and since f≥0f\geq 0 it follows that ⟨f,ϕ⟩≤1−δ/2+ϵρ′\langle f,\phi\rangle\leq 1-\delta/2+\epsilon\rho^{\prime}, which is a contradiction. ∎

The abstract theorem stated and proved by Tao and Ziegler is both more and less general than Theorem 4.8. It is less general in that it takes ν\nu to be the uniform probability measure (and uses the letter ν\nu instead of μ\mu, so that the two measures are ν\nu and 1\mathbf{1}). But in a small way it is more general: they observe that we did not really need the full strength of the assumptions we made.

4. Arithmetic progressions in the primes.

In this section we shall briefly describe how a special case of Theorem 4.8, the second transference principle we proved earlier in the paper, was used by Green and Tao to prove that the primes contain arbitrarily long arithmetic progressions.

The main idea of their proof is an ingenious way of getting round the difficulty that the primes less than NN do not form a dense subset of {1,2,…,N}\{1,2,\dots,N\}. This sparseness problem occurs in several places in the literature, and there is a method by which one can sometimes deal with it, which is to exploit the fact that one has a lot of control over random (or random-like) sets. In particular, there are various results that assert that if XX is a sparse random-like set and YY is a subset of XX that is dense in XX (in the sense that ∣Y∣/∣X∣|Y|/|X| is bounded below by a positive constant) then YY behaves in a way that is analogous to how a dense set would behave. That is, sparse sets can be handled if you can embed them densely into random-like sets.

Green and Tao reasoned that an approach like this might work for the primes. There is a standard technicality to deal with first, which is that the primes are much denser in some arithmetic progressions than others. A moment’s thought shows that this makes it impossible to embed the primes from 1 to NN densely into a quasirandom set. However, one can restrict to an arithmetic progression in which the primes are particularly dense (by looking at primes that are congruent to aa mod mm, where mm is the product of the first few primes and aa is coprime to mm), in which this problem effectively disappears.

To carry out their approach, they needed to do two things. First, they had to prove that there was indeed a quasirandom set containing the primes (inside a suitable arithmetic progression, but we’ll use the word “primes” as a shorthand here) that was not much bigger than the primes. If they could do that, then the general principle that relatively dense subsets of quasirandom sets behave like dense sets would suggest that the primes should behave like a dense set. Since dense sets contain plenty of arithmetic progressions, so should the primes. The second stage of their proof was to make this heuristic argument rigorous.

As it turns out, they did not construct a quasirandom superset of the primes, but an object that they called a pseudorandom measure. This was a non-negative function ν\nu that did not have to be 01-valued, but in other respects behaved like a superset of the primes. (In fact, they normalized it to have average 1, but even then it did not take just one non-zero value.) The construction of ν\nu was based on very recent (at the time) results of Goldston and Yıldırım [GY]. This part of the proof belongs squarely in analytic number theory and we shall say no more about it here.

The other part of the proof proceeded as follows. Let ν\nu be a pseudorandom measure: that is, a non-negative function defined on {1,2,…,N}\{1,2,\dots,N\} such that ∥ν∥1=1\|\nu\|_{1}=1, which satisfied certain quasirandom properties. (These properties were similar to, but stronger than, the assertion that ∥ν−1∥Uk\|\nu-\mathbf{1}\|_{U^{k}} was very small.) Let us call a set AA dense relative to ν\nu if there is a positive constant λ\lambda such that λA≤ν\lambda A\leq\nu and ∥λA∥1≥c\|\lambda A\|_{1}\geq c for some positive constant cc that does not depend on NN. Since ∥ν−1∥Uk\|\nu-\mathbf{1}\|_{U^{k}} is small, the transference principle of Theorem 4.8 can be used to replace the function λA\lambda A by a function ff that takes values in $andhasthepropertythatand has the property that\|f-\lambda A\|_{U^{k}}$ is small, provided, that is, that the hypotheses of Theorem 4.8 are satisfied.

The programme for completing the proof is therefore clear: one must prove that the hypotheses are indeed satisfied, and one must prove that the fact that ∥f−λA∥Uk\|f-\lambda A\|_{U^{k}} is small allows us to conclude that AA contains arithmetic progressions of length k+2k+2 (as one expects, since in other contexts the UkU^{k} norm controls progressions of this length).

Let us briefly recall what these hypotheses are. We define XX to be the set of all functions that are bounded above in modulus by ν+1\nu+1, and we would like the UkU^{k} norm to be a QAP-norm with respect to XX. (These were defined at the beginning of Section 4.3.) Not surprisingly, as our non-linear operator D\mathcal{D} we take the operator defined just before Proposition 4.5 (for the appropriate kk), except that for convenience we multiply it by 2−(k+1)2^{-(k+1)}.

The first hypothesis is that ⟨f,Df⟩≤1\langle f,\mathcal{D}f\rangle\leq 1 for every f∈Xf\in X. It is straightforward to check from Green and Tao’s definition of pseudorandomness that ∥f∥Uk\|f\|_{U^{k}} is at most 2k+o(1)2^{k}+o(1) for each f∈Xf\in X, and therefore this hypothesis is satisfied.

The second is that ⟨f,Df⟩≥c(ϵ)\langle f,\mathcal{D}f\rangle\geq c(\epsilon) for every f∈Xf\in X with ∥f∥Uk≥ϵ\|f\|_{U^{k}}\geq\epsilon. But this is true because, with our definition of D\mathcal{D}, ⟨f,Df⟩=2−(k+1)∥f∥Uk\langle f,\mathcal{D}f\rangle=2^{-(k+1)}\|f\|_{U^{k}}. (We have essentially given this argument already, in Proposition 4.5.)

The third is that products of basic anti-uniform functions have bounded (Uk)∗(U^{k})^{*}-norms. This is a lemma of Green and Tao that we stated as Lemma 4.6. It should be noted that to prove this they required quasirandomness hypotheses on ν\nu that are stronger than one might expect: in particular they needed more than just that ν\nu should be close to 1\mathbf{1} in some UrU^{r} norm. (The precise condition they needed is called the correlation condition in their paper.) It is not known whether there exists an rr such that their transference theorem holds under the hypothesis that ∥ν−1∥Ur\|\nu-\mathbf{1}\|_{U^{r}} is small.

The one remaining ingredient of their argument is what they call a “generalized von Neumann theorem,” in which they establish the fact mentioned above, that if ∥f−λA∥Uk\|f-\lambda A\|_{U^{k}} is small then AA contains arithmetic progressions of length k+2k+2. More precisely,

If AA is a dense set, so that λ\lambda is bounded above by a constant independent of NN, then this is a standard result, but it is quite a bit harder to prove when all one knows about AA is that λA\lambda A is bounded above by a pseudorandom measure.

Tao’s structure theorem.

In this section we shall combine some of the methods and results of previous sections in order to obtain a general structure theorem for bounded functions. This result resembles Proposition 3.7 in that we decompose a function ff as a sum f1+f2+f3f_{1}+f_{2}+f_{3} with ∥f1∥∗≤C\|f_{1}\|^{*}\leq C, ∥f2∥≤η(C)\|f_{2}\|\leq\eta(C) and ∥f3∥2≤ϵ\|f_{3}\|_{2}\leq\epsilon, but this time we shall assume that ff takes values in an interval [a,b][a,b] and deduce stronger properties of the functions fif_{i}: in particular, f1f_{1} will also take values in the interval [a,b][a,b]. In order to do this, we shall need to use polynomial approximations. It would be possible to prove a result about QAP-norms, but the notation is simpler if we assume the stronger hypothesis that the dual norm ∥.∥∗\|.\|^{*} is an algebra norm. As we shall see, this result is general enough to apply in many interesting situations.

Here, then, is the structure theorem we shall prove in this section. Tao’s structure theorem is essentially the same result, but for a specific sequence of algebra norms. However, his method can easily be modified to prove this more general formulation. (In other words, the point of this section is the method of proof rather than the extra generality of the conclusion.) We should mention here that there are other results of a similar flavour to Tao’s, which are often referred to as “arithmetic regularity lemmas”. The following result can be thought of as an abstract arithmetic regularity lemma.

There is a simple way of making Theorem 5.1 more general, and this is very important for some applications, including Tao’s application to Szemerédi’s theorem. In order to explain the generalization, it will be convenient to introduce another definition.

The proof we shall give in this paper is quite different from that of Tao. The main idea is to start with a decomposition obtained using Proposition 3.7 (which was an easy consequence of the Hahn-Banach theorem) and to adjust it until the functions f1f_{1} and f1+f3f_{1}+f_{3} have the right ranges. During the process of adjustment, we shall have cause to use Theorem 4.3, the first of the transference theorems obtained in the previous section. The proof is conceptually very simple, but it involves a longish sequence of small calculations to check that the errors that we introduce when we adjust our decomposition are small.

To begin with, then, let θ\theta be a decreasing positive function and β\beta a positive constant, both to be specified later, and apply Proposition 3.7 to write ff as f1+f2+f3f_{1}+f_{2}+f_{3} with ∥f1∥∗=K\|f_{1}\|^{*}=K, ∥f2∥≤θ(K)\|f_{2}\|\leq\theta(K) and ∥f3∥≤β\|f_{3}\|\leq\beta. Here, KK is bounded above by a function of θ\theta and β\beta, so later we shall need θ\theta and β\beta to depend only on η\eta and ϵ\epsilon.

We would now like to modify f1f_{1} so that it takes values in the interval [a,b][a,b]. The obvious way of doing this is to apply Lemma 4.2 with the continuous function JJ that takes the value aa when x<ax<a, bb when x>bx>b and xx when x∈[a,b]x\in[a,b]. This gives us a new function Pf1Pf_{1} such that ∥Pf1−Jf1∥∞≤δ\|Pf_{1}-Jf_{1}\|_{\infty}\leq\delta and ∥Pf1∥∗≤ρ=ρ(K,δ,J)\|Pf_{1}\|^{*}\leq\rho=\rho(K,\delta,J). The first inequality implies that Pf1Pf_{1} takes values in [a−δ,b+δ][a-\delta,b+\delta], and a small adjustment will correct that to [a,b][a,b]. However, before we do the adjustment, let us check that f1−Pf1f_{1}-Pf_{1} is small in an appropriate sense. Intuitively, this is plausible: it should not be possible for the structured part of ff to stray too far from the interval [a,b][a,b] for too long. This intuition turns out to be correct, and proving it rigorously is not very hard.

Let f1f_{1} and Pf1Pf_{1} be the functions just defined. Then provided that the function θ\theta is sufficiently small (in terms of aa, bb and β\beta), we have the inequality ∥f1−Pf1∥2≤3β/2\|f_{1}-Pf_{1}\|_{2}\leq 3\beta/2.

From the decomposition f=f1+f2+f3f=f_{1}+f_{2}+f_{3} we obtain the decomposition

We shall now bound ∥f1−Pf1∥22\|f_{1}-Pf_{1}\|_{2}^{2} by looking at the inner products of f1−Pf1f_{1}-Pf_{1} with each of the three terms on the right-hand side.

First of all, if f1(x)>bf_{1}(x)>b then Jf1(x)=bJf_{1}(x)=b, so ∣Pf1(x)−b∣≤δ|Pf_{1}(x)-b|\leq\delta, and therefore f1(x)−Pf1(x)≥−δf_{1}(x)-Pf_{1}(x)\geq-\delta. Since ff takes values in [a,b][a,b], we also find that f(x)−Pf1(x)≤δf(x)-Pf_{1}(x)\leq\delta. Similarly, if f1(x)<af_{1}(x)<a then we find that f1(x)−Pf1(x)≤δf_{1}(x)-Pf_{1}(x)\leq\delta and f(x)−Pf1(x)≥−δf(x)-Pf_{1}(x)\geq-\delta. If f1(x)∈[a,b]f_{1}(x)\in[a,b], then f1(x)=Jf1(x)f_{1}(x)=Jf_{1}(x), so ∣f1(x)−Pf1(x)∣≤δ|f_{1}(x)-Pf_{1}(x)|\leq\delta, and ∣f(x)−Pf1(x)∣≤(b−a+2δ)|f(x)-Pf_{1}(x)|\leq(b-a+2\delta). It follows from these three estimates that ⟨f1−Pf1,f−Pf1⟩≤4δ2+δ(b−a)\langle f_{1}-Pf_{1},f-Pf_{1}\rangle\leq 4\delta^{2}+\delta(b-a).

Since ∥f1∥∗≤K\|f_{1}\|^{*}\leq K, ∥Pf1∥∗≤ρ\|Pf_{1}\|^{*}\leq\rho, and ∥f2∥≤θ(K)\|f_{2}\|\leq\theta(K), it follows that

For the third inner product we use Cauchy-Schwarz to give a trivial implicit estimate:

From the estimates for these inner products it follows that

Therefore, if we choose δ\delta such that 4δ2+δ(b−a)≤β2/44\delta^{2}+\delta(b-a)\leq\beta^{2}/4 and θ\theta in such a way that (K+ρ(K,δ,J))θ(K)≤β2/2(K+\rho(K,\delta,J))\theta(K)\leq\beta^{2}/2 for every KK, then

from which it follows, on completing the square, that ∥f1−Pf1∥2≤3β/2\|f_{1}-Pf_{1}\|_{2}\leq 3\beta/2, as claimed. To complete the proof, note that the condition on θ\theta depends on ρ\rho, and hence on δ\delta, and δ\delta depends on aa, bb and β\beta. ∎

The next step is very simple. Let LL be the linear function that takes a−δa-\delta to aa and b+δb+\delta to bb. Then ∣L(x)−x∣|L(x)-x| is at most δ\delta for every xx in the interval [a−δ,b+δ][a-\delta,b+\delta]. Since f1f_{1} takes values in this interval, it follows that ∥LPf1−Pf1∥∞≤δ\|LPf_{1}-Pf_{1}\|_{\infty}\leq\delta. Also, if we write L(x)=λx+μL(x)=\lambda x+\mu, it is easy to see that 0<λ<10<\lambda<1, from which it follows that ∥LPf1∥∗≤∥Pf1∥∗+μ\|LPf_{1}\|^{*}\leq\|Pf_{1}\|^{*}+\mu (since ∣1∣∗=1|\mathbf{1}|^{*}=1). A small calculation shows that μ=−(a+b)δ/(a−b−2δ)\mu=-(a+b)\delta/(a-b-2\delta), so ∥LPf1∥∗≤2ρ\|LPf_{1}\|^{*}\leq 2\rho, provided δ\delta is moderately small (depending on aa and bb).

Let us now see where we have reached. We started with a decomposition f=f1+f2+f3f=f_{1}+f_{2}+f_{3}, and we have now modified f1f_{1}, first to Pf1Pf_{1} and then to LPf1LPf_{1}. The first modification incurred an extra error of L2L_{2}-norm at most 3β/23\beta/2, and the second an extra error of L∞L_{\infty}-norm, and hence L2L_{2}-norm, at most δ\delta. If we assume that δ≤β/2\delta\leq\beta/2 then we find that we have a decomposition f=g1+g2+g3f=g_{1}+g_{2}+g_{3}, where g1=LPf1g_{1}=LPf_{1}, g2=f2g_{2}=f_{2}, and g3=f3+(f1−LPf1)g_{3}=f_{3}+(f_{1}-LPf_{1}). We have shown that ∥g1∥∗≤2ρ\|g_{1}\|^{*}\leq 2\rho, that ∥g2∥=∥f2∥≤θ(K)\|g_{2}\|=\|f_{2}\|\leq\theta(K), and that ∥g3∥2≤β+3β/2+β/2=3β\|g_{3}\|_{2}\leq\beta+3\beta/2+\beta/2=3\beta. Moreover, g1g_{1} takes values in the interval [a,b][a,b].

This gives us most of what we want (if we choose β\beta and θ\theta appropriately). The main thing we are missing is any information about the range of g1+g3g_{1}+g_{3}. In order to obtain the extra property that g1+g3g_{1}+g_{3} takes values in [a,b][a,b], we shall focus on the equivalent problem of ensuring that f(x)−b≤g2(x)≤f(x)−af(x)-b\leq g_{2}(x)\leq f(x)-a for every xx.

Note that f(x)−b≤0f(x)-b\leq 0 and f(x)−a≥0f(x)-a\geq 0 for every xx. Our strategy for obtaining these bounds on g2g_{2} is even simpler than our strategy for adjusting f1f_{1} earlier: we shall replace g2(x)g_{2}(x) by f(x)−af(x)-a whenever g2(x)>f(x)−ag_{2}(x)>f(x)-a, and similarly on the other side. However, if that is all we do then we lose all information about ∥g2∥\|g_{2}\|. This is where Theorem 4.3, our first transference theorem, comes in: when we adjust the positive part of g2g_{2} we can use Theorem 4.3 to make a complementary adjustment to the negative part, and vice versa.

Let us therefore set g2′(x)g_{2}^{\prime}(x) to be min⁡{g2(x),f(x)−a}\min\{g_{2}(x),f(x)-a\} for each xx. First we need a simple lemma.

If g2′=min⁡{g2,f−a}g_{2}^{\prime}=\min\{g_{2},f-a\}, then ∥g2−g2′∥2≤3β.\|g_{2}-g_{2}^{\prime}\|_{2}\leq 3\beta.

For every xx, either g2(x)−g2′(x)=0g_{2}(x)-g_{2}^{\prime}(x)=0 or

where the last inequality follows from the fact that g1(x)∈[a,b]g_{1}(x)\in[a,b] for every xx. It follows that ∥g2−g2′∥2≤∥g3∥2\|g_{2}-g_{2}^{\prime}\|_{2}\leq\|g_{3}\|_{2}, which we have established to be at most 3β3\beta. ∎

Our first attempt at adjusting the decomposition is to write

Our main problem now is that we do not have a good estimate for ∥g2′∥\|g_{2}^{\prime}\|. To deal with this, we shall adjust the negative part of g2g_{2} as well, using Theorem 4.3. Let μ=(g2)+\mu=(g_{2})_{+} and let ν=(g2)−\nu=(g_{2})_{-}. Then μ\mu and ν\nu are disjointly supported, so both ∥μ∥1\|\mu\|_{1} and ∥ν∥1\|\nu\|_{1} are at most ∥g2∥1\|g_{2}\|_{1}, which is at most ∥g2∥2\|g_{2}\|_{2}. Since g2=(f−g1)+g3g_{2}=(f-g_{1})+g_{3} and ff and g1g_{1} take values in [a,b][a,b], ∥g2∥≤∣b−a∣+3β\|g_{2}\|\leq|b-a|+3\beta, by the triangle inequality and our estimate for ∥g3∥2\|g_{3}\|_{2}. Let α=∣b−a∣+3β\alpha=|b-a|+3\beta.

We now apply Theorem 4.3 with μ\mu and ν\nu as above and with f=(g2′)+f=(g_{2}^{\prime})_{+}. Strictly speaking, this is not quite accurate, since the upper bounds for ∥μ∥1\|\mu\|_{1} and ∥ν∥1\|\nu\|_{1} are α\alpha rather than 1, but we can look at the functions α−1μ\alpha^{-1}\mu, α−1ν\alpha^{-1}\nu and α−1f\alpha^{-1}f instead. The main hypothesis we have is that ∥g2∥=∥μ−ν∥≤θ(K)\|g_{2}\|=\|\mu-\nu\|\leq\theta(K), so we can take ϵ\epsilon to be α−1θ(K)\alpha^{-1}\theta(K) in Theorem 4.3. If τ>0\tau>0 is a constant such that α−1θ(K)=δ/2ρ(ατ−1,β/4,J)\alpha^{-1}\theta(K)=\delta/2\rho(\alpha\tau^{-1},\beta/4,J) (where now J(x)J(x) is the function (x+∣x∣)/2(x+|x|)/2), then we may conclude that there is a function gg such that 0≤g≤ν(1−β)−10\leq g\leq\nu(1-\beta)^{-1} and ∥f−g∥≤τ\|f-g\|\leq\tau. The important thing to note here is that τ\tau tends to zero as θ(K)\theta(K) tends to zero.

Define g2′′g_{2}^{\prime\prime} to be f−gf-g. This gives us a decomposition

We have the upper bounds g2′′(x)≤f(x)−ag_{2}^{\prime\prime}(x)\leq f(x)-a for every xx, and ∥g2′′∥≤τ\|g_{2}^{\prime\prime}\|\leq\tau. However, we have not yet checked that ∥g2′−g2′′∥2\|g_{2}^{\prime}-g_{2}^{\prime\prime}\|_{2} is small. For this we need another simple lemma.

The bound stated is an easy consequence of this. ∎

Let g′′g^{\prime\prime} be any function such that g′′(x)=g2′(x)g^{\prime\prime}(x)=g_{2}^{\prime}(x) when g2′(x)g_{2}^{\prime}(x) is non-negative, and 0≥g′′(x)≥g2′(x)0\geq g^{\prime\prime}(x)\geq g_{2}^{\prime}(x) otherwise. Suppose also that ∥g2∥≤τ\|g_{2}\|\leq\tau. Then ∥g′′−g2′∥2≤3β+(α(τ+3β))1/2\|g^{\prime\prime}-g_{2}^{\prime}\|_{2}\leq 3\beta+(\alpha(\tau+3\beta))^{1/2}.

It follows from the hypotheses that 0≤g′′(x)−g2′(x)≤ν(x)0\leq g^{\prime\prime}(x)-g_{2}^{\prime}(x)\leq\nu(x) for every xx. Recall that g2=(f−g1)+g3g_{2}=(f-g_{1})+g_{3} and that ∥f−g1∥∞≤b−a\|f-g_{1}\|_{\infty}\leq b-a. It follows easily that ν=(g2)−\nu=(g_{2})_{-} satisfies the conditions of Lemma 5.5, with γ=3β\gamma=3\beta. (We could improve α\alpha to b−ab-a, but this is not worth bothering about.)

Since the function g2′′g_{2}^{\prime\prime} constructed earlier satisfies the hypotheses required of g′′g^{\prime\prime} in Corollary 5.6, we now have an improved decomposition f=h1+h2+h3f=h_{1}+h_{2}+h_{3}, where h1=g1h_{1}=g_{1}, h2=g2′′h_{2}=g_{2}^{\prime\prime} and h3=g3+g2−g2′′h_{3}=g_{3}+g_{2}-g_{2}^{\prime\prime}. Our arguments so far have shown that h1h_{1} takes values in [a,b][a,b], that ∥h1∥∗≤2ρ\|h_{1}\|^{*}\leq 2\rho, that ∥h2∥≤τ\|h_{2}\|\leq\tau, that h2(x)≤f(x)−ah_{2}(x)\leq f(x)-a for every xx, and that ∥h3∥2≤6β+3β+(α(τ+3β))1/2\|h_{3}\|_{2}\leq 6\beta+3\beta+(\alpha(\tau+3\beta))^{1/2}. If β\beta is sufficiently small (depending on b−ab-a if that is small, which in a typical application it will not be), and τ\tau is sufficiently small (depending on β\beta), then this last quantity is at most 2(β(b−a))1/22(\beta(b-a))^{1/2}, which we shall call ζ\zeta.

From the way we constructed h2h_{2}, we know that the sign of h2h_{2} is the same as that of g2g_{2}, and that ∣h2(x)∣≤∣g2(x)∣|h_{2}(x)|\leq|g_{2}(x)| for every xx. We have obtained the upper bound of f−af-a that we wanted for h2h_{2}; now we need a further adjustment in order to obtain a lower bound of f−bf-b. It is obvious how to do this: we shall sketch the argument only very briefly.

First, we let h2′(x)=max⁡{h2(x),f(x)−b}h_{2}^{\prime}(x)=\max\{h_{2}(x),f(x)-b\} for every xx. Then a simple modification of Lemma 5.4 shows that ∥h2−h2′∥2≤3ζ\|h_{2}-h_{2}^{\prime}\|_{2}\leq 3\zeta.

Next, we use Theorem 4.3 to reduce the positive part of h2′h_{2}^{\prime}, while leaving the negative part unchanged, to create a function h2′′h_{2}^{\prime\prime} with ∥h2′′∥\|h_{2}^{\prime\prime}\| small. If we let α′=b−a+3ζ\alpha^{\prime}=b-a+3\zeta, then the same argument as before gives us an upper bound ∥h2′′∥≤κ\|h_{2}^{\prime\prime}\|\leq\kappa, where κ\kappa is a constant such that α′−1τ=δ/2ρ(α′κ−1,ζ/4,J)\alpha^{\prime-1}\tau=\delta/2\rho(\alpha^{\prime}\kappa^{-1},\zeta/4,J). In particular, κ\kappa tends to zero as τ\tau tends to zero.

Next, a simple modification of Corollary 5.6 tells us that ∥h2′′−h2′∥2≤3ζ+(α′(κ+3ζ))1/2\|h_{2}^{\prime\prime}-h_{2}^{\prime}\|_{2}\leq 3\zeta+(\alpha^{\prime}(\kappa+3\zeta))^{1/2}. Therefore, we have a decomposition f=u1+u2+u3f=u_{1}+u_{2}+u_{3}, with u1=h1u_{1}=h_{1}, u2=h2′′u_{2}=h_{2}^{\prime\prime} and u3=h3+h2−h2′′u_{3}=h_{3}+h_{2}-h_{2}^{\prime\prime}. Since u1=h1u_{1}=h_{1}, it takes values in [a,b][a,b]. The construction of h2′′h_{2}^{\prime\prime} guarantees that f(x)−b≤u2(x)≤f(x)−af(x)-b\leq u_{2}(x)\leq f(x)-a, and hence that u1+u3u_{1}+u_{3} takes values in [a,b][a,b]. Finally, we have the estimates ∥u1∥∗≤2ρ\|u_{1}\|^{*}\leq 2\rho, ∥u2∥≤κ\|u_{2}\|\leq\kappa, and ∥u3∥2≤6ζ+3ζ+(α′(κ+3ζ))1/2\|u_{3}\|_{2}\leq 6\zeta+3\zeta+(\alpha^{\prime}(\kappa+3\zeta))^{1/2}. If ζ\zeta is small enough (depending on b−ab-a) and κ\kappa is small enough (depending on ζ\zeta), then this last quantity is at most 2((b−a)ζ)1/22((b-a)\zeta)^{1/2}.

Now let us see why these estimates are enough, recalling from the beginning of the proof that we are free to choose β\beta and θ\theta. To begin with, we need 2((b−a)ζ)1/22((b-a)\zeta)^{1/2} to be at most ϵ\epsilon. But ζ\zeta tends to zero with β\beta, so this is easily achieved. Next, recall that ρ=ρ(K,δ,J)\rho=\rho(K,\delta,J). We would like κ\kappa to be at most η(ρ)\eta(\rho), which we shall ensure by making a suitable choice of θ\theta. The constant δ\delta depends on β\beta, aa and bb only, while κ\kappa tends to zero with τ\tau, which tends to zero with θ(K)\theta(K). Thus, for each KK we can choose θ(K)\theta(K) in a way that depends on KK, β\beta, aa and bb only, such that κ≤η(ρ)\kappa\leq\eta(\rho). The proof is complete.

2. Decomposition theorems with bounds on ranges.

As a simple application of Theorem 5.1, we shall now obtain the improvement that we promised earlier to our results about deducing decomposition theorems from inverse theorems. So far, we have shown that a function can be decomposed into a multiple of a convex combination of structured functions, plus an error, provided that we have a suitable inverse theorem concerning the structured functions and the kind of error we are prepared to allow. As we commented, it is sometimes useful to obtain a decomposition for which the “structured part” is bounded. We shall see that Theorem 5.1 implies rather easily that such a decomposition exists, and it has the added advantage of yielding an L2L_{2} error term rather than the L1L_{1} error term that appears in Theorem 3.8 or weaker theorems of a similar type that were discussed earlier in Section 3.2. However, the bound on the sum of the coefficients of the structured functions is very bad. For some applications, this is not a concern, but for others it turns out to be preferable to use weaker theorems.

(ii) ⟨f,ϕ⟩≤1\langle f,\phi\rangle\leq 1 for every ff with ∥f∥≤1\|f\|\leq 1 and every ϕ∈Φ\phi\in\Phi;

(iii) if ∥f∥∞≤1\|f\|_{\infty}\leq 1 and ∥f∥≥ϵ\|f\|\geq\epsilon then there exists ϕ∈Φ\phi\in\Phi such that ⟨f,ϕ⟩≥c(ϵ)\langle f,\phi\rangle\geq c(\epsilon).

Let Ψ\Psi be the set of all products of functions in Φ\Phi. Define a norm ∣.∣∗|.|^{*} by taking ∣g∣∗|g|^{*} to be the infimum of all sums ∑i∣λi∣\sum_{i}|\lambda_{i}| such that gg can be written as ∑iλiψi\sum_{i}\lambda_{i}\psi_{i} with every ψi\psi_{i} in Ψ\Psi. It is straightforward to check that this is an algebra norm. (The fact that it is a norm rather than a seminorm relies on the boundedness of functions in Φ\Phi, which one could in fact deduce from (ii) rather than stating as a separate assumption.) Moreover, (ii) and (iii) imply easily that ∣.∣∗|.|^{*} is an approximate dual for ∥.∥\|.\|. Therefore, Corollary 5.2 implies the result. ∎

The following simple trick is important in applications. Property (iii) in the statement of the theorem is the assertion that there is an inverse theorem relating the norm ∥.∥\|.\| to the set of functions in Φ\Phi. However, the conclusion of the theorem concerns products of functions in Φ\Phi, and in practice it often happens that the set Φ\Phi of functions that one obtains from an inverse theorem is not closed under pointwise multiplication. However, it also often happens that one can give an explicit description of products of functions in Φ\Phi, and that this description becomes only gradually less useful as the number of functions in the product increases. Under such circumstances, one can replace Φ\Phi by the set {1,−1}∪(Φ/2)\{\mathbf{1},-\mathbf{1}\}\cup(\Phi/2). This modified set clearly satisfies all the hypotheses that Φ\Phi was required to satisfy, but now the corresponding set Ψ\Psi comes with a “penalty” of 2−k2^{-k} attached to a product of KK functions. This means that the sum of the ∣λi∣|\lambda_{i}| over products of significantly more than log⁡2M0\log_{2}M_{0} functions in Φ\Phi make a very small (in L∞L_{\infty}) contribution to f1f_{1} and can be absorbed into the error term.

3. Applying Tao’s structure theorem

Let us briefly consider this example. If we have written a function ff as f1+f2+f3f_{1}+f_{2}+f_{3} in such a way that ∥f^∥1≤C\|\hat{f}\|_{1}\leq C, ∥f^∥2≤η(C)\|\hat{f}\|_{2}\leq\eta(C) and ∥f3∥2≤ϵ\|f_{3}\|_{2}\leq\epsilon, then we can analyse it as follows.

Now let β\beta be the characteristic measure of BB: that is, the function that takes the value N/∣B∣N/|B| on BB and 00 elsewhere. This multiple of BB is chosen so that ∥β∥1=1\|\beta\|_{1}=1. A useful property of β\beta is that f1f_{1} is close to f1∗βf_{1}*\beta in L2L_{2}. This can be shown with the help of Fourier transforms: the general method is known as Bogolyubov’s method, and it is a very useful tool in additive combinatorics. We begin by observing that

This tells us that for a typical pair xx and yy, if x−y∈Bx-y\in B, then f1(x)f_{1}(x) and f1(y)f_{1}(y) are close. Equivalently, f1f_{1} is almost always roughly constant on translates of BB.

is bounded below by some (very small) positive constant related to the density of BB, which depended on CC only. If η(C)\eta(C) is much smaller than this constant, then perturbing by f2f_{2} cannot change this lower bound to zero.

This is not quite a sketch proof of Roth’s theorem (though it is close), because there remains the problem of dealing with f3f_{3}. In fact, the correct order to work in is to think about f1f_{1} first, then f1+f3f_{1}+f_{3}, and finally f1+f2+f3f_{1}+f_{2}+f_{3}. This is why it is so helpful for f1f_{1} and f1+f3f_{1}+f_{3} to be non-negative functions.

The above idea can be thought of as a discrete analogue of at least one ergodic-theoretic proof of Roth’s theorem. Tao applied his structure theorem to a sequence of cleverly constructed algebra norms in order to extend the argument to a proof of the general case of Szemerédi’s theorem. Unfortunately, the analysis of the structured function f1f_{1} becomes far harder: that is where the real difficulty of his argument lies.

The structure theorem can also be used to replace arguments that use Szemerédi’s regularity lemma. This is not too surprising, as in both cases the strength of the result comes from the fact that the bound on the quasirandomness can be made so small that it is even small compared with the “natural scale” of the structured part. Similarly, it can be used to replace a version of Szemerédi’s regularity lemma, due to Green [G], that concerns dense subsets of finite Abelian groups.

References