Independent sets in hypergraphs
József Balogh, Robert Morris, Wojciech Samotij
Introduction
A great many of the central questions in combinatorics fall into the following general framework: Given a finite set and a collection of forbidden structures, what can be said about sets that do not contain any member of ? For example, the celebrated theorem of Szemerédi states that if and is the collection of -term arithmetic progressions in , then every set that contains no member of satisfies . The archetypal problem studied in extremal graph theory, dating back to the work of Turán and Erdős and Stone , is the problem of characterizing such sets when is the edge set of the complete graph on vertices and is the collection of copies of some fixed graph in . In this setting, a great deal is known, not only about the maximum size of that contains no member of , but also what the largest such sets look like, how many such sets there are, and what the structure of a typical such set is.
A collection as above is usually referred to as a hypergraph on the vertex set and any set that contains no element (edge) of is called an independent set. Therefore, one might say that a large part of extremal combinatorics is concerned with studying independent sets in various specific hypergraphs. We might add here that in many natural settings, such as the two mentioned above, the hypergraphs considered are uniform, that is, all edges of have the same size.
Although it might at first seem somewhat artificial to study concrete questions in such an abstract setting, the past few years have proved that taking such a general approach can be highly beneficial. The recently-proved general transference theorems of Conlon and Gowers and Schacht (see also ), which imply, among other things, sparse random analogues of the classical theorems of Szemerédi and of Erdős and Stone, were stated in the language of hypergraphs. Roughly speaking, these transference theorems say the following: Let be a hypergraph whose edges are sufficiently ‘uniformly distributed’. Then the independence number of is ‘well-behaved’ with respect to taking subhypergraphs induced by (sufficiently dense) random subsets of the vertex set. More precisely, given and a finite set , we shall write to denote the -random subset of , that is, the random subset of in which each element of is included with probability , independently of all other elements. We write and to denote the size of the largest independent set and the number of vertices in a hypergraph , respectively. The results of Conlon and Gowers and Schacht imply, in particular, that if the distribution of the edges of some uniform hypergraph is sufficiently ‘balanced’, then with probability tending to as ,
In this work, we give an approximate structural characterization of the family of all independent sets in uniform hypergraphs whose edge distribution satisfies a certain natural boundedness condition. More precisely, we shall prove that the family of independent sets of such a hypergraph exhibits a certain clustering phenomenon. Our main result (Theorem 2.2, below) states that admits a partition into relatively few classes with the following property: all members of each class are essentially contained in a single ‘almost independent’ subset of (i.e., one which contains only a tiny proportion of all the edges of ). This somewhat abstract statement has surprisingly many deep and interesting consequences, some of which we list in the remainder of this section. We remark that Theorem 2.2 was partly inspired by the work of Kleitman and Winston , who implicitly considered a statement of this type in the setting of graphs (-uniform hypergraphs) and subsequently used it to bound the number of -vertex graphs without a -cycle. We also note that a result similar to Theorem 2.2 was independently proved by Saxton and Thomason , who also use it to derive many of the statements that we present in Sections 1.1– 1.4.
-subsets of that contain no -term AP.
We remark that Theorem 1.1 and Corollary 1.2 are both sharp up to the value of the constant , see the discussion in Section 4, where both of these statements are proved.
Our main result has a variety of other applications in additive combinatorics, see for example where, jointly with Alon, we used a much simpler version of it to count sum-free sets of fixed size in various Abelian groups and the set . In Section 4, we shall mention two other applications: generalizations of Theorem 1.1 to higher dimensions and to -term APs whose common difference is of the form . In each case, the random version (which was proved in ) follows as an easy corollary.
2. Turán’s problem in random graphs
The famous theorem of Erdős and Stone states that the maximum number of edges in an -free graph on vertices, the Turán number for , denoted , satisfies
where denotes the maximum number of edges in an -free subgraph of .
By considering a random -partition of the vertex set of , it is straightforward to show that the inequality \operatorname{ex}\big{(}G(n,p),H\big{)}\geqslant\left(1-\frac{1}{\chi(H)-1}+o(1)\right)\binom{n}{2}p holds for every . On the other hand, if the number of copies of some subgraph in is much smaller than the number of edges in , then the converse inequality cannot hold, since one can make any graph -free by removing from it one edge from each copy of . This observation motivates the notion of -density of , denoted by , which is defined by
It now follows easily that for every graph with maximum degree at least and every \delta\in\big{(}0,1/(\chi(H)-1)\big{)}, there exists a positive constant such that if , then a.a.s.
It was conjectured by Haxell, Kohayakawa, and Łuczak and Kohayakawa, Łuczak, and Rödl that the above simple argument, removing an arbitrary edge from each copy of in , is the main obstacle that prevents (2) from holding asymptotically almost surely. The conjecture, often referred to as Turán’s theorem for random graphs, has attracted considerable attention in the past fifteen years. Numerous partial results and special cases had been established by various researchers before the conjecture was finally proved by Conlon and Gowers (under the assumption that is strictly -balancedA graph is -balanced if the maximum in (3) is achieved with , that is, if . It is strictly -balanced if for every proper subgraph .) and by Schacht .
For every graph with and every positive , there exists a positive constant such that if , then a.a.s.
Our methods give yet another proof of Theorem 1.3. In fact, we shall deduce from our main result, Theorem 2.2, a version of the general transference theorem of Schacht [58, Theorem 3.3], which easily implies Theorem 1.3 for such graphs . Our version of Schacht’s transference theorem, Theorem 5.2, is stated and proved in Section 5. We then, in Section 7, use it to derive a natural generalization of Theorem 1.3 to -uniform hypergraphs, Theorem 7.2, which was also first proved in and .
In the original version of this paper, we only proved the results concerning -free graphs under the additional assumption that is -balanced. However, a simple modification of our method (permitting multiple edges in our hypergraphs, as in ) allowed us to remove this condition. We would like to thank David Saxton for pointing this out.
Our methods also yield the following sparse random analogue of the famous stability theorem of Erdős and Simonovits , originally proved by Conlon and Gowers in the case when is strictly -balanced and then extended to arbitrary by Samotij , who adapted the argument of Schacht for this purpose.
For every graph with and every positive , there exist positive constants and such that if , then a.a.s. the following holds. Every -free subgraph of with at least
edges may be made -partite by removing from it at most edges.
As with Theorem 1.3, we shall in fact deduce Theorem 1.5 from a more general statement, Theorem 6.2, which is a version of the general transference theorem for stability results proved in . Theorem 6.2 is stated and proved in Section 6; in Section 7, we use it to derive Theorem 1.5.
3. The typical structure of H𝐻H-free graphs
Let be an arbitrary non-empty graph. For an integer , denote by the number of labelled -free graphs on the vertex set . Since every subgraph of an -free graph is also -free, it follows that . Erdős, Frankl, and Rödl proved that this crude lower bound is in a sense tight, namely that
Our next result can be viewed as a ‘sparse version’ of (4). Such a statement was already considered by Łuczak , who derived it from the so-called KŁR conjecture, which we discuss in the next subsection. For integers and with , let be the number of labelled -free graphs on the vertex set that have exactly edges. The following theorem refines (4) to -vertex graphs with edges.
In fact, we shall deduce from our main result, Theorem 2.2, a ‘counting version’ of the general transference theorem of Schacht [58, Theorem 3.3], which easily implies Theorem 1.6. This ‘counting version’ of Schacht’s theorem (which refines and, in some respects, strengthens the main results of ) is stated and proved in Section 5. We then use it to derive Theorem 1.6 in Section 8. We remark that (4) was refined in a different sense by Balogh, Bollobás, and Simonovits , who showed that , where is some positive constant, and also gave a very precise structural description of almost all -free graphs. We would also like to point out that our proof of Theorem 1.6 does not use Szemerédi’s regularity lemma, unlike the proof given in or the proofs of Erdős, Frankl, and Rödl and Balogh, Bollobás, and Simonovits .
The result of Erdős, Frankl, and Rödl has, in some cases, a structural counterpart that significantly strengthens (4). For example, Erdős, Kleitman, and Rothschild proved that almost all triangle-free graphs are bipartite, that is, that with probability tending to as , a graph selected uniformly at random from the family of all triangle-free graphs on the vertex set is bipartite or, in other words (since clearly every bipartite graph is triangle-free), is asymptotic to the number of bipartite graphs on the vertex set . Extending this result, Osthus, Prömel, and Taraz proved that if for some , then almost all -vertex triangle-free graphs with edges are bipartite. The corresponding result for -free graphs was proved recently in .
Our next result, which is a strengthening of Theorem 1.6, is an approximate version of this statement for an arbitrary graph . Such a statement was also considered by Łuczak , who derived it from the KŁR conjecture. Following , given a positive real and an integer , let us say that a graph is -partite if can be made -partite by removing from it at most edges.
For every graph with , and every positive , there exists a positive constant such that the following holds. If , then almost all -free graphs with vertices and edges are \big{(}\delta,\chi(H)-1\big{)}-partite.
As with Theorem 1.6, we shall in fact deduce Theorem 1.7 from a ‘counting version’ of the general transference theorem for stability results proved in . Our version of it, Theorem 6.3, is stated and proved in Section 6. In Section 8, we use it to derive Theorem 1.7. Once again, our proof does not use the regularity lemma, unlike that in . Finally, we would like to mention that, as observed by Łuczak , Theorem 1.7 has the following elegant corollary.
where is a uniformly selected random -vertex graph with edges.
4. The KŁR conjecture
The celebrated Szemerédi regularity lemma , which is considered to be one of the most important and powerful tools in extremal graph theory, says that the vertex set of every graph may be divided into a bounded number of parts of approximately the same size in such a way that most of the bipartite subgraphs induced between pairs of parts of the partition satisfy a certain pseudo-randomness condition termed -regularity. The strength of the regularity lemma lies in the fact that it may be combined with the so-called embedding lemma to show that a graph contains particular subgraphs. The combination of the regularity and embedding lemmas allows one to prove many well-known theorems in extremal graph theory, such as the theorem of Erdős and Stone and the stability theorem of Erdős and Simonovits , both mentioned in Section 1.2.
For sparse graphs, that is, -vertex graphs with edges, the original version of the regularity lemma is vacuous since if the vertex set of a sparse graph is partitioned into a bounded number of parts, then all induced bipartite subgraphs thus obtained are trivially -regular, provided that is sufficiently large. However, it was independently observed by Kohayakawa and Rödl (unpublished) that the notion of -regularity may be extended in a meaningful way to graphs with density tending to zero. Moreover, with this more general notion of regularity, they were also able to prove an associated regularity lemma which applies to a large class of sparse graphs, including (a.a.s.) the random graph .
Given a and a positive , we say that a bipartite graph between sets and is -regular if for every and with and , the density of edges between and satisfies
A partition of the vertex set of a graph into parts is said to be -regular if \big{|}|V_{i}|-|V_{j}|\big{|}\leqslant 1 for all and and for all but at most pairs , the graph induced between and is -regular. The class of graphs to which the Kohayakawa-Rödl regularity lemma applies are the so-called upper-uniform graphs. Given positive and , we say that an -vertex graph is -upper-uniform if for all with , the density of edges within satisfies . This condition is satisfied by many natural classes of graphs, including (a.a.s.) all subgraphs of random graphs of density . The sparse regularity lemma of Kohayakawa and Rödl says the following.
For all positive , , and , there exist a positive constant and an integer such that for every , the following holds. Every -upper-uniform graph with at least vertices admits an -regular partition of its vertex set into parts, for some .
We remark that a version of this theorem avoiding the need for the upper-uniformity assumption was recently proved by Scott .
The aforementioned embedding lemma roughly says that if we start with an arbitrary graph , replace its vertices by large independent sets and its edges by -regular bipartite graphs with density much larger than , then this blown-up graph will contain a copy of . To make it more precise, let be a graph on the vertex set , let and be as above, and let and be integers satisfying . Let us denote by the collection of all graphs constructed in the following way. The vertex set of is a disjoint union of sets of size , one for each vertex of . For each edge of , we add to an -regular bipartite graph with edges between the sets and . These are the only edges of . With this notation in hand, we can state the embedding lemma. Given any graph as above, we define canonical copies of to be all copies of in in which (the image of) each vertex lies in the set .
For every graph and every positive , there exist a positive and an integer such that for every and with and , every contains a canonical copy of .
One might hope that a similar statement holds when one replaces by an arbitrary and the assumption by , even if is a decreasing function of . However, for an arbitrary function , this is too much to hope for. Indeed, consider the random ‘blow-up’ of , that is, the random graph obtained from by replacing each vertex of by an independent set of size and each edge of by a random bipartite graph with edges. With high probability, the number of canonical copies of in will be about and hence if , then one can remove all copies of from by deleting a tiny proportion of all edges. Since in the above argument one may replace with an arbitrary subgraph , it follows easilyNote that we also replace with some , and that the removal of edges does not affect the -regularity conditions. that if , then there are graphs in that do not contain any canonical copies of .
As in the case of Turán’s theorem for random graphs, see Section 1.2, one might still hope that if for some large constant , then the natural sparse analogue of the embedding lemma discussed above holds. However, it was observed by Łuczak (see ) that, somewhat surprisingly, for any graph which contains a cycle and any function satisfying , there are graphs in with no canonical copy of . Nevertheless, it still seemed likely that such atypical graphs comprise so tiny a proportion of that they do not appear in asymptotically almost surely.
This was formalized in the following conjecture of Kohayakawa, Łuczak, and Rödl , usually referred to as the KŁR conjecture. Given a graph , integers and , a , and a positive , let denote the collection of graphs in that contain no canonical copy of . We will prove the conjecture in Section 9.
It is well-known that Theorem 1.9 easily implies Turán’s theorem for random graphs, Theorem 1.3, and also its stability version, Theorem 1.5. In fact, this was the original motivation behind the KŁR conjecture, see . Moreover, it was proved by Łuczak that Theorem 1.9 implies Theorems 1.6 and 1.7. The work of Conlon and Gowers and Schacht (see also ), as well as this work, have shown that one does not need to appeal to the sparse regularity lemma and to the KŁR conjecture in order to prove such extremal statements in random graphs. Nevertheless, there are still many beautiful corollaries of the conjecture that cannot (yet) be proved by other means. For discussion and derivation of some of them, we refer the reader to . Here, we present only one corollary of the KŁR conjecture, the threshold for asymmetric Ramsey properties of random graphs, which does not follow from the version of the conjecture proved in . The deduction of this result from the KŁR conjecture is essentially due to Kohayakawa and Kreuter .
5. Ramsey properties of random graphs
Let be a fixed graph and let be a positive integer. For an arbitrary graph , we write if every -coloring of the edges of contains a monochromatic copy of . It follows from the classical result of Ramsey that , provided that is sufficiently large. Ramsey properties of random graphs were first investigated by Frankl and Rödl and since then much effort has been devoted to their study. Most notably, Rödl and Ruciński established the following general threshold result.
For every graph that is not a forest, and every positive integer , there exist positive constants and such that
In the above discussion, a copy of the same graph is forbidden in each of the color classes. A natural generalization of Theorem 1.10 would determine thresholds for so-called asymmetric Ramsey properties. For any graphs , , we write if for every coloring of the edges of with colors , there exists, for some , a copy of all of whose edges have color . In the context of asymmetric Ramsey properties of random graphs, the following generalization of the -density was introduced in . For two graphs and , defineTo motivate this definition, set and observe that the edges of which are contained in a copy of each subgraph have density roughly .
Kohayakawa and Kreuter formulated the following conjecture and proved it in the case when all are cycles.
Let be graphs with . Then there exist constants and such that
More accurately, the above conjecture was stated in only in the case , but the above generalization is quite natural.To see why the graphs do not appear in the threshold, replace each of by the disjoint union , and note that , see . There had been little progress on Conjecture 1.11 until quite recently, when the -statement was proved by Marciniszyn, Skokan, Spöhel, and Steger in the case where all of the are cliques, and the -statement in the case was establishedIn their concluding remarks, the authors of moreover claim that their method can be extended to the setting with more than two colours, using ideas from . by Kohayakawa, Schacht, and Spöhel under very mild extra assumptions on and . It was observed in [47, Theorem 31] that, using Theorem 1.9, the approach of Kohayakawa and Kreuter , which employs the sparse regularity lemma, can be adapted to yield a proof of the -statement in Conjecture 1.11 for the following class of graphs.
Let be graphs with and such that is strictly -balanced. Then there exists a constant such that if , then a.a.s.
For the deduction of Theorem 1.12 from Theorem 1.9, see and [47, Section 4].
6. Outline of the paper
The remainder of this paper is organized as follows. In Section 2, we state and discuss our main result, Theorem 2.2, which we then prove in Section 3. In Section 4, we discuss the applications of Theorem 2.2 in the context of subsets of with no -term arithmetic progressions. In particular, we prove Theorem 1.1 and use it to derive Corollary 1.2. In Section 5, we prove two versions of the general transference theorem of Schacht [58, Theorem 3.3] (obtained independently, in a slightly different form, by Conlon and Gowers ) – a ‘random’ version suited for extremal problems in sparse random discrete structures and its ‘counting’ counterpart that generalizes Theorem 1.1. In Section 6, we prove ‘random’ and ‘counting’ versions of the general stability result of Conlon and Gowers in a form that is easily comparable with [56, Theorem 3.4]. In Section 7, we discuss several applications of Theorem 2.2 in the context of the Turán problem in sparse random graphs. In particular, using the results of Sections 5 and 6 we give new proofs of the sparse random analogues (stated above) of the classical theorems of Erdős and Stone, and Erdős and Simonovits, see Section 1.2. In Section 8, we discuss applications of Theorem 2.2 to the problem of describing the typical structure of a sparse graph without a forbidden subgraph. In particular, we prove sparse analogues of classical theorems of Erdős, Frankl, and Rödl and Erdős, Kleitman, and Rothschild, see Section 1.3. Finally, in Section 9, we use Theorem 2.2 to prove the KŁR conjecture for every graph .
The Main Theorem
In this section, we present the main result of this paper, Theorem 2.2, which gives a structural characterization of the collection of all independent sets in a large class of uniform hypergraphs. Let us stress here that all of the hypergraphs we consider are allowed to have multiple edges; moreover, we shall always count edges with multiplicities.
We start with an important definition. Recall that a family of sets is called increasing (or an upset) if it is closed under taking supersets, that is, if for every , and imply that .
Let be a uniform hypergraph with vertex set , let be an increasing family of subsets of and let . We say that is -dense if
A moment of thought reveals that for an arbitrary hypergraph and , it is extremely simple to find families for which is -dense. To this end, let
and note that is increasing and is -dense. In fact, the families for which is -dense are precisely all increasing subfamilies of .
In this work, we will be interested in upsets that admit a much more ‘constructive’ description than that of . Many such families arise naturally in the study of extremal and structural problems in combinatorics. For example, consider the -uniform hypergraph on the vertex set whose edges are all -term arithmetic progressions in and let be the collection of all subsets of with at least elements. Clearly, is an upset and it follows from the famous theorem of Szemerédi that is -dense for some positive depending only on and , see Section 4. Similarly, consider the -uniform hypergraph on the vertex set whose edges are edge sets of all copies of in the complete graph and let be the family of all -vertex graphs (subgraphs of ) with at least edges such that every -coloring of its vertices yields at least monochromatic edges. Again, is increasing and it follows from the stability theorem of Erdős and Simonovits and the triangle removal lemma of Ruzsa and Szemerédi that is -dense, provided that is sufficiently small as a function of .
Our main result roughly says the following. If is a uniform hypergraph that is -dense for some family and whose edge distribution satisfies certain natural boundedness conditions, then the collection of all independent sets in admits a partition into relatively few classes such that all independent sets in one class are essentially contained in a single set . Before we state the result, we first need to quantify the above boundedness conditions for the edge distribution of a hypergraph. Given a hypergraph , for each , we defineWe emphasize that if has multiple edges, then should be thought of as a multi-set. In other words, is the number of edges of , counted with multiplicities, which contain .
Recall that denotes the family of all independent sets in . The following theorem is our main result.
Then there exists a family and functions and such that for every ,
Roughly speaking, if satisfies certain technical conditions, then each independent set in can be labelled with a small subset in such a way that all sets labelled with some are essentially contained in a single set that contains very few edges of . We remark that the constant in the theorem has only a polynomial dependence on . Unfortunately, however, in most of our applications will have a tower-type dependence on some other parameter.
Theorem 2.2 will be proved in Section 3. We end this section with a short informal discussion of its consequences. As we have already mentioned, Theorem 2.2 combined with some classical extremal results on discrete structures has strikingly strong implications. Let us briefly explain why this is so. Many classical extremal problems ask for an estimate on the number of independent sets (of a certain size) in some auxiliary uniform hypergraph. If applicable, Theorem 2.2 implies that all such independent sets are almost contained in one of very few sets that are almost independent, that is, contain a small number of copies of some forbidden substructure. If we know a good characterization of sets that are almost independent in the above sense, which is often the case, we can easily obtain an upper bound on the number of independent sets. For example, consider the problem of counting subsets of with no -term AP and recall the definition of and from the beginning of this section. Theorem 2.2, applied to this pair, implies that every subset of with no -term AP is essentially contained in one of at most sets of size at most each, where is an arbitrarily small positive constant. This easily implies that if , then there are at most sets of size with no -term AP. For more details, we refer the reader to Section 4.
Proof of the main theorem
In this section, we shall prove Theorem 2.2. The main ingredient in the proof is the following proposition, which (roughly) says that Theorem 2.2 holds in the special case when is the family of all subsets of with at least elements. Theorem 2.2 follows by applying Proposition 3.1 a constant number of times.
Then there exist a family and functions and such that for every ,
Moreover, if for some , and , then .
The final line of Proposition 3.1 states that the labelling function exhibits a certain consistency. This property of , which may look somewhat puzzling, will be crucial in the proof of Theorem 2.2.
In order to prove Proposition 3.1, given an independent set , we shall construct a sequence of subsets of with , for some , and use it to define a sequence , where , of hypergraphs such that the following holds for each :
is an -uniform hypergraph on the vertex set ,
is an independent set in ,
\Delta_{1}(\mathcal{H}_{i})\leqslant O\big{(}e(\mathcal{H}_{i})/v(\mathcal{H}_{i})\big{)}, and
.
We shall be able to do it in such a way that in the end, there will be a set of size at most such that the remaining elements of (i.e., the set , where ) must all lie inside . If , then we will simply let be the set of non-edges of the -uniform hypergraph ; in this case, the upper bound on will follow from (c) and (d). If , then we will obtain an appropriate while trying (and failing) to construct the hypergraph using the hypergraph and the set . Crucially, this set will depend solely on , that is, if for some pair our procedure generates and , respectively, and if , then also . This will allow us to set and .
For the remainder of this section, let us fix , , , and as in the statement of Proposition 3.1. Without loss of generality, we may assume that . Let be an independent set in . We shall describe a procedure of choosing the sets and constructing the hypergraphs as above. This procedure, which we shall term the Scythe Algorithm, lies at the heart of the proof of Proposition 3.1.
The general strategy used in the Scythe Algorithm, that of selecting a small set of high-degree vertices and using it to define a set such that , dates back to the work of Kleitman and Winston , who used it to bound the number of independent sets in graphs satisfying the following local density condition: all sufficiently large vertex sets induce subgraphs with many edges. Recently, Balogh and Samotij refined the ideas of Kleitman and Winston and obtained a bound on the number of independent sets in uniform hypergraphs satisfying a similar local density condition. Even more recently, Alon, Balogh, Morris and Samotij used similar ideas to bound the number of independent sets in ‘almost linear’ -uniform hypergraphs satisfying a more general density condition termed -stability, see Definition 6.1. Here, we combine, generalize, and refine all of the above approaches and make them work in the general setting of -dense uniform hypergraphs.
At each step of the Scythe Algorithm, we shall order the vertices of a certain subhypergraph of with respect to their degrees in that subhypergraph. For the sake of brevity and clarity of the presentation, let us make the following definition.
Given a hypergraph , we define the max-degree order on as follows:
Fix an arbitrary total ordering of .
For each , let be the maximum-degree vertex in the hypergraph \mathcal{G}\big{[}V(\mathcal{G})\setminus\{u_{1},\ldots,u_{j-1}\}\big{]}; ties are broken by giving preference to vertices which come earlier in the order chosen in (1).
The max-degree order on is .
Finally, we write to denote the initial segment of the max-degree order on that ends with , i.e., for every , we let .
We remark here that the only property of the max-degree order that will be important for us is that for every , the degree of the vertex in the hypergraph is at least as large as the average degree of this hypergraph.
Let and for each , let .
The key properties that we would like the constructed hypergraph to possess are:
is -uniform and ,
is an independent set in ,
.
Set and note that (P1)–(P4) are vacuously satisfied for . The main step of the Scythe Algorithm will be a procedure that, given and satisfying (P1)–(P4), outputs a set of cardinality at most , a set with the property that , and a hypergraph satisfying (P1)–(P3). Moreover, if the constructed does not satisfy (P4), then we have . Crucially, these and depend solely on and , that is, if on two inputs and , the procedure outputs the same set , it also outputs the same and .
Given an -uniform hypergraph and an independent set , set and let be the empty hypergraph on the vertex set . For , do the following:
If I\cap V\big{(}\mathcal{A}_{i+1}^{(j)}\big{)}=\emptyset, then set , , and and STOP.
Let be the first vertex of in the max-degree order on V\big{(}\mathcal{A}_{i+1}^{(j)}\big{)}.
Let be the hypergraph on the vertex set defined by:
Let be the hypergraph on the vertex set V\big{(}\mathcal{A}_{i+1}^{(j)}\big{)}\setminus W(u_{j}) defined by:We emphasize that is defined relative to the max-degree order on .
Finally, set , A_{i}=V\big{(}\mathcal{A}_{i+1}^{(b)}\big{)}, and .
We shall now establish various properties of the Scythe Algorithm. We begin by making some basic (but key) observations.
The following hold for every :
is -uniform and .
If , then .
.
The hypergraph and the set depend only on and the set .
Property (a) is trivial. To see (b), simply observe that each edge of is of the form for some and . Thus, if contains an edge of , it must also contain an edge of . To see (c), observe that for each , is the first vertex of in the max-degree order on V\big{(}\mathcal{A}_{i+1}^{(j)}\big{)} and hence . It follows that and that . Note in particular that if , then I\cap V\big{(}\mathcal{A}_{i+1}^{(j)}\big{)}=\emptyset for some , which implies that . Finally, to prove (d), observe that all steps of the Scythe Algorithm are deterministic and that every element of that we need to observe in order to define and is placed in . More precisely, note that while choosing the vertex , we only need to know the first vertex of in the max-degree order on V\big{(}\mathcal{A}_{i+1}^{(j)}\big{)}; the remaining vertices remain unobserved. Since we have , this information can be recovered from . Thus, at each step, the hypergraph can be recovered from and , and the hypergraph can be recovered from , and . Hence, a trivial inductive argument proves that, if the algorithm does not stop in step (1), for each , the hypergraphs and are determined by and the set , as required. Finally, the algorithm stops in step (1) if and only if . If this happens, then and are empty. ∎
We next show that the Scythe Algorithm exhibits a certain ‘consistency’ while generating its output. This property will be important in the proof of Proposition 3.1.
Suppose that on inputs and , the Scythe Algorithm outputs and , respectively. If and , then .
By Lemma 3.5, it suffices to show that . Let us first consider the (degenerate) case when . Without loss of generality, we may assume that . This means that, while running on , the Scythe Algorithm stopped in step (1). By Lemma 3.5, it follows that and hence , which means that and therefore . Hence, , as claimed. On the other hand, if and , then there must exist some such that . Let be the smallest such index. Note that by the minimality of , we have \mathcal{A}_{i+1}^{(j)}=\big{(}\mathcal{A}_{i+1}^{(j)}\big{)}^{\prime}=\mathcal{A}. Since , one of these vertices comes earlier in the max-degree order on ; without loss of generality, we may suppose that it is . Since , it follows that and hence the Algorithm, while running on the input , would not pick in step , a contradiction. This shows that in fact , as required. ∎
where the last inequality follows from (7). ∎
Next, let us establish an easy bound on the numbers .
for every .
Finally, we show that if satisfies (P3) and (P4), then either also satisfies (P4) or we have . Recall that .
or .
If the Scythe Algorithm stops in step (1), then and there is nothing to prove. Hence, we may assume that steps (2)–(4) are executed times. Note that, for each , we have
Hence, if (i+1)e\big{(}\mathcal{A}_{i+1}^{(j+1)}\big{)}\geqslant e\big{(}\mathcal{H}_{i+1}\big{)} for every , then
since , as required. Thus, we may assume that for some ,
Recall that and observe that for every ,
Since we assumed that e(\mathcal{A}_{i+1}^{(b)})<e\big{(}\mathcal{H}_{i+1}\big{)}/(i+1), see (11), and , it follows that if
Case 2: .
We claim that in this case, . Indeed, we have
Recall that by Lemma 3.8. Thus,
since and . ∎
2. The proof of Proposition 3.1 and Theorem 2.2
Let be an integer and let be a positive constant. Furthermore, let and let be a -uniform hypergraph that satisfy the assumptions of Proposition 3.1. Let and . We will use the Scythe Algorithm, described in Section 3.1, to construct a family and functions and as in the statement of Proposition 3.1. We obtain them by running the following algorithm (with ) on every independent set . We shall define somewhat implicitly by defining a function that is constant on the set for every .
Given an , set and repeat the following:
Apply the Scythe Algorithm to and . Suppose that it outputs , and .
If , then set , and STOP.
If , then set . Otherwise, set and STOP.
Now, let us define and . Suppose first that and note that in this case, the algorithm stopped in step (2), which means that ; we set
We will define by letting for some . We first show that this definition will not depend on the choice of . In fact, we shall prove a slightly stronger statement, which also establishes the consistency property of stated in the final line of Proposition 3.1.
Suppose that for some , and . Then and .
Suppose that while running the algorithm on some , we obtain a sequence . Since depends solely on and, by Lemma 3.5, for each , the hypergraph and the set depend only on , then also depends solely on . Hence, it suffices to show that if, while running the algorithm on some with , we obtain a sequence with , then . To this end, let us first observe that, under the above assumptions, for every , if , then . Indeed, note that and are the outputs of the Scythe Algorithm executed on the inputs and , respectively. Hence, if , then since
then Lemma 3.6 implies that . Since clearly and, as noted before, for each , depends only on , it follows that for all , as required. ∎
By the above claim, we can define by letting, for every , for any . Finally, let us show that the , , and , which we have just defined, satisfy the required conditions, that is, for all ,
for every ,
,
,
and imply that .
To see (i), simply recall that for every . To see (ii), note that for every , by Lemma 3.5, that is an independent set in (if ) and, crucially, that . To see (iii), note that if , then , see step (2) of the algorithm; if , then since , by Lemma 3.8 and property (P3), we have
since and satisfies property (P4), so . Finally, (iv) follows directly from the claim. ∎
The theorem follows by applying Proposition 3.1 a bounded number of times. Given an integer and positive reals and , let and let
Let be a finite set and let be an increasing family of subsets of such that for every . Let and suppose that is a -uniform hypergraph on the vertex set that is -dense and satisfies the assumptions of the theorem, that is,
for every . Similarly as in the proof of Proposition 3.1, we shall define via a function that is constant on each set with .
Fix some . Using Proposition 3.1, we shall construct (for some ) a sequence of pairs of subsets of such that for each ,
Moreover, while . Crucially, the set will depend solely on . We will let and .
Let and let . For , do the following:
If , then let and apply Proposition 3.1 with and to the hypergraph and the set to obtain sets and such that and . Otherwise, if , then STOP.
Let and let .
Let us first show that the above procedure is well-defined, that is, that the assumptions of Proposition 3.1 are satisfied each time we are in (1). To this end, fix some and note that if , then, since is -dense,
where the last step follows since and .
Next, let us show that the above procedure terminates, therefore producing a finite sequence with . To this end, let us simply note that by Proposition 3.1, for all , and for every . Moreover, since , then
and hence . It immediately follows that
Finally, let . It remains to show that for every , is constant on . Similarly as in the proof of Proposition 3.1, we shall prove a somewhat stronger statement.
Suppose that for some , and . Then and .
Suppose that while running the above procedure on some , we generate a sequence . Since for each , depends solely on and , where , then both and depend solely on . Hence, it suffices to show that if, while running the above procedure on some with , we generate a sequence with , then . To this end, it suffices to note that if , then, since
by the consistency property of stated in the final line of Proposition 3.1, . Since and for each , depends only on , it follows that for all , as required. ∎
Finally, for every , we let for some . This completes the proof of Theorem 2.2. ∎
Szemerédi’s theorem for sparse sets
In this section, we prove Theorem 1.1 and derive from it Corollary 1.2. Before we get to the proofs, let us first remark that Theorem 1.1 and Corollary 1.2 are both sharp up to the value of the constant in the lower bounds for and . More precisely, let us make the following two observations.
For every , there is a positive such that if , then the number of -subsets of that contain no -term AP is at least . To see this, let and observe that if is sufficiently small and , then the expected number of -term APs in a random -subset of is smaller than and hence by Markov’s inequality, at least half of all -subsets of contain a subset of size with no -term AP. HenceWe assume here, without loss of generality, that (and hence also ) is sufficiently small.
where the final inequality holds since \binom{n}{(1+\varepsilon)m}\geqslant\big{(}\frac{n}{2m}\big{)}^{\varepsilon m}\binom{n}{m} and \binom{n}{\varepsilon m}\leqslant\big{(}\frac{en}{\varepsilon m}\big{)}^{\varepsilon m}.
There is a positive constant such that if , then
For a (simple) proof of this statement, we refer the reader to .
We shall in fact prove the following somewhat stronger version of Corollary 1.2, originally proved by Schacht (the approach of Conlon and Gowers yields a somewhat weaker probability estimate).
In the proofs of Theorem 1.1 and Corollary 4.1, and frequently in later sections, we shall need various estimates on binomial coefficients, which we list here for future reference. Let , , and be integers satisfying . Then the following inequalities hold:
We remark that each inequality above follows easily from the definition of .
Let denote the event that is not -Szemerédi, i.e., that contains a subset with elements and no -term AP. By (19) and Chernoff’s inequality (see, e.g., [3, Appendix A]), it follows that
Finally, let us show how to deduce Theorem 1.1 from Theorem 2.2. Our proof will use the following robust version of Szemerédi’s theorem, which can be proved by a simple averaging argument, originally observed by Varnavides .
For every positive and , there exists a positive such that the following holds for all sufficiently large . Every subset of with at least elements contains at least -term APs.
and .
Let , let , and assume that . Note that if , then by Szemerédi’s theorem, so we may assume that . Since , then by Theorem 2.2, there exists a family and functions and , such that for every ,
Therefore, using (15) and (17), the number of independent sets of size in can be estimated as follows:
Since and the function is increasing on , it follows that
where the final inequality follows since , by (16), and since if . This proves Theorem 1.1. ∎
Finally, using the famous polynomial Szemerédi theorem of Bergelson and Leibman , the same argument gives a counting version of [14, Theorem 10.7].
-subsets of that contain no set of the form .
Extremal results for sparse sets
In this section, we shall deduce from Theorem 2.2 two versions of the general transference theorem of Schacht [58, Theorem 3.3]. We remind the reader that a statement very similar to Schacht’s theorem was proved independently by Conlon and Gowers . For the benefit of the readers who are familiar with , we shall state it using the terminology used there.
Let us remark here that Definition 2.1 is a generalization of Definition 5.1. Indeed, if denotes the collection of all subsets of with at least elements, then a sequence of hypergraphs is -dense if and only if for every positive , there exists a positive such that for all sufficiently large , the hypergraph is -dense.
We start with the ‘random’ version of our extremal result, which was originally proved by Schacht [58, Theorem 3.3].
If is -dense, then the following holds. For every positive , there exists a constant such that if and as , then a.a.s.
We note that the probability bounds implicit in the ‘asymptotically almost surely’ statement that we obtain are, as in , optimal, that is, they decay exponentially in .
Our methods also yield the following ‘counting’ analogue of Theorem 5.2. This generalizes Theorem 1.1, and does not follow from the methods of or . In the case , it can be thought of as a strengthening of Theorem 5.2, see Corollary 1.2.
If is -dense, then the following holds. For every positive , there exists a constant such that for all sufficiently large , if , then
for every . Let and assume that . Let and, for the sake of brevity, let us write and . Observe that
Fix an and let . We estimate the summand in the right-hand side of (21) as follows:
To see the above inequality, simply note that for every , we have .
Now, since and , then
and hence . On the other hand, since by the definition of , then
Finally, note that since for every , and using (15),
Putting (21), (22), (23), and (24) together, we obtain
for every . Let and assume that . Fix an , let , and note for future reference that
Since , we have . Therefore,
To see the above inequality, simply note that for every , we have .
Now, if , then every -subset of belongs to and hence there is no independent set of size . We may therefore assume that . Setting , we obtain
since , by (25), and provided that is sufficiently small. It follows that
Stability results for sparse sets
In this section, we shall deduce from Theorem 2.2 two versions of the general transference theorem for stability results proved by Conlon and Gowers . Similarly as in Section 5, we shall state our results using the terminology used by Schacht . We remark here that in parallel to this work, Schacht’s method was adapted to yield sparse random analogues of stability statements by Samotij . The main result of this section is most easily compared with [56, Theorem 3.4]. We begin by recalling the following definition from .
Let be a sequence of -uniform hypergraphs, let be a positive real, and let be a sequence of sets with . We say that is -stable if for every positive , there exist positive and such that the following holds. For every with and every with , we have either or for some .
Roughly speaking, a sequence of hypergraphs is -stable if for every that is almost as large as , the set is either very ‘close’ to some extremal set or it contains ‘many’ (a positive fraction of all) edges of . Note that in many natural settings, such a property does hold, for example, as a consequence of the Erdős-Simonovits stability theorem and the removal lemma for graphs.
We again start with the ‘random’ version of our stability result, which was originally proved in .
and let be a sequence of sets with .
If is -stable, then the following holds. For every positive , there exist and such that if and as , then a.a.s. every independent set with satisfies for some .
The following theorem, a ‘counting’ analogue of Theorem 6.2, is our main stability result. A simple version of it, applicable to -uniform hypergraphs with , was proved in and used in to count sum-free subsets in Abelian groups and in the set .
and let be a sequence of sets with .
If is -stable, then the following holds. For every positive , there exist and such that if , then there are at most
independent sets such that for every .
Since is -stable, it follows that is -dense, provided that is sufficiently small. Let . By Theorem 2.2, there exist a family and functions and such that
for every . Let and assume that . Let and, for the sake of brevity, let us write and . Let
Fix an , let , and note for future reference that
In order to prove (29), recall that since , we either have or for some . We therefore consider two cases.
Case 1: .
We bound the left-hand side of (29) as follows:
In order to justify the above inequality, note that for every , we have . Recall that . Since , by (28), and
Combining (30) and (31), we obtain (29), as required.
Case 2: for some .
We estimate the left-hand side of (29) as follows:
This follows from the definition of and the fact that for every . Since , we have
whereas by (28) and since . By Chernoff’s inequality, it follows that
since was chosen sufficiently small. Thus (29) follows in this case as well.
Finally, note that, since for every , as in (24), we have
Putting (27), (29), and (32) together, we obtain
Since is -stable, it follows that is -dense, provided that is sufficiently small (as a function of ). Let . By Theorem 2.2, there exist a family and functions and such that
for every . Let , assume that , and set
Our task is to bound the size of from above. To this end, fix an and let . Note for future reference that
Since , we either have or for some . We therefore consider two cases.
Case 1: .
To prove (34), we first estimate the size of as follows:
The above inequality follows since for every .
It follows, using (16) and (17), as in (26), that
Now, if , then and hence , since is -dense. We may therefore assume that . We obtain
since and , as claimed.
Case 2: for some .
To prove (35), we first estimate the size of as follows:
To see the first inequality, recall that every contains at least elements of for every . Recall that and note that therefore, if , then and hence . Thus, we may assume that . It follows, using (17) and (18), that
Hence, by (33), (36), and (37), using (15), we have
as claimed, since and and were chosen to be sufficiently small. Indeed, note that (for this calculation, and assuming that is sufficiently small) and suffice.
Turán’s problem in random graphs
In this section, we shall deduce from Theorems 5.2 and 6.2 the sparse random analogues of the classical theorems of Erdős and Stone and Turán and of Erdős and Simonovits , Theorems 1.3 and 1.5. In fact, we will prove a natural generalization of Theorem 1.3 to -uniform hypergraphs, Theorem 7.2 below, which was already proved by Conlon and Gowers and Schacht . We first recall the following generalization of the notion of -density of a graph to -uniform hypergraphs.
Let be a -uniform hypergraph with at least vertices. We define the -density of , denoted by , by
We also recall that the Turán density of a -uniform hypergraph , denoted , is defined by
where, as usual, \operatorname{ex}\big{(}K_{n}^{t},H\big{)} is the Turán number for , that is, the maximum number of edges in an -free -uniform hypergraph with vertices.
For every -uniform hypergraph with and every positive , there exists a positive constant such that if , then
Once again, we emphasize that we actually obtain essentially optimal bounds on the probability in the above statement, i.e., bounds of the form for some positive constant that depends only on and .
Theorems 7.2 and 1.5, and hence also Theorem 1.3, will follow easily from our general transference results, Theorems 5.2 and 6.2, the classical supersaturation results of Erdős and Simonovits (for Theorem 7.2), and the stability theorem of Erdős and Simonovits together with the so-called graph removal lemma (for Theorem 1.5). We only need to check that the hypergraph of copies of in the complete hypergraph , to which we would like to apply our transference theorems, satisfies the assumptions of Theorems 5.2 and 6.2. Since we are going to use this fact several times in this and later sections, we state it as a separate proposition.
Let be an arbitrary -uniform hypergraph. The hypergraph of copies of in is the -uniform hypergraph on the vertex set whose edges are the edge sets of all copies of in .
Let and be integers with and let be a -uniform hypergraph. Set and let be the -uniform hypergraph of copies of in . There exists a positive constant such that, letting ,
Note that and that e(\mathcal{H})=\frac{(v(H))!}{|\operatorname{Aut}(H)|}\cdot\binom{n}{v(H)}=\Theta\big{(}n^{v(H)}\big{)}. By the definition of and , we have
for some positive constant . Since for some constant , it follows that
where the last inequality follows by (40). ∎
In the proof of Theorems 1.5 and 1.7, we shall need the following proposition, which is a fairly straightforward consequence of the Erdős-Simonovits stability theorem and the graph removal lemma . A proof of this statement can be found in . We remark that a new proof of the graph removal lemma, which avoids the use of the Szemerédi regularity lemma, was given recently by Fox .
then either may be made -partite by removing from it at most edges or contains at least copies of .
The typical structure of H𝐻H-free graphs
In this section, we shall deduce from Theorems 5.4 and 6.3 the sparse analogue of the theorem of Erdős, Frankl, and Rödl , Theorem 1.6, and an approximate sparse analogue of the result of Erdős, Kleitman, and Rothschild , Theorem 1.7. We stress once again that neither proof employs Szemerédi’s regularity lemma. In order to prove Theorem 1.6, we are actually going to prove the following natural generalization of it to -uniform hypergraphs. Generalizing the definition stated in Section 1.3, given integers and with and a -uniform hypergraph , let us denote by the number of -free -uniform hypergraphs on the vertex set that have exactly edges.
We remark that Theorem 8.1 refines a result of Nagle, Rödl, and Schacht , who, using the hypergraph regularity lemma, generalized (4) to -uniform hypergraphs.
as required. The claimed lower bound on is trivial. ∎
and hence f_{n,m}^{\delta}(H)=o\big{(}f_{n,m}(H)\big{)}, as claimed. ∎
For -uniform hypergraphs, there is no general stability theorem known; however, such results have been proved for a few specific hypergraphs (see ), and in each case we obtain a corresponding result for sparse hypergraphs. For example, following , let denote the ‘3-uniform triangle’, i.e., the hypergraph with edge set isomorphic to , and say that a 3-uniform hypergraph is triangle-free if it contains no copy of . The following theorem follows easily, as above, from Theorem 6.3 combined with the hypergraph removal lemma of Gowers and Rödl and Skokan and the stability theorem for 3-uniform triangle-free hypergraphs, which was proved by Keevash and Mubayi .
For every positive , there exists a constant such that the following holds. If , then almost every triangle-free -uniform hypergraph with vertices and edges can be made tripartite by removing from it at most edges.
It follows by Proposition 7.3 that satisfies the conditions of Theorem 6.3 with . Hence the number of triangle-free -uniform hypergraphs with vertices and edges that cannot be made tripartite by removing at most edges is at most
Finally, we remark that Theorem 8.2 can be seen as an approximate sparse analogue of a result of Balogh and Mubayi , who used the hypergraph regularity lemma and [36, Theorem 1.6] to show that almost all triangle-free 3-uniform hypergraphs are tripartite. For similar results for other forbidden hypergraphs, see and .
The KŁR Conjecture
In this section, we shall deduce from Theorem 2.2 the KŁR conjecture, Theorem 1.9. As in the preceding sections, the proof will be a fairly straightforward application of Theorem 2.2 to an appropriately defined hypergraph and family . Let be an arbitrary graph and let be the -uniform hypergraph of canonical copies of in the complete blow-up of . Defining an appropriate family and showing that is -dense will require some work.
Given a graph and integers , let us denote by the collection of all graphs constructed in the following way. The vertex set of is a disjoint union of sets of sizes , respectively, one for each vertex of . The only edges of lie between those pairs of sets such that is an edge of . Recall the definition of from Section 1.4 and observe that for all , , and .
The following lemma, which is a robust version of the embedding lemma, stated in Section 1.4, suggests the right choice of . The lemma is well-known, and so we omit the (standard) proof.
Let be a graph and let be an arbitrary function. There exist positive constants , , and such that for every collection of integers satisfying and every graph , one of the following holds:
contains at least canonical copies of .
There exist a positive constant with , an edge , and sets , such that , , and .
Our next lemma is also straightforward. It allows us to count -regular subgraphs of a graph that has a ‘hole’, as in Lemma 9.1(b). Recall that denotes the collection of all -regular bipartite graphs with edges and vertices in each part. Given such , let and denote the two parts. For each , define a function by setting
Note that the right-hand side of (42) is zero if , so we may assume that . Thus, using (15) and (17), (42) implies that
as required, since \big{(}4e\delta(\alpha)\big{)}^{\alpha^{2}/2}=\beta/2. ∎
We can now easily deduce Theorem 1.9 from Theorem 2.2.
Fix an arbitrary positive constant , let be the function defined in (41) with replaced by , i.e., set
for each , and let , , and . Let be the family of all subgraphs of , i.e., graphs in , for which (b) in Lemma 9.1 is not satisfied. Clearly is an upset, and so, by Lemma 9.1, is -dense provided that .
Now, since is contained in the hypergraph of all copies of in the complete graph on vertices and contains a positive proportion of those copies, it follows from Proposition 7.3 that satisfies the assumptions of Theorem 2.2 with and , for some constant depending only on . Therefore, there is a constant , a family , and functions and such that
for every .
Let be a sufficiently small positive constant such that, in particular, , let , and suppose that . Let and note that . We are required to bound from above the number of graphs in .
To this end, fix an , let
and let . For each , let and note that . Since
then for every .
Now, since , it follows that there exist an , an edge , and sets , such that and . By Lemma 9.2, it follows that there are at most
choices for the edges between and such that and . It follows immediately that
Summing over sets , and using (15) and (17), we obtain
Now, since was chosen to be sufficiently small, it follows that the summand above is increasing in on and hence
Acknowledgement. The third author would like to thank Noga Alon and David Conlon for stimulating discussions. The authors would also like to thank David Conlon and Yoshiharu Kohayakawa for helpful comments on the manuscript, and David Saxton for pointing out the usefulness of allowing multiple edges. Finally, we would like to thank the anonymous referee for a very careful reading of the proof, and a plenitude of helpful suggestions.