Stein's method and normal approximation of Poisson functionals
Giovanni Peccati, Josep Lluís Solé, Murad S. Taqqu, Frederic Utzet
Introduction
In a recent series of papers, Nourdin and Peccati , and Nourdin, Peccati and Réveillac , have shown that one can effectively combine Malliavin calculus on a Gaussian space (see e.g. ) and Stein’s method (see e.g. ) in order to obtain explicit bounds for the normal and non-normal approximation of smooth functionals of Gaussian fields.
The aim of the present paper is to extend the analysis initiated in to the framework of the normal approximation (in the Wasserstein distance) of regular functionals of Poisson measures defined on abstract Borel spaces. As in the Gaussian case, the main ingredients of our analysis are the following:
A set of Stein differential equations, relating the normal approximation in the Wasserstein distance to first order differential operators.
A (Hilbert space-valued) derivative operator , acting on real-valued square-integrable random variables.
An integration by parts formula, involving the adjoint operator of .
A “pathwise representation” of which, in the Poisson case, involves standard difference operators.
As a by-product of our analysis, we obtain substantial generalizations of the Central Limit Theorems (CLTs) for functionals of Poisson measures (for instance, for sequences of single and double Wiener-Itô integrals) recently proved in (see also for applications of these results to Bayesian non-parametric statistics). In particular, one of the main results of the present paper (see Theorem 5.1 below) is a CLT for sequences of multiple Wiener-Itô integrals of arbitrary (fixed) order with respect to a general Poisson measure. Our conditions are expressed in terms of contraction operators, and can be seen as a Poisson counterpart to the CLTs on Wiener space proved by Nualart and Peccati and Nualart and Ortiz-Latorre . The reader is referred to Decreusefond and Savy for other applications of Stein-type techniques and Malliavin operators to the assessment of Rubinstein distances on configuration spaces.
The remainder of the paper is organized as follows. In Section 2, we discuss some preliminaries, involving multiplication formulae, Malliavin operators, limit theorems and Stein’s method. In Section 3, we derive a general inequality concerning the Gaussian approximation of regular functionals of Poisson measures. Section 4 is devoted to upper bounds for the Wasserstein distance, and Section 5 to CLTs for multiple Wiener-Itô integrals of arbitrary order. Section 6 deals with sums of a single and a double integral. In Section 7, we apply our results to non-linear functionals of Ornstein-Uhlenbeck L vy processes.
Preliminaries
where is a Poisson random variable with parameter . Note that properties (i)-(ii) imply, in particular, that is an independently scattered (or completely random) measure (see e.g. ).
where denotes the Dirac mass at , and is the compensated canonical mapping given by
For every deterministic function we write to indicate the Wiener-Itô integral of with respect to (see e.g. or ). We recall that, for every , the random variable has an infinitely divisible law, with Lévy-Khinchine exponent (see again ) given by
Fix We denote by the space of real valued functions on that are square-integrable with respect to , and we write to indicate the subspace of composed of symmetric functions. For every , we denote by the multiple Wiener-Itô integral of order , of with respect to . Observe that, for every , and , one has the isometric formula (see e.g. ):
where the series converges in and, for each , the kernel is an element of .
2 Contractions, stars and products
We now recall a useful version of the multiplication formula for multiple Poisson integrals. To this end, we define, for , , , and , the (contraction) kernel on , which reduces the number of variables in the product from to as follows: variables are identified and, among these, are integrated out. This contraction kernel is formally defined as follows:
so that . For example, if ,
The quite suggestive ‘star-type’ notation is standard, and has been first used by Kabanov in (but see also Surgailis ). Plainly, for some choice of the contraction may not exist, in the sense that its definition involves integrals that are not well-defined. On the positive side, the contractions of the following three types are well-defined (although possibly infinite) for every and every kernel :
, where , as obtained from (2.9), by setting ;
, for every ;
In particular, a contraction of the type , where may equal at some point . The following (elementary) statement ensures that any kernel of the type is square-integrable.
Let , and let and . Fix . Then, .
Proof. Just use equation (2.2) in the case , and deduce the conclusion by a standard use of the Cauchy-Schwarz inequality.
We also record the following identity (which is easily verified by a standard Fubini argument), valid for every , every :
for every . The forthcoming product formula for two Poisson multiple integrals is proved e.g. in and .
Let and , , and suppose moreover that for every and such that . Then,
where the tilde “ ” stands for symmetrization, that is,
where runs over all permutations of the set .
where: (i) is a standard Brownian motion, (ii)
(with convergence in ), that is, is a centered independently scattered random measure such that
3 Four Malliavin-type operators
In what follows, given () and , we write to indicate the function on given by .
If verifies (2.16) (that is, if ), then the random function is given by
For instance, if , then is the non-random function . If , then is the random function
A version of the following result, whose content is one of the staples of our analysis, is proved e.g. in [19, Theorem 6.2] (see also [28, Proposition 5.1]). One should also note that the proof given in applies to the framework of a Radon control measure : however, the arguments extend immediately to the case of a Borel control measure considered in the present paper, and we do not reproduce them here (see, however, the remarks below). It relates to and provides a representation of as a difference operator.
In the Itô-type framework detailed in Remark 2.6, we could alternatively use the definition of the Malliavin derivative introduced in , that is,
When applied to the case , formula (2.20) is just a consequence of the straightforward relation
To have an intuition of the proof of (2.20) in the general case, consider for instance a random variable of the type , where the sets are disjoint. Then, one has that , where . Using (2.18), we have that
Now fix . There are three possible cases: (i) and , (ii) , and (iii) . If is as in (i), then . If is as in (ii) (resp. as in (iii)), then
As a consequence, one deduces that , so that relation (2.20) is obtained from (2.21).
Observe also that Lemma 2.7 yields that, if are such that , then
(see [19, Lemma 6.1] for a detailed proof of this fact).
If , then the random variable is defined as
For every and every , one has that
If , then the random variable is given by
For every , one has that and . Moreover,
Proof. The first part of the statement is easily proved by applying the definitions of and given above. In view of Proposition 2.3, it is now enough to prove (2.28) for a random variable of the type , . In this case, one has immediately that , so that .
4 Normal approximation in the Wasserstein distance, via Stein’s method
Let be a random variable. Then, if, and only if,
If is absolutely continuous with bounded derivative, then (2.31) has a solution which is twice differentiable and such that and .
Let denote the class of twice differentiable functions, whose first derivative is bounded by 1 and whose second derivative is bounded by 2. If and thus , then the solution , appearing in Lemma 2.11(ii), satisfies and , and hence .
A general inequality involving Poisson functionals
The following estimate, involving the normal approximation of smooth functionals of , will be crucial for the rest of the paper. We use the notation introduced in the previous section.
Moreover, if has the form , where and , then
By the fact that and by Cauchy-Schwarz,
On the other hand, one sees immediately that
Relations (3.3) and (3.4) are immediate consequences of the definition of given in (2.29). The proof is complete.
Note that, in general, the bounds in formulae (3.1)–(3.2) can be infinite. In the forthcoming Sections 4–7, we will exhibit several examples of random variables in such that the bounds in the statement of Theorem 3.1 are finite.
Let be an isonormal Gaussian process (see ) over some separable Hilbert space , and suppose that is centered and differentiable in the sense of Malliavin. Then, the Malliavin derivative of , noted , is a -valued random element, and in it is proved that one has the following upper bound on the Wasserstein distance between the law of and the law of :
where is the inverse of the Ornstein-Uhlenbeck generator associated with .
Now fix . It is clear that the random variable is an element of . One has that ; moreover . Thanks to these relations, one deduces immediately from Theorem 3.1 the following refinement of Part A of Theorem 3 in .
Let and let . Then, the following bound holds:
As a consequence, if and if a sequence verifies, as ,
and the inequality (3.6) provides an explicit upper bound in the Wasserstein distance.
In the following section, we will use Theorem 3.1 in order to prove general bounds for the normal approximation of multiple integrals of arbitrary order. As a preparation, we now present two simple applications of Corollary 3.4.
which is consistent with the usual Berry-Ess en estimates.
Fix . We consider the Ornstein-Uhlenbeck Lévy process given by
We shall show that Corollary 3.4 implies the existence of a finite constant , depending uniquely on , such that, for every
To see this, first use a Fubini theorem in order to represent as an integral with respect to , that is, write
Clearly, and . By using the computations contained in [23, Proof of Theorem 4], one sees immediately that there exists a constant , depending uniquely on and such that
Since one has also that , the estimate (3.10) is immediately deduced from Corollary 3.4.
Bounds on the Wasserstein distance for multiple integrals of arbitrary order
In this section we establish general upper bounds for multiple Wiener-It integrals of arbitrary order , with respect to the compensated Poisson measure . Our techniques hinge on the forthcoming Theorem 4.2, which uses the product formula (2.14) and the inequality (3.2).
Fix and let . The operator transforms the function , of variables, into a function of variables, where can be as large as . When , we set
where the ‘star’ contractions have been defined in formulae (2.2) and (2.9), and the tilde “ ” indicates a symmetrization. The notation (4.1) is mainly introduced in order to give a more compact representation of the RHS of (2.14) when . Indeed, suppose that (), and that for every and such that ; then, by using (2.14) and (4.1), one deduces that
where . Note that the advantage of (4.2) (over (2.14)) is that the square is now represented as an orthogonal sum of multiple integrals. As before, given () and , we write to indicate the function on given by . To simplify the presentation of the forthcoming results, we now introduce a further assumption.
Assumption A. For the rest of the paper, whenever considering a kernel , we will implicitly assume that every contraction of the type
is well-defined and finite for every , every and every .
Assumption A ensures, in particular, that the following relations are true for every , every and every :
(note that the symmetrization on the LHS of the second equality does not involve the variable ).
The notation () stands for the action of the operator (defined according to (4.1)) on , that is,
For instance, if , then
Note also that, for a fixed , the quantity is given by the following constant
Finally, for every and every , we set
where in (4.7) we have used the change of variables and , as well as the fact that . We stress that the symmetrization in (4.6) does not involve the variable .
2 Bounds on the Wasserstein distance
When and , we shall focus on kernels verifying the following technical condition: for every ,
As will become clear from the subsequent discussion, the requirement (4.8) is used to justify a Fubini argument.
When , one deduces from (4.3) that and . It follows that, in this case, condition (4.8) is verified if, and only if, the following relation holds:
Indeed, since is square-integrable, the additional relation
From relation (4.3), one deduces immediately that (4.8) is implied by the following (stronger) condition: for every and every such that
condition (4.8) is automatically satisfied (to see this, just apply the Cauchy-Schwarz inequality).
Arguing as in the previous point, a sufficient condition for (4.8) to be satisfied, is that the support of the symmetric function is contained in a set of the type where is such that .
Fix and let . Let be such that:
whenever , condition (4.8) is satisfied for every ;
for -almost every , every and every , the kernel is an element of .
Denote by the multiple Wiener-It integral, of order , of with respect to . Then, the following bound holds:
where the notations and are defined, respectively, in (4.5)–(4.7) and (4.3). Moreover, the bound appearing on the RHS of (4.12)–(4.13) can be assessed by means of the following estimate:
There are contraction norms in (4.18) that do not appear in the previous formula (4.15), and vice versa. For example, in (4.18) one has , where (this corresponds to the case and ). By using formula (2.13), these norms can be computed as follows:
We stress that , and therefore if, and only if, .
One should compare Theorem 4.2 with Proposition 3.2 in , which provides upper bounds for the normal approximation of multiple integrals with respect to an isonormal Gaussian process. The bounds in are also expressed in terms of contractions of the underlying kernel.
To obtain (4.21), observe first that, since assumption (a) above is in order, then relations (4.12)–(4.13) in the statement of Theorem 4.2 yield that
since . A general statement, involving random variables of the type is given in Theorem 6.1.
Proof of Theorem 4.2. First observe that, according to Theorem 3.1, we have that
The rest of the proof is divided in four steps:
Proof of the estimate displayed in formulae (4.14)–(4.15).
Proof of the estimate in formulae (4.17)–(4.18), under the assumption (4.16).
Step (S1). Start by defining as the collection of those such that Assumption (ii) in the statement is violated, that is,
By assumption, one has that . By writing
For every , every and every , one has that .
Now use (2.17) to write , . By virtue of the multiplication formula (2.14), in particular (4.2), and by adopting the notation (4.1), we infer that, for every
Since (4.8) is in order, one has that, for every ,
where we have used the Cauchy-Schwarz inequality, combined with the isometric properties of multiple integrals, as well as the fact that, for every ,
Relations (4.23)–(4.24) yield that one can write
Since assumption (4.8) is in order, one has that, for every ,
and one can easily verify that, for , the random variables
The proof of (4.27) can be achieved by using the following relations:
Note that the use of the Fubini theorem in the equality (4.28) is justified by the chain of inequalities (4.26), which is in turn a consequence of assumption (4.8).
Now use the Cauchy-Schwarz inequality, in order to write
By using (4.4) and (4.23), one deduces immediately that
Step (S3). By using several times the inequality () one sees that, in order to prove (4.14)–(4.15), it is sufficient to show that
To see this, use (4.7) and the fact that (by (2.6)) , to obtain that
Step (S4). By using (4.3) and some standard estimates, we deduce that
We claim that, if (4.16) is satisfied, then, for every and
relation (4.34) can be deduced by a standard use of the Fubini theorem (assumption (4.16) is not needed here). Now fix , as well as and in such a way that . For every fixed , write to indicate the contraction of indices obtained from the positive kernel . Note that, for fixed, such a contraction is a function on , and also, in general, and . By a standard use of the Cauchy-Schwarz inequality and of the Fubini theorem, one sees that
where the last relation is a consequence of assumption (4.16) as well as of the fact that, by construction, . Relation (4.35) implies that one can apply the Fubini Theorem to the quantity
(by first writing the contractions in an explicit form), so to obtain the desired equality (4.34). By plugging (4.34) into (4.32) and by applying the change of variables and , one deduces (4.17)–(4.18). This concludes the proof of Theorem 4.2.
Central limit theorems
We consider here CLTs. The results of this section generalize the main findings of . The following result uses Theorem 4.2 in order to establish a general CLT for multiple integrals of arbitrary order.
For every , the kernel verifies (4.8) for every .
For every , and every , one has that and also (as ).
For every , one has that and, as , .
Then, , as , and formulae (4.14)–(4.20) provide explicit bounds in the Wasserstein distance .
This last fact coincides with the content of Part 1 of Theorem 2 in , where one can find an alternate proof based on a decoupling technique, known as the “principle of conditioning” (see e.g. Xue ). Note that an explicit upper bound for the Wasserstein distance can be deduced from relation (4.21).
Consider a sequence of random variables of the type , , with unitary variance and verifying Assumption (I) in the statement of Theorem 5.1. Then, according to the conclusion of Theorem 5.1, a sufficient condition in order to have that, as ,
is that the following six quantities converge to zero:
Moreover, an explicit upper bound in the Wasserstein distance is given by the estimate (4.5).
The following result, proved in [23, Theorem 2], represents a counterpart to the CLTs for double integrals discussed in Example 5.2.
Consider a sequence , , of double integrals verifying assumptions (a), (b) and (c) of Example 5.2. Suppose moreover that (5.2) takes place. Then,
if the sequence is uniformly integrable, then conditions (5.1), (5.3) and (5.4) are equivalent.
For the time being, it seems quite hard to prove a result analogous to Proposition 5.4 for a sequence of multiple integrals of order .
Sum of a single and a double integral
As we will see in the forthcoming Section 7, when dealing with quadratic functionals of stochastic processes built from completely random measures, one needs explicit bounds for random variables of the type , that is, random variables that are the sum of a single and a double integral. The following result, that can be seen as a generalization of Part B of Theorem 3 in , provides explicit bounds for random variables of this type.
The function belongs to ;
The kernel is such that: (a) , (b) relation (4.9) is verified, with replacing , and (c) .
Then, one has the following upper bound on the Wasserstein distance between the law of and the law of :
Proof. Thanks to Theorem 3.1, we know that is less or equal to the RHS of (3.2). We also know that
By using the multiplication formula (2.14) (in the case ) as well as a Fubini argument, one easily deduces that
To conclude the proof, one shall use the following relations, holding for every real :
By applying (6.4) in the case and , one deduces that
By using the Cauchy-Schwarz inequality, one infers that
Formula (6.2) is once again an elementary consequence of the Cauchy-Schwarz inequality.
Consider a sequence of vectors , such that: (i) , , is a sequence of double integrals verifying assumptions (a), (b) and (c) in Example 5.2, and (ii) , , is a sequence of single integrals with unitary variance. Suppose moreover that the asymptotic relations in (3.7), (5.2) and (5.3) take place. Then, the estimates (6.1)–(6.2) yield that, for every , the Wasserstein distance between the law of
and the law of , converges to zero as , thus implying that converges in law to a vector of i.i.d. standard Gaussian random variables. Roughly speaking, this last fact implies that, when assessing the asymptotic joint Gaussianity of a vector such as , one can study separately the one-dimensional sequences and . This phenomenon coincides with the content of Part B of Theorem 3 in . See , and for similar results involving vectors of multiple integrals (of arbitrary order) with respect to Gaussian random measures.
Applications to non-linear functionals of Ornstein-Uhlenbeck L vy processes
As an illustration, in this section we focus on CLTs related to Ornstein-Uhlenbeck L vy processes, that is, processes obtained by integrating an exponential kernel of the type
with respect to an independently scattered random measure. Ornstein-Uhlenbeck L vy processes have been recently applied to a variety of frameworks, such as finance (where they are used to model stochastic volatility – see e.g. ) or non-parametric Bayesian survival analysis (where they represent random hazard rates – see e.g. ). In particular, in the references and it is shown that one can use some of the CLTs of this section in the context of Bayesian prior specification.
We consider the stationary Ornstein-Uhlenbeck Lévy process given by
The following result has been proved in [23, Theorem 5].
For every , as ,
where and is a centered standard Gaussian random variable.
By using Theorem 6.1, one can obtain the following Berry-Esséen estimate on the CLT appearing in (7.2) (compare also with Example 3.6).
Let , , be defined as in (7.2), and set
Then, there exists a constant , independent of and such that
As a consequence of the multiplication formula (2.14) and of a standard Fubini argument, one has (see [23, Proof of Theorem 5])
a combination of a single and of a double integral. To apply Theorem 6.1, we use the following asymptotic relations (that one can verify by resorting to the explicit definitions of and given in (7.1)), holding for :
The conclusion is obtained by using the estimates (6.1)–(6.2) and applying Theorem 6.1.
2 Berry-Esséen bounds for arbitrary tensor powers of Ornstein-Uhlenbeck kernels
We sometimes set . Note that, for every , one has that , and therefore ; it follows that the multiple integral
is well defined for every .
Fix , and suppose that , . Then, one can prove that is square-integrable and also that the random variable coincides with the projection of on the th Wiener chaos associated with . This fact can be easily checked when : indeed (using Proposition 2.5 in the case ) one has that
thus implying the desired relation. The general case can be proved by induction on .
The main result of this section is the following application of Theorem 4.2 and Theorem 5.1.
Fix and , and define the positive constant . Then, one has that, as ,
and there exists a finite constant such that, for every ,
Proof. The crucial fact is that, for each , the random variable has the form of a multiple integral, that is, , where is given by
(relation (7.9) improves the bounds in Theorem 4.2). In order to prove (7.9)–(7.11), for every we introduce the notation
(recall that ) and also, for ,
To prove (7.9), one uses the relation (7.12) to get
In the remaining of the proof, we will write in order to indicate a strictly positive finite constant independent of , that may change from line to line. To prove (7.10), one uses the fact that
where the last relation is obtained by resorting to the explicit representation (7.14), and then by evaluating the restriction of the quadruple integral to each simplex of the type , where is a permutation of the set . We shall now verify the class of asymptotic relations (7.11) for and . With , one has
where the last relation is verified by first using (7.12)–(7.14), and then by assessing the restriction of the quadruple integral to each one of the simplexes of the type . To deal with (7.11) in the case and , one uses the fact that
where the last relation is once again obtained by separately evaluating each restriction of the quadruple integral over a given simplex. This concludes the proof.
Acknowledgments. Part of this paper has been written while G. Peccati was visiting the Department of Mathematics of the “Universitat Autónoma de Barcelona”, in April 2008. This author heartily thanks J.L. Solé and F. Utzet for their hospitality and support. J.L. Solé and F. Utzet were supported by the Grant BFM2006-06427, Ministerio de Educación y Ciencia and FEDER. M.S. Taqqu was partially supported by the NSF Grants DMS-0505747 and DMS-0706786 at Boston University.