Machine Learning for Pricing American Options in High-Dimensional Markovian and non-Markovian models
Ludovic Goudenège, Andrea Molent, Antonino Zanette
Introduction
Pricing American options is clearly a crucial question of finance but also a challenging one since computing the optimal exercise strategy is not an evident task. This issue is even more exacting when the underling of the option is a multi-dimensional process, such as a baskets of assets, since in this case the direct application of standard numerical schemes, such as finite difference or tree methods, is not possible because of the exponential growth of the calculation time and the required working memory.
Common approaches in this field can be divided in four groups: techniques which rely on recombinant trees to discretize the underlyings (see , and ), techniques which employ regression on a truncated basis of in order to compute the conditional expectations (see and ), techniques which exploit Malliavin calculus to obtain representation formulas for the conditional expectation (see , , , and ) and techniques which make use of duality-based approaches for Bermudan option pricing (see , and ).
Recently, Machine Learning algorithms (Rasmussen and Williams ) and Deep Learning techniques (Nielsen ) have found great application in this sector of option pricing.
Neural networks are used by Kohler et al. to price American options based on several underlyings. Deep Learning techniques are nowadays widely used in solving large differential equations, which is intimately related to option pricing. In particular, Han et al. introduce a Deep Learning-based approach that can handle general high-dimensional parabolic PDEs. E et al. propose an algorithm for solving parabolic partial differential equations and backward stochastic differential equations in high dimension. Beck et al. introduce a method for solving high-dimensional fully nonlinear second-order PDEs. As far as American options in high dimension are concerned, Becker et al. develop a Deep Learning method for optimal stopping problems which directly learns the optimal stopping rule from Monte Carlo samples.
Also Machine Learning techniques have made their contribution. For example, Dixon and Crépey present a multi-Gaussian process regression for estimating portfolio risk, and in particular the associated CVA. De Spiegeleer et al. propose to apply Gaussian Process Regression (GPR) to predict the price of the derivatives from a training set made of observed prices for particular combinations of model parameters. Ludkovski proposes to use GPR meta-models for fitting the continuation values of Bermudan options. Similarly, GoudenÚge et al. propose the GPR-MC, which is a backward induction algorithm that employs Monte Carlo simulations and GPR to compute the price of American options in very high dimension (up to 100). In the insurance context, Gan studies the pricing of a large portfolio of Variable Annuities in the Black-Scholes model by using clustering and GPR. Moreover, Gan and Lin propose a novel approach that combines clustering technique and GPR to efficiently evaluate policies considering nested simulations.
In this paper we present two numerical techniques which upgrade the GPR-MC approach by replacing the Monte Carlo based computation of the continuation value respectively with a tree step and with an exact integration step. In particular, the algorithms we propose proceed backward over time and compute the price function only on a set of predetermined points. At each time step, a binomial tree step or a closed formula for integration are used together with GPR to approximate the continuation value at these points. The option price is then obtained as the maximum between the continuation value and the intrinsic value of the option and the algorithms proceed backward. For the sake of simplicity, we name these new approaches Gaussian Process Regression - Tree (GPR-Tree) and Gaussian Process Regression - Exact Integration (GPR-EI). We observe that the use of the GPR method to extrapolate the option value is particularly efficient in terms of computing time with respect to other techniques such as Neural Networks, especially because a small dataset is considered here. Moreover, Le Gratiet et Garnier developed recent convergence results about GPR, extending the outcomes of Rasmussen and Williams , and founding the convergence rate when different kernels are employed.
In order to demonstrate the wide applicability of the GPR methods, we also consider the rough Bergomi model, which is a non-Markovian model with stochastic volatility. Such a model, introduced by Bayer et al. stood out for explaining implied volatility smiles and other phenomena in the pricing of European options. The non-Markovian property of the model makes it difficult to implement a methodologically correct approach to address the valuation of American options. The literature in this framework is really poor. Horvat et al. propose an approach based on Donsker’s approximation for fractional Brownian motion and on a tree with exponential complexity. More recently, Bayer et al. introduce a method based on Monte Carlo simulation and exercise Rate Optimization.
Numerical results show that both the GPR-Tree and the GPR-EI methods are accurate and reliable in the multi-dimensional Black-Scholes model. Moreover the computational times with respect to the GPR-MC method are improved. The GPR-Tree and the GPR-EI methods prove its accuracy also when applied to the rough Bergomi model.
The reminder of the paper is organized as follows. Section 2 presents American options in the multi-dimensional Black-Scholes model. Section 3 and Section 4 introduce the GPR-Tree and the GPR-EI methods for the multi-dimensional Black-Scholes model respectively. Section 5 presents the American options in the rough Bergomi model. Section 6 and Section 7 introduce the GPR-Tree and the GPR-EI methods for the rough Bergomi model. Section 8 reports some numerical results. Section 9 draws some conclusions.
American options in the multi-dimensional Black-Scholes model
An American option with maturity is a derivative instrument whose holder can exercise the intrinsic optionality at any moment before maturity. Let denote the -dimensional underlying process, which is supposed to randomly evolve according to the multi-dimensional Black-Scholes model: under the risk neutral probability, such a model is given by the following equation
For simulation purposes, the dimensional Black-Scholes model can be written alternatively using the Cholesky decomposition. Specifically, for we can write
where is a -dimensional uncorrelated Brownian motion and is the -th row of the matrix defined as a square root of the correlation matrix , given by
The GPR-Tree method in the multi-dimensional Black-Scholes model
The GPR-Tree method is similar to the GPR-MC method but the diffusion of the underlyings is performed through a step of a binomial tree. In particular, the algorithm proceeds backward over time, approximating the price of the American option with the price of a Bermudan option on the same basket. At each time step, the price function is evaluated only on a set of predetermined points, through a binomial tree step together with GPR to approximate the continuation value. Finally, the optionality is exploited by computing the option value as the maximum between the continuation value and the exercise value.
Let denote the number of time steps, be the time increment and represent the discrete exercise dates for . At any exercise date , the value of the option is determined by the vector of the underlying prices as follows:
where denotes the continuation value of the option and it is given by the following relation:
We observe that, if the function is known, then it is possible to compute by approximating the expectation in (3.2). In order to obtain such an approximation, we consider a set of points whose elements represent certain possible values for the underlyings :
The GPR-Tree approximation of the value function at time can be computed as follows:
Then, the function can be obtained as
The GPR-EI method in the multi-dimensional Black-Scholes model
The GPR-EI method differs from both the GPR-MC and GPR-Tree methods for two reasons. First of all, the predictors employed in the GPR step are related to the logarithms of the predictors used in the GPR-Tree method. Secondly, the continuation value at these points is computed through a closed formula which comes from an exact integration.
where are weights that are computed by solving a linear system. The continuation value can be computed by integrating the function against a -dimensional probability density. This calculation can be done easily by means of a closed formula.
Specifically, the GPR-EI method relies on the following Proposition.
Let and suppose the function at time to be known at . The GPR-EI approximation of the option value at time at is given by
, , and are certain constants determined by the GPR approximation of the function for , considering as the predictor set, and is the covariance matrix of the log-increments defined by .
The proof of Proposition 1 is reported in the Appendix A. Equation (4.5) allows one to compute the option price at time by proceeding backward. In fact, the function is known at time throught (4.2) since the price function is equal to the payoff function . Moreover, if an approximation of is available, then one can approximate at by means of relation (4.5). Finally, the option price at time is approximated by .
American options in the rough Bergomi model
The rough Bergomi model, introduced by Bayer et al. , shapes the underlying process and its volatility through the following relations:
with the (constant) interest rate, a positive parameter and the Hurst parameter. The deterministic function represents the forward variance curve and following Bayer et al. we consider it as constant. The process is a Brownian motion, whereas is a Riemann-Liouville fractional Brownian motion that can be expressed as a stochastic integral:
with a Brownian motion and the instantaneous correlation coefficient between and .
The rough Bergomi model stood out for its ability to explain implied volatility and other phenomena related to European options. Moreover, it is particularly interesting from a computational point of view as it is a non-Markovian model and therefore it is not possible to apply standard techniques for American options.
where is the natural filtration generated by the couple for . We point out that, as opposed to the multi-dimensional Brownian motion, in this case, the stopping time does not only depend from the actual values of and but, since these are non-Markovian processes, it depends on the whole filtration, that is from the whole observed history of the processes.
The GPR-Tree method in the rough Bergomi model
The GPR-Tree method can be adapted to price American options in the rough Bergomi model. Despite the dimension of the model is only two, it is a non-Markovian model which obliges one to take into account the past history when evaluating the price of an option. So, the price of an option at a certain moment depends on all the filtration at that moment. Clearly, evaluating an option by considering the whole history of the process (a continuous process) is not possible. To overcome such an issue, we simulate the process on a finite number of dates and we consider the sub-filtration induced by these observations. First of all, we consider a finite number of time steps that determines the time increment , and we employ the scheme presented in Bayer et. al to generate a set of simulations of the couple at for . In particular, if we set , then the -dimensional random vector , given by
follows a zero-mean Gaussian distribution. Moreover, using the relations stated in Appendix B, one can calculate the covariance matrix of and its lower triangular square root by using the Cholesky factorization. The vector can be simulated by computing , where is a vector of independent standard Gaussian random variables. Finally, a simulation for can be obtained from by considering the initial values
First of all, the GPR-Tree method simulates different samples for the vector , namely for , and it computes the corresponding paths according to (6.2), (6.3) and (6.4). To summarize the values assumed by and , let us define the vector
for and . Moreover, we also define
where stands for the natural logarithm.
Then, the GPR-Tree method computes the option value for each of these trajectories, proceeding backward in time and considering the past history coded into the filtration. Since we consider only a finite number of steps, we approximate the filtration with the natural filtration generated by the variables . Moreover, is equal to the filtration generated by because there exists a deterministic bijective function that allows one to obtain from and vice versa. Therefore, when we calculate the option value conditioned by filtration , it is enough to conditioning with respect to the knowledge of the variables .
The GPR-Tree method proceeds backward in time, using a tree method and the GPR to calculate the option price with respect to the initially simulated trajectories. As opposed to the multi-dimensional Black-Scholes model, here we perform more than one single tree step, so as to reduce the number of GPR regressions and thus increasing the computational efficiency. In particular, we consider with and natural numbers that represent how many times the tree method is used and the number of time steps employed, respectively.
After simulating the random paths , we compute the tree approximation of the option value at time for each path as follows:
with stands for the the approximation of the continuation value function at time obtained by means of a tree approach, which discretizes each component of the Gaussian vector that generates the process. As opposed to the multi-dimensional Black-Scholes model, the approximation of the independent Gaussian components of through the equiprobable couple is not suitable since the convergence to the right price is too slow. So, we propose to use the same discrete approximation employed by Alfonsi in , which is stated in the following Lemma.
So, for each path , we consider a quadrinomial tree with time steps, and we use it to compute the continuation value. In particular, we consider the discrete time process defined through
where is the -th rows of the matrix and the -th row. Moreover, for and the other components, that is for , are sampled by using the random variable of Lemma 2.
An option value is assigned to each node of the tree: at maturity, that is for it is equal to the payoff , and for it can be obtained as the maximum between the exercise value and the discounted mean value at the future nodes, weighted according to the transition probabilities determined by the probability distribution of .
This approach allows us to compute the function for . We point out that, since the quadrinomial tree is not recombinant, the number of nodes grows exponentially with the number of time steps . Therefore, must be small. A similar problem arises with the tree approach proposed by Horvat et al. . In order to overcome such an issue, we apply the GPR method to approximate the function . Specifically, consider a natural number and define . We train the GPR method considering the predictor set given by
We term the function obtained by the aforementioned regression, which depends on . We stress out that if we consider (or greater), then the function would consider all the observed values of and as predictors. Anyway, numerical tests show that it is enough to consider smaller values of , which reduces the dimension of the regression and thus improves the numerical efficiency. A similar approach is taken by Bayer et al. .
Once we have obtained , we can approximate the option value at time by means of the tree approach again. The only difference in this case is that the value attributed to the terminal nodes is not determined by the payoff function, but through the function . We term the function obtained after this backward tree step. If we train the GPR method considering the predictor set given by
then we obtain the function , which can be employed to repeat the tree step and the GPR step, proceeding backward up to obtaining the initial option price by backward induction.
The GPR-EI method in the rough Bergomi model
The GPR-EI method can be adapted to price American options in the rough Bergomi model. Just like the GPR-Tree approach, the GPR-EI method starts by simulating different paths for the processes and , and it goes on by solving a backward induction problem, through the use of the GPR method and a closed formula for integration.
As opposed to the multi-dimensional Black-Scholes model, in the rough Bergomi case the use of the squared exponential kernel is not suitable because it is a isotropic kernel and the predictors employed have different nature (prices and volatilities at different times) and thus changes in each predictor impact differently on the price. So, we employ the Automatic Relevance Determination (ARD) Squared Exponential Kernel, that has separate length scale for each predictor and it is given by
with the number of the considered predictors. Specifically, the GPR-EI method relies on the following Propositions.
The GPR-EI approximation of the option value at time at is given by:
where , , and are certain constants determined by the GPR approximation of the function . Moreover,
The proof of Proposition 3 is reported in the Appendix C. Therefore, we can compute the value of the option at time for each simulated path by using (7.2).
Let and suppose the option price function at time to be known for all the simulated paths . Define
where is the -th row of the matrix and , and
where , , and are certain constants determined by the GPR approximation of the function considering as the predictor set. Moreover, and are two factors given by
where if is even and if is odd, for .
The proof of Proposition 4 is reported in the Appendix D. Relations (7.2) and (7.7) can be used to compute the option price at time by backward induction.
Numerical results
In this Section we present some numerical results about the effectiveness of the proposed algorithms. The first section is devoted to the numerical tests about the multi-dimensional Black-Scholes model, while the second is devoted to the rough Bergomi model. The algorithms have been implemented in MATLAB and computations have been preformed on a server which employs a GHz Intel® Xenon® processor (Gold 6148, Skylake) and 20 GB of RAM.
Following GoudenÚge et al. , we consider an Arithmetic basket Put, a Geometric basket Put and a Call on the Maximum of -assets.
In particular, we use the following parameters , , , , constant volatilities , constant correlations and exercise dates. Moreover, we consider or points. As opposed to the other input parameters, we vary the dimension , considering and .
We present now the numerical results obtained with the GPR-Tree and the GPR-EI methods for the three payoff examples.
Geometric basket Put is a particularly interesting option since it is possible to reduce the problem of pricing it in the -dimensional model to a one dimensional American Put option in the Black-Scholes model which can be priced straightforwardly, for example using the CRR algorithm with steps (see Cox et al. ). Therefore, in this case, we have a reliable benchmark to test the proposed methods. Moreover, when is smaller than we can also compute the price by means of a multi-dimensional binomial tree (see Ekvall ). In particular, the number of steps employed for the multi-dimensional binomial tree is equal to when and to when . For values of larger than , prices cannot be approximated via such a tree, because the memory required for the calculations would be too large. Furthermore, we also report the prices obtained with the GPR-MC method, employing points and Monte Carlo simulations, for comparison purposes. As far as the GPR-Tree is concerned, we compute the prices only for the values of smaller than since for higher values of the tree step becomes over time demanding. In fact, the computation of the continuation value with the tree step grows exponentially with the dimension and for it requires the evaluation of the GPR approximation at points for every times step and for every point of .
Results are reported in Table 1. We observe that the two proposed methods provide accurate and stable results and the computational time is generally very small, except for the GPR-Tree method at . Moreover, the computer processing time of the GRP-EI method increases little with the size of the problem and this makes the method particularly effective when the dimension of the problem is high. This is because the computation of the expected value and the training of the GPR model are minimally affected by the dimension of the problem.
Figure 8.1 investigates the convergence of the GPR methods changing the dimension . As we can see, the relative error is small with all the considered methods, but the computational time required by the GPR-Tree method and the GPR-EI method is generally smaller with respect to the GPR-MC method.
1.2 Arithmetic basket Put option
As opposed to the Geometric basket Put option, in this case we have no method to obtain a fully reliable benchmark. Therefore we only consider the prices obtained by means of the GPR-MC method, employed with points and Monte Carlo simulations. Moreover, for small values of , a benchmark can be obtained by means of a multi-dimensional tree method (see Boyle et al. ), just as shown for the Geometric case. Results are reported in Table 2. Similarly to the Geometric basket Put, the prices obtained are reliable and they do not change much with respect to the number of points. As opposed to the GPR-Tree method, which can not be applied for high values of , the GPR-EI method requires a small computational time for all the values concerned of .
1.3 Call on the Maximum
As for the Arithmetic basket Put, in this case we have no numerical methods to obtain a fully reliable benchmark. However, for small values of , we can approximate the price obtained by means of a multi-dimensional tree method. Moreover, we also consider the price obtained with the GPR-MC method. Results, which are shown in Table 3, have an accuracy comparable to the one obtained for the Arithmetic basket Put option.
2 Rough Bergomi model
Following Bayer et al. , we consider an American Put option and we use the same parameters: , , , , , , and strike or . As far as the GPR-Tree is concerned, we employ or time steps with , or random paths, and or past values. As far as the GPR-EI is concerned, we employ or time steps, or random paths, and or past values. Similar to what observed by Bayer et al. , the difference changing the value of does not impact significantly on the price, which indicates that considering the non-Markovian nature of the processes in the formulation of the exercise strategies is not particularly relevant. Conversely, using a large number of predictors significantly increases computational time. Numerical results are reported in Tables 4 and 5, together with the results reported by Bayer et al. in . Prices are very close to the benchmark, except for the case : in this case with both the two GPR methods we obtain a price which is close to while Bayer et al. obtain . Anyway, it is worth noticing that the relative gap between these two results is less than .
Conclusions
In this paper we have presented two numerical methods to compute the price of American options on a basket of underlyings following the Black-Scholes dynamics. These two methods are based on the GPR-Monte Carlo method and improve its results in terms of accuracy and computational time. The GPR-Tree method can be applied for dimensions up to and it proves to be very efficient when . The GPR-Exact Integration method proves to be particularly flexible and stands out for the small computational cost which allows one to obtain excellent estimates in a very short time. The two methods also turns out to be an effective tool to address non-Markovian problems such as the pricing of American options in the rough Bergomi model. These two methods are thus a step forward in overcoming the curse of dimensionality.
References
Appendix A Proof of Proposition 1
Let and suppose the function at time to be known at . Let us define the quantity
for . The function at time at follows
where is the random variable defined as
Let us define as the covariance matrix of the log-increments, that is . Moreover, let be a square root of and as a vector that follows a standard Gaussian law. Then, we observe that has the following conditional law
Moreover, relation (A.8) can also be stated as
Let denote the density function of given . Specifically,
In particular, with reference to (A.13), the additional parameters and are called hyperparameters and are obtained by means of a maximum likelihood estimation. So let
be the GPR approximation of the function , where in (A.14) is a vector of weights that can be computed by solving a linear system (see Rasmussen and Williams ). The GPR-EI approximation of the continuation value is then given by
To compute each integral in (A.16), we observe that
where is the convolution product and is the density function of a Gaussian random vector which has law given by . Moreover, the convolution product of the densities of two independent random variables is equal to the density of their sum (see Hogg et al. ) and we can obtain the following relation which allows one to exactly compute the integrals in (A.16):
Therefore, the GPR-EI approximation at reads
and the GPR-EI approximation of the option value at time and at is given by
Appendix B Covariance of the vector R𝑅R in (6.1)
Let us report the formulas for the covariance of the components of the vector in (6.1). For all , and , the following relations hold:
Appendix C Proof of Proposition 3
Let us denote the random vector for and with . We observe that the option value at time is given by the payoff function , which only depends by the final value of the underlying. The option value at time about the -th path is given by
where stands for the continuation value and it is equal to
We approximate the continuation value in (C.2) by means of the GPR approximation of . In particular, let be the approximation of the function by using the GPR method employing the Squared Exponential Kernel and considering the log-underlying values at maturity as predictors. Specifically, the predictor set is
where is the Squared Exponential kernel, is the characteristic length scale, is the signal standard deviation and are weights.
So we approximate the continuation value with the expression:
We observe that the law of given is normal
Therefore, the GPR-EI approximation for the continuation value at time is as follows:
Taking advantage of the properties of the convolution between density functions, we obtain
Appendix D Proof of Proposition 4
In order to proceed backward, from up to we consider an integer positive value and train the GPR method considering the last observed values of the couple as predictors, and the option price as response. Specifically, the predictor set is
approximates .
Since the predictors have different nature (log-prices and log-volatilities at different times), we use the Automatic Relevance Determination (ARD) Squared Exponential Kernel to perform the GPR regression. In particular, if is the dimension of the space containing the predictors, it holds
As opposed to the Squared Exponential kernel, the ARD Squared Exponential kernel considers a different length scale for each predictor that allows the regression to better learn the impact of each predictor on the response.
where if is even and if is odd, for . This means that is the observed log-price at time of the -th path if is even, and it is the observed log-volatility at time of the -th path if is odd.
where is the -th row of the matrix and . Moreover, the covariance matrix is given by
where stands for the element of in position . Using a similar reasoning as done for the continuation value at time , one can obtain the following GPR-EI approximation for the continuation value at time :
where and are two factors given by
In particular, measures the impact of the past observed values on the price, whereas integrates the changes due to the diffusion of the underlying and its volatility.
Finally, we observe that, in order to compute , we train the GPR method considering the predictor set given by
By induction we can compute the option price value for .
To conclude, we observe that the continuation value at time can be computed by using (D.9) and considering for since in this case, there are no past values to consider.