Skip to main content
Kent Academic Repository

An Efficient Gradient Projection Method for Stochastic Optimal Control Problems

Gong, Bo, Liu, Wenbin, Tang, Tao, Zhao, Weidong, Zhou, Tao (2017) An Efficient Gradient Projection Method for Stochastic Optimal Control Problems. SIAM Journal on Numerical Analysis, 55 (6). pp. 2982-3005. ISSN 0036-1429. (doi:10.1137/17M1123559) (KAR id:65556)

Abstract

In this work, we propose a simple yet effective gradient projection algorithm for a class of stochastic optimal control problems. We first reduce the optimal control problem to an optimization problem for a convex functional by means of a projection operator. Then we propose a convergent iterative scheme for the optimization problem. The key issue in our iterative scheme is to compute the gradient of the objective functional by solving the adjoint equations that are given by backward stochastic differential equations (BSDEs). The Euler method is used to solve the resulting BSDEs. Rigorous convergence analysis is presented, and it is shown that the entire numerical algorithm admits a first order rate of convergence. Several numerical examples are carried out to support the theoretical finding.

Item Type: Article
DOI/Identification number: 10.1137/17M1123559
Divisions: Divisions > Kent Business School - Division > Kent Business School (do not use)
Depositing User: Steve Liu
Date Deposited: 19 Dec 2017 10:41 UTC
Last Modified: 09 Dec 2022 06:19 UTC
Resource URI: https://kar.kent.ac.uk/id/eprint/65556 (The current URI for this page, for reference purposes)

University of Kent Author Information

  • Depositors only (login required):

Total unique views for this document in KAR since July 2020. For more details click on the image.