ON STOCHASTIC CONTROL PROBLEMS WITH HIGHER-ORDER MOMENTS

  • Yike Wang
  • , Jingzhen Liu
  • , Alain Bensoussan
  • , Ka Fai Cedric Yiu
  • , Jiaqin Wei

Research output: Contribution to journalArticlepeer-review

Abstract

In this paper, we focus on a class of time-inconsistent stochastic control problems, where the objective function includes the mean and several higher-order central moments of the terminal value of state. To tackle the time-inconsistency, we seek both the closed-loop and the open-loop Nash equilibrium controls as time-consistent solutions. We establish a partial differential equation (PDE) system for deriving a closed-loop Nash equilibrium control, which does not include the equilibrium value function and is different from the extended Hamilton-Jacobi-Bellman (HJB) equations as in Bj\" ork, Khapko, and Murgoci [Finance Stoch., 21 (2017), pp. 331-360]. We show that our PDE system is equivalent to the extended HJB equations that seem difficult to solve for our higher-order moment problems. In deriving an open-loop Nash equilibrium control, due to the nonseparable higher-order moments in the objective function, we make some moment estimates in addition to the standard perturbation argument for developing a maximum principle. Then, the problem is reduced to solving a flow of forward-backward stochastic differential equations. In particular, we investigate linear controlled dynamics and some objective functions affine in the mean. The closed-loop and the open-loop Nash equilibrium controls are identical, which are independent of the state value, the random path, and the preference on the odd-order central moments. By sending the highest order of central moments to infinity, we obtain the time-consistent solutions to some control problems whose objective functions include some penalty functions for deviation.

Original languageEnglish
Pages (from-to)1560-1589
Number of pages30
JournalSIAM Journal on Control and Optimization
Volume63
Issue number3
DOIs
StatePublished - 2025

Keywords

  • closed-loop Nash equilibrium control
  • higher-order moment
  • open-loop Nash equilibrium control
  • stochastic control
  • time-consistent

Fingerprint

Dive into the research topics of 'ON STOCHASTIC CONTROL PROBLEMS WITH HIGHER-ORDER MOMENTS'. Together they form a unique fingerprint.

Cite this