A leavable bounded-velocity stochastic control problem

Ioannis Karatzas, Daniel Ocone

Research output: Contribution to journalArticlepeer-review

21 Scopus citations

Abstract

This paper studies bounded-velocity control of a Brownian motion when discretionary stopping, or 'leaving', is allowed. The goal is to choose a control law and a stopping time in order to minimize the expected sum of a running and a termination cost, when both costs increase as a function of distance from the origin. There are two versions of this problem: the fully observed case, in which the control multiplies a known gain, and the partially observed case, in which the gain is random and unknown. Without the extra feature of stopping, the fully observed problem originates with Beneš (Stochastic Process. Appl. 2 (1974) 127-140), who showed that the optimal control takes the 'bang-bang' form of pushing with maximum velocity toward the origin. We show here that this same control is optimal in the case of discretionary stopping; in the case of power-law costs, we solve the variational equation for the value function and explicitly determine the optimal stopping policy. We also discuss qualitative features of the solution for more general cost structures. When no discretionary stopping is allowed, the partially observed case has been solved by Beneš et al. (Stochastics Monographs, Vol. 5, Gordon & Breach, New York and London, pp. 121-156) and Karatzas and Ocone (Stochastic Anal. Appl. 11 (1993) 569-605). When stopping is allowed, we obtain lower bounds on the optimal stopping region using stopping regions of related, fully observed problems.

Original languageEnglish (US)
Pages (from-to)31-51
Number of pages21
JournalStochastic Processes and their Applications
Volume99
Issue number1
DOIs
StatePublished - 2002

All Science Journal Classification (ASJC) codes

  • Statistics and Probability
  • Modeling and Simulation
  • Applied Mathematics

Keywords

  • Control with discretionary stopping
  • Optimal stopping
  • Partial observations
  • Stochastic control

Fingerprint

Dive into the research topics of 'A leavable bounded-velocity stochastic control problem'. Together they form a unique fingerprint.

Cite this