Suppose there is a stochastic optimal control problem where the uncertainty is because of the random arrival of entities into our system which is modelled as a Poisson process with rate $\lambda(p)$. The BHJ optimality equation is as follows:

enter image description here

where $(x,q,t)$ are states of our system. Since the planning horizon is finite, $t\in [0,T]$, I should consider time as a state. $V(x,q,t)$ is the cost-to-go when the system is in state $(x,q,t)$. Since the system might be noisy, we may access some realization of $\lambda(p)$, and the exact value is not known. I am wondering if there is any data-driven approach to solve this BHJ equation?

I should also mention that the state-space can be extremely large and approximation might be used. I would be thankful if you can recommend some reference to handle this problem.

  • $\begingroup$ I don't really understand this kind of stuff but it looks a bit like an optimization problem, right? If so genetic learning might be applicable. $\endgroup$
    – Erwan
    Sep 22 '21 at 16:17

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.