Sensitivity analysis in discounted Markovian decison problems
OR Spektrum , Volume 7 - Issue 3 p. 143- 151
This paper deals with a finite-state, finiteaction discrete-time Markov decision model. A linear programming procedure is developed for the computation of optimal policies over the entire range of the discount factor. Furthermore, a procedure is presented for the computation of a Blackwell optimal policy.