This paper deals with a finite-state, finiteaction discrete-time Markov decision model. A linear programming procedure is developed for the computation of optimal policies over the entire range of the discount factor. Furthermore, a procedure is presented for the computation of a Blackwell optimal policy.

,
doi.org/10.1007/BF01721353, hdl.handle.net/1765/2248
OR Spektrum
Erasmus School of Economics