Optimal Stopping for Markov chains with infinite time has been discussed in this paper. The sufficient condition for the existence of the optimal stopping variable and the value function of the optimal stopping for Markov chains with infinite states has been obtained. The results show that the condition and calculation of the optimal stopping problem for Markov chains with finite states are equivalent to solving some linear programs.
参考文献
相似文献
引证文献
引用本文
谷建湘.马尔可夫链最优停止的值函数[J].国防科技大学学报,1990,12(1):1-11. Gu Jianxiang. The Value Function of Optimal Stopping for Markov Chains[J]. Journal of National University of Defense Technology,1990,12(1):1-11.