Abstract
In Chap. 4, we study the expected α-discounted cost criterion. After some technical preliminaries in Sects. 4.2 and 4.3, the corresponding discounted cost optimality equation and the existence of a discounted cost optimal stationary policy are established in Sects. 4.4 and 4.5, respectively. The convergence of value and policy iteration procedures is shown in Sects. 4.6 and 4.7, respectively.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Author information
Authors and Affiliations
Corresponding authors
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Guo, X., Hernández-Lerma, O. (2009). Discount Optimality for Nonnegative Costs. In: Continuous-Time Markov Decision Processes. Stochastic Modelling and Applied Probability, vol 62. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-02547-1_4
Download citation
DOI: https://doi.org/10.1007/978-3-642-02547-1_4
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-02546-4
Online ISBN: 978-3-642-02547-1
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)