Onesimo Hernandez-Lerma

• Continuous-Time Markov Decision Processes
• Continuous-Time Markov Decision Processes: Theory and Applications (Stochastic Modelling and Applied Probability Book 62)
• Discrete-time Markov control processes
• Further Topics on Discrete-Time Markov Control Processes
• Markov Chains and Invariant Probabilities
• Adaptive Markov Control Processes
• Selected Topics on Continuous-Time Controlled Markov Chains and Markov Games