O. Hernández-Lerma

• Adaptive Markov control processes
• Discrete-time Markov control processes
• Further topics on discrete-time Markov control processes
• Markov chains and invariant probabilities
• Lectures on continuous-time Markov control processes