Lecture 35 (2009-07-23)
Continious-time Markov Chains Introduction
IE-325 Stochastic Models
Asst. Prof. Dr. Savaş Dayanık
2008-2009- Summer
Probability review and conditional expectations. Discrete-time Markov chains. Markov decision processes. Poisson processes. Continuous-time Markov chains. Applications to inventory control, queuing systems, and cash management.
