Table of contents:
Introduction. Discrete-Time Markov Chains: Transient Behavior. Discrete-Time Markov Chains: Limiting Behavor. Discrete-Time Markov Chains: First Passage Times. Poisson Processes
Continuous-Time Markov Chains. Applications of Markov Chains to Queueing Theory. Renewal Processes. Markov Renewal Processes
Epilogue. Appendices. Answers to Selected Problems. Bibliography.
Introduction. Discrete-Time Markov Chains: Transient Behavior. Discrete-Time Markov Chains: Limiting Behavor. Discrete-Time Markov Chains: First Passage Times. Poisson Processes
Continuous-Time Markov Chains. Applications of Markov Chains to Queueing Theory. Renewal Processes. Markov Renewal Processes
Epilogue. Appendices. Answers to Selected Problems. Bibliography.