This text contains a systematic presentation on the subject from the simple branching process through Markov chains,
renewal processes, birth-death processes, to continuous time finite Markov processes and beyond. Numerous examples assembled from applied fields, plus a decorous collection of problems and their solutions are included. |