A self-contained treatment, this text covers both theory and applications. Topics include homogeneous finite and infinite Markov chains, including those employed in the mathematical modeling of psychology and genetics; the basics of nonhomogeneous finite Markov chain theory; and a study of Markovian dependence in continuous time. 1980 edition.