Skip to main content
SpringerLink
Log in
Book cover

An Introduction to Markov Processes

  • Textbook
  • © 2005

Overview

Authors:
  1. Daniel W. Stroock

    1. Department of Mathematics, MIT, Cambridge, USA

    View author publications

    You can also search for this author in PubMed   Google Scholar

Part of the book series: Graduate Texts in Mathematics (GTM, volume 230)

This is a preview of subscription content, log in via an institution to check access.

Access this book

Log in via an institution
eBook USD 49.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book USD 64.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Other ways to access

Licence this eBook for your library

Institutional subscriptions

Table of contents (6 chapters)

  1. Front Matter

    Pages i-xiv
    Download chapter PDF

  2. Random Walks A Good Place to Begin

    Pages 1-22

  3. Doeblin's Theory for Markov Chains

    Pages 23-44

  4. More about the Ergodic Theory of Markov Chains

    Pages 45-74

  5. Markov Processes in Continuous Time

    Pages 75-106

  6. Reversible Markov Processes

    Pages 107-144

  7. Some Mild Measure Theory

    Pages 145-166

  8. Back Matter

    Pages 167-175
    Download chapter PDF
Back to top

Keywords

About this book

To some extent, it would be accurate to summarize the contents of this book as an intolerably protracted description of what happens when either one raises a transition probability matrix P (i. e. , all entries (P)»j are n- negative and each row of P sums to 1) to higher and higher powers or one exponentiates R(P — I), where R is a diagonal matrix with non-negative entries. Indeed, when it comes right down to it, that is all that is done in this book. However, I, and others of my ilk, would take offense at such a dismissive characterization of the theory of Markov chains and processes with values in a countable state space, and a primary goal of mine in writing this book was to convince its readers that our offense would be warranted. The reason why I, and others of my persuasion, refuse to consider the theory here as no more than a subset of matrix theory is that to do so is to ignore the pervasive role that probability plays throughout. Namely, probability theory provides a model which both motivates and provides a context for what we are doing with these matrices. To wit, even the term "transition probability matrix" lends meaning to an otherwise rather peculiar set of hypotheses to make about a matrix.

Reviews

From the reviews:

“The book under review … provides an excellent introduction to the theory of Markov processes … . An abstract mathematical setting is given in which Markov processes are then defined and thoroughly studied. Because of this the book will basically be of interest to mathematicians and those who have at least a good knowledge of undergraduate analysis and probability theory. … The proofs are clearly written and explanations are not too concise which makes this book indeed very useful for a graduate course.” (Stefaan De Winter, Bulletin of the Belgian Mathematical Society, Vol. 15 (1), 2008)

Authors and Affiliations

  • Department of Mathematics, MIT, Cambridge, USA

    Daniel W. Stroock

About the author

The author has held positions at NYU, the Univresity of Colorado, and MIT. In addition, he has visited and lectured at many universities throughout the world. He has authored several book bout various aspects of probability theory.

Bibliographic Information

Publish with us

Policies and ethics

Back to top

Search

Navigation