Skip to main content
SpringerLink
Log in
Birkhäuser

Markov Chains and Invariant Probabilities

  • Book
  • © 2003

Overview

Authors:
  1. Onésimo Hernández-Lerma

    1. Departamento de Matemáticas, CINVESTAV-IPN, México, México

    View author publications

    You can also search for this author in PubMed   Google Scholar

  2. Jean Bernard Lasserre

    1. LAAS-CNRS, France

    View author publications

    You can also search for this author in PubMed   Google Scholar

  • Some of the results presented appear for the first time in book form
  • Emphasis on the role of expected occupation measures to study the long-run behavior of Markov chains on uncountable spaces

Part of the book series: Progress in Mathematics (PM, volume 211)

This is a preview of subscription content, log in via an institution to check access.

Access this book

Log in via an institution
eBook USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book USD 54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Other ways to access

Licence this eBook for your library

Institutional subscriptions

Table of contents (12 chapters)

  1. Front Matter

    Pages i-xvi
    Download chapter PDF

  2. Preliminaries

    1. Preliminaries

      • Onésimo Herná-Lerma, Jean Bernard Lasserre
      Pages 1-18

  3. Markov Chains and Ergodicity

    1. Front Matter

      Pages 19-19
      Download chapter PDF

    2. Markov Chains and Ergodic Theorems

      • Onésimo Herná-Lerma, Jean Bernard Lasserre
      Pages 21-39

    3. Countable Markov Chains

      • Onésimo Herná-Lerma, Jean Bernard Lasserre
      Pages 41-46

    4. Harris Markov Chains

      • Onésimo Herná-Lerma, Jean Bernard Lasserre
      Pages 47-61

    5. Markov Chains in Metric Spaces

      • Onésimo Herná-Lerma, Jean Bernard Lasserre
      Pages 63-82

    6. Classification of Markov Chains via Occupation Measures

      • Onésimo Herná-Lerma, Jean Bernard Lasserre
      Pages 83-92

  4. Further Ergodicity Properties

    1. Front Matter

      Pages 93-93
      Download chapter PDF

    2. Feller Markov Chains

      • Onésimo Herná-Lerma, Jean Bernard Lasserre
      Pages 95-102

    3. The Poisson Equation

      • Onésimo Herná-Lerma, Jean Bernard Lasserre
      Pages 103-120

    4. Strong and Uniform Ergodicity

      • Onésimo Herná-Lerma, Jean Bernard Lasserre
      Pages 121-131

  5. Existence and Approximation of Invariant Probability Measures

    1. Front Matter

      Pages 133-133
      Download chapter PDF

    2. Existence and Uniqueness of Invariant Probability Measures

      • Onésimo Herná-Lerma, Jean Bernard Lasserre
      Pages 135-155

    3. Existence and Uniqueness of Fixed Points for Markov Operators

      • Onésimo Herná-Lerma, Jean Bernard Lasserre
      Pages 157-174

    4. Approximation Procedures for Invariant Probability Measures

      • Onésimo Herná-Lerma, Jean Bernard Lasserre
      Pages 175-191

  6. Back Matter

    Pages 193-208
    Download chapter PDF
Back to top

Keywords

About this book

This book is about discrete-time, time-homogeneous, Markov chains (Mes) and their ergodic behavior. To this end, most of the material is in fact about stable Mes, by which we mean Mes that admit an invariant probability measure. To state this more precisely and give an overview of the questions we shall be dealing with, we will first introduce some notation and terminology. Let (X,B) be a measurable space, and consider a X-valued Markov chain ~. = {~k' k = 0, 1, ... } with transition probability function (t.pJ.) P(x, B), i.e., P(x, B) := Prob (~k+1 E B I ~k = x) for each x E X, B E B, and k = 0,1, .... The Me ~. is said to be stable if there exists a probability measure (p.m.) /.l on B such that (*) VB EB. /.l(B) = Ix /.l(dx) P(x, B) If (*) holds then /.l is called an invariant p.m. for the Me ~. (or the t.p.f. P).

Reviews

"It should be stressed that an important part of the results presented is due to the authors. . . . In the reviewer's opinion, this is an elegant and most welcome addition to the rich literature of Markov processes."

--MathSciNet

Authors and Affiliations

  • Departamento de Matemáticas, CINVESTAV-IPN, México, México

    Onésimo Hernández-Lerma

  • LAAS-CNRS, France

    Jean Bernard Lasserre

Bibliographic Information

Publish with us

Policies and ethics

Back to top

Search

Navigation