Skip to main content
  • Book
  • © 2010

Constructive Computation in Stochastic Models with Applications

The RG-Factorizations

Authors:

  • The first book in the area of matrix-analytic methods bridging applied mathematics to computer science, operations research and management sciences.
  • Presents recent results on applications in optimization, decision, and game theory.
  • Presents a large number of useful algorithms.

Buy it now

Buying options

eBook USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book USD 169.00
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Other ways to access

This is a preview of subscription content, log in via an institution to check for access.

Table of contents (11 chapters)

  1. Front Matter

    Pages i-xiv
  2. Stochastic Models

    • Quan-Lin Li
    Pages 1-71
  3. Block-Structured Markov Chains

    • Quan-Lin Li
    Pages 72-130
  4. Markov Chains of GI/G/1 Type

    • Quan-Lin Li
    Pages 131-175
  5. Asymptotic Analysis

    • Quan-Lin Li
    Pages 176-215
  6. Markov Chains on Continuous State Space

    • Quan-Lin Li
    Pages 216-287
  7. Block-Structured Markov Renewal Processes

    • Quan-Lin Li
    Pages 288-330
  8. Examples of Practical Applications

    • Quan-Lin Li
    Pages 331-388
  9. Transient Solution

    • Quan-Lin Li
    Pages 389-431
  10. Quasi-Stationary Distributions

    • Quan-Lin Li
    Pages 432-525
  11. Markov Reward Processes

    • Quan-Lin Li
    Pages 526-573
  12. Back Matter

    Pages 652-672

About this book

"Constructive Computation in Stochastic Models with Applications: The RG-Factorizations" provides a unified, constructive and algorithmic framework for numerical computation of many practical stochastic systems. It summarizes recent important advances in computational study of stochastic models from several crucial directions, such as stationary computation, transient solution, asymptotic analysis, reward processes, decision processes, sensitivity analysis as well as game theory. Graduate students, researchers and practicing engineers in the field of operations research, management sciences, applied probability, computer networks, manufacturing systems, transportation systems, insurance and finance, risk management and biological sciences will find this book valuable.

Dr. Quan-Lin Li is an Associate Professor at the Department of Industrial Engineering of Tsinghua University, China.

Reviews

From the reviews:

“This 672-page book is the result of a colossal undertaking on the part of the author. … Li’s book includes extensive bibliographies at the end of each chapter. The book uses a wide variety of methods and creates a welcome unifying presentation. This book is for the serious researcher in stochastic models, and is a great book with which a young researcher might quickly move into serious analysis of applied queueing models.” (Myron Hlynka, Mathematical Reviews, Issue 2011 f)

“This book deals with numerical … methods for computing aspects of Markov chains, such as stationary and transient probability distributions, first passage times, and visiting times to certain states. … this book is well organized, and should be a valuable reference for researchers and advanced graduate students working in numerical probability, structured matrices, etc. The results apply to large classes of stochastic models.” (Charles Knessl, SIAM Review, Vol. 54 (1), 2012)

Authors and Affiliations

  • Department of Industrial Engineering, Tsinghua University, Beijing, P. R. China

    Quan-Lin Li

Bibliographic Information

Buy it now

Buying options

eBook USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book USD 169.00
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Other ways to access