175 years of Springer publishing +++ Limited offer: Any eBook in the Springer Archives 9.99 each!

International Series in Operations Research & Management Science

Markov Chains: Models, Algorithms and Applications

Authors: Ching, Wai-Ki, Ng, Michael K.

  • Markov chains are a powerful and widely used tool for analyzing a variety of stochastic systems over time
  • Systematically discusses all the models beginning with the basic to the more advanced and illustrates each of the models with the most recent and high interest applications and uses
see more benefits

Buy this book

eBook $129.00
price for USA (gross)
  • ISBN 978-0-387-29337-0
  • Digitally watermarked, DRM-free
  • Included format: PDF
  • ebooks can be used on all reading devices
  • Immediate eBook download after purchase
Softcover $169.00
price for USA
  • ISBN 978-1-4419-3986-9
  • Free shipping for individuals worldwide
  • Usually dispatched within 3 to 5 business days.
About this book

Markov chains are a particularly powerful and widely used tool for analyzing a variety of stochastic (probabilistic) systems over time. This monograph will present a series of Markov models, starting from the basic models and then building up to higher-order models. Included in the higher-order discussions are multivariate models, higher-order multivariate models, and higher-order hidden models. In each case, the focus is on the important kinds of applications that can be made with the class of models being considered in the current chapter. Special attention is given to numerical algorithms that can efficiently solve the models.

Therefore, Markov Chains: Models, Algorithms and Applications outlines recent developments of Markov chain models for modeling queueing sequences, Internet, re-manufacturing systems, reverse logistics, inventory systems, bio-informatics, DNA sequences, genetic networks, data mining, and many other practical systems.

Reviews

From the reviews:

"The authors outline recent developments of Markov chain models … . This book is aimed at students, professionals, practitioners, and researchers in scientific computing and operational research, who are interested in the formulation and computation of queuing and manufacturing systems. It gives a number of useful tools for researchers in real applications … ." (Alexander I. Zejfman, Zentralblatt MATH, Vol. 1089 (15), 2006)

"In this book’s … essential notions on Markov chains, hidden Markov models, and Markov decision processes are covered, with special emphasis on iterative methods for solving linear systems. … Each chapter finishes with a short summary and sometimes a selection of open problems. … This book is intended for students and researchers in applied mathematics, scientific computing, and operations research … . Overall, this book offers much interesting and up-to-date material on a wide variety of topics, dealing with finite-space Markov processes." (Jozef L. Teugels, Journal of the American Statistical Association, Vol. 103 (483), September, 2008)


Table of contents (5 chapters)

Buy this book

eBook $129.00
price for USA (gross)
  • ISBN 978-0-387-29337-0
  • Digitally watermarked, DRM-free
  • Included format: PDF
  • ebooks can be used on all reading devices
  • Immediate eBook download after purchase
Softcover $169.00
price for USA
  • ISBN 978-1-4419-3986-9
  • Free shipping for individuals worldwide
  • Usually dispatched within 3 to 5 business days.
Loading...

Recommended for you

Loading...

Bibliographic Information

Bibliographic Information
Book Title
Markov Chains: Models, Algorithms and Applications
Authors
Series Title
International Series in Operations Research & Management Science
Series Volume
83
Copyright
2006
Publisher
Springer US
Copyright Holder
Springer-Verlag US
eBook ISBN
978-0-387-29337-0
DOI
10.1007/0-387-29337-X
Softcover ISBN
978-1-4419-3986-9
Series ISSN
0884-8289
Edition Number
1
Number of Pages
XIV, 208
Number of Illustrations and Tables
18 b/w illustrations
Topics