Springer celebrates 175 years of publishing excellence! Join us >>

Stochastic Modelling and Applied Probability

Discrete-Time Markov Chains

Two-Time-Scale Methods and Applications

Authors: Yin, George, Zhang, Qing

Buy this book

eBook $79.99
price for USA (gross)
  • ISBN 978-0-387-26871-2
  • Digitally watermarked, DRM-free
  • Included format: PDF
  • ebooks can be used on all reading devices
  • Immediate eBook download after purchase
Softcover $109.00
price for USA
  • ISBN 978-1-4419-1955-7
  • Free shipping for individuals worldwide
  • Usually dispatched within 3 to 5 business days.
About this book

Focusing on discrete-time-scale Markov chains, the contents of this book are an outgrowth of some of the authors' recent research.  The motivation stems from existing and emerging applications in optimization and control of complex hybrid Markovian systems in manufacturing, wireless communication, and financial engineering.  Much effort in this book is devoted to designing system models arising from these applications, analyzing them via analytic and probabilistic techniques, and developing feasible computational algorithms so as to reduce the inherent complexity.

This book presents results including asymptotic expansions of probability vectors, structural properties of occupation measures, exponential bounds, aggregation and decomposition and associated limit processes, and interface of discrete-time and continuous-time systems.  One of the salient features is that it contains a diverse range of applications on filtering, estimation, control, optimization, and Markov decision processes, and financial engineering.  This book will be an important reference for researchers in the areas of applied probability, control theory, operations research, as well as for practitioners who use optimization techniques.  Part of the book can also be used in a graduate course of applied probability, stochastic processes, and applications.

Reviews

From the reviews:

"Discrete-time Markov chains are the basic building blocks for understanding random dynamic phenomena, in preparation for more complex situations. … the book is a research monograph based largely on the author’s own work. … The book does … fill an important niche in the literature on singularly perturbed Markov chains. … the book will be useful to applied probabilities and engineers who deal with such systems. Other than this, the book’s primary audience is other researchers in singulary perturbed Markov chains." (IEEE Control Systems Magazine, December, 2005)


Buy this book

eBook $79.99
price for USA (gross)
  • ISBN 978-0-387-26871-2
  • Digitally watermarked, DRM-free
  • Included format: PDF
  • ebooks can be used on all reading devices
  • Immediate eBook download after purchase
Softcover $109.00
price for USA
  • ISBN 978-1-4419-1955-7
  • Free shipping for individuals worldwide
  • Usually dispatched within 3 to 5 business days.
Loading...

Recommended for you

Loading...

Bibliographic Information

Bibliographic Information
Book Title
Discrete-Time Markov Chains
Book Subtitle
Two-Time-Scale Methods and Applications
Authors
Series Title
Stochastic Modelling and Applied Probability
Series Volume
55
Copyright
2005
Publisher
Springer-Verlag New York
Copyright Holder
Springer-Verlag New York
eBook ISBN
978-0-387-26871-2
DOI
10.1007/b138226
Softcover ISBN
978-1-4419-1955-7
Series ISSN
0172-4568
Edition Number
1
Number of Pages
XX, 347
Topics