Editors:
Buy it now
Buying options
Tax calculation will be finalised at checkout
Other ways to access
This is a preview of subscription content, log in via an institution to check for access.
Table of contents (32 chapters)
-
Front Matter
-
Markov Processes
-
Front Matter
-
-
Controlled Markov Chains and Decision Processes
-
Front Matter
-
-
Stochastic Processes and Martingales
-
Front Matter
-
About this book
The general theory of stochastic processes and the more specialized theory of Markov processes evolved enormously in the second half of the last century. In parallel, the theory of controlled Markov chains (or Markov decision processes) was being pioneered by control engineers and operations researchers. Researchers in Markov processes and controlled Markov chains have been, for a long time, aware of the synergies between these two subject areas. However, this may be the first volume dedicated to highlighting these synergies and, almost certainly, it is the first volume that emphasizes the contributions of the vibrant and growing Chinese school of probability. The chapters that appear in this book reflect both the maturity and the vitality of modern day Markov processes and controlled Markov chains. They also will provide an opportunity to trace the connections that have emerged between the work done by members of the Chinese school of probability and the work done by the European, US, Central and South American and Asian scholars.
Editors and Affiliations
-
Research Department, Changsha Railway University, Changsha, China
Zhenting Hou
-
School of Mathematics, University of South Australia, Mawson Lakes, Australia
Jerzy A. Filar
-
School of Computing and Mathematical Sciences, University of Greenwich, London, UK
Anyue Chen
Bibliographic Information
Book Title: Markov Processes and Controlled Markov Chains
Editors: Zhenting Hou, Jerzy A. Filar, Anyue Chen
DOI: https://doi.org/10.1007/978-1-4613-0265-0
Publisher: Springer New York, NY
-
eBook Packages: Springer Book Archive
Copyright Information: Kluwer Academic Publishers 2002
Hardcover ISBN: 978-1-4020-0803-0Published: 30 September 2002
Softcover ISBN: 978-1-4613-7968-3Published: 17 September 2011
eBook ISBN: 978-1-4613-0265-0Published: 01 December 2013
Edition Number: 1
Number of Pages: X, 512
Topics: Probability Theory and Stochastic Processes, Operations Research/Decision Theory, Theoretical, Mathematical and Computational Physics, Mathematical and Computational Biology, Mathematical Modeling and Industrial Mathematics