Skip to main content
Book cover

Further Topics on Discrete-Time Markov Control Processes

  • Book
  • © 1999

Overview

Part of the book series: Stochastic Modelling and Applied Probability (SMAP, volume 42)

This is a preview of subscription content, log in via an institution to check access.

Access this book

eBook USD 119.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book USD 159.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book USD 159.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Other ways to access

Licence this eBook for your library

Institutional subscriptions

Table of contents (6 chapters)

Keywords

About this book

This book presents the second part of a two-volume series devoted to a sys­ tematic exposition of some recent developments in the theory of discrete­ time Markov control processes (MCPs). As in the first part, hereafter re­ ferred to as "Volume I" (see Hernandez-Lerma and Lasserre [1]), interest is mainly confined to MCPs with Borel state and control spaces, and possibly unbounded costs. However, an important feature of the present volume is that it is essentially self-contained and can be read independently of Volume I. The reason for this independence is that even though both volumes deal with similar classes of MCPs, the assumptions on the control models are usually different. For instance, Volume I deals only with nonnegative cost­ per-stage functions, whereas in the present volume we allow cost functions to take positive or negative values, as needed in some applications. Thus, many results in Volume Ion, say, discounted or average cost problems are not applicable to the models considered here. On the other hand, we now consider control models that typically re­ quire more restrictive classes of control-constraint sets and/or transition laws. This loss of generality is, of course, deliberate because it allows us to obtain more "precise" results. For example, in a very general context, in §4.

Authors and Affiliations

  • Departamento de Matemáticas, CINVESTAV-IPN, Mexico DF, Mexico

    Onésimo Hernández-Lerma

  • LAAS-CNRS, Toulouse Cedex, France

    Jean Bernard Lasserre

Bibliographic Information

  • Book Title: Further Topics on Discrete-Time Markov Control Processes

  • Authors: Onésimo Hernández-Lerma, Jean Bernard Lasserre

  • Series Title: Stochastic Modelling and Applied Probability

  • DOI: https://doi.org/10.1007/978-1-4612-0561-6

  • Publisher: Springer New York, NY

  • eBook Packages: Springer Book Archive

  • Copyright Information: Springer Science+Business Media New York 1999

  • Hardcover ISBN: 978-0-387-98694-4Published: 22 June 1999

  • Softcover ISBN: 978-1-4612-6818-5Published: 12 October 2012

  • eBook ISBN: 978-1-4612-0561-6Published: 06 December 2012

  • Series ISSN: 0172-4568

  • Series E-ISSN: 2197-439X

  • Edition Number: 1

  • Number of Pages: XIII, 277

  • Topics: Probability Theory and Stochastic Processes

Publish with us