Communications and Control Engineering

Adaptive Dynamic Programming for Control

Algorithms and Stability

Authors: Zhang, H., Liu, D., Luo, Y., Wang, D.

  • Convergence proofs of the algorithms presented teach readers how to derive necessary stability and convergence criteria for their own systems
  • Establishes the fundamentals of ADP theory so that student readers can extrapolate their learning into control, operations research and related fields
  • Applications examples show how the theory can be made to work in real example systems
see more benefits

Buy this book

eBook $159.00
price for USA (gross)
  • ISBN 978-1-4471-4757-2
  • Digitally watermarked, DRM-free
  • Included format: PDF, EPUB
  • ebooks can be used on all reading devices
  • Immediate eBook download after purchase
Hardcover $209.00
price for USA
  • ISBN 978-1-4471-4756-5
  • Free shipping for individuals worldwide
  • Usually dispatched within 3 to 5 business days.
Softcover $209.00
price for USA
  • ISBN 978-1-4471-5881-3
  • Free shipping for individuals worldwide
  • Usually dispatched within 3 to 5 business days.
Rent the ebook  
  • Rental duration: 1 or 6 month
  • low-cost access
  • online reader with highlighting and note-making option
  • can be used across all devices
About this book

There are many methods of stable controller design for nonlinear systems. In seeking to go beyond the minimum requirement of stability, Adaptive Dynamic Programming in Discrete Time approaches the challenging topic of optimal control for nonlinear systems using the tools of  adaptive dynamic programming (ADP). The range of systems treated is extensive; affine, switched, singularly perturbed and time-delay nonlinear systems are discussed as are the uses of neural networks and techniques of value and policy iteration. The text features three main aspects of ADP in which the methods proposed for stabilization and for tracking and games benefit from the incorporation of optimal control methods:
• infinite-horizon control for which the difficulty of solving partial differential Hamilton–Jacobi–Bellman equations directly is overcome, and  proof provided that the iterative value function updating sequence converges to the infimum of all the value functions obtained by admissible control law sequences;
• finite-horizon control, implemented in discrete-time nonlinear systems showing the reader how to obtain suboptimal control solutions within a fixed number of control steps and with results more easily applied in real systems than those usually gained from infinite-horizon control;
• nonlinear games for which  a pair of mixed optimal policies are derived for solving games both when the saddle point does not exist, and, when it does, avoiding the existence conditions of the saddle point.
Non-zero-sum games are studied in the context of a single network scheme in which policies are obtained guaranteeing system stability and minimizing the individual performance function yielding a Nash equilibrium.
In order to make the coverage suitable for the student as well as for the expert reader, Adaptive Dynamic Programming in Discrete Time:
• establishes the fundamental theory involved clearly with each chapter devoted to a clearly identifiable control paradigm;
• demonstrates convergence proofs of the ADP algorithms to deepen understanding of the derivation of stability and convergence with the iterative computational methods used; and
• shows how ADP methods can be put to use both in simulation and in real applications.
This text will be of considerable interest to researchers interested in optimal control and its applications in operations research, applied mathematics computational intelligence and engineering. Graduate students working in control and operations research will also find the ideas presented here to be a source of powerful methods for furthering their study.

Reviews

From the book reviews:

“This book provides a self-contained treatment of adaptive dynamic programming with applications in feedback control and game theory. … This book … will appeal to graduate students, practitioners, and researchers seeking an up-to-date and consolidated treatment of the field.” (IEEE Control Systems Magazine, October, 2013)


Table of contents (10 chapters)

  • Overview

    Zhang, Huaguang (et al.)

    Pages 1-25

  • Optimal State Feedback Control for Discrete-Time Systems

    Zhang, Huaguang (et al.)

    Pages 27-107

  • Optimal Tracking Control for Discrete-Time Systems

    Zhang, Huaguang (et al.)

    Pages 109-160

  • Optimal State Feedback Control of Nonlinear Systems with Time Delays

    Zhang, Huaguang (et al.)

    Pages 161-199

  • Optimal Tracking Control of Nonlinear Systems with Time Delays

    Zhang, Huaguang (et al.)

    Pages 201-221

Buy this book

eBook $159.00
price for USA (gross)
  • ISBN 978-1-4471-4757-2
  • Digitally watermarked, DRM-free
  • Included format: PDF, EPUB
  • ebooks can be used on all reading devices
  • Immediate eBook download after purchase
Hardcover $209.00
price for USA
  • ISBN 978-1-4471-4756-5
  • Free shipping for individuals worldwide
  • Usually dispatched within 3 to 5 business days.
Softcover $209.00
price for USA
  • ISBN 978-1-4471-5881-3
  • Free shipping for individuals worldwide
  • Usually dispatched within 3 to 5 business days.
Rent the ebook  
  • Rental duration: 1 or 6 month
  • low-cost access
  • online reader with highlighting and note-making option
  • can be used across all devices
Loading...

Recommended for you

Loading...

Bibliographic Information

Bibliographic Information
Book Title
Adaptive Dynamic Programming for Control
Book Subtitle
Algorithms and Stability
Authors
Series Title
Communications and Control Engineering
Copyright
2013
Publisher
Springer-Verlag London
Copyright Holder
Springer-Verlag London
eBook ISBN
978-1-4471-4757-2
DOI
10.1007/978-1-4471-4757-2
Hardcover ISBN
978-1-4471-4756-5
Softcover ISBN
978-1-4471-5881-3
Series ISSN
0178-5354
Edition Number
1
Number of Pages
XVI, 424
Topics