Adaptive Dynamic Programming: Single and Multiple Controllers

1. Front Matter

   Pages i-xv

   PDF

2. Introduction

   • Ruizhuo Song, Qinglai Wei, Qing Li

   Pages 1-6

3. Neural-Network-Based Approach for Finite-Time Optimal Control

   • Ruizhuo Song, Qinglai Wei

   Pages 7-23

4. Nearly Finite-Horizon Optimal Control for Nonaffine Time-Delay Nonlinear Systems

   • Ruizhuo Song, Qinglai Wei, Qing Li

   Pages 25-48

5. Multi-objective Optimal Control for Time-Delay Systems

   • Ruizhuo Song, Qinglai Wei, Qing Li

   Pages 49-62

6. Multiple Actor-Critic Optimal Control via ADP

   • Ruizhuo Song, Qinglai Wei, Qing Li

   Pages 63-93

7. Optimal Control for a Class of Complex-Valued Nonlinear Systems

   • Ruizhuo Song, Qinglai Wei, Qing Li

   Pages 95-111

8. Off-Policy Neuro-Optimal Control for Unknown Complex-Valued Nonlinear Systems

   • Ruizhuo Song, Qinglai Wei, Qing Li

   Pages 113-126

9. Approximation-Error-ADP-Based Optimal Tracking Control for Chaotic Systems

   • Ruizhuo Song, Qinglai Wei, Qing Li

   Pages 127-145

10. Off-Policy Actor-Critic Structure for Optimal Control of Unknown Systems with Disturbances

    • Ruizhuo Song, Qinglai Wei, Qing Li

    Pages 147-164

11. An Iterative ADP Method to Solve for a Class of Nonlinear Zero-Sum Differential Games

    • Ruizhuo Song, Qinglai Wei, Qing Li

    Pages 165-205

12. Neural-Network-Based Synchronous Iteration Learning Method for Multi-player Zero-Sum Games

    • Ruizhuo Song, Qinglai Wei, Qing Li

    Pages 207-225

13. Off-Policy Integral Reinforcement Learning Method for Multi-player Non-zero-Sum Games

    • Ruizhuo Song, Qinglai Wei, Qing Li

    Pages 227-249

14. Optimal Distributed Synchronization Control for Heterogeneous Multi-agent Graphical Games

    • Ruizhuo Song, Qinglai Wei, Qing Li

    Pages 251-269

15. Back Matter

    Pages 271-271

    PDF

This book presents a class of novel optimal control methods and games schemes based on adaptive dynamic programming techniques. For systems with one control input, the ADP-based optimal control is designed for different objectives, while for systems with multi-players, the optimal control inputs are proposed based on games. In order to verify the effectiveness of the proposed methods, the book analyzes the properties of the adaptive dynamic programming methods, including convergence of the iterative value functions and the stability of the system under the iterative control laws. Further, to substantiate the mathematical analysis, it presents various application examples, which provide reference to real-world practices. 

• Optimal control
• Multi-player games
• Adaptive dynamic programming
• Nonlinear systems
• Neural network-based control

• University of Science and Technology Beijing, Beijing, China

  Ruizhuo Song, Qing Li

• Institute of Automation, Chinese Academy of Sciences, Beijing, China

  Qinglai Wei

Ruizhuo Song received the Ph.D. degree in control theory and control engineering from Northeastern University, Shenyang, China, in 2012. She was a postdoctoral fellow with University of Science and Technology Beijing, Beijing, China. She is currently an Associate Professor with the School of Automation and Electrical Engineering, University of Science and Technology Beijing. She was a Visiting Scholar with the Department of Electrical Engineering at University of Texas at Arlington, Arlington, TX, USA, from 2013 to 2014. Her current research interests include optimal control, multi-player games, neural-networks-based control, nonlinear control, wireless sensor networks, and adaptive dynamic programming and their industrial application. She has published over 40 journal and conference papers, and coauthored 2 monographs. 

Qinglai Wei received the B.S. degree in Automation, and the Ph.D. degree in control theory and control engineering, from the Northeastern University, Shenyang, China, in 2002 and 2009, respectively. From 2009--2011, he was a postdoctoral fellow with The State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China. He is currently a professor of the institute. He has authored two books, and published over 60 international journal papers. His research interests include adaptive dynamic programming, neural-networks-based control, optimal control, nonlinear systems and their industrial applications.

Dr. Qing Li received his B.E. degree from North China University of Science and Technology, Tangshan, China, in 1993, and the Ph. D degree incontrol theory and its applications from University of Science and Technology Beijing, Beijing, China, in 2000. He is currently a Professor with the School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing, China. He has been a visiting scholar at Ryerson University, Toronto, Canada, from February 2006 to February 2007. His research interests include intelligent control and intelligent optimization.

Policies and ethics