Skip to main content
  • Book
  • © 2012

Reinforcement Learning

State-of-the-Art

  • Covers all important recent developments in reinforcement learning
  • Very good introduction and explanation of the different emerging areas in Reinforcement Learning
  • Includes a survey of previous papers written on the topic

Part of the book series: Adaptation, Learning, and Optimization (ALO, volume 12)

Buy it now

Buying options

eBook USD 299.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book USD 379.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book USD 379.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Other ways to access

This is a preview of subscription content, log in via an institution to check for access.

Table of contents (19 chapters)

  1. Front Matter

    Pages 1-31
  2. Introductory Part

    1. Front Matter

      Pages 1-1
    2. Reinforcement Learning and Markov Decision Processes

      • Martijn van Otterlo, Marco Wiering
      Pages 3-42
  3. Efficient Solution Frameworks

    1. Front Matter

      Pages 43-43
    2. Batch Reinforcement Learning

      • Sascha Lange, Thomas Gabel, Martin Riedmiller
      Pages 45-73
    3. Least-Squares Methods for Policy Iteration

      • Lucian BuÅŸoniu, Alessandro Lazaric, Mohammad Ghavamzadeh, Rémi Munos, Robert BabuÅ¡ka, Bart De Schutter
      Pages 75-109
    4. Learning and Using Models

      • Todd Hester, Peter Stone
      Pages 111-141
    5. Sample Complexity Bounds of Exploration

      • Lihong Li
      Pages 175-204
  4. Constructive-Representational Directions

    1. Front Matter

      Pages 205-205
    2. Hierarchical Approaches

      • Bernhard Hengst
      Pages 293-323
  5. Probabilistic Models of Self and Others

    1. Front Matter

      Pages 357-357
    2. Bayesian Reinforcement Learning

      • Nikos Vlassis, Mohammad Ghavamzadeh, Shie Mannor, Pascal Poupart
      Pages 359-386
    3. Partially Observable Markov Decision Processes

      • Matthijs T. J. Spaan
      Pages 387-414
    4. Predictively Defined Representations of State

      • David Wingate
      Pages 415-439
    5. Game Theory and Multi-agent Reinforcement Learning

      • Ann Nowé, Peter Vrancx, Yann-Michaël De Hauwere
      Pages 441-470
    6. Decentralized POMDPs

      • Frans A. Oliehoek
      Pages 471-503

About this book

Reinforcement learning encompasses both a science of adaptive behavior of rational beings in uncertain environments and a computational methodology for finding optimal behaviors for challenging problems in control, optimization and adaptive behavior of intelligent agents. As a field, reinforcement learning has progressed tremendously in the past decade.

The main goal of this book is to present an up-to-date series of survey articles on the main contemporary sub-fields of reinforcement learning. This includes surveys on partially observable environments, hierarchical task decompositions, relational knowledge representation and predictive state representations. Furthermore, topics such as transfer, evolutionary methods and continuous spaces in reinforcement learning are surveyed. In addition, several chapters review reinforcement learning methods in robotics, in games, and in computational neuroscience. In total seventeen different subfields are presented by mostly young experts in those areas, and together they truly represent a state-of-the-art of current reinforcement learning research.

Marco Wiering works at the artificial intelligence department of the University of Groningen in the Netherlands. He has published extensively on various reinforcement learning topics. Martijn van Otterlo works in the cognitive artificial intelligence group at the Radboud University Nijmegen in The Netherlands. He has mainly focused on expressive knowledge
representation in reinforcement learning settings.

Editors and Affiliations

  • Fac. Mathematics &, Natural Sciences, University of Groningen, Groningen, Netherlands

    Marco Wiering

  • , Artificial Intelligence, Radboud University Nijmegen, Nijmegen, Netherlands

    Martijn Otterlo

Bibliographic Information

  • Book Title: Reinforcement Learning

  • Book Subtitle: State-of-the-Art

  • Editors: Marco Wiering, Martijn Otterlo

  • Series Title: Adaptation, Learning, and Optimization

  • DOI: https://doi.org/10.1007/978-3-642-27645-3

  • Publisher: Springer Berlin, Heidelberg

  • eBook Packages: Engineering, Engineering (R0)

  • Copyright Information: Springer-Verlag Berlin Heidelberg 2012

  • Hardcover ISBN: 978-3-642-27644-6Published: 14 March 2012

  • Softcover ISBN: 978-3-642-44685-6Published: 16 April 2014

  • eBook ISBN: 978-3-642-27645-3Published: 05 March 2012

  • Series ISSN: 1867-4534

  • Series E-ISSN: 1867-4542

  • Edition Number: 1

  • Number of Pages: XXXIV, 638

  • Topics: Computational Intelligence, Artificial Intelligence

Buy it now

Buying options

eBook USD 299.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book USD 379.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book USD 379.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Other ways to access