Logo - springer
Slogan - springer

Computer Science - Artificial Intelligence | Qualitative Spatial Abstraction in Reinforcement Learning

Qualitative Spatial Abstraction in Reinforcement Learning

Frommberger, Lutz

2010, XVII, 174 p.

Available Formats:
eBook
Information

Springer eBooks may be purchased by end-customers only and are sold without copy protection (DRM free). Instead, all eBooks include personalized watermarks. This means you can read the Springer eBooks across numerous devices such as Laptops, eReaders, and tablets.

You can pay for Springer eBooks with Visa, Mastercard, American Express or Paypal.

After the purchase you can directly download the eBook file or read it online in our Springer eBook Reader. Furthermore your eBook will be stored in your MySpringer account. So you can always re-download your eBooks.

 
$119.00

(net) price for USA

ISBN 978-3-642-16590-0

digitally watermarked, no DRM

Included Format: PDF

download immediately after purchase


learn more about Springer eBooks

add to marked items

Hardcover
Information

Hardcover version

You can pay for Springer Books with Visa, Mastercard, American Express or Paypal.

Standard shipping is free of charge for individual customers.

 
$149.00

(net) price for USA

ISBN 978-3-642-16589-4

free shipping for individuals worldwide

usually dispatched within 3 to 5 business days


add to marked items

Softcover
Information

Softcover (also known as softback) version.

You can pay for Springer Books with Visa, Mastercard, American Express or Paypal.

Standard shipping is free of charge for individual customers.

 
$149.00

(net) price for USA

ISBN 978-3-642-26600-3

free shipping for individuals worldwide

usually dispatched within 3 to 5 business days


add to marked items

  • Introduces many original ideas
  • A significant contribution to the field of reinforcement learning
  • Offers pointers to future research

Reinforcement learning has developed as a successful learning approach for domains that are not fully understood and that are too complex to be described in closed form. However, reinforcement learning does not scale well to large and continuous problems. Furthermore, acquired knowledge specific to the learned task, and transfer of knowledge to new tasks is crucial.

 

In this book the author investigates whether deficiencies of reinforcement learning can be overcome by suitable abstraction methods. He discusses various forms of spatial abstraction, in particular qualitative abstraction, a form of representing knowledge that has been thoroughly investigated and successfully applied in spatial cognition research. With his approach, he exploits spatial structures and structural similarity to support the learning process by abstracting from less important features and stressing the essential ones. The author demonstrates his learning approach and the transferability of knowledge by having his system learn in a virtual robot simulation system and consequently transfer the acquired knowledge to a physical robot. The approach is influenced by findings from cognitive science.

 

The book is suitable for researchers working in artificial intelligence, in particular knowledge representation, learning, spatial cognition, and robotics.

 

Content Level » Research

Keywords » Spatial Abstraction - State Space Representation - Temporal Abstraction - Transfer Learni - artificial intelligence - cognition - cognitive science - intelligence - knowledge - knowledge representation - learning - reinforcement learning - robot - robotics - simulation

Related subjects » Artificial Intelligence - Robotics

Table of contents 

Foundations of Reinforcement Learning.- Abstraction and Knowledge Transfer in Reinforcement Learning.- Qualitative State Space Abstraction.- Generalization and Transfer Learning with Qualitative Spatial Abstraction.- RLPR – An Aspectualizable State Space Representation.- Empirical Evaluation.- Summary and Outlook.

Popular Content within this publication 

 

Articles

Read this Book on Springerlink

Services for this book

New Book Alert

Get alerted on new Springer publications in the subject area of Artificial Intelligence (incl. Robotics).