Intrinsically Motivated Learning in Natural and Artificial Systems

Editors: Baldassarre, Gianluca, Mirolli, Marco (Eds.)

  • Interdisciplinary authors explain latest theories on mammalian intelligence and learning, artificial intelligence, creativity, and evolution Identifies scientific and technological open challenges and most promising research directions Grounds theoretical with practical robotics experiments

Buy this book

eBook $139.00
price for USA (gross)
  • ISBN 978-3-642-32375-1
  • Digitally watermarked, DRM-free
  • Included format: PDF, EPUB
  • ebooks can be used on all reading devices
  • Immediate eBook download after purchase
Hardcover $179.00
price for USA
  • ISBN 978-3-642-32374-4
  • Free shipping for individuals worldwide
  • Usually dispatched within 3 to 5 business days.
About this book

It has become clear to researchers in robotics and adaptive behaviour that current approaches are yielding systems with limited autonomy and capacity for self-improvement. To learn autonomously and in a cumulative fashion is one of the hallmarks of intelligence, and we know that higher mammals engage in exploratory activities that are not directed to pursue goals of immediate relevance for survival and reproduction but are instead driven by intrinsic motivations such as curiosity, interest in novel stimuli or surprising events, and inter­est in learning new behaviours. The adaptive value of such intrinsically motivated activities lies in the fact that they allow the cumulative acquisition of knowledge and skills that can be used later to accomplish fitness-enhanc­ing goals. Intrinsic motivations continue during adulthood, and in humans they underlie lifelong learning, artistic creativity, and scientific discovery, while they are also the basis for processes that strongly affect human well-being, such as the sense of competence, self-determination, and self-esteem.

This book has two aims: to present the state of the art in research on intrinsically motivated learning, and to identify the related scientific and technological open challenges and most promising research directions. The book introduces the concept of intrinsic motivation in artificial systems, reviews the relevant literature, offers insights from the neural and behavioural sciences, and presents novel tools for research. The book is organized into six parts: the chapters in Part I give general overviews on the concept of intrinsic motivations, their function, and possible mechanisms for implementing them; Parts II, III, and IV focus on three classes of intrinsic motivation mechanisms, those based on predictors, on novelty, and on competence; Part V discusses mechanisms that are complementary to intrinsic motivations; and Part VI introduces tools and experimental frameworks for investigating intrinsic motivations.

The contributing authors are among the pioneers carrying out fundamental work on this topic, drawn from related disciplines such as artificial intelligence, robotics, artificial life, evolution, machine learning, developmental psychology, cognitive science, and neuroscience. The book will be of value to graduate students and academic researchers in these domains, and to engineers engaged with the design of autonomous, adaptive robots.

The contributing authors are among the pioneers carrying out fundamental work on this topic, drawn from related disciplines such as artificial intelligence, robotics, artificial life, evolution, machine learning, developmental psychology, cognitive science, and neuroscience. The book will be of value to graduate students and academic researchers in these domains, and to engineers engaged with the design of autonomous, adaptive robots.

About the authors

Dr. Gianluca Baldassarre is a Researcher at the Institute of Cognitive Sciences and Technologies (ISTC) of the Italian National Research Council (CNR) where he is a member of the Laboratory of Computational Embodied Neuroscience; his research interests include computational embodied neuroscience, psychology, neuroscience, developmental robotics, artificial life, and machine learning.

Dr. Marco Mirolli is a Researcher at the Institute of Cognitive Sciences and Technologies (ISTC) of the Italian National Research Council (CNR) where he is a member of the Laboratory of Computational Embodied Neuroscience Laboratory; his research interests lie in the study of behavior through computer simulations, in particular the evolution of communication and language, the role of language as a cognitive tool, the biological bases of motivations and emotions, and the role of intrinsic motivations in cumulative learning.

Table of contents (17 chapters)

  • Intrinsically Motivated Learning Systems: An Overview

    Baldassarre, Gianluca (et al.)

    Pages 1-14

  • Intrinsic Motivation and Reinforcement Learning

    Barto, Andrew G.

    Pages 17-47

  • Functions and Mechanisms of Intrinsic Motivations

    Mirolli, Marco (et al.)

    Pages 49-72

  • Exploration from Generalization Mediated by Multiple Controllers

    Dayan, Peter

    Pages 73-91

  • Maximizing Fun by Creating Data with Easily Reducible Subjective Complexity

    Schmidhuber, Jürgen

    Pages 95-128

Buy this book

eBook $139.00
price for USA (gross)
  • ISBN 978-3-642-32375-1
  • Digitally watermarked, DRM-free
  • Included format: PDF, EPUB
  • ebooks can be used on all reading devices
  • Immediate eBook download after purchase
Hardcover $179.00
price for USA
  • ISBN 978-3-642-32374-4
  • Free shipping for individuals worldwide
  • Usually dispatched within 3 to 5 business days.
Loading...

Recommended for you

Loading...

Bibliographic Information

Bibliographic Information
Book Title
Intrinsically Motivated Learning in Natural and Artificial Systems
Editors
  • Gianluca Baldassarre
  • Marco Mirolli
Copyright
2013
Publisher
Springer-Verlag Berlin Heidelberg
Copyright Holder
Springer-Verlag Berlin Heidelberg
eBook ISBN
978-3-642-32375-1
DOI
10.1007/978-3-642-32375-1
Hardcover ISBN
978-3-642-32374-4
Edition Number
1
Number of Pages
VII, 458
Number of Illustrations and Tables
27 b/w illustrations, 55 illustrations in colour
Topics