Anticipatory Behavior in Adaptive Learning Systems

1. Front Matter

   PDF

2. Introduction

   1. Anticipations, Brains, Individual and Social Behavior: An Introduction to Anticipatory Systems

      • Martin V. Butz, Olivier Sigaud, Giovanni Pezzulo, Gianluca Baldassarre

      Pages 1-18

3. Anticipatory Aspects in Brains, Language, and Cognition

   1. Neural Correlates of Anticipation in Cerebellum, Basal Ganglia, and Hippocampus

      • Jason G. Fleischer

      Pages 19-34

   2. The Role of Anticipation in the Emergence of Language

      • Samarth Swarup, Les Gasser

      Pages 35-56

   3. Superstition in the Machine

      • Alexander Riegler

      Pages 57-72

4. Individual Anticipatory Frameworks

   1. From Actions to Goals and Vice-Versa: Theoretical Analysis and Models of the Ideomotor Principle and TOTE

      • Giovanni Pezzulo, Gianluca Baldassarre, Martin V. Butz, Cristiano Castelfranchi, Joachim Hoffmann

      Pages 73-93

   2. Project “Animat Brain”: Designing the Animat Control System on the Basis of the Functional Systems Theory

      • Vladimir G. Red’ko, Konstantin V. Anokhin, Mikhail S. Burtsev, Alexander I. Manolov, Oleg P. Mosalov, Valentin A. Nepomnyashchikh et al.

      Pages 94-107

   3. Cognitively Inspired Anticipatory Adaptation and Associated Learning Mechanisms for Autonomous Agents

      • Aregahegn Negatu, Sidney D’Mello, Stan Franklin

      Pages 108-127

   4. Schema-Based Design and the AKIRA Schema Language: An Overview

      • Giovanni Pezzulo, Gianguglielmo Calvi

      Pages 128-152

5. Learning Predictions and Anticipations

   1. Training and Application of a Visual Forward Model for a Robot Camera Head

      • Wolfram Schenck, Ralf Möller

      Pages 153-169

   2. A Distributed Computational Model of Spatial Memory Anticipation During a Visual Search Task

      • Jérémy Fix, Julien Vitay, Nicolas P. Rougier

      Pages 170-188

   3. A Testbed for Neural-Network Models Capable of Integrating Information in Time

      • Stefano Zappacosta, Stefano Nolfi, Gianluca Baldassarre

      Pages 189-217

   4. Construction of an Internal Predictive Model by Event Anticipation

      • Philippe Capdepuy, Daniel Polani, Chrystopher L. Nehaniv

      Pages 218-232

6. Anticipatory Individual Behavior

   1. The Interplay of Analogy-Making with Active Vision and Motor Control in Anticipatory Robots

      • Kiril Kiryazov, Georgi Petkov, Maurice Grinberg, Boicho Kokinov, Christian Balkenius

      Pages 233-253

   2. An Intrinsic Neuromodulation Model for Realizing Anticipatory Behavior in Reaching Movement under Unexperienced Force Fields

      • Toshiyuki Kondo, Koji Ito

      Pages 254-266

   3. Anticipating Rewards in Continuous Time and Space: A Case Study in Developmental Robotics

      • Arnaud J. Blanchard, Lola Cañamero

      Pages 267-284

   4. Anticipatory Model of Musical Style Imitation Using Collaborative and Competitive Reinforcement Learning

      • Arshia Cont, Shlomo Dubnov, Gérard Assayag

      Pages 285-306

7. Anticipatory Social Behavior

   1. An Anticipatory Trust Model for Open Distributed Systems

      • Mario Gómez, Javier Carbó, Clara Benac-Earle

      Pages 307-324

   2. Anticipatory Alignment Mechanisms for Behavioral Learning in Multi Agent Systems

      • Gerben G. Meyer, Nick B. Szirbik

      Pages 325-344

   3. Backward vs. Forward-Oriented Decision Making in the Iterated Prisoner’s Dilemma: A Comparison Between Two Connectionist Models

      • Emilian Lalev, Maurice Grinberg

      Pages 345-364

Anticipatory behavior in adaptive learning systems is steadily gaining the - terest of scientists, although many researchers still do not explicitly consider the actual anticipatory capabilities of their systems. Similarly to the previous two workshops, the third workshop on anticipatory behavior in adaptive lea- ing systems (ABiALS 2006) has shown yet again that the similarities between di?erent anticipatory mechanisms in diverse cognitive systems are striking. The discussions and presentations on the workshop day of September 30th, 2006, during the Simulation of Adaptive Behavior Conference (SAB 2006), con?rmed that the investigations into anticipatory cognitive mechanisms for behavior and learning strongly overlap among researchers from various disciplines, including the whole interdisciplinary cognitive science area. Thus, further conceptualizations of anticipatory mechanisms seem man- tory. The introductory chapter of this volume therefore does not only provide an overview of the contributions included in this volume but also proposes a taxonomy of how anticipatory mechanisms can improve adaptive behavior and learning in cognitive systems. During the workshop it became clear that ant- ipations are involved in various cognitive processes that range from individual anticipatory mechanisms to social anticipatory behavior. This book re?ects this structure by ?rst providing neuroscienti?c as well as psychological evidence for anticipatorymechanismsinvolvedinbehavior,learning,language,andcognition. Next,individualpredictivecapabilitiesandanticipatorybehaviorcapabilitiesare investigated. Finally, anticipation relevant in social interaction is studied.

• Animat control system
• Navigation
• adaptive learning
• alife
• anticipation
• artificial life
• autonomous agents
• cognitive modeling
• collective behavior
• decision-making
• evolutionary computation
• learning
• robot
• robotics
• trust
• algorithm analysis and problem complexity

Policies and ethics