Affective Dialogue Systems

1. Front Matter

   PDF

2. Emotion Recognition

   1. From Emotion to Interaction: Lessons from Real Human-Machine-Dialogues

      • Anton Batliner, Christian Hacker, Stefan Steidl, Elmar Nöth, Jürgen Haas

      Pages 1-12

   2. Emotions in Short Vowel Segments: Effects of the Glottal Flow as Reflected by the Normalized Amplitude Quotient

      • Matti Airas, Paavo Alku

      Pages 13-24

   3. Towards Real Life Applications in Emotion Recognition

      • Daniel Küstner, Raquel Tato, Thomas Kemp, Beate Meffert

      Pages 25-35

   4. Emotion Recognition Using Bio-sensors: First Steps towards an Automatic System

      • Andreas Haag, Silke Goronzy, Peter Schaich, Jason Williams

      Pages 36-48

   5. Neural Architecture for Temporal Emotion Classification

      • Roland Schweiger, Pierre Bayerl, Heiko Neumann

      Pages 49-52

3. Affective User Modeling

   1. Empathic Embodied Interfaces: Addressing Users’ Affective State

      • H. Prendinger, H. Dohi, H. Wang, S. Mayer, M. Ishizuka

      Pages 53-64

   2. Cognitive-Model-Based Interpretation of Emotions in a Multi-modal Dialog System

      • Michael Streit, Anton Batliner, Thomas Portele

      Pages 65-76

   3. Affective Advice Giving Dialogs

      • Addolorata Cavalluzzi, Valeria Carofiglio, Fiorella de Rosis

      Pages 77-88

4. Emotional Databases, Annotation Schemes, and Tools

   1. A Categorical Annotation Scheme for Emotion in the Linguistic Content of Dialogue

      • Richard Craggs, Mary McGee Wood

      Pages 89-100

   2. Data-Driven Tools for Designing Talking Heads Exploiting Emotional Attitudes

      • Piero Cosi, Andrea Fusaro, Daniele Grigoletto, Graziano Tisato

      Pages 101-112

   3. Design of a Hungarian Emotional Database for Speech Analysis and Synthesis

      • Márk Fék, Géza Németh, Gábor Olaszy, Géza Gordos

      Pages 113-116

5. Affective Conversational Agents and Dialogue Simulation

   1. Emotion and Dialogue in the MRE Virtual Humans

      • David Traum, Stacy Marsella, Jonathan Gratch

      Pages 117-127

   2. Coloring Multi-character Conversations through the Expression of Emotions

      • Patrick Gebhard, Martin Klesen, Thomas Rist

      Pages 128-141

   3. Domain-Oriented Conversation with H.C. Andersen

      • Niels Ole Bernsen, Laila Dybkjær

      Pages 142-153

   4. Simulating the Emotion Dynamics of a Multimodal Conversational Agent

      • Christian Becker, Stefan Kopp, Ipke Wachsmuth

      Pages 154-165

   5. Design and First Tests of a Chatter

      • Hans Dybkjær, Laila Dybkjær

      Pages 166-177

   6. Endowing Spoken Language Dialogue Systems with Emotional Intelligence

      • Elisabeth André, Matthias Rehm, Wolfgang Minker, Dirk Bühler

      Pages 178-187

   7. Do You Want to Talk About It?

      • T. J. Muller, A. Hartholt, S. Marsella, J. Gratch, D. Traum

      Pages 188-192

   8. Application of D-Script Model to Emotional Dialogue Simulation

      • Artemy Kotov

      Pages 193-196

Human conversational partners are able, at least to a certain extent, to detect the speaker’s or listener’s emotional state and may attempt to respond to it accordingly. When instead one of the interlocutors is a computer a number of questions arise, such as the following: To what extent are dialogue systems able to simulate such behaviors? Can we learn the mechanisms of emotional be- viors from observing and analyzing the behavior of human speakers? How can emotionsbeautomaticallyrecognizedfromauser’smimics,gesturesandspeech? What possibilities does a dialogue system have to express emotions itself? And, very importantly, would emotional system behavior be desirable at all? Given the state of ongoing research into incorporating emotions in dialogue systems we found it timely to organize a Tutorial and Research Workshop on A?ectiveDialogueSystems(ADS2004)atKlosterIrseein GermanyduringJune 14–16, 2004. After two successful ISCA Tutorial and Research Workshops on Multimodal Dialogue Systems at the same location in 1999 and 2002, we felt that a workshop focusing on the role of a?ect in dialogue would be a valuable continuation of the workshop series. Due to its interdisciplinary nature, the workshop attracted submissions from researchers with very di?erent backgrounds and from many di?erent research areas, working on, for example, dialogue processing, speech recognition, speech synthesis, embodied conversational agents, computer graphics, animation, user modelling, tutoring systems, cognitive systems, and human-computer inter- tion.

• affective computing
• affective dialogue systems
• animation
• computer graphics
• databases
• dialogue processing
• embodied conversational agents
• emotional behavior
• gestures
• mimics
• multimodal dialogue systems
• speech recognition
• speech synthesis
• tools
• user modeling

• University of Augsburg, Germany

  Elisabeth André

• Prolog Development Center A/S (PDC), Brøndby, Denmark

  Laila Dybkjær

• Department of Information Technology, University of Ulm, Ulm, Germany

  Wolfgang Minker

• DaimlerChrysler AG, Dialog Systems, Ulm, Germany

  Paul Heisterkamp

Policies and ethics