Development of Multimodal Interfaces: Active Listening and Synchrony

1. Front Matter

   PDF

2. Spacing and Orientation in Co-present Interaction

   • Adam Kendon

   Pages 1-15

3. Group Cohesion, Cooperation and Synchrony in a Social Model of Language Evolution

   • Carl Vogel

   Pages 16-32

4. Pointing Gestures and Synchronous Communication Management

   • Kristiina Jokinen

   Pages 33-49

5. How an Agent Can Detect and Use Synchrony Parameter of Its Own Interaction with a Human?

   • Ken Prepin, Philippe Gaussier

   Pages 50-65

6. Accessible Speech-Based and Multimodal Media Center Interface for Users with Physical Disabilities

   • Markku Turunen, Jaakko Hakulinen, Aleksi Melto, Juho Hella, Tuuli Laivo, Juha-Pekka Rajaniemi et al.

   Pages 66-79

7. A Controller-Based Animation System for Synchronizing and Realizing Human-Like Conversational Behaviors

   • Aleksandra Čereković, Tomislav Pejša, Igor S. Pandžić

   Pages 80-91

8. Generating Simple Conversations

   • Mark ter Maat, Dirk Heylen

   Pages 92-101

9. Media Differences in Communication

   • Roxanne B. Raine

   Pages 102-112

10. Towards Influencing of the Conversational Agent Mental State in the Task of Active Listening

    • Stanislav Ondáš, Elisabetta Bevacqua, Jozef Juhár, Peter Demeter

    Pages 113-121

11. Integrating Emotions in the TRIPLE ECA Model

    • Kiril Kiryazov, Maurice Grinberg

    Pages 122-133

12. Manipulating Stress and Cognitive Load in Conversational Interactions with a Multimodal System for Crisis Management Support

    • Andreea Niculescu, Yujia Cao, Anton Nijholt

    Pages 134-147

13. Sentic Computing: Exploitation of Common Sense for the Development of Emotion-Sensitive Systems

    • Erik Cambria, Amir Hussain, Catherine Havasi, Chris Eckl

    Pages 148-156

14. Face-to-Face Interaction and the KTH Cooking Show

    • Jonas Beskow, Jens Edlund, Björn Granström, Joakim Gustafson, David House

    Pages 157-168

15. Affect Listeners: Acquisition of Affective States by Means of Conversational Systems

    • Marcin Skowron

    Pages 169-181

16. Nonverbal Synchrony or Random Coincidence? How to Tell the Difference

    • Fabian Ramseyer, Wolfgang Tschacher

    Pages 182-196

17. Biometric Database Acquisition Close to “Real World” Conditions

    • Marcos Faundez-Zanuy, Joan Fàbregas, Miguel Ángel Ferrer-Ballester, Aythami Morales, Javier Ortega-Garcia, Guillermo Gonzalez de Rivera et al.

    Pages 197-206

18. Optimizing Phonetic Encoding for Viennese Unit Selection Speech Synthesis

    • Michael Pucher, Friedrich Neubarth, Volker Strom

    Pages 207-216

19. Advances on the Use of the Foreign Language Recognizer

    • Rytis Maskeliunas, Algimantas Rudzionis, Vytautas Rudzionis

    Pages 217-224

20. Challenges in Speech Processing of Slavic Languages (Case Studies in Speech Recognition of Czech and Slovak)

    • Jan Nouza, Jindrich Zdansky, Petr Cerva, Jan Silovsky

    Pages 225-241

This volume brings together, through a peer-revision process, the advanced research results obtained by the European COST Action 2102: Cross-Modal Analysis of Verbal and Nonverbal Communication, primarily discussed for the first time at the Second COST 2102 International Training School on “Development of Multimodal Int- faces: Active Listening and Synchrony” held in Dublin, Ireland, March 23–27 2009. The school was sponsored by COST (European Cooperation in the Field of Sci- tific and Technical Research, www.cost.esf.org ) in the domain of Information and Communication Technologies (ICT) for disseminating the advances of the research activities developed within the COST Action 2102: “Cross-Modal Analysis of Verbal and Nonverbal Communication” (cost2102.cs.stir.ac.uk) COST Action 2102 in its third year of life brought together about 60 European and 6 overseas scientific laboratories whose aim is to develop interactive dialogue systems and intelligent virtual avatars graphically embodied in a 2D and/or 3D interactive virtual world, capable of interacting intelligently with the environment, other avatars, and particularly with human users.

• Animation
• computer speech processing
• human-machine interaction
• speech recognition
• virtual agents
• virtual reality
• virtual worlds
• visualization

• Second University of Naples, and IIASS, Vietri sul Mare, Italy

  Anna Esposito

• Centre for Language and Communication Studies, Trinity College, The University of Dublin, Dublin 2, Ireland

  Nick Campbell, Carl Vogel

• Department of Computing Science & Mathematics, University of Stirling, Stirling, UK

  Amir Hussain

• Faculty of Electrical Engineering, Mathematics and Computer Science, University of Twente, Enschede, The Netherlands

  Anton Nijholt

Policies and ethics