Towards Autonomous, Adaptive, and Context-Aware Multimodal Interfaces: Theoretical and Practical Issues

1. Front Matter

   PDF

2. Human-Computer Interaction: Cognitive and Computational Issues

   1. Interaction and Resistance: The Recognition of Intentions in New Human-Computer Interaction

      • Vincent C. Müller

      Pages 1-7

   2. Speaking without Thinking: Embodiment, Speech Technology and Social Signal Processing

      • Tim Rohrer

      Pages 8-22

   3. More Than Words: Inference of Socially Relevant Information from Nonverbal Vocal Cues in Speech

      • Alessandro Vinciarelli, Hugues Salamin, Gelareh Mohammadi, Khiet Truong

      Pages 23-33

   4. A Timely Endeavor: Theoretical, Behavioral, Bioimaging, and Clinical Perspectives on Time Perception

      • Argiro Vatakis, Georgios Papadelis

      Pages 34-38

   5. Instruction and Belief Effects on Sentential Reasoning

      • Olimpia Matarazzo, Ivana Baldassarre

      Pages 39-54

   6. Audio-Visual Prosody: Perception, Detection, and Synthesis of Prominence

      • Samer Al Moubayed, Jonas Beskow, Björn Granström, David House

      Pages 55-71

   7. Adaptation in Turn-Initiations

      • Štefan Beňuš

      Pages 72-80

   8. Sentic Avatar: Multimodal Affective Conversational Agent with Common Sense

      • Erik Cambria, Isabelle Hupont, Amir Hussain, Eva Cerezo, Sandra Baldassarri

      Pages 81-95

   9. Patterns of Synchronization of Non-verbal Cues and Speech in ECAs: Towards a More “Natural” Conversational Agent

      • Nicla Rossini

      Pages 96-103

   10. Top-Down Influences on Eye-Movements during Painting Perception: The Effect of Task and Titles

       • Evgenia Hristova, Severina Georgieva, Maurice Grinberg

       Pages 104-115

   11. Visual Sociology in the Classroom: Fostering Interaction Awareness Using Video

       • Paolo Parmeggiani

       Pages 116-133

   12. Analysis of Interrogatives in Different Domains

       • Helena Moniz, Fernando Batista, Isabel Trancoso, Ana Isabel Mata

       Pages 134-146

   13. Interviewers’ Use of Coercive Questioning during a Midterm Period Favorable to the Opposition Party

       • Angiola Di Conza, Augusto Gnisci, Angelo Caputo

       Pages 147-154

   14. Emotions and Speech Disorders: Do Developmental Stutters Recognize Emotional Vocal Expressions?

       • Anna Esposito, Alda Troncone

       Pages 155-164

   15. Representing Meaning in Mind: When Predicate Argument Structures Meet Mental Representations

       • Rosa Volpe

       Pages 165-179

   16. Beyond the Panopticon Framework: Privacy, Control and User Generated Content

       • Manuela Farinosi

       Pages 180-189

   17. Micro and Macro Spatial Dimensions of New Media in Five European Countries

       • Leopoldina Fortunati, Federico de Luca

       Pages 190-206

   18. Nonverbal Expressions of Turn Management in TV Interviews: A Cross-Cultural Study between Greek and Icelandic

       • Maria Koutsombogera, Sigrún María Ammendrup, Hannes Högni Vilhjálmsson, Harris Papageorgiou

       Pages 207-213

3. Synchrony through Verbal and Nonverbal Signals

   1. Interpretation and Generation of Dialogue with Multidimensional Context Models

      • Harry Bunt

      Pages 214-242

This volume brings together the advanced research results obtained by the European COST Action 2102: "Cross Modal Analysis of Verbal and Nonverbal Communication". The research published in this book was discussed at the 3rd jointly EUCOGII-COST 2102 International Training School entitled "Toward Autonomous, Adaptive, and Context-Aware Multimodal Interfaces: Theoretical and Practical Issues ", held in Caserta, Italy, on March 15-19, 2010. The book is arranged into two scientific sections. The 18 revised papers of the first section, "Human-Computer Interaction: Cognitive and Computational Issues", deal with conjectural and processing issues of defining models, algorithms, and strategies for implementing cognitive behavioural systems. The second section, "Synchrony through Verbal and Nonverbal Signals", presents 21 revised lectures that provide theoretical and practical solutions to the modelling of timing synchronization between linguistic and paralinguistic expressions, actions, body movements, activities in human interaction and on their assistance for an effective communication.

• AI
• EEG
• NLP
• affective UI
• clustering
• cognitive systems
• context modeling
• converzational agents
• coordination
• dialogue semantics
• dynamical systems
• embodied conversational agents
• emotion recognition
• entrainment
• facial expressions
• gesture-speech synchronization
• human-computer interaction
• identification
• intelligence
• interaction
• interfaces
• multimodality
• neuroscience
• ontology
• pattern completion
• privacy
• prosody
• semantic Web
• social media
• spatial dimensions
• speech recognition
• spellchecking
• systems design
• telephone speech
• temporal processing
• text normalization
• time perception
• video-analysis
• videoconferencing

• Institute for Advanced Scientific Studies, Second University of Naples, and IIASS, Vietri sul Mare (SA), Italy

  Anna Esposito

• Istituto Nazionale di Geofisica e Vulcanologia, Osservatorio Vesuviano, Napoli, Italy

  Antonietta M. Esposito

• Dipartemento di Ingegneria dell’ Informazione, Seconda Università di Napoli, Aversa (CE), Italy

  Raffaele Martone

• Department of Humanities and Social Sciences, Anatolia College/ACT, Pylaia, Greece

  Vincent C. Müller

• Departmnet of Physics "E.R. Caoamoeööp", University of Salerno and IIASS, International Institute for Advanced Scientific Studies, Baronissi (SA), Italy

  Gaetano Scarpetta

Policies and ethics