Skip to main content
SpringerLink
Log in
Book cover

Advances in Natural Multimodal Dialogue Systems

  • Book
  • © 2005

Overview

Editors:
  1. Jan C. J. Kuppevelt

    1. Waalre, The Netherlands

    View editor publications

    You can also search for this editor in PubMed   Google Scholar

  2. Laila Dybkjær

    1. University of Southern Denmark, Odense, Denmark

    View editor publications

    You can also search for this editor in PubMed   Google Scholar

  3. Niels Ole Bernsen

    1. University of Southern Denmark, Odense, Denmark

    View editor publications

    You can also search for this editor in PubMed   Google Scholar

  • Brings together a great many contributions regarding aspects of natural and multimodal interaction written by many of the important actors in the field
  • A timely update of Multimodality in Language and Speech Systems by Björn Granström, David House and Inger Karlsson and, at the same time, it presents a much broader overview of the field
  • Its 17 chapters provide a broad and detailed impression of where the fairly new field of natural and multimodal interactivity engineering stands today

Part of the book series: Text, Speech and Language Technology (TLTB, volume 30)

This is a preview of subscription content, log in via an institution to check access.

Access this book

Log in via an institution
eBook USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Other ways to access

Licence this eBook for your library

Institutional subscriptions

Table of contents (16 chapters)

  1. Front Matter

    Pages i-xii
    Download chapter PDF

  2. Natural and Multimodal Interactivity Engineering - Directions and Needs

    1. Natural and Multimodal Interactivity Engineering - Directions and Needs

      • Niels Ole Bernsen, Laila Dybkjær
      Pages 1-19

  3. Making Dialogues More Natural: Empirical Work and Applied Theory

    1. Front Matter

      Pages 21-21
      Download chapter PDF

    2. Social Dialongue with Embodied Conversational Agents

      • Timothy Bickmore, Justine Cassell
      Pages 23-54

    3. A First Experiment in Engagement for Human-Robot Interaction in Hosting Activities

      • Candace L. Sidner, Myroslava Dzikovska
      Pages 55-76

  4. Annotation and Analysis of Multimodal Data: Speech and Gesture

    1. Front Matter

      Pages 77-77
      Download chapter PDF

    2. Form

      • Craig H. Martell
      Pages 79-95

    3. On the Relationships Among Speech, Gestures, and Object Manipulation in Virtual Environments: Initial Evidence

      • Andrea Corradini, Philip R. Cohen
      Pages 97-112

    4. Analysing Multimodal Communication

      • Patrick G. T. Healey, Marcus Colman, Mike Thirlwell
      Pages 113-129

    5. Do Oral Messages Help Visual Search?

      • Noëlle Carbonell, Suzanne Kieffer
      Pages 131-157

    6. Geometric and Statistical Approaches to Audiovisual Segmentation

      • Trevor Darrell, John W. Fisher III, Kevin W. Wilson, Michael R. Siracusa
      Pages 159-180

  5. Animated Talking Heads and Evaluation

    1. Front Matter

      Pages 181-181
      Download chapter PDF

    2. The Psychology and Technology of Talking Heads: Applications in Language Learning

      • Dominic W. Massaro
      Pages 183-214

    3. Effective Interaction with Talking Animated Agents an Dialogue Systems

      • Björn Granström, David House
      Pages 215-243

    4. Controlling the Gaze of Conversational Agents

      • Dirk Heylen, Ivo van Es, Anton Nijholt, Betsy van Dijk
      Pages 245-262

  6. Architectures and Technologies for Advanced and Adaptive Multimodal Dialogue Systems

    1. Front Matter

      Pages 263-263
      Download chapter PDF

    2. Mind: A Context-Based Multimodal Interpretation Framework in Conversational Systems

      • Joyce Y. Chai, Shimei Pan, Michelle X. Zhou
      Pages 265-285

    3. A General Purpose Architecture for Intelligent Tutoring Systems

      • Brady Clark, Oliver Lemon, Alexander Gruenstein, Elizabeth Owen Bratt, John Fry, Stanley Peters et al.
      Pages 287-305

    4. Miamm — A Multimodal Dialogue System Using Haptics

      • Norbert Reithinger, Dirk Fedeler, Ashwani Kumar, Christoph Lauer, Elsa Pecourt, Laurent Romary
      Pages 307-332

    5. Adaptive Human-Computer Dialogue

      • Sorin Dusan, James Flanagan
      Pages 333-354
Back to top

Keywords

About this book

References 74 Part II Annotation and Analysis of Multimodal Data: Speech and Gesture 4 FORM 79 Craig H. Martell 1. Introduction 79 2. Structure of FORM 80 3. Annotation Graphs 85 4. Annotation Example 86 5. Preliminary Inter-Annotator Agreement Results 88 6. Conclusion: Applications to HLT and HCI? 90 Appendix: Other Tools, Schemes and Methods of Gesture Analysis 91 References 95 5 97 On the Relationships among Speech, Gestures, and Object Manipulation in Virtual Environments: Initial Evidence Andrea Corradini and Philip R. Cohen 1. Introduction 97 2. Study 99 3. Data Analysis 101 4. Results 103 5. Discussion 106 6. Related Work 106 7. Future Work 108 8. Conclusions 108 Appendix: Questionnaire MYST III - EXILE 110 References 111 6 113 Analysing Multimodal Communication Patrick G. T. Healey, Marcus Colman and Mike Thirlwell 1. Introduction 113 2. Breakdown and Repair 117 3. Analysing Communicative Co-ordination 125 4. Discussion 126 References 127 7 131 Do Oral Messages Help Visual Search? Noëlle Carbonell and Suzanne Kieffer 1. Context and Motivation 131 2. Methodology and Experimental Set-Up 134 3. Results: Presentation and Discussion 141 4. Conclusion 153 References 154 Contents vii 8 159 Geometric and Statistical Approaches to Audiovisual Segmentation Trevor Darrell, John W. Fisher III, Kevin W. Wilson, and Michael R. Siracusa 1. Introduction 159 2. Related Work 160 3. Multimodal Multisensor Domain 162 4. Results 166 5. Single Multimodal Sensor Domain 167 6.

Editors and Affiliations

  • Waalre, The Netherlands

    Jan C. J. Kuppevelt

  • University of Southern Denmark, Odense, Denmark

    Laila Dybkjær, Niels Ole Bernsen

Bibliographic Information

Publish with us

Policies and ethics

Back to top

Search

Navigation