Spoken Multimodal Human-Computer Dialogue in Mobile Environments

1. Front Matter

   Pages i-xxviii

   PDF

2. Issues in Multimodal Spoken Dialogue Systems and Components

   1. Multimodal Dialogue Systems

      • Alexander I. Rudnicky

      Pages 3-11

   2. Speech Recognition Technology in Multimodal/Ubiquitous Computing Environments

      • Sadaoki Furui

      Pages 13-36

   3. A Robust Multimodal Speech Recognition Method using Optical Flow Analysis

      • Satoshi Tamura, Koji Iwano, Sadaoki Furui

      Pages 37-53

   4. Feature Functions for Tree-Based Dialogue Course Management

      • Klaus Macherey, Hermann Ney

      Pages 55-76

   5. A Reasoning Component for Information-Seeking and Planning Dialogues

      • Dirk Bühler, Wolfgang Minker

      Pages 77-91

   6. A Model for Multimodal Dialogue System Output Applied to an Animated Talking Head

      • Jonas Beskow, Jens Edlund, Magnus Nordstrand

      Pages 93-113

3. System Architecture and Example Implemesntations

   1. Overview of System Architecture

      • Andreas Kellner

      Pages 117-132

   2. XISL: A Modality-Independent MMI Description Language

      • Kouichi Katsurada, Hirobumi Yamada, Yusaku Nakamura, Satoshi Kobayashi, Tsuneo Nitta

      Pages 133-148

   3. A Path to Multimodal Data Services for Telecommunications

      • Georg Niklfeld, Michael Pucher, Robert Finan, Wolfgang Eckhart

      Pages 149-167

   4. Multimodal Spoken Dialogue with Wireless Devices

      • Roberto Pieraccini, Bob Carpentert, Eric Woudenberg, Sasha Caskey, Stephen Springer, Jonathan Bloom et al.

      Pages 169-184

   5. The Smartkom Mobile Car Prototype System for Flexible Human-Machine Communication

      • Dirk Bühler, Wolfgang Minker

      Pages 185-202

   6. LARRI: A Language-Based Maintenance and Repair Assistant

      • Dan Bohus, Alexander I. Rudnicky

      Pages 203-218

4. Evaluation and Usability

   1. Overview of Evaluation and Usability

      • Laila Dybkjær, Niels Ole Bernsen, Wolfgang Minker

      Pages 221-246

   2. Evaluating Dialogue Strategies in Multimodal Dialogue Systems

      • Steve Whittaker, Marilyn Walker

      Pages 247-268

   3. Enhancing the Usability of Multimodal Virtual Co-drivers

      • Niels Ole Bernsen, Laila Dybkjaer

      Pages 269-285

   4. Design, Implementation and Evaluation of the SENECA Spoken Language Dialogue System

      • Wolfgang Minker, Udo Haiber, Paul Heisterkamp, Sven Scheible

      Pages 287-310

   5. Segmenting Route Descriptions for Mobile Devices

      • Sabine Geldof, Robert Dale

      Pages 311-328

   6. Effects of Prolonged Use on the Usability of a Multimodal Form-Filling Interface

      • Janienke Sturm, Bert Cranen, Jacques Terken, Ilse Bakx

      Pages 329-348

   7. User Multitasking with Mobile Multimodal Systems

      • Anthony Jameson, Kerstin Klöckner

      Pages 349-377

This book is based on publications from the ISCA Tutorial and Research Workshop on Multi-Modal Dialogue in Mobile Environments held at Kloster Irsee, Germany, in 2002. The workshop covered various aspects of devel- ment and evaluation of spoken multimodal dialogue systems and components with particular emphasis on mobile environments, and discussed the state-- the-art within this area. On the development side the major aspects addressed include speech recognition, dialogue management, multimodal output gene- tion, system architectures, full applications, and user interface issues. On the evaluation side primarily usability evaluation was addressed. A number of high quality papers from the workshop were selected to form the basis of this book. The volume is divided into three major parts which group together the ov- all aspects covered by the workshop. The selected papers have all been - tended, reviewed and improved after the workshop to form the backbone of the book. In addition, we have supplemented each of the three parts by an invited contribution intended to serve as an overview chapter.

• Augmented Reality
• Design
• Segment
• Usability
• human-computer interaction (HCI)
• speech recognition
• spoken dialogue system

• University of Ulm, Germany

  W. Minker, Dirk Bühler

• University of Southern Denmark, Odense, Denmark

  Laila Dybkjær

Policies and ethics