Skip to main content
  • Book
  • © 2006

SmartKom: Foundations of Multimodal Dialogue Systems

  • Provides a detailed description of the salient characteristics of SmartKom:
  • Seamless integration and mutual disambiguation of multimodal input and output on semantic and pragmatic levels
  • Situated understanding of possibly imprecise, ambiguous, or incomplete multimodal input
  • Context-sensitive interpretation of dialog interaction on the basis of dynamic discourse and context models
  • Adaptive generation of coordinated, cohesive, and coherent multimodal presentations
  • Semi- or fully automatic completion of user-delegated tasks through the integration of information services
  • Intuitive personification of the system through a presentation agent
  • Includes supplementary material: sn.pub/extras

Part of the book series: Cognitive Technologies (COGTECH)

Buy it now

Buying options

eBook USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Other ways to access

This is a preview of subscription content, log in via an institution to check for access.

Table of contents (38 chapters)

  1. Front Matter

    Pages I-XVIII
  2. Introduction

    1. Front Matter

      Pages 1-1
    2. An Exemplary Interaction with SmartKom

      • Norbert Reithinger, Gerd Herzog
      Pages 41-52
  3. Multimodal Input Analysis

    1. Front Matter

      Pages 53-53
    2. Modeling Domain Knowledge: Know-How and Know-What

      • Iryna Gurevych, Robert Porzel, Rainer Malaka
      Pages 71-84
    3. Speech Recognition

      • André Berton, Alfred Kaltenmeier, Udo Haiber, Olaf Schreiner
      Pages 85-107
    4. Class-Based Language Model Adaptation

      • Martin C. Emele, Zica Valsan, Yin Hay Lam, Silke Goronzy
      Pages 109-121
    5. The Dynamic Lexicon

      • Silke Goronzy, Stefan Rapp, Martin Emele
      Pages 123-138
    6. The Prosody Module

      • Viktor Zeißler, Johann Adelhardt, Anton Batliner, Carmen Frank, Elmar Nöth, Rui Ping Shi et al.
      Pages 139-152
    7. The Sense of Vision: Gestures and Real Objects

      • Jens Racky, Michael Lützeler, Hans Röttger
      Pages 153-165
    8. The Facial Expression Module

      • Carmen Frank, Johann Adelhardt, Anton Batliner, Elmar Nöth, Rui Ping Shi, Viktor Zeißler et al.
      Pages 167-180
    9. Multiple Biometrics

      • Stephan Grashey, Matthias Schuster
      Pages 181-193
    10. Natural Language Understanding

      • Ralf Engel
      Pages 195-207
    11. The Gesture Interpretation Module

      • Rui Ping Shi, Johann Adelhardt, Anton Batliner, Carmen Frank, Elmar Nöth, Viktor Zeißler et al.
      Pages 209-219
  4. Multimodal Dialogue Processing

    1. Front Matter

      Pages 221-221
    2. Modality Fusion

      • Ralf Engel, Norbert Pfleger
      Pages 223-235
    3. Discourse Modeling

      • Jan Alexandersson, Norbert Pfleger
      Pages 237-253

Reviews

From the reviews:

"The book is organized into six parts, each of which contains several chapters. … This book should be useful for many types of readers. Those who want to get a sense of the state of the art of multimodal communication … will find it invaluable. Students who have had a good grounding in artificial intelligence or natural language processing should read the book to get an overview of how the techniques from these fields can be integrated into a comprehensive system." (J. P. E. Hodgson, ACM Computing Reviews, Vol. 49 (4), April, 2008)

Editors and Affiliations

  • German Research Center for AI, DFKI GmbH, Saarbrücken, Germany

    Wolfgang Wahlster

About the editor

Prof. Dr. Dr. h.c. mult. Wolfgang Wahlster is the Director and CEO of the German Research Center for Artificial Intelligence (DFKI GmbH) and a Professor of Computer Science at the Universität des Saarlandes, Saarbrücken. In 2000, he was coopted as a Professor of Computational Linguistics at the same university. In addition, he is the Head of the Intelligent User Interfaces Lab at DFKI.

He was the Scientific Director of the Verbmobil consortium on spontaneous speech translation (1993-2000), the SmartKom consortium on multimodal dialog systems (1999-2003), and the SmartWeb consortium on mobile multimodal access to semantic web services (2004-2008).

He has authored more than 150 technical papers and 6 books on language technology and intelligent user interfaces, and edited many books, among them the Springer titles "Verbmobil: Foundations of Speech-to-Speech Translation", "SmartKom: Foundations of Multimodal Dialogue Systems", and "SemProM: Foundations of Semantic Product Memories for the Internet of Things". His research includes multimodal and perceptive user interfaces, user modeling, embodied conversational agents, smart navigation systems, semantic web services, and resource-adaptive cognitive technologies.

He was awarded the Deutscher Zukunftspreis (German Future Award) in 2001 and he received the Federal Cross of Merit, First Class, the Officer's Cross of the Order of Merit of the Federal Republic of Germany in 2006.

He is the Chief Academic Advisor for Information and Communication Technologies (ICT) in the Research Union of the German Government, he is a member or chair of many key international scientific advisory and governance boards, including the National Institute of Informatics (NII) of Japan, the jury for the European ICT Prize of the European Commission, the SingaporeAgency for Science, Technology and Research, the SAP Next Business & Technology Advisory Board, the Center for Advanced Security Research in Darmstadt, the Intel Visual Computing Institute, the Fondazione Bruno Kessler, and the Future Internet Public-Private Partnership of the European Commission.

He is a member of many academies, including the German Academy of Sciences and Literature, Mainz, the Royal Swedish Academy of Sciences, Stockholm, the German Academy of Natural Scientists Leopoldina, Acatech, the Council for Engineering Sciences of the Union of German Academies of Science and Humanities, and the Berlin-Brandenburg Academy of Sciences and Humanities.

He has chaired and given invited talks at the key international conferences in computational linguistics and artificial intelligence, he is a board member of the key AI journals, and he is a Fellow of the Association for the Advancement of Artificial Intelligence (AAAI), the European Coordinating Committee for Artificial Intelligence (ECCAI), and the Gesellschaft für Informatik (GI).

Bibliographic Information

Buy it now

Buying options

eBook USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Other ways to access