Skip to main content
  • Book
  • © 2017

Multimodal Interaction with W3C Standards

Toward Natural User Interfaces to Everything

Editors:

  • Comprehensive resource that explains the W3C standards for multimodal interaction clear and straightforward way
  • Includes case studies of the use of the standards on a wide variety of devices, including mobile devices, tablets, wearables and robots, in applications such as assisted living, language learning, and health care
  • Features illustrative examples of implementations that use the standards, to help spark innovative ideas for future applications
  • Includes supplementary material: sn.pub/extras

Buy it now

Buying options

eBook USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Other ways to access

This is a preview of subscription content, log in via an institution to check for access.

Table of contents (19 chapters)

  1. Front Matter

    Pages i-xxix
  2. Standards

    1. Front Matter

      Pages 1-1
    2. The Role and Importance of Speech Standards

      • Paolo Baggia, Daniel C. Burnett, Rob Marchand, Val Matula
      Pages 19-36
    3. EmotionML

      • Felix Burkhardt, Catherine Pelachaud, Björn W. Schuller, Enrico Zovato
      Pages 65-80
    4. Introduction to SCXML

      • Jim Barnett
      Pages 81-107
    5. Dialogue Act Annotation with the ISO 24617-2 Standard

      • Harry Bunt, Volha Petukhova, David Traum, Jan Alexandersson
      Pages 109-135
    6. Six-Layered Model for Multimodal Interaction Systems

      • Kouichi Katsurada, Tsuneo Nitta, Masahiro Araki, Kazuyuki Ashimura
      Pages 137-153
    7. WebRTC: Handling Media on the Web

      • Daniel C. Burnett
      Pages 155-169
  3. Implementations

    1. Front Matter

      Pages 171-171
    2. SCXML on Resource Constrained Devices

      • Stefan Radomski, Jens Heuschkel, Dirk Schnelle-Walka, Max Mühlhäuser
      Pages 213-255
    3. Standard Portals for Intelligent Services

      • Deborah A. Dahl
      Pages 257-269
    4. Applications of the Multimodal Interaction Architecture in Ambient Assisted Living

      • António Teixeira, Nuno Almeida, Carlos Pereira, Miguel Oliveira e Silva, Diogo Vieira, Samuel Silva
      Pages 271-291
  4. Applications

    1. Front Matter

      Pages 293-293
    2. Assembling the Jigsaw: How Multiple Open Standards Are Synergistically Combined in the HALEF Multimodal Dialog System

      • Vikram Ramanarayanan, David Suendermann-Oeft, Patrick Lange, Robert Mundkowsky, Alexei V. Ivanov, Zhou Yu et al.
      Pages 295-310
  5. Future Directions

    1. Front Matter

      Pages 323-323
    2. Discovery and Registration: Finding and Integrating Components into Dynamic Systems

      • B. Helena Rodríguez, Jean-Claude Moissinac
      Pages 325-349

About this book

This book presents new standards for multimodal interaction published by the W3C and other standards bodies in straightforward and accessible language, while also illustrating the standards in operation through case studies and chapters on innovative implementations. The book illustrates how, as smart technology becomes ubiquitous, and appears in more and more different shapes and sizes, vendor-specific approaches to multimodal interaction become impractical, motivating the need for standards. This book covers standards for voice, emotion, natural language understanding, dialog, and multimodal architectures. The book describes the standards in a practical manner, making them accessible to developers, students, and researchers.

  • Comprehensive resource that explains the W3C standards for multimodal interaction clear and straightforward way;
  • Includes case studies of the use of the standards on a wide variety of devices, including mobile devices, tablets, wearables and robots, in applications such as assisted living, language learning, and health care;
  • Features illustrative examples of implementations that use the standards, to help spark innovative ideas for future applications.

Reviews

“This 341-page book provides relatively comprehensive coverage of programming language concepts, a core topic in the ACM model computer science curriculum and a required topic for ABET accreditation of a computer science program. As such the book is appropriately aimed at senior students in an undergraduate curriculum.” (Michael Oudshoorn, Computing Reviews, February, 2018)​

Editors and Affiliations

  • Conversational Technologies, Plymouth Meeting, USA

    Deborah A. Dahl

About the editor

Dr. Deborah Dahl has over 20 years of experience in speech and natural language technologies, including working on research, defense, and commercial systems. She is also active in speech and multimodal standards activities in the World Wide Web Consortium, serving as Chair of the Multimodal Interaction Working Group and Co-Chair of the Hypertext Coordination Group. She is an editor of the EMMA (Extensible MultiModal Annotation specification). Dr. Dahl received the prestigious "Speech Luminary" award from Speech Technology Magazine, in 2012 and 2014.

Bibliographic Information

Buy it now

Buying options

eBook USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Other ways to access