Overview
- Presents an experimental procedure to collect data about the users’ judgment behavior
- Examines how automatic evaluation methods can be applied to Spoken Dialog Systems
- Introduces a system design environment
- Includes supplementary material: sn.pub/extras
Part of the book series: T-Labs Series in Telecommunication Services (TLABS)
Access this book
Tax calculation will be finalised at checkout
Other ways to access
Table of contents (7 chapters)
-
Front Matter
-
Back Matter
Keywords
About this book
Spoken dialog systems have the potential to offer highly intuitive user interfaces, as they allow systems to be controlled using natural language. However, the complexity inherent in natural language dialogs means that careful testing of the system must be carried out from the very beginning of the design process. Â Â This book examines how user models can be used to support such early evaluations in two ways: Â by running simulations of dialogs, and by estimating the quality judgments of users. First, a design environment supporting the creation of dialog flows, the simulation of dialogs, and the analysis of the simulated data is proposed. Â How the quality of user simulations may be quantified with respect to their suitability for both formative and summative evaluation is then discussed. The remainder of the book is dedicated to the problem of predicting quality judgments of users based on interaction data. New modeling approaches are presented, which process the dialogs as sequences, and which allow knowledge about the judgment behavior of users to be incorporated into predictions. All proposed methods are validated with example evaluation studies.
Authors and Affiliations
Bibliographic Information
Book Title: Estimating Spoken Dialog System Quality with User Models
Authors: Klaus-Peter Engelbrecht
Series Title: T-Labs Series in Telecommunication Services
DOI: https://doi.org/10.1007/978-3-642-31591-6
Publisher: Springer Berlin, Heidelberg
eBook Packages: Engineering, Engineering (R0)
Copyright Information: Springer-Verlag Berlin Heidelberg 2013
Hardcover ISBN: 978-3-642-31590-9Published: 04 August 2012
Softcover ISBN: 978-3-642-43191-3Published: 20 September 2014
eBook ISBN: 978-3-642-31591-6Published: 04 August 2012
Series ISSN: 2192-2810
Series E-ISSN: 2192-2829
Edition Number: 1
Number of Pages: XIV, 130
Topics: Signal, Image and Speech Processing, User Interfaces and Human Computer Interaction, Engineering Acoustics, Communications Engineering, Networks