Multimodal Corpora
From Models of Natural Interaction to Systems and Applications
Editors: Kipp, M., Martin, J.-C., Paggio, P., Heylen, D. (Eds.)
Free PreviewBuy this book
- About this book
-
Empirically based research in multimodality starts with the collection of video data relevant for a specific research question. This data must then be enriched by human coders, who annotate the corpus and who also explore the potential interconnections between modalities (e.g., face, gesture, speech, posture, etc.). The data must then be validated for consistency using quantitative measures -- systematic analysis of the observed multimodal behaviors is the central characteristic of multimodal corpora. For analysis and modeling tasks, exploratory qualitative and quantitative analysis tools are needed for browsing, viewing, extraction, and modeling. At the same time, the intercultural dimension must be taken into account, since multimodal interaction is always embedded in a social setting.
This state-of-the-art survey documents the scientific outcome of the International Workshop on "Multimodal Corpora: From Models of Natural Interaction to Systems and Applications", held in conjunction with the 6th International Conference for Language Resources and Evaluation (LREC), on May 27, 2008, in Marrakech, Morocco. It presents current research from fields as diverse as psychology, artificial intelligence, robotics, signal processing, computational linguistics, and human-computer interaction.
The 6 selected workshop contributions are complemented by 7 invited research articles, including contributions from major international multimodal corpus projects like AMI and SmartWeb. All papers underwent a special review process for this volume, resulting in significant revisions and extensions based on the experts' advice.
- Table of contents (13 chapters)
-
-
The SmartWeb Corpora: Multimodal Access to the Web in Natural Environments
Pages 1-17
-
Promoting free Dialog Video Corpora: The IFADV Corpus Example
Pages 18-37
-
Creating and Exploiting Multimodal Annotated Corpora: The ToMA Project
Pages 38-53
-
Multi-track Annotation of Child Language and Gestures
Pages 54-72
-
Gesture, Gaze and Persuasive Strategies in Political Discourse
Pages 73-92
-
Table of contents (13 chapters)
Recommended for you
Bibliographic Information
- Bibliographic Information
-
- Book Title
- Multimodal Corpora
- Book Subtitle
- From Models of Natural Interaction to Systems and Applications
- Editors
-
- Michael Kipp
- Jean-Claude Martin
- Patrizia Paggio
- Dirk Heylen
- Series Title
- Lecture Notes in Artificial Intelligence
- Series Volume
- 5509
- Copyright
- 2009
- Publisher
- Springer-Verlag Berlin Heidelberg
- Copyright Holder
- Springer-Verlag Berlin Heidelberg
- eBook ISBN
- 978-3-642-04793-0
- DOI
- 10.1007/978-3-642-04793-0
- Softcover ISBN
- 978-3-642-04792-3
- Edition Number
- 1
- Number of Pages
- X, 223
- Topics
