Gesture-Based Communication in Human-Computer Interaction

1. Front Matter

   PDF

2. Foundational Issues

   1. Gesture Analysis: Invariant Laws in Movement

      • Sylvie Gibet, Jean-François Kamp, Franck Poirier

      Pages 1-9

   2. The Features People Use to Recognize Human Movement Style

      • Frank E. Pollick

      Pages 10-19

   3. Multimodal Analysis of Expressive Gesture in Music and Dance Performances

      • Antonio Camurri, Barbara Mazzarino, Matteo Ricchetti, Renee Timmers, Gualtiero Volpe

      Pages 20-39

   4. Correlation of Gestural Musical Audio Cues and Perceived Expressive Qualities

      • Marc Leman, Valery Vermeulen, Liesbeth De Voogdt, Johannes Taelman, Dirk Moelants, Micheline Lesaffre

      Pages 40-54

   5. Gestural Imagery in the Service of Musical Imagery

      • Rolf Inge Godøy

      Pages 55-62

   6. The Interaction of Iconic Gesture and Speech in Talk

      • Judith Holler, Geoffrey Beattie

      Pages 63-69

   7. Conceptual and Lexical Factors in the Production of Speech and Conversational Gestures: Neuropsychological Evidence

      • Carla Cristilli, Sergio Carlomagno

      Pages 70-76

   8. The Communicative System of Touch. Alphabet, Lexicon, and Norms of Use

      • Isabella Poggi, Filomena Cirella, Antonietta Zollo, Alessia Agostini

      Pages 77-89

   9. Some Issues in Sign Language Processing

      • Bruno Bossard, Annelies Braffort, Michèle Jardino

      Pages 90-100

   10. Multimodality and Gestures in the Teacher’s Communication

       • Giorgio Merola, Isabella Poggi

       Pages 101-111

   11. Deixis in Multimodal Human Computer Interaction: An Interdisciplinary Approach

       • Alfred Kranstedt, Peter Kühnlein, Ipke Wachsmuth

       Pages 112-123

   12. The Analysis of Gesture: Establishing a Set of Parameters

       • Nicla Rossini

       Pages 124-131

3. Gesture Tracking

   1. Holistic Body Tracking for Gestural Interfaces

      • Christian Lange, Thomas Hermann, Helge Ritter

      Pages 132-139

   2. Recovering Articulated Motion with a Hierarchical Factorization Method

      • Hanning Zhou, Thomas S. Huang

      Pages 140-151

   3. An Experimental Comparison of Trajectory-Based and History-Based Representation for Gesture Recognition

      • Kenny Morrison, Stephen J. McKenna

      Pages 152-163

   4. Tracking of Real Time Acrobatic Movements by Image Processing

      • Ryan Cassel, Christophe Collet

      Pages 164-171

   5. A Dynamic Model for Real-Time Tracking of Hands in Bimanual Movements

      • Atid Shamaie, Alistair Sutherland

      Pages 172-179

4. Gesture Recognition

   1. Robust Video-Based Recognition of Dynamic Head Gestures in Various Domains – Comparing a Rule-Based and a Stochastic Approach

      • Gregor McGlaun, Frank Althoff, Manfred Lang, Gerhard Rigoll

      Pages 180-197

   2. Remote Vision-Based Multi-type Gesture Interaction

      • Christian Brockmann, Heinrich Müller

      Pages 198-209

Research on the multifaceted aspects of modeling, analysis, and synthesis of - man gesture is receiving growing interest from both the academic and industrial communities. On one hand, recent scienti?c developments on cognition, on - fect/emotion, on multimodal interfaces, and on multimedia have opened new perspectives on the integration of more sophisticated models of gesture in c- putersystems.Ontheotherhand,theconsolidationofnewtechnologiesenabling “disappearing” computers and (multimodal) interfaces to be integrated into the natural environments of users are making it realistic to consider tackling the complex meaning and subtleties of human gesture in multimedia systems, - abling a deeper, user-centered, enhanced physical participation and experience in the human-machine interaction process. The research programs supported by the European Commission and s- eral national institutions and governments individuated in recent years strategic ?elds strictly concerned with gesture research. For example, the DG Infor- tion Society of the European Commission (www.cordis.lu/ist) supports several initiatives, such as the “Disappearing Computer” and “Presence” EU-IST FET (Future and Emerging Technologies), the IST program “Interfaces & Enhanced Audio-Visual Services” (see for example the project MEGA, Multisensory - pressive Gesture Applications, www.megaproject.org), and the IST strategic - jective “Multimodal Interfaces.” Several EC projects and other funded research are represented in the chapters of this book. Awiderangeofapplicationscanbene?tfromadvancesinresearchongesture, from consolidated areas such as surveillance to new or emerging ?elds such as therapy and rehabilitation, home consumer goods, entertainment, and aud- visual, cultural andartistic applications, just to mention only a few of them.

• Animation
• Design
• Navigation
• Text
• computational intelligence
• gestural imagery
• gestural interaction
• gesture mediated HCI
• gesture recognition
• haptics
• human-computer interaction (HCI)
• motion tracking
• multimodal interaction
• sign languages
• virtual reality

• InfoMus Lab, DIST- University of Genova, Genova, Italy

  Antonio Camurri

• InfoMus Lab, DIST University of Genova, Genova, Italy

  Gualtiero Volpe

Policies and ethics