Advances in Multimodal Interfaces - ICMI 2000

1. Front Matter

   Pages I-XV

   PDF

2. Affective and Perceptual Computing

   1. Gaze and Speech in Attentive User Interfaces

      • Paul P. Maglio, Teenie Matlock, Christopher S. Campbell, Shumin Zhai, Barton A. Smith

      Pages 1-7

   2. Resolving References to Graphical Objects in Multimodal Queries by Constraint Satisfaction

      • Daqing He, Graeme Ritchie, John Lee

      Pages 8-15

   3. Human-Robot Interface Based on Speech Understanding Assisted by Vision

      • Shengshien Chong, Yoshinori Kuno, Nobutaka Shimada, Yoshiaki Shirai

      Pages 16-23

   4. Designing Multi-sensory Models for Finding Patterns in Stock Market Data

      • Keith Nesbitt

      Pages 24-31

   5. Audio-visual Segmentation and “The Cocktail Party Effect”

      • Trevor Darrell, John W. Fisher III, Paul Viola

      Pages 32-40

   6. Visual Recognition of Emotional States

      • Karl Schwerdt, Daniela Hall, James L. Crowley

      Pages 41-48

   7. An Experimental Study of Input Modes for Multimodal Human-Computer Interaction

      • Xiangshi Ren, Gao Zhang, Guozhong Dai

      Pages 49-56

   8. Emotion Expression Function in Multimodal Presentation

      • Yuan Zong, Hiroshi Dohi, Helmut Prendinger, Mitsuru Ishizuka

      Pages 57-64

   9. A Sound MagicBoard

      • Christophe Le Gal, Ali Erdem Ozcan, Karl Schwerdt, James L. Crowley

      Pages 65-71

3. Gesture Recognition

   1. A Head Gesture Recognition Algorithm

      • Jinshan Tang, Ryohei Nakatsu

      Pages 72-80

   2. Gesture Recognition for a Walking Person by Using a Sequence of Spatially Reduced Range Image

      • T. Nishimura, S. Nozaki, K. Makimura, S. Endo, H. Yabe, R. Oka

      Pages 81-87

   3. Virtual Mouse—Inputting Device by Hand Gesture Tracking and Recognition

      • Hu Changbo, Liang Lichen, Ma Songde, Lu Hanqing

      Pages 88-95

   4. A Self-reliance Smoothness of the Vision-Based Recognition of Hand Gestures

      • Xiao-juan Wang, Zhen Zhang, Li-fang Peng

      Pages 96-102

   5. Hand Shape Extraction and Understanding by Virtue of Multiple Cues Fusion Technology

      • Lin Xueyin, Zhang Xiaoping, Ren Haibing

      Pages 103-110

   6. Head Pose Estimation for Video-Conferencing with Multiple Cameras and Microphones

      • Ce Wang, Michael Brandstein

      Pages 111-118

4. Face and Facial Expression Detection, Recognition and Synthesis

   1. A General Framework for Face Detection

      • Ai Haizhou, Liang Luhong, Xu Guangyou

      Pages 119-126

   2. Glasses Detection for Face Recognition Using Bayes Rules

      • Zhong Jing, Robert Mariani, Jiankang Wang

      Pages 127-134

   3. Real-Time Face Tracking under Partial Occlusion and Illumination Change

      • Zhihong Zeng, Songde Ma

      Pages 135-142

   4. Eye-State Action Unit Detection by Gabor Wavelets

      • Ying-li Tian, Takeo Kanade, Jeffrey F. Cohn

      Pages 143-150

Multimodal Interfaces represents an emerging interdisciplinary research direction and has become one of the frontiers in Computer Science. Multimodal interfaces aim at efficient, convenient and natural interaction and communication between computers (in their broadest sense) and human users. They will ultimately enable users to interact with computers using their everyday skills. These proceedings include the papers accepted for presentation at the Third International Conference on Multimodal Interfaces (ICMI 2000) held in Beijing, China on 1416 O ctober 2000. The papers were selected from 172 contributions submitted worldwide. Each paper was allocated for review to three members of the Program Committee, which consisted of more than 40 leading researchers in the field. Final decisions of 38 oral papers and 48 poster papers were made based on the reviewers’ comments and the desire for a balance of topics. The decision to have a single track conference led to a competitive selection process and it is very likely that some good submissions are not included in this volume. The papers collected here cover a wide range of topics such as affective and perceptual computing, interfaces for wearable and mobile computing, gestures and sign languages, face and facial expression analysis, multilingual interfaces, virtual and augmented reality, speech and handwriting, multimodal integration and application systems. They represent some of the latest progress in multimodal interfaces research.

• Augmented Reality
• HCI
• Human-computer interaction
• Human-computer interaction (HCI)
• Navigation
• Processing
• face recognition
• graphical user interfaces
• handwriting recognition
• intelligent user interfaces
• interface design
• multimodal user interfaces
• natural language processing
• object
• speech processing

• Institute of Automation, Chinese Academy of Sciences, Beijing, China

  Tieniu Tan

• Computer Department, Media Laboratory, Tsinghua University, Beijing, China

  Yuanchun Shi

• Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China

  Wen Gao

Policies and ethics