Multimedia Interaction and Intelligent User Interfaces

1. Front Matter

   Pages I-X

   PDF

2. Retrieving Human Actions Using Spatio-Temporal Features and Relevance Feedback

   • Rui Jin, Ling Shao

   Pages 1-23

3. Computationally Efficient Clustering of Audio-Visual Meeting Data

   • Hayley Hung, Gerald Friedland, Chuohao Yeo

   Pages 25-59

4. Cognitive-Aware Modality Allocation in Intelligent Multimodal Information Presentation

   • Yujia Cao, Mariët Theune, Anton Nijholt

   Pages 61-83

5. Natural Human–Computer Interaction

   • Gianpaolo D’Amico, Alberto Del Bimbo, Fabrizio Dini, Lea Landucci, Nicola Torpei

   Pages 85-106

6. Gesture Control for Consumer Electronics

   • Caifeng Shan

   Pages 107-128

7. Empirical Study of a Complete System for Real-Time Face Pose Estimation

   • Tommaso Gritti

   Pages 129-162

8. Evolution-based Virtual Content Insertion with Visually Virtual Interactions in Videos

   • Chia-Hu Chang, Ja-Ling Wu

   Pages 163-184

9. Physical Activity Recognition with Mobile Phones: Challenges, Methods, and Applications

   • Jun Yang, Hong Lu, Zhigang Liu, Péter Pál Boda

   Pages 185-213

10. Gestures in an Intelligent User Interface

    • Wim Fikkert, Paul van der Vet, Anton Nijholt

    Pages 215-242

11. Video Summary Quality Evaluation Based on 4C Assessment and User Interaction

    • Tongwei Ren, Yan Liu, Gangshan Wu

    Pages 243-269

12. Multimedia Experience on Web-Connected CE Devices

    • Dan Tretter, Jerry Liu, Xuemei Zhang, Yuli Gao, Brian Atkins, Hui Chao et al.

    Pages 271-300

13. Back Matter

    Pages 301-302

    PDF

Consumer electronics (CE) devices, providing multimedia entertainment and enabling communication, have become ubiquitous in daily life. However, consumer interaction with such equipment currently requires the use of devices such as remote controls and keyboards, which are often inconvenient, ambiguous and non-interactive. An important challenge for the modern CE industry is the design of user interfaces for CE products that enable interactions which are natural, intuitive and fun. As many CE products are supplied with microphones and cameras, the exploitation of both audio and visual information for interactive multimedia is a growing field of research. Collecting together contributions from an international selection of experts, including leading researchers in industry, this unique text presents the latest advances in applications of multimedia interaction and user interfaces for consumer electronics. Covering issues of both multimedia content analysis and human-machine interaction, the book examines a wide range of techniques from computer vision, machine learning, audio and speech processing, communications, artificial intelligence and media technology. Topics and features: introduces novel computationally efficient algorithms to extract semantically meaningful audio-visual events; investigates modality allocation in intelligent multimodal presentation systems, taking into account the cognitive impacts of modality on human information processing; provides an overview on gesture control technologies for CE; presents systems for natural human-computer interaction, virtual content insertion, and human action retrieval; examines techniques for 3D face pose estimation, physical activity recognition, and video summary quality evaluation; discusses the features that characterize the new generation of CE and examines how web services can be integrated with CE products for improved user experience. This book is an essential resource for researchers and practitionersfrom both academia and industry working in areas of multimedia analysis, human-computer interaction and interactive user interfaces. Graduate students studying computer vision, pattern recognition and multimedia will also find this a useful reference.

• Audio Processing
• Computer Vision
• Consumer Electronics
• Context-Awareness
• Design
• Human-Computer Interaction
• Multimedia
• User Experience
• User Experience (UX)
• User Interface
• human-computer interaction (HCI)
• multimodal interaction

• , Dept Electronic & Electrical Engineering, University of Sheffield, Sheffield, United Kingdom

  Ling Shao

• Philips Research, Eindhoven, Netherlands

  Caifeng Shan

• Kodak Research Laboratories, Rochester, USA

  Jiebo Luo

• , Service & Solution Development Dept, NTT DoCoMo, Inc., Yokosuka, Japan

  Minoru Etoh

Policies and ethics