Multimodal Analysis of User-Generated Multimedia Content

1. Front Matter

   Pages i-xxii

   PDF

2. Introduction

   • Rajiv Shah, Roger Zimmermann

   Pages 1-30

3. Literature Review

   • Rajiv Shah, Roger Zimmermann

   Pages 31-57

4. Event Understanding

   • Rajiv Shah, Roger Zimmermann

   Pages 59-99

5. Tag Recommendation and Ranking

   • Rajiv Shah, Roger Zimmermann

   Pages 101-138

6. Soundtrack Recommendation for UGVs

   • Rajiv Shah, Roger Zimmermann

   Pages 139-171

7. Lecture Video Segmentation

   • Rajiv Shah, Roger Zimmermann

   Pages 173-203

8. Adaptive News Video Uploading

   • Rajiv Shah, Roger Zimmermann

   Pages 205-234

9. Conclusion and Future Work

   • Rajiv Shah, Roger Zimmermann

   Pages 235-260

10. Back Matter

    Pages 261-263

    PDF

This book presents a summary of the multimodal analysis of user-generated multimedia content (UGC). Several multimedia systems and their proposed frameworks are also discussed. First, improved tag recommendation and ranking systems for social media photos, leveraging both content and contextual information, are presented. Next, we discuss the challenges in determining semantics and sentics information from UGC to obtain multimedia summaries. Subsequently, we present a personalized music video generation system for outdoor user-generated videos. Finally, we discuss approaches for multimodal lecture video segmentation techniques. This book also explores the extension of these multimedia system with the use of heterogeneous continuous streams.

• Multimodal Analysis
• Semantics and Sentics Analysis
• User-Gererated Content
• Social Media
• Multimedia

• School of Computing, National University of Singapore, Singapore, Singapore

  Rajiv Shah, Roger Zimmermann

Rajiv Ratn Shah received his B.Sc. with honors in Mathematics from Banaras Hindu University, India in 2005. He received his M.Tech. in Computer Technology and Applications from Delhi Technological University, India in 2010. Prior joining Indraprastha Institute of Information Technology Delhi (IIIT Delhi), India as an assistant professor, Dr Shah has received his Ph.D. in Computer Science from the National University of Singapore, Singapore. Currently, he is also working as a research fellow in living analytics research centre (LARC) at the Singapore Management University, Singapore. His research interests include the multimodal analysis of user-generated multimedia content in the support of social media applications, multimodal event detection and recommendation, and multimedia analysis, search, and retrieval. Dr Shah is the recipient of several awards, including the runner-up in the Grand Challenge competition of ACM International Conference on Multimedia. He is involved in reviewingof many top-tier international conferences and journals. He has published several research work in top-tier conferences and journals such as Springer MultiMedia Modeling, ACM International Conference on Multimedia, IEEE International Symposium on Multimedia, and Elsevier Knowledge-Based Systems.

Policies and ethics