Integration of Natural Language and Vision Processing

1. Front Matter

   Pages i-158

   PDF

2. Editorial

   • Paul Mc Kevitt

   Pages 159-163

3. Collaborative Research Centre “Situated Artificial Communicators” at the University of Bielefeld, Germany

   • G. Rickheit, I. Wachsmuth

   Pages 165-170

4. Using Spatial Logic to Describe Visual Languages

   • J. M. Gooday, A. G. Cohn

   Pages 171-186

5. A Visual News Processing Environment

   • Graziella Tonfoni

   Pages 187-208

6. Integrating Vision, Motion and Language through Mind

   • Naoyuki Okada

   Pages 209-234

7. Automatic Reconstruction of Vasculature

   • Paul Mc Kevitt, Peter Hall

   Pages 235-252

8. Visualization of Rhythm, Time and Metre

   • Neil P. McAngus Todd, Guy J. Brown

   Pages 253-273

9. The Sensitive Interface

   • Paul Mc Kevitt, John G. Gammack

   Pages 275-298

10. Multimodal Interfaces

    • Alex Waibel, Minh Tue Vo, Paul Duchnowski, Stefan Manke

    Pages 299-319

11. Picture Semantics for Integrating Text and Diagram Input

    • Raman Rajagopalan

    Pages 321-344

12. Dynamic Conceptualization in a Mechanical-Object Assembly Environment

    • I. Wachsmuth, B. Jung

    Pages 345-367

13. Book Review

    • Robin Collier

    Pages 369-371

Although there has been much progress in developing theories, models and systems in the areas of Natural Language Processing (NLP) and Vision Processing (VP) there has up to now been little progress on integrating these two subareas of Artificial Intelligence (AI). This book contains a set of edited papers on recent advances in the theories, computational models and systems of the integration of NLP and VP.
The volume includes original work of notable researchers:
Alex Waibel outlines multimodal interfaces including studies in speech, gesture and points; eye-gaze, lip motion and facial expression; hand writing, face recognition, face tracking and sound localization in a connectionist framework.
Antony Cohen and John Gooday use spatial relations to describe visual languages.
Naoguki Okada considers intentions of agents in visual environments.
In addition to these studies, the volume includes many recent advances from North America, Europe and Asia demonstrating the fact that integration of Natural Language Processing and Vision is truly an international challenge.

• agents
• artificial intelligence
• cognition
• intelligence
• natural language
• natural language processing
• semantics
• visualization

• Dept. of Computer Science, University of Sheffield, UK

  Paul Mc Kevitt

Policies and ethics