Integration of Natural Language and Vision Processing

1. Front Matter

   Pages i-12

   PDF

2. The Real World Computing Program

   • Ryuichi Oka

   Pages 13-19

3. An Investigation into the Common Semantics of Language and Vision

   • Seán Ó Nualláin, Arnold G. Smith

   Pages 21-30

4. Hierarchical Labelling for Integrating Images and Words

   • Ryuichi Oka

   Pages 31-53

5. Quantitative Perceptual Representation of Prepositional Semantics

   • Patrick Olivier, Jun-Ichi Tsujii

   Pages 55-66

6. From Vision to Multimodal Communication: Incremental Route Descriptions

   • Wolfgang Maaß

   Pages 67-82

7. VIsual TRAnslator: Linking Perceptions and Natural Language Descriptions

   • Gerd Herzog, Peter Wazinski

   Pages 83-95

8. A Vision of ‘Vision and Language’ Comprises Action: An Example from Road Traffic

   • Hans-Hellmut Nagel

   Pages 97-122

9. What You Say is What You See — Interactive Generation, Manipulation and Modification of 3-D Shapes Based on Verbal Descriptions

   • Yuri A. Tijerino, Shinji Abe, Tsutomu Miyasato, Fumio Kishino

   Pages 123-142

10. Towards an American Sign Language Interface

    • Brigitte Dorner, Eli Hagen

    Pages 143-161

11. Integrating Natural Language Understanding with Document Structure Analysis

    • Suzanne Liebowitz Taylor, Deborah A. Dahl, Mark Lipshutz, Carl Weir, Lewis M. Norton, Roslyn Weidner Nilson et al.

    Pages 163-184

12. Computational Models for Integrating Linguistic and Visual Information: A Survey

    • Rohini K. Srihari

    Pages 185-205

13. Grounding Language in Perception

    • Jeffrey Mark Siskind

    Pages 207-227

14. Connectionist Visualisation of Tonal Structure

    • Niall Griffith

    Pages 229-244

15. Use of Captions and Other Collateral Text in Understanding Photographs

    • Rohini K. Srihari

    Pages 245-266

16. The DenK-architecture: A Fundamental Approach to User-Interfaces

    • R. M. C. Ahn, R. J. Beun, T. Borghuis, H. C. Bunt, C. W. A. M. van Overveld

    Pages 267-281

17. AI Meets Authoring: User Models for Intelligent Multimedia

    • Andrew Csinger, Kellogg S. Booth, David Poole

    Pages 283-304

18. Book Reviews

    • Nadine Lucas, Jean-Baptiste Berthelin, Stuart A. Jackson, Amanda J. C. Sharkey

    Pages 305-309

Although there has been much progress in developing theories, models and systems in the areas of Natural Language Processing (NLP) and Vision Processing (VP) there has heretofore been little progress on integrating these subareas of Artificial Intelligence (AI). This book contains a set of edited papers addressing computational models and systems for the integration of NLP and VP. The papers focus on site descriptions such as that of the large Japanese $500 million Real World Computing (RWC) project, on historical philosophical issues, on systems which have been built and which integrate the processing of visual scenes together with language about them, and on spatial relations which appear to be the key to integration. The U.S.A., Japan and the EU are well reflected, showing up the fact that integration is a truly international issue. There is no doubt that all of this will be necessary for the InformationSuperHighways of the future.

• artificial intelligence
• communication
• information
• intelligence
• natural language
• natural language processing
• perception
• semantics

• Dept. of Computer Science, University of Sheffield, UK

  Paul Mc Kevitt

Policies and ethics