Integration of Natural Language and Vision Processing

1. Front Matter

   Pages i-iii

   PDF

2. Editorial

   • Paul Mc Kevitt

   Pages 5-8

3. Research in Multimedia Systems at DFKI

   • Elisabeth André, Thomas Rist

   Pages 9-12

4. Apple Computer’s Authoring Tools & Titles R&D Program

   • James C. Spohrer

   Pages 13-17

5. Research into Iconic Communication at the University of Brighton

   • Colin Beardon

   Pages 19-21

6. Temporal Codes within a Typology of Cooperation Between Modalities

   • Jean-Claude Martin, Dominique Béroule

   Pages 23-30

7. Research in Multimedia and Multimodal Parsing and Generation

   • Mark T. Maybury

   Pages 31-55

8. A Third Modality of Natural Language?

   • Oliviero Stock

   Pages 57-74

9. Generating Coherent Presentations Employing Textual and Visual Material

   • Elisabeth André, Thomas Rist

   Pages 75-93

10. The Design of a Model-Based Multimedia Interaction Manager

    • Yigal Arens, Eduard Hovy

    Pages 95-116

11. Discourse Structures in Iconic Communication

    • Colin Beardon

    Pages 117-131

12. Communicating Through Pictures

    • Masoud Yazdani, Stuart Mealing

    Pages 133-141

13. Language Visualisation: Applications and Theoretical Foundations of a Primitive-Based Approach

    • A. Narayanan, D. Manuel, L. Ford, D. Tallis, M. Yazdani

    Pages 143-163

14. Book Review

    • Elisabeth Maier

    Pages 165-170

Although there has been much progress in developing theories, models and systems in the areas of natural language processing (NLP) and vision processing (VP), there has hitherto been little progress in integrating these two subareas of artificial intelligence. The papers in Integration of Natural Language and Vision Processing focus on site descriptions, such as the work at Apple Computer, California, and the DFKI, Saarbrücken, on historical surveys and philosophical issues, on systems that have been built, enabling communication through text, speech, sound, touch, video, graphics and icons, and on the automatic presentation of information, whether it be in the form of instruction manuals, statistical data or visualisation of language. There is also a review of Mark Maybury's book Intelligent Multimedia Interfaces.
Audience: Vital reading for all interested in the SuperInformationHighways of the future.

• artificial intelligence
• communication
• information
• intelligence
• multimedia
• natural language
• visualization

• Dept. of Computer Science, University of Sheffield, UK

  Paul Mc Kevitt

Policies and ethics