Integration of Natural Language and Vision Processing

1. Front Matter

   Pages i-8

   PDF

2. Ongoing Research Projects at the Institute for the Learning Sciences

   • Roger C. Schank, Andrew Fano

   Pages 9-12

3. A Logical Approach to Representing and Reasoning About Space

   • A. G. Cohn, J. M. Gooday, B. Bennett, N. M. Gotts

   Pages 13-17

4. Memory and Expectations in Learning, Language, and Visual Understanding

   • Roger C. Schank, Andrew Fano

   Pages 19-29

5. Language, Vision and Metaphor

   • Yorick Wilks

   Pages 31-47

6. Language and Vision: A Single Perceptual Mechanism?

   • Derek Partridge

   Pages 49-61

7. Sandy Ideas and Coloured Days: Some Computational Implications of Embodiment

   • Ronan G. Reilly

   Pages 63-80

8. A Comparison of Models for Fusion of the Auditory and Visual Sensors in Speech Perception

   • Jordi Robert-Ribes, Jean-Luc Schwartz, Pierre Escudier

   Pages 81-104

9. Visible Speech Improves Human Language Understanding: Implications for Speech Processing Systems

   • Laura A. Thompson, William C. Ogden

   Pages 105-116

10. Work on the Integration of Language and Vision at the University of Torino

    • Diego Marconi

    Pages 117-122

11. On the Referential Competence of Some Machines

    • Diego Marconi

    Pages 123-137

12. Understanding Language through Vision

    • Cristina Meini, Alfredo Paternoster

    Pages 139-150

13. From Chinese Rooms to Irish Rooms: New Words on Visions for Language

    • Paul Mc Kevitt, Chengming Guo

    Pages 151-165

14. Grounding Computational Engines

    • Stuart A. Jackson, Noel E. Sharkey

    Pages 167-184

15. Successful Naïve Representation Grounding

    • N. J. Sales, R. G. Evans, I. Aleksander

    Pages 185-204

16. L0 — The First Five Years of an Automated Language Acquisition Project

    • Jerome Feldman, George Lakoff, David Bailey, Srini Narayanan, Terry Regier, Andreas Stolcke

    Pages 205-231

17. Grounding Symbols into Perceptions

    • Alain Grumbach

    Pages 233-248

18. Book Review

    • Mark Lee, Paul Mc Kevitt, John Neary

    Pages 249-255

Although there has been much progress in developing theories, models and systems in the areas of Natural Language Processing (NLP) and Vision Processing (VP), there has heretofore been little progress on integrating these two subareas of Artificial Intelligence (AI). This book contains a set of edited papers addressing theoretical issues and the grounding of representations in NLP and VP from philosophical and psychological points of view. The papers focus on site descriptions such as the reasoning work on space at Leeds, UK, the systems work of the ILS (Illinois, U.S.A.) and philosophical work on grounding at Torino, Italy, on Schank's earlier work on pragmatics and meaning incorporated into hypermedia teaching systems, Wilks' visions on metaphor, on experimental data for how people fuse language and vision and theories and computational models, mainly connectionist, for tackling Searle's Chinese Room Problem and Harnad's Symbol Grounding Problem. The Irish Room is introduced as a mechanism through which integration solves the Chinese Room. The U.S.A., China and the EU are well reflected, showing the fact that integration is a truly international issue. There is no doubt that all of this will be necessary for the SuperInformationHighways of the future.

• Symbol
• artificial intelligence
• information
• intelligence
• learning
• natural language
• robot
• speech processing

• Department of Computer Science, University of Sheffield, England, EU

  Paul Mc Kevitt

• Dún Na nGall (Donegal), Ireland, EU

  Paul Mc Kevitt

Policies and ethics