Evaluating Natural Language Processing Systems

1. Front Matter

   PDF

2. Introduction

   • Karen Sparck Jones, Julia R. Galliers

   Pages 1-2

3. The framework: Scope and concepts

   • Karen Sparck Jones, Julia R. Galliers

   Pages 3-63

4. NLP evaluation: Work and strategies

   • Karen Sparck Jones, Julia R. Galliers

   Pages 65-192

5. Strategies for Evaluation

   • Karen Sparck Jones, Julia R. Galliers

   Pages 193-218

6. Back Matter

   PDF

This comprehensive state-of-the-art book is the first devoted to the important and timely issue of evaluating NLP systems. It addresses the whole area of NLP system evaluation, including aims and scope, problems and methodology.
The authors provide a wide-ranging and careful analysis of evaluation concepts, reinforced with extensive illustrations; they relate systems to their environments and develop a framework for proper evaluation. The discussion of principles is completed by a detailed review of practice and strategies in the field, covering both systems for specific tasks, like translation, and core language processors. The methodology lessons drawn from the analysis and review are applied in a series of example cases. A comprehensive bibliography, a subject index, and term glossary are included.

• Algorithmische Linguistik
• Computational Linguistics
• Language Engineering
• Machine Translation
• Maschinelles Übersetzen
• NLP Systems Evaluation
• NLP-Systembewertung
• Naturlichsprachliche Verarbeitung
• Sprach-Engineering
• natural language
• natural language processing

Policies and ethics