Coarse-to-Fine Natural Language Processing

1. Front Matter

   Pages i-xxii

   PDF

2. Introduction

   • Slav Petrov

   Pages 1-6

3. Latent Variable Grammars for Natural Language Parsing

   • Slav Petrov

   Pages 7-46

4. Discriminative Latent Variable Grammars

   • Slav Petrov

   Pages 47-67

5. Structured Acoustic Models for Speech Recognition

   • Slav Petrov

   Pages 69-82

6. Coarse-to-Fine Machine Translation Decoding

   • Slav Petrov

   Pages 83-98

7. Conclusions and Future Work

   • Slav Petrov

   Pages 99-100

8. Back Matter

   Pages 101-105

   PDF

The impact of computer systems that can understand natural language will be tremendous. To develop this capability we need to be able to automatically and efficiently analyze large amounts of text. Manually devised rules are not sufficient to provide coverage to handle the complex structure of natural language, necessitating systems that can automatically learn from examples. To handle the flexibility of natural language, it has become standard practice to use statistical models, which assign probabilities for example to the different meanings of a word or the plausibility of grammatical constructions.

This book develops a general coarse-to-fine framework for learning and inference in large statistical models for natural language processing.

Coarse-to-fine approaches exploit a sequence of models which introduce complexity gradually. At the top of the sequence is a trivial model in which learning and inference are both cheap. Each subsequent model refines the previous one, until a final, full-complexity model is reached. Applications of this framework to syntactic parsing, speech recognition and machine translation are presented, demonstrating the effectiveness of the approach in terms of accuracy and speed. The book is intended for students and researchers interested in statistical approaches to Natural Language Processing.

Slav’s work Coarse-to-Fine Natural Language Processing represents a major advance in the area of syntactic parsing, and a great advertisement for the superiority of the machine-learning approach.

Eugene Charniak (Brown University)

• 68T50
• Computational Linguistics
• Machine Learning
• Natural Language Processing

• Google, New York, USA

  Slav Petrov

Slav Petrov is a Research Scientist at Google New York. He works on problems at the intersection of natural language processing and machine learning. In particular, he is interested in syntactic parsing and its applications to machine translation and information extraction. He also teaches Statistical Natural Language Processing at New York University as an Adjunct Professor.

Policies and ethics