Text, Speech and Language Technology

Word Frequency Distributions

Authors: Baayen, R. Harald

Buy this book

eBook 71,39 €
price for Spain (gross)
  • ISBN 978-94-010-0844-0
  • Digitally watermarked, DRM-free
  • Included format: PDF
  • ebooks can be used on all reading devices
  • Immediate eBook download after purchase
Hardcover 176,79 €
price for Spain (gross)
  • ISBN 978-0-7923-7017-8
  • Free shipping for individuals worldwide
  • Usually dispatched within 3 to 5 business days.
  • The final prices may differ from the prices shown due to specifics of VAT rules
Softcover 88,39 €
price for Spain (gross)
  • ISBN 978-1-4020-0927-3
  • Free shipping for individuals worldwide
  • Usually dispatched within 3 to 5 business days.
  • The final prices may differ from the prices shown due to specifics of VAT rules
About this book

This book is an introduction to the statistical analysis of word frequency distributions, intended for linguists, psycholinguistics, and researchers work­ ing in the field of quantitative stylistics and anyone interested in quantitative aspects of lexical structure. Word frequency distributions are characterized by very large numbers of rare words. This property leads to strange statisti­ cal phenomena such as mean frequencies that systematically keep changing as the number of observations is increased, relative frequencies that even in large samples are not fully reliable estimators ofpopulationprobabilities, and model parameters that emerge as functions of the text size. Special statistical techniques for the analysis of distributions with large numbers of rare events can be found in various technical journals. The aim of this book is to make these techniques more accessible for non-specialists. Chapter 1 introduces some basic concepts and notation. Chapter 2 describes non-parametricmethods for the analysis ofword frequency distributions. The next chapterdescribes in detail three parametricmodels, the lognormal model, the Yule-Simon Zipfian model, and the generalized inverse Gauss-Poisson model. Chapter 4 introduces the concept of mixture distributions. Chapter 5 explores the effectofnon-randomness inword use on the accuracy of the non­ parametric and parametric models, all of which are based on the assumption that words occur independently and randomly in texts. Chapter 6 presents examples of applications.

Reviews

From the reviews:
"Baayen's book must surely in the future become the standard point of departure for statistical studies of vocabulary."
(Geoffrey Sampson (Computational Linguistics, 28:04)


Table of contents (6 chapters)

Buy this book

eBook 71,39 €
price for Spain (gross)
  • ISBN 978-94-010-0844-0
  • Digitally watermarked, DRM-free
  • Included format: PDF
  • ebooks can be used on all reading devices
  • Immediate eBook download after purchase
Hardcover 176,79 €
price for Spain (gross)
  • ISBN 978-0-7923-7017-8
  • Free shipping for individuals worldwide
  • Usually dispatched within 3 to 5 business days.
  • The final prices may differ from the prices shown due to specifics of VAT rules
Softcover 88,39 €
price for Spain (gross)
  • ISBN 978-1-4020-0927-3
  • Free shipping for individuals worldwide
  • Usually dispatched within 3 to 5 business days.
  • The final prices may differ from the prices shown due to specifics of VAT rules
Loading...

Recommended for you

Loading...

Bibliographic Information

Bibliographic Information
Book Title
Word Frequency Distributions
Authors
Series Title
Text, Speech and Language Technology
Series Volume
18
Copyright
2001
Publisher
Springer Netherlands
Copyright Holder
Springer Science+Business Media Dordrecht
eBook ISBN
978-94-010-0844-0
DOI
10.1007/978-94-010-0844-0
Hardcover ISBN
978-0-7923-7017-8
Softcover ISBN
978-1-4020-0927-3
Series ISSN
1386-291X
Edition Number
1
Number of Pages
XXII, 335
Topics