Authors:
- Covers the universal mathematical properties of natural language from Zipf's law to the present
- Explains how the properties show the essential limitation of language models in natural language processing
- Speculates on how the properties relate to linguistic grammar, word formation, and meaning
Part of the book series: Mathematics in Mind (MATHMIN)
Buy it now
Buying options
Tax calculation will be finalised at checkout
Other ways to access
This is a preview of subscription content, log in via an institution to check for access.
Table of contents (25 chapters)
-
Front Matter
-
Language as a Complex System
-
Front Matter
-
-
Property of Population
-
Front Matter
-
-
Property of Sequences
-
Front Matter
-
-
Relation to Linguistic Elements and Structure
-
Front Matter
-
-
Mathematical Models
-
Front Matter
-
About this book
The main focus of the book further lies in explaining the property of long memory, which was discovered and studied more recently by borrowing concepts from complex systems theory. The statistical universals not only possibly lie as the precursor of language system formation, but they also highlight the qualities of language that remain weak points in today's machine learning.
In summary, this book provides an overview of language's global properties. It will be of interest to anyone engaged in fields related to language and computing or statistical analysis methods, with an emphasis on researchers and students in computational linguistics and natural language processing. While the book does apply mathematical concepts, all possible effort has been made to speak to a non-mathematical audience as well by communicating mathematical content intuitively, with concise examples taken from real texts.
Reviews
Authors and Affiliations
-
Research Center for Advanced Science and Technology (RCAST), The University of Tokyo, Tokyo, Japan
Kumiko Tanaka-Ishii
Bibliographic Information
Book Title: Statistical Universals of Language
Book Subtitle: Mathematical Chance vs. Human Choice
Authors: Kumiko Tanaka-Ishii
Series Title: Mathematics in Mind
DOI: https://doi.org/10.1007/978-3-030-59377-3
Publisher: Springer Cham
eBook Packages: Mathematics and Statistics, Mathematics and Statistics (R0)
Copyright Information: The Editor(s) (if applicable) and The Author(s) 2021
Hardcover ISBN: 978-3-030-59376-6Published: 02 April 2021
Softcover ISBN: 978-3-030-59379-7Published: 02 April 2022
eBook ISBN: 978-3-030-59377-3Published: 01 April 2021
Series ISSN: 2522-5405
Series E-ISSN: 2522-5413
Edition Number: 1
Number of Pages: VIII, 236
Number of Illustrations: 52 b/w illustrations, 100 illustrations in colour