Utility and Application of Language Corpora

This book discusses some of the basic issues relating to corpus generation and the methods normally used to generate a corpus. Since corpus-related research goes beyond corpus generation, the book also addresses other major topics connected with the use and application of language corpora, namely, corpus readiness in the context of corpus sanitation and pre-editing of corpus texts; the application of statistical methods; and various text processing techniques. Importantly, it explores how corpora can be used as a primary or secondary resource in English language teaching, in creating dictionaries, in word sense disambiguation, in various language technologies, and in other branches of linguistics. Lastly, the book sheds light on the status quo of corpus generation in Indian languages and identifies current and future needs.

Discussing various technical issues in the field in a lucid manner, providing extensive new diagrams and charts for easy comprehension, and using simplified English, the book is an ideal resource for non-native English readers. Written by academics with many years of experience teaching and researching corpus linguistics, its focus on Indian languages and on English corpora makes it applicable to graduate and postgraduate students of applied linguistics, computational linguistics and language processing in South Asia and across countries where English is spoken as a first or second language.

• digital speech corpora
• monolingual corpora
• issue relating to text corpus generation
• skewedness and imbalance in corpus generation
• corpus sanitation
• statistical approaches for processing a corpus
• use of corpus as primary resource in ELT
• application to bilingual work
• bilingual dictionary creation
• use in studying dialects
• word sense disambiguation
• corpora use in linguistics
• corpus linguistics
• learning and instruction

• Indian Statistical Institute, Linguistic Research Unit, Kolkata, India

  Niladri Sekhar Dash

• Linguistic Data Consortium-Indian Languages, Central Institute of Indian Languages, Mysore, India

  L. Ramamoorthy

Niladri Sekhar Dash, PhD, is an associate professor at the Linguistic Research Unit of the Indian Statistical Institute, Kolkata, where his interests include corpus linguistics, language technology, natural language processing, language documentation and digitization, computational lexicography, computer assisted language teaching, and manual and machine translation for over two decades. He has published 15 research monographs and 160 research papers in peer-reviewed national and international journals, anthologies, and conference proceedings. He has delivered lectures and taught courses as an invited scholar at more than 30 universities and institutes in India and abroad, and has acted as a consultant for several organizations working in the field of Language Technology and Natural Language Processing. Dr. Dash is the principal investigator for 5 language technology projects funded by the Government of India and the Indian Statistical Institute, Kolkata. He is the editor-in-chief of the Journal of Advanced Linguistic Studies—an international peer-reviewed journal; and editorial board member of 5 international journals. He is a member of several linguistics associations across the globe and a regular PhD thesis adjudicator for several Indian universities. Dr. Dash is currently working on a digital pronunciation dictionary for Bangla, Hindi-Bangla parallel translation corpus generation, endangered language documentation and digitization, POS tagging and chunking, word sense disambiguation, manual and machine translation, and computer-assisted language teaching.

L. Ramamoorthy, PhD, is the head of the Linguistic Data Consortium for Indian Languages (LDC-IL) at the Central Institute of Indian Languages (CIIL), Mysuru, Ministry of Human Resource Development, Government of India. He is one of the leading corpus linguists in India, and is in charge of the Corpus Development Project for Indian Languages at the CIIL. Under his leadership, more than 30scholars have been working on this mega project. He is a member/active participant of several corpus-oriented projects in India. He has conducted numerous workshops on computational and corpus linguistics in various universities and colleges in India. He has published 7 research monographs, edited 8 volumes, and published/presented 140 research papers at national and international seminars and conferences. He has guided more than 15 PhD scholars and trained school teachers, college and university teachers in and outside India in language technology, linguistics, and teaching methods. He was also the director of the Pondicherry Institute of Linguistics and Culture (for over four years), editor-in-chief of the PILC Journal of Dravidic Studies, and co-editor for Languages in India (e-Journal).

Policies and ethics