From Extractive to Abstractive Summarization: A Journey

1. Front Matter

   Pages i-xi

   PDF

2. Introduction

   • Parth Mehta, Prasenjit Majumder

   Pages 1-9

3. Related Work

   • Parth Mehta, Prasenjit Majumder

   Pages 11-24

4. Corpora and Evaluation for Text Summarisation

   • Parth Mehta, Prasenjit Majumder

   Pages 25-34

5. Domain-Specific Summarisation

   • Parth Mehta, Prasenjit Majumder

   Pages 35-48

6. Improving Sentence Extraction Through Rank Aggregation

   • Parth Mehta, Prasenjit Majumder

   Pages 49-68

7. Leveraging Content Similarity in Summaries for Generating Better Ensembles

   • Parth Mehta, Prasenjit Majumder

   Pages 69-81

8. Neural Model for Sentence Compression

   • Parth Mehta, Prasenjit Majumder

   Pages 83-95

9. Conclusion

   • Parth Mehta, Prasenjit Majumder

   Pages 97-98

10. Back Matter

    Pages 99-116

    PDF

This book describes recent advances in text summarization, identifies remaining gaps and challenges, and proposes ways to overcome them. It begins with one of the most frequently discussed topics in text summarization –  ‘sentence extraction’ –, examines the effectiveness of current techniques in domain-specific text summarization, and proposes several improvements. 
In turn, the book describes the application of summarization in the legal and scientific domains, describing two new corpora that consist of more than 100 thousand court judgments and more than 20 thousand scientific articles, with the corresponding manually written summaries. The availability of these large-scale corpora opens up the possibility of using the now popular data-driven approaches based on deep learning. The book then highlights the effectiveness of neural sentence extraction approaches, which perform just as well as rule-based approaches, but without the need for any manual annotation. As a next step, multiple techniques for creating ensembles of sentence extractors – which deliver better and more robust summaries – are proposed. In closing, the book presents a neural network-based model for sentence compression. Overall the book takes readers on a journey that begins with simple sentence extraction and ends in abstractive summarization, while also covering key topics like ensemble techniques and domain-specific summarization, which have not been explored in detail prior to this.

• Automatic Text Summarization
• Legal document summarization
• Scientific document summarization
• Ensemble techniques
• Neural summarization

• Information Retrieval and Language Processing Lab, Dhirubhai Ambani Institute of Information and Communication Technology, Gandhinagar, India

  Parth Mehta, Prasenjit Majumder

Dr. Parth Mehta completed his M.Tech. in Machine Intelligence and his Ph.D. in Text Summarization at Dhirubhai Ambani Institute of ICT (DA-IICT), Gandhinagar, India. At the DA-IICT he was part of the Information Retrieval and Natural Language Processing Lab. He was also involved in the national project “Cross Lingual Information Access”, funded by the Govt. of India, which focused on building a cross-lingual search engine for nine Indian languages. 
Dr. Mehta has served as reviewer for the journals Information Processing and Management and Forum for Information Retrieval Evaluation. Apart from several journal and conference papers, he has also co-edited a book on text processing published by Springer. 
Prof. Prasenjit Majumder is an Associate Professor at Dhirubhai Ambani Institute of ICT (DA-IICT), Gandhinagar and a Visiting Professor at the Indian Institute of Information Technology, Vadodara (IIIT-V). Prof. Majumder completed his Ph.D. at Jadavpur University in 2008 and worked as a postdoctoral fellow at the University College Dublin, prior to joining the DA-IICT, where he currently heads the Information Retrieval and Language Processing Lab. His research interests lie at the intersection of Information Retrieval, Cognitive Science and Human Computing Interaction. He has headed several projects sponsored by the Govt. of India. 
He is one of the pioneers of the Forum for Information Retrieval Evaluation (FIRE), which assesses research on Information Retrieval and related areas for South Asian languages. Since being founded in 2008, FIRE has grown to become a respected conference, drawing participants from across the globe. Prof. Majumder has authored several journal and conference papers, and co-edited two special issues of Transactions in Information Systems (ACM). He has co-edited two books: ‘Multi Lingual Information Access in South Asian Languages’ and ‘Text Processing,’ both published by Springer.

Policies and ethics