Overview
- Provides an overview of 20 years of research in evaluating information retrieval systems
- Presents summaries of the most important experimental results and findings concerning information retrieval in various types of media
- Highlights the lessons learnt over the years, providing readers with useful guidelines on the best approaches and techniques
Part of the book series: The Information Retrieval Series (INRE, volume 41)
Access this book
Tax calculation will be finalised at checkout
Other ways to access
Table of contents (25 chapters)
-
Front Matter
-
Experimental Evaluation and CLEF
-
Front Matter
-
-
Multilingual and Multimedia Information Retrieval
-
Front Matter
-
-
Retrieval in New Domains
-
Front Matter
-
Keywords
About this book
The book is divided into six parts. Parts I and II provide background and context, with the first part explaining what is meant by experimental evaluation and the underlying theory, and describing how this has been interpreted in CLEF and in other internationally recognized evaluation initiatives. Part II presents research architectures and infrastructures that have been developed to manage experimental data and to provide evaluation services in CLEF and elsewhere. Parts III, IV andV represent the core of the book, presenting some of the most significant evaluation activities in CLEF, ranging from the early multilingual text processing exercises to the later, more sophisticated experiments on multimodal collections in diverse genres and media. In all cases, the focus is not only on describing “what has been achieved”, but above all on “what has been learnt”. The final part examines the impact CLEF has had on the research world and discusses current and future challenges, both academic and industrial, including the relevance of IR benchmarking in industrial settings.
Mainly intended for researchers in academia and industry, it also offers useful insights and tips for practitioners in industry working on the evaluation and performance issues of IR tools, and graduate students specializing in information retrieval.
Editors and Affiliations
About the editors
Carol Peters, now Research Associate, was a Researcher at the Italian National Research Council’s “Istituto di Scienza e Tecnologie dell'Informazione.” Her main research activities focused on the development of multilingual access mechanisms for digital libraries and evaluation methodologies for cross-language information retrieval systems. She was leader of the EU Sixth Framework MultiMatch project, and coordinated the Cross-Language Evaluation Forum (CLEF) during its first ten years of activity. In 2009, in recognition of her work for CLEF, she was awarded the Tony Kent Strix Award.
Bibliographic Information
Book Title: Information Retrieval Evaluation in a Changing World
Book Subtitle: Lessons Learned from 20 Years of CLEF
Editors: Nicola Ferro, Carol Peters
Series Title: The Information Retrieval Series
DOI: https://doi.org/10.1007/978-3-030-22948-1
Publisher: Springer Cham
eBook Packages: Computer Science, Computer Science (R0)
Copyright Information: Springer Nature Switzerland AG 2019
Hardcover ISBN: 978-3-030-22947-4Published: 26 August 2019
Softcover ISBN: 978-3-030-22950-4Published: 26 August 2020
eBook ISBN: 978-3-030-22948-1Published: 13 August 2019
Series ISSN: 1871-7500
Series E-ISSN: 2730-6836
Edition Number: 1
Number of Pages: XXII, 595
Number of Illustrations: 14 b/w illustrations, 75 illustrations in colour
Topics: Information Storage and Retrieval, Natural Language Processing (NLP)