Skip to main content
SpringerLink
Log in
Book cover

Multilingual and Multimodal Information Access Evaluation

International Conference of the Cross-Language Evaluation Forum, CLEF 2010, Padua, Italy, September 20-23, 2010, Proceedings

  • Conference proceedings
  • © 2010

Overview

Editors:
  1. Maristella Agosti

    1. Department of Information Engineering, University of Padua, Padova, Italy

    View editor publications

    You can also search for this editor in PubMed   Google Scholar

  2. Nicola Ferro

    1. University of Padua, Padua, Italy

    View editor publications

    You can also search for this editor in PubMed   Google Scholar

  3. Carol Peters

    1. ISTI-CNR, Area Ricerca CNR, Pisa, Italy

    View editor publications

    You can also search for this editor in PubMed   Google Scholar

  4. Maarten Rijke

    1. ISLA, University of Amsterdam, Amsterdam, The Netherlands

    View editor publications

    You can also search for this editor in PubMed   Google Scholar

  5. Alan Smeaton

    1. Dublin City University, Dublin, Ireland

    View editor publications

    You can also search for this editor in PubMed   Google Scholar

Part of the book series: Lecture Notes in Computer Science (LNCS, volume 6360)

Part of the book sub series: Information Systems and Applications, incl. Internet/Web, and HCI (LNISA)

Included in the following conference series:

Conference proceedings info: CLEF 2010.

This is a preview of subscription content, log in via an institution to check access.

Access this book

Log in via an institution
eBook USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Other ways to access

Licence this eBook for your library

Institutional subscriptions

Table of contents (16 papers)

  1. Front Matter

    Download chapter PDF

  2. Keynote Addresses

    1. IR between Science and Engineering, and the Role of Experimentation

      • Norbert Fuhr
      Pages 1-1

    2. Retrieval Evaluation in Practice

      • Ricardo Baeza-Yates
      Pages 2-2

  3. Resources, Tools, and Methods

    1. A Dictionary- and Corpus-Independent Statistical Lemmatizer for Information Retrieval in Low Resource Languages

      • Aki Loponen, Kalervo Järvelin
      Pages 3-14

    2. A New Approach for Cross-Language Plagiarism Analysis

      • Rafael Corezola Pereira, Viviane P. Moreira, Renata Galante
      Pages 15-26

    3. Creating a Persian-English Comparable Corpus

      • Homa Baradaran Hashemi, Azadeh Shakery, Heshaam Faili
      Pages 27-39

  4. Experimental Collections and Datasets (1)

    1. Validating Query Simulators: An Experiment Using Commercial Searches and Purchases

      • Bouke Huurnink, Katja Hofmann, Maarten de Rijke, Marc Bron
      Pages 40-51

    2. Using Parallel Corpora for Multilingual (Multi-document) Summarisation Evaluation

      • Marco Turchi, Josef Steinberger, Mijail Kabadjov, Ralf Steinberger
      Pages 52-63

  5. Experimental Collections and Datasets (2)

    1. MapReduce for Information Retrieval Evaluation: “Let’s Quickly Test This on 12 TB of Data”

      • Djoerd Hiemstra, Claudia Hauff
      Pages 64-69

    2. Which Log for Which Information? Gathering Multilingual Data from Different Log File Types

      • Maria Gäde, Vivien Petras, Juliane Stiller
      Pages 70-81

  6. Evaluation Methodologies and Metrics (1)

    1. Examining the Robustness of Evaluation Metrics for Patent Retrieval with Incomplete Relevance Judgements

      • Walid Magdy, Gareth J. F. Jones
      Pages 82-93

    2. On the Evaluation of Entity Profiles

      • Maarten de Rijke, Krisztian Balog, Toine Bogers, Antal van den Bosch
      Pages 94-99

  7. Evaluation Methodologies and Metrics (2)

    1. Evaluating Information Extraction

      • Andrea Esuli, Fabrizio Sebastiani
      Pages 100-111

    2. Tie-Breaking Bias: Effect of an Uncontrolled Parameter on Information Retrieval Evaluation

      • Guillaume Cabanac, Gilles Hubert, Mohand Boughanem, Claude Chrisment
      Pages 112-123

    3. Automated Component–Level Evaluation: Present and Future

      • Allan Hanbury, Henning Müller
      Pages 124-135

  8. Panels

    1. The Four Ladies of Experimental Evaluation

      • Donna Harman, Noriko Kando, Mounia Lalmas, Carol Peters
      Pages 136-139

    2. A PROMISE for Experimental Evaluation

      • Martin Braschler, Khalid Choukri, Nicola Ferro, Allan Hanbury, Jussi Karlgren, Henning Müller et al.
      Pages 140-144

  9. Back Matter

    Download chapter PDF
Back to top

Other volumes

  1. Multilingual and Multimodal Information Access Evaluation

Keywords

About this book

In its ?rst ten years of activities (2000-2009), the Cross-Language Evaluation Forum (CLEF) played a leading role in stimulating investigation and research in a wide range of key areas in the information retrieval domain, such as cro- language question answering, image and geographic information retrieval, int- activeretrieval,and many more.It also promotedthe study andimplementation of appropriateevaluation methodologies for these diverse types of tasks and - dia. As a result, CLEF has been extremely successful in building a wide, strong, and multidisciplinary research community, which covers and spans the di?erent areasofexpertiseneededto dealwith thespreadofCLEFtracksandtasks.This constantly growing and almost completely voluntary community has dedicated an incredible amount of e?ort to making CLEF happen and is at the core of the CLEF achievements. CLEF 2010 represented a radical innovation of the “classic CLEF” format and an experiment aimed at understanding how “next generation” evaluation campaigns might be structured. We had to face the problem of how to innovate CLEFwhile still preservingits traditionalcorebusiness,namely the benchma- ing activities carried out in the various tracks and tasks. The consensus, after lively and community-wide discussions, was to make CLEF an independent four-day event, no longer organized in conjunction with the European Conference on Research and Advanced Technology for Digital Libraries (ECDL) where CLEF has been running as a two-and-a-half-day wo- shop. CLEF 2010 thus consisted of two main parts: a peer-reviewed conference – the ?rst two days – and a series of laboratories and workshops – the second two days.

Editors and Affiliations

  • Department of Information Engineering, University of Padua, Padova, Italy

    Maristella Agosti

  • University of Padua, Padua, Italy

    Nicola Ferro

  • ISTI-CNR, Area Ricerca CNR, Pisa, Italy

    Carol Peters

  • ISLA, University of Amsterdam, Amsterdam, The Netherlands

    Maarten Rijke

  • Dublin City University, Dublin, Ireland

    Alan Smeaton

Bibliographic Information

Publish with us

Policies and ethics

Back to top

Search

Navigation