Evaluating Systems for Multilingual and Multimodal Information Access

1. Front Matter

   PDF

2. What Happened in CLEF 2008

   1. What Happened in CLEF 2008

      • Carol Peters

      Pages 1-14

3. Part I: Multilingual Textual Document Retrieval (Ad Hoc)

   1. CLEF 2008: Ad Hoc Track Overview

      • Eneko Agirre, Giorgio Maria Di Nunzio, Nicola Ferro, Thomas Mandl, Carol Peters

      Pages 15-37

4. TEL@CLEF

   1. Logistic Regression for Metadata: Cheshire Takes on Adhoc-TEL

      • Ray R. Larson

      Pages 38-41

   2. Query Expansion via Library Classification System

      • Alessio Bosca, Luca Dini

      Pages 42-49

   3. Experiments on a Multinomial Language Model versus Lucene’s Off-the-Shelf Ranking Scheme and Rocchio Query Expansion (TEL@CLEF Monolingual Task)

      • Jorge Machado, Bruno Martins, José Borbinha

      Pages 50-57

   4. WikiTranslate: Query Translation for Cross-Lingual Information Retrieval Using Only Wikipedia

      • Dong Nguyen, Arnold Overwijk, Claudia Hauff, Dolf R. B. Trieschnigg, Djoerd Hiemstra, Franciska de Jong

      Pages 58-65

   5. UFRGS@CLEF2008: Using Association Rules for Cross-Language Information Retrieval

      • André Pinto Geraldo, Viviane P. Moreira

      Pages 66-74

   6. CLEF 2008 Ad-Hoc Track: Comparing and Combining Different IR Approaches

      • Jens Kürsten, Thomas Wilhelm, Maximilian Eibl

      Pages 75-82

   7. Multi-language Models and Meta-dictionary Adaptation for Accessing Multilingual Digital Libraries

      • Stephane Clinchant, Jean-Michel Renders

      Pages 83-88

5. Persian@CLEF

   1. Improving Persian Information Retrieval Systems Using Stemming and Part of Speech Tagging

      • Reza Karimpour, Amineh Ghorbani, Azadeh Pishdad, Mitra Mohtarami, Abolfazl AleAhmad, Hadi Amiri et al.

      Pages 89-96

   2. Fusion of Retrieval Models at CLEF 2008 Ad Hoc Persian Track

      • Zahra Aghazade, Nazanin Dehghani, Leili Farzinvash, Razieh Rahimi, Abolfazl AleAhmad, Hadi Amiri et al.

      Pages 97-104

   3. Cross Language Experiments at Persian@CLEF 2008

      • Abolfazl AleAhmad, Ehsan Kamalloo, Arash Zareh, Masoud Rahgozar, Farhad Oroumchian

      Pages 105-112

6. Robust-WSD

   1. Evaluating Word Sense Disambiguation Tools for Information Retrieval Task

      • Fernando Martínez-Santiago, José M. Perea-Ortega, Miguel A. García-Cumbreras

      Pages 113-117

   2. IXA at CLEF 2008 Robust-WSD Task: Using Word Sense Disambiguation for (Cross Lingual) Information Retrieval

      • Eneko Agirre, Arantxa Otegi, German Rigau

      Pages 118-125

   3. SENSE: SEmantic N-levels Search Engine at CLEF2008 Ad Hoc Robust-WSD Track

      • Annalina Caputo, Pierpaolo Basile, Giovanni Semeraro

      Pages 126-133

   4. IR-n in the CLEF Robust WSD Task 2008

      • Sergio Navarro, Fernando Llopis, Rafael Muñoz

      Pages 134-137

   5. Query Clauses and Term Independence

      • José R. Pérez-Agüera, Hugo Zaragoza

      Pages 138-145

   6. Analysis of Word Sense Disambiguation-Based Information Retrieval

      • Jacques Guyot, Gilles Falquet, Saïd Radhouani, Karim Benzineb

      Pages 146-154

   7. Crosslanguage Retrieval Based on Wikipedia Statistics

      • Andreas Juffinger, Roman Kern, Michael Granitzer

      Pages 155-162

The ninth campaign of the Cross-Language Evaluation Forum (CLEF) for European languages was held from January to September 2008. There were seven main eval- tion tracks in CLEF 2008 plus two pilot tasks. The aim, as usual, was to test the p- formance of a wide range of multilingual information access (MLIA) systems or s- tem components. This year, 100 groups, mainly but not only from academia, parti- pated in the campaign. Most of the groups were from Europe but there was also a good contingent from North America and Asia plus a few participants from South America and Africa. Full details regarding the design of the tracks, the methodologies used for evaluation, and the results obtained by the participants can be found in the different sections of these proceedings. The results of the CLEF 2008 campaign were presented at a two-and-a-half day workshop held in Aarhus, Denmark, September 17–19, and attended by 150 resear- ers and system developers. The annual workshop, held in conjunction with the European Conference on Digital Libraries, plays an important role by providing the opportunity for all the groups that have participated in the evaluation campaign to get together comparing approaches and exchanging ideas. The schedule of the workshop was divided between plenary track overviews, and parallel, poster and breakout sessions presenting this year’s experiments and discu- ing ideas for the future. There were several invited talks.

• Cross-Language Evaluation Forum
• Wiki
• answer validation
• cross-language
• cross-language queries
• cross-lingual
• data mining
• image retrieval
• information retrieval
• machine learning
• medical images
• natural language processing
• semantic analysis
• video retrieval

• Istituto di Scienza e Tecnologie dell’Informazione, CNR, Pisa, Italy

  Carol Peters

• RWTH Aachen University, Aachen, Germany

  Thomas Deselaers

• University of Padua, Padua, Italy

  Nicola Ferro

• LSI-UNED, Madrid, Spain

  Julio Gonzalo, Anselmo Peñas

• Dublin City University, Dublin 9, Ireland

  Gareth J. F. Jones

• Helsinki University of Technology, Espoo, Finland

  Mikko Kurimo

• University of Hildesheim, Hildesheim, Germany

  Thomas Mandl

• Humboldt University Berlin, Germany

  Vivien Petras

Policies and ethics