E-Book Overview
This book presents the thoroughly refereed post-proceedings of a workshop by the Cross-Language Evaluation Forum Campaign, CLEF 2002, held in Rome, Italy in September 2002.
The 43 revised full papers presented together with an introduction and run data in an appendix were carefully reviewed and revised upon presentation at the workshop. The papers are organized in topical sections on systems evaluation experiments, cross language and more, monolingual experiments, mainly domain-specific information retrieval, interactive issues, cross-language spoken document retrieval, and cross-language evaluation issues and initiatives.
E-Book Content
Preface
The third campaign of the Cross-Language Evaluation Forum (CLEF) for European languages was held from January to September 2002. Participation in this campaign showed a slight rise in the number of participants with, 37 groups from both academia and industry and a steep rise in the number of experiments they submitted for one or more of the five official tracks. The campaign culminated in a two-day workshop held in Rome, Italy, 19–20 September, immediately following the Sixth European Conference on Digital Libraries (ECDL 2002), attended by nearly 70 researchers and system developers. The objective of the workshop was to bring together the groups that had participated in CLEF 2002 so that they could report on the results of their experiments. Attendance at the workshop was thus limited to participants in the campaign plus several invited guests with recognized expertise in the multilingual information access field. This volume contains thoroughly revised and expanded versions of the preliminary papers presented at the workshop accompanied by a complete run-down and detailed analysis of the results, and it thus provides an exhaustive record of the CLEF 2002 campaign. CLEF 2002 was conducted within the framework of a project of the Information Society Technologies programme of the European Commission (IST-200031002). The campaign was organized in collaboration with the US National Institute of Standards and Technology (NIST) and with the support of the DELOS Network of Excellence for Digital Libraries. The support of NIST and DELOS in the running of the evaluation campaign is gratefully acknowledged. We would also like to thank the other members of the Workshop Steering Committee for their assistance in the coordination of this event. June 2003
Carol Peters Martin Braschler Julio Gonzalo Michael Kluck
VI
Preface
CLEF 2002 Workshop Steering Committee Martin Braschler Khalid Choukri Julio Gonzalo Arroyo Donna Harman Noriko Kando Michael Kluck Patrick Kremer Carol Peters Peter Sch¨ auble Laurent Schmitt Ellen Voorhees
Eurospider Information Technology AG, Switzerland Evaluations and Language Resources Distribution Agency, France Universidad Nacional de Educaci´ on a Distancia, Spain National Institute of Standards and Technology, USA National Institute of Informatics, Japan IZ Sozialwissenschaften, Bonn, Germany Institute de Information Scientifique et Technique, Vandoevre, France Italian National Research Council, Pisa, Italy Eurospider Information Technology AG, Switzerland Institute de Information Scientifique et Technique, Vandoevre, France National Institute of Standards and Technology, USA
Table of Contents
Introduction C. Peters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
I
System Evaluation Experiments at CLEF 2002
CLEF 2002 – Overview of Results M. Braschler . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
Cross-Language and More Cross-Language Retrieval Experiments at CLEF 2002 A. Chen . . . . . . . .