ImageCLEF is the cross-language image retrieval track which is run as part of the Cross Language Evaluation Forum (CLEF) campaign. The ImageCLEF retrieval benchmark was established in 2003 with the aim of evaluating image retrieval from multilingual document collections. Images by their very nature are language independent, but often they are accompanied by texts semantically related to the image (e.g. textual captions or metadata). Images can then be retrieved using primitive features based on pixels with form the contents of an image (e.g. using a visual exemplar), abstracted features expressed through text or a combination of both. The language used to express the associated texts or textual queries should not a ect retrieval, i.e. an image with a caption written in English should be searchable in languages other than English.
ImageCLEF's Wikipedia Retrieval task provides a testbed for the systemoriented evaluation of visual information retrieval from a collection of Wikipedia images. The aim is to investigate retrieval approaches in the context of a large and heterogeneous collection of images (similar to those encountered on the Web) that are searched for by users with diverse information needs.
In 2011, ImageCLEF's Wikipedia Retrieval used a collection of over 237000 Wikipedia images that cover diverse topics of interest. These images are associated with unstructured and noisy textual annotations in English, French, and German.
Overall, based on the best run per group, as illustrated in the following Table, we are 4th out of 11 in MAP:
Based on the best run per group, as illustrated in the following Table, we are 4nd out of 11 in P@10:
No comments:
Post a Comment