CIVR 2010: Unsupervised Multi-Feature Tag Relevance Learning for Social Image Retrieval

The CIVR 2010 paper entitled Unsupervised Multi-Feature Tag Relevance Learning for Social Image Retrieval by Xirong Li, Cees Snoek, and Marcel Worring is available online. The work extends upon our tag-relevance approach. Interpreting the relevance of a user-contributed tag with respect to the visual content of an image is an emerging problem in social image retrieval. In the literature this problem is tackled by analyzing the correlation between tags and images represented by specific visual features. Unfortunately, no single feature represents the visual content completely, e.g., global features are suitable for capturing the gist of scenes, while local features are better for depicting objects. To solve the problem of learning tag relevance given multiple features, we introduce in this paper two simple and effective methods: one is based on the classical Borda Count and the other is a method we name UniformTagger. Both methods combine the output of many tag relevance learners driven by diverse features in an unsupervised, rather than supervised, manner. Experiments on 3.5 million social-tagged images and two test sets verify our proposal. Using learned tag relevance as updated tag frequency for social image retrieval, both Borda Count and UniformTagger outperform retrieval without tag relevance learning and retrieval with single-feature tag relevance learning. Moreover, the two unsupervised methods are comparable to a state-of-the-art supervised alternative, but without the need of any training data.

http://staff.science.uva.nl/~cgmsnoek/index.php/civr-2010-unsupervised-multi-feature-tag-relevance-learning-for-social-image-retrieval/