Volume 9, Number 6, 548-560, DOI: 10.1007/s00530-003-0127-y

Robust content-based image indexing using contextual clues and automatic pseudofeedback

Y.Alp Aslandogan, ClementT. Yu, Ravishankar Mysore and Bo Liu

View Related Documents

Abstract

In this paper we present a robust information integration approach to identifying images of persons in large collections such as the Web. The underlying system relies on combining content analysis, which involves face detection and recognition, with context analysis, which involves extraction of text or HTML features. Two aspects are explored to test the robustness of this approach: sensitivity of the retrieval performance to the context analysis parameters and automatic construction of a facial image database via automatic pseudofeedback. For the sensitivity testing, we reevaluate system performance while varying context analysis parameters. This is compared with a learning approach where association rules among textual feature values and image relevance are learned via the CN2 algorithm. A face database is constructed by clustering after an initial retrieval relying on face detection and context analysis alone. Experimental results indicate that the approach is robust for identifying and indexing person images.

Keywords:  Content-based image retrieval - Evidence combination - Dempster-Shafer theory - Information integration - Image search engines

Y. Alp Aslandogan: Correspondence to:

Fulltext Preview

Image of the first page of the fulltext document