Browse > Article

Web Image Classification using Semantically Related Tags and Image Content  

Cho, Soo-Sun (충주대학교 컴퓨터정보공학과)
Publication Information
Journal of Internet Computing and Services / v.11, no.3, 2010 , pp. 15-24 More about this Journal
Abstract
In this paper, we propose an image classification which combines semantic relations of tags with contents of images to improve the satisfaction of image retrieval on application domains as huge image sharing sites. To make good use of image retrieval or classification algorithms on huge image sharing sites as Flickr, they are applicable to real tagged Web images. To classify the Web images by 'bag of visual word' based image content, our algorithm includes training the category model by utilizing the preliminary retrieved images with semantically related tags as training data and classifying the test images based on PLSA. In the experimental results on the Flickr Web images, the proposed method produced the better precision and recall rates than those from the existing method using tag information.
Keywords
Web image classification; semantically related tags; content based classification; Flickr; bag of visual word; PLSA;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 G-A. Miller, "WordNet: An On-line Lexical Database," International Journal of Lexicography, Vol. 3, No. 4, 1990.
2 T. Hofmann, "Probabilistic latent semantic analysis," In Proc. of the Fifteenth Conference on. Uncertainty in Artificial Intelligence (UAI'99), 1999.
3 J. Sivic, B. Russell, A. Efros, A. Zisserman, and W. Freeman. "Discovering object categories in image collections," Technical Report A. I. Memo 2005-005, Massachusetts Institute of Technology, 2005.
4 이시화, 이만형, 황대훈, "Web2.0 환경에서의 효율적인 이미지 검색을 위한 태그 클러스터링 시스템의 설계 및 구현," 멀티미디어학회 논문지, 제11권, 제8호, 2008.   과학기술학회마을
5 권대현, 홍준혁, 조수선, "워드넷 의미정보로 선별된 우선 태그와 이를 이용한 웹 이미지의 검색," 멀티미디어학회 논문지, 제12권, 제7호, 2009.   과학기술학회마을
6 J. Yang, C-W. Ngo, A. Hauptmann, and Y-G. Jiang, "Evaluating Bag-of-Visual-Words Representations in Scene Classification," In Proc. of the ACM Multimedia Information Retrieval Workshop (MIR 2007) at ACM Multimedia 2007, 2007.
7 L. Fei-Fei, R. Fergus, and P. Perona, "Learning generative visual models from few training examples: an incremental Bayesian approach tested on 101 object categories," In Proc. of Workshop on Generative-Model Based Vision, 2004.
8 S. Agarwal, A. Awan, and D. Roth, "Learning to detect objects in images via a sparse, part-based representation," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 26, No. 11, 2004.
9 R. Fergus, P. Perona, and A. Zisserman, "Object class recognition by unsupervised scale-invariant learning," In Proc. Computer Vision and Pattern Recognition, 2003.
10 http://people.csail.mit.edu/fergus/iccv2005/bagwords.html
11 G. Begelman, P. Keller, and F. Smadja, "Automated Tag Clustering: Improving search and exploration in the tag space," In Proc. of the Collaborative Web Tagging Workshop at WWW''06, 2006.
12 C-V. Damme, M. Hepp, and K. Siorpaes, "Folksontology: An integrated approach for turning folksonomies into ontologies," In Proc. of Workshop: Bridging the Gap between Semantic Web and Web 2.0 at European Semantic Web Conference, 2007.
13 Y-G. Jiang, C-W. Ngo, and J. Yang, "Towards optimal bag-of-features for object categorization and semantic video retrieval," In Proc. of ACM Int' Conf. on Image and Video Retrieval, 2007.
14 WordNet 3.0, "WordNet, a lexical database for the English language," http://wordnet.princeton.edu/, 2006.
15 J. Sivic, B. Russell, A. Efros, A. Zisserman, and W. Freeman, "Discovering object categories in image collections," In Proc. of International Conference on Computer Vision, 2005.
16 L. Fei-Fei, and P. Perona, "A bayesian hierarchical model for learning natural scene categories," In Proc. of the 2005 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, 2005.
17 D-G. Lowe, "Distinctive Image Features from Scale-Invariant Keypoints," International Journal of Computer Vision, Vol. 20, No.2, 2004.
18 P. Schmitz, "Inducing Ontology from Flickr Tags," In Proc. of the Collaborative Web Tagging Workshop at WWW''06, 2006.
19 A. Hotho, R. Jaschke, C. Schmitz, and G. Stumme, "Information Retrieval in Folksonomies: Search and Ranking," In Proc. of ESWC''06, 2006.
20 S. Angeletou, et al., "Bridging the Gap Between Folksonomies and the Semantic Web: An Experience Report," In Proc. of Workshop: Bridging the Gap between Semantic Web and Web 2.0 at European Semantic Web Conference, 2007.