Browse > Article
http://dx.doi.org/10.9717/kmms.2016.19.8.1498

Semantic Image Annotation and Retrieval in Mobile Environments  

No, Hyun-Deok (Division of Computer and Information Engineering., Hoseo University)
Seo, Kwang-won (Division of Computer and Information Engineering., Hoseo University)
Im, Dong-Hyuk (Division of Computer and Information Engineering., Hoseo University)
Publication Information
Abstract
The progress of mobile computing technology is bringing a large amount of multimedia contents such as image. Thus, we need an image retrieval system which searches semantically relevant image. In this paper, we propose a semantic image annotation and retrieval in mobile environments. Previous mobile-based annotation approaches cannot fully express the semantics of image due to the limitation of current form (i.e., keyword tagging). Our approach allows mobile devices to annotate the image automatically using the context-aware information such as temporal and spatial data. In addition, since we annotate the image using RDF(Resource Description Framework) model, we are able to query SPARQL for semantic image retrieval. Our system implemented in android environment shows that it can more fully represent the semantics of image and retrieve the images semantically comparing with other image annotation systems.
Keywords
Image tag; Ontology; Image Annotation; Mobile; Image retrieval;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 C. Yeung, N. Gibbins, and N. Shadbolt, "Contextualising Tags in Collaborative Tagging Systems," Proceedings of the Twentieth ACM Conference on Hypertext and Hypermedia, pp. 251-260, 2009.
2 S. Fadzli and R. Setchi, "Semantic Approach to Image Retrieval Using Statistical Models Based on a Lexical Ontology," Proceedings of the 14th International Conference on Knowledge-based and Intelligent Information & Engineering Systems, pp. 240-250, 2010.
3 L. Hollink, G. Schreiber, J. Wielemaker, and B. Wielinga, "Semantic Annotation of Image Collections," Proceedings of KCAP , pp. 41-48, 2003.
4 K. Park, J. Jeong, and D. Lee, "OLYBIA: Ontology-based Automatic Annotation System Using Semantic Inference Rules," Proceedings of International Conference on Database Systems for Advanced Application, pp. 485-496, 2007.
5 N. Chen, Q. Zhou, and V. Prasnna, "Under-Standing Web Images by Object Relation Network," Proceedings of World Wide Web, pp. 291-300, 2012.
6 H. Shin and B. Chang, "Design and Implementation of Location-based Mobile Bus Guide System using Social Tagging," Journal of Korea Multimedia Society, Vol. 15, No. 2, pp. 281-289, 2012.   DOI
7 D. Im and G. Park, "Linked Tag: Image Annotation using Semantic Relationships between Image Tags," Journal of Multimedia Tools and Applications, Vol. 74, No. 7, pp. 2273-2287, 2015.   DOI
8 D. Im and G. Park, "STAG: Semantic Image Annotation Using Relationships between Tags," Proceedings of Information Science and Applications, pp. 1-2, 2013.
9 J. Jeong, H. Hong, and D. Lee, "i-TagRanker: an Efficient Tag Ranking System for Image Sharing and Retrieval Using the Semantic Relationships between Tags," Journal of Multimedia Tools and Applications, Vol. 62, No. 2, pp. 451-478, 2013.   DOI
10 H. No, K. Seo, and D. Im, "Design of Ontology-Based Image Annotation and Retrieval System in Android Environment," Proceedings of the Fall Conference of the Korea Multimedia Society, pp, 1748-1750, 2015.
11 S. Xia, X. Gong, W. Wang, Y. Tian, X. Yang, and J. Ma, "Context-aware Image Annotation and Retrieval on Mobile Device," Proceedings of Multimedia and Information Technology, pp. 111-114, 2010.
12 W. Viana, J. Filho, J. Gensel, M. Oliver, and H. Martin, "PhotoMap: Automatic Spatiotemporal Annotation for Mobile Photos," Proceeding of Web and Wireless Geographical Information Systems, pp. 187-201, 2007.
13 Resource Description Framework(RDF): Concepts and Abstract Syntax, http://www.w3.org/TR/2014/REC-rdf11-concepts-20140225/, W3C Recommendation, (accessed Jan., 14, 2016).
14 SPARQL Query Language for RDF, http://w3c.org/TR/rdf-sparql-query/, (accessd Jan., 14, 2016).
15 N. Magesh and P. Thangarai, "Semantic Image Retrieval Based on Ontology and SPARQL Query," Proceedings of ICACT, pp. 12-16, 2011.