DOI QR코드

DOI QR Code

컬러 분포와 WordNet상의 유사도 측정을 이용한 의미적 이미지 검색

Semantic Image Retrieval Using Color Distribution and Similarity Measurement in WordNet

  • 최준호 (조선대학교 대학원 전자계산학과) ;
  • 조미영 (조선대학교 대학원 전자계산학과) ;
  • 김판구 (조선대학교 컴퓨터공학부)
  • 발행 : 2004.08.01

초록

의미기반 이미지 검색에서의 의미적 내용 인식은 주석 위주의 텍스트 정보를 이용하는 것이 일반적이다. 이러한 텍스트 정보 기반 이미지 검색은 전통적인 검색 방법인 키워드 검색 기술을 그대로 사하여 쉽게 구현할 수 있으나, 텍스트의 개념적 매칭이 아닌 스트링 매칭이므로 주석 처리된 단어와 정확한 매칭이 없다면 검색할 수 없는 단점이 있었다. 이에 본 논문에서는 Ontology의 일종인 WordNet을 이용하여 깊이, 정보량, 링크 타입, 밀도 등을 고려한 단어간 의미 유사도를 측정하여 패턴 매칭의 문제점을 해결하고자 한다. 또한, 이미지의 컬러 분포 유사도를 측정하여 저차원 특징과 결합한 의미적 이미지 검색이 가능하도록 설계하였다. 제안된 검색 방안에 대해 'Microsoft Design Gallery Live'의 주석을 포함한 이미지를 대상으로 실험한 결과, 기존 의미기반 검색 시스템보다 향상된 결과를 확인하였다.

Semantic interpretation of image is incomplete without some mechanism for understanding semantic content that is not directly visible. For this reason, human assisted content-annotation through natural language is an attachment of textual description to image. However, keyword-based retrieval is in the level of syntactic pattern matching. In other words, dissimilarity computation among terms is usually done by using string matching not concept matching. In this paper, we propose a method for computerized semantic similarity calculation In WordNet space. We consider the edge, depth, link type and density as well as existence of common ancestors. Also, we have introduced method that applied similarity measurement on semantic image retrieval. To combine wi#h the low level features, we use the spatial color distribution model. When tested on a image set of Microsoft's 'Design Gallery Line', proposed method outperforms other approach.

키워드

참고문헌

  1. George A. Miller, 'Introduction to WordNet : An On-line Lexical Database,' International Journal of Lexicography, 1990 https://doi.org/10.1093/ijl/3.4.235
  2. Sussna, 'WordSense Disambiguation for Free-text Indexing Using a Massive Semantic Network,' Proceedings of the Second International Conference on Information and Knowledge Management, CIKM93 https://doi.org/10.1145/170088.170106
  3. Philip Resnik, 'Using Information Content to Evaluate Semantic Similarity in a Taxonomy,' Proceedings of the 14th International Joint Conference on Artificial Intelligence, 1995
  4. R. Richardson, A. F. Smeaton, 'Using WordNet in a Knowledge-Based Approach to Information Retrieval,' Working paper, CA-0395, School of Computer Applications, Dublin City University, Ireland, 1995
  5. Eneko Agirre and German Rigau, 'Word sense disambiguation using conceptual density,' In Proceedings of the 16th International Conference on Computational Linguistics, pp. 1622, Copenhagen, 1996
  6. Jay J Jiang, David W. Conrath, 'Semantic Similarity Based Corpus Statistics and Lexical Taxonomy,' Proc. Of International Conference Research on Computational Linguistics, 1997
  7. Y. Alp Aslandogan. et al., 'Using Semantic contents and WordNet in image retrieval,' Proceeding of ACM SIGIR 97, Philadelphia PA, USA, pp.286-295, 1997 https://doi.org/10.1145/278459.258591
  8. J. Z. Wang, J. Li, D. Chan, G. Wiederhold, 'Semantics-sensitive Retrieval or Digital Picture Libraries,' D-Lib. Magazine, 1999
  9. Y. C. Park, F. Golshani, S. Panchanathan, 'Conceptualization and Ontology : Tools for Efficient Storage and Retrieval of Semantic Visual Information,' Internet Multimedia Management Systems Conference, 2000 https://doi.org/10.1117/12.403824
  10. Y. C. Park, P. K. Kim, F. Golshani, S. Panchanathan, 'Concept-based visual information management with large lexical corpus,' DEXA, 2001
  11. http://www.cogsci.princeton.edu/~wn/
  12. Kobus Barnard, Pinar Duygulu, David Forsyth, 'Clustering Art,' In IEEE conf. on Computer vision and Pattern Recognition, 2001 https://doi.org/10.1109/CVPR.2001.990994
  13. K. Barnard, D. A. Forsyth, 'Learning the semantics of words and pictures,' In Int. Conf. on Computer Vision, 2001 https://doi.org/10.1109/ICCV.2001.937654
  14. Guarino, N. and Welty, C., 'Supporting Ontological Analysis of Taxonomic Relationship,' Data and Knowledge Engineering (in press), 2001 https://doi.org/10.1016/S0169-023X(01)00030-1
  15. Budanitsky, A. and G. Hirst, 'Semantic Distance in WordNet : An Experimental, Application-oriented Evaluation of Five Measures,' Workshop on WordNet and Other Lexical Resources, in the North American Chapter of the Association for Computational Linguistics (NAACL-2000), Pittsburgh, PA, June, 2001
  16. K. Barnard, P. Duygulg, J. F. G. de Freitas, D. A. Forsyth 'Object Recognition as Machine Translation : Learning a Lexicon for a Fixed Image vocabulary,' Seventh European Conference on Computer Vision, 2002