Browse > Article

Content Based Image Retrieval using 8AB Representation of Spatial Relations between Objects  

Joo, Chan-Hye (SK 텔레콤 Service 기술연구원)
Chung, Chin-Wan (한국과학기술원 전자전산학과)
Park, Ho-Hyun (중앙대학교 전자전기공학부)
Lee, Seok-Lyong (한국외국어대학교 산업정보시스템공학부)
Kim, Sang-Hee (국방과학연구소 지형영상처리팀)
Abstract
Content Based Image Retrieval (CBIR) is to store and retrieve images using the feature description of image contents. In order to support more accurate image retrieval, it has become necessary to develop features that can effectively describe image contents. The commonly used low-level features, such as color, texture, and shape features may not be directly mapped to human visual perception. In addition, such features cannot effectively describe a single image that contains multiple objects of interest. As a result, the research on feature descriptions has shifted to focus on higher-level features, which support representations more similar to human visual perception like spatial relationships between objects. Nevertheless, the prior works on the representation of spatial relations still have shortcomings, particularly with respect to supporting rotational invariance, Rotational invariance is a key requirement for a feature description to provide robust and accurate retrieval of images. This paper proposes a high-level feature named 8AB (8 Angular Bin) that effectively describes the spatial relations of objects in an image while providing rotational invariance. With this representation, a similarity calculation and a retrieval technique are also proposed. In addition, this paper proposes a search-space pruning technique, which supports efficient image retrieval using the 8AB feature. The 8AB feature is incorporated into a CBIR system, and the experiments over both real and synthetic image sets show the effectiveness of 8AB as a high-level feature and the efficiency of the pruning technique.
Keywords
CBIR; Shape feature; image retrieval; spatial relation;
Citations & Related Records
연도 인용수 순위
  • Reference
1 J. R. Smith and S.-F. Chang, 'VisualSEEk: A Fully Automated Content-based Image Query System,' ACM Multimedia 96, Boston, MA, 1996
2 이동호, 송용준, 김형주, 'SCARLET:웨이브릿 변환을 이용한 내용기반 이미지 검색 시스템의 설계 및 구현', 정보과학회 논문지(C), Vol.3, No.4, pp.353-364, Aug. 1997
3 S.K. Chang, Q.Y. Shi, and C.W. Yan, 'Iconic Indexing by 2-D Strings,' IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 9, no. 3, pp. 413-428, May 1987   DOI
4 C.C. Chang, 'Spatial Match Retrieval of Symbolic Pictures,' J. Information Science and Eng., vol. 7, pp.405-422, Dec. 1991
5 Po-Whei Huang, Chu-Hui Lee. 'Image Database Design Based on 9D-SPA Representation for Spatial Relations,' IEEE Transactions on Knowledge and Data Engineering, vol. 16, no. 12, pp. 1486-1496, Dec. 2004   DOI   ScienceOn
6 김덕환, 김시우, 박광순, 이병구, 차광호, 정진완, 'COSMIC : 영역 지식과 시각 정보를 이용한 내용 기반 멀티미디어 검색 시스템의 설계 및 구현', 정보과학회 논문지(C), 5권 1호, pp.14-28, Feb. 1999
7 G. Bilodeau and R. Bergevin, 'PLASTIQUE: Image retrieval based on cognitive theories,' VI 2003, pp.292-298, 2003
8 http://www.inf.ethz.ch/personal/gaertner/miniball.html
9 Bilodeau, G.A., Bergevin, R., 'Constructing and matching fuzzy graphs of volumetric primitives hypotheses,' in Vision Interface 2003, 2003
10 Huet B., A.D.J. Cross and E.R. Hancock, 'Shape Retrieval by Inexact Graph Matching,' IEEE International Conference on Multimedia Computing and Systems (ICMCS'99), Florence, Italy, page 772-776, 7-11 Jun. 1999
11 영상정보 특화연구센터 센서융합연구실 1단계 중간보고서, 국방과학연구소, p. 187, 2005
12 S.Y. Lee and F.J. Hsu, 'Spatial Reasoning and Similarity Retrieval of Images Using 2D C-String Knowledge Representation,' Pattern Recognition, vol. 25, no. 3, pp. 305-318, Mar. 1992   DOI   ScienceOn
13 S.Y. Lee and F.J. Hsu, '2D C-String: A New Spatial Knowledge Representation for Image Database Systems,' Pattern Recognition, vol. 23, no. 10, pp. 1077-1087, Oct. 1990   DOI   ScienceOn
14 P.W. Huang and Y.R. Jean, 'Using 2D PC+-Strings as Spatial Knowledge Representation for Image Database Systems,' Pattern Recognition, vol. 27, no. 9, pp. 1249-1257, Sept. 1994   DOI   ScienceOn
15 B. GAartner, 'Fast and Robust Smallest Enclosing Balls,' Proc. 7th Annual European Symposium on Algorithms (ESA), Lecture Notes in Computer Science $1643{\copyright}Springer-Verlag$, pp. 325-338, 1999
16 T. S. Huang, S. Mehratra, and K. Ramchandran, 'Multimedia Analysis and Retrieval System (MARS) project,' Appeared in Proceedings of the 33rd Annual Clinic on Library Application of Data Processing - Digital Image Access and Retrieval, University of Illinois at Urbana-Champaign, Mar. 1996
17 Myron Flickner and et. al, 'Query by Image and Video Content: The QBIC system,' IEEE Computer, 28(9), pp.23-32, 1995
18 R. Baeza-Yates, B. Ribeiro-Neto. 'Modern Information Retrieval,' Addison-Wesley, 1999