DOI QR코드

DOI QR Code

Region Based Image Similarity Search using Multi-point Relevance Feedback

다중점 적합성 피드백방법을 이용한 영역기반 이미지 유사성 검색

  • 김덕환 (인하대학교 전자전기공학부) ;
  • 이주홍 (인하대학교 컴퓨터공학부) ;
  • 송재원 (인하대학교 대학원)
  • Published : 2006.12.31

Abstract

Performance of an image retrieval system is usually very low because of the semantic gap between the low level feature and the high level concept in a query image. Semantically relevant images may exhibit very different visual characteristics, and may be scattered in several clusters. In this paper, we propose a content based image rertrieval approach which combines region based image retrieval and a new relevance feedback method using adaptive clustering together. Our main goal is finding semantically related clusters to narrow down the semantic gap. Our method consists of region based clustering processes and cluster-merging process. All segmented regions of relevant images are organized into semantically related hierarchical clusters, and clusters are merged by finding the number of the latent clusters. This method, in the cluster-merging process, applies r: using v principal components instead of classical Hotelling's $T_v^2$ [1] to find the unknown number of clusters and resolve the singularity problem in high dimensions and demonstrate that there is little difference between the performance of $T^2$ and that of $T_v^2$. Experiments have demonstrated that the proposed approach is effective in improving the performance of an image retrieval system.

질의 이미지의 시각적 특징이 사용자의 상위 수준 개념을 잘 표현하지 못하기 때문에 이미지 검색 시스템의 성능은 보통 매우 낮다. 의미적으로 유사한 이미지들이 매우 다른 시각적 특징을 보일 수도 있으며 따라서 여러 개의 군집에 분산될 수 있다. 본 논문에서는 영역기반 이미지 검색과 군집-합병을 이용한 새로운 적합성 피드백 방법을 결합한 내용기반 이미지 검색 방법을 제안한다. 주요 목표는 의미적 차이를 줄이기 위해 의미적으로 관련된 군집들을 찾는 것이다. 제안된 방법은 영역기반 군집 과정과 군집-합병 과정으로 이루어진다. 적합한 이미지들의 모든 분할된 영역들을 의미적으로 관련된 계층적인 군집으로 구성한다. 잠재된 군집의 개수를 결정하고 근접한 군집들을 합병한 후 최종 군집의 대표점들로 다중 질의를 표현한다. 군집-합병 과정에서 군집의 개수를 찾고 고차원에서 특이점 문제를 해결하기 위하여 호텔링의 $T^2$ 대신에 v개의 주성분을 이용하는 $T_v^2$를 적용하였으며 $T^2$의 성능과 $T_v^2$의 성능의 차이가 없음을 보인다. 실험 결과는 제안된 방법이 내용기반 이미지 검색 시스템의 성능을 개선하는 데 효율적임을 보여준다.

Keywords

References

  1. R. D. Duda, P. E. Hart, D. G. Stork. Pattern Classification. John Wiley & Sons, Inc., New York, 2001
  2. M. Flickner, H. S. Sawhney, J. Ashley, Q. Huang, B. Dom, M. Gorkani, J. Hafner, D. Lee, D. Petkovic, D. Steele, and P. Yanker. Query by image and Video content: The qbic system. IEEE Computer, 28(9), 23-32, 1995 https://doi.org/10.1109/2.410146
  3. H. Hotelling. Multivariate Quality Control. In C. Eisenhart, M. W. Hastay, and W. A. Wallis, eds. Techniques of Statistical Analysis. N.Y., McGraw-Hill, 1947
  4. K.A. Hua, N. Yu, D. Liu. Query Decomposition: A Multiple Neighborhood Approach to Relevance Feedback Processing in Content-based Image Retrieval. Proceedings of IEEE Int. Conference on Data Engineering, 2005 https://doi.org/10.1109/ICDE.2006.123
  5. J. S. Hare, P.A.S. Sinclair, P. H. Lewis, K. Martinez, P. G. B. Enser, C. J. Sandom. Bridging the Semantic Gap in Multimedia Information Retrieval: Top down and Bottom-up approaches. Proceedings of 3rd European Semantic Web Conference, 2006
  6. Y. Ishikawa, It. Subramanya, C. Faloutsos. MindReader: Querying databases through multiple examples. Proceedings of the 24th VLDB Conference, 218-227, New York, USA, 1998
  7. R.A. Johnson, D.W. Wichern. Applied Multivariate Statistical Analysis. Prentice-Hall, N.J., 1998
  8. F. Jing, M. Li, H. J. Zhang, B. Zhang. Relevance feedback in region-based image retrieval. IEEE Transactions on Circuits and Systems for Video Technology, 14(5), 672-681, May 2004 https://doi.org/10.1109/TCSVT.2004.826775
  9. Q. Lv, M. Charikar, K. Li. Image Similarity Search with Compact Data Structures. Proceedings of CIKM'04, 208-217, Washington DC, Nov., 2004 https://doi.org/10.1145/1031171.1031213
  10. A. Natsev, R. Rastogu, K. Shim. WALRUS: A similarity retrieval algorithm for image databases. Proceedings of SIGMOD'99, Philadelphia, PA, 395-406, 1999 https://doi.org/10.1145/304181.304217
  11. K. Porkaew, K. Chakrabarti. Query Refinement for Multimedia Similarity Retrieval in MARS. Proceedings of the 7th ACM Multimedia Conference, 235-238, Orlando, Florida, 1999 https://doi.org/10.1145/319463.319613
  12. J. J. Rocchio. Relevance feedback in information retrieval. In Salton, G. (Ed), The SMART Retrieval system Experiments in Automatic Document Processing. Prentice Hall, Englewood Cliffs, NJ, 313-323
  13. Y. Rubner, L.J. Guibas, C. Tomasi. The earth mover's distance, Shimutil-dimensional scaling, and color-based image retrieval. Proc. ARPA Image Underatanding Workshop, 661-668, New Orelans, LA, May 1997
  14. Y. Rui, T. Huang, S. Mehrotra. Content-based image retrieval with relevance feedback in MARS. Proceedings of IEEE International Conference on Image Processing '97, Santa Barbara, CA, October 1997 https://doi.org/10.1109/ICIP.1997.638621
  15. J. Shi and J. Malik. Normalized Cuts and Image Segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(8), 888-905, August 2000 https://doi.org/10.1109/34.868688
  16. J. Z. Wang, J. Lie, G. Wiederhold. SIMPLIcity: Semantics-Sensitive Integrated Matching for Picture Libraries. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(9), 947-963, 2001 https://doi.org/10.1109/34.955109