Fast Multi-Resolution Exhaustive Search Algorithm Based on Clustering for Efficient Image Retrieval

효율적인 영상 검색을 위한 클러스터링 기반 고속 다 해상도 전역 탐색 기법

  • Song, Byeong-Cheol (Dept. of Electronic Computer Science, Korea Advanced Institute of Science and Technology) ;
  • Kim, Myeong-Jun (Dept. of Electronic Computer Science, Korea Advanced Institute of Science and Technology) ;
  • Ra, Jong-Beom (Dept. of Electronic Computer Science, Korea Advanced Institute of Science and Technology)
  • 송병철 (한국과학기술원 전자전산학과) ;
  • 김명준 (한국과학기술원 전자전산학과) ;
  • 라종범 (한국과학기술원 전자전산학과)
  • Published : 2001.03.01

Abstract

In order to achieve optimal retrieval, i.e., to find the best match to a query according to a certain similarity measure, the exhaustive search should be performed literally for all the images in a database. However, the straightforward exhaustive search algorithm is computationally expensive in large image databases. To reduce its heavy computational cost, this paper presents a fast exhaustive multi-resolution search algorithm based on image database clustering. Firstly, the proposed algorithm partitions the whole image data set into a pre-defined number of clusters having similar feature contents. Next, for a given query, it checks the lower bound of distances in each cluster, eliminating disqualified clusters. Then, it only examines the candidates in the remaining clusters. To alleviate unnecessary feature matching operations in the search procedure, the distance inequality property is employed based on a multi-resolution data structure. The proposed algorithm realizes a fast exhaustive multi-resolution search for either the best match or multiple best matches to the query. Using luminance histograms as a feature, we prove that the proposed algorithm guarantees optimal retrieval with high searching speed.

유사도 측정자 (similarity measure)에 따라 문의자 (query)의 최적 정합자 (the best match)를 찾는 최적 검색 (optimal retrieval)을 위해서는 데이터베이스의 모든 영상들에 대해 전역 탐색 (exhaustive search)을 수행해야 한다. 그러나, 일반적인 전역 탐색은 방대한 계산량을 요구한다. 그 계산량을 줄이기 위해, 본 논문은 영상 데이터베이스의 클러스터링 (clustering)에 기반한 고속 다 해상도 전역 탐색 기법을 제안한다. 먼저 데이터베이스 내의 모든 영상들을 일정 수의 클러스터 (cluster)들로 나눈다. 각 클러스터는 유사한 특징 (feature)을 갖는 영상들로 구성된다. 그리고, 각 클러스터와 문의자 간 거리 (distance)의 하계(lower bound)를 구하고, 가능성이 전혀 없다고 판단될 경우 그 클러스터를 제거한다. 가능성이 있다고 판단된 클러스터들에 속한 후보 영상들 중에서 최적 정합자를 찾는다. 또한, 불필요한 특징 정합 연산을 줄이기 위해 다 해상도 데이터 구조에 기반한 거리 부등식 성질 (distance inequality property)을 유도하여, 탐색 과정에 적용한다. 제안한 기법은 고속 다 해상도 전역 탐색 기법으로서 단일 최적 정합자뿐만 아니라 다수의 상위 최적 정합자들도 정확하게 찾을 수 있다. 가장 보편적인 밝기 히스토그램 (luminance histogram)특징을 사용하여, 제안한 기법이 고속의 탐색 속도와 함께 최적 검색을 보장함을 증명해 보인다.

Keywords

References

  1. A. Pentland, R. W. Picard, and S. Sclaroff, 'Photobook: Tools for content-based mani-pulation of image databases,' International Journal of Computer Vision, vol. 18, no. 3, pp. 233-254, 1996 https://doi.org/10.1007/BF00123143
  2. M. Flicker, H. Sawhney, W. Niblack, J. Ashley, Q. Huang, B. Dom, M. Gorkani, J. Hafner, D. Lee, D. Petkovic, D. Steele, and P. Yanker, 'Query by image and video content: The QBIC system,' IEEE Computer, vol. 28, no. 9, pp. 23-32, Sept. 1995 https://doi.org/10.1109/2.410146
  3. J. R. Bach, C. Fuller, A. Gupta, A. Hampapur, B. Horowitz, R. Humphrey, R. C. Jain, and C. Shu, 'The virage image search engine: An open framework for image management,' in Proc. SPIE Conf. Storage and Retrieval for Image and Video Databases, vol. 2670, pp. 76-87, Feb. 1996 https://doi.org/10.1117/12.234785
  4. J. R. Smith and S. F. Chang, 'Exploring image functionalities in www applications-development of image/video search and editing engines,' Proc. ICIP, pp. 1-4, Oct. 1997 https://doi.org/10.1109/ICIP.1997.631953
  5. Y. Rui, T. Huang, and S. F. Chang, 'Image retrieval: current techniques, promising directions, and open issues,' Journal of Visual Communication and Image Representation, vol. 10, no. 1, pp. 39-62, 1999 https://doi.org/10.1006/jvci.1999.0413
  6. S. -K. Chang, C. W. Yan, D. C. Dimitroff, and T. Arndt, 'An intelligent image database system,' IEEE Trans. Software Eng., vol. 14, no. 5, 1988 https://doi.org/10.1109/32.6147
  7. M. Swain and D. Ballad, 'Color indexing,' International Journal of Computer Vision, vol. 7, no. 1, pp. 11-32, 1991 https://doi.org/10.1007/BF00130487
  8. J. Huang, S. R. Kumar, M. Mitra, W. -J. Zhu, and R. Zabih, 'Image indexing using color correlograms,' in Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 762-768, 1997 https://doi.org/10.1109/CVPR.1997.609412
  9. X. Wan and C. -C. J. Kuo, 'A new approach to image retrieval with hierarchical color clustering,' IEEE Trans. Circ. and Syst. for Video Technol., vol. 8, no. 5, pp. 628-643, Sept. 1998 https://doi.org/10.1109/76.718509
  10. S. -C. Pei and C. -M. Cheng, 'Extracting color features and dynamic matching for image data-base retrieval,' IEEE Trans. Circ. and Syst. for Video Technol., vol. 9, no. 3, pp. 501-512, April 1999 https://doi.org/10.1109/76.754779
  11. B. Manjunath and W. Ma, 'Texture features for browsing and retrieval of image data,' IEEE Trans. Pattern Anal. Machine Intell., vol. 18, no. 8, pp. 837-842, Aug. 1996 https://doi.org/10.1109/34.531803
  12. L. M. Kaplan, R. Murenzi, and K. R. Namuduri, 'Fast texture database retrieval using extended fractal features,' Proc. SPIE Conf. Storage and Retrieval for Image and Video Databases, vol. 3312, pp. 162-175, Jan. 1998 https://doi.org/10.1117/12.298440
  13. R. Mehrotra and J. Gary, 'Similar-shape retrieval in shape data management,' IEEE Computer, vol. 28, pp. 57-62, Sept. 1995 https://doi.org/10.1109/2.410154
  14. G. C.-H. Chuang and C.-C. J. Kuo, 'Wavelet descriptor of planar curves: Theory and applications,' IEEE Trans. Image Processing, vol. 5, no. 1, pp. 56-70, Jan. 1996 https://doi.org/10.1109/83.481671
  15. A. P. Berman and L. G. Shapiro, 'Efficient image retrieval with multiple distance measures,' in Proc. SPIE Conf. Storage and Retrieval for Image and Video Databases, vol. 3022, pp. 12-21, Feb. 1997 https://doi.org/10.1117/12.263409
  16. A. P. Berman and L. G. Shapiro, 'Triangle-inequality-based pruning algorithms with triangle tries,' Proc. SPIE Conf. Storage and Retrieval for Image and Video Databases, vol. 3656, pp. 356-365, Jan. 1999 https://doi.org/10.1117/12.333855
  17. J. Shepherd, X. Zhu, and N. Megiddo, 'A fast indexing method for multi-resolutionval nearest neighbor search,' Proc. SPIE Conf. Storage and Retrieval for Image and Video Databases, vol. 3656, pp. 350-355, Jan. 1999 https://doi.org/10.1117/12.333854
  18. Krishnamachari and M. A. Mottaleb, 'Hierarchical clustering algorithm for fast image retrieval,' in Proc. SPIE Conf. Storage and Retrieval for Image and Video Databases, vol. 3656, pp. 427-435, Jan. 1999 https://doi.org/10.1117/12.333862
  19. M. Sonka, V. Hlavac, and R. Boyle, Image Processing, Analysis, and Machine Vision, Pacific Groves, CA: Brooks/Cole Publishing Company, 1998
  20. W. Li and E. Salari, 'Successive elimination algorithm for motion estimation,' IEEE Trans. Image Processing, vol. 4, no. 1, Jan. 1995 https://doi.org/10.1109/83.350809
  21. ISO/IEC JTC1/SC29/WG11/N2466, 'Licensing agreement for the MPEG-7 content set,' Atlantic City, USA, Oct. 1998
  22. Test data sets for MPEG-7 core experiments CT1, CT2, and CT3, in [ftp://bs.hhi.de/pub/Color DataSet/]