Content-based Image Retrieval using Weighted Color Histogram and Spatial Distribution of Dominant Colors

가중 색 히스토그램과 지배적인 색의 영상 공간 분포를 이용한 내용기반 영상 검색

  • 박두식 (삼성종합기술원 신호처리Lab. 전문연구원) ;
  • 한준희 (포항공과대학교 컴퓨터공학과)
  • Published : 2001.03.01

Abstract

본 논문에서는 특정한 객체의 색 분포 모델링으로부터 얻어지는 가중 색 히스토그램과 지배적인 색의 영상공간 분포특성을 이용한 내용기반 영상 검색 방법을 제안한다. 특정한 객체의 예로 사람 얼굴을 선택했고, 그것의 색 분포를 u*-v* 색도 공간에서 모델링 했으며, 모델의 정규화된 부피를 균등 양자화된 색도 공간의 각 빈(bin)의 히스토그램 값에 대한 가중치로 결정하고, 결정된 가중치를 히스토그램 정합 과정에 적용하였다. 또한 색 히스토그램 값이 큰 특정한 수의 빈으로 정의되는 지배적인 색의 영상 공간 분포를 가중 색 히스토그램과 함께 유사성의 측정기준으로 사용하였다. 제안한 검색 방법을 500여개의 영상에 대해 실험한 결과 제안한 방법이 얼굴을 포함하는 영상을 질의로 주었을 때 얼굴을 포함하는 영상을 우선적으로 찾는데 효과적임을 확인하였다.

Keywords

References

  1. John R. Smith, 'Integrated Spatial and Feature Image Systems: Retrieval, Analysis and Compression,' Columbia University, Ph.D. Dissertation, 1997
  2. W. Niblack, R. Barber, W. Equitz, M. Flickner, E. Glasman, D. Petkovic, P. Yanker, and C. Faloutsos, 'The qbic project: Querying images by content using color, texture, and shape,' In Storage and Retrieval for Image and Video Database(SPIE), vol. 1908, pp. 173-187, 1993 https://doi.org/10.1117/12.143648
  3. J. R. Bach, C. Fuller, A. Gupta, A. Hampapur, B. Horowitz, R. Humphrey, R. C. Jain, and C. Shu, 'Virage image search engine: an open framework for image management,' In Symposium on Electronic Imaging: Science and Technology - Storage and Retrieval for Image and Video Database(SPIE), vol. 2670, pp.76-87, 1996 https://doi.org/10.1117/12.234785
  4. Hidenori Yamamoto, Hidehiko Iwasa, Naokazu Yokoya, Haruo Takemura, 'Content-Based Similarity Retrieval of Image Based on Spatial Color Distributions,' In ICIAP99, pp. 951-956, 1999 https://doi.org/10.1109/ICIAP.1999.797718
  5. A. Pentland, P. W. Picard, and S. Sclaroff', 'Photobook: Content-based manipulation of image databases,' International Journal of Computer Vision, vol. 18, no. 3, pp.233-254, 1996 https://doi.org/10.1007/BF00123143
  6. Serge Belongie, Chad Carson, Hayit Greenspan, and Jitendra Malik, 'Color- and Texture-based Image Segmentation Using EM and Its Application to Content-based Image Retrieval,' In International Conference on Computer Vision, 1998 https://doi.org/10.1109/ICCV.1998.710790
  7. 유태웅, 오일석, '색채 분포 정보에 기반한 얼굴 영역 추출', 정보과학회논문지(B), 제 24 권 제 2 호, pp. 180-192, 1997
  8. Jie Yang, Weier Lu, and Alex Waibel, 'Skin-colour modeling and adaptation,' School of Computer Science, CMU, Technical Report CMU-CS-97-146, 1997
  9. Ming-Hsuan Yang and Narendra Ahuja, 'Gaussian Mixture Modeling of Human Skin Color and Its Applications in Image and Video Databases,' In Proceedings of SPIE/EIT Storage and Retrieval for Image and Video Databases (SPIE 99), 1999 https://doi.org/10.1117/12.333865
  10. Ming-Hsuan Yang and Narendra Ahuja, 'Detecting Human Faces in Color Images,' In IEEE International Conference on Image Processing, vol. 1, pp. 127-130, 1998
  11. Douglas Chai and King N. Ngan, 'Locating Facial Region of a Head-and-Shoulders Color Image,' In 3rd IEEE International Conference on Automatic Face and Gesture Recognition(FG'98), 1998 https://doi.org/10.1109/AFGR.1998.670936
  12. Lifang Gu and Don Bone, Skin Colour Region Detection in MPEG Video Sequences, In 10th International Conference on Image Analysis and Processing, pp. 898-903, 1999 https://doi.org/10.1109/ICIAP.1999.797709
  13. 김남호 김형곤 고성제, '색상 움직임을 이용한 얼굴 특징점 자동 추출', 전자공학회논문지(S), vol. 35, no. 8, pp. 55-67, 1998
  14. Jie Yang and Alex Waibel, 'A Real-Time Face Tracker,' In Proceedings of the Third IEEE Workshop on Applications of Computer Vision, 1996 https://doi.org/10.1109/ACV.1996.572043
  15. Douglas Chai and King N. Ngan, Face Segmentation Using Skin-Color Map in Videophone Applications, IEEE Transactions on Circuits and Systems for Video Technology, vol. 9, no. 4, pp. 551-564, 1999 https://doi.org/10.1109/76.767122
  16. 양애경 이근수 최형일, '동영상에서 예측된 얼굴 영역의 기울어짐 보상에 의한 얼굴 구성요소 추출', 정보과학회논문지(B) 제 26권 제 11 호, pp. 1332-1341, 1999
  17. Michael J. Swain and Dana H. Ballard, 'Color indexing,' International Journal of Computer Vision, vol. 7, no. 1, pp. 11-32, 1991 https://doi.org/10.1007/BF00130487
  18. Xia Wan and C.-C. Jay Kuo, 'Color distribution analysis and quantization for image retrieval,' SPIE proceedings, vol. 2670, 1996
  19. Du-Sik Park, Jong-Seung Park, TaeYong Kim, and Joon Hee Han, Image Indexing Using Weighted Color Histogram, In 10th International Conference on Image Analysis and Processing(ICIAP'99), pp. 909-914, 1999 https://doi.org/10.1109/ICIAP.1999.797711
  20. 류명분 우석훈 박동권 원치선, '블록단위 특성분류를 이용한 컬러 영상의 검색', 전자공학회논문지(S), vol. 34, no. 12, pp. 81-89, 1997
  21. 강현인 백광렬, '가변 블록 크기와 블록 매칭 알고리즘의 조합에 의한 내용기반 화상 검색', 전자공학회논문지(S), vol. 35, no. 8, pp. 47-54, 1998
  22. K.C.Ravishankar, B.G. Prasad, S.K. Gupta, and K.K. Biswas, Dominant color region based indexing for cbir, In 10th International Conference on Image Analysis and Processing(ICIAP'99), pp. 887-892, 1999 https://doi.org/10.1109/ICIAP.1999.797707
  23. Hidenori Yamamoto, Hidehiko Iwasa, Naokazu Yokoya, and Haruo Takemura, Content-based similarity retrieval of images based on spatial color distributions, In 10th International Conference on Image Analysis and Processing(ICIAP'99), pp. 951-956, 1999 https://doi.org/10.1109/ICIAP.1999.797718
  24. Kankanhalli S. Mohan, Mehtre M. Babu, and Huang Hock Yiung, 'Color and spatial feature for content-based image retrieval,' Pattern Recognition Letters, vol. 20, no 1, pp. 109-118, 1999 https://doi.org/10.1016/S0167-8655(98)00100-7
  25. J. Huang, S. R. Kumar, M. Mitra, W. J. Zhu, and R. Zabih , 'Image Indexing using color correlograms,' CVPR, 1997 https://doi.org/10.1109/CVPR.1997.609412
  26. Richard O. Duda and Peter E. Hart, Pattern Classification and Scene Analysis, John Wiley & Sons, 1973
  27. Alan Jennings, 'Matrix Computation for Engineers and Scientists,' John Wiley & Sons, pp. 235-241, 1978
  28. Chad Carson and Serge Belongie, 'Region-Based Image Querying,' IEEE Workshop on the Content-Based Access of Images and Video Libraries, 1997 https://doi.org/10.1109/IVL.1997.629719
  29. Kankanhalli S. Mohan, Mehtre M. Babu, and Huang Hock Yiung, 'Color and spatial feature for content-based image retrieval,' Pattern Recognition Letters, vol. 20, no 1, pp. 109-118, 1999 https://doi.org/10.1016/S0167-8655(98)00100-7