Web-based Image Retrieval and Classification System using Sketch Query

스케치 질의를 통한 웹기반 영상 검색과 분류 시스템

  • Published : 2003.08.01

Abstract

With the explosive growth n the numbers and sizes of imaging technologies, Content-Based Image Retrieval (CBIR) has been attacked the interests of researchers in the fields of digital libraries, image processing, and database systems. In general, in the case of query-by-image, in user has to select an image from database to query, even though it is not his completely desired one. However, since query-by-sketch approach draws a query shape according to the user´s desire it can provide more high-level searching interface to the user compared to the query-b-image. As a result, query-by-sketch has been widely used. In this paper, we propose a Java-based image retrieval system that consists of sketch query and image classification. We use two features such as color histogram and Haar wavelets coefficients to search similar images. Then the Leave-One-Out method is used to classify database images. The categories of classification are photo & painting, city & nature, and sub-classification of nature image. By using the sketch query and image classification, w can offer convenient image retrieval interface to user and we can also reduce the searching time.

디지털 기술의 발달과 인터넷의 대중화에 더불어 영상데이타의 생산과 교환이 더 자유로워짐에 따라 디지털 도서관, 영상처리, 데이타베이스 시스템과 같은 연구분야에서 내용기반 영상검색에 대한 관심이 높아지고 있다. 일반적으로 ´영상에 의한 질의´의 경우 사용자가 마음에 드는 영상이 없더라도 반듯이 진의 영상을 데이타베이스로부터 선택해야 하지만, ´스케치에 의한 질의´는 사용자의 생각에 따라 영상온 그림으로 표현할 수 있으므로 최근에 가장 많이 사용되는 질의 방법 중 하나이다. 본 논문에서는 스케치 진의와 영상 분류 방법을 이용하는 사바 기반의 영상검색 시스템을 제안한다. 본 시스템에서는 유사영상을 검색하기 위해 영상으로부터 색상 히스토그램과 Haar-웨이블릿 계수를 사용하고, leave-one-out 방법을 이용하여 영상을 분류하도록 하였다. 본 논문에서는 사진-그림, 자연 도시 등의 영상 분류론 통해 영상의 의미정보를 추출할 수 있을 뿐 아니라, 사용자 질의 영상을 분류하여, 질의 영상이 갖고 있는 의미공간으로 검색 공간을 축소하여 검색 시간을 단축시키는 효율성을 얻을 수 있었다.

Keywords

References

  1. Venkat N. Gudivada, Vijay V. Raghavan, 'Content Based Image Retrieval Systems,' IEEE Computer, 1995 https://doi.org/10.1109/2.410145
  2. Jing Huang, S Ravi Kumar, Ramin Zabih, 'An Automatic Hierarchical Image Classification scheme,' ACM Multimedia 1998 https://doi.org/10.1145/290747.290774
  3. http://www.cselt.it/mpeg/
  4. Charles E. Jacobs, Adam Finkelstein, David Salesin, 'Fast Multiresolution Image Querying,' SIGGRAPH 95, New York, 1995 https://doi.org/10.1145/218380.218454
  5. Eric J. Stollnitz, Tony D. DeRose, David H. Salesin, Wavelets for computer Graphics-Theory and Applications, p.245, Morgan Kaufmann Publishers, Inc. 1996
  6. James Ze Wang, Gio Wiederhold, Oscar Firschein, Sha Xin Wei, 'Wavelet-based Image indexing techiniques with partial sketch retrieval capability,' Proceedings of the Fourth forum on Research and Technology Advances in Digital Libraries, 1997 https://doi.org/10.1109/ADL.1997.601196
  7. J. R. Smith and S. F. Chang, 'VisualSEEK : A Fully Automated Content-Based Image Query System,' ACM Multimedia 1996, Boston MA, Nov, 1996 https://doi.org/10.1145/244130.244151
  8. Martin Szummer and Rosalind W. Picard, 'Indoor-Outdoor Image Classification,' IEEE International Workshop on Content-based Access of Image and Video Databases, Jan 1998 https://doi.org/10.1109/CAIVD.1998.646032
  9. A. Vailaya, A. K. Jain and H. J. Zhang, 'On Image Classification : City Image vs. Landscapes,' Pattern Recognition, vol.31, no. 12, 1998
  10. J. R. Smith, Chung-Sheng Li, 'Decoding image semantics using composite region templates,' IEEE Workshop on Content-based Access of Image and Video Libraries, June, 1998 https://doi.org/10.1109/IVL.1998.694467
  11. J. R. Smith. 'Integrated Spatial and Feature Image Systems: Retrieval, Compression and Analysis,' Ph.D. thesis, Graduate School of Arts and Sciences, Columbia University, February, 1997
  12. D. Androutsos, K.N. Plataniotis and A.N. Venetsanopoulos, 'Image region extraction for contentbased image retrieval,' EUSIPCO 1998, Rhodes, Greece, September 7-10, 1998
  13. D. Androutsos, K. N. Plataniotis, A. N. Venetsanopoulos, 'Vector Angular Distance Measure for Indexing and Retrieval of Color,' SPIE Electrical Imaging '99, vol. 3656, p.604-613, January 1999
  14. Shi-Kuo Chang, Qing-Yun Shi, Cheng-Wen Yan, 'Iconic Indexing by 2-D Strings,' IEEE Transaction on Patter Analysis and Machine Intelligence, Vol. 9, No. 3, May, 1987
  15. Rafael C. Gonzales and Richard E. Woods. Digital Image Processing, p.716, Addison Wesley Publishing Company, Reading, Massachussetts, 1993
  16. Earl Gose, Richard Johnsonbaugh, Steve Jost, Pattern Recognition and Image analysis, p.484, Prentice Hall, 1996
  17. Ioannis Pitas, Digital image processing algorithms, p.362, Prentice Hall international series in acoustics, speech, and signal processing, 1993