정보관리연구 (Journal of Information Management)

한국과학기술정보연구원 과학기술정보센터 (Korea Institute of Science and Technology Information)
권호 표지
DOI QR코드

DOI QR Code

시각 예제에 의한 질의: 시각정보 검색지원을 위한 이미지 질의 패러다임의 유용성 비교 연구

Query by Visual Example: A Comparative Study of the Efficacy of Image Query Paradigms in Supporting Visual Information Retrieval

  • Venters, Colin C. (Dept. of Library and Information Science, Kyungpook National University)
  • 투고 : 2011.05.24
  • 심사 : 2011.06.01
  • 발행 : 2011.07.30
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

시각적 실례에 의한 질의는 내용기반 이미지 검색 환경에서 질의 표현을 위한 중요한 질의 패러다임이다. 이미지 및 스케치에 의한 질의는 질의표현을 가능하게 하는 방법으로서 오랫동안 알려졌다. 하지만 이 방법이 질의를 쉽게 작성하는 데 얼마나 도움을 주는지에 대한 효율성에 대한 실험적 입증은 아직 미미하다. 정보검색시스템에 표현하는 탐색자의 능력은 검색과정의 기본이다. 이 연구의 목적은 탐색자의 정보 문제와 효율적이고도 효과적인 시각적 질의 작성을 지원하기 위해 필요한 질의 방법들 간의 지식 격차의 원인이 되는 다양한 정보 요구를 지원하는 데 있어서 유용성 실험을 통해 이미지에 의한 질의와 스케치방법에 의한 질의 조사하기 위함이었다. 본 연구 결과는 이미지에 의한 질의가 시각적 질의 작성에 실행 가능한 접근방식임을 제시한다. 반면에, 본 연구결과를 통해 탐색자의 정보 문제와 시각적인 질의 작성에 도움을 주는 스케치 패러다임에 의한 질의표현 능력 간에 상당한 불일치가 있다는 것을 알 수 있다. 효율(시간)과 유효성(오류)에 초점을 둔 유용성 실험결과와 이용자의 만족도는 큰 차이점이 있다고 보여준다(p<0.001). 이는 다음 세 가지 측정(시간, 오류, 이용자의 만족도)에 대한 두 가지 질의 방식(이미지에 의한 질의, 스케치에 의한 질의) 사이에서 나타난 시간(Z=-3.597, p<0.001), 오류(Z=-3.317, p<0.001), 그리고 만족도(Z=-10.223, p<0.001)에서 드러난다. 본 연구결과는 또한 질의도구를 참가자가 인지하는 유용성에 큰 차이가 있다는 것을 보여준다(Z=-4.672, p<0.001).

Query by visual example is the principal query paradigm for expressing queries in a content-based image retrieval environment. Query by image and query by sketch have long been purported as being viable methods of query formulation yet there is little empirical evidence to support their efficacy in facilitating query formulation. The ability of the searcher to express their information problem to an information retrieval system is fundamental to the retrieval process. The aim of this research was to investigate the query by image and query by sketch methods in supporting a range of information problems through a usability experiment in order to contribute to the gap in knowledge regarding the relationship between searchers' information problems and the query methods required to support efficient and effective visual query formulation. The results of the experiment suggest that query by image is a viable approach to visual query formulation. In contrast, the results strongly suggest that there is a significant mismatch between the searchers information problems and the expressive power of the query by sketch paradigm in supporting visual query formulation. The results of a usability experiment focusing on efficiency (time), effectiveness (errors) and user satisfaction show that there was a significant difference, p<0.001, between the two query methods on all three measures: time (Z=-3.597, p<0.001), errors (Z=-3.317, p<0.001), and satisfaction (Z=-10.223, p<0.001). The results also show that there was a significant difference in participants perceived usefulness of the query tools Z=-4.672, p<0.001.

키워드

참고문헌

  1. Berlin, B. and P. Kay. 1991. Basic Color Terms: Their Universality and Evolution. Berkeley: University of California Press.
  2. Bird, C., P. J. Elloitt, and P. M. Hayward. 1999. "Content-Based Retrieval for European Image Libraries." In: The Challenge of Image Retrieval: CIR99, The 2nd UK Conference on Image Retrieval, Forte Posthouse Hotel, Newcastle upon Tyne, United Kingdom, 25th-26th February 1999, edited by D. J. Harper and J. P. Eakins.
  3. Blaser, A. D. 1997. "User Interaction in a Sketch-Based GIS User Interface." Lecture Notes In Computer Science, 1329 (1997): 505-506.
  4. Bordogna, G. and M. Pagani. 2010. "A Flexible Content-based Image Retrieval Model and Customizable System for the Retrieval of Shapes." Journal of the American Society for Information Science and Technology, 61(5): 907-926. https://doi.org/10.1002/asi.21286
  5. Boujemaa, N., J. Fauqueur, and V. Gouet. 2004. "What's Beyond Query by Example?" Lecture Notes in Computer Science, Springer-Verlag.
  6. Castelli, V. and L. D. Bergman. 2002. Image Databases: Search and Retrieval of Digital Imagery. New York: John Wiley, 1-10.
  7. Chin, J., V. Diehl, and L. Norman. 1988. "Development of an Instrument Measuring User Satisfaction of the Human- Computer Interface." In: CHI '88: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Washington, D.C. USA, 15-19 May 1988, edited by J. J. O'Hare, ACM Press: 213-218.
  8. Datta, R., D. Joshi, J. Li, and J. Z. Wang. 2008. "Image Retrieval: Ideas, Influences, and Trends of the New Age." ACM Computing Surveys, 40(2).
  9. Del Bimbo, A. and P. Pala. 1997. "Visual Image Retrieval by Elastic Matching of User Sketches." IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(2): 121-132. https://doi.org/10.1109/34.574790
  10. Di Lecce, V and A. Guerriero. 1999. "An Evaluation of the Effectiveness of Image Features for Image Retrieval." Journal of Visual Communication and Image Representation, 10(4): 351-362. https://doi.org/10.1006/jvci.1999.0423
  11. Eakins, J. P. 1992. "Pictorial Information Systems: Prospects and Problems." Proceedings of 14th BCS Information Retrieval Specialist Group Research Colloquium, Lancaster, April 1992: 102-123.
  12. Eakins, J. P., J. M. Boardman, and M. E. Graham. 1998. "Similarity Retrieval of Trademark Images." IEEE MultiMedia, 5(2): 53-63. https://doi.org/10.1109/93.682526
  13. Eidenberger, H. and C. Breiteneder. 2003. "VizIR: A Framework for Visual Information Retrieval." Journal of Visual Languages and Computing, 14(5): 443- 469. https://doi.org/10.1016/S1045-926X(03)00035-1
  14. Enser, P. G. B. 1995. "Progress in Documentation Pictorial Information Retrieval." Journal of Documentation, 51(2): 126- 170. https://doi.org/10.1108/eb026946
  15. Feng, D., W. C. Siu, and H. J. Zhang. 2003. Multimedia Information Retrieval and Management: Technological Fundamentals and Applications. New York: Springer, 1-26.
  16. Flickner, M., H. Sawhney, W. Niblack, J. Ashley, Q. Huang, B. Dom, M. Gorkani, J. Hafner, D. Lee, D. Petkovic, D. Steele, and P. Yanker. 1995. "Query by Image and Video Content: The QBIC System." IEEE Computer, 28(9): 23-32. https://doi.org/10.1109/2.410146
  17. Frokjaer, E., M. Hertzum, and K. Hornbaek. 2000. "Measuring Usability: Are Effectiveness, Efficiency, and Satisfaction Really Correlated?" Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, The Hague, The Netherlands, 01- 06, April, 2000, ACM Press: 345-352.
  18. Gecsei, J. and D. Martin. 1989. "Browsing Assess to Visual Information." Optical Information Systems, 9(5): 237-241.
  19. Gudivada, V. N. and V. V. Raghaven. 1995. "Content-based Image Retrieval Systems." IEEE Computer, September 1995: 20.
  20. Hanjalic, A., N. Sebe, and E. Y. Chang. 2006. "Multimedia Content Analysis, Management and Retrieval: Trends and Challenges." In: Electronic Imaging 2006, Multimedia Content Analysis, Management and Retrieval 2006, IS&T/SPIE International Symposium, SPIE Vol. 6073, San Jose Marriott and San Jose Convention Centre, San Jose, California, USA, 15-19 January 2006, edited by Edward Y. Chang, Alan Hanjalic and Nicu Sebe, SPIE.
  21. Hirata, K. and T. Kato. 1992. "Query by Visual Example." Proceedings of the 3rd International Conference on Extending Database Technology, Vienna, Austria, 23rd-27th March 1992, edited by A. Pirotte, C. Delobel and G. Gottlob, Springer-Verlag: 56-71.
  22. Hix, D. and H. R. Hartson. 1993. Developing User Interfaces: Ensuring Usability Through Product and Process. New York: John Wiley.
  23. Idris, F. and S. Panchanathan. 1997. "Review of Image and Video Indexing Techniques." Journal of Visual Communication and Image Representation, 8(2): 146-166. https://doi.org/10.1006/jvci.1997.0355
  24. ISO 9241. 1998. International Organization for Standardization.
  25. Jaimes, A. and S-F. Chang. 2002. "Concepts and Techniques for Indexing Visual Concepts." In: Castelli, V. and Bergman, L. D. (ed). Image Databases: Search and Retrieval of Digital Imagery, John Wiley & Sons Inc. : 497.
  26. Jaimes, A., N. Sebe, and D. Gatica-Perez. 2006. "Human-centered Computing: A Multimedia Perspective." Proceedings of the 14th annual ACM international conference on Multimedia. Santa Barbara, CA, USA, October 23-27, 2006, ACM: 855-864.
  27. Kato, T. 1991. "Intelligent Visual Interaction with Image Database Systems: Toward the Multimedia Personal Interface." Journal of Information Processing, 14(2): 134-143.
  28. Kato, T., T. Kurita, and H. Shimogaki. 1989. "Multimedia Interaction with Image Database Systems." In: Advanced Database System Symposium '89, Kyoto, Japan, 1989: 271-278.
  29. Kimia, B. B. 2002. "Shape Representation for Image Retrieval." In: Castelli, V. and Bergman, L. D. (eds). Image Databases: Search and Retrieval of Digital Imagery, John Wiley & Sons Inc. : 345-372.
  30. Ko, B. C. and H. Byun. 2002. "Query-by- Gesture: An Alternative Content-Based Image Retrieval Query Scheme." Journal of Visual Languages and Computing, 13(4): 375-390. https://doi.org/10.1006/jvlc.2002.0220
  31. Ko, B. C., J. Peng, and H. Byun. 2001. "Region- Based Image Retrieval Using Probabilistic Feature Relevance Learning." Pattern Analysis and Applications, 4(2-3): 174- 184. https://doi.org/10.1007/s100440170015
  32. Korfhage, R. R. 1997. Information Storage and Retrieval. New York: John Wiley.
  33. Laaksonen, J., M. Koskela, S. Laakso, and E. Oja. 2000. "PicSOM: Content-based Image Retrieval with Self-organizing maps." Pattern Recognition Letters, 21(3- 14): 1199-1207. https://doi.org/10.1016/S0167-8655(00)00082-9
  34. Lai, T-S. 2000. "CHROMA: A Photographic Image Retrieval System." Ph.D. Thesis. University of Sunderland, UK. January 2000.
  35. Lew, M. S. and T. S. Huang. 2001. "Visual Information Retrieval: Paradigms, Applications, and Research Issues." In: Lew, M. S. (ed.) Principles of Visual Information Retrieval. Springer-Verlag, Advances in Pattern Recognition: 3-9.
  36. Loncaric, S. 1998. "A Survey of Shape Analysis Techniques." Pattern Recognition, 31(8): 983-1001. https://doi.org/10.1016/S0031-2023(97)00122-2
  37. Preece, J., Y. Rogers, H. Sharp, D. Benyon, S. Holland, and T. Carey. 1994. Humancomputer Interaction. Boston: Pearson Addison Wesley.
  38. Mingqiang, Y., K. Kidiyo, and R. Joseph. 2008. A Survey of Shape Feature Extraction Techniques. Pattern Recognition Techniques, Technology and Applications, P-Y. Yin (Ed.), InTech: 43-90.
  39. Muller, W., H. Müller, S. Marchand-Maillet, T. Pun, D. M. Squire, Z. Pecenovic, C. Giess, and A. P. de Vries. 2000. "MRML: An Extensible Communication Protocol for Interoperability and Bench-marking of Multimedia Information Retrieval Systems." Visual Information and Information Systems: 300-311.
  40. Nakazato M. and T. S. Huang. 2001. "An Interactive 3d Visualization for Content-based Image Retrieval." Proceedings of the International Conference on Multimedia and Expo, Waseda University, Tokyo, Japan, 22-25 August 2001: 44-47.
  41. Rui, Y. and T. S. Huang. 2001. "Relevance Feedback Techniques." In: Lew, M. S. (ed.) Principles of Visual Information Retrieval. Springer-Verlag, Advances in Pattern Recognition: 219-258.
  42. Santini, S. and R. Jain. 1997. "Image Databases are not Databases with Images." Proceedings of the 9th International Conference on Image Analysis and Processing. Volume II: 38-45.
  43. Smeulders, A. W. M., M. Worring, S. Santini, A. Gupta, and R. Jain. 2000. "Contentbased Image Retrieval at the End of the Early Years." IEEE Transaction on Pattern Analysis and Machine Intelligence, 22(12): 1349-1380. https://doi.org/10.1109/34.895972
  44. Veltkamp, R. C. and M. Hagedoorn. 2001. "State of the Art in Shape Matching." In: Lew, M. S. (ed.) Principles of Visual Information Retrieval. Springer-Verlag, Advances in Pattern Recognition: 87-120.
  45. Vendrig, J., M. Worring, and A. W. M. Smeulders. 2001. "Filter Image Browsing: Interactive Image Retrieval by Using Database Overviews." Multimedia Tools and Applications, 15(1): 83-103. https://doi.org/10.1023/A:1011367820253
  46. Wilson, T. D. 1981. "On User Studies and Information Needs." Journal of Documentation, 37: 3-15. https://doi.org/10.1108/eb026702
  47. Yoshitaka, A. and T. Ichikawa. 1999. "A Survey on Content-Based Retrieval for Multimedia Databases." IEEE Transactions on Knowledge and Data Engineering, 11(1): 81-93. https://doi.org/10.1109/69.755617