Natural Object Recognition for Augmented Reality Applications

증강현실 응용을 위한 자연 물체 인식

  • Received : 2010.04.06
  • Accepted : 2010.04.29
  • Published : 2010.04.30

Abstract

Markerless augmented reality system must have the capability to recognize and match natural objects both in indoor and outdoor environment. In this paper, a novel approach is proposed for extracting features and recognizing natural objects using visual descriptors and codebooks. Since the augmented reality applications are sensitive to speed of operation and real time performance, our work mainly focused on recognition of multi-class natural objects and reduce the computing time for classification and feature extraction. SIFT(scale invariant feature transforms) and SURF(speeded up robust feature) are used to extract features from natural objects during training and testing, and their performance is compared. Then we form visual codebook from the high dimensional feature vectors using clustering algorithm and recognize the objects using naive Bayes classifier.

무마커 증강현실 시스템은 실내나 옥외 환경에서 자연 물체를 인식하고 매칭하는 기능이 필수적이다. 본 논문에서는 비주얼 서술자와 코드북을 사용하여 특징을 추출하고 자연 물체를 인식하는 기법을 제안한다. 증강현실 응용은 동작 속도와 실시간 성능에 민감하기 때문에, 본 연구에서는 멀티 클래스의 자연 물체 인식에 초점을 두었으며 분류와 특징 추출 시간을 줄이는 것을 포함한다. 훈련과 테스트 과정에서 자연 물체로부터 특징을 추출하기 위해 SIFT와 SURF을 각각 사용하고 그들의 성능을 비교한다. 또한, 클러스터링 알고리즘을 이용하여 다차원의 특징 벡터들로부터 비주얼 코드북을 생성하고 나이브 베이즈 분류기를 이용해 물체를 인식한다.

Keywords

References

  1. R. T. Azuma. A survey of augmented reality. Teleoperators and virtual Environments, 6(4):355-385, Aug.1997.
  2. In Mixed Reality: Merging Real and Virtual Worlds. Yuichi Ohta and Hideyuki Tamura (ed.), Springer-Verlag, 1999. Chp 21 pp. 379-390. ISBN 3-540-65623-5.
  3. http://www.hitl.washington.edu/artoolkit/
  4. D. Beier, R. Billert, B. Bruderlin, D. Stichling, B. Kleinjohann, "Marker-less Vision Based Tracking for Mobile Augmented Reality" Proc. of IEEE Int. Conf. on Mixed and Augmented Reality pp.25-259, Oct. 2003
  5. Q. Wang and S. You, "Real-Time Image Matching Based on Multiple View Kernel Projections" IEEE Conference on Computer Vision and Pattern Recognition, 2007.
  6. G. Csurka, C. Bray, C. Dance, and L. Fan, "Visual Categorization with Bags of Keypoints." ECCV Workshop on Statistical Learning in Computer Vision, pp.1-22, 2004.
  7. J. Sivic, B. Russell, A. Efros, A. Zisserman, and W. Freeman "Discovering Dbjects and Their Location in Images." ICCV, vol.1, pp.370-377, 2005.
  8. E. Sudderth, A. Torralba, W. Freeman, and A. Willsky "Learning Hierarchical Models of Scenes, Objects, and Parts", in ICCV, Vol. 2, pp.1331-1338, 2005.
  9. L. Fei-Fei and P. Perona, "A Bayesian Hierarchical Model for Learning Natural Secne Categories." Proc. of IEEE Computer Vision and Pattern Recognition. pp.524-531, 2005.
  10. D. Lowe, "Distinctive Image Features from Scale-Invariant Keypoints." IJCV 60(2), pp.91-110, 2004.
  11. H. Bay, A. Ess, T.Tuytelaars, and Luc Van Gool: "Speeded-Up Robust Features (SURF)." Computer Vision and Image Understanding CVIU, Vol. 110.