Browse > Article

Research Trends and Case Study on Keypoint Recognition and Tracking for Augmented Reality in Mobile Devices  

Choi, Heeseung (한국과학기술연구원 영상미디어연구단)
Ahn, Sang Chul (한국과학기술연구원 영상미디어연구단)
Kim, Ig-Jae (한국과학기술연구원 영상미디어연구단)
Publication Information
Journal of the HCI Society of Korea / v.10, no.2, 2015 , pp. 45-55 More about this Journal
Abstract
In recent years, keypoint recognition and tracking technologies are considered as crucial task in many practical systems for markerless augmented reality. The keypoint recognition and technologies are widely studied in many research areas, including computer vision, robot navigation, human computer interaction, and etc. Moreover, due to the rapid growth of mobile market related to augmented reality applications, several effective keypoint-based matching and tracking methods have been introduced by considering mobile embedded systems. Therefore, in this paper, we extensively analyze the recent research trends on keypoint-based recognition and tracking with several core components: keypoint detection, description, matching, and tracking. Then, we also present one of our research related to mobile augmented reality, named mobile tour guide system, by real-time recognition and tracking of tour maps on mobile devices.
Keywords
Augmented reality; keypoint recognition and tracking; keypoint extraction; local descriptor matching; mobile tour guide system;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Tuytelaars, T. and Mikolajczyk, K. Local Invariant Feature Detectors: A Survey. Foundations and Trends in Computer Graphics and Vision. Vol. 3. No. 3. pp. 177-280. 2007.   DOI
2 Harris, C. and Stephens, M. A combined corner and edge detector. Proceedings of the 4th Alvey Vision Conference. pp. 147-151. 1988.
3 Shi, J. and Tomasi, C. Good Features to Track. Computer Vision and Pattern Recognition. 1994.
4 Lindeberg, T. Feature Detection with Automatic Scale Selection. International Journal of Computer Vision. Vol. 30. No. 2. pp. 79-116. 1998.   DOI
5 Mikolajczyk, K. and Schmid, C. Indexing based on Scale Invariant Interest Points. Proceedings of the International Conference on Computer Vision. pp. 525-531. 2001.
6 Lowe, D. G. Distinctive Image Features from Scale Invariant Keypoints. International Journal of Computer Vision. Vol. 60. No. 2. pp. 91-110. 2004.   DOI
7 Mikolajczyk, K. and Schmid, C. Scale & Affine Invariant Interest Point Detectors. International Journal of Computer Vision. Vol. 60. No. 1. pp. 63-86. 2004.   DOI
8 Smith, S. M. and Brady, J. M. SUSAN- A New Approach to Low Level Image Processing. International Journal of Computer Vision. Vol. 23. No. 1. pp. 45-78. 1997.   DOI
9 Rosten, E. and Drummond, T. Fusing points and lines for high performance tracking. Proceedings of the International Conference on Computer Vision. pp. 1508-1511. 2005.
10 Shakhnarovich, G., Darrell, T. and Indyk, P. Nearest-Neighbor Methods in Learning and Vision: Theory and Practice. MIT Press. 2006.
11 Locality sensitive hashing. https://micvog.files.wordpress.com/2013/08/lsh1.png. July 10. 2015.
12 Fischler, M. and Bolles, R. Random Sampling Consensus: A Paradigm for Model Fitting with Application to Image Analysis and Automated Cartography. Communications of the ACM. Vol. 24. No. 6. pp. 381-395. 1981.   DOI
13 Ballard, D. H. Generalizing the Hough Transform to Detect Arbitrary Shapes. Pattern Recognition, Vol.13. No.2. pp.111-122. 1981.   DOI
14 Kalal, Z., Mikolajczyk, K. and Matas, J. Trackinglearning-detection. IEEE Transactions on Pattern Analysis and Machine Intelligence. Vol. 34. No. 7 pp. 1409-1422. 2012.   DOI
15 Hare, S., Saffari, A. and Torr, P. Efficient online structured output learning for keypoint-based object tracking. Computer Vision and Pattern Recognition. 2012.
16 Zhang, K., Zhang, L. and Yang, M. Real-time compressive tracking. European Conference on Computer Vision. 2012.
17 Bouachir, W. and Bilodeau, G. Structure-aware keypoint tracking for partial occlusion handling. IEEE Winter Conference on Applications of Computer Vision. 2014.
18 Lucas, B. D. and Kanade, T. An iterative image registration technique with an application in stereo vision. International Joint Conferences on Artificial Intelligence. 1981.
19 Yu, Q., Dinh, T. B. and Medioni, G. Online tracking and reacquisition using co-trained generative and discriminative trackers. European Conference on Computer Vision. 2008.
20 Klein, G. and Murray, D. Parallel Tracking and Mapping on a Camera Phone. Proceedings of International Symposium on Mixed and Augmented Reality. pp. 83-86. 2009.
21 Mair, E., Hager, G. D., Burschka, D., Suppa, M. and Hirzinger, D. Adaptive and Generic Corner Detection Based on the Accelerated Segment Test. European Conference on Computer Vision. 2010.
22 Leutenegger, S., Chli, M. and Siegwart, R. Y. BRISK: Binary robust invariant scalable keypoints. International Conference on Computer Vision. 2011.
23 Matas, J., Chum, O., Urban, M. and Pajdla, T. Robust wide-baseline stereo from maximally stable extremal regions. Proceedings of the British Machine Vision Conference, pp. 384-393, 2002.
24 Ren X. and Malik, J. Learning a classification model for segmentation. Proceedings of the International Conference on Computer Vision. pp. 10-17, 2003.
25 Bay, H., Tuytelaars, T., Van Gool, and L. SURF: Speeded Up Robust Features. European Conference on Computer Vision. 2006.
26 Cornelis, N. and Van Gool, L. Fast scale invariant feature detection and matching on programmable graphics hardware. Computer Vision and Pattern Recognition Workshops. 2008.
27 Ke, Y. and Sukthankar, R. PCA-SIFT: A More Distinctive Representation for Local Image Descriptors. Computer Vision and Pattern Recognition. 2004.
28 Mikolajczyk, K. and Schmid, C. A performance evaluation of local descriptors. IEEE Transactions on Pattern Analysis and Machine Intelligence. Vol. 10, No. 27, pp. 1615-1630. 2005.
29 Tola, E., Lepetit, V. and Fua, P. DAISY: An Efficient Dense Descriptor Applied to Wide Baseline Stereo. IEEE Transactions on Pattern Analysis and Machine Intelligence. Vol. 32, No. 5, pp. 815-830. 2010.   DOI
30 Zhou, H., Yuan, Y. and Shi, C. Object tracking using sift features and mean shift. Computer Vision and Image Understand. Vol. 113. No. 3. pp. 345-352. 2009.   DOI
31 He, W., Yamashita, T., Lu, H. and Lao, S. Surf tracking. International Conference on Computer Vision. 1586-1592. 2009.
32 Comaniciu, D., Ramesh, V. and Meer, P. Kernelbased object tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence. Vol. 25. No. 5. pp. 564-577. 2003.   DOI
33 Li, M., Zhang, Z., Huang, K. and Tan, T. Robust visual tracking based on simplified biologically inspired features. International Conference on Image Processing. 2009.
34 Ronfard, R. Region-based strategies for active contour models, International Journal of Computer Vision, Vol. 13 No. 2. pp. 229-251. 1994.   DOI
35 Kalman, R. A new approach to linear filtering and prediction problems. Journal of Fluids Engineering. Vol. 82 No. 1 pp. 35-45. 1960.
36 Welch, G. and Bishop, G. An introduction to the Kalman filter. University of North Carolina at Chapel Hill Chapel Hill. Technical Report TR95041. 2000.
37 Arulampalam, M., Maskell, S., Gordon, N. and Clapp, T. A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking. IEEE Transactions on Signal Processing. Vol. 50. No. 2 pp. 174-188. 2002.   DOI
38 Julier, S. J. and Uhlmann, J. K. A new extension of the Kalman filter to nonlinear systems. International Symposium on Aerospace Defense Sensing, Simulations and Controls, 1997.
39 Wan, E. and Merwe, R. The unscented Kalman filter for nonlinear estimation. Adaptive Systems for Signal Processing, Communications, and Control Symposium. 2000.
40 Tomasi, C. and Kanade, T. Detection and tracking of point features. Carnegie Mellon University. 1991.
41 Heinly, J., Dunn, E. and Frahm, J. Comparative evaluation of binary features. European Conference on Computer Vision. 2012.
42 Grauman, K. and Leibe, B. Visual Object Recognition. Morgan & Claypool Publisher. 2010.
43 Calonder, M., Lepetit, V., Strecha, C. and Fua, P. Brief: Binary robust independent elementary features. European Conference on Computer Vision. 2010.
44 Rublee, E., Rabaud, V., Konolige, K. and Bradski, G. ORB: an efficient alternative to SIFT or SURF. Proceedings of the International Conference on Computer Vision. pp. 2564-2571. 2011.
45 Alahi, A., Ortiz, R. and Vandergheynst, P. FREAK: Fast retina keypoints. Computer Vision and Pattern Recognition. 2012.
46 Freidman, J., Bentley, J. and Finkel, A. An Algorithm for Finding Best Matches in Logarithmic Expected Time. ACM Transactions on Mathematical Software. Vol. 3, No. 3, pp. 209-226. 1997.
47 Muja, M. and Lowe, D. Fast approximate nearest neighbors with automatic algorithm configuration. International Conference on Computer Vision Theory and Application. 2009.
48 Silpa-Anan, C. and Hartley, R. Optimised kd-trees for fast image descriptor matching, Computer Vision and Pattern Recognition. 2008.
49 Lecture on Kd-tree. www.cise.ufl.edu/class/cot5520fa09. July 10. 2015.
50 Lepetit, V. and Fua, P. Keypoint Recognition using Randomized Trees. IEEE Transactions on Pattern Analysis and Machine Intelligence. Vol. 28, No. 9, pp. 1465-1479. 2006.   DOI
51 Ozuysal, M., Calonder, M., Lepetit, V. and Fua, P. Fast Keypoint Recognition Using Random Ferns. IEEE Transactions on Pattern Analysis and Machine Intelligence. Vol. 32, No. 3, pp. 448-461. 2010.   DOI