[KSCI] Korea Science Citation Index Service

http://dx.doi.org/10.9717/kmms.2021.24.2.167

Combining an Edge-Based Method and a Direct Method for Robust 3D Object Tracking

Lomaliza, Jean-Pierre (Dept. of Electronic Engineering, Pukyong National University)
Park, Hanhoon (Dept. of Electronic Engineering, Pukyong National University)

Publication Information

Journal of Korea Multimedia Society / v.24, no.2, 2021 , pp. 167-177 More about this Journal

Abstract

In the field of augmented reality, edge-based methods have been popularly used in tracking textureless 3D objects. However, edge-based methods are inherently vulnerable to cluttered backgrounds. Another way to track textureless or poorly-textured 3D objects is to directly align image intensity of 3D object between consecutive frames. Although the direct methods enable more reliable and stable tracking compared to using local features such as edges, they are more sensitive to occlusion and less accurate than the edge-based methods. Therefore, we propose a method that combines an edge-based method and a direct method to leverage the advantages from each approach. Experimental results show that the proposed method is much robust to both fast camera (or object) movements and occlusion while still working in real time at a frame rate of 18 Hz. The tracking success rate and tracking accuracy were improved by up to 84% and 1.4 pixels, respectively, compared to using the edge-based method or the direct method solely.

Keywords

3D Object Tracking; Camera Pose Estimation; Edge-Based Method; Direct Method; Textureless Object; Augmented Reality;

Citations & Related Records

Reference

1	J. Moon, D. Park, H. Jung, Y. Kim, and S. Hwang, "An Image-Based Augmented Reality System for Multiple Users Using Multiple Markers," Journal of Korea Multimedia Society, Vol. 21, No. 10, pp. 1162-1170, 2018. DOI
2	H. Kato and M. Billinghurst, "Marker Tracking and HMD Calibration for a Video-Based Augmented Reality Conferencing System," Proceeding of 2nd IEEE and ACM International Workshop on Augmented Reality, pp. 85-94, 1999.
3	K.W. Chia, A.D. Cheok, and S.J.D. Prince, "Online 6 DOF Augmented Reality Registration from Natural Features," Proceeding of International Symposium on Mixed and Augmented Reality, pp. 305-313, 2002.
4	A.I. Comport, E. Marchand, and F. Chaumette, "A Real-Time Tracker for Markerless Augmented Reality," Proceeding of International Symposium on Mixed and Augmented Reality, pp. 36-45, 2003.
5	C. Harris and C. Stennett, "RAPID: A Video-Rate Object Tracker," Proceeding of British Machine Vision Conference, pp. 73-77, 1990.
6	T. Drummond and R. Cipolla, "Real-Time Visual Tracking of Complex Structures," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 24, No. 7, pp. 932-946, 2002. DOI
7	H. Wuest, F. Vial, and D. Stricker, "Adaptive Line Tracking with Multiple Hypotheses for Augmented Reality," Proceeding of IEEE/ACM International Symposium on Mixed and Augmented Reality, pp. 62-69, 2005.
8	I. Skrypnyk and D.G. Lowe, "Scene Modeling, Recognition, and Tracking with Invariant Image Features," Proceeding of IEEE/ACM International Symposium on Mixed and Augmented Reality, pp. 110-119, 2004.
9	S. Hinterstoisser, S. Benhimane, and N. Navab, "N3M: Natural 3D Markers for Real-Time Object Detection and Pose Estimation," Proceeding of IEEE International Conference on Computer Vision, pp. 1-7, 2007.
10	E. Ladikos, S. Benhimane, and N. Navab, "A Realtime Tracking System Combining Template-Based and Feature-Based Approaches," Proceeding of International Conference on Computer Vision Theory and Applications, pp. 325-332, 2007.
11	Y. Park, V. Lepetit, and W. Woo, "Handling Motion-Blur in 3D Tracking and Rendering for Augmented Reality," IEEE Transactions on Visualization and Computer Graphics, Vol. 18, No. 9, pp. 1449-1459, 2012. DOI
12	B.-K. Seo, H. Park, J.-I. Park, S. Hinterstoisser, and S. Ilic, "Optimal Local Searching for Fast and Robust Textureless 3D Object Tracking in Highly Cluttered Backgrounds," IEEE Transactions on Visualization and Computer Graphics, Vol. 20, No. 1, pp. 99-110, 2013. DOI
13	S. Baker and I. Matthews, "Lucas-Kanade 20 Years On: a Unifying Framework," International Journal of Computer Vision, Vol. 56, No. 3, pp. 221-255, 2004. DOI
14	G. Caron, A. Dame, and E. Marchand, "Direct Model Based Visual Tracking and Pose Estimation Using Mutual Information," Image and Vision Computing, Vol. 32, No. 1, pp. 54-63, 2014. DOI
15	B.-K. Seo and H. Wuest, "A Direct Method for Robust Model-Based 3D Object Tracking from a Monocular RGB Image," Lecture Notes on Computer Science, Vol. 9915, pp. 551-562, 2016.
16	J. Engel, T. Schops, and D. Cremers, "LSD-SLAM: Large-Scale Direct Monocular SLAM," Proceeding of European Conference on Computer Vision, pp. 834-849, 2014.