Browse > Article
http://dx.doi.org/10.9717/kmms.2019.22.10.1142

Marker-less Calibration of Multiple Kinect Devices for 3D Environment Reconstruction  

Lee, Suwon (Dept. of Computer Science and The Research Institute of Natural Science., Gyeongsang National University)
Publication Information
Journal of Korea Multimedia Society / v.22, no.10, 2019 , pp. 1142-1148 More about this Journal
Abstract
Reconstruction of the three-dimensional (3D) environment is a key aspect of augmented reality and augmented virtuality, which utilize and incorporate a user's surroundings. Such reconstruction can be easily realized by employing a Kinect device. However, multiple Kinect devices are required for enhancing the reconstruction density and for spatial expansion. While employing multiple Kinect devices, they must be calibrated with respect to each other in advance, and a marker is often used for this purpose. However, a marker needs to be placed at each calibration, and the result of marker detection significantly affects the calibration accuracy. Therefore, a user-friendly, efficient, accurate, and marker-less method for calibrating multiple Kinect devices is proposed in this study. The proposed method includes a joint tracking algorithm for approximate calibration, and the obtained result is further refined by applying the iterative closest point algorithm. Experimental results indicate that the proposed method is a convenient alternative to conventional marker-based methods for calibrating multiple Kinect devices. Hence, the proposed method can be incorporated in various applications of augmented reality and augmented virtuality that require 3D environment reconstruction by employing multiple Kinect devices.
Keywords
Kinect Calibration; Marker-less Calibration; 3D Environment Reconstruction; Augmented Reality; Augmented Virtuality;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 Y. Zhu, K. Zhu, Q. Fu, X. Chen, H. Gong, J. Yu, et al., "SAVE: Shared Augmented Virtual Environment for Real-Time Mixed Reality Applications," Proceedings of ACM SIGGRAPH Conference on Virtual-Reality Continuum and I ts Applications in Industry, pp. 13-21, 2016.
2 E. Bostanci, N. Kanwal, and A.F. Clark, “Augmented Reality Applications for Cultural Heritage Using Kinect,” Human-Centric Computing and Information Sciences, Vol. 5, No. 1, pp. 1-18, 2015.   DOI
3 D. Nahon, G. Subileau, and B. Capel, ""Never Blind VR" Enhancing the Virtual Reality Headset Experience with Augmented Virtuality," Proceedings of IEEE Virtual Reality, pp. 347-348, 2015.
4 M. Kowalski, J. Naruniec, and M. Daniluk, "LiveScan3D: A Fast and Inexpensive 3D Data Acquisition System for Multiple Kinect v2 Sensors," Proceeding of IEEE International Conference on 3D Vision, pp. 318-325, 2015.
5 J. Shotton, T. Sharp, A. Kipman, A. Fitzgibbon, M. Finocchio, A. Blake, et al., “Real-Time Human Pose Recognition in Parts from Single Depth Images,” Communications of the ACM, Vol. 56, No. 1, pp. 116-124, 2013.   DOI
6 J. Shotton, A. Fitzgibbon, A. Blake, A. Kipman, M. Finocchio, M. Moore, et al., "Real-Time Human Pose Recognition in Parts from Single Depth Images," Proceeding of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1297-1304, 2011.
7 P.J. Besl and N.D. McKay, “Method for Registration of 3-D Shapes,” Sensor Fusion IV: Control Paradigms and Data Structures, Vol. 1611, No. 1, pp. 586-606, 1992.   DOI
8 N. Nikolakis, V. Maratos, and S. Makris, “A Cyber Physical System (CPS) Approach for Safe Human-Robot Collaboration in a Shared Workplace,” Robotics and Computer-Integrated Manufacturing, Vol. 56, No. 1, pp. 233-243, 2019.   DOI
9 P.Q. David, N.P. Barteld, and F.K. Brian, "Augmented Auralization: Complementing Auralizations with Immersive Virtual Reality Technologies," Proceedings of International Symposium on Music and Room Acoustics, pp. 1-10, 2016.
10 Reference Documentation of the Kinect for Windows SDK 2.0, http://docs.microsoft.com/en-us/previous-versions/windows/kinect/ (accessed July 19, 2019).
11 B. Muller, W. Ilg, M.A. Giese, and N. Ludolphs, “Validation of Enhanced Kinect Sensor Based Motion Capturing for Gait Assessment,” PloS one, Vol. 12, No. 4, pp. 1-18, 2017.
12 Y. Choi, J. Tang, S. Jang, and S. Kim, “User Customizable Hit Action Recognition Method using Kinect,” Journal of Korea Multimedia Society, Vol. 18, No. 4, pp. 557-564, 2015.   DOI
13 T. Rybus, J. Nicolau-Kuklinski, K. Seweryn, T. Barcinski, M. Ciesielska, K. Grassmann, et al., "New Planar Air-bearing Microgravity Simulator for Verification of Space Robotics Numerical Simulations and Control Algorithms," Proceedings of Symposium on Advanced Space Technologies in Robotics and Automation, pp. 1-8, 2013.
14 V. Lepetit, P. Lagger, and P. Fua, "Randomized Trees for Real-Time Keypoint Recognition," Proceeding of IEEE Conference on Computer Vision and Pattern Recognition, pp. 775-781, 2005.
15 X. Zhang, S. Fonz, and N. Navab, "Visual Marker Detection and Decoding in AR Systems: A Comparative Study," Proceeding of International Symposium on Mixed and Augmented Reality, pp. 97-106, 2002.
16 P. Schnemann, “A Generalized Solution of the Orthogonal Procrustes Problem,” Psychometrika, Vol. 31, No. 1, pp. 1-10, 1966.   DOI