Browse > Article
http://dx.doi.org/10.9717/kmms.2018.21.12.1493

A Design and Implementation of Object Recognition based Interactive Game Contents using Kinect Sensor and Unity 3D Engine  

Jung, Se-hoon (School of Major Connection, Youngsan University)
Lee, Ju-hwan (Dept. of Multimedia Eng., Sunchon University)
Jo, Kyeong-Ho (Dept. of Multimedia Eng., Sunchon University)
Park, Jae-Seong (Dept. of Multimedia Eng., Sunchon University)
Sim, Chun Bo (School of Information Com. and Multimedia Eng., Sunchon University)
Publication Information
Journal of Korea Multimedia Society / v.21, no.12, 2018 , pp. 1493-1503 More about this Journal
Abstract
We propose an object recognition system and experiential game contents using Kinect to maximize object recognition rate by utilizing underwater robots. we implement an ice hockey game based on object-aware interactive contents to validate the excellence of the proposed system. The object recognition system, which is a preprocessor module, is composed based on Kinect and OpenCV. Network sockets are utilized for object recognition communications between C/S. The problem of existing research, degradation of object recognition at long distance, is solved by combining the system development method suggested in the study. As a result of the performance evaluation, the underwater robot object recognized all target objects (90.49%) with 80% of accuracy from a 2m distance, revealing 42.46% of F-Measure. From a 2.5m distance, it recognized 82.87% of the target objects with 60.5% of accuracy, showing 34.96% of F-Measure. Finally, it recognized 98.50% of target objects with 59.4% of accuracy from a 3m distance, showing 37.04% of F-measure.
Keywords
Kinect; Unity 3D Engine; Underwater Robot; Interactive Game;
Citations & Related Records
Times Cited By KSCI : 3  (Citation Analysis)
연도 인용수 순위
1 D.K. Yu, J.G. Lee, and J.Y. Jung, "Fast Extraction of Vehicle Plate in Car Image Using Morphology Operation," Proceeding of The International Industrial Information Systems Conference, pp. 343-347, 2002.
2 J.K. Won, H.Y. Kim, and J.S. Cho, "Text Area Extraction Method for Color Images Based on Labeling and Gradient Difference Method," Journal of the Korea Contents Association, Vol. 11, No. 12, pp. 511-521, 2011.   DOI
3 C.J. Lee and T.J. Choi, "3D Content Creation of Korean Traditional Tales Using a Depth Camera : on the Basis of The Hare and The Tortoise," Journal of the Korea Entertainment Industry Association, Vol. 10, No. 3, pp. 329-336, 2016.   DOI
4 S.B. Lee and I.H. Jung, "A Design and Implementation of Natural User Interface System Using Kinect," Journal of Digital Contents Society, Vol. 15, No. 4, pp. 473-480, 2014.   DOI
5 J.H. Lee, S.H. Jung, K.H. Jo, J.S. Park, K.S. You, C.B. Sim, et al., "Design and Implementation of Sensing Program Based on Object Recognition Using Depth Information of Kinect Camera," Proceedings of the Spring Conference of the Korean Electronic Communication Sciences, Vol. 12, No. 1, pp. 87-90, 2018.
6 S.K. Kwon and H.J. Kim, “Tracking Method for Moving Object Using Depth Picture,” Journal of Korea Multimedia Society, Vol. 19, No. 4, pp. 774-779, 2016.   DOI
7 S. Kwon, J.S. Kim, Y.H. Kim, and Y.H. Lee, "Architecture and Design of Real-time Depth Map Extraction Hardware Using Stereo Vision," The Journal of Korean Institute of Information Technology, Vol. 12, No. 2, pp. 163-171, 2014.
8 D.S. Lee and S.K. Kwon, "A Recognition Method for Moving Objects Using Depth and Color Information," Journal of Korea Multimedia Society, Vol. 19, No. 4, pp. 681-688, 2016.   DOI
9 M.G. Seo, S.Y. Kim, J.B. J, and C. Lee, "Frequency Estimation of Human Movements Using Kinect and Its Application," Journal of Korea Multimedia Society, Vol. 20, No. 8, pp. 1248-1257, 2017.   DOI
10 H.H. Son, D.H. Koo, S.C. Jeong, Y.M. Lee, S.M. Lee, D.H. Lee, et al., "Hand-Grabbing Recognition Based on Kinect and Unity3D," Proceedings of the Fall Conference of the Korean Information Science Society, pp. 1481-1483, 2014.
11 N. Otsu, “A Threshold Selection Method from Gray-level Histograms,” IEEE Transactions on Systems, Man, and Cybernetics, Vol. 9, No. 1, pp. 62-66, 1979.   DOI
12 Y.N. Kim, S.J. Kim, J.S. Lee, and E.S. Cho, "Sensible 3D Virtual Reality Rehabilitation Treatment System Using Kinect and Unity 3D," Proceedings of the Fall Conference of the Institute of Electronics and Information Engineers, pp. 935-938, 2013.