Browse > Article
http://dx.doi.org/10.9717/kmms.2015.18.5.583

Hybrid Real-time Monitoring System Using2D Vision and 3D Action Recognition  

Lim, Jong Heon (Faculty of Computer Engineering, Keimyung University)
Sung, Man Kyu (Faculty of Computer Engineering, Keimyung University)
Lee, Joon Jae (Faculty of Computer Engineering, Keimyung University)
Publication Information
Journal of Korea Multimedia Society / v.18, no.5, 2015 , pp. 583-598 More about this Journal
Abstract
We need many assembly lines to produce industrial product such as automobiles that require a lot of composited parts. Big portion of such assembly line are still operated by manual works of human. Such manual works sometimes cause critical error that may produce artifacts. Also, once the assembly is completed, it is really hard to verify whether of not the product has some error. In this paper, for monitoring behaviors of manual human work in an assembly line automatically, we proposes a realtime hybrid monitoring system that combines 2D vision sensor tracking technique with 3D motion recognition sensors.
Keywords
2D Vision; 3D Vision; Action Recognition; Monitoring System;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 O. Patsadu, C. Nukoolkit, and B. Watanapa, “Human Gesture Recognition using Kinect Camera,” Proceeding of Joint Conference on Computer Science and Software Engineering, pp. 28-32, 2012.
2 C.H. Choi, Y. Taguchi, O. Tuzel, M. Liu, and S. Ramalinagam, “Voting-Based Pose Estimation for Robotic Assembly using a 3D Sensor,” Proceeding of IEEE International Conference on Robotics and Automation, pp. 14-18, 2012.
3 J.P. Lewis, “Fast Template Matching,” Proceeding of Canadian Image Processing and Pattern Recognition Society, pp. 120-123, 1995.
4 OpenCV 2.4.9.0 Documentation, Template Matching, http://docs.opencv.org/doc/tutorials/imgproc/histograms/template_matching/template_matching.html (accessed Feb. 2014).
5 B.G. Lee and J.J. Lee, “Wafer Position Recognition System using Radial Shape Calibrator,” Journal of Korea Multimedia Society, Vol. 14, No. 5, pp. 632-641, 2011.   DOI
6 J.A. Ward, P. Lukowicz, G. Troster, and T.E. Starner, “Activity Recognition of Assembly Tasks using Body-Worn Microphones and Accelerometers,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 28, No. 10, pp. 1553-1567, 2006.   DOI
7 W. Wang, C. Yang, X. Wu, S. Xu, and H. Li, “Kinect Based Dynamic Hand Gesture Recognition Algorithm Research,” Proceeding of Intelligent Human-Machine Systems and Cybernetics, pp. 274-279, 2012.
8 E. Weng and L. Fu, “On-Line Human Action Recognition by Combining Joint Tracking and Key Pose Recognition,” Proceeding of IEEE Intelligent Robots and Systems, pp. 4112- 4117, 2012.
9 X. Zhang, Y. Ding, Y. Lv, A. Shi, and R. Liang, “A Vision Inspection System for the Surface Defects of Strongly Reflected Metal based on Multi-Class SVM,” Expert Systems with Applications, Vol. 38, No. 5, pp. 5930-5939, 2011.   DOI
10 Microsoft Kinect for Windows SDK Document, http://msdn.microsoft.com/en- us/library/hh855347.aspx (accessed Feb, 2014).