Browse > Article
http://dx.doi.org/10.14702/JPEE.2022.543

Development of Collaborative Robot Control Training Medium to Improve Worker Safety and Work Convenience Using Image Processing and Machine Learning-Based Hand Signal Recognition  

Jin-heork Jung (School of Mechatronics Engineering, Korea University of Technology and Education)
Hun Jeong (School of Mechatronics Engineering, Korea University of Technology and Education)
Gyeong-geun Park (School of Mechatronics Engineering, Korea University of Technology and Education)
Gi-ju Lee (School of Mechatronics Engineering, Korea University of Technology and Education)
Hee-seok Park (School of Mechatronics Engineering, Korea University of Technology and Education)
Chae-hun An (School of Mechatronics Engineering, Korea University of Technology and Education)
Publication Information
Journal of Practical Engineering Education / v.14, no.3, 2022 , pp. 543-553 More about this Journal
Abstract
A collaborative robot(Cobot) is one of the production systems presented in the 4th industrial revolution and are systems that can maximize efficiency by combining the exquisite hand skills of workers and the ability of simple repetitive tasks of robots. Also, research on the development of an efficient interface method between the worker and the robot is continuously progressing along with the solution to the safety problem arising from the sharing of the workspace. In this study, a method for controlling the robot by recognizing the worker's hand signal was presented to enhance the convenience and concentration of the worker, and the safety of the worker was secured by introducing the concept of a safety zone. Various technologies such as robot control, PLC, image processing, machine learning, and ROS were used to implement this. In addition, the roles and interface methods of the proposed technologies were defined and presented for using educational media. Students can build and adjust the educational media system by linking the introduced various technologies. Therefore, there is an excellent advantage in recognizing the necessity of the technology required in the field and inducing in-depth learning about it. In addition, presenting a problem and then seeking a way to solve it on their own can lead to self-directed learning. Through this, students can learn key technologies of the 4th industrial revolution and improve their ability to solve various problems.
Keywords
cooperation robot; hand signal recognition; inverse kinematics; machine learning; OpenCV; PLC; safety zone;
Citations & Related Records
Times Cited By KSCI : 4  (Citation Analysis)
연도 인용수 순위
1 J. Seung and J. Byeongjin, "Cooperate robot trends," The Korean Institute of Electrical Engineers, vol. 68, no. 1, pp. 22-26, 2019. 
2 Y. H. Kim and J. O. Kim, "A design methodology of task safety scenario for the application of collaborative robots," The Journal of Korea Robotics Society, vol. 15, no. 3, pp. 256-268, 2020.    DOI
3 J. Jun, J. Ryu, K. Kim, and H. Kim, "Development of risk assessment method for cobot workplace and regulation response," The Journal of Korea Robotics Society, vol. 14, no. 4, pp. 333-339, 2019.    DOI
4 J. Seo, Deep Learning Py Torch Textbook, 2022. 
5 S. K. Hwang, Computer Vision and Machine Learning with OpenCV 4, 2019. 
6 M. Quigley and B. Ger, Programming Robots with ROS, 2017. 
7 Y. S. Pyo, ROS Robot Programming, 2017 
8 G.-S. Cho, "Improvement for the safety on the automobile-parts assembly process using collaborative robot through risk assessment : disk snap ring assembly process mainly," Journal of the Korea Academia-Industrial Cooperation Society, vol. 21, no. 8, pp. 342-347, 2020.    DOI
9 K. Hur, "Development of convolutional neural network basic practice cases," Journal of Practical Engineering Education, vol. 14, no. 2, pp. 279-285, 2022.    DOI
10 Y. K. Cho, "Using python programming language for teaching industrial engineering subjects: a case study on engineering economy," Journal of Practical Engineering Education, vol. 14, no. 2, pp. 245-258, 2022.   DOI