Browse > Article
http://dx.doi.org/10.7236/IJIBC.2020.12.3.171

Implementation of a Gesture Recognition Signage Platform for Factory Work Environments  

Rho, Jungkyu (Dept. of Computer Science, Seokyeong University)
Publication Information
International Journal of Internet, Broadcasting and Communication / v.12, no.3, 2020 , pp. 171-176 More about this Journal
Abstract
This paper presents an implementation of a gesture recognition platform that can be used in a factory workplaces. The platform consists of signages that display worker's job orders and a control center that is used to manage work orders for factory workers. Each worker does not need to bring work order documents and can browse the assigned work orders on the signage at his/her workplace. The contents of signage can be controlled by worker's hand and arm gestures. Gestures are extracted from body movement tracked by 3D depth camera and converted to the commandsthat control displayed content of the signage. Using the control center, the factory manager can assign tasks to each worker, upload work order documents to the system, and see each worker's progress. The implementation has been applied experimentally to a machining factory workplace. This flatform provides convenience for factory workers when they are working at workplaces, improves security of techincal documents, but can also be used to build smart factories.
Keywords
Gesture Recognition; 3D Depth Camera; Digital Signage; Smart Factory;
Citations & Related Records
Times Cited By KSCI : 4  (Citation Analysis)
연도 인용수 순위
1 S. Escalera, V. Athitsos, and I. Guyon, "Challenges in multimodal gesture recognition", Journal of Machine Learning Research, Vol. 17, No. 1, pp. 1-54, Jan. 2016. DOI: https://dl.acm.org/doi/abs/10.5555/2946645.3007025
2 M. S. Jang and W. B. Lee, "Implementation of Hand-Gesture Interface to manipulate a 3D Object of Augmented Reality", The Journal of the Institute of Internet, Broadcasting and Communication(JIIBC), Vol. 16, No. 4, pp. 117-123, Aug. 2016. DOI: https://doi.org/10.7236/JIIBC.2016.16.4.117   DOI
3 S. Yousefi, M. Kidaney, Y. Delgadoy, J. Chanay, and N. Reski, "3D Gesture-based Interaction for Immersive Experience in Mobile VR", in Proc. 23rd International Conference on Pattern Recognition(ICPR), pp. 2122-2127, Dec. 4-8, 2016.
4 Z. Ren, J. Yuan, J. Meng, and Z. Zhang, "Robust Part-Based Hand Gesture Recognition Using Kinect Sensor", IEEE Transactions on Multimedia, Vol. 15, No. 5, pp. 1110-1120, Aug. 2013. DOI: https://doi.org/10.1109/TMM.2013.2246148   DOI
5 J. Aliprantis, M. Konstantakis, R. Nikopoulou, P. Mylonas, G. Caridakis, "Natural Interaction in Augmented Reality Context", in Proc. Visual Pattern Extraction and Recognition for Cultural Heritage Understanding Workshop(VIPERC), pp. 50-61, Jan. 30.
6 K. Kim, J. Kim, J. Choi, J. Kim, and S. Lee, "Depth Camera-Based 3D Hand Gesture Controls with Immersive Tactile Feedback for Natural Mid-Air Gesture Interactions", Sensors, Vol. 15, No. 1, pp. 1022-1046, Jan. 2015. DOI: https://doi.org/10.3390/s150101022   DOI
7 T. Heimonen, J. Hakulinen, M. Turunen, J. P. P. Jokinen, T. Keskinen, and R. Raisamo, "Designing Gesture-Based Control for Factory Automation", in Proc. INTERACT, pp. 202-209, Sep. 2-6, 2013. DOI: https://doi.org/10.1007/978-3-642-40480-1_13
8 M. Kim, S.H. Choi, K.-B. Park, and J.Y. Lee, "User Interactions for Augmented Reality Smart Glasses: A Comparative Evaluation of Visual Contexts and Interaction Gestures", Applied Sciences, Vol. 9, No. 15, 2019. DOI: https://doi.org/10.3390/app9153171
9 Y. H. Hong, S. J. Song, K. M. Jang, and J. Rho, "Smart Factory Platform based on Multi-Touch and Image Recognition Technologies", The Journal of the Institute of Internet, Broadcasting and Communication(JIIBC), Vol. 18, No. 1, pp. 23-28, Feb. 2018. DOI: https://doi.org/10.7236/JIIBC.2018.18.1.23   DOI
10 A. Syberfeldt, O. Danielsson and P. Gustavsson, "Augmented Reality Smart Glasses in the Smart Factory: Product Evaluation Guidelines and Review of Available Products", IEEE Access, Vol. 5, pp. 9118-9130, May 2017. DOI: https://doi.org/10.1109/ACCESS.2017.270395   DOI