International Journal of Internet, Broadcasting and Communication

The Institute of Internet, Broadcasting and Communication (한국인터넷방송통신학회)
권호 표지
DOI QR코드

DOI QR Code

Implementation of a Gesture Recognition Signage Platform for Factory Work Environments

  • Rho, Jungkyu (Dept. of Computer Science, Seokyeong University)
  • Received : 2020.06.28
  • Accepted : 2020.07.12
  • Published : 2020.08.31
Download PDF
⟨ Previous Next ⟩

Abstract

This paper presents an implementation of a gesture recognition platform that can be used in a factory workplaces. The platform consists of signages that display worker's job orders and a control center that is used to manage work orders for factory workers. Each worker does not need to bring work order documents and can browse the assigned work orders on the signage at his/her workplace. The contents of signage can be controlled by worker's hand and arm gestures. Gestures are extracted from body movement tracked by 3D depth camera and converted to the commandsthat control displayed content of the signage. Using the control center, the factory manager can assign tasks to each worker, upload work order documents to the system, and see each worker's progress. The implementation has been applied experimentally to a machining factory workplace. This flatform provides convenience for factory workers when they are working at workplaces, improves security of techincal documents, but can also be used to build smart factories.

Keywords

References

  1. S. Escalera, V. Athitsos, and I. Guyon, "Challenges in multimodal gesture recognition", Journal of Machine Learning Research, Vol. 17, No. 1, pp. 1-54, Jan. 2016. DOI: https://dl.acm.org/doi/abs/10.5555/2946645.3007025
  2. M. S. Jang and W. B. Lee, "Implementation of Hand-Gesture Interface to manipulate a 3D Object of Augmented Reality", The Journal of the Institute of Internet, Broadcasting and Communication(JIIBC), Vol. 16, No. 4, pp. 117-123, Aug. 2016. DOI: https://doi.org/10.7236/JIIBC.2016.16.4.117
  3. S. Yousefi, M. Kidaney, Y. Delgadoy, J. Chanay, and N. Reski, "3D Gesture-based Interaction for Immersive Experience in Mobile VR", in Proc. 23rd International Conference on Pattern Recognition(ICPR), pp. 2122-2127, Dec. 4-8, 2016.
  4. Z. Ren, J. Yuan, J. Meng, and Z. Zhang, "Robust Part-Based Hand Gesture Recognition Using Kinect Sensor", IEEE Transactions on Multimedia, Vol. 15, No. 5, pp. 1110-1120, Aug. 2013. DOI: https://doi.org/10.1109/TMM.2013.2246148
  5. J. Aliprantis, M. Konstantakis, R. Nikopoulou, P. Mylonas, G. Caridakis, "Natural Interaction in Augmented Reality Context", in Proc. Visual Pattern Extraction and Recognition for Cultural Heritage Understanding Workshop(VIPERC), pp. 50-61, Jan. 30.
  6. K. Kim, J. Kim, J. Choi, J. Kim, and S. Lee, "Depth Camera-Based 3D Hand Gesture Controls with Immersive Tactile Feedback for Natural Mid-Air Gesture Interactions", Sensors, Vol. 15, No. 1, pp. 1022-1046, Jan. 2015. DOI: https://doi.org/10.3390/s150101022
  7. T. Heimonen, J. Hakulinen, M. Turunen, J. P. P. Jokinen, T. Keskinen, and R. Raisamo, "Designing Gesture-Based Control for Factory Automation", in Proc. INTERACT, pp. 202-209, Sep. 2-6, 2013. DOI: https://doi.org/10.1007/978-3-642-40480-1_13
  8. A. Syberfeldt, O. Danielsson and P. Gustavsson, "Augmented Reality Smart Glasses in the Smart Factory: Product Evaluation Guidelines and Review of Available Products", IEEE Access, Vol. 5, pp. 9118-9130, May 2017. DOI: https://doi.org/10.1109/ACCESS.2017.270395
  9. M. Kim, S.H. Choi, K.-B. Park, and J.Y. Lee, "User Interactions for Augmented Reality Smart Glasses: A Comparative Evaluation of Visual Contexts and Interaction Gestures", Applied Sciences, Vol. 9, No. 15, 2019. DOI: https://doi.org/10.3390/app9153171
  10. Y. H. Hong, S. J. Song, K. M. Jang, and J. Rho, "Smart Factory Platform based on Multi-Touch and Image Recognition Technologies", The Journal of the Institute of Internet, Broadcasting and Communication(JIIBC), Vol. 18, No. 1, pp. 23-28, Feb. 2018. DOI: https://doi.org/10.7236/JIIBC.2018.18.1.23