Browse > Article
http://dx.doi.org/10.5762/KAIS.2021.22.1.24

Detecting the screw-assembly state of a valve-body using the AR method  

Kang, Moon-Ho (Department of Information and Communication Engineering, Sunmoon University)
Publication Information
Journal of the Korea Academia-Industrial cooperation Society / v.22, no.1, 2021 , pp. 24-30 More about this Journal
Abstract
In this study, an augmented reality (AR) app that detects the screw-assembly state of a car valve-body and assists the assembly work is developed and the effectiveness of the app is shown through testing. The app creates the contents indicating the screw-assembly position and order, and the screw-assembly state. Then, the contents are registrated onto the valve-body image on a smart-phone screen to be shown to the worker during assembly. To this end, the features are extracted from the 2D image of the valve-body and the location of the valve-body is tracked. By extracting the areas where the screws are to be assembled, and periodically determining the luminance of these areas, it is checked whether the screws are assembled in order at the predetermined position of the valve-body. When an error is detected during assembly, a warning sound is notified to the worker, and the worker can check the assembly state on the smart-phone screen and handle the error, immediately. Study results found that it takes about 65 ms to detect the assembly state of the five screws, and the assembly state is detected without error for 1 hour.
Keywords
Android app; Augmented reality; Detect assembly state; Valve-body; Pose tracking;
Citations & Related Records
연도 인용수 순위
  • Reference
1 S. Kapur and N. Thakkar. Mastering OpenCV Android Application Programming, Packt Publishing Ltd, pp. 23-46, 2015.
2 Schmalstieg and T. Hollerer, Augmented Reality, Principles and Practice, Dieter, Addison-Wesley, pp. 78-84, 2016.
3 S. Aukstakalnis, Practical Augmented Reality: A Guide to the Technologies, Applications, and Human Factors for AR and VR, Addison-Wesley, pp.227-329, 2016.
4 V. Paelke, "Augmented Reality in the Smart Factory Supporting Workers in an Industry 4.0. Environment", Proc. of the IEEE Emerging Technology and Factory Automation, pp. 1-4, 2014. DOI: https://doi.org/10.1109/ETFA.2014.7005252   DOI
5 A. Deshpande and I. Kim, "The Effects of Augmented Reality on Improving Spatial Problem Solving for Object Assembly", Advanced Engineering Informatics, vol. 38, pp. 760-775, 2018. DOI: https://doi.org/10.1016/j.aei.2018.10.004   DOI
6 O. Danielsson, A. Syberfeldta, M. Holma, and L. Wangb, "Operators Perspective on Augmented Reality as a Support Tool in Engine Assembly", Procedia CIRP, vol. 72, pp. 45-50, 2018. DOI: https://doi.org/10.1016/j.procir.2018.03.153   DOI
7 D. Aouam, S. Benbelkacem, N. Zenati, S. Zakaria, Z. Meftah, "Voice-based Augmented Reality Interactive System for Car's Components Assembly", 3rd International Conference on Pattern Analysis and Intelligent Systems (PAIS), pp. 1-5, 2018. DOI: https://doi.org/10.1109/PAIS.2018.8598516   DOI
8 K. Qian, X. Zhang, H. Yu and X. Ma, "Industrial Maintenance and Assembly Guidance Using a Markerless AR System with Monocular Camera", 15th International Conference on Control, Automation, Robotics and Vision (ICARCV), pp. 1911-1016, 2018. DOI: https://doi.org/10.1109/ICARCV.2018.8581087   DOI
9 R. Laganiere, OpenCV Computer Vision Application Programming Cookbook, 2nd Edition, Packt, pp. 281-313, 2014.
10 I. E. Nugraha, T. W. Sen, R. Wahyu, B. Sulistyo, et al., "Assembly instruction with augmented reality on Android application "assembly with AR"", 4th International Conference on New Media Studies, pp. 32-37, 2017. DOI: https://doi.org/10.1109/CONMEDIA.2017.8266027   DOI
11 Getting Started with Vuforia Engine for Android Development, https://library.vuforia.com/articles/Solution/Getting-Started-with-Vuforia-for-Android-Development.html
12 R. Kusterer, jMonkeyEngine 3.0: Beginner's Guide, June 2013.