DOI QR코드

DOI QR Code

음성인식과 딥러닝 기반 객체 인식 기술이 접목된 모바일 매니퓰레이터 통합 시스템

Integrated System of Mobile Manipulator with Speech Recognition and Deep Learning-based Object Detection

  • Jang, Dongyeol (Korea University of Technology and Education) ;
  • Yoo, Seungryeol (Mechanical Engineering, Korea University of Technology and Education)
  • 투고 : 2021.04.05
  • 심사 : 2021.07.08
  • 발행 : 2021.08.31

초록

Most of the initial forms of cooperative robots were intended to repeat simple tasks in a given space. So, they showed no significant difference from industrial robots. However, research for improving worker's productivity and supplementing human's limited working hours is expanding. Also, there have been active attempts to use it as a service robot by applying AI technology. In line with these social changes, we produced a mobile manipulator that can improve the worker's efficiency and completely replace one person. First, we combined cooperative robot with mobile robot. Second, we applied speech recognition technology and deep learning based object detection. Finally, we integrated all the systems by ROS (robot operating system). This system can communicate with workers by voice and drive autonomously and perform the Pick & Place task.

키워드

과제정보

This project was funded by Korea Robotics Society (KROS), and is currently supported by the publication grant; This paper was supported by Education and Research promotion program of KOREATECH in 2021.

참고문헌

  1. H. J. Yoo and H. B. Kim, "Collaborative robot for manufacturing," Korea Institute of S&T Evaluation and Planning, Eumseong, Chungcheongbuk, Korea, [Online], https://www.kistep.re.kr/.
  2. Y. G. Kim, "ICT Spot Issue (2017-06) The Next Big Thing, Trend and implication of Service Robot," Institute for Information & Communication Technology Planning & Evaluation, Daejeon, Korea, [Online], https://www.iitp.kr.
  3. Omron, [Online], http://asq.kr/rMZb6MZE1fugB, Accessed: January 29, 2021.
  4. D. Hu, D. DeTone, and T. Malisiewicz, "Deep ChArUco: Dark ChArUco Marker Pose Estimation," IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), California, USA, pp. 8436-8444, 2019, DOI: 10.1109/CVPR.2019.00863.
  5. J. Denavit and R. S. Hartenberg, "A Kinematic Notation for Lower-Pair Mechanisms Based on Matrices," Journal of Applied Mechanics, pp. 215-221, Jun., 1955, DOI: 10.1115/1.4011045.
  6. K. He, G. Gkioxari, P. Dollar, and R. Girshick, "Mask R-CNN," 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy, pp. 2961-2969, 2017, DOI: 10.1109/ICCV.2017.322.
  7. Center of mass - Wikipedia, [Online], https://en.wikipedia.-org/wiki/Center_of_mass, Accessed: January 29, 2021.
  8. S. Choi and J. Kim, "Comparison Analysis of Speech Recognition Open APIs' Accuracy," Asia-pacific Journal of Multimedia Services Convergent with Art, Humanities, and Sociology, vol. 7, no. 8, pp. 411-418, 2017, DOI : 10.35873/ajmahs.2017.7.8.038.
  9. F. Spenrath and A. Pott, "Gripping Point Determination for Bin Picking Using Heuristic Search," 10th CIRP Conference on Intelligent Computation in Manufacturing Engineering - CIRP ICME '16, Ischia, Italy, pp. 606-611, 2017, DOI: 10.1016/j.procir.2016.06.015.