Journal of IKEEE (전기전자학회논문지)

Institute of Korean Electrical and Electronics Engineers (한국전기전자학회)
권호 표지
DOI QR코드

DOI QR Code

Implementation of ROS-Based Intelligent Unmanned Delivery Robot System

ROS 기반 지능형 무인 배송 로봇 시스템의 구현

  • Seong-Jin Kong (Dept. of Intelligent Robot Engineering, Pukyong National University) ;
  • Won-Chang Lee (Dept. of Electronic Engineering, Pukyong National University)
  • Received : 2023.12.14
  • Accepted : 2023.12.27
  • Published : 2023.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we implement an unmanned delivery robot system with Robot Operating System(ROS)-based mobile manipulator, and introduce the technologies employed for the system implementation. The robot consists of a mobile robot capable of autonomous navigation inside the building using an elevator and a Selective Compliance Assembly Robot Arm(SCARA)-Type manipulator equipped with a vacuum pump. The robot can determines the position and orientation for picking up a package through image segmentation and corner detection using the camera on the manipulator. The proposed system has a user interface implemented to check the delivery status and determine the real-time location of the robot through a web server linked to the application and ROS, and recognizes the shipment and address at the delivery station through You Only Look Once(YOLO) and Optical Character Recognition(OCR). The effectiveness of the system is validated through delivery experiments conducted within a 4-story building.

본 논문에서는 Robot Operating System(ROS) 기반의 모바일 매니퓰레이터(Manipulator)를 이용한 무인 배송 로봇 시스템을 구현하고 시스템 구현을 위해 사용된 기술에 대해 소개한다. 로봇은 엘리베이터를 이용해 건물 내부에서 자율주행이 가능한 모바일 로봇과 진공 펌프를 부착한 Selective Compliance Assembly Robot Arm(SCARA)-Type의 매니퓰레이터로 구성된다. 로봇은 매니퓰레이터에 부착된 카메라를 이용하여 이미지 분할과 모서리 검출을 통해 배송물을 들어올리기 위한 위치와 자세를 결정할 수 있다. 제안된 시스템은 스마트폰 앱 및 ROS와 연동된 웹서버를 통해 배송 현황을 조회하고 로봇의 실시간 위치를 파악할 수 있도록 사용자 인터페이스를 가지고 있으며, You Only Look Once(YOLO)와 Optical Character Recognition(OCR)을 통해 배송 스테이션에서 배송물과 주소지를 인식한다. 아울러 4층 건물 내부에서 진행한 배송 실험을 통해 시스템의 유효성을 검증하였다.

Keywords

Acknowledgement

This work was supported by a Research Grant of Pukyong National University(2023)

References

  1. Srinivas, Sharan, Surya Ramachandiran, and Suchithra Rajendran, "Autonomous robot-driven deliveries: A review of recent developments and future directions.," Transportation research part E: logistics and transportation review, 165, (2022): 102834. DOI: 10.1016/j.tre.2022.102834
  2. Abdulla, A. A., Liu, H., Stoll, N., & Thurow, K., "An automated elevator management and multi-floor estimation for indoor mobile robot transportation based on a pressure sensor," 2016 17th International Conference on Mechatronics-Mechatronika (ME), IEEE, 2016.
  3. Siao, Cheng-Yan, Jhe-Wei Lin, and Rong-Guey Chang, "The design and implementation of a delivery system," 2020 IEEE Eurasia Conference on IOT, Communication and Engineering (ECICE), IEEE, 2020. DOI: 10.1109/ECICE50847.2020.9301993
  4. Gao, K., Xin, J., Cheng, H., Liu, D., & Li, J., "Multi-mobile robot autonomous navigation system for intelligent logistics," 2018 Chinese Automation Congress (CAC), IEEE, 2018. DOI: 10.1109/CAC.2018.8623343
  5. Lee, D., Kang, G., Kim, B., & Shim, D. H., "Assistive delivery robot application for real-world postal services," IEEE Access 9 (2021): 141981-141998. DOI: 10.1109/ACCESS.2021.3120618
  6. Grisetti, G., Kummerle, R., Stachniss, C., & Burgard, W., "A tutorial on graph-based SLAM," IEEE Intelligent Transportation Systems Magazine, 2010, 2.4: 31-43. DOI: 10.1109/MITS.2010.939925
  7. L. Zhi, M. Xuesong, "Navigation and control system of mobile robot based on ROS," 2018 IEEE 3rd Advanced Information Technology, Electronic and Automation Control Conference (IAEAC), IEEE, pp.368-372, 2018. DOI: 10.1109/IAEAC.2018.8577901
  8. K. Zheng, "Ros navigation tuning guide," Robot Operating System (ROS) The Complete Reference (Volume 6), Springer, pp.197-226. 2021. DOI:10.1007/978-3-030-75472-3_6
  9. Chang, Wei-Che, Ming-Yang Cheng, and Hong-Jin Tsai., "Image feature command generation of contour following tasks for SCARA robots employing Image-Based Visual Servoing-A PH-spline approach," Robotics and Computer-Integrated Manufacturing 44 (2017): 57-66. DOI:10.1016/j.rcim.2016.08.002
  10. POP, Cristian; GRIGORESCU, Sanda M.; DAVIDESCU, Arjana., "Colored object detection algorithm for visual-servoing application," In 2012 13th International Conference on Optimization of Electrical and Electronic Equipment (OPTIM), IEEE, 2012. pp.1539-1544. DOI:10.1109/OPTIM.2012.6231887
  11. MALIK, Jyoti; DAHIYA, Ratna; SAINARAYANAN, G., "Harris operator corner detection using sliding window method", International Journal of Computer Applications, 2011, 22.1: 28-37. DOI:10.5120/2546-3489
  12. Ma, X., Fang, F., Qian, K., & Liang, C., "Networked robot systems for indoor service enhanced via ROS middleware," In 2018 13th IEEE Conference on Industrial Electronics and Applications (ICIEA), IEEE, 2018. pp.852-857. DOI: 10.1109/ICIEA.2018.8397832