Journal of Navigation and Port Research (한국항해항만학회지)

Korean Institute of Navigation and Port Research (한국항해항만학회)
권호 표지
DOI QR코드

DOI QR Code

3D Mapping for Improving the Safety of Autonomous Driving in Container Terminals

  • Ngo Quang Vinh (Graduate School of Korea Maritime and Ocean University) ;
  • Ji-Hoon Park (Department of Smart Port Logistics, Korea Maritime and Ocean University) ;
  • Hyeon-Soo Shin (KMI-KMOU Cooperation Program, Graduate School of Korea Maritime and Ocean University) ;
  • Hwan-Seong Kim (Dept. of Logistics, Korea Maritime and Ocean University)
  • Received : 2023.06.01
  • Accepted : 2023.06.26
  • Published : 2023.10.31
Download PDF
⟨ Previous Next ⟩

Abstract

Automated container terminals (ACTs) contribute many benefits to operation shipments, such as productivity, management cost, and real-time freight tracking, in which ensuring a high level of safety in container terminals is extremely important to prevent accidents and optimize operations. This study proposes a method for increasing safety levels in container terminals through the application of object detection with state-of-the-art EfficientDet model support. A distance estimation method is employed to accurately measure the distance to objects and provide proximity alerts when predefined safety thresholds are exceeded. 3D Mapping technology is utilized to create a detailed representation of the container terminal in a virtual environment. This enables a comprehensive visualization of the surroundings, including structures, equipment, and objects. By combining object detection and distance estimation results with the 3D map, potential safety issues can be identified with greater precision. A realistic container terminal scenario was used to evaluate the robustness of the proposed method.

Keywords

References

  1. Bayoudh, K. et al.(2021), "Transfer Learning Based Hybrid 2D-3D CNN for Traffic Sign Recognition and Semantic Road Detection Applied in Advanced Driver Assistance Systems", Applied Intelligence, Vol. 51, No. 1, pp. 124-142. https://doi.org/10.1007/s10489-020-01801-5
  2. Heikkila, M. et al.(2022), "Innovation in Smart Ports: Future Directions of Digitalization in Container Ports", Journal of Marine Science Engineering, Vol. 10, No. 12, 1925.
  3. Liu, R. W. et al.(2021), "An Enhanced CNN-enabled Learning Method for Promoting Ship Detection in Maritime Surveillance System", Ocean Engineering, Vol. 235, 109435.
  4. Lin, T. Y. et al.(2017), "Feature Pyramid Networks for Object Detection", 2017 IEEE Conference on Computer Vision and Pattern Recognition, pp. 936-944.
  5. Ogawa, T. and Takagi, K.(2006), "Lane Recognition using On-vehicle LIDAR", 2006 IEEE Intelligent Vehicles Symposium, pp. 540-545.
  6. Patole, S. M. et al.(2017), "Automotive Radars: A Review of Signal Processing Techniques", IEEE Signal Processing Magazine, Vol. 34, No. 2, pp. 22-35. https://doi.org/10.1109/MSP.2016.2628914
  7. Tan, M. et al.(2020), "EfficientDet: Scalable and Efficient Object Detection", 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 10778-10787.
  8. Thrun, S. et al.(1998), "A probabilistic approach to concurrent mapping and localization for mobile robots, Autonomous Robots, 5, pp. 253-271. https://doi.org/10.1023/A:1008806205438
  9. UNCTAD(2022), "Review of Maritime Report 2022" https://unctad.org/system/files/official-document/rmt2022_en.pdf (accessed on May 26th, 2023)
  10. Xu, X. et al.(2022), "Exploiting High-fidelity Kinematic Information from Port Surveillance Videos via a YOLO-based Framework", Ocean & Coastal Management, Vol. 222, 106117.
  11. Zhao, J. et al.(2019), "Detection and Tracking of Pedestrians and Vehicles using Roadside LiDAR Sensors", Transportation Research Part C: Emerging Technologies, Vol. 100, pp. 68-87. https://doi.org/10.1016/j.trc.2019.01.007
  12. Zou, Q. et al.(2021), "A Comparative Analysis of LiDAR SLAM-based Indoor Navigation for Autonomous Vehicles", IEEE Transactions on Intelligent Transportation Systems, Vol. 23, No. 7, pp. 6907-6921.
  13. Zhe, T. et al.(2020), "Inter-Vehicle Distance Estimation Method Based on Monocular Vision Using 3DDetection", IEEE Transactions on Vehicular Technology, Vol. 69, No. 5, pp. 4907-4919.