Browse > Article
http://dx.doi.org/10.15701/kcgs.2022.28.3.125

Deep Learning based Vehicle AR Manual for Improving User Experience  

Lee, Jeong-Min (Soongsil University Graduates School)
Kim, Jun-Hak (DEEP.FINE Co., Ltd.)
Seok, Jung-Won (DEEP.FINE Co., Ltd.)
Park, Jinho (Soongsil University Graduates School)
Publication Information
Journal of the Korea Computer Graphics Society / v.28, no.3, 2022 , pp. 125-134 More about this Journal
Abstract
This paper implements an AR manual for a vehicle that can be used even in the vehicle interior space where it is difficult to apply the augmentation method of AR content, which is mainly used, and applies a deep learning model to improve the augmentation matching between real space and virtual objects. Through deep learning, the logo of the steering wheel is recognized regardless of the position, angle, and inclination, and 3D interior space coordinates are generated based on this, and the virtual button is precisely augmented on the actual vehicle parts. Based on the same learning model, the function to recognize the main warning light symbols of the vehicle is also implemented to increase the functionality and usability as an AR manual for vehicles.
Keywords
augmented reality; AR; AI; deep learning; manual for vehicle; user guide; object detection;
Citations & Related Records
Times Cited By KSCI : 4  (Citation Analysis)
연도 인용수 순위
1 YOLOv5 Documentation, Retrieved Dec., 30, 2021, from https://docs.ultralytics.com/#yolov5
2 김익수, 이문구, 전용호.(2021). 결함검출 적용을 위한 YOLO 딥러닝 알고리즘 비교. 한국생산제조학회지, 30(6), 514-519.
3 Calculate X, Y, Z Real World Coordinates from Image Coordinates using OpenCV, Retrieved Apr., 5, 2022, from https://www.fdxlabs.com/calculate-x-y-z-real-world-coordinates-from-a-single-camera-using-opencv/
4 송주은, 국중진.(2021). Visual SLAM 기반의 모바일 증강현실 시스템 구축. 한국반도체디스플레이기술학회, 20(4), 96-101.
5 한국소비자원.(2020). 자동차 휴대용 취급설명서 표준화. 안전보고서, (), 1-35.
6 Ankur Joshi, Saket Kale, Satish Chandel, D. K. Pal.(2015). Likert Scale: Explored and Explained. Current Journal of Applied Science and Technology, 7(4), 396-403.
7 이용환, 김영섭.(2020). 객체 검출을 위한 CNN과 YOLO 성능 비교 실험. 한국반도체디스플레이기술학회, 19(1), 85-92.
8 Oh Sung-hwan, Kiduk Kim.(2013). Study on Establishment of Deoksugung Palace, Tourist Information Services using Augmented Reality(AR) Technology. 문화재, 46(2), 26-45.   DOI
9 정지정, 이광, 김봉근.(2017). 3차원 비콘 위치측정을 이용한 마커기반 증강현실의 안정적 서비스에 관한 연구. 한국전자통신학회, 12(5), 883-890.   DOI
10 권오흠, 정명환, 송하주.(2017). 스마트폰을 이용한 물체의 3차원 위치 추정 기법. 멀티미디어학회논문지, 20(8), 1200-1207.
11 TensorFlow Lite | ML for Mobile and Edge Devices, Retr ieved Dec., 30, 2021, from https://www.tensorflow.org/lite
12 KIA Owner's manual (Google Play APP), Retrieved Dec., 30, 2021, from https://play.google.com/store/apps/details?id=com.kia.mowners.p
13 Performance Monitoring | An app performance monitoring tool | Firebase, Retrieved Apr., 5, 2022, from https://firebase.google.com/products/performance
14 김보성, 송오영.(2021). Unity MARS를 이용한 증강현실 기반 불 특수효과 콘텐츠 개발. 한국컴퓨터그래픽스학회 학술대회, (), 38-39.
15 강태석, 이동연, 김진모.(2020). CLO 3D와 Vuforia를 활용한 증강현실 기반 디지털 패션 콘텐츠 제작. 컴퓨터그래픽스학회논문지, 26(3), 21-29.