The Journal of Korea Institute of Information, Electronics, and Communication Technology (한국정보전자통신기술학회논문지)

Korea Information Electronic Communication Technology (한국정보전자통신기술학회)
권호 표지
DOI QR코드

DOI QR Code

A Design of the Emergency-notification and Driver-response Confirmation System(EDCS) for an autonomous vehicle safety

자율차량 안전을 위한 긴급상황 알림 및 운전자 반응 확인 시스템 설계

  • Son, Su-Rak (Catholic Kwandong University, Department of Computer Engineering) ;
  • Jeong, Yi-Na (Catholic Kwandong University, Department of Software)
  • Received : 2021.03.02
  • Accepted : 2021.03.23
  • Published : 2021.04.30
Download PDF
⟨ Previous Next ⟩

Abstract

Currently, the autonomous vehicle market is commercializing a level 3 autonomous vehicle, but it still requires the attention of the driver. After the level 3 autonomous driving, the most notable aspect of level 4 autonomous vehicles is vehicle stability. This is because, unlike Level 3, autonomous vehicles after level 4 must perform autonomous driving, including the driver's carelessness. Therefore, in this paper, we propose the Emergency-notification and Driver-response Confirmation System(EDCS) for an autonomousvehicle safety that notifies the driver of an emergency situation and recognizes the driver's reaction in a situation where the driver is careless. The EDCS uses the emergency situation delivery module to make the emergency situation to text and transmits it to the driver by voice, and the driver response confirmation module recognizes the driver's reaction to the emergency situation and gives the driver permission Decide whether to pass. As a result of the experiment, the HMM of the emergency delivery module learned speech at 25% faster than RNN and 42.86% faster than LSTM. The Tacotron2 of the driver's response confirmation module converted text to speech about 20ms faster than deep voice and 50ms faster than deep mind. Therefore, the emergency notification and driver response confirmation system can efficiently learn the neural network model and check the driver's response in real time.

현재 자율주행차량 시장은 3레벨 자율주행차량을 상용화하고 있으나, 여전히 운전자의 주의를 필요로 한다. 3레벨 자율주행 이후 4레벨 자율주행차량에서 가장 주목되는 부분은 차량의 안정성이다. 3레벨과 다르게 4레벨 이후의 자율주행차량은 운전자의 부주의까지 포함하여 자율주행을 실시해야 하기 때문이다. 따라서 본 논문에서는 운전자가 부주의한 상황에서 긴급상황을 알리고 운전자의 반응을 인식하는 자율차량 안전을 위한 긴급상황 알림 및 운전자 반응 확인 시스템을 제안한다. 긴급상황 알림 및 운전자 반응 확인 시스템은 긴급상황 전달 모듈을 사용하여 긴급상황을 텍스트화하여 운전자에게 음성으로 전달하며 운전자 반응 확인 모듈을 사용하여 긴급상황에 대한 운전자의 반응을 인식하고 운전 권한을 운전자에게 넘길지 결정한다. 실험 결과, 긴급상황 전달 모듈의 HMM은 RNN보다 25%, LSTM보다 42.86% 빠른 속도로 음성을 학습했다. 운전자 반응 확인 모듈의 Tacotron2는 deep voice보다 약 20ms, deep mind 보다 약 50ms 더 빨리 텍스트를 음성으로 변환했다. 따라서 긴급상황 알림 및 운전자 반응 확인 시스템은 효율적으로 신경망 모델을 학습시키고, 실시간으로 운전자의 반응을 확인할 수 있다.

Keywords

References

  1. Tesla owner in Canada charged with 'sleeping' while driving over 90 mph, Andrew J. Hawkins, Available online: https://www.theverge.com/2020/9/18/21445168/tesla-driver-sleeping-police-charged-canada-autopilot
  2. Ji Hoon Na, Jung Mo Sung, Yoon Gi Yang, "Low-cost implementation of text to speech(TTS) system for car navigation", Journal of the Acoustical Society of Korea 2000 Summer Conference, The Acoustical Society of Korea, Vol.19, No.1, pp. 141-144, 2000
  3. Ji Young Yoon, Hyeon Ji Lee, Sung Soo Hwang, "Bus Arrival Guide Application for the Blind and Low Vision", PROCEEDINGS OF HCI KOREA 2018, The HCI Society of Korea, pp. 858-861, January, 2018
  4. Jin Woo Choi, Gu Min Jeong, "Development of Walking Assist Smartphone Case for Blind People", The Journal of Korea Institute of Information, Electronics, and Communication Technology, Korea Information Electronic Communication Technology, Vol.8, No.3, pp. 239-242, 2015 https://doi.org/10.17661/jkiiect.2015.8.3.239
  5. So Yeon Min, Kwang Hyong Lee, Dong Seon Lee, Dong Yeop Ryu, "A Study on Quantitative Evaluation Method for STT Engine Accuracy based on Korean Characteristics", Journal of Korea Academia-Industrial cooperation Society, Korea Academy Industrial Cooperation Society, Vol.21, No.7, pp. 699-707, 2020 https://doi.org/10.5762/KAIS.2020.21.7.699
  6. Chul Hee Han, Hong Goo Kang, Young Soo Hwang, Dae Hee Youn, "A Microphone Array Beamformer for the Performance Enhancement of Speech Recognizer in Car", The journal of the acoustical society of Korea, The acoustical society of Korea, Vol.24, No.7, pp.423-430, 2015
  7. Yuxuan Wang, RJ Skerry-Ryan, Daisy Stanton, Yonghui Wu, Ron J. Weiss, Navdeep Jaitly, Zongheng Yang, Ying Xiao, Zhifeng Chen, Samy Bengio, Quoc Le, Yannis Agiomyrgiannakis, Rob Clark, Rif A. Saurous, "Tacotron: Towards End-to-End Speech Synthesis", Interspeech 2017, Stockholm, Sweden, August, 2017
  8. The LJ Speech Dataset. Available online: https://keithito.com/LJ-Speech-Dataset/(2020-09-03).
  9. Won-jun Yoo, "Introduction to natural language processing using deep learning", 2020
  10. Understanding LSTM Networks, colah, Available online: http://colah.github.io/posts/2015-08-Understanding-LSTMs/
  11. Miles Anderson, Yadong Wang, Francois Leo, Stephane Coen, Miro Erkintalo, Stuart Murdoch, "Super cavity solitons and the coexistence of multiple nonlinear states in a tristable passive Kerr resonator", Phys. Rev., Vol. 7, 2017
  12. Jeff Donahue, Sander Dieleman, Mikolaj Binkowski, Erich Elsen, Karen Simonyan, "END-TO-END ADVERSARIAL TEXT-TO-SPEECH", DeepMind, 2020