Browse > Article
http://dx.doi.org/10.6109/jkiice.2022.26.6.859

Driver Drowsiness Detection System using Image Recognition and Bio-signals  

Lee, Min-Hye (Center for General Education, Wonkwang University)
Shin, Seong-Yoon (School of Computer Information & Communication Engineering, Kunsan National University)
Abstract
Drowsy driving, one of the biggest causes of traffic accidents every year, is accompanied by various factors. As a general method to check whether or not there is drowsiness, a method of identifying a driver's expression and driving pattern, and a method of analyzing bio-signals are being studied. This paper proposes a driver fatigue detection system using deep learning technology and bio-signal measurement technology. As the first step in the proposed method, deep learning is used to detect the driver's eye shape, yawning presence, and body movement to detect drowsiness. In the second stage, it was designed to increase the accuracy of the system by identifying the driver's fatigue state using the pulse wave signal and body temperature. As a result of the experiment, it was possible to reliably determine the driver's drowsiness and fatigue in real-time images.
Keywords
Deep learning; Bio-signals; Image recognition; Drowsy driving; Fatigue detection;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 J. W. Son and M. O. Park, "Driving behavior Analysis to Verify the Criteria of a Driver Monitoring System in a Conditional Autonomous Vehicle-Part II-," Journal of Auto-Vehicle Safety Association, vol. 13, no. 1, pp. 38-44, Mar. 2022.
2 B. J. Moon, K. B. Yeon, S. G. Lee, S. P. Hong, S. Y. Nam, and D. H. Kim, "Drowsy Driving Detection Algorithm Using a Steering Angle Sensor And State of the Vehicle," Journal of the institute of electronics engineers of Korea IE, vol. 49, no. 2, pp. 30-39, Jun. 2012.
3 J. Y. Lee, J. H. Jeong, D. Y. Kim, J. H. Gwon, and T. J. Yun, "Drowsiness warning system using eye-blink and heart rate," in Proceeding of the 64th Korea Society of Computer and Information, Jeju, Korea, pp. 519-520, 2021.
4 Public data portal. National Police Agency_Drowsy Driving Traffic Accidents [Internet]. Available: https://www.data.go.kr/data/15047952/fileData.do.
5 M. Y. Oh, Y. S. Jeong, and K. H. Park, "Driver Drowsiness Detection Algorithm based on Facial Feature," Journal of Korea Multimedia Society, vol. 19, no. 11, pp. 1852-1861, Nov. 2016.   DOI
6 H. A. Lee and S. Y. Shin, "Implementation of Drowsy Prevention System Using Arduino and YOLO," Journal of the Korea Institute of Information and Communication Engineering, vol. 25, no. 7, pp. 917-922, Jul. 2021.   DOI
7 S. M. Jeong, G. H. Kim, H. J. Mun, and C. G. Kim, "Design and Implementation of a System to Detect Zigzag Driving using Sensor," Journal of digital convergence, vol. 14, no. 11, pp. 305-311, Nov. 2016.   DOI
8 C. M. Park, "A Study on the Drowsy Driving Prevention System using the Pulse Sensor," in Proceeding of the 38th Korea Institute of Information and Communication Engineering, Busan, Korea, pp. 577-578, 2016.
9 K. Fujiwara, E. Abe, K. Kamata, C. Nankayama, Y. Suzuki, T. Yamakawa, T. Hiraoka, M. Kano, Y. Sumi, F. Masuda, M. Matsuo, and H. Kadotani, "Heart rate variability-based driver drowsiness detection and its validation with EEG," IEEE Transactions on Biomedical Engineering, vol. 66, no. 6, pp. 1769-1778, Jun. 2019.   DOI
10 H. S. Park, "Appratus and method for sensing driver sleepiness/drinking," Hyundai Mobis, Seoul, Korea, Patent 10-2011-0093033, DOI: 10.8080/1020110093033.   DOI
11 S. G. Lee, Y. S. Kwon, J. S. Park, S. J. Yun, and W. T. Kim, "A Sleep-driving Accident Prevention System based on EEG analysis using Deep-learning Algorithm," Journal of The Institute of Electronics and Information Engineers, vol. 55, no. 3, pp. 67-73, Mar. 2018   DOI
12 H. T. Choi, M. K. Back, J. S. Kang, and K. C. Lee, "Driver Drowsiness Detection Based on Visual-Feature Using Multi-Modal Learning," The Journal of Korean Institute of Communications and Information Sciences, vol. 43, no. 7, pp. 1124-1132, Jul. 2018.   DOI
13 Y. H. Kim, C. H. Lee, H. S. Cho, J. S. Park, J. Y. Park, G. H. Song, J. H. An, S. J. Lee, J. Y. Lee, J. S. Lee, and S. J. Hong, "Convergent Ideation for Future Transport Systems," Korea transport institute(KOTI), Sejong, KR, Research Report, 2011.
14 B. T. Ahn, "Study for Drowsy Driving Detection & Prevention System," Journal of Convergence for Information Technology, vol. 8, no. 3, pp. 193-198, Mar. 2018.   DOI