Journal of the Korean Institute of Intelligent Systems (한국지능시스템학회논문지)

Korean Institute of Intelligent Systems (한국지능시스템학회)
권호 표지
DOI QR코드

DOI QR Code

Sleepiness Determination of Driver through the Frequency Analysis of the Eye Opening and Shutting

눈 개폐의 빈도수를 통한 운전자의 졸음판단 분석

  • Gong, Do-Hyun (Dept. of Control and Instrumentation Engineering, Chosun University) ;
  • Kwak, Keun-Chang (Dept. of Control and Instrumentation Engineering, Chosun University)
  • 공도현 (조선대학교 제어계측공학과) ;
  • 곽근창 (조선대학교 제어계측공학과)
  • Received : 2016.11.25
  • Accepted : 2016.12.21
  • Published : 2016.12.25
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we propose an improved face detection algorithm and determination method for drowsiness status of driver from the opening and closing frequency of the detected eye. For this purpose, face, eyes, nose, and mouth are detected based on conventional Viola-Jones face detection algorithm and spatial correlation of face. Here the spatial correlation of face is performed by DFP(Detect Face Part) based on seven characteristics. The experimental results on Caltect face image database revealed that the detection rates of noise particularly showed the improved performance of 13.78% in comparison to that of the previous Viola-Jones algorithm. Furthermore, we analyze the driver's drowsiness determination cumulative value of the eye closed state as a function of time based on SVM (Support Vector Machine) and PERCLOS(Percentage Closure of Eyes). The experimental results confirmed the usefulness of the proposed method by obtaining a driver's drowsiness determination rate of 93.28%.

본 논문은 개선된 얼굴검출 알고리즘과 눈의 개폐 빈도수로부터 운전자의 졸음을 판단하는 방법을 제안한다. 이를 위해 기존의 Viola-Jones 알고리즘과 얼굴의 공간적 상관관계를 이용하여 얼굴, 눈, 코, 입을 검출한다. 여기서, 얼굴의 공간적 상관관계는 7가지 특징에 기반한 DFP(Detect Face Part)에 의해 수행된다. Caltect 얼굴 데이터베이스에 실험을 한 결과, 특히 코 영역에 대한 검출률은 기존 Viola-Jones 알고리즘과 비교하여 13.78% 증가된 검출률을 보여주고 있다. 그리고, SVM(Support Vector Machine)과 PERCLOS(Percentage Closure of Eyes)을 사용해 시간에 따른 눈 개폐상태의 누적 값으로 운전자의 졸음 판단을 분석한다. 실험결과 93.28%의 운전자 졸음판단률을 얻어 제안된 방법의 유용성을 확인하였다.

Keywords

References

  1. Article of the korean times 2009-04-03
  2. S. M. Kang, K. M. Huh, Y. B. Joo, "Development of a drowsiness detection system using edge of eyes image," IEIE (The Institute of Electronics and Information Engineers) 2016 Information and Control Symposium, pp. 222-224, 2016.
  3. J. M. Choi, H. Song, S. H. Park and C. D. Lee , "Implementation of driver fatigue monitoring system," The Journal of the Institute of Webcasting, Internet and Telecommunication, vol. 37, pp. 711-720, 2012.
  4. J. Lee, H. Yoo, "A method to identify the identification eye status for drowsiness monitoring system," Transactions of The Korean Institute of Electrical Engineers, vol. 63, no. 12, pp. 1667-1670, 2014. https://doi.org/10.5370/KIEE.2014.63.12.1667
  5. Jae-Kyung Sung, In-Ho Choi, Sang-Min Park, Yong-Guk Kim, "Measure and analysis of open-close frequency of mouth and eyes for sleepiness decision," The Journal of the Institute of Internet, Broadcasting and Communication(IIBC), vol. 14, no. 3, pp. 89-97, 2014. https://doi.org/10.7236/JIIBC.2014.14.3.89
  6. S. Darshana, D. Fernando, "Efficient PERCLOS and gaze measurement methodologies to estimate driver attention in real time," International Conference on Intelligent Systems, pp. 27-29, 2014.
  7. S. L. Ham, N. Kwak, "Binary classification by the combination of Adaboost and feature extraction methods," Journal of the Institute of Electronics Engineers of Korea-CI, vol. 49, no.4, pp. 42-53, 2012.
  8. S. C. Lim, S. J. Jang, S. P. Lee, M. Y. Kim "Feature-Vector normalization for SVM-Based Music Genre Classification," Journal of the Institute of Electronics Engineers of Korea-SC, vol. 48, no.5, pp. 31-36, 2011.
  9. M. Weber 1999, Faces 1999 Front database", Available: http://www.vision.caltech.edu/archive.html, 1999
  10. H. Han, U. Chong, "Electroencephalogram- based Driver Drowsiness Detection System Using AR Coefficients and SVM," Journal of Korean Institute of Intelligent Systems, vol. 22, no. 6, pp. 768-773, 2012. https://doi.org/10.5391/JKIIS.2012.22.6.768
  11. J. Yang, S. Cho, S. T. Chung, "Fake Face Detection System Using Pupil Reflection," Journal of Korean Institute of Intelligent Systems, vol. 20, no. 5, pp. 645-651, 2010. https://doi.org/10.5391/JKIIS.2010.20.5.645
  12. C. H. Han, K. B. Sim, "Development of Driver's Emotion and Attention Recognition System using Multi-modal Sensor Fusion Algorithm," Journal of Korean Institute of Intelligent Systems, vol. 18, no. 6, pp. 754-761, 2010. https://doi.org/10.5391/JKIIS.2008.18.6.754
  13. Y. H. Joo, J. K. Kim, I. H. Ra, "Intelligent Drowsiness Drive Warning System," Journal of Korean Institute of Intelligent Systems, vol. 18, no. 2, pp. 223-229, 2008. https://doi.org/10.5391/JKIIS.2008.18.2.223
  14. C. Lee, C. H. Rhee, "Region Based Fuzzy Neural Networks for Face Detection," Journal of Korean Institute of Intelligent Systems, vol. 11, no. 1, pp. 39-44, 2001.
  15. R. Lienhart, A. Kuranov, and V. Pisarevsky "Empirical Analysis of Detection Cascades of Boosted Classifiers for Rapid Object Detection," Proceedings of the 25th DAGM Symposium on Pattern Recognition, Magdeburg, Germany, 2003.