Journal of the Ergonomics Society of Korea (대한인간공학회지)

Ergonomics Society of Korea (대한인간공학회)
권호 표지
DOI QR코드

DOI QR Code

A Survey of Objective Measurement of Fatigue Caused by Visual Stimuli

시각자극에 의한 피로도의 객관적 측정을 위한 연구 조사

  • Kim, Young-Joo (Division of Fusion and Convergence of Mathematical Sciences, National Institute for Mathematical Sciences) ;
  • Lee, Eui-Chul (Division of Fusion and Convergence of Mathematical Sciences, National Institute for Mathematical Sciences) ;
  • Whang, Min-Cheol (Division of Digital Media Technology, Sangmyung University) ;
  • Park, Kang-Ryoung (Division of Electronics and Electrical Engineering, Dongguk University)
  • 김영주 (국가수리과학연구소 융복합수리과학연구부) ;
  • 이의철 (국가수리과학연구소 융복합수리과학연구부) ;
  • 황민철 (상명대학교 디지털미디어학부) ;
  • 박강령 (동국대학교 전자전기공학부)
  • Received : 2011.02.01
  • Accepted : 2011.02.08
  • Published : 2011.02.28
Download PDF
⟨ Previous Next ⟩

Abstract

Objective: The aim of this study is to investigate and review the previous researches about objective measuring fatigue caused by visual stimuli. Also, we analyze possibility of alternative visual fatigue measurement methods using facial expression recognition and gesture recognition. Background: In most previous researches, visual fatigue is commonly measured by survey or interview based subjective method. However, the subjective evaluation methods can be affected by individual feeling's variation or other kinds of stimuli. To solve these problems, signal and image processing based visual fatigue measurement methods have been widely researched. Method: To analyze the signal and image processing based methods, we categorized previous works into three groups such as bio-signal, brainwave, and eye image based methods. Also, the possibility of adopting facial expression or gesture recognition to measure visual fatigue is analyzed. Results: Bio-signal and brainwave based methods have problems because they can be degraded by not only visual stimuli but also the other kinds of external stimuli caused by other sense organs. In eye image based methods, using only single feature such as blink frequency or pupil size also has problem because the single feature can be easily degraded by other kinds of emotions. Conclusion: Multi-modal measurement method is required by fusing several features which are extracted from the bio-signal and image. Also, alternative method using facial expression or gesture recognition can be considered. Application: The objective visual fatigue measurement method can be applied into the fields of quantitative and comparative measurement of visual fatigue of next generation display devices in terms of human factor.

Keywords

References

  1. Busso, C., Deng, Z., Yildirim, S., Bulut, M., Lee, C. M., Kazemzadeh, A., Lee, S., Neumann, U. and Narayanan, S., "Analysis of emotion recognition using facial expressions, speech and multimodal information", In Proceedings of the 6th international conference on Multimodal interfaces, (pp. 205-211), 2004.
  2. Cavallaro, F. I., Cacace, I., Testa, M. D., Andre, P., Carli, G., Pascalis, V. D., Rocchi, R. and Santarcangelo, E. L., Hypnotizability-related EEG alpha and theta activities during visual and somesthetic imageries,Neuroscience Letter, 470, 13-18, 2010. https://doi.org/10.1016/j.neulet.2009.12.044
  3. Chen, M. and Lin, C., Comparison of TFT-LCD and CRT on visual recognition and subjective preference, International Journal of Industrial Ergonomics, 34(3), 167-174, 2004. https://doi.org/10.1016/j.ergon.2004.02.003
  4. Cho, C. W., Lee, J. W., Lee E. C. and Park, K. R., A Robust Gaze Tracking Method by Using Frontal Viewing and Eye Tracking Cameras, Optical Engineering, 48(12), 2009.
  5. Emoto, M., Niida, T. and Okano, F., Repeated Vergence Adaptation Causes the Decline of Visual Functions in Watching Stereoscopic Television, Journal of Display Technology, 1(2), 328-340, 2005. https://doi.org/10.1109/JDT.2005.858938
  6. Gunes, H. and Piccardi, M., Bi-modal emotion recognition from expressive face and body gestures, Journal of Network and Computer Applications, 30(4), 1334-1345, 2007. https://doi.org/10.1016/j.jnca.2006.09.007
  7. Gupta, S., Kar, S., Gupta, S. and Routray, A., "Fatigue in Human Drivers: A Study Using Ocular, Psychometric, Physiological Signals", Proceeding of the 2010 IEEE Students' Technology Symposium, IIT Kharagpur. 2010.
  8. Hakkinen, J., Vuori, T. and Paakka, M., "Postural stability and sickness symptoms after HMD use", The Proceedings of IEEE International Conference on Systems, Man and Cybernetics, 1(pp. 147-152), 2002.
  9. Han, E. J., Kang, B. J., Park, K. R., and S. Lee, "Support vector machinebased facial-expression recognition method combining shape and appearance", Optical Engineering, 49(11), 117202, 2010. https://doi.org/10.1117/1.3506200
  10. Heo, H., Lee, E. C., Woo, J. C., Kim, C. J., Park, K. R. and Whang, M. C., A Realistic game system using Multi-modal user interface, IEEE Transactions on Consumer Electronics, 53(6), 1364-1372, 2010. https://doi.org/10.1109/TCE.2010.5606271
  11. Iwakiri, K., Mori, I., Sotoyama, M., Horiguchi, K., Ochiai, T., Jonai, H. and Saito, S., Survey on visual and musculoskeletal symptoms in VDT workers. Journal of Occupational Health, 46(6), 201-212. 2004.
  12. Kaneko, K. and Sakamoto, K., Spontaneous blinks as a criterion of visual fatigue during prolonged work on visual display terminals, Perceptual and Motor Skills, 92(1), 234-250, 2001. https://doi.org/10.2466/PMS.92.1.234-250
  13. Kar, S., Bhagat, M.and Routray, A., EEG signal analysis for the assessment and quantification of driver's fatigue, Transportation Research Part F, 13, 297-306, 2010. https://doi.org/10.1016/j.trf.2010.06.006
  14. Katsuyuki, M., Shunichi, A., Kazuhito, Y., Kohei, Y., Toshihiro, O. and Shinichi, S., Accumulation of VDT work-related eyestrain assessed by visual evoked potential, near point distance and critical flicker fusion. Industrial Health, 34(2), 61-69, 1996. https://doi.org/10.2486/indhealth.34.61
  15. Lal, S. K. L. and Craig, A., A critical review of the psychophysiology of driver fatigue, Biological Psychology, 55, 173-194, 2001. https://doi.org/10.1016/S0301-0511(00)00085-5
  16. Lal, S. K. L. and Craig, A., Driver Fatigue: Psychological and Electroencephalography Assessment, Psychophysiology, 39(3), 313-321, 2002. https://doi.org/10.1017/S0048577201393095
  17. Lambooij, M. and Ijsselsteijn, W., Visual Discomfort and Visual Fatigue of Steroscopic Display: A Review, Journal of Imaging Science and Technology, 53(3), 030201-1-14, 2009.
  18. Lee, E. C., "Camera Vision Based System for Quantitatively Measuring Emotional Responses Caused by Visual Stimuli", In Proceeding of Korean Workshop on Image Processing and Image Understanding, to be appeared, 2011.
  19. Lee, E. C., Heo, H. and Park, K. R., The Comparative Measurements of Eyestrain Caused by 2D and 3D Displays, IEEE Transactions on Consumer Electronics, 53(6), 2010. https://doi.org/10.1109/TCE.2010.5606312
  20. Lee, E. C., Lee, S., Won, C. S. and Park, K. R., Minimizing Eyestrain on LCD TV Based on Edge Difference and Scene Change, IEEE Transactions on Consumer Electronics, 55(4), 2009. https://doi.org/10.1109/TCE.2009.5373801
  21. Lee, E. C., Park, K. R., Whang, M and Min, K. H., Measuring the Degree of Eyestrain caused by watching LCD and PDP Devices, International Journal of Industrial Ergonomics, 39(5), 798-806, 2009. https://doi.org/10.1016/j.ergon.2009.02.008
  22. Lee, E. C. and Park, K. R., "Measuring Eyestrain on LCD TV According to Adjustment Factors of Image", IEEE Transactions on Consumer Electronics, 55(3), 1447-1452, 2009. https://doi.org/10.1109/TCE.2009.5278012
  23. Lienhart, R. and Maydt, J., "An extended set of haar-like features for rapid object detection", Proceedings of international conference on image processing, 1(pp. 900-903), 2002. https://doi.org/10.1109/ICIP.2002.1038171
  24. Li, H-C. O., Seo, J., Kham, K. and Lee, S., "Measurement of 3D Visual Fatigue using Event-Related Potential(ERP): 3D Oddball Paradigm", 3DTV CONFERENCE, Istanbul, Turkey. 2008.
  25. Miyao, M., Hacisalihzade, S. S. and Allen J. S., Effects of VDT resolution on eyestrain and readability: an eye movement approach, Ergonomics, 32(6), 603-614, 1989. https://doi.org/10.1080/00140138908966135
  26. Nakaishi, H. and Yamada, Y., Abnormal tear dynamics and symptoms of eyestrain in operators of visual display terminals, Occupational and Environmental Medicine, 56, 6-9, 1999. https://doi.org/10.1136/oem.56.1.6
  27. Nilsen, E., Salibello, C., Salvendy, G., Michael, J. S. and Richard, J. K., "Survey of U.S. optometrists regarding prevalence and treatment of visual stress symptoms", The Proceedings of the Seventh International Conference on Human-Computer Interaction, 1(pp. 663-666), 1997.
  28. Park, J.-S., Oh, Y.-H., Ahn, S.-C. and Lee, S.-W., Glasses Removal from Facial Image Using Recursive Error Compensation, IEEE Trans. on Pattern Analysis and Machine Intelligence, 27(5), 805-811, 2005. https://doi.org/10.1109/TPAMI.2005.103
  29. Sharbrough, F. and Chatrian, G. E., American electroencephalographic society guidelines for standard electrode position nomenclature, Journal of Clinical Neurophysiology, 8, 200-202, 1991. https://doi.org/10.1097/00004691-199104000-00007
  30. Shieh, K., Effects of reflection and polarity on LCD viewing distance, International Journal of Industrial Ergonomics, 25(3), 275-282, 2000. https://doi.org/10.1016/S0169-8141(99)00018-9
  31. Takahashi, M., "LCD vs PDP picture quality status and the task of FPD TVs", Korean Display Conference COEX, Seoul. South Korea. 2006.
  32. Trejo, L. J., Knuth, K., Prado, R., Rosipal, R., Kubitz, K., Kochavi, R., Mattews, B. and Zhang, Y., EEG-Based Estimation of Mental Fatigue: Convergent Evidence for a Three-State Model, Lecture Notes in Computer Science, 201-211, 2007.
  33. Trejo, L. J., Kochavi, R., Kubitz, K., Montgomery, L. D., Rosipal, R. and Mattews, B., "EEG-based Estimation of Cognitive Fatigue", ic. Arc.nasa.gov, 2006.
  34. Wang, H., Li, S. Z. and Wang, Y., "Face Recognition under Varying Lighting Conditions Using Self Quotient Image", Proceedings of the Sixth IEEE International Conference on Automatic Face and Gesture Recognition, (pp. 819-824), 2004.