Browse > Article
http://dx.doi.org/10.6109/jkiice.2022.26.9.1279

Non-contact Input Method based on Face Recognition and Pyautogui Mouse Control  

Park, Sung-jin (Applied Artificial Intelligence, Sungkyunkwan University)
Shin, Ye-eun (Applied Artificial Intelligence, Sungkyunkwan University)
Lee, Byung-joon (Department of Mathematics, Sungkyunkwan University)
Oh, Ha-young (College of Computing and Informatics, Sungkyunkwan University)
Publication Information
Journal of the Korea Institute of Information and Communication Engineering / v.26, no.9, 2022 , pp. 1279-1292 More about this Journal
Abstract
This study proposes a non-contact input method based on face recognition and Pyautogui mouse control as a system that can help users who have difficulty using input devices such as conventional mouse due to physical discomfort. This study includes features that help web surfing more conveniently, especially screen zoom, scroll function, and also solves the problem of eye fatigue, which has been suggested as a limitation in existing non-contact input systems. In addition, various set values can be adjusted in consideration of individual physical differences and Internet usage habits. Furthermore, no high-performance CPU or GPU environment is required, and no separate tracker devices or high-performance cameras are required. Through these studies, we intended to contribute to the realization of barrier-free access by increasing the web accessibility of the disabled and the elderly who find it difficult to use web content.
Keywords
Face recognition; Upper limb disorders; Web Accessibility; Landmark detection;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 H. Hayashi, R. Inomata, R. Fujishiro, Y. Ouchi, K. Suzuki, and T. Nanami, "Development of Pre-Crash Safety System with Pedestrian Collision Avoidance Assist," in Proceedings of the 23rd International Conference on the Enhanced Safety of Vehicles, Seoul, Republic of Korea, pp. 13-0271. 2013.
2 KOSIS. Informatization statistical survey [Internet]. Available:https://kosis.kr/statHtml/statHtml.do?orgId=127&tblId=DT_120008_2019B001&conn_path=I2.
3 KOSIS. Informatization statistical survey [Internet]. Available:https://kosis.kr/statHtml/statHtml.do?orgId=127&tblId=DT_120008_2019B005&conn_path=I2.
4 J. E. Seo, "An Empirical Study of the Quality of Assistive Technology for Improving Web Accessibility," M. S. thesis, Soongsil University, Seoul, 2012.
5 Y. Kartynnik, A. Ablavatski, I. Grishchenko, and M. Grundmann. "Real-time Facial Surface Geometry from Monocular Video on Mobile GPUs," arXiv preprint arXiv:1907.06724, 2019.
6 Y. W. Suh, K. H. Kim, S. Y. Kang, S. W. Kim, J. R. Oh, H. M. Kim, and J. S. Song, "The Objective Methods to Evaluate Ocular Fatigue Associated With Computer Work," Journal of The Korean Ophthalmological Society, vol. 51, no. 10, pp. 1327-1332, Oct. 2010.   DOI
7 J. H. Park, S. R. Jo, and S. B. Lim. "Object Magnification and Voice Command in Gaze Interface for the Upper Limb Disabled," Journal of Korea Multimedia Society, vol. 24, no. 7, pp. 903-912, Jul. 2021.   DOI
8 T. Soukupova and J. Cech, "Eye-Blink Detection Using Facial Landmarks," in Proceedings of 21st computer vision winter workshop, Rimske Toplice, Slovenia, 2016.
9 H. Y. Kim, "Improvement of Web Accessibility through Auto-generated OCR Based Alternative Text," M. S. thesis, Hanbat University, Daejeon, 2022.