Browse > Article
http://dx.doi.org/10.5573/ieek.2013.50.6.212

Discriminant Analysis of Human's Implicit Intent based on Eyeball Movement  

Jang, Young-Min (School of Electronics Engineering, Kyungpook National University)
Mallipeddi, Rammohan (School of Electronics Engineering, Kyungpook National University)
Kim, Cheol-Su (School of Electronics Engineering, Kyungpook National University)
Lee, Minho (School of Electronics Engineering, Kyungpook National University)
Publication Information
Journal of the Institute of Electronics and Information Engineers / v.50, no.6, 2013 , pp. 212-220 More about this Journal
Abstract
Recently, there has been tremendous increase in human-computer/machine interaction system, where the goal is to provide with an appropriate service to the user at the right time with minimal human inputs for human augmented cognition system. To develop an efficient human augmented cognition system based on human computer/machine interaction, it is important to interpret the user's implicit intention, which is vague, in addition to the explicit intention. According to cognitive visual-motor theory, human eye movements and pupillary responses are rich sources of information about human intention and behavior. In this paper, we propose a novel approach for the identification of human implicit visual search intention based on eye movement pattern and pupillary analysis such as pupil size, gradient of pupil size variation, fixation length/count for the area of interest. The proposed model identifies the human's implicit intention into three types such as navigational intent generation, informational intent generation, and informational intent disappearance. Navigational intent refers to the search to find something interesting in an input scene with no specific instructions, while informational intent refers to the search to find a particular target object at a specific location in the input scene. In the present study, based on the human eye movement pattern and pupillary analysis, we used a hierarchical support vector machine which can detect the transitions between the different implicit intents - navigational intent generation to informational intent generation and informational intent disappearance.
Keywords
human computer interface & interaction; eyeball movement & pupil analysis; implicit intent recognition; navigational intent generation; informational intent generation or disappearance;
Citations & Related Records
Times Cited By KSCI : 4  (Citation Analysis)
연도 인용수 순위
1 Majaranta, P., and K.-J. Raiha. "Twenty years of eye typing: systems and design issues," Proceedings of the symposium on Eye tracking research & applications. New Orleans, Louisiana, ACM, pp. 15-22, 2002
2 Breazeal, C., "Social Interactions in HRI: The Robot View," IEEE Transactions on Systems, Man, and Cybernetics-Part C: Applications and Reviews, 34(2): pp. 181-186, 2004.   DOI   ScienceOn
3 변증남, 한정수, "바이오사인에 기반한 HCI 및 서비스 로봇에의 응용," 대한전자공학회, 전자공학회지 제 28권 제 12호, pp. 37-42, 2001.   과학기술학회마을
4 http://www.gartner.com/it/page.jsp?id=1124212
5 심정연, "개인성을 고려한 지식-감정 반응 모델의 설계," 대한전자공학회, 전자공학회논문지-CI, 제 47권, 제 1호, pp. 116-122, 2010.   과학기술학회마을
6 권순진, 홍철의, 김원일, "효율적 검색의도 파악을 위한 쿼리 단어 가시화에 관한 연구," 대한전자공학회, 전자공학회논문지-CI, 제 49권, 제 2호, pp. 44-52, 2012.   과학기술학회마을
7 Bernard, J. J., Danielle, L.B., and Amanda, S.: "Determining the informational, navigational, and transactional intent of Web queries," Information Processing and Management 44, pp 1251-1266, 2008.   DOI   ScienceOn
8 Chen, Z., Lin, F., Liu, H., Ma, W. Y., and Wenyin, L., "User Intention Modelling in Web Applications Using Data Mining," Internet and Web Information Systems Journal, Kluwer Academic Publishers, vol. 5, pp. 181-192, 2002.
9 이인혜, 정신생리학, 학지사, 1997, ISBN-8975481654
10 Schwarz, U., and Schmuckle, T., "Cognitive Eyes, Schweiz Arch Neurol Psychiatr," vol. 153, pp. 175-179, 2002.   DOI
11 Schutz, A. C., Braun, D. I., and Gegenfurtner, K. R., "Eye movements and perception: A selective review," Journal of Vision, vol. 11, pp. 1-30, 2011.
12 Just, M. A., and Carpenter, P. A., "Eye fixations and cognitive processes," Cognitive Psychology, vol. 8, pp. 441-480, 1976.   DOI
13 Gareze, L., Harris, J. M., Barenghi, C. F., and Tadmor, Y., "Characterising patterns of eye movements in natural images and visual scanning," Journal of Modern Optics, vol. 55, pp. 533-555, 2008.   DOI   ScienceOn
14 Claudio, M. P., Laura, W. R., Thom, C., Stanley, K., and Mario, A., "The pupil dilation response to visual detection," Human Vision and Electronic Imaging XIII / SPIE-IS&T, vol. 6806, 2008.
15 Hess, E. H., and Polt, J. M., "Pupil size in relation to mental activity during problem-solving," Science, vol. 143, pp. 1190-1192, 1964.   DOI   ScienceOn
16 Kahneman, D., and Peavler, W. S., "Incentive effects and pupillary changes in association learning," Journal of Experimental Psychology, vol. 79, pp. 312-318, 1969.   DOI
17 Kahneman, D., and Beatty, J., "Pupil diameter and load on memory," Science, vol. 154, pp. 1583-1585, 1966.   DOI   ScienceOn
18 Rose, D. E., and Levinson, D., "Understanding User Goals in Web Search," in Proceedings of the 13th International Conference on World Wide Web, pp. 13-19, 2004.
19 Libby, W. L., Lacey, B. C., and Lacey, J. I., "Pupillary and cardiac activity during visual attention," Psychophysiology, vol. 10, pp. 270-294, 1973.   DOI   ScienceOn
20 Iqbal, S. T., Zheng, X. S., and Bailey, B. P., "Task-evoked pupillary response to mental workload in human-computer interaction," Human Factors in Computing Systems, pp. 1477-1480, 2004.
21 Young-Min Jang, Sangil Lee, Rammohan Mallipeddi, Ho-Wan Kwak, and Minho Lee, "Recognition of Human's Implicit Intention Based on an Eyeball Movement Pattern Analysis," LNCS 7062, pp. 138-145, 2011.
22 Eye tracking system of Tobii Technology, http://www.tobii.com/
23 임정수, 송지현, 장준혁, "SVM의 미세조정을 통한 음성/음악 분류 성능향상," 대한전자공학회, 전자공학회논문지-SP, pp. 141-148, 2011.   과학기술학회마을
24 Kecman, V., Learning and Soft Computing Cambridge, MA, MIT Press, 2001.
25 Young-Min Jang, Sangil Lee, Rammohan Mallipeddi, Ho-Wan Kwak, and Minho Lee, "Human implicit intent transition detection based on pupillary analysis," IEEE International Conference on World Congress on Computational Intelligence 2012.