Browse > Article
http://dx.doi.org/10.5909/JBE.2020.25.6.973

Pupil Data Measurement and Social Emotion Inference Technology by using Smart Glasses  

Lee, Dong Won (SmartDiagnosis, Inc.)
Mun, Sungchul (Department of Industrial Engineering, Jeonju University)
Park, Sangin (Center for Bionics, Korea Institute of Science and Technology)
Kim, Hwan-jin (SmartDiagnosis, Inc.)
Whang, Mincheol (Department of Intelligent Engineering Information for Human, Sangmyung University)
Publication Information
Journal of Broadcast Engineering / v.25, no.6, 2020 , pp. 973-979 More about this Journal
Abstract
This study aims to objectively and quantitatively determine the social emotion of empathy by collecting pupillary response. 52 subjects (26 men and 26 women) voluntarily participated in the experiment. After the measurement of the reference of 30 seconds, the experiment was divided into the task of imitation and spontaneously self-expression. The two subjects were interacted through facial expressions, and the pupil images were recorded. The pupil data was processed through binarization and circular edge detection algorithm, and outlier detection and removal technique was used to reject eye-blinking. The pupil size according to the empathy was confirmed for statistical significance with test of normality and independent sample t-test. Statistical analysis results, the pupil size was significantly different between empathy (M ± SD = 0.050 ± 1.817)) and non-empathy (M ± SD = 1.659 ± 1.514) condition (t(92) = -4.629, p = 0.000). The rule of empathy according to the pupil size was defined through discriminant analysis, and the rule was verified (Estimation accuracy: 75%) new 12 subjects (6 men and 6 women, mean age ± SD = 22.84 ± 1.57 years). The method proposed in this study is non-contact camera technology and is expected to be utilized in various virtual reality with smart glasses.
Keywords
Social Emotion; Empathy; Non-contact camera; Smart glasses; Pupillary response;
Citations & Related Records
Times Cited By KSCI : 4  (Citation Analysis)
연도 인용수 순위
1 J. Gratch, W. Mao, and S. Marsella, "Modeling social emotions and social attributions", Cambridge University Press, pp.219-251, 2006.
2 P. Salovey, and J. D. Mayer, "Emotional intelligence. Imagination", cognition and personality, Vol.9, No.3, pp. 185-211, 1990, https://doi.org/10.2190/DUGG-P24E-52WK-6CDG (accessed Mar. 1, 1990).   DOI
3 S. G. Barsade, "The ripple effect: Emotional contagion in groups", Yale SOM Working Paper, No.OB-01, 2000, http://dx.doi.org/10.2139/ssrn.250894 (accessed Jul. 30, 2001).   DOI
4 R. A. Baron, "The sweet smell of... helping: Effects of pleasant ambient fragrance on prosocial behavior in shopping malls", Personality and Social Psychology Bulletin, Vol.23, No.5, pp. 498-503, 1997, https://doi.org/10.1177/0146167297235005 (accessed May. 1, 1997).   DOI
5 L. Steinberg, S. D. Lamborn, N. Darling, N. S. Mounts, and S. M. Dornbusch, "Over‐time changes in adjustment and competence among adolescents from authoritative, authoritarian, indulgent, and neglectful families", Child development, Vol.65, No.3, pp. 754-770, 1994, https://doi.org/10.1111/j.1467-8624.1994.tb00781.x (accessed Jun. 1994).   DOI
6 L. Tarassenko, M. Villarroel, A. Guazzi, J. Jorge, D. A. Clifton, and C. Pugh, "Non-contact video-based vital sign monitoring using ambient light and auto-regressive models", Physiological measurement, Vol.35, No.5, 807, 2014, https://doi.org/10.1088/0967-3334/35/5/807 (accessed Mar. 28, 2014).   DOI
7 W. Boucsein, and R. W. Backs, "The psychophysiology of emotion, arousal, and personality: Methods and models", Handbook of digital human modeling: Research for applied ergonomics and human factors engineering, 35, 2009.
8 G. Rizzolatti, and L. Craighero, "The mirror-neuron system", Annual Review of Neuroscience, Vol.27, pp. 169-192, 2004, https://doi.org/10.1146/annurev.neuro.27.070203.144230 (accessed Jul. 21, 2004).   DOI
9 P. Ekman, "An argument for basic emotions", Cognition & emotion, Vol.6, No.3-4, pp. 169-200, 1992, https://doi.org/10.1080/02699939208411068 (accessed Jan. 7, 2008).   DOI
10 E. Hatfield, J. T. Cacioppo, and R. L. Rapson, "Emotional contagion", Current directions in psychological science, Vol.2, No.3, pp. 96-100, 1993, https://doi.org/10.1111/1467-8721.ep10770953 (accessed Jun. 1, 1993).   DOI
11 E. C. Lee, K. R. Park, M. Whang, and K. Min, "Measuring the degree of eyestrain caused by watching LCD and PDP devices", International Journal of Industrial Ergonomics, Vol.39, No.5, pp. 798-806, 2009, https://doi.org/10.1016/j.ergon.2009.02.008 (accessed Mar. 18, 2009)   DOI
12 S. W. Huck, W. H. Cormier, and W. G. Bounds, "Reading statistics and research", New York: Harper & Row, pp. 74-102, 1974.
13 S. D. Preston, and F. B. De Waal, "Empathy: Its ultimate and proximate bases", Behavioral and brain sciences, Vol.25, No.1, pp. 1-20, 2002, https://doi.org/10.1017/S0140525X02000018 (accessed Jan. 23, 2003).   DOI
14 G. Bohner, and T. Weinerth, "Negative affect can increase or decrease message scrutiny: The affect interpretation hypothesis", Personality and Social Psychology Bulletin, Vol.27, No.11, pp. 1417-1428, 2001, https://doi.org/10.1177/01461672012711003 (accessed Nov. 1, 2001).   DOI
15 J. Lee, K. Suh, and S. Nam, "C-P-N-D Ecosystem-based Broadcasting/Media Virtual Reality (VR) Prospects", Journal of Broadcast Engineering, Vol.23, No.1, pp. 19-25, 2018, https://doi.org/10.5909/JBE.2018.23.1.19 (accessed Oct. 11, 2018).   DOI
16 S. W. Porges, "Orienting in a defensive world: Mammalian modifications of our evolutionary heritage. A polyvagal theory", Psychophysiology, Vol.32, No.4, pp. 301-318, 1995, https://doi.org/10.1111/j.1469-8986.1995.tb01213.x (accessed Mar. 23, 1995).   DOI
17 R. McCraty, M. Atkinson, D. Tomasino, and R. T. Bradley, "The Coherent Heart Heart-Brain Interactions, Psychophysiological Coherence, and the Emergence of System-Wide Order", Integral Review: A Transdisciplinary & Transcultural Journal for New Thought, Research, & Praxis, Vol. 5, No.2, 2009.
18 E. H. Hess, and J. M. Polt, "Pupil size in relation to mental activity during simple problem-solving", Science, Vol.143, No.3611, pp. 1190-1192, 1964, https://doi.org/10.1126/science.143.3611.1190 (accessed Mar. 13, 1964).   DOI
19 D. Kahneman, and J. Beatty, "Pupil diameter and load on memory", Science, Vol.154 No.3756, pp. 1583-1585, 1966, https://doi.org/10.1126/science.154.3756.1583 (accessed Dec. 23, 1966).   DOI
20 M. M. Bradley, L. Miccoli, M. A. Escrig, and P. J. Lang, "The pupil as a measure of emotional arousal and autonomic activation", Psychophysiology, Vol.45, No.4, pp. 602-607, 2008, https://doi.org/10.1111/j.1469-8986.2008.00654.x (accessed May. 22, 2008).   DOI
21 S. Mun, M. Whang, S. Park, D. W. Lee, and H. I. Kim, "Overview of VR Media Technology and Methods to Reduce Cybersickness" Journal of Broadcast Engineering, Vol.23, No.6, pp. 800-812, 2018, https://doi.org/10.5909/JBE.2018.23.6.800 (accessed Oct. 16, 2018).   DOI
22 M. M. Bradley, L. Miccoli, M. A. Escrig, and P. J. Lang, "The pupil as a measure of emotional arousal and autonomic activation", Psychophysiology, Vol.45, No.4, pp. 602-607, 2008, https://doi.org/10.1111/j.1469-8986.2008.00654.x (accessed May. 22, 2008).   DOI