• Design Convergence Study
• /
• v.16 no.6
• /
• pp.137-152
• /
• 2017

This research aims to develop the companion robot experience design for elderly in korea based on needs-function deploy matrix of robot and emotion expression research of robot in multimodal interaction. First, Elder users' main needs were categorized into 4 groups based on ethnographic research. Second, the functional elements and physical actuators of robot were mapped to user needs in function- needs deploy matrix. The final UX design prototype was implemented with a robot type that has a verbal non-touch multi modal interface with emotional facial expression based on Ekman's Facial Action Coding System (FACS). The proposed robot prototype was validated through a user test session to analyze the influence of the robot interaction on the cognition and emotion of users by Story Recall Test and face emotion analysis software; Emotion API when the robot changes facial expression corresponds to the emotion of the delivered information by the robot and when the robot initiated interaction cycle voluntarily. The group with emotional robot showed a relatively high recall rate in the delayed recall test and In the facial expression analysis, the facial expression and the interaction initiation of the robot affected on emotion and preference of the elderly participants.

• The Journal of Korean Medicine
• /
• v.42 no.4
• /
• pp.102-119
• /
• 2021

Objectives: Facial diagnosis is an important part of clinical diagnosis in traditional East Asian Medicine. In this paper, using a fully automated facial shape analysis system, we show that facial morphological features are associated with cold pattern. Methods: The facial morphological features calculated from 68 facial landmarks included the angles, areas, and distances between the landmark points of each part of the face. Cold pattern severity was determined using a questionnaire and the cold pattern scores (CPS) were used for analysis. The association between facial features and CPS was calculated using Pearson's correlation coefficient and partial correlation coefficients. Results: The upper chin width and the lower chin width were negatively associated with CPS. The distance from the center point to the middle jaw and the distance from the center point to the lower jaw were negatively associated with CPS. The angle of the face outline near the ear and the angle of the chin line were positively associated with CPS. The area of the upper part of the face and the area of the face except the sensory organs were negatively associated with CPS. The number of facial morphological features that exhibited a statistically significant correlation with CPS was 37 (unadjusted). Conclusions: In this study of a Korean population, subjects with a high CPS had a more pointed chin, longer face, more angular jaw, higher eyes, and more upward corners of the mouth, and their facial sensory organs were relatively widespread.

• Korean Journal of Cognitive Science
• /
• v.16 no.4
• /
• pp.323-331
• /
• 2005

This paper proposes an improved system for recognizing facial expressions in various internal states that is illumination-invariant and without detectable rue such as a neutral expression. As a preprocessing to extract the facial expression information, a whitening step was applied. The whitening step indicates that the mean of the images is set to zero and the variances are equalized as unit variances, which reduces murk of the variability due to lightening. After the whitening step, we used the facial expression information based on principal component analysis(PCA) representation excluded the first 1 principle component. Therefore, it is possible to extract the features in the lariat expression images without detectable cue of neutral expression from the experimental results, we ran also implement the various and natural facial expression recognition because we perform the facial expression recognition based on dimension model of internal states on the images selected randomly in the various facial expression images corresponding to 83 internal emotional states.

• Journal of Korea Multimedia Society
• /
• v.18 no.5
• /
• pp.610-619
• /
• 2015

*In this paper, we propose a real-time face tracking system using an adaptive face detector and a tracking algorithm. An image is divided into the regions of background and face candidate by a real-time updated skin color identifying system in order to accurately detect facial features. The facial characteristics are extracted using the five types of simple Haar-like features. The extracted features are reinterpreted by Principal Component Analysis (PCA), and the interpreted principal components are processed by Support Vector Machine (SVM) that classifies into facial and non-facial areas. The movement of the face is traced by Kalman filter and Mean shift, which use the static information of the detected faces and the differences between previous and current frames. The proposed system identifies the initial skin color and updates it through a real-time color detecting system. A similar background color can be removed by updating the skin color. Also, the performance increases up to 20% when the background color is reduced in comparison to extracting features from the entire region. The increased detection rate and speed are acquired by the usage of Kalman filter and Mean shift.

• Archives of Craniofacial Surgery
• /
• v.22 no.6
• /
• pp.303-309
• /
• 2021

Background: Transferring the hypoglossal nerve to the facial nerve using an end-to-end method is very effective for improving facial motor function. However, this technique may result in hemitongue atrophy. The ansa cervicalis, which arises from the cervical plexus, is also used for facial reanimation. We retrospectively reviewed cases where facial reanimation was performed using the ansa cervicalis to overcome the shortcomings of existing techniques of hypoglossal nerve transfer. Methods: The records of 15 patients who underwent hypoglossal nerve transfer were retrospectively reviewed. Three methods were used: facial reanimation with hypoglossal nerve transfer (group 1), facial nerve reanimation using the ansa cervicalis (group 2), and sural nerve interposition grafting between the hypoglossal nerve and facial nerve (group 3). In group 1, the ansa cervicalis was coapted to neurotize the distal stump of the hypoglossal nerve in a subset of patients. Clinical outcomes were evaluated using the House-Brackmann (H-B) grading system and Emotrics software. Results: All patients in group 1 (n= 4) achieved H-B grade IV facial function and showed improvements in the oral commissure angle at rest (preoperative vs. postoperative difference, 6.48° ± 0.77°) and while smiling (13.88° ± 2.00°). In groups 2 and 3, the oral commissure angle slightly improved at rest (group 2: 0.95° ± 0.53°, group 3: 1.35° ± 1.02°) and while smiling (group 2: 2.06° ± 0.67°, group 3: 1.23° ± 0.56°). In group 1, reduced tongue morbidity was found in patients who underwent ansa cervicalis transfer. Conclusion: Facial reanimation with hypoglossal nerve transfer, in combination with hypoglossal nerve neurotization using the ansa cervicalis for complete facial palsy patients, might enable favorable facial reanimation outcomes and reduce tongue morbidity. Facial reanimation using the ansa cervicalis or sural nerve for incomplete facial palsy patients did not lead to remarkable improvements, but it warrants further investigation.

• Journal of Yeungnam Medical Science
• /
• v.25 no.2
• /
• pp.108-116
• /
• 2008

Background : When surgeons plan mandible ortho surgery for patients with skeletal class III facial asymmetry, they must be consider the exact method of surgery for correction of the facial asymmetry. Three-dimensional (3D) CT imaging is efficient in depicting specific structures in the craniofacial area. It reproduces actual measurements by minimizing errors from patient movement and allows for image magnification. Due to the rapid development of digital image technology and the expansion of treatment range, rapid progress has been made in the study of three-dimensional facial skeleton analysis. The purpose of this study was to conduct 3D CT image comparisons of mandible changes after mandibular surgery in facial asymmetry patients. Materials & methods : This study included 7 patients who underwent 3D CT before and after correction of facial asymmetry in the oral and maxillofacial surgery department of Yeungnam University Hospital between August 2002 and November 2005. Patients included 2 males and 5 females, with ages ranging from 16 years to 30 years (average 21.4 years). Frontal CT images were obtained before and after surgery, and changes in mandible angle and length were measured. Results : When we compared the measurements obtained before and after mandibular surgery in facial asymmetry patients, correction of facial asymmetry was identified on the "after" images. The mean difference between the right and left mandibular angles before mandibular surgery was $7^{\circ}$, whereas after mandibular surgery it was $1.5^{\circ}$. The right and left mandibular length ratios subtracted from 1 was 0.114 before mandibular surgery, while it was 0.036 after mandibular surgery. The differences were analyzed using the nonparametric test and the Wilcoxon signed ranks test (p<0.05). Conclusion: The system that has been developed produces an accurate three-dimensional representation of the skull, upon which individualized surgery of the skull and jaws is easily performed. The system also permits accurate measurement and monitoring of postsurgical changes to the face and jaws through reproducible and noninvasive means.

• The Journal of Korean Medicine
• /
• v.44 no.4
• /
• pp.136-149
• /
• 2023

Objectives: Facial diagnosis is an important part of clinical diagnosis in traditional East Asian Medicine. In this paper, we proposed a model to quantitatively classify cold sensitivity using a fully automated facial image analysis system. Methods: We investigated cold sensitivity in 452 subjects. Cold sensitivity was determined using a questionnaire and the Cold Pattern Score (CPS) was used for analysis. Subjects with a CPS score below the first quartile (low CPS group) belonged to the cold non-sensitivity group, and subjects with a CPS score above the third quartile (high CPS group) belonged to the cold sensitivity group. After splitting the facial images into train/validation/test sets, the train and validation set were input into a convolutional neural network to learn the model, and then the classification accuracy was calculated for the test set. Results: The classification accuracy of the low CPS group and high CPS group using facial images in all subjects was 76.17%. The classification accuracy by sex was 69.91% for female and 62.86% for male. It is presumed that the deep learning model used facial color or facial shape to classify the low CPS group and the high CPS group, but it is difficult to specifically determine which feature was more important. Conclusions: The experimental results of this study showed that the low CPS group and the high CPS group can be classified with a modest level of accuracy using only facial images. There was a need to develop more advanced models to increase classification accuracy.

• Journal of Pharmacopuncture
• /
• v.20 no.2
• /
• pp.100-106
• /
• 2017

Objectives: This study aimed to assess a Qi Blood Yin Yang evaluation method systematically and objectively and to identify the correlation between the Qi Blood Yin Yang deficiency pattern (QBYYDP) and facial color. Methods: Thirty-seven participants (17 males, 20 females) were enrolled in this study. Twenty-four (10 males, 14 females) had ages from 40 to over 60, and 13 (7 males and 6 females) were in their twenties. After sufficient rest, facial images were taken with a camera. Based on the results from a questionnaire survey, we divided the participants into five groups: the normal and the Qi-, Blood-, Yin-, and Yang-deficient groups, after which the relationships between the L, 'a', and 'b' values in the Lab color system and the characteristics of the participants in each of the deficient groups were elucidated using a facial color analysis program. Results: The color analysis for Qi-deficient (QD) participants revealed that the L value was fairly decreased in comparison with the normal participants, but the 'a' and 'b' values were almost the same. A comparison between the normal and the Yang-deficient (YaD) groups revealed that the L values were somewhat lower compared to the normal group, but the 'a' and 'b' values were not statistically different. For the Yin-deficient (YiD) group, the L value was slightly lower compared to the normal group, but the 'a' and 'b' values were almost the same and the R values were slightly increased. For the Blood-deficient (BD) group, the L values were slightly increased compared to the normal group, but the 'a' and 'b' values were decreased slightly. Conclusion: This study obtained objective, reliable data for judging the QBYYDP by using facial images and a color analysis program. However, further study with at least 10 or more subjects in each of the deficient groups is necessary to confirm our findings.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.8 no.5
• /
• pp.1690-1710
• /
• 2014

In this paper, we propose the rapid implementation of a 3-dimensional (3D) facial reconstruction from a single frontal face image and introduce a design for its application on a mobile device. The proposed system can effectively reconstruct human faces in 3D using an approach robust to lighting conditions, and a fast method based on a Canonical Correlation Analysis (CCA) algorithm to estimate the depth. The reconstruction system is built by first creating 3D facial mapping from a personal identity vector of a face image. This mapping is then applied to real-world images captured with a built-in camera on a mobile device to form the corresponding 3D depth information. Finally, the facial texture from the face image is extracted and added to the reconstruction results. Experiments with an Android phone show that the implementation of this system as an Android application performs well. The advantage of the proposed method is an easy 3D reconstruction of almost all facial images captured in the real world with a fast computation. This has been clearly demonstrated in the Android application, which requires only a short time to reconstruct the 3D depth map.

• Journal of Acupuncture Research
• /
• v.25 no.6
• /
• pp.109-116
• /
• 2008

Objectives : This study investigated the effect of imbalance of autonomic nerve system on the idiopathic facial palsy by the comparison Heart Rate Variability results of Facial palsy group and healthy control group, and to clarify correlation between House-Brackmann Grade and Heart Rate Variability results. Methods : 119 idiopathic facial palsy patients and 88 health subjects who underwent HRV test were retrospectively reviewed based on medical records. We compared between the HRV results of facial palsy group and that of normal control group, and also compared the HRV results of facial palsy subgroup classified by House-Brackmann Grade. Results 1. All HRV results－Mean Heart Rat(MHRT), Standard Deviation of all the Normal RR intervals(SDNN), Total Power(TP), Very Low Frequency(VLF), Low Frequency(LF), High Frequency(HF), ratio betwween the Low Frequency and High Frequency power(LF/HF ratio) of facial palsy group are decreased compared to that of normal control group, especially SDNN, TP, VLF, LF, LF/HF ratio showed significant difference(p<0.05). 2. HRV results showed no significant correlation in House-Brackmann Grade. Conclusions : This study showed that lower HRV results of facial palsy group than normal control group and suggests that imbalance of autonomic nerve system related with facial palsy. HRV could be a objective tool to reflect condition of idiopathic facial palsy patients.