• Title/Summary/Keyword: facial expression analysis

Search Result 164, Processing Time 0.023 seconds

Face Recognition using Modified Local Directional Pattern Image (Modified Local Directional Pattern 영상을 이용한 얼굴인식)

  • Kim, Dong-Ju;Lee, Sang-Heon;Sohn, Myoung-Kyu
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.2 no.3
    • /
    • pp.205-208
    • /
    • 2013
  • Generally, binary pattern transforms have been used in the field of the face recognition and facial expression, since they are robust to illumination. Thus, this paper proposes an illumination-robust face recognition system combining an MLDP, which improves the texture component of the LDP, and a 2D-PCA algorithm. Unlike that binary pattern transforms such as LBP and LDP were used to extract histogram features, the proposed method directly uses the MLDP image for feature extraction by 2D-PCA. The performance evaluation of proposed method was carried out using various algorithms such as PCA, 2D-PCA and Gabor wavelets-based LBP on Yale B and CMU-PIE databases which were constructed under varying lighting condition. From the experimental results, we confirmed that the proposed method showed the best recognition accuracy.

Effects of remifentanil preconditioning on factors related to uterine contraction in WISH cells

  • Kim, Cheul-Hong;Lee, Sang-Hoon;Kim, Eun-Jung;Ahn, Ji-Hye;Choi, Eun-Ji;Yoon, Ji-Uk;Choi, In-Seok
    • Journal of Dental Anesthesia and Pain Medicine
    • /
    • v.19 no.6
    • /
    • pp.343-351
    • /
    • 2019
  • Background: Preterm labor and miscarriage may occur in stressful situations, such as a surgical operation or infection during pregnancy. Pharyngeal and buccal abscess and facial bone fractures are inevitable dental surgeries in pregnant patients. Remifentanil is an opioid analgesic that is commonly used for general anesthesia and sedation. Nonetheless, no study has investigated the effects of remifentanil on amniotic epithelial cells. This study evaluated the effects of remifentanil on the factors related to uterine contraction and its mechanism of action on amniotic epithelial cells. Methods: Amniotic epithelial cells were preconditioned at various concentrations of remifentanil for 1 h, followed by 24-h lipopolysaccharide (LPS) exposure. MTT assays were performed to assess the cell viability in each group. The effects of remifentanil on factors related to uterine contractions in amniotic epithelial cells were assessed using a nitric oxide (NO) assay, western blot examinations of the expression of nuclear factor-kappa B (NF-κB), cyclooxygenase 2 (COX2), and prostaglandin E2 (PGE2), and RT-PCR examinations of the expression of the proinflammatory cytokines interleukin (IL)-1β and tumor necrosis factor-alpha (TNF-α). Results: Remifentanil did not affect viability and nitric oxide production of amniotic epithelial cells. Western blot analysis revealed that remifentanil preconditioning resulted in decreased expressions of NF-κB and PGE2 in the cells in LPS-induced inflammation, and a tendency of decreased COX2 expression. The results were statistically significant only at high concentration. RT-PCR revealed reduced expressions of IL-1β and TNF-α. Conclusions: Preconditioning with remifentanil does not affect the viability of amniotic epithelial cells but reduces the expression of factors related to uterine contractions in situations where cell inflammation is induced by LPS, which is an important inducer of preterm labor. These findings provide evidence that remifentanil may inhibit preterm labor in clinical settings.

Classification of Three Different Emotion by Physiological Parameters

  • Jang, Eun-Hye;Park, Byoung-Jun;Kim, Sang-Hyeob;Sohn, Jin-Hun
    • Journal of the Ergonomics Society of Korea
    • /
    • v.31 no.2
    • /
    • pp.271-279
    • /
    • 2012
  • Objective: This study classified three different emotional states(boredom, pain, and surprise) using physiological signals. Background: Emotion recognition studies have tried to recognize human emotion by using physiological signals. It is important for emotion recognition to apply on human-computer interaction system for emotion detection. Method: 122 college students participated in this experiment. Three different emotional stimuli were presented to participants and physiological signals, i.e., EDA(Electrodermal Activity), SKT(Skin Temperature), PPG(Photoplethysmogram), and ECG (Electrocardiogram) were measured for 1 minute as baseline and for 1~1.5 minutes during emotional state. The obtained signals were analyzed for 30 seconds from the baseline and the emotional state and 27 features were extracted from these signals. Statistical analysis for emotion classification were done by DFA(discriminant function analysis) (SPSS 15.0) by using the difference values subtracting baseline values from the emotional state. Results: The result showed that physiological responses during emotional states were significantly differed as compared to during baseline. Also, an accuracy rate of emotion classification was 84.7%. Conclusion: Our study have identified that emotions were classified by various physiological signals. However, future study is needed to obtain additional signals from other modalities such as facial expression, face temperature, or voice to improve classification rate and to examine the stability and reliability of this result compare with accuracy of emotion classification using other algorithms. Application: This could help emotion recognition studies lead to better chance to recognize various human emotions by using physiological signals as well as is able to be applied on human-computer interaction system for emotion recognition. Also, it can be useful in developing an emotion theory, or profiling emotion-specific physiological responses as well as establishing the basis for emotion recognition system in human-computer interaction.

Application of Support Vector Regression for Improving the Performance of the Emotion Prediction Model (감정예측모형의 성과개선을 위한 Support Vector Regression 응용)

  • Kim, Seongjin;Ryoo, Eunchung;Jung, Min Kyu;Kim, Jae Kyeong;Ahn, Hyunchul
    • Journal of Intelligence and Information Systems
    • /
    • v.18 no.3
    • /
    • pp.185-202
    • /
    • 2012
  • .Since the value of information has been realized in the information society, the usage and collection of information has become important. A facial expression that contains thousands of information as an artistic painting can be described in thousands of words. Followed by the idea, there has recently been a number of attempts to provide customers and companies with an intelligent service, which enables the perception of human emotions through one's facial expressions. For example, MIT Media Lab, the leading organization in this research area, has developed the human emotion prediction model, and has applied their studies to the commercial business. In the academic area, a number of the conventional methods such as Multiple Regression Analysis (MRA) or Artificial Neural Networks (ANN) have been applied to predict human emotion in prior studies. However, MRA is generally criticized because of its low prediction accuracy. This is inevitable since MRA can only explain the linear relationship between the dependent variables and the independent variable. To mitigate the limitations of MRA, some studies like Jung and Kim (2012) have used ANN as the alternative, and they reported that ANN generated more accurate prediction than the statistical methods like MRA. However, it has also been criticized due to over fitting and the difficulty of the network design (e.g. setting the number of the layers and the number of the nodes in the hidden layers). Under this background, we propose a novel model using Support Vector Regression (SVR) in order to increase the prediction accuracy. SVR is an extensive version of Support Vector Machine (SVM) designated to solve the regression problems. The model produced by SVR only depends on a subset of the training data, because the cost function for building the model ignores any training data that is close (within a threshold ${\varepsilon}$) to the model prediction. Using SVR, we tried to build a model that can measure the level of arousal and valence from the facial features. To validate the usefulness of the proposed model, we collected the data of facial reactions when providing appropriate visual stimulating contents, and extracted the features from the data. Next, the steps of the preprocessing were taken to choose statistically significant variables. In total, 297 cases were used for the experiment. As the comparative models, we also applied MRA and ANN to the same data set. For SVR, we adopted '${\varepsilon}$-insensitive loss function', and 'grid search' technique to find the optimal values of the parameters like C, d, ${\sigma}^2$, and ${\varepsilon}$. In the case of ANN, we adopted a standard three-layer backpropagation network, which has a single hidden layer. The learning rate and momentum rate of ANN were set to 10%, and we used sigmoid function as the transfer function of hidden and output nodes. We performed the experiments repeatedly by varying the number of nodes in the hidden layer to n/2, n, 3n/2, and 2n, where n is the number of the input variables. The stopping condition for ANN was set to 50,000 learning events. And, we used MAE (Mean Absolute Error) as the measure for performance comparison. From the experiment, we found that SVR achieved the highest prediction accuracy for the hold-out data set compared to MRA and ANN. Regardless of the target variables (the level of arousal, or the level of positive / negative valence), SVR showed the best performance for the hold-out data set. ANN also outperformed MRA, however, it showed the considerably lower prediction accuracy than SVR for both target variables. The findings of our research are expected to be useful to the researchers or practitioners who are willing to build the models for recognizing human emotions.

Case study of Lighting method to improve TV news viewers' attention span -Based on KBS News 9 Lighting Method Analysis- (TV뉴스 시청자의 집중도 향상을 위한 조명 기법의 사례 연구 -KBS 9시 뉴스 조명 기법 분석을 중심으로-)

  • Han, Hak-Soo
    • Journal of the Korea Society of Computer and Information
    • /
    • v.14 no.12
    • /
    • pp.97-107
    • /
    • 2009
  • Television News has significant impact on the information analysis of viewers by delivering world news to anonymous individuals everyday. We need to pay more attention to resolution considering the fact that even slight facial expression and the dress of TV anchor can be noticed by viewers in the high definition age, called HD TV, by radical changes in broadcasting situation. As a result, the beauty of expression that lighting technology has is extremely important in the high definition age. In news broadcast, as a phenomenon according to this change in trend, people have been looking for change in order to break with traditional TV news production by adopting DLP(Digital Lighting Processing) or LED(Light Emitting Diode). This effort has contributed to creating proper picture quality appropriate for HD TV. Nowadays Digital imaging is creating new trend in TV news production method from traditional analog-based lighting environment thanks to the development of IT(Information Technology) and digitalized lighting equipment. This change has led to building of HD studio and appropriate sets and lighting system. There are film set and projector which projects image on the screen and PDP, LCD, and DLP which has been used widely in recent years and LED which is often used as background in news program as examples, which has appeared since 1990s with HD TV. In this article, I analyzed the KBS News 9 lnce 1990s with in order to research the influence of television image component on the alyzed the KBS of TV article, I. I wille uggest the category of TV anchor image formulation in delivering information by means of lnce 1990s with based on the analysis result.

Posture features and emotion predictive models for affective postures recognition (감정 자세 인식을 위한 자세특징과 감정예측 모델)

  • Kim, Jin-Ok
    • Journal of Internet Computing and Services
    • /
    • v.12 no.6
    • /
    • pp.83-94
    • /
    • 2011
  • Main researching issue in affective computing is to give a machine the ability to recognize the emotion of a person and to react it properly. Efforts in that direction have mainly focused on facial and oral cues to get emotions. Postures have been recently considered as well. This paper aims to discriminate emotions posture by identifying and measuring the saliency of posture features that play a role in affective expression. To do so, affective postures from human subjects are first collected using a motion capture system, then emotional features in posture are described with spatial ones. Through standard statistical techniques, we verified that there is a statistically significant correlation between the emotion intended by the acting subjects, and the emotion perceived by the observers. Discriminant Analysis are used to build affective posture predictive models and to measure the saliency of the proposed set of posture features in discriminating between 6 basic emotional states. The evaluation of proposed features and models are performed using a correlation between actor-observer's postures set. Quantitative experimental results show that proposed set of features discriminates well between emotions, and also that built predictive models perform well.

System Development for Measuring Group Engagement in the Art Center (공연장에서 다중 몰입도 측정을 위한 시스템 개발)

  • Ryu, Joon Mo;Choi, Il Young;Choi, Lee Kwon;Kim, Jae Kyeong
    • Journal of Intelligence and Information Systems
    • /
    • v.20 no.3
    • /
    • pp.45-58
    • /
    • 2014
  • The Korean Culture Contents spread out to Worldwide, because the Korean wave is sweeping in the world. The contents stand in the middle of the Korean wave that we are used it. Each country is ongoing to keep their Culture industry improve the national brand and High added value. Performing contents is important factor of arousal in the enterprise industry. To improve high arousal confidence of product and positive attitude by populace is one of important factor by advertiser. Culture contents is the same situation. If culture contents have trusted by everyone, they will give information their around to spread word-of-mouth. So, many researcher study to measure for person's arousal analysis by statistical survey, physiological response, body movement and facial expression. First, Statistical survey has a problem that it is not possible to measure each person's arousal real time and we cannot get good survey result after they watched contents. Second, physiological response should be checked with surround because experimenter sets sensors up their chair or space by each of them. Additionally it is difficult to handle provided amount of information with real time from their sensor. Third, body movement is easy to get their movement from camera but it difficult to set up experimental condition, to measure their body language and to get the meaning. Lastly, many researcher study facial expression. They measures facial expression, eye tracking and face posed. Most of previous studies about arousal and interest are mostly limited to reaction of just one person and they have problems with application multi audiences. They have a particular method, for example they need room light surround, but set limits only one person and special environment condition in the laboratory. Also, we need to measure arousal in the contents, but is difficult to define also it is not easy to collect reaction by audiences immediately. Many audience in the theater watch performance. We suggest the system to measure multi-audience's reaction with real-time during performance. We use difference image analysis method for multi-audience but it weaks a dark field. To overcome dark environment during recoding IR camera can get the photo from dark area. In addition we present Multi-Audience Engagement Index (MAEI) to calculate algorithm which sources from sound, audience' movement and eye tracking value. Algorithm calculates audience arousal from the mobile survey, sound value, audience' reaction and audience eye's tracking. It improves accuracy of Multi-Audience Engagement Index, we compare Multi-Audience Engagement Index with mobile survey. And then it send the result to reporting system and proposal an interested persons. Mobile surveys are easy, fast, and visitors' discomfort can be minimized. Also additional information can be provided mobile advantage. Mobile application to communicate with the database, real-time information on visitors' attitudes focused on the content stored. Database can provide different survey every time based on provided information. The example shown in the survey are as follows: Impressive scene, Satisfied, Touched, Interested, Didn't pay attention and so on. The suggested system is combine as 3 parts. The system consist of three parts, External Device, Server and Internal Device. External Device can record multi-Audience in the dark field with IR camera and sound signal. Also we use survey with mobile application and send the data to ERD Server DB. The Server part's contain contents' data, such as each scene's weights value, group audience weights index, camera control program, algorithm and calculate Multi-Audience Engagement Index. Internal Device presents Multi-Audience Engagement Index with Web UI, print and display field monitor. Our system is test-operated by the Mogencelab in the DMC display exhibition hall which is located in the Sangam Dong, Mapo Gu, Seoul. We have still gotten from visitor daily. If we find this system audience arousal factor with this will be very useful to create contents.

Erk AND RETINOIC ACID SIGNALING PARTICIPATE IN THE SEGREGATION AND PATTERNING OF FIRST ARCH DERIVED MAXILLA AND MANDIBLE (Erk와 retinoic acid의 제1인구둥 패터닝 조절)

  • Park, Eun-Ju;Tak, Hye-Jin;Park, Eun-Ha;Baik, Jeong-Mi;Zhengguo, Piao;Lee, Sang-Hwy
    • Maxillofacial Plastic and Reconstructive Surgery
    • /
    • v.31 no.2
    • /
    • pp.103-115
    • /
    • 2009
  • In vertebrates, the face is mainly formed with neural crest derived neural crest cells by the inherent programs and the interactive environmental factors. Extracellular signaling-regulated kinase (Erk) is one of such programs to regulate the various cellular functions. And retinoic acid (RA) also plays an important role as a regulator in differentiation process at various stages of vertebrate embryogenesis. We wanted to know that the segregation as well as the patterning of maxillary and mandibular structure is greatly influenced by the maxillomandibular cleft (MMC) and the failure of this development may result in the maxillomandibular fusion (syngnathia) or other patterning related disorder. It has been well documented that the epithelium at this cleft region has significant expression of Fibroblast growth factor (Fgf) 8, and it is essential for the patterning of the first arch derived structures. By the morphological, skeletal, cell proliferation and apoptotic, and hybridization analysis, we checked the effects of Erk inhibition and/or RA activation onto MMC and could observe that Erk and RA signaling is individually and synergically involved in the facial patterning in terms of FGF signaling pathway via Barx-l. So RA and Erk signaling work together for the MMC patterning and the segregation of maxilla-mandible by controlling the Fgf-related signaling pathways. And the abnormality in MMC brought by aberrant Fgf signaling may result in the disturbances of maxillary-mandibular segregation.

Local Prominent Directional Pattern for Gender Recognition of Facial Photographs and Sketches (Local Prominent Directional Pattern을 이용한 얼굴 사진과 스케치 영상 성별인식 방법)

  • Makhmudkhujaev, Farkhod;Chae, Oksam
    • Convergence Security Journal
    • /
    • v.19 no.2
    • /
    • pp.91-104
    • /
    • 2019
  • In this paper, we present a novel local descriptor, Local Prominent Directional Pattern (LPDP), to represent the description of facial images for gender recognition purpose. To achieve a clearly discriminative representation of local shape, presented method encodes a target pixel with the prominent directional variations in local structure from an analysis of statistics encompassed in the histogram of such directional variations. Use of the statistical information comes from the observation that a local neighboring region, having an edge going through it, demonstrate similar gradient directions, and hence, the prominent accumulations, accumulated from such gradient directions provide a solid base to represent the shape of that local structure. Unlike the sole use of gradient direction of a target pixel in existing methods, our coding scheme selects prominent edge directions accumulated from more samples (e.g., surrounding neighboring pixels), which, in turn, minimizes the effect of noise by suppressing the noisy accumulations of single or fewer samples. In this way, the presented encoding strategy provides the more discriminative shape of local structures while ensuring robustness to subtle changes such as local noise. We conduct extensive experiments on gender recognition datasets containing a wide range of challenges such as illumination, expression, age, and pose variations as well as sketch images, and observe the better performance of LPDP descriptor against existing local descriptors.

The Study and Hypothesis of Realize AR Video Calling Method (효과적인 AR 영상통화 구현 방법을 위한 가설 방안과 연구)

  • Guo, Dawei;Chung, Jeanhun
    • Journal of Digital Convergence
    • /
    • v.16 no.9
    • /
    • pp.413-419
    • /
    • 2018
  • Nowadays, smart phone became an important part of communication media and integrated into people's life. If callers rely on helmet-mounted display(HMD) augmented reality technique to add two-way user's facial expression, appearance, actions during the calling process, it will let callers have a visualized fantastic sensual experience. And through that method can break the limitations of vision, so research that technical problem can promote the development of visual arts, that is meaningful. This paper will choose and composite several existed technologies to set up two hypothesis, try to realize AR video calling. Through comparison and analysis to find those two hypothesis' problem, and create design solutions to solve problems. And use case study method to present two cases for prove my paper's result that is those two hypothesis can be realize in future. Use those technologies can bring more convenience and enjoyment to people's life. It can be predicted that AR video calling process can be successfully realized and will have unlimited development in future.