• Journal of Information Processing Systems
• /
• v.19 no.3
• /
• pp.323-333
• /
• 2023

Facial expression recognition can aid in the development of fatigue driving detection, teaching quality evaluation, and other fields. In this study, a facial expression recognition method was proposed with a residual masking reconstruction network as its backbone to achieve more efficient expression recognition and classification. The residual layer was used to acquire and capture the information features of the input image, and the masking layer was used for the weight coefficients corresponding to different information features to achieve accurate and effective image analysis for images of different sizes. To further improve the performance of expression analysis, the loss function of the model is optimized from two aspects, feature dimension and data dimension, to enhance the accurate mapping relationship between facial features and emotional labels. The simulation results show that the ROC of the proposed method was maintained above 0.9995, which can accurately distinguish different expressions. The precision was 75.98%, indicating excellent performance of the facial expression recognition model.

• Journal of Institute of Control, Robotics and Systems
• /
• v.12 no.3
• /
• pp.255-263
• /
• 2006

In the last decade, face analysis, e.g. face detection, face recognition, facial expression recognition, is a very lively and expanding research field. As computer animated agents and robots bring a social dimension to human computer interaction, interest in this research field is increasing rapidly. In this paper, we introduce an artificial emotion mimic system which can recognize human facial expressions and also generate the recognized facial expression. In order to recognize human facial expression in real-time, we propose a facial expression classification method that is performed by weak classifiers obtained by using new rectangular feature types. In addition, we make the artificial facial expression using the developed robotic system based on biological observation. Finally, experimental results of facial expression recognition and generation are shown for the validity of our robotic system.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2019.01a
• /
• pp.243-246
• /
• 2019

본 논문에서는 감성과 힐링, 머신러닝이라는 주제를 바탕으로 딥러닝을 통한 사용자의 얼굴표정을 인식하고 그 얼굴표정을 기반으로 음악을 재생해주는 얼굴표정 기반의 음악재생 프로그램을 제안한다. 얼굴표정 기반 음악재생 프로그램은 딥러닝 기반의 음악 프로그램으로써, 이미지 인식 분야에서 뛰어난 성능을 보여주고 있는 CNN 모델을 기반으로 얼굴의 표정을 인식할 수 있도록 데이터 학습을 진행하였고, 학습된 모델을 이용하여 웹캠으로부터 사용자의 얼굴표정을 인식하는 것을 통해 사용자의 감정을 추측해낸다. 그 후, 해당 감정에 맞게 감정을 더 증폭시켜줄 수 있도록, 감정과 매칭되는 노래를 재생해주고, 이를 통해, 사용자의 감정이 힐링 및 완화될 수 있도록 도움을 준다.

• Proceedings of the Korean Institute of Interior Design Conference
• /
• 2007.05a
• /
• pp.231-236
• /
• 2007

The aspects of contemporary society change have been changed rapidly running for function value on the part of part industrialization and information-oriented. The transfer to the society focused on a human being emphasis and symbol value is in progress rising with natural desire of recurrence of human nature accordingly and desires of a human being inborn of sensitivity-oriented and pluralism-oriented are being expressed. Answering these social and cultural demands, concerns about an arbitrary mind world of a human being and pursuit dispositions about impractical and transcendental world are coincided with to the purpose and so various kinds of expressions except for art sphere are being experimented and applied. Here upon also in the field of the contemporary interior design, answering sensual desire of users, various arts and cultural tendency, the concept of surrealism is being applied in design introducing the concept of surrealism positive. And fantastical and unreasonable expression features of surrealism are being used as subjective essential elements to make new spaces. Especially amoung various kinds of the interiors designs, the features like surrealistic expressions in Food & Beverage Space which proper identity and strong symbolism will be expressed can be recognized as appropriate expression patterns to give still more sensitivity stimuli to customers. Thus this research disclosed conceptual and ideological background of surrealism and also analyzed and studied surrealistic expression features applied to the interiors designs of Contemporary Food & Beverage Space through expression disposition, study and classification of techniques. And standing on the result of analyzing surrealistic expression features of Contemporary Food & Beverage Space with a key word of expression features derived we groped for estatescape trend demanded in Food & Beverage Space and direction coming.

• Journal of Korea Multimedia Society
• /
• v.23 no.12
• /
• pp.1464-1475
• /
• 2020

Due to the spread of COVID-19, the online lecture has become more prevalent. However, it was found that a lot of students and professors are experiencing lack of communication. This study is therefore designed to improve interactive communication between professors and students in real-time online lectures. To do so, we explore deep learning approaches for automatic recognition of students' facial expressions and classification of their understanding into 3 classes (Understand / Neutral / Not Understand). We use 'BlazeFace' model for face detection and 'ResNet-GRU' model for facial expression recognition (FER). We name this entire process 'Degree of Understanding (DoU)' algorithm. DoU algorithm can analyze a multitude of students collectively and present the result in visualized statistics. To our knowledge, this study has great significance in that this is the first study offers the statistics of understanding in lectures using FER. As a result, the algorithm achieved rapid speed of 0.098sec/frame with high accuracy of 94.3% in CPU environment, demonstrating the potential to be applied to real-time online lectures. DoU Algorithm can be extended to various fields where facial expressions play important roles in communications such as interactions with hearing impaired people.

• Journal of the Korea Fashion and Costume Design Association
• /
• v.20 no.3
• /
• pp.63-78
• /
• 2018

This study analyzed gender-fluid images as expressions of feminism and gender identity expressed in fashion collections. As for the research method, this study searched the fashion collections, with the theme of feminism, utilizing key words related to feminism on an online portal, and collected the photo materials of fashion collections provided by vogue.com. This study classified the photo materials of 31 fashion collections, with the theme of feminism, into femininity, masculinity, androgyny, and avant-garde, according to the fashion design elements that divide gender identity. As a result of the classification, 326 photos were collected, in which gender identity was expressed ambiguously. This study reclassified the collected photos according to their fashion items and styles. As a result of the study, it was noticed that the fashion collections with the theme of feminism expressed the messages, using lettering graphic images, and performance. In addition, they showed a form in which men's collections and women's collections were integrated according to the change of the perceptions of gender identity, of feminism, and delivered body positive expressions, respecting differences and diversity as individual subjects, by casting diverse models in terms of age, body size, race, and culture. As for the gender identity expressed in the fashion collections, the gender-fluid images were classified into empowerment images, that expresses social rights and dignity; agender images that expresses the possibility of a gender-flexible transition; rational images that expresses the rational and practical characteristics that removed the boundary of fashion; and images of pro-sexism that expresses a new gender identity.

• Journal of the Korea Institute of Information Security & Cryptology
• /
• v.23 no.3
• /
• pp.395-404
• /
• 2013

A pattern matching algorithm plays an important role in traffic identification and classification based on predefined patterns for intrusion detection and prevention. As attacks become prevalent and complex, current patterns are written using regular expressions, called regexes, which are expressed into the deterministic finite automata(DFA) due to the guaranteed worst-case performance in pattern matching process. Currently, because of the increased complexity of regex patterns and their large number, memory-efficient DFA from states reduction have become the mainstay of pattern matching process. However, most of the previous works have focused on reducing only the number of states on a single automaton, and thus there still exists a state blowup problem under the large number of patterns. To solve the above problem, we propose a new state compression algorithm that merges states on multiple automata. We show that by merging states with the same input character on multiple automata, the proposed algorithm can lead to a significant reduction of the number of states in the original DFA by as much as 40.0% on average.

• Journal of the Korea Society of Computer and Information
• /
• v.28 no.2
• /
• pp.89-97
• /
• 2023

In this paper, we propose factors that make log analysis difficult and design technique for detecting various objects embedded in the logs which helps in the subsequent analysis. In today's IT systems, logs have become a critical source data for many advanced AI analysis techniques. Although logs contain wealth of useful information, it is difficult to directly apply techniques since logs are semi-structured by nature. The factors that interfere with log analysis are various objects such as file path, identifiers, JSON documents, etc. We have designed a BERT-based object pattern recognition algorithm for these objects and performed object identification. Object pattern recognition algorithms are based on object definition, GROK pattern, and regular expression. We find that simple pattern matchings based on known patterns and regular expressions are ineffective. The results show significantly better accuracy than using only the patterns and regular expressions. In addition, in the case of the BERT model, the accuracy of classifying objects reached as high as 99%.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.14 no.3
• /
• pp.139-146
• /
• 2014

This paper proposes an efficient method for automatically distinguishing various facial expressions. To recognize the emotions from facial expressions, the facial images are obtained by digital cameras, and a number of feature points were extracted. The extracted feature points are then transformed to 49-dimensional feature vectors which are robust to scale and translational variations, and the facial emotions are recognized by statistical pattern classifiers such Naive Bayes, MLP (multi-layer perceptron), and SVM (support vector machine). Based on the experimental results with 5-fold cross validation, SVM was the best among the classifiers, whose performance was obtained by 50.8% for 6 emotion classification, and 78.0% for 3 emotions.

• Korean Journal of Cognitive Science
• /
• v.21 no.1
• /
• pp.157-175
• /
• 2010

Understanding dialogue participant's emotion is important as well as decoding the explicit message in human communication. It is well known that non-verbal elements are more suitable for conveying speaker's emotions than verbal elements. Written texts, however, contain a variety of linguistic units that express emotions. This study aims at analyzing components for constructing an emotion ontology, that provides us with numerous applications in Human Language Technology. A majority of the previous work in text-based emotion processing focused on the classification of emotions, the construction of a dictionary describing emotion, and the retrieval of those lexica in texts through keyword spotting and/or syntactic parsing techniques. The retrieved or computed emotions based on that process did not show good results in terms of accuracy. Thus, more sophisticate components analysis is proposed and the linguistic factors are introduced in this study. (1) 5 linguistic types of emotion expressions are differentiated in terms of target (verbal/non-verbal) and the method (expressive/descriptive/iconic). The correlations among them as well as their correlation with the non-verbal expressive type are also determined. This characteristic is expected to guarantees more adaptability to our ontology in multi-modal environments. (2) As emotion-related components, this study proposes 24 emotion types, the 5-scale intensity (-2~+2), and the 3-scale polarity (positive/negative/neutral) which can describe a variety of emotions in more detail and in standardized way. (3) We introduce verbal expression-related components, such as 'experiencer', 'description target', 'description method' and 'linguistic features', which can classify and tag appropriately verbal expressions of emotions. (4) Adopting the linguistic tag sets proposed by ISO and TEI and providing the mapping table between our classification of emotions and Plutchik's, our ontology can be easily employed for multilingual processing.