• Journal of Digital Contents Society
• /
• 제19권1호
• /
• pp.103-112
• /
• 2018

In this paper, we propose a method of recognizing emotions using PPG sensor which measures blood flow according to emotion. From the existing PPG signal, we use a method of determining positive emotions and negative emotions in the frequency domain through PSD (Power Spectrum Density). Based on James R. Russell's two-dimensional prototype model, we classify emotions as joy, sadness, irritability, and calmness and examine their association with the magnitude of energy in the frequency domain. It is significant that this study used the same PPG sensor used in wearable devices to measure the top four kinds of emotions in the frequency domain through image experiments. Through the questionnaire, the accuracy, the immersion level according to the individual, the emotional change, and the biofeedback for the image were collected. The proposed method is expected to be various development such as commercial application service using PPG and mobile application prediction service by merging with context information of existing smart phone.

• Journal of Software Assessment and Valuation
• /
• 제15권2호
• /
• pp.73-83
• /
• 2019

Voice Recognition has recently been improved with AI(Artificial Intelligence) and has greatly improved the false recognition rate and provides an effective and efficient Human Machine Interface (HMI). This trend has also been applied in the defense industry, particularly in the aviation, F-35. However, for the quality evaluation of Voice Recognition, the defense industry, especially the aircraft, requires measurable quantitative models. In this paper, the quantitative evaluation model is proposed for applying Voice Recognition to aircraft. For the proposal, the evaluation items are identified from the Voice Recognition technology and ISO/IEC 25000(SQuaRE) quality attributes. Using these two perspectives, the quantitative evaluation model is proposed under aircraft operation condition and confirms the evaluation results.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• 제21권4호
• /
• pp.737-743
• /
• 2017

The intelligent life-log system proposed in this paper is intended to identify and record a myriad of everyday life information as to the occurrence of various events based on when, where, with whom, what and how, that is, a wide variety of contextual information involving person, scene, ages, emotion, relation, state, location, moving route, etc. with a unique tag on each piece of such information and to allow users to get a quick and easy access to such information. Context awareness generates and classifies information on a tag unit basis using the auto-tagging technology and biometrics recognition technology and builds a situation information database. In this paper, we developed an active modeling method and an application that recognizes expressionless and smile expressions using lip lines to automatically record emotion information.

• Journal of the Korea Convergence Society
• /
• 제10권3호
• /
• pp.167-176
• /
• 2019

The conversational agent, which is at the forefront of the 4th industry, aims to personalize the user-centered focus in the future and holds an important position to have a hub that can be connected to various IoT devices. It is a challenge for interactive agents to recognize the user's emotions and provide the correct interaction to personalization. The study first I looked at emotional definitions and scientific and engineering approaches. Then I recognized through social perspectives what social function and what factors emotions have and how they can be used to understand emotions. Based on this, I explored how users can be discovered emotional social factors in communication. This research has shown that social factors can be found in the user's speech, which can be linked to the social meaning of emotions. Finally, I propose a model to discover social factors in user communication. I hope that this will help designer and researcher to study user-centered design and interaction in designing interactive agents.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 한국컴퓨터정보학회 2024년도 제69차 동계학술대회논문집 32권1호
• /
• pp.55-58
• /
• 2024

최근 각 기업의 AI 면접시스템 도입이 증가하고 있으며, AI 면접에 대한 실효성 논란 또한 많은 상황이다. 본 논문에서는 AI 면접 과정에서 지원자를 평가하는 방식을 시각, 음성, 자연어처리 3영역에서 구현함으로써, 면접 지원자를 다방면으로 분석 방법론의 적절성에 대해 평가하고자 한다. 첫째, 시각적 측면에서, 면접 지원자의 감정을 인식하기 위해, 합성곱 신경망(CNN) 기법을 활용해, 지원자 얼굴에서 6가지 감정을 인식했으며, 지원자가 카메라를 응시하고 있는지를 시계열로 도출하였다. 이를 통해 지원자가 면접에 임하는 태도와 특히 얼굴에서 드러나는 감정을 분석하는 데 주력했다. 둘째, 시각적 효과만으로 면접자의 태도를 파악하는 데 한계가 있기 때문에, 지원자 음성을 주파수로 환산해 특성을 추출하고, Bidirectional LSTM을 활용해 훈련해 지원자 음성에 따른 6가지 감정을 추출했다. 셋째, 지원자의 발언 내용과 관련해 맥락적 의미를 파악해 지원자의 상태를 파악하기 위해, 음성을 STT(Speech-to-Text) 기법을 이용하여 텍스트로 변환하고, 사용 단어의 빈도를 분석하여 지원자의 언어 습관을 파악했다. 이와 함께, 지원자의 발언 내용에 대한 감정 분석을 위해 KoBERT 모델을 적용했으며, 지원자의 성격, 태도, 직무에 대한 이해도를 파악하기 위해 객관적인 평가지표를 제작하여 적용했다. 논문의 분석 결과 AI 면접의 다면적 평가시스템의 적절성과 관련해, 시각화 부분에서는 상당 부분 정확도가 객관적으로 입증되었다고 판단된다. 음성에서 감정분석 분야는 면접자가 제한된 시간에 모든 유형의 감정을 드러내지 않고, 또 유사한 톤의 말이 진행되다 보니 특정 감정을 나타내는 주파수가 다소 집중되는 현상이 나타났다. 마지막으로 자연어처리 영역은 면접자의 발언에서 나오는 말투, 특정 단어의 빈도수를 넘어, 전체적인 맥락과 느낌을 이해할 수 있는 자연어처리 분석모델의 필요성이 더욱 커졌음을 판단했다.

• The Journal of the Korea institute of electronic communication sciences
• /
• 제19권1호
• /
• pp.105-112
• /
• 2024

In contemporary society, the expression of emotions and self-reflection are considered pivotal factors with a positive impact on stress management and mental well-being, thereby highlighting the significance of journaling. However, traditional journaling methods have posed challenges for many individuals due to constraints in terms of time and space. Recent rapid advancements in chatbot and emotion analysis technologies have garnered significant attention as essential tools to address these issues. This paper introduces an artificial intelligence chatbot that integrates the GPT-3 model and emotion analysis technology, detailing the development process of a system that automatically generates journals based on users' chat data. Through this system, users can engage in journaling more conveniently and efficiently, fostering a deeper understanding of their emotions and promoting positive emotional experiences.

• Proceedings of the KAIS Fall Conference
• /
• 한국산학기술학회 2009년도 추계학술발표논문집
• /
• pp.245-248
• /
• 2009

The aim of the study is to look at the relationships among emotional dimensions, commitment to environment, consumer typology, and quality of life. For this study, 303 students completed the questionnaires and SPSS and Amos 4 were employed. The findings are: First, positive emotion increases commitment to environment. Second, commitment to environment encourages green consumer behaviors and quasi-green consumer behaviors while it reduces non-green consumer behaviors. Third, green consumer behaviors increase quality of life while quasi-green consumer behaviors and non-green consumer behaviors do not have any influence on quality of life. Some practical implications are included.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• 제10권12호
• /
• pp.3788-3796
• /
• 2009

The aim of the study is to look at the relationships among emotional dimensions, commitment to environment, consumer typology, and quality of life. For this study, 303 students completed the questionnaires and SPSS and Amos 4 were employed. The findings are: First, positive emotion increases commitment to environment. Second, commitment to environment encourages green consumer behaviors and quasi-green consumer behaviors while it reduces non-green consumer behaviors. Third, green consumer behaviors increase quality of life while quasi-green consumer behaviors and non-green consumer behaviors do not have any influence on quality of life. Some practical implications are included.

• Journal of the Institute of Electronics Engineers of Korea CI
• /
• 제45권5호
• /
• pp.134-139
• /
• 2008

In this paper, we propose a story generation system using multi emotional agents. The proposed multi emotional agents are equipped with multiple emotional model so that it can be used as individually personalized agents that can generates unique storylines. Basically these kinds of multi emotional agents are easily employed as Avatar or NPC in computer games. In the proposed system, emotional agents are used as actor or actress whose characters and preferences are different each other. The storylines generated using the proposed system are realistic since the characters are emotional as humans.

• Proceedings of the Korea Information Processing Society Conference
• /
• 한국정보처리학회 2022년도 추계학술발표대회
• /
• pp.559-561
• /
• 2022

인공지능 시대에 들어서면서 개인 맞춤형 환경을 제공하기 위하여 사람의 감정을 인식하고 교감하는 기술이 많이 발전되고 있다. 사람의 감정을 인식하는 방법으로는 얼굴, 음성, 신체 동작, 생체 신호 등이 있지만 이 중 가장 직관적이면서도 쉽게 접할 수 있는 것은 표정이다. 따라서, 본 논문에서는 정확도 높은 얼굴 감정 식별을 위해서 Convolution Block Attention Module(CBAM)의 각 Gate와 Residual Block, Skip Connection을 이용한 Identity- CBAM Module을 제안한다. CBAM의 각 Gate와 Residual Block을 이용하여 각각의 표정에 대한 핵심 특징 정보들을 강조하여 Context 한 모델로 변화시켜주는 효과를 가지게 하였으며 Skip-Connection을 이용하여 기울기 소실 및 폭발에 강인하게 해주는 모듈을 제안한다. AI-HUB의 한국인 감정 인식을 위한 복합 영상 데이터 세트를 이용하여 총 6개의 클래스로 구분하였으며, F1-Score, Accuracy 기준으로 Identity-CBAM 모듈을 적용하였을 때 Vanilla ResNet50, ResNet101 대비 F1-Score 0.4~2.7%, Accuracy 0.18~2.03%의 성능 향상을 달성하였다. 또한, Guided Backpropagation과 Guided GradCam을 통해 시각화하였을 때 중요 특징점들을 더 세밀하게 표현하는 것을 확인하였다. 결과적으로 이미지 내 표정 분류 Task에서 Vanilla ResNet50, ResNet101을 사용하는 것보다 Identity-CBAM Module을 함께 사용하는 것이 더 적합함을 입증하였다.