• Journal of Korea Game Society
• /
• v.17 no.3
• /
• pp.45-52
• /
• 2017

This paper proposes a new strategy of emotion-based music visualization. Emotional LED lighting control system is suggested to help audiences enhance the musical experience. In the system, emotion in music is recognized by a proposed algorithm using a dimensional approach. The algorithm used a method of music emotion variation detection to overcome some weaknesses of Thayer's model in detecting emotion in a one-second music segment. In addition, IRI color model is combined with Thayer's model to determine LED light colors corresponding to 36 different music emotions. They are represented on LED lighting control system through colors and animations. The accuracy of music emotion visualization achieved to over 60%.

• KIPS Transactions on Software and Data Engineering
• /
• v.7 no.6
• /
• pp.239-248
• /
• 2018

Many new technologies are studied with the arrival of the 4th industrial revolution. In particular, emotional intelligence is one of the popular issues. Researchers are focused on emotional analysis studies for music services, based on artificial intelligence and pattern recognition. However, they do not consider how we recommend proper music according to the specific emotion of the user. This is the practical issue for music-related IoT applications. Thus, in this paper, we propose an probability-based music emotion classification technique that makes it possible to classify music with high precision based on the range of emotion, when developing music related services. For user emotion recognition, one of the popular emotional model, Russell model, is referenced. For the features of music, the average amplitude, peak-average, the number of wavelength, average wavelength, and beats per minute were extracted. Multiple regressions were derived using regression analysis based on the collected data, and probability-based emotion classification was carried out. In our 2 different experiments, the emotion matching rate shows 70.94% and 86.21% by the proposed technique, and 66.83% and 76.85% by the survey participants. From the experiment, the proposed technique generates improved results for music classification.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2019.01a
• /
• pp.243-246
• /
• 2019

본 논문에서는 감성과 힐링, 머신러닝이라는 주제를 바탕으로 딥러닝을 통한 사용자의 얼굴표정을 인식하고 그 얼굴표정을 기반으로 음악을 재생해주는 얼굴표정 기반의 음악재생 프로그램을 제안한다. 얼굴표정 기반 음악재생 프로그램은 딥러닝 기반의 음악 프로그램으로써, 이미지 인식 분야에서 뛰어난 성능을 보여주고 있는 CNN 모델을 기반으로 얼굴의 표정을 인식할 수 있도록 데이터 학습을 진행하였고, 학습된 모델을 이용하여 웹캠으로부터 사용자의 얼굴표정을 인식하는 것을 통해 사용자의 감정을 추측해낸다. 그 후, 해당 감정에 맞게 감정을 더 증폭시켜줄 수 있도록, 감정과 매칭되는 노래를 재생해주고, 이를 통해, 사용자의 감정이 힐링 및 완화될 수 있도록 도움을 준다.

• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.47 no.1
• /
• pp.73-79
• /
• 2010

Emotion intelligence computing is able to processing of human emotion through it's studying and adaptation. Also, Be able more efficient to interaction of human and computer. As sight and hearing, music & image is constitute of short time and continue for long. Cause to success marketing, understand-translate of humanity emotion. In this paper, Be design of check system that matched music and image by user emotion keyword(irritability, gloom, calmness, joy). Suggested system is definition by 4 stage situations. Then, Using music & image and emotion ontology to retrieval normalized music & image. Also, A sampling of image peculiarity information and similarity measurement is able to get wanted result. At the same time, Matched on one space through pared correspondence analysis and factor analysis for classify image emotion recognition information. Experimentation findings, Suggest system was show 82.4% matching rate about 4 stage emotion condition.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2011.07a
• /
• pp.254-257
• /
• 2011

본 논문에서는 내용 기반 음악의 감성추출 연구의 동향을 살펴보고, 평가치를 기반으로 청중의 기호를 분석해 본다. 청중의 기호 분석은 가능한 많은 사람이 공감 할 수 있는 데이터를 사용하고자, 최근 이슈가 되고 있는 "나는 가수다" 방송 프로그램의 음원 분석을 통해 이루어졌다. 데이터베이스는 총 7 번의 공연/경연마다 7 곡씩 순위가 매겨지므로 총 49 곡으로 이루어진다. 청중 평가단은 총 500 명의 엄격히 선발된 10 대에서 50 대, 각각 100 명 씩으로 구성되었다. 특징값은 오픈소스인 MIRtoolbox 를 이용해서, 총 376 개의 특징값을 추출하여 평가치와의 상관관계를 구해 청중 평가단의 기호를 분석한다. 실험결과 총 376 개의 특징값 중 10 개의 특징값이 청중평가단의 기호와 상관관계가 있다는 것이 나타났다. 마지막으로 내용 기반 음악의 감성 추출 연구에서 보이는 감성의 주관적 인식성 및 심리학적 설명의 난해함을 줄이고자, 향후 과제로 내용 기반 및 평가치 기반의 시스템을 결합한 감성 기반 음악 추천 시스템을 제안한다.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2021.11a
• /
• pp.834-836
• /
• 2021

멀티모달 감정인식을 통해 사람의 감정을 정확하게 분류하고, 사람의 감정에 어울리는 음악을 매칭하는 시스템을 설계한다. 멀티모달 감정 인식 방법으로는 IEMOCAP(Interactive Emotional Dyadic Motion Capture) 데이터셋을 활용해 감정을 분류하고, 분류된 감정의 분위기에 맞는 음악을 매칭시키는 시스템을 구축하고자 한다. 유니모달 대비 멀티모달 감정인식의 정확도를 개선한 시스템을 통해 텍스트, 음성, 표정을 포함하고 있는 동영상의 감성 분위기에 적합한 음악 매칭 시스템을 연구한다.

• The Journal of the Korea Contents Association
• /
• v.10 no.6
• /
• pp.286-296
• /
• 2010

The study of the development of DJ robots is to meet the demands of the music services which are changing very rapidly in the digital and network era. Existing studies, as a whole, develop music services on the premise of personalized environment and equipment, but the DJ robot is on the premise of the open space shared by the public. DJ robot gives priority to traditional space and music. Recently as the hospitality and demand for cultural contents of South Korea expand to worldwide, industrial use of the contents based on traditional or our unique characteristics is getting more and more. Meanwhile, the DJ robot is composed of a combination of two modules. One is to detect changes in the external environment and the other is to set the properties of the music by psychology, emotional engineering, etc. DJ robot detect the footprint of the temperature, humidity, illumination, wind, noise and other environmental factors measured, and will ensure the objectivity of the music source by repeated experiments and verification with human sensibility ergonomics based on Hevner Adjective Circle. DJ robot will change the soundscape of the traditional space being more beautiful and make the revival and prosperity of traditional music with the use of traditional music through BGM.

• Proceedings of the KAIS Fall Conference
• /
• 2005.05a
• /
• pp.111-114
• /
• 2005

현재 휴대폰은 대중화되고 있으며, 로봇기술 또한 각광 받고 있다. 그래서 우리는 로봇기술과 휴대폰 기술을 접목한 RCP(Robotic Cellular Phone)를 구현하려 한다. RCP를 구성하기 위해서 휴대폰의 움직임을 구현, 외부환경 및 RCP 자신의 상태인식 기능 그리고 사용자의 감성을 유발할 수 있는 감성유발엔진 및 감성평가모델의 군축이 필요하다. 본 연구에서는 감성평가모델의 개발을 위하여 음악과 진동 자극을 주어 생체신호 HRV와 GSR을 측정하여 정량적인 데이터를 수집, 특정감성을 평가하였다. 감성을 평가함에 있어서 개인의 차이가 발생하기 때문에 개개인의 표준화 (Normalize)가 필요하게 되었다. 표준화를 위하여 IAPS영상을 활용한 결과 우리가 얻고자 하는 감성의 변화에 대한 판단을 할 수 있음으로 감성의 신호 모델을 유추할 수 있었다.

• The Journal of Korea Institute of Information, Electronics, and Communication Technology
• /
• v.14 no.3
• /
• pp.215-222
• /
• 2021

As the importance of human-computer interaction (Human Computer Interface) technology grows and research on HCI is progressing, it is inferred about the research emotion inference or the computer reaction according to the user's intention, not the computer reaction by the standard input of the user. Stress is an unavoidable result of modern human civilization, and it is a complex phenomenon, and depending on whether or not there is control, human activity ability can be seriously changed. In this paper, we propose an intelligent emotional recommendation system using music as a way to relieve stress after measuring heart rate variability (HRV) and acceleration photoplethymogram (APG) increased through stress as part of human-computer interaction. The differential evolution algorithm was used to extract reliable data by acquiring and recognizing the user's biometric information, that is, the stress index, and emotional inference was made through the semantic web based on the obtained stress index step by step. In addition, by searching and recommending a music list that matches the stress index and changes in emotion, an emotional recommendation system suitable for the user's biometric information was implemented as an application.

• The Journal of the Korea Contents Association
• /
• v.11 no.3
• /
• pp.116-127
• /
• 2011

This paper proposes interactive game elements for children : contents, design, sound, gesture recognition, and speech recognition. Interactive games for early children must use the contents which reflect the educational needs and the design elements which are all bright, friendly, and simple to use. Also the games should consider the background music which is familiar with children and the narration which make easy to play the games. In gesture recognition and speech recognition, the interactive games must use gesture and voice data which hits to the age of the game user. Also, this paper introduces the development process for the interactive skipping game and applies the child-oriented contents, gestures, and voices to the game.