• Journal of Korea Game Society
• /
• v.17 no.3
• /
• pp.45-52
• /
• 2017

This paper proposes a new strategy of emotion-based music visualization. Emotional LED lighting control system is suggested to help audiences enhance the musical experience. In the system, emotion in music is recognized by a proposed algorithm using a dimensional approach. The algorithm used a method of music emotion variation detection to overcome some weaknesses of Thayer's model in detecting emotion in a one-second music segment. In addition, IRI color model is combined with Thayer's model to determine LED light colors corresponding to 36 different music emotions. They are represented on LED lighting control system through colors and animations. The accuracy of music emotion visualization achieved to over 60%.

• Journal of Biomedical Engineering Research
• /
• v.19 no.5
• /
• pp.539-546
• /
• 1998

The purpose of this study is to estimate human emotion quantitatively under colors and music stimuli and to examine the for correlation between color and music sensibility. Physiological signals(electroencephalogram, electrocardiogram, Galvanic skin conductivity and respiration rate) were measured to compare color with music sensibilities. The personality of the subject were investigated using factor analysis and semantic differential method of 20 items(7 interval scaled). The results showed that red, yellow and violets color provoked active and exciting senses mainly as dance, rock and blues music. While blue, cyan and pink colors ware involved in tranquil and resting emotions deeply as classic and ballade music.

• Proceedings of the Korea Multimedia Society Conference
• /
• 2012.05a
• /
• pp.211-214
• /
• 2012

스트레스는 다양한 질병의 원인이 되며 스트레스의 해소는 질병 예방에 중요한 요인이라 할 수 있을 것이다. 스트레스를 해소시키는 방법 중 한 가지는 청각이나 시각을 이용하는 방법이다. 청각과 시각을 동시에 이용할 수 있다면 그 효과를 극대화 할 수 있을 것이다. 본 논문에서는 음악의 분위기를 자동으로 파악하고, 파악한 음악의 분위기를 표현할 수 있는 음악감성 조명기용 임베디드 리눅스 기반 필드 시스템을 제안하였다. 본 논문에서 제시한 필드서버를 감성조명과 함께 공원이나 가정집 등에 제공할 수 있을 것이고, 음악과 조명을 동시에 제공함으로 현대인 질병의 원인이라 할 수 있는 스트레스 해소가 가능할 것이다. 또한 본 논문의 시스템을 이용하여 임상실험을 실시하여 임상데이터를 확보한다면 심리 치료를 목적으로 하는 의학적 도구로 발전 할 수 있을 것으로 보인다.

• The Journal of the Korea Contents Association
• /
• v.20 no.10
• /
• pp.89-99
• /
• 2020

In this study, we tried to produce moving-image works through sentiment analysis of music. First, Google natural language API was used for the sentiment analysis of lyrics, then the result was applied to the image visualization rules. In prior engineering researches, text-based sentiment analysis has been conducted to understand users' emotions and attitudes by analyzing users' comments and reviews in social media. In this study, the data was used as a material for the creation of artworks so that it could be used for aesthetic expressions. From the machine's point of view, emotions are substituted with numbers, so there is a limit to normalization and standardization. Therefore, we tried to overcome these limitations by linking the results of sentiment analysis of lyrics data with the rules of formative elements in visual arts. This study aims to transform existing traditional art works such as literature, music, painting, and dance to a new form of arts based on the viewpoint of the machine, while reflecting the current era in which artificial intelligence even attempts to create artworks that are advanced mental products of human beings. In addition, it is expected that it will be expanded to an educational platform that facilitates creative activities, psychological analysis, and communication for people with developmental disabilities who have difficulty expressing emotions.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2011.04a
• /
• pp.1039-1042
• /
• 2011

스트레스는 다양한 질병의 원인이 되며 스트레스의 해소는 질병 예방에 중요한 요인이라 할 수 있을 것이다. 스트레스를 해소시키는 방법 중 한 가지는 청각이나 시각을 이용하는 방법이다. 청각과 시각을 동시에 이용할 수 있다면 그 효과를 극대화 할 수 있을 것이다. 본 논문에서는 음악의 분위기를 자동으로 파악하고, 파악한 음악의 분위기를 표현할 수 있는 감성조명 시스템을 제안하였다. 본 논문에서 제시한 감성조명을 공원이나 가정집 등에 제공할 수 있을 것이고, 음악과 조명을 동시에 제공함으로 현대인 질병의 원인이라 할 수 있는 스트레스 해소가 가능 할 것이다. 또한 본 논문의 시스템을 이용하여 임상실험을 실시하여 임상데이터를 확보한다면 심리 치료를 목적으로 하는 의학적 도구로 발전 할 수 있을 것으로 보인다.

• KIPS Transactions on Software and Data Engineering
• /
• v.4 no.4
• /
• pp.195-200
• /
• 2015

Recently, most people use android based smartphones and we can find music players in any smartphones. However, it's hard to find a personalized music player which applies user's preference. In this paper, we propose an emotion-based music player, which analyses and classifies the music with user's emotion, recommends the music, applies the user's preference, and visualizes the music by color. Through the proposed music player, user could be able to select musics easily and use an optimized application.

• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.47 no.1
• /
• pp.73-79
• /
• 2010

Emotion intelligence computing is able to processing of human emotion through it's studying and adaptation. Also, Be able more efficient to interaction of human and computer. As sight and hearing, music & image is constitute of short time and continue for long. Cause to success marketing, understand-translate of humanity emotion. In this paper, Be design of check system that matched music and image by user emotion keyword(irritability, gloom, calmness, joy). Suggested system is definition by 4 stage situations. Then, Using music & image and emotion ontology to retrieval normalized music & image. Also, A sampling of image peculiarity information and similarity measurement is able to get wanted result. At the same time, Matched on one space through pared correspondence analysis and factor analysis for classify image emotion recognition information. Experimentation findings, Suggest system was show 82.4% matching rate about 4 stage emotion condition.

• Science of Emotion and Sensibility
• /
• v.14 no.1
• /
• pp.59-72
• /
• 2011

Since stress can cause a variety of diseases, the relaxation of stress is an important factor for preventing diseases. One way to relieve stress is to use auditory or visual materials. If auditory and visual ones are used together, the effect of stress relaxation will be maximized. In this context, we analyze mood distribution of genre of music and color distribution of mood from the mood data for musics and color data for mood words collected directly from volunteers. Based on these two distributions, we also perform the $X^2$-test with Minitab for checking that color distributions are different from genre to genre. The results show that a different genre has a different color distribution and that the distributions of color, brightness and saturation depend on mood (P<0.0001). The results will be used to develop an emotional lighting system which plays lighting according to music mood, which can be applied to psychotherapy but more data and analysis are needed for clinical trials.

• Fashion & Textile Research Journal
• /
• v.17 no.4
• /
• pp.524-540
• /
• 2015

This study develops textile pattern design ideas created through the visualization of music. Methods of auditory and synesthesia were employed to analyze various attributes of popular music genres and appoint language image, shape image, and color image to obtain their interrelationships. This study provides data that can be used to express emotional images on textile print pattern designs. This research used different genres of popular music as stimuli. The language image was extracted and introduced to the overall color scheme; in addition, the color image was verified. The analysis of the color image was executed by applying it with the color set image scale of I.R.I colors. Then, the color image of the target genre of popular music was examined and analyzed through a color tone system. The preference in shape image was realized through visual images based on basic principles of points, lines, and sides composition; subsequently, an analysis of the emotional image of popular music followed. An examination of the emotional images of different popular music genres have led to the discovery that language image, color image, and shape image all share a common emotional image. There was also a realization that similarity and interrelationship exists in language, color, and shape images experienced by listening to popular music.

• Journal of the Korea Fashion and Costume Design Association
• /
• v.8 no.1
• /
• pp.111-125
• /
• 2006

This study measured and analyzed musical sense objectively, and visualized it to express visual effects as if watching music with the eye. For the visualization of music, we examined the concept of synesthesia and the correlation between hearing and seeing, and reviewed theoretical grounds and a number of cases necessary in reproducing musical sense visually based on synesthetic expression. Furthermore, we studied the visual elements and associated colors of rhythm to prove that visual conception of music through various approaches enable a transitional approach to aesthetic exploration and interpretation. The conclusions drawn from this research are as follows. First, classic music selected for visualization had musical characteristics highly correlated with dress design. Second, basic formative elements suggested as materials of visualization in this study were suitable in their form for expressing the rhythmic sense of music and, because they started from the most basic form, they were effective in extracting design elements. Third, when the result of the questionnaire survey, which was focused on the visualization of the rhythmic sense of the five pieces of classic music, was analyzed from the aspect of sensibility ergonomics, design elements of each piece of music were obtained in an objective and scientific way. Fourth, it was confirmed that common concepts could be derived from intangible elements such as forms and sounds observed in the rhythmic sense of music obtained from the result of the questionnaire survey. Fifth, works were made based on the results of this study and, according to the result, musical images can express sense through dress design and obtain visual effects as if watching music with the eye. Dress desist through the visualization of music in this study was an attempt to suggest that the language of music can be expressed in dress design, a visual formative language, based on synesthetic expression. Through this attempt, we confirmed the infinity of music as motives of dress design and suggested a method of aesthetic expression demanded in contemporary society that is pursuing aesthetic values.