• The Journal of the Convergence on Culture Technology
• /
• v.2 no.2
• /
• pp.23-27
• /
• 2016

'Colored hearing' occurs to those who caused confusion in the visual, auditory path to brain because pruning had not normally done in the growth phase. It is called as 'colored hearing'. 'Colored hearing' is a phenomenon which some people can see colors when they hear sounds. In the interview of video, art experts say that the phenomenon is a natural talents, however professionals in the medical field say that the disorder may be causing a major disruption to daily life. Usually people are unknowingly suffering from synesthesia phenomenon. In this paper, based on the video, we show the phenomenon of 'colored hearing' based on the results of scientific research and on the daily life, and also analyze the video from the viewpoint of the editors and the audience.

• Journal of the Korea Society of Computer and Information
• /
• v.13 no.2
• /
• pp.135-141
• /
• 2008

In this paper, we propose colored-hear recognition that distinguishing feature of synesthesia for human sensing by shared vision and specific sense of hearing. We perceived what potential influence of human's structured object recognition by visual analysis through the camera, So we've studied how to make blind persons can feel similar vision of real object. First of all, object boundaries are detected in the image data representing a specific scene. Then, four specific features such as object location in the image focus, feeling of average color, distance information of each object, and object area are extracted from picture. Finally, mapping these features to the audition factors. The audition factors are used to recognize vision for blind persons. Proposed colored-hear transformation for recognition can get fast and detail perception, and can be transmit information for sense at the same time. Thus, we were get a food result when applied this concepts to blind person's case of image recognition.

• The Journal of the Korea Contents Association
• /
• v.15 no.12
• /
• pp.8-17
• /
• 2015

This paper presents a sound into color signal conversion using a colored-hearing synesthesia. The aim of the present paper is to implement a real-time conversion system which focuses on both hearing and sight which account for a great part of bodily senses. The proposed method of the real-time conversion of color into sound, in this paper, was simple and intuitive where scale, octave and velocity were extracted from MIDI input signals, which were converted into hue, intensity and saturation, respectively, as basic elements of HSI color model. In experiments, we implemented both the hardware system for delivering MIDI signals to PC and the VC++ based software system for monitoring both input and output signals, so we made certain that the conversion was correctly performed by the proposed method.

• Proceedings of the Korea Contents Association Conference
• /
• 2012.05a
• /
• pp.307-308
• /
• 2012

인간은 음에서도 색을 느낄 수 있다. 그리고 청각을 통하여 음의 높고(고음), 낮음(저음), 장(길고), 단(짧음), 맑고, 탁함에 따라 색을 다르게 느낄 수 있다. 이러한 현상을 색청(色聽)이라고 한다. 소리와 색의 연관성에 대하여 선행 연구를 고찰한 결과 색의 3속성 색상, 채도, 명도는 음악의 음계, 옥타브, 음색과 연관성이 있었다. 그리고 음악의 리듬은 조형의 공간, 형태의 조화와 반복이 유사하다는 것을 알 수 있었다. 본 연구는 에드워드 마이언(Edward D. Maryon)의 마르코톤의 음과 색의 이론을 바탕으로 뉴턴의 색채와 음계로 경상도 민요 밀양아리랑의 색채를 분석하였다. 분석 결과 밀양아리랑 음의 빈도에 의한 색채는 Blue Violet, Green Blue, Red, Yellow, Orange의 순으로 색채를 추출할 수 있었다. 추출된 색에서 연상되는 형용사 이미지는 힘, 정열, 인내, 열정, 진취적인, 우호적, 야망, 불꽃 등으로 경상도 지역 이미지로 연관 시킬 수 있다. 본 연구는 경상도민요 밀양아리랑의 음을 분석하여 색의 연상이미지와 지역 색을 찾는데 그 의의를 두었다.

• The Journal of the Korea Contents Association
• /
• v.16 no.8
• /
• pp.484-492
• /
• 2016

Role of music in an image can be divided into a supplementary function to express narrative of image and an independent function to become the subject of music and to lead the image. To perceive sound through hearing and then, to make it visualized is called visual music. Since the 19th century, image synchronization of music through colored hearing has been continuously attempted by artists in their works. Also in the 20th century, many artists could attempt time-wise concept of movement passing the bounds of three-dimensional expression due to development of cinema. In such a process, artists with strong experimental spirits inferred correlation between sound and image and then, pioneered new genre of visual music. As a result, the times are being changed from those of listening to those of watching, and various works are being produced by experimental attempt of various music and images. This thesis aims to investigate aesthetic characteristics of modern visual music and then, to conduct comparative analysis on how visual music using colors are utilized in diversified fields such as movie, animation, music video and media art.