• The Journal of the Convergence on Culture Technology
• /
• v.2 no.2
• /
• pp.23-27
• /
• 2016

'Colored hearing' occurs to those who caused confusion in the visual, auditory path to brain because pruning had not normally done in the growth phase. It is called as 'colored hearing'. 'Colored hearing' is a phenomenon which some people can see colors when they hear sounds. In the interview of video, art experts say that the phenomenon is a natural talents, however professionals in the medical field say that the disorder may be causing a major disruption to daily life. Usually people are unknowingly suffering from synesthesia phenomenon. In this paper, based on the video, we show the phenomenon of 'colored hearing' based on the results of scientific research and on the daily life, and also analyze the video from the viewpoint of the editors and the audience.

• The Journal of the Korea Contents Association
• /
• v.15 no.12
• /
• pp.8-17
• /
• 2015

This paper presents a sound into color signal conversion using a colored-hearing synesthesia. The aim of the present paper is to implement a real-time conversion system which focuses on both hearing and sight which account for a great part of bodily senses. The proposed method of the real-time conversion of color into sound, in this paper, was simple and intuitive where scale, octave and velocity were extracted from MIDI input signals, which were converted into hue, intensity and saturation, respectively, as basic elements of HSI color model. In experiments, we implemented both the hardware system for delivering MIDI signals to PC and the VC++ based software system for monitoring both input and output signals, so we made certain that the conversion was correctly performed by the proposed method.

• Journal of the Korea Society of Computer and Information
• /
• v.13 no.2
• /
• pp.135-141
• /
• 2008

In this paper, we propose colored-hear recognition that distinguishing feature of synesthesia for human sensing by shared vision and specific sense of hearing. We perceived what potential influence of human's structured object recognition by visual analysis through the camera, So we've studied how to make blind persons can feel similar vision of real object. First of all, object boundaries are detected in the image data representing a specific scene. Then, four specific features such as object location in the image focus, feeling of average color, distance information of each object, and object area are extracted from picture. Finally, mapping these features to the audition factors. The audition factors are used to recognize vision for blind persons. Proposed colored-hear transformation for recognition can get fast and detail perception, and can be transmit information for sense at the same time. Thus, we were get a food result when applied this concepts to blind person's case of image recognition.

• The Journal of the Korea Contents Association
• /
• v.16 no.8
• /
• pp.484-492
• /
• 2016

Role of music in an image can be divided into a supplementary function to express narrative of image and an independent function to become the subject of music and to lead the image. To perceive sound through hearing and then, to make it visualized is called visual music. Since the 19th century, image synchronization of music through colored hearing has been continuously attempted by artists in their works. Also in the 20th century, many artists could attempt time-wise concept of movement passing the bounds of three-dimensional expression due to development of cinema. In such a process, artists with strong experimental spirits inferred correlation between sound and image and then, pioneered new genre of visual music. As a result, the times are being changed from those of listening to those of watching, and various works are being produced by experimental attempt of various music and images. This thesis aims to investigate aesthetic characteristics of modern visual music and then, to conduct comparative analysis on how visual music using colors are utilized in diversified fields such as movie, animation, music video and media art.