Browse > Article
http://dx.doi.org/10.5391/JKIIS.2010.20.2.251

A Basic Study on the System of Converting Color Image into Sound  

Kim, Sung-Ill (Department of Electronic Engineering, Kyungnam University)
Jung, Jin-Seung (Department of Electronic Engineering, Kyungnam University)
Publication Information
Journal of the Korean Institute of Intelligent Systems / v.20, no.2, 2010 , pp. 251-256 More about this Journal
Abstract
This paper aims for developing the intelligent robot emulating human synesthetic skills which associate a color image with sound, so that we are able to build an application system based on the principle of mutual conversion between color image and sound. As the first step, in this study, we have tried to realize a basic system using the color image to sound conversion. This study describes a new conversion method to convert color image into sound, based on the likelihood in the physical frequency information between light and sound. In addition, we present the method of converting color image into sound using color model conversion as well as histograms in the converted color model. In the basis of the method proposed in this study, we built a basic system using Microsoft Visual C++(ver. 6.0). The simulation results revealed that the hue, saturation and intensity elements of a input color image were converted into F0, harmonic and octave elements of a sound, respectively. The converted sound elements were synthesized to generate a sound source with WAV file format using Csound toolkit.
Keywords
Image-to-sound Conversion; Sound-to-image Conversion; RGB; HSI Color model; Histogram;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 김길호, 화성법을 이용하여 색과 음을 상호변환하고 색채를 조화하는 방법 및 장치, 출원번호 10-99-34242, 1999.
2 김길호, 화성법을 이용한 음색변환표, 출원번호 10-2001-0087651, 2001.
3 강동중, 하종은, VISUAL C++을 이용한 디지털 영상처리, 사이텍미디어, 2003.
4 김용성, VISUAL C++ 6 완벽가이드, 영진닷컴. 2004.
5 이동재, CSOUND, 예당출판사, 2005.
6 석용환, MIT CSOUND를 활용한 소리보기, 천이 미디어, 2006.
7 김유라, "소리의 표현 연구", 서울여자대학교 대학원, 석사학위논문, 1998.
8 N. Osmanovic, N. Hrustemovic, H. R. Myler, "A testbed for auralization of graphic art", IEEE Region 5, 2003 Annual Technical Conference, pp.45-49, 2003.   DOI
9 김민호, 정성환, 강민수, "음의 시각화와 그 표현의 경향", 디자인學硏究, Vol. 16, No. 3, pp. 101-110, 2003.   과학기술학회마을
10 박진희, "음악과 색채의 유기적 관계에 관한 연구: 모드를 중심으로", 상명대 뉴미디어정보통신대학원, 석사논문, 2005.
11 S. Matta, D. K. Kumar, X. Yu, M. Burry, "Discriminative analysis for image to sound mapping", Intelligent Sensing and Information Processing, pp. 119-122, 2004.   DOI
12 G. Bologna, B. Deville, T. Pun, "On the use of the auditory pathway to represent image scenes in real-time", Neurocomputing, Vol. 72, No. 4/6, pp. 839-849, 2009.   DOI
13 이형민, 영상악기 만들기 1, 마이크로소프트웨어, 10월호, pp. 234-239, 2006.
14 손우람, 영상악기 만들기 2, 마이크로소프트웨어, 11월호, pp. 232-238, 2006.
15 김길호, 백정기, 사운드컬러하모니즘: 음악이 흐르는 컬러 배색 사전, 임프레스, 2003.