• Science of Emotion and Sensibility
• /
• v.16 no.2
• /
• pp.187-194
• /
• 2013

The final aim of the present study is to build a system of converting a color image into musical elements based on a synesthetic perception, emulating human synesthetic skills, which make it possible to associate a color image with a specific sound. This can be done on the basis of the similarities between physical frequency information of both light and sound. As a first step, an input true color image is converted into hue, saturation, and intensity domains based on a color model conversion theory. In the next step, musical elements including note, octave, loudness, and duration are extracted from each domain of the HSI color model. A fundamental frequency (F0) is then extracted from both hue and intensity histograms. The loudness and duration are extracted from both intensity and saturation histograms, respectively. In experiments, the proposed system on the conversion of a color image into musical elements was implemented using standard C and Microsoft Visual C++(ver. 6.0). Through the proposed system, the extracted musical elements were synthesized to finally generate a sound source in a WAV file format. The simulation results revealed that the musical elements, which were extracted from an input RGB color image, reflected in its output sound signals.

• Journal of Korea Multimedia Society
• /
• v.19 no.3
• /
• pp.642-649
• /
• 2016

This paper presents a method for conversion of muscular sense into both visual and auditory senses based on synesthetic perception. Muscular sense can be defined by rotation angles, direction changes and motion degrees of human body. Synesthetic interconversion can be made by learning, so that it can be possible to create intentional synesthetic phenomena. In this paper, the muscular sense was converted into both color and sound signals which comprise the great majority of synesthetic phenomena. The measurement of muscular sense was performed by using the AHRS(attitude heading reference system). Roll, yaw and pitch signals of the AHRS were converted into three basic elements of color as well as sound, respectively. The proposed method was finally applied to a wearable device, Samsung gear S, successfully.

• Proceedings of the Korea Society of Design Studies Conference
• /
• 2003.11a
• /
• pp.82-83
• /
• 2003

• The Journal of the Acoustical Society of Korea
• /
• v.25 no.5
• /
• pp.197-206
• /
• 2006

Vibration of string is transmitted to the front plate through bridge to cause resonance of the instrument body in viol family string instruments. Therefore. the properties. geometrical shape. and positioning of the bridge are expected to have some effect on the sound color. In this study the strain and the stress in the bridge. and the force exerted on the top plate by the bridge as the string vibrates the bridge in cello are calculated through simulation based on the theory of elasticity. The modes of vibration and the characteristic frequencies are also found. Furthermore. the effect of geometric shape of bridge on sound color is studied in terms of frequency response. The results of this study show that the vibration characteristics of bridge is quite complex and the properties and the geometrical shape of bridge have significant effect on sound color, and therefore. the sound color of a cello can be controlled by changing the geometrical shape of bridge.

• The Journal of the Korea Contents Association
• /
• v.15 no.12
• /
• pp.8-17
• /
• 2015

This paper presents a sound into color signal conversion using a colored-hearing synesthesia. The aim of the present paper is to implement a real-time conversion system which focuses on both hearing and sight which account for a great part of bodily senses. The proposed method of the real-time conversion of color into sound, in this paper, was simple and intuitive where scale, octave and velocity were extracted from MIDI input signals, which were converted into hue, intensity and saturation, respectively, as basic elements of HSI color model. In experiments, we implemented both the hardware system for delivering MIDI signals to PC and the VC++ based software system for monitoring both input and output signals, so we made certain that the conversion was correctly performed by the proposed method.

• Proceedings of the Korean Society for Emotion and Sensibility Conference
• /
• 1999.03a
• /
• pp.271-276
• /
• 1999

This study was carried out to investigate the relationship between sound color and physical propertiessuiting fabrics. Rustling sounds of 23 suiting fabrics by sound generator developed for this study were recorded and analysed through FFT analysis. Three sound color factor(ΔL Δf. LPT) were obtained.Physical properties of specimens were measured by KES-FB. Level range(L) showed significant correlation with tensile resilience(RT) and thickness (T). Frequency difference(Δf) showed significant correlation with tensile linearity(LT), shear properties(G, 2HG, 2HG5), compressional energy(WC), and weight(W). Total sound pressure (LPT) showed significant correlation with elongation at maximum load (EM), tensile linearity(LY), and tesile energy(WT). By stepwise regression LPT was found to be explained by EM, MIU, RC, LT significantly.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.24 no.5
• /
• pp.462-469
• /
• 2014

As a basic study on both engineering applications and representation methods of synesthesia, this paper aims at building basic system which converts a muscular sense into both visual and auditory elements. As for the building method, data of the muscular sense can be acquired through roll and pitch signals which are calculated from both three-axis acceleration sensor and the two-axis gyro sensor. The roll and pitch signals are then converted into both visual and auditory information as outputs. The roll signals are converted into both intensity elements of the HSI color model and octaves as one of auditory elements. In addition, the pitch signals are converted into both hue elements of the HSI color model and scales as another one of auditory elements. Each of the extracted elements of the HSI color model is converted into each of the three elements of the RGB color model respectively, so that the real-time output color signals can be obtained. Octaves and scales are also converted and synthesized into MIDI signals, so that the real-time sound signals can be obtained as anther one of output signals. In experiments, the results revealed that normal color and sound output signals were successfully obtained from roll and pitch values that represent muscular senses or physical movements, depending on the conversion relationship based on the similarity between color and sound.

• 한국HCI학회:학술대회논문집
• /
• 2008.02b
• /
• pp.268-273
• /
• 2008

This work defines user intention according to intention range, and also proposes an interactive sound installation which reflects and varies above features. User intention consists of several decomposition concepts, which are elemental intentions, partial intentions, and a universal intention. And also, each concept is defined as inclusion/affiliation relationship with other concepts. For the representation of elemental intention, we implemented an musical interface, Color note, which represents the colors and notes according to response of participants. We also propose Harmonic Defragmentation (HD), which arranges the partial intentions with harmonic rule. Finally, the universal intention is inferred to the comprehensive direction of elemental intentions. We used Karhunen-Lo$\`{e}$ve(K-L) Transform for the inference. For verifying the validity of our proposed interface, the "Color Note," and the various techniques, we installed our work and surveyed various users for the evaluation of HD and statistical techniques. Also, we commissioned another survey to find out satisfaction measurement which was used for expressing universal intention.

• Proceedings of the Korea Contents Association Conference
• /
• 2009.05a
• /
• pp.927-932
• /
• 2009

There is such a kind of characteristic by using the computer digitization technology's interaction. It not only provides the authoring tool, and also has the user-friendly window. The paper based on this kind of interaction, through the sound and the color exchange of information, as well as each information's digitization, carries on about the scientific dielectric related advance research. This research carries on the analysis to the people to the color and the sound perceptual characteristic first, then makes comparison to the people regarding the color and the music perceptual cognition.. The research is about the research stage of the interactive sound installation creation, which shape is carried on the analysis through the extraction image in color. It is based on the perceptual characteristic,is that the algorithm manufacture reasearch of how to make color sonification. Through capturing the non-stop changing colors by camera,it transforms colors into music. The paper's foundation is the fundamental algorithm manufacture of experimental music composition.

• Proceedings of the Korean Society for Emotion and Sensibility Conference
• /
• 1999.03a
• /
• pp.265-269
• /
• 1999

This study was carried out to evaluate human subjective sensation for fabric rustling sounds and predict the sensation with quantified sound color measurements and mechanical properties of fabrics. Thirty subjects at Virginia Tech were asked to evaluate seven sound sensation descriptors by semantic differential scale after hearing eight different fabric sounds. Sound measurements were quantified by calculating total sound pressure(LPT), level range(ΔL), and frequency difference (Δf). Mechanical properties of fabrics were measured by KES-FB. Subjective sensation for fabric sound showed significant differences among fabrics except clearness sensation. Subjective sensation predicted by sound measurements showed well fitted regression equation with ΔL and LPT> Sharpness, clearness, and highness were significantly released with mechanical properties of fabrics. All sensation was found to be predicted with sound measurements L:PT and Δf and mechanical properties such as LT, 2HG5, WC, T, and W.