• International Journal of Fuzzy Logic and Intelligent Systems
• /
• v.12 no.2
• /
• pp.101-107
• /
• 2012

This study describes a proposed method of converting an input sound signal into a color image by emulating human synesthetic skills which make it possible to associate an sound source with a specific color image. As a first step of sound-to-image conversion, features such as fundamental frequency(F0) and energy are extracted from an input sound source. Then, a musical scale and an octave can be calculated from F0 signals, so that scale, energy and octave can be converted into three elements of HSI model such hue, saturation and intensity, respectively. Finally, a color image with the BMP file format is created as an output of the process of the HSI-to-RGB conversion. We built a basic system on the basis of the proposed method using a standard C-programming. The simulation results revealed that output color images with the BMP file format created from input sound sources have diverse hues corresponding to the change of the F0 signals, where the hue elements have different intensities depending on octaves with the minimum frequency of 20Hz. Furthermore, output images also have various levels of chroma(or saturation) which is directly converted from the energy.

• Journal of Korea Game Society
• /
• v.11 no.1
• /
• pp.147-157
• /
• 2011

Webcam doesn't perform memory-alignment in order to reduce the transmission time of image data. Memory-unaligned image data is unsuitable for the processing on GPU. Accordingly, we convert it to available color format for optimization in high speed image processing. In this paper, we propose a technique that accelerates webcam's color format conversion by using NVDIA CUDA. We propose an optimization which is about memory accesses and thread composition, also evaluate memory and computing performance for verifying a hypothesis which is the performance of the proposed architecture and optimizing degree on low-performance GPU. Following the optimization technique, we show performance improvements over maximum 68 percent.

• The Journal of the Acoustical Society of Korea
• /
• v.30 no.3
• /
• pp.142-148
• /
• 2011

The final aim of the present study is to develop the intelligent robot, emulating human synesthetic skills which make it possible to associate a color image with a specific sound. This can be done on the basis of the mutual conversion between color image and sound. As a first step of the final goal, this study focused on a basic system using a conversion of color image into sound. This study describes a proposed method to convert color image into sound, based on the likelihood in the physical frequency information between light and sound. The method of converting color image into sound was implemented by using HSI histograms through RGB-to-HSI color model conversion, which was done by Microsoft Visual C++ (ver. 6.0). Two different color images were used on the simulation experiments, and the results revealed that the hue, saturation and intensity elements of each input color image were converted into fundamental frequency, harmonic and octave elements of a sound, respectively. Through the proposed system, the converted sound elements were then synthesized to automatically generate a sound source with wav file format, using Csound.

• Science of Emotion and Sensibility
• /
• v.16 no.2
• /
• pp.187-194
• /
• 2013

The final aim of the present study is to build a system of converting a color image into musical elements based on a synesthetic perception, emulating human synesthetic skills, which make it possible to associate a color image with a specific sound. This can be done on the basis of the similarities between physical frequency information of both light and sound. As a first step, an input true color image is converted into hue, saturation, and intensity domains based on a color model conversion theory. In the next step, musical elements including note, octave, loudness, and duration are extracted from each domain of the HSI color model. A fundamental frequency (F0) is then extracted from both hue and intensity histograms. The loudness and duration are extracted from both intensity and saturation histograms, respectively. In experiments, the proposed system on the conversion of a color image into musical elements was implemented using standard C and Microsoft Visual C++(ver. 6.0). Through the proposed system, the extracted musical elements were synthesized to finally generate a sound source in a WAV file format. The simulation results revealed that the musical elements, which were extracted from an input RGB color image, reflected in its output sound signals.

• Science of Emotion and Sensibility
• /
• v.15 no.2
• /
• pp.231-238
• /
• 2012

This study aims for building an application system of converting sound into color image based on synesthetic perception. As the major features of input sound, both scale and octave elements extracted from F0(fundamental frequency) were converted into both hue and intensity elements of HSI color model, respectively. In this paper, we used the fixed saturation value as 0.5. On the basis of color model conversion theory, the HSI color model was then converted into the RGB model, so that a color image of the BMP format was finally created. In experiments, the basic system was implemented on both software and hardware(TMS320C6713 DSP) platforms based on the proposed sound-color image conversion method. The results revealed that diverse color images with different hues and intensities were created depending on scales and octaves extracted from the F0 of input sound signals. The outputs on the hardware platform were also identical to those on the software platform.

• KIPS Transactions on Software and Data Engineering
• /
• v.6 no.3
• /
• pp.117-124
• /
• 2017

To access PDF documents on an electronic book, PDF documents need to be converted into EPUB which is a standard format of the electronic book. When converting a PDF document into EPUB format, we need to convert color representations from CMYK into RGB representation. It is possible to give a visual effect and a user interaction using a video and JavaScript supported by EPUB format. The schemes for converting from PDF to EPUB are studied in this paper. (1) The first study is to carry out not to lose the color conversion effect using an ICC profile. (2) The second one is a layout configuration in the conversion process. (3) The third one is to highlight a specific content such as quiz platform to provide interactive visual effect for electronic book readers. Finally, in this paper we will show the usability of EPUB based eBook converting scheme through user study.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.20 no.2
• /
• pp.251-256
• /
• 2010

This paper aims for developing the intelligent robot emulating human synesthetic skills which associate a color image with sound, so that we are able to build an application system based on the principle of mutual conversion between color image and sound. As the first step, in this study, we have tried to realize a basic system using the color image to sound conversion. This study describes a new conversion method to convert color image into sound, based on the likelihood in the physical frequency information between light and sound. In addition, we present the method of converting color image into sound using color model conversion as well as histograms in the converted color model. In the basis of the method proposed in this study, we built a basic system using Microsoft Visual C++(ver. 6.0). The simulation results revealed that the hue, saturation and intensity elements of a input color image were converted into F0, harmonic and octave elements of a sound, respectively. The converted sound elements were synthesized to generate a sound source with WAV file format using Csound toolkit.

• Journal of the Korea Furniture Society
• /
• v.20 no.5
• /
• pp.467-479
• /
• 2009

The high-tech computer technology developments have greatly affected the area of design education. Starting from the mid 80s, innovations in visual presentation methods have heightened with 2D computer graphic programs, CAD & 3D modeling, and Rapid Prototype that allows dimensional generation. The specialty and quality in design studio education have advanced due to the development in presentation methods such as Power Point and Keynote. But there are many problems with the current method of presenting the visual outcome in a data format using beam projectors, which is a vertical presenting method compared to the old studio study method of conducting discussions and reviews based on the substantial outcome. The essence of studio study that allows for comparisons and analysis by horizontally opening up the various work outcomes is being offset. Also the requirement for manual idea sketching work that plays an important role in the initial design phase continuing to decrease due to the digital working process dependence and cumbersome procedures in the presentation. In order to resolve this problem, the CALM system (Class Applied LCD Modular System) has been developed that replaces the method of attaching the sketches or renderings on the wall with a digital multi-display system. In a nutshell, individuals will upload the outcomes online and display them on the CALM system studio that is composed of 32 LCD (Columns: 4 $\times$ Rows: 8) monitors that are 19 inches in size so that various personnel can openly study the design outcomes. Also the central 42 inch PDP monitor that offers touch pad capability allows each design outcome to be described and examined by expanding. The concept phase of this development process has elevated to the production of an operating prototype that is being reviewed of its practicality. It is considered that the development of this system will decrease the extreme tendency of depending on digital operation but achieve revitalization of a more realistic and opened studio study environment compared to the individual consulting method of the old study approach.