• Journal of Korea Multimedia Society
• /
• v.19 no.3
• /
• pp.642-649
• /
• 2016

This paper presents a method for conversion of muscular sense into both visual and auditory senses based on synesthetic perception. Muscular sense can be defined by rotation angles, direction changes and motion degrees of human body. Synesthetic interconversion can be made by learning, so that it can be possible to create intentional synesthetic phenomena. In this paper, the muscular sense was converted into both color and sound signals which comprise the great majority of synesthetic phenomena. The measurement of muscular sense was performed by using the AHRS(attitude heading reference system). Roll, yaw and pitch signals of the AHRS were converted into three basic elements of color as well as sound, respectively. The proposed method was finally applied to a wearable device, Samsung gear S, successfully.

• Science of Emotion and Sensibility
• /
• v.16 no.2
• /
• pp.187-194
• /
• 2013

The final aim of the present study is to build a system of converting a color image into musical elements based on a synesthetic perception, emulating human synesthetic skills, which make it possible to associate a color image with a specific sound. This can be done on the basis of the similarities between physical frequency information of both light and sound. As a first step, an input true color image is converted into hue, saturation, and intensity domains based on a color model conversion theory. In the next step, musical elements including note, octave, loudness, and duration are extracted from each domain of the HSI color model. A fundamental frequency (F0) is then extracted from both hue and intensity histograms. The loudness and duration are extracted from both intensity and saturation histograms, respectively. In experiments, the proposed system on the conversion of a color image into musical elements was implemented using standard C and Microsoft Visual C++(ver. 6.0). Through the proposed system, the extracted musical elements were synthesized to finally generate a sound source in a WAV file format. The simulation results revealed that the musical elements, which were extracted from an input RGB color image, reflected in its output sound signals.

• Korean Institute of Interior Design Journal
• /
• v.22 no.5
• /
• pp.11-21
• /
• 2013

The development of modern industry and the production of new materials of architecture have recognized as an important aspect. This study intended to discuss about the meaning of main elements of the architecture materials, its implications for properties, and, highlighted meaning of the properties of modern interior design. The purpose of this study is to analyze the case studies of Place and Physical materials of synaesthesia of modern architecture as well as modern architecture is not only concentrated in the visual aspect but also the larger ramifications of sensory. Synesthesia in architectural space can be called experiential existence that built in the space of human perception and based on the human emotion that targeted by physical architectural space. Accordingly, these case studies are to consider about how the materials being passed by any effect in a modern interior space presented, In order to find the essential meaning in modern interior space, this studies focused on Swiss architect Peter Zumthor's cases. Following analyze of Peter Zumthor's place of architectural space and materials, this study structured by the six kinds of synesthesia characters. First, time and remember to infer changes, Second, traditional and regional ingredients involve the substitution of one empirical space, Third, non-materiality through the neutralization, Fourth, auditory memory through the embodiment of everydayness, Fifth, trail through the sense of smell for the presence, Sixth, the relationship of natural and industrial products. Peter Zumthor's characteristics of these works are result of factors on the synesthetic relationship with the human response to architecture, the five senses, memories, experiences, and temperature. Also it is a synesthetic result of all human emotion to clarify of the architecture materials and non-material mediums by which light by a compound.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.24 no.5
• /
• pp.462-469
• /
• 2014

As a basic study on both engineering applications and representation methods of synesthesia, this paper aims at building basic system which converts a muscular sense into both visual and auditory elements. As for the building method, data of the muscular sense can be acquired through roll and pitch signals which are calculated from both three-axis acceleration sensor and the two-axis gyro sensor. The roll and pitch signals are then converted into both visual and auditory information as outputs. The roll signals are converted into both intensity elements of the HSI color model and octaves as one of auditory elements. In addition, the pitch signals are converted into both hue elements of the HSI color model and scales as another one of auditory elements. Each of the extracted elements of the HSI color model is converted into each of the three elements of the RGB color model respectively, so that the real-time output color signals can be obtained. Octaves and scales are also converted and synthesized into MIDI signals, so that the real-time sound signals can be obtained as anther one of output signals. In experiments, the results revealed that normal color and sound output signals were successfully obtained from roll and pitch values that represent muscular senses or physical movements, depending on the conversion relationship based on the similarity between color and sound.

• Science of Emotion and Sensibility
• /
• v.15 no.2
• /
• pp.231-238
• /
• 2012

This study aims for building an application system of converting sound into color image based on synesthetic perception. As the major features of input sound, both scale and octave elements extracted from F0(fundamental frequency) were converted into both hue and intensity elements of HSI color model, respectively. In this paper, we used the fixed saturation value as 0.5. On the basis of color model conversion theory, the HSI color model was then converted into the RGB model, so that a color image of the BMP format was finally created. In experiments, the basic system was implemented on both software and hardware(TMS320C6713 DSP) platforms based on the proposed sound-color image conversion method. The results revealed that diverse color images with different hues and intensities were created depending on scales and octaves extracted from the F0 of input sound signals. The outputs on the hardware platform were also identical to those on the software platform.

• Journal of the Korean Institute of Landscape Architecture
• /
• v.33 no.5 s.112
• /
• pp.1-14
• /
• 2005

This study describes the recognition and the application of materials corresponding to the formative language of landscape design as the formative process of creating connote forms and meanings in a space. The purpose of this study is to propose the significance of materiality not only for conveying the meaning of landscape but also for providing expanded experience through synesthetic perception. The study consists of two parts: (1) The concept of materiality in landscape architecture is studied in three categories, which are divided in chronological order when the recognition of materials was changed. (2) Based on this exploration of the concept of materiality and the ways of expressing it that have developed from landscape arts to landscape architecture, the significance of materiality as the medium of contemporary landscape design is proposed. Breaking from previous technical and engineering approaches to materials and from a vision-centered recognition of materials, this study focuses on aesthetic and semantic aspects of materiality and is based on multidimensional recognition though synesthesia. Materiality has significance not only as the dynamic medium that carries the meaning of landscape by providing connections with the surrounding environmental context, but also as the engagement medium that expands observers' experiences with the environment through synesthesia. The study of materiality as the medium of landscape design would contribute to expanding the scope of the language of landscape design and to expressing the meaning of landscape through materiality being revealed on the basis of converted recognition of materials.

• The Journal of the Korea Contents Association
• /
• v.15 no.12
• /
• pp.8-17
• /
• 2015

This paper presents a sound into color signal conversion using a colored-hearing synesthesia. The aim of the present paper is to implement a real-time conversion system which focuses on both hearing and sight which account for a great part of bodily senses. The proposed method of the real-time conversion of color into sound, in this paper, was simple and intuitive where scale, octave and velocity were extracted from MIDI input signals, which were converted into hue, intensity and saturation, respectively, as basic elements of HSI color model. In experiments, we implemented both the hardware system for delivering MIDI signals to PC and the VC++ based software system for monitoring both input and output signals, so we made certain that the conversion was correctly performed by the proposed method.

• Korean Institute of Interior Design Journal
• /
• v.23 no.1
• /
• pp.143-151
• /
• 2014

Nowadays, space branding becomes more important since it reflects and synthesizes the diverse experiences of the consumer. The objective of the research is to present the new possibilities that space branding offers by analyzing the brand strategy and the design characteristics of branded hotels, which are being projected as constructed branded environments. By integrating the brand with visible or invisible elements of the hotel, such as unique space planning, service, and consumer experience, a branded hotel can be a good vehicle to reflect fast changing consumer lifestyles and trends; it enables the consumer to experience brands in his or her everyday life, and it conveys the overall image of the brand by considering the consumer's multi-sensual experiences. The study processed with theoretical research which is related to the hotel space and branded environment. Four brands were selected with distinct business area and brand strategy, and studied to analyze the strategy and the characteristics of the branded environment in a branded hotel. In particular, the case study attempted to evaluate the distinctiveness of the branded hotel's spatial design by comparing each brand's representative flagship store with the hotel. As a result, four characteristics of branded environments in branded hotels were identified, namely, strengthen brand image, consistent brand strategy, extend brand perception, spatialize brand experience. Armani emphasizes their consistent brand image by applying similar design methods in both retail stores and hotel spaces. IKEA, in contrast, applies not their design identity but their brand concepts like practicality, efficiency, and low prices. Pantone gives an expanded brand experience by using synesthetic sensual stimulation using their color system. Missoni mixes and composes their patterns and materials in a three-dimensional manner and strengthens design possibilities and spatiality. This study suggests specific design methods to construct a branded environment in a branded hotel and offers new strategic directions for space branding.