• Korean Institute of Interior Design Journal
• /
• v.26 no.4
• /
• pp.12-21
• /
• 2017

This study is on the constructive ways of body perception applied to architecture space. This research also has a purpose of extending the range of possibility of body perception's application. Research on the phenomenological method applied to architecture space was mainly focused on sensation, which made limited awareness on the range of body perception. The scope of body perception includes not only sensation, but also perception, cognition, and human behavior. Therefore this study explicate how operant features of body perception works together. Operant features of body perception are perception as cognition, synesthesia, and Interaction with others. Herzog & de Meuron, Sejima, and R. Koolhaas's works are reviewed to verify these features of body perception.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2011.01a
• /
• pp.277-278
• /
• 2011

공감각(共感覺, synesthesia)은 그리스어에서 유래된 syn + anesthesis 로서 union + no sensation 즉, 결합된 감각이라고 할 수 있다. 즉, 하나의 감각이 다른 영역의 감각을 불러일으키는, 또는 그렇게 일으켜진 감각이라고 정의 한다. 즉 색채의 공감각은 색채와 다름 감각간의 교류 현상이고, 영국의 유전학자인 프란시스 칼톤은 색채의 공감각은 유전이나 선천성에 의해 생겨난다고 하였다. 본 논문에서는 오감에 관련된 색채 공감각의 중요성을 인식하고자 하였고, 또한 오감에 따른 따른 색채를 제시하였다.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2011.10a
• /
• pp.145-148
• /
• 2011

본 논문은 사용자에게 유연하고 추상적인 데이터를 전달하여 사용자 스스로가 물체를 인지하고 '느낄' 수 있도록 공감각 현상에 대한 연구결과를 응용하다. 또한, 오픈소스(ReacTable)를 사용하여 일종의 TAG 역할을 하는 특징적 그림을 명세코드화한 후 이를 실제 숫자나 문자 혹은 객체 인식에 응용하여 시각적인 정보 없이 객체를 인식하고 사용할 수 있는 일상적인 생활이 가능하도록 하였다. 덧붙여 이동성과 휴대성을 고려함과 동시에 저렴하고 이용가능성이 많은 ZigBee 무선 영상통신 기술을 통하여 처리하고자 하는 영상을 실내의 서버나 휴대용단말기에 전송하는 방법을 사용하였다.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.16 no.8
• /
• pp.5683-5694
• /
• 2015

In architecture, Sensibility is the most basic thing in the environmental cognition. Emotion is the phychological or cognitive phenomenon of sensory changes. A cross-causal relationship is formed between the two, and they have a consensus in contact with humans and environment. Sensibility ever to serve as bundle and cognize as mutual superposition. Humans unconsciously perceive through the synesthesia that integrated all the senses. In this study, it has been identified as a result of the study, the architectural design through the sense must be design to the multisensory experience of the emotional design. Depending on the times change, it can know that the gradual changes based on the anthropocentric sense and sensibility. Emotional design in architecture shall ensure that a variety of experience through the multisensory. In this emotional design, multisensory design (or various sensory function) -visual & tactory or visual & auditory etc.- is required beyond the limitation of conventional visual concenturated. Therefore, In order to achieve the demands of the modern social objectives of sympathy or empathy for the human-centered design sensibility, the visual perception as well as a variety of sensory must be recognized that a combination of cognitive and functional. And the application of multisensory design is required to aim the synesthesia cognition.

• Journal of the Korea Society of Computer and Information
• /
• v.13 no.2
• /
• pp.135-141
• /
• 2008

In this paper, we propose colored-hear recognition that distinguishing feature of synesthesia for human sensing by shared vision and specific sense of hearing. We perceived what potential influence of human's structured object recognition by visual analysis through the camera, So we've studied how to make blind persons can feel similar vision of real object. First of all, object boundaries are detected in the image data representing a specific scene. Then, four specific features such as object location in the image focus, feeling of average color, distance information of each object, and object area are extracted from picture. Finally, mapping these features to the audition factors. The audition factors are used to recognize vision for blind persons. Proposed colored-hear transformation for recognition can get fast and detail perception, and can be transmit information for sense at the same time. Thus, we were get a food result when applied this concepts to blind person's case of image recognition.

• Design Convergence Study
• /
• v.19 no.2
• /
• pp.107-122
• /
• 2020

"lux et sonitus" is an audiovisual art exhibition series with an artistic combination of music and video at its center. Since its first introduction in 2013, the series have been held five times under the theme of "exhibition of music", presenting works featuring both audio and visual media in an effort to explore the key issues in the field of audiovisual art. In addition to the previous achievement of the exhibition, recent works from the series feature new concepts that explore the possibility of expanding the realm of synesthesia. In this paper, details of the entire series are summarized. In addition, theoretical background behind creative results of the series is analyzed in the context of music, synesthesia and space found in Nam June Paik's audiovisual artwork as a source of inspiration. This will contribute to establishing a vision for the creation/analysis of audiovisual art in the future.

• Journal of Korea Entertainment Industry Association
• /
• v.13 no.8
• /
• pp.167-180
• /
• 2019

The purpose of this study is to find out the results of synesthesia speech training using similar language for shaping audiobook text. The audiobook text for training uses Tolstoy's work, and uses similar language of tone, tone, pose, speed, intonation, accent, and expression of emotions. The participants who ten visually impaired trainee in H library were selected for qualitative research. Based on the research questions raised in this study, the results are as follows. First, synesthesia training, in which more than two senses of the five senses work simultaneously in voice training for audio book text shaping, produced the result by visualizing the original purpose, meaning, and background of the text. Second, the use of similar language was helpful in the whole process of expressing the meaning of sentence and dialogue for audiobook text shaping. In addition, although there were some differences among the study subjects, they found commonalities that considered tone, pose, and intonation important. Third, the visually impaired have advanced sensory aspects and memory, which resulted in rapid acquisition of metabolism and acceptance of transmission during training. In addition, the teacher's friendly behavior was a very important key mediator in the training process.

• Journal of Korea Multimedia Society
• /
• v.23 no.4
• /
• pp.615-624
• /
• 2020

By enabling musicians to freely control the elements involved in sound production and tone generation with a variety of timbre, synthesizers have revolutionized and permanently changed music since the 1960s. Paik-Abe Video Synthesizer, a masterpiece of video art maestro Nam June Paik, is a prominent example of re-interpretation of this new musical instrument in the realm of video and audio. This article examines Paik-Abe Video Synthesizer as an innovative instrument to play videos from the perspective of audiovisual art, and establishes its aesthetic value and significance through both artistic and technical analysis. The instrument, which embodied the concept of image sampling and real-time interactive video as an image-based multi-channel music production tool, contributed to establishing a new relationship between sound and image within the realm of audiovisual art. The fact that his video synthesizer not only adds image to sound, but also presents a complete fusion of image and sound as an image instrument with musical characteristics, becomes highly meaningful in this age of synesthesia.

• Journal of IKEEE
• /
• v.24 no.1
• /
• pp.254-259
• /
• 2020

This paper is the implementation of the conversion system from image to music based on intentional synesthesia. The input image based on color, texture, and shape was converted into melodies, harmonies and rhythms of music, respectively. Depending on the histogram of colors, the melody can be selected and obtained probabilistically to form the melody. The texture in the image expressed harmony and minor key with 7 characteristics of GLCM, a statistical texture feature extraction method. Finally, the shape of the image was extracted from the edge image, and using Hough Transform, a frequency component analysis, the line components were detected to produce music by selecting the rhythm according to the distribution of angles.

• Journal of Korea Multimedia Society
• /
• v.24 no.5
• /
• pp.727-735
• /
• 2021

The purpose of this study is to evaluate visual arts in interactive technology in art museum applications and to analyze the impact relationship between interactive technology and the five senses. This study was conducted to survey respondents who had used art museum applications. The results are as follows. First, this study evaluates the differences in perception of art museum applications according to the general characteristics of the respondents. They show that there are differences in gender, marital status, age, and social income. Second, this study identifies the impact of five senses and synesthesia on interaction design among emotional design elements. They reveal that visual, auditory, tactile components, and synesthesia have significant effects on interactive design. This study reveals that emotional design elements of art museum applications affect interaction design. Also, it suggests that research on interaction design reflecting five senses is continuously needed to improve audience satisfaction and revitalize art museum applications.