• The Journal of the Korea Contents Association
• /
• v.15 no.12
• /
• pp.8-17
• /
• 2015

This paper presents a sound into color signal conversion using a colored-hearing synesthesia. The aim of the present paper is to implement a real-time conversion system which focuses on both hearing and sight which account for a great part of bodily senses. The proposed method of the real-time conversion of color into sound, in this paper, was simple and intuitive where scale, octave and velocity were extracted from MIDI input signals, which were converted into hue, intensity and saturation, respectively, as basic elements of HSI color model. In experiments, we implemented both the hardware system for delivering MIDI signals to PC and the VC++ based software system for monitoring both input and output signals, so we made certain that the conversion was correctly performed by the proposed method.

• The Journal of the Korea Contents Association
• /
• v.16 no.8
• /
• pp.484-492
• /
• 2016

Role of music in an image can be divided into a supplementary function to express narrative of image and an independent function to become the subject of music and to lead the image. To perceive sound through hearing and then, to make it visualized is called visual music. Since the 19th century, image synchronization of music through colored hearing has been continuously attempted by artists in their works. Also in the 20th century, many artists could attempt time-wise concept of movement passing the bounds of three-dimensional expression due to development of cinema. In such a process, artists with strong experimental spirits inferred correlation between sound and image and then, pioneered new genre of visual music. As a result, the times are being changed from those of listening to those of watching, and various works are being produced by experimental attempt of various music and images. This thesis aims to investigate aesthetic characteristics of modern visual music and then, to conduct comparative analysis on how visual music using colors are utilized in diversified fields such as movie, animation, music video and media art.

• Journal of Korea Multimedia Society
• /
• v.18 no.2
• /
• pp.277-286
• /
• 2015

Recently, to draw the web users' attention and stay in the website for a long time to transmit information efficiently, the website designing is focused on providing emotional experience. Emotional experience is possible through the use of interactive storytelling and multimedia. Users immersion, pleasurable experience and synesthesia satisfaction is connected to the emotional experience due to the interaction operation and multimedia feedback. In this study, application of the parallax scrolling technique's possibility has been studied to induce the emotional experience of the web users that appeared in the technical development of the web. Realizing characteristics of the elements that effect emotional experience through web cases are studied and the possibility of effective emotional experience is proposed as using parallax scrolling technique on web.

• Journal of Korea Multimedia Society
• /
• v.23 no.6
• /
• pp.765-771
• /
• 2020

To enable AI(artificial intelligence) to realize visual emotions, it attempts to create music centered on color, an element that causes emotions in paintings. Traditional image-based music production studies have a limitation in playing notes that are unrelated to the picture because of the absence of musical elements. In this paper, we propose a new algorithm to set the group of music through the average color of the picture, and to produce music after adding diatonic code progression and deleting sound using median value. And the results obtained through the proposed algorithm were analyzed.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2012.01a
• /
• pp.63-64
• /
• 2012

본 논문은 보다 유연하고 추상적인 데이터를 사용자에게 전달하여 스스로가 물체를 인지하고 느낄 수 있도록 하는 공감각 현상에 대하여 연구하고 이 연구 결과를 응용하도록 한다. 오픈소스인 ReacTable을 이용하여 일종의 TAG 역할을 하는 특징적 그림을 명세코드화 한다. 그리고 이를 실제 숫자나 문자 혹은 객체 인식에 응용하도록 한다. 그리하여 시각적인 정보 없이 객체를 인식하고 사용할 수 있는 일상적인 생활이 가능하도록 하였다. 또한 가격이 이용가능성이 많으며 이동성과 휴대성을 동시에 고려한 ZigBee 무선 영상통신 기술을 통하여 영상을 서버나 휴대용단말기에 전송하는 방법을 사용하였다.

• Journal of Science Education
• /
• v.38 no.1
• /
• pp.41-56
• /
• 2014

This study has developed STEAM educational program designed to cultivate topophilia using Jeonbuk educational resources and applied the program to a science camp. Topophilia is a sense of attachment and nostalgia towards one's birth place and specific objects, which can create positive affection and act as motivations for learning to the students. We developed a 32-hour STEAM program which consisted of 8 experiential activities and 2 travel programs including Gochujang, Hanok Village, a reverse ice spikes in Mai Mountain, and art works by Choi Book. In particular, we emphasized the fun of class, voluntary learning, and process of attaching significance by providing aesthetic and emotional experience of synesthesia. As a result of application, the students' level of confidence(Likert scale level 4, 2.5 points) in science and the level of interests(3.3 points) have improved. The pleasant experience of voluntary learning and active participation in class provided meaningful memories through value recognition and significance ascription. 93.3% of the students participated said they would recommend the Topophilia science camp to their peers. The level of satisfaction overall was 3.8 points(Likert scale level 5) and the program received positive evaluations that the class was fun and interesting(4.1 points).

• Korean Institute of Interior Design Journal
• /
• v.22 no.4
• /
• pp.3-14
• /
• 2013

This study is aimed to specify the meaning of the body and the design trends in contemporary architecture. Architecture is based on the human life of various meaning, events, experiences, images, senses and interactions through the body. Thoughts, behaviors, and senses of human are interrelated in architectural experiences. Individuals experience the built environments and space, not through the ideas but through the senses and movements of the body. So, bodies make the real space of architecture. Contemporary architecture accepts the theory of phenomenology and places on the thoughts of Maurice Merleau-Ponty, Heidegger, Nroberg Schulz and so on. Such researches effect on the architectural trends to make design processes works on the programs in views of the expansion and the structuralization of human body. In detail, the aim of this study is to analyse the architecture as the fields of the subject with body as the center, design processes and principles changed form metaphysical thought to phenomenological discourse, and the design trends in contemporary architecture at last. In process of movements, vision centered architecture moves into the bodily experienced architecture and changed the trends from absolute form design to design of relative processes. In conclusion, architectural formation-dissolution-reconstitution of body creates the architectural thoughts such as human proportions, perspective space, ergonomics, modular, organic architecture, experience space, synesthesia, event architecture, fashion-invoked architecture, interactive surfaces, metamorphosis, and others.

• Journal of the Korean Society of Clothing and Textiles
• /
• v.45 no.1
• /
• pp.200-216
• /
• 2021

This article considers short-form fashion videos as distinguished from fashion films, defines the concept, details the expressive characteristics of short-form fashion video, and reveals the method of producing it. For the methodology, a literature review was conducted to derive the concept and expression techniques. A case study was also performed to define the expressive characteristics. Five short-form fashion videos were also produced based on the results. The final results are as follows. First, short-form fashion video was defined as a fashion medium on the purpose of fashion communication within 60 seconds and classified by three digital image formats. Second, the result of analyzing the expression of the short-form fashion video shows the simplicity and reconstitution, characterization and remediation, borderless and expansion, and synesthesia trigger of the fashion image. Third, five short-form fashion videos were produced based on the theme of the digital garden. It shows that the short-form fashion video intensively expresses the content as a medium whose sensational expression is more prominent than the composition of the story by the short running time that reflects the taste of digital mainstream.

• Journal of the Korean Institute of Landscape Architecture
• /
• v.35 no.2 s.121
• /
• pp.37-48
• /
• 2007

An exhibit entitled 'Revelatory Landscapes' was held at the San Francisco Museum of Modem Art from May 5 to October 14, 2001. For this Museum's rot off-site outdoor exhibition, five outstanding design teams-Kathryn Gustafson, Hargreaves Associates, Hood Design, Tom Leader Studio, and ADOBE LA-created site-specific installations in Berkeley, Oakland, San Jose, and the San Francisco Bay Area. Each project showcased a hybridization of environmental art and landscape design. The main content revealed through revelatory landscapes were the natural, cultural, and historical palimpsest of the sites-particularly as related to the history of minorities such as Native American, African Americans and Latin Americans-as well as the every day life of ordinary people. To represent these ideas, a juxtaposition of the past and the present was broadly applied. Furthermore, the use of dramatic colors, textures, and forms in consideration of materials coupled with the revelation of natural elements such as wind and sunlight accelerated the effect of this juxtaposition. Every project of the Revelatory Landscapes exhibit requires a phenomenological experience to be appreciated. Via the five senses, these experiences cause a synesthetic experience beyond solely the visual. By examining the projects of 'Revelatory landscapes', the threshold for a new blending between environmental art and landscape design as well as new landscape design strategies that overcome the dichotomy between nature and culture will change and evolve.

• The Journal of the Convergence on Culture Technology
• /
• v.9 no.6
• /
• pp.545-551
• /
• 2023

In this paper, we present the environment interface as a method of bringing the virtual environment in the interface to reality, and explain the experience of the virtual that can be sensed in the real environment. Expanded experience by discussing the transparency of the interface and interactivity that expands synesthesia as a condition for an interface to express virtual without distinction from the real environment, and establishing a discussion on the composition and inevitability of an environment interface that satisfies these conditions The environment interface is discussed as a tool for realizing the interface that extends from the real environment, the expansion of cognition into the environment by interaction, and the virtual for immersion into the environment due to these conditions.