• Transactions of the Korean Society of Mechanical Engineers A
• /
• v.35 no.7
• /
• pp.737-743
• /
• 2011

Service robots are equipped with various sensors such as vision camera, sonar sensor, laser scanner, and microphones. Although these sensors have their own functions, some of them can be made to work together and perform more complicated functions. AudioFvisual fusion is a typical and powerful combination of audio and video sensors, because audio information is complementary to visual information and vice versa. Human beings also mainly depend on visual and auditory information in their daily life. In this paper, we conduct two studies using audioFvision fusion: one is on enhancing the performance of sound localization, and the other is on improving robot attention through sound localization and face detection.

• Journal of Korean Electronics
• /
• v.4 no.9
• /
• pp.31-34
• /
• 1984

• Journal of Korea Multimedia Society
• /
• v.24 no.8
• /
• pp.1171-1177
• /
• 2021

Measuring and evaluation of audience's visual message perception are crucial process for scientific production of visual content. This study tried to evaluate the difference of viewer's awareness of visual object depends on his or her inherent characteristics like conservatism using an eye tracker system. Especially, this experiment tested research questions about positive correlation between conservatism and peoples' eye movements following the sound visual messages. 57 subjects participated in the test. Two different groups were exposed to two visual elements representing 'the conservative' and 'the liberal'. The results showed that people tended to have different way of seeing visual objects according to their inherent characteristics. Also by comparing the gaze time at the object and area of interest(AOI) in visual, this study is able to verify the existence of 'positive way of seeing' and 'negative way of seeing'. The two different ways of seeing have their own trail of eye movement.

• Transactions of the Korean Society for Noise and Vibration Engineering
• /
• v.16 no.4 s.109
• /
• pp.414-419
• /
• 2006

In this research, the test how the evaluation of the spacial image influenced by the environmental friendly elements included in the visual information, and how the selection of the sound changed depending on the characteristics of spacial image were carried out by the 40 subjects. Vast tracts of green land and the waterfront were highly preferred and impressive than the other spaces. The green music, signal with water sound and bird chirping sound were highly scored. In the frequency characteristics of the factors, the first factor was artificial sound (high at the low frequency band), the second was natural sound(uniform at all frequency band) and the third was water sound (high at the middle and high frequency band over 500 Hz) . This shows that the proposal of the sound which has the frequency characteristics fit to the spacial image should be selected for the soundscape of the target space.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.20 no.2
• /
• pp.251-256
• /
• 2010

This paper aims for developing the intelligent robot emulating human synesthetic skills which associate a color image with sound, so that we are able to build an application system based on the principle of mutual conversion between color image and sound. As the first step, in this study, we have tried to realize a basic system using the color image to sound conversion. This study describes a new conversion method to convert color image into sound, based on the likelihood in the physical frequency information between light and sound. In addition, we present the method of converting color image into sound using color model conversion as well as histograms in the converted color model. In the basis of the method proposed in this study, we built a basic system using Microsoft Visual C++(ver. 6.0). The simulation results revealed that the hue, saturation and intensity elements of a input color image were converted into F0, harmonic and octave elements of a sound, respectively. The converted sound elements were synthesized to generate a sound source with WAV file format using Csound toolkit.

• Proceedings of the Korean Society for Noise and Vibration Engineering Conference
• /
• 2003.05a
• /
• pp.622-627
• /
• 2003

Until now, product mostly has revealed physical quantities created by the standpoint of engineers. Consumers, however, perceive and evaluate products on the non-physical characteristics, such as feelings, emotions, and experiences in different social and cultural situations. Especially, for the household appliances fur instance air-conditioner or refrigerator, the sound is heavily related to the satisfaction of a customer who is a real user of the product and is very important factor to decide purchasing as well as visual design. Therefore, in this research, the general tendency of consumer's psychology was investigated for the appliances. And also, in order to obtain clear guidelines for sound manipulation, the characteristics of the sound of air-conditioning systems and refrigerators were compared with others. Since it is important to overcome the discrepancy between engineering and marketing, the relevance of sound manipulation must be documented from the consumer's perspective. That is the reason why we conducted a consumer and marketing oriented study.

• Proceedings of the Korean Society for Noise and Vibration Engineering Conference
• /
• 2006.11a
• /
• pp.616-621
• /
• 2006

A began of this study is to verify Spontaneous Acoustic Field Reproduction System(SAFRS), developed as an embodiment of creating agreeable sound environment, with evaluation on the field application. SAFRS is a system to sense changes of surroundings and produce sounds, which can go well with environment elements sensed by the system in to the space. The sound which can go well with environment elements is sound which judged by individual evaluation to be so, the classification of the preferred sounds according to the mood of the space was suggested in the former study. So, SAFRS was applied into the Square of D University to evaluate effectiveness of the system. The executed evaluations were 1) evaluation on sounds perception, frequency, volume and matchability with the space, 2) image evaluation on the square and sound environment and 3) evaluation on sound environment with existing sounds, fountains sound, sound produced by SAFRS, and both fountains sound and sound produced by SAFRS. Verifying SAPRS of field application was deduced from those evaluations. Theresultsofthestudyarefollowing: Though the system was applied into the space, the volume of the sounds shouldn't be too high. And with visual surroundings, the effectiveness of the system would be increased. At the results of four evaluations, the result of day evaluation is; both fountains sound and sound produced by SAFRS>fountains sound>sound produced by SAFRS>existing sounds, the result of night evaluation is; sound produced by SAFRS>both fountains sound and sound produced by SAFRS>fountains sound>existing sounds and these results pointed out that sounds environment produced by the system was highly evaluated due to less background sounds.

• The Journal of the Korea Contents Association
• /
• v.16 no.8
• /
• pp.484-492
• /
• 2016

Role of music in an image can be divided into a supplementary function to express narrative of image and an independent function to become the subject of music and to lead the image. To perceive sound through hearing and then, to make it visualized is called visual music. Since the 19th century, image synchronization of music through colored hearing has been continuously attempted by artists in their works. Also in the 20th century, many artists could attempt time-wise concept of movement passing the bounds of three-dimensional expression due to development of cinema. In such a process, artists with strong experimental spirits inferred correlation between sound and image and then, pioneered new genre of visual music. As a result, the times are being changed from those of listening to those of watching, and various works are being produced by experimental attempt of various music and images. This thesis aims to investigate aesthetic characteristics of modern visual music and then, to conduct comparative analysis on how visual music using colors are utilized in diversified fields such as movie, animation, music video and media art.

• Proceedings of the Korean Society for Noise and Vibration Engineering Conference
• /
• 2004.11a
• /
• pp.772-777
• /
• 2004

Opera house acoustics were subjectively evaluated in order to investigate the effect of performance stage views on the audience's perception of the seat acoustics in an opera house. Nine seats from an existing opera house were selected for the auditory and/or visual experiments according to seating area distribution and acoustical parameters such as RT and $1-IACC_{E3}$. The recorded music, convolved from the impulse response, was presented with and without visual images of the stage. Subjects were asked to assess the auditory/visual descriptors and overall impression of the music at each seat. The results showed that good visual input helps produce a favorable impression of the acoustics, but a limited view degrades acoustical impression. The acoustical parameters in the tested seats were also investigated to find the relationship between the acoustical parameters and the visual/sound impression.

• 한국HCI학회:학술대회논문집
• /
• 2009.02a
• /
• pp.1145-1149
• /
• 2009

In the 1960s, light art using neon or fluorescent lamp, etc and 'light and space art' appeared with kinetic art. Light art that is an extension of kinetic art tends to be digitalized art and focus on movement, while light and space art emphasizes psychological side and focuses more on phenomenal experience than movement itself. Light art generally tends to offer visual play, but light and space art offers not only visual play but also deep impression on audience's mind. In this paper, LED control method using sound and how color change influences people's mind are studied based on my works try to supplement shortcoming of light art. The main goal of my work is to make more effective and empathic interaction between audience and light in order to avoid cold and mechanical impressions that light art has. Based on its contents, this study seeks method to stimulate people's emotion, and suggests applying mentality on the color and sound interaction together to media art. In conclusion, it is believed that new model of media art is suggested through this study.