• Cartoon and Animation Studies
• /
• s.35
• /
• pp.329-346
• /
• 2014

Art is the product from the combination of politics, economy, and social and cultural aspects. Recent development of digital media has affected on the expansion of visual expression in art. Digital media allow artists to use sound and physical interaction as well as image as an plastic element for making a work of art. Also, digital media help artists create an interactive, synaesthetic and visual perceptive environment by combining viewers' physical interaction with the reconstruction of image, sound, light, and among other plastic elements. This research was focused on the analysis of the relationship between images in art work and the viewer and data visualization using sound from the perspective of visual perception. This research also aimed to develop an interactive art by visualizing physical data with sound generating from outer stimulus or the viewer. Physical data generating from outer sound can be analyzed in various aspects. For example, Sound data can be analyzed and sampled within pitch, volume, frequency, and etc. This researcher implemented a new form of media art through the visual experiment of LED light triggered by sound frequency generating from viewers' voice or outer physical stimulus. Also, this researcher explored the possibility of various visual image expression generating from the viewer's reaction to illusionary characteristics of light(LED), which can be transformed within external physical data in real time. As the result, this researcher used a motif from Piet Mondrian's Broadway Boogie Woogie in order to implement a visual perceptive interactive work reacting with sound. Mondrian tried to approach at the essence of visual object by eliminating unnecessary representation elements and simplifying them in painting and making them into abstraction consisting of color, vertical and horizontal lines. This researcher utilized Modrian's simplified visual composition as a representation metaphor in oder to transform external sound stimulus into the element of light(LED), and implemented an environment inducing viewers' participation, which is a dynamic composition maximizing a synaesthetic expression, differing from Modrian's static composition.

• Journal of Korea Multimedia Society
• /
• v.23 no.1
• /
• pp.67-73
• /
• 2020

This paper analyzed the characteristics of Motion Poster (Moster) and discussed the visual expression methods. To this end, the existing literature on motion posters was organized. The visual representation of motion posters was analyzed by dividing into 'Main Visual', 'Mode of Movement', 'Playtime' and 'Sound'. The analysis results were as follows. As motion posters are kind of movie posters, they are made from the original movie poster images, characters, or scenes of the movie. Graphical representations used either photo-realism or computer realism. The movement methods are 'simple movement of visual elements(movement, gesture and rotation, appear or disappear)+fixed camera movement' or' camera movement (zoom in/out, rotate, move) + fixed visual element movement'. Playback time ranged from about 10 seconds to over 1 minute of video, and the longer the video, the higher the probability of including sound.

• Speech Sciences
• /
• v.15 no.1
• /
• pp.53-62
• /
• 2008

The purpose of this study was to examine the English l sound in an English short story produced by 16 Korean students in order to determine various allophones of the sound using acoustic visual displays and perceptual judgments. The subjects read the story in a quiet office at normal speed. Each word included the lateral sound in onset or coda positions and before a vowel of the following word. Results showed as follows: Firstly, there was a durational difference between the two major groups. Also the majority of the subjects produced the clear l regardless of the contexts. Some students produced the sound as the Korean flap or the English glide [r]. A few missing cases were also seen. The dark l was mostly produced by the subjects of English majors in coda position with a few cases before a vowel in a phrase. Visual displays using the computer analysis were very helpful in distinguishing lateral variants but sometimes perceptual process would be necessary to judge them in fast and weak production of the target word. Further studies would be desirable to test the discrepancies between the acoustical and perceptual decisions.

• Proceedings of the Korean Society for Noise and Vibration Engineering Conference
• /
• 2004.05a
• /
• pp.1018-1021
• /
• 2004

This study is an experimental study to introduce the soundscape design for urban parks. subjective response to soundscape for 4 urban park are carried out using 7 scale S.D. method which are included 25 adjective pairs. In order to recognized the effect environmental sound(bird singing, sweet environmental music, nature sound) for enriching the present sondscape, this study analyse the subject response for soundscape after and before using the environmental sound. The degree of satisfaction for visual atmosphere is higher than for auditory atmosphere of parks, this means that visual clues are much more effective to the environment condition than auditory clues. The effect of using the environmental sound is positive and effective to enrich the soundscape. On providing environmental sounds, it is necessary to consider the charcteristics of urban parks.

• Proceedings of the Acoustical Society of Korea Conference
• /
• 1994.06a
• /
• pp.752-757
• /
• 1994

Very often, one would like to have visual image of mechanical or acoustical events such as musical sound and transient vibrations. Conventional methods to visualize the signal, such as power spectrum, do not normally allow to cultivate the signal of interests due to their inherent limitation on transient signals. Other than the conventional method, one could use an instantaneous frequency which can reveal the variation of frequency in terms of time. Nevertheless it is quite sensitive to noise and can not resolve the frequency components of signals; normally produces additional components other than those of the signals. In this paper, we introduce the Wigner-Ville spectrum to see the transient characteristics of signal, especially musical sound and transient mechanical vibration signatures. For musical sound, several popular western classic music have been selected for the analysis. For the transient mechanical signature, the signals obtained from the car door experiment and the beam experiment are interpreted in terms of Wigner-Ville spectrum. Results demonstrate the visual expressions of transient signals; musical sound and vibrations.

• Journal of the Korea Society of Computer and Information
• /
• v.20 no.8
• /
• pp.53-59
• /
• 2015

Noise from the surrounding environment, building structures and machine equipment have significant effects on daily life. Many solutions to this problem have been suggested by analyzing causes of noise generated from particular locations in general buildings or machine equipment and detecting defects of buildings or equipment. Therefore, this paper suggests a visualization technique of sounds by using the microphone array to measure sound sources from machines and perform the visual machine condition monitoring (VMCM). By analyzing sound signals and presenting effective sound visualization methods, it can be applied to identify machine's conditions and correct errors through real-time monitoring and visualization of noise generated from the plant machine equipment.

• Proceedings of the Korean Society for Noise and Vibration Engineering Conference
• /
• 2003.05a
• /
• pp.1009-1009
• /
• 2003

VIPER a new tool for the VIsual PERception of sound quality and for sound design will be presented. Requirement for the visualization of sound quality is a signal analysis modeling the information processing of the ear. The first step of the signal processing implemented in VIPER, calculates an auditory spectrogram by a filter bank adapted to the time- and frequency resolution of the human ear. The second step removes redundant information by extracting time- and frequency contours from the auditory spectrogram in analogy to contours of the visual system. In a third step contours and/or auditory spectrogram can be resynthesised confirming that only aurally relevant information were extracted. The visualization of the contours in VIPER allows intuitively to grasp the important components of a signal. Contributions of parts of a signal to the overall quality can be easily auralized by editing and resynthesising the contours or the underlying auditory spectrogram. Resynthesis of time contours alone allows e.g. to auralize impulsive components separately from the tonal components. Further processing of the contours determines tonal parts in form of tracks. Audible differences between two versions of a sound can be visually inspected in VIPER through the help of auditory distance spectrograms. Applications are shown for the sound design of several interior noises of cars.

• Speech Sciences
• /
• v.11 no.4
• /
• pp.29-42
• /
• 2004

This paper presents an implementation of real-time speaker localization using audio-visual information. Four channels of microphone signals are processed to detect vertical as well as horizontal speaker positions. At first short-time average magnitude difference function(AMDF) signals are used to determine whether the microphone signals are human voices or not. And then the orientation and distance information of the sound sources can be obtained through interaural time difference. Finally visual information by a camera helps get finer tuning of the angles to speaker. Experimental results of the real-time localization system show that the performance improves to 99.6% compared to the rate of 88.8% when only the audio information is used.

• The Journal of the Korea Contents Association
• /
• v.8 no.6
• /
• pp.121-129
• /
• 2008

With the help of information technology The problem of building a concrete form with a shapeless media is the starting point of presenting information by means of sound. Audio-Visual System using sound as a medium is a method that presents an auditory material visually and has a role of linking different sensory organs. In a sense, Audio-Visual System transfers a non-concrete sensation to a concrete one. Audio-Visual System presentation by late methods using active and non-active images produced by computerized irregular procedures can be limited because of the limited ways of visual output. On the other side, visualization using active images can induce more diverse expressions using sound as a medium. This study suggests a new way of expression in animations using visualization of various auditory materials and sounds built by Audio-Visual System with active images.

• Review of Korea Contents Association
• /
• v.9 no.4
• /
• pp.21-28
• /
• 2011