• Journal of Korea Entertainment Industry Association
• /
• v.10 no.4
• /
• pp.77-92
• /
• 2016

In this study, the relationship of images and sounds of the animations "Dots" and "Loops" which Norman McLaren animated with his Animated sound technique when he worked at Guggenheim museum at New York, are analyzed through the audiovisual analysis theory by Michel Chion, and through the theory of synchronism/asynchronism and parallelism/counterpoint by Siegfried Kracauer. For the results of the analysis, there are a few difference between "Dots" and "Loops" regarding the aspect of sound arrangement and expressive aspect of abstract animation. However, there are being of two main elements of sound, composing with monophony sound, making musical structure with sound effects, and the emphasizing of parallelism with synchronization bewteen images and sounds in common with both "Dots" and "Loops". In "Dots" and "Loops", there are close correlations between pitch of sound and arrangement/shape of image, between loudness of sound and size of image, and between length of sound and length/shape of image. The image and sound of "Dots" and "Loops" have equal relationship each other, rather than subordinate relationship according as image become sound and the sound become new image with the animated sound technique. "Dots" and "Loops" show tendency of minimal art and music video. Since these two films, and remind about the new approach to sound creation in today's animation production.

• The Journal of the Acoustical Society of Korea
• /
• v.30 no.3
• /
• pp.142-148
• /
• 2011

The final aim of the present study is to develop the intelligent robot, emulating human synesthetic skills which make it possible to associate a color image with a specific sound. This can be done on the basis of the mutual conversion between color image and sound. As a first step of the final goal, this study focused on a basic system using a conversion of color image into sound. This study describes a proposed method to convert color image into sound, based on the likelihood in the physical frequency information between light and sound. The method of converting color image into sound was implemented by using HSI histograms through RGB-to-HSI color model conversion, which was done by Microsoft Visual C++ (ver. 6.0). Two different color images were used on the simulation experiments, and the results revealed that the hue, saturation and intensity elements of each input color image were converted into fundamental frequency, harmonic and octave elements of a sound, respectively. Through the proposed system, the converted sound elements were then synthesized to automatically generate a sound source with wav file format, using Csound.

• Cartoon and Animation Studies
• /
• s.20
• /
• pp.87-104
• /
• 2010

Animation creates meaning and affection by combinig image and sound like film. directed by Yuri Norstein is a good text for analyzing animation sound in that it combines image and various music and sound effects well. This study focuses on analyzing the way that sound function to make meaning in this text. Generally sound is categorized into dialogue, music, and sound effect. And animation has its own characteristic in each category. The voice for dialogue is created corresponding to the image of the character and the rhythm is very important in Animation. Plus Sound effect in animation can be said to mimic not just sound but also movement. This study analyzes sound based on three sound factors and the concepts of the point of listening, subjective sound, and sound bridge. Subjective sound using the point of listening of the wolf and the baby bestows a special position on the main characters in the text. It is the overall characteristic of the sound use of this text that the repetitive combination of sound and image, the linguistic and annotative function of sound effect, and comparatively conventional use of music and sound effect enhance the affection and readability.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2007.11a
• /
• pp.121-123
• /
• 2007

현재까지 유해한 컨텐츠(Contents)를 차단하기 위한 활발한 연구가 있었으나, 사람의 사운드(sound)와 이미지(image)를 통합한 필터링(filtering) 기법에 대한 연구는 활발히 이루어지지 않은 측면이 있다. 본 논문은 이미지(image) 데이터 중 피부색 분포 비율과 사운드(sound) 데이터 중 주파수 분석을 통한 심층적인 기법을 활용하여 현재까지 진행되고 있는 이미지 필터링(image filtering)방법에 대한 수행 결과보다 획기적으로 개선된 성능을 보이고자 한다. 즉, 사운드와 이미지의 특징 정보를 이용한 성인 컨텐츠(Adult Contents)분류 기법을 활용하는 것으로 성인 컨텐츠(Adult Contents)에서 두드러지는 특징을 보이는 사운드 패턴을 분석하여 현재까지 한정된 자원인 이미지만을 활용한 기법보다는 현저한 향상된 수행능력을 예측해 볼 수 있다.

• Journal of Digital Convergence
• /
• v.14 no.7
• /
• pp.331-337
• /
• 2016

The purpose of this study is to provide a method to visualize the sound data to the three-dimensional image. The visualization of the sound data is performed according to the algorithm set after production of the text-based script that form the channel range of the sound data. The algorithm consists of a total of five levels, including setting sound channel range, setting picture frame for sound visualization, setting 3D image unit's property, extracting channel range of sound data and sound visualization, 3D visualization is performed with at least an operation signal input by the input device such as a mouse. With the sound files with the amount an animator can not finish in the normal way, 3D visualization method proposed in this study was highlighted that the low-cost, highly efficient way to produce creative artistic image by comparing the working time the animator with a study presented method and time for work. Future research will be the real-time visualization method of the sound data in a way that is going through a rendering process in the game engine.

• Science of Emotion and Sensibility
• /
• v.15 no.2
• /
• pp.231-238
• /
• 2012

This study aims for building an application system of converting sound into color image based on synesthetic perception. As the major features of input sound, both scale and octave elements extracted from F0(fundamental frequency) were converted into both hue and intensity elements of HSI color model, respectively. In this paper, we used the fixed saturation value as 0.5. On the basis of color model conversion theory, the HSI color model was then converted into the RGB model, so that a color image of the BMP format was finally created. In experiments, the basic system was implemented on both software and hardware(TMS320C6713 DSP) platforms based on the proposed sound-color image conversion method. The results revealed that diverse color images with different hues and intensities were created depending on scales and octaves extracted from the F0 of input sound signals. The outputs on the hardware platform were also identical to those on the software platform.

• Cartoon and Animation Studies
• /
• s.36
• /
• pp.469-491
• /
• 2014

Webtoon has developed the method that makes it possible to express sound visually. Also we can also hear sound in webtoon through the development of web technology. It is natural that we analyze the sound that we can hear, but we can also analyze the sound that we can not hear. This study is based on 'dual code' in cognitive psychology. Cartoonists can make visual expression on the basis of auditive impression and memory, and readers can recall the sound through the process of memory and memory-retrieval. This study analyzes both audible sound and inaudable sound. Concise analysis owes the method to film sound theory. Three main factor, Volume, pitch, and tone are recognized by frequency in acoustics. On the other hand they are expressed by the thickness and site of line and image of sound source. The visual expression of in screen sound and off screen sound is related to the frame of comics. Generally the outside of frame means off sound, but some off sound is in the frame. In addition, horror comics use much sound for the effect of genre like horror film. When analyzing comics sound using this kinds of the method film sound analysis, we can find that webtoon has developed creative expression method comparing with simple ones of early comics. Especially arranging frames and expressing sound following and vertical moving are new ones in webtoon. Also types and arrangement of frame has been varied. BGM is the first in using audible sound and recently BGM composed mixing sound effect is being used. In addition, the program which makes it possible for readers to hear sound according to scroll moving. Especially horror genre raise the genre effects using this technology. Various methods of visualizing sound are being created, and the change shows that webtoon could be the model of convergence in contents.

• The Journal of the Korea Contents Association
• /
• v.14 no.11
• /
• pp.50-59
• /
• 2014

A basic role of sound is to give realism to the expressions on the screen or to highlight the images using exaggerated effect as a supporting role. In that way, sound effect makes it possible for audiences to naturally understand realistic images. However, the sound effect in movies is not real 'sound' in fact. Rather, sound effect is a separate cinematic tool that needs a separate direction to manipulate sounds in order to create appropriate effects for particular intention in the movie. While watching the movie, the audiences go through unique experience where they comprehend the manipulated world as the real world. Therefore, direction for sound effect must help deliver realism to the images by auditory factors. Thus, effective sound direction shall have precise and independent design for identification, reason and eurythmical match with the screen and occurred sounds shall be designed based on the subjective listening point to see who is actually listening.

• The Journal of the Korea Contents Association
• /
• v.18 no.8
• /
• pp.82-91
• /
• 2018

This paper examines the sound of Godard's <$Pr{\acute{e}}nom$ Carmen> from Deleuze's film aesthetics and Merleau-Ponty's phenomenological point of view. The rehearsal scene of a string quartet is a mirror-image that illuminates the music itself, and becomes a crystal-image with the indiscernibility of the present and the past in the break with the main narrative. On the other hand, urban noise and waves are the seeds composed of pure optical (sound) images and grow into pure sound crystals that collide with what is seen through the juxtaposition, substitution, and intentional connection of sound. However, these sound contradictions also lead to the integrated sound category as a 'sole movement' through Merleau-Ponty's dialectical thought, and even the dialectical sound management of pop and classical music is no longer a confrontation of the genre, but is integrated into the materialistic category of sound. This study is differentiated from the existing research by solving the sound aesthetics of the Godard's film through philosophical thought.

• Science of Emotion and Sensibility
• /
• v.10 no.4
• /
• pp.613-622
• /
• 2007

Recently, sound design is being made by corporations for the production as well as for marketing and web with consideration of image of productions and attributes to improve corporational image through the design of melody which would remain in users. And sound is becoming an important factor to establish the identity of each area such as life environment and public facilities. At present, our local governments are promoting active business like as CIP to improve urban image but there is a limit to establish identity as the result of its partial focus on visual sense or insufficient recognition about it. Jeonju, the place of sound, has many festivals and great meetings related with sound but it has not identity in the sense of sound. So the purpose of this study is to suggest the condition of sound which has the trait of Jeonju and to provide data for the trait to be used as a necessary element to establish identity in order to activate regional image. For the method of research, sampling Korean beautiful 100 sounds among the natural sounds of residents. most favorite as the samples of sound to search the sound of regional image. Selecting favorite samples among them and analyzed the factors through the questionnaire on the image of adjective in each sample. As the result of analysis, it has been shown that the factor of sound to reveal trait of Jeonju is the image of bright, delight, and cozy with consideration of harmony, dynamics, contrast, and culture. For this study is to provide data so it can be used to actively establish and identify the local image.