• Cartoon and Animation Studies
• /
• s.35
• /
• pp.329-346
• /
• 2014

Art is the product from the combination of politics, economy, and social and cultural aspects. Recent development of digital media has affected on the expansion of visual expression in art. Digital media allow artists to use sound and physical interaction as well as image as an plastic element for making a work of art. Also, digital media help artists create an interactive, synaesthetic and visual perceptive environment by combining viewers' physical interaction with the reconstruction of image, sound, light, and among other plastic elements. This research was focused on the analysis of the relationship between images in art work and the viewer and data visualization using sound from the perspective of visual perception. This research also aimed to develop an interactive art by visualizing physical data with sound generating from outer stimulus or the viewer. Physical data generating from outer sound can be analyzed in various aspects. For example, Sound data can be analyzed and sampled within pitch, volume, frequency, and etc. This researcher implemented a new form of media art through the visual experiment of LED light triggered by sound frequency generating from viewers' voice or outer physical stimulus. Also, this researcher explored the possibility of various visual image expression generating from the viewer's reaction to illusionary characteristics of light(LED), which can be transformed within external physical data in real time. As the result, this researcher used a motif from Piet Mondrian's Broadway Boogie Woogie in order to implement a visual perceptive interactive work reacting with sound. Mondrian tried to approach at the essence of visual object by eliminating unnecessary representation elements and simplifying them in painting and making them into abstraction consisting of color, vertical and horizontal lines. This researcher utilized Modrian's simplified visual composition as a representation metaphor in oder to transform external sound stimulus into the element of light(LED), and implemented an environment inducing viewers' participation, which is a dynamic composition maximizing a synaesthetic expression, differing from Modrian's static composition.

• MALSORI
• /
• no.59
• /
• pp.89-99
• /
• 2006

This paper proposes a new structural head-related transfer function(HRTF) model to produce sounds in a virtual environment. The proposed HRTF model generates 3-D sounds by using a head model, a pinna model and the proposed distance model for azimuth, elevation, and distance that are three aspects for 3-D sounds, respectively. In particular, the proposed distance model consists of level normalization block distal region model, and proximal region model. To evaluate the performance of the proposed model, we setup an experimental procedure that each listener identifies a distance of 3-D sound sources that are generated by the proposed method with a predefined distance. It is shown from the tests that the proposed model provides an average distance error of $0.13{\sim}0.31$ meter when the sound source is generated as if it is 0.5 meter $\sim$ 2 meters apart from the listeners. This result is comparable to the average distance error of the human listening for the actual sound source.

• Journal of Korea Game Society
• /
• v.11 no.2
• /
• pp.29-37
• /
• 2011

As a field in Digital Arts, interactive video introduced the mirror metaphor to the foundation of media, given its characteristic as a medium that extracts an audience image in a particular perspective. The interactive video work introduced in this paper addresses conceptual topics in the extension of Zhuangzi's Butterfly Dream and illustrates the technological approaches that employ an intensity-based computer vision processing in order to obtain the silhouette of audience for multiple graphical butterflies to draw an audience image. Users generate narratives in the interaction with the projected image. Sound is used in order for the system to provide augmented perception in the space and to add more rooms for narratives. The computer vision and the graphics methods introduced in this paper are suggested as tools for interactive video.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2018.07a
• /
• pp.439-440
• /
• 2018

본 논문에서는 제작한 가상현실 게임의 소개와 적용기술에 대해여 논한다. HTC VIVE를 이용하여 강력한 주요 게임 개발엔진 중 하나인 Unreal engine4를 이용하여 쉽게 접근 할 수 있는 VR 리듬게임 구현을 목적으로 한다. 플랫폼의 한계의 벗어나 HUD로 좀 더 현실감과 몰입을 요구하는 게임개발을 목표로 리듬감 증진 혹은 운동효과도 기대할 수 있다. 사운드 플러그를 이용하여 주파수별 스펙트럼을 시각화하여 재생되는 음원중 스펙트럼 값이 조건을 만족하면, 노트가 자동으로 생성되고 일정 시간이 경과한 후 사라지거나, 플레이어가 타격하여 점수를 획득 하는 방식으로 진행되며, 플레이어가 노트를 맞을 경우 체력값이 단계별로 낮아져 게임이 종료된다. 더 많은 곡과 맵을 추가하여 흥미소요를 늘릴 수 있으며, 단순타격이 아닌 조건이나 임무를 부여 다양성과 복잡함을 추가해 낮은 접근성과 높은 정복성을 가질 수 있다.

• The Journal of the Acoustical Society of Korea
• /
• v.30 no.5
• /
• pp.255-264
• /
• 2011

The Head Related Transfer Function (HRTF) means a process related to acoustic transmission from 3d space to the listener's ear. In other words, it contains the information that human can perceive locations of sound sources. So, we make virtual 3d sound using HRTF, despite it doesn't actually exist. But, it can deteriorate some three-dimensional effect by the confusion between front and back directions due to the non-individual HRTF depending on each listener. In this paper, we proposed the new algorithm to reduce the confusion of sound image localization using human's acoustic characteristics. The frequency spectrum and global masking threshold of 3d sounds using HRTF are used to calculate the psychoacoustical differences among each directions. And perceptible cues in each critical band are boosted to create effective 3d sound. As a result, we can make the improved 3d sound, and the performances are much better than conventional methods.

• Journal of Platform Technology
• /
• v.10 no.4
• /
• pp.39-46
• /
• 2022

Recently, digital contents including video and sound are created in various fields, transmitted to the cloud through the Internet, and then stored and used. In order to utilize digital content, it is essential to verify data integrity, and it is necessary to ensure network bandwidth efficiency of verified data. This paper describes the design and implementation of a server that maintains, manages, and provides data for verifying the integrity of video data. The server receives and stores image data from Logger, a module that acquires image data, and performs a function of providing data necessary for verification to Verifier, a module that verifies image data. Then, a lightweight Merkle tree is constructed using the hash value. The light-weight Merkle tree can quickly detect integrity violations without comparing individual hash values of the corresponding video frame changes of the video frame indexes of the two versions. A lightweight Merkle tree is constructed by generating a hash value of digital content so as to have network bandwidth efficiency, and the result of performing proof of integrity verification is presented.

• The Journal of the Convergence on Culture Technology
• /
• v.7 no.2
• /
• pp.85-95
• /
• 2021

Currently, we stand between computers as creative tools and computers as creators. A new genre of movies, which can be called a post-cinema situation, is emerging. This paper aims to diagnose the possibility of the emergence of AI cinema. To confirm the possibility of AI cinema, it was examined through a case study whether the creation of a story, narrative, image, and sound, which are necessary conditions for film creation, is possible by artificial intelligence. First, we checked the visual creation of AI painting algorithms Obvious, GAN, and CAN. Second, AI music has already entered the distribution stage in the market in cooperation with humans. Third, AI can already complete drama scripts, and automatic scenario creation programs using big data are also gaining popularity. That said, we confirmed that the filmmaking requirements could be met with AI algorithms. From the perspective of Manovich's 'AI Genre Convention', web documentaries and desktop documentaries, typical trends post-cinema, can be said to be representative genres that can be expected as AI cinemas. The conditions for AI, web documentaries and desktop documentaries to exist are the same. This article suggests a new path for the media of the 4th Industrial Revolution era through research on AI as a creator of post-cinema.

• The Journal of the Korea Contents Association
• /
• v.17 no.11
• /
• pp.82-89
• /
• 2017

This paper intends to examine how North Korea has incited and persuaded its people by figuring out the structure regarding the meaning creation of its documentary film "Kim Jong-un, the Respected Comrade Supreme Commander, Giving On-site Guidance on the Grand Project of the People's Army" produced in 2015, which was North Korea's politically important year. The analysis results show that its narrative structure of the film took the form of an introduction, body, and conclusion to substantiate it obviously given theme. Its imaging techniques are geared towards uplifting the public's combat mentality and its sound contributes to achieving their adherence. In this regard, its film literature has the following meaning structure: first, the film takes the form of both film annals and the structure for the public to easily comprehend; second, the film clearly demonstrates its deep-rooted theme asking for the public to follow in the footsteps of the party's late father for its leadership; and third, the film also aims to establish the images of an always awake working leader by implanting and arranging the leader's diligence about his revolutionary activities in the documentary film. North Korea's documentary films serve as a weapon used for instigating revolution and construction. Given this, the producers of all documentary films have made sure to turn film literatures into the film literatures of the great leader. It was identified that under the social vision that the Kim Jong-un regime is a "socialist civilized country", he has tightened his grip on power in North Korea through the propaganda tool of film literatures.

• The Journal of the Korea Contents Association
• /
• v.11 no.4
• /
• pp.164-176
• /
• 2011

To get an implication for desirable direction for Collaboration between Reporter & Producer, I found that had 4 modes of collaboration such as, Producer System, Reporter System, Double Reporting System, Co-Work System, and each was distinguished by field cover, on-mic, editing, writing. Producer system and Reporter system got no chemical synergy because of simple array of single reports due to physical assemble. The achievements of collaboration was birth of new news which had different duration, visual, sound & perspective. It also offered fertile soil for new program and genre literacy of 8 o'clock news. The success factor of collaboration was surprisingly turned out to be personnel rather than system. The balance of reporter & producer was also good factor. But the wall between 2 groups was so high that, after disappearance of extraordinary leader, system began to crumble and at last program was repealed.

• Archives of design research
• /
• v.18 no.2 s.60
• /
• pp.211-218
• /
• 2005

As digital Information equipment is new arrival, new paradigm such as 'function exist but form don't' is needed in the field of design. Therefore, the activity of design is focused on the relationship of human and machine against visual form. For that reason, it is involved emotional factor in the relationship and studied on new field, the emotional interlace. The goal of this paper is to suggest the way of emotional interface on searching multimedia data. The main target of paper is effect sound and human's step and the main way of research is visualization after measuring and analyzing numerically similarity level among emotion-words. This paper suggests the theoretical bad(ground such as personal opinion, the character of auditory information and human's step and case studies on the emotion research. The experimental content about sound is fueled from my previous research and the main experimental content about human's step is made with regression-expression to substitute Quantification method 1 for value about stimulation. The realistic prototype to apply the research result will is suggested on the next research after studying the search environment.