• International journal of advanced smart convergence
• /
• 제11권2호
• /
• pp.88-94
• /
• 2022

The relationship between sound and vision was experimentally confirmed by physicist Ernst Florens Friedrich Chladni as early as the 18th century and formally entered into systematic research. With the development of emerging media technology, sound reactive type visual content is not limited to a single visual interaction based on the vibration of sound, and its visual content shows a diversified and scalable development trend according to different purposes in many fields. This study analyzes the development and changes of sound visual art contents from early stage to modernization, and analyzes the development characteristic of sound visual art content in different fields and scene environments influence by interactive media, new media technologies and devices by means of case analysis. Through this research, it is expected that the sound reactive type visual art content can continue to develop and extend in the existing fields, while explore the scalability of the application of sound reactive type visual art content in more fields.

• 한국소음진동공학회논문집
• /
• 제21권7호
• /
• pp.629-636
• /
• 2011

In this study, survey experiment and EEG test was carried out to know the effect of visual images on EEG for evaluating words of soundscape sound source with 18 subjects. Analysis on the EEG were executed to know the difference according to with and without visual images. Followings are results of this study. 1) There is no big difference with visual images in soundscape sound evaluating adjectives such as "Full", "Clear", "Enjoyable" whereas there is a big difference in soundscape sound evaluating adjectives such as "Pleasant", "Comfortable", "Gentle", "Sonorous". 2) There is a tendency that soundscape sound source which is consist of single sound source shows + 1 above increase in survey test when visual image is suggested whereas soundscape sound source which is consist of one more sound source shows - 1 below decrease in survey test. 3) Statistical analysis was used to know considerable probability. ${\alpha}$-wave has a considerable probability and Maximum level difference occurring brain spots were number 1 and 2.

• International journal of advanced smart convergence
• /
• 제9권4호
• /
• pp.101-105
• /
• 2020

In this study, we are going to discuss the role of sound, which exists as the background of a movie scene, and the relationship between seeing and hearing. In order to analyze the form in which the scene and sound are matched, the visual content of the image must be analyzed first. In this study, we analyzed Stanley Kubrick's film . Generally, there are both visual and auditory features in the scene of the movie. In some cases, the sound is emphasized more than the scene, and the scene is emphasized more than the sound. In particular, the sound in movies enables a wider imagination and a three-dimensional experience. Images and sounds will have different meanings and effects depending on the purpose of use. By analyzing the correlation between visual scene and auditory sound based on the role sound plays in the film in this study, we would like to confirm that sound is one essential element that has the role of equivalent and independent expression, not the role of assisting images.

• Journal of Audiology & Otology
• /
• 제24권4호
• /
• pp.174-179
• /
• 2020

Background and Objectives: The integration of auditory-visual speech information improves speech perception; however, if the auditory system input is disrupted due to hearing loss, auditory and visual inputs cannot be fully integrated. Additionally, temporal coincidence of auditory and visual input is a significantly important factor in integrating the input of these two senses. Time delayed acoustic pathway caused by the signal passing through digital signal processing. Therefore, this study aimed to investigate the effects of hearing loss and hearing aid digital delay circuit on sound-induced flash illusion. Subjects and Methods: A total of 13 adults with normal hearing, 13 with mild to moderate hearing loss, and 13 with moderate to severe hearing loss were enrolled in this study. Subsequently, the sound-induced flash illusion test was conducted, and the results were analyzed. Results: The results showed that hearing aid digital delay and hearing loss had no detrimental effect on sound-induced flash illusion. Conclusions: Transmission velocity and neural transduction rate of the auditory inputs decreased in patients with hearing loss. Hence, the integrating auditory and visual sensory cannot be combined completely. Although the transmission rate of the auditory sense input was approximately normal when the hearing aid was prescribed. Thus, it can be concluded that the processing delay in the hearing aid circuit is insufficient to disrupt the integration of auditory and visual information.

• 대한전자공학회:학술대회논문집
• /
• 대한전자공학회 2002년도 ITC-CSCC -1
• /
• pp.702-705
• /
• 2002

This paper describes effects of visual information influencing sound localization in the peripheral visual Held under dynamic conditions. Presentation experiments of an audio-visual stimulus were carried out using a movie of a moving patrol car and its siren sound. The tallowing results were obtained: first, the sound image on the timing at the beginning of the presentation was more strongly captured by the visual image than that at the end, i.e., the "beginning effect" was occurred; second, in the peripheral regions, the "beginning effect" was strongly appeared in near the fixation point of eyes.

• 한국디자인학회:학술대회논문집
• /
• 한국디자인학회 2002년도 봄 학술발표회 논문집
• /
• pp.80-81
• /
• 2002

• 대한의용생체공학회:의공학회지
• /
• 제15권1호
• /
• pp.77-82
• /
• 1994

We investigated the characteristic of the sensory motor coordination by measuring the hand point ins and the gaze movement to the visual and sound stimulation. Our results showed that the gaze vol ocity to sound stimulation did not depend on stimulation direction, but lagged behind 0.2 sec toward the pheriperal direction to the visual stimulation. Our data showed that to both visual and sound stimulation, the error of hand pointing value increased with an increasement of eccentricity.

• 정보처리학회논문지B
• /
• 제14B권4호
• /
• pp.273-280
• /
• 2007

본 논문은 2D/3D 가상환경에서 실감 사운드의 실시간 합성을 위한 $EVE-Sound^{TM}$ 툴킷의 설계와 개발결과를 제시한다. $EVE-Sound^{TM}$는 사운드 효과 계산에 필요한 장면요소를 간추리는 전처리 도구와 실시간 렌더링 API들로 구성되며, 다중 모달리티의 실감 재현을 필요로 하는 가상현실, 게임 등의 각종 인터랙티브 콘텐츠에서 사용자에게 고급 그래픽 환경을 허용하면서 동시에 사운드의 실시간 재현을 가능하게 함을 목표로 하였다. 3차원 사운드 계산이 매우 복잡하기 때문에 기존의 사운드 API들이 간단한 사운드 효과와 재생을 제공하는 것과 달리, 복잡한 가상환경에서 3차원 사운드의 원리를 반영하되 그 렌더링을 실시간화하는 데 초점을 두었고, 이를 위해 새로운 장면 간략화 및 공간사운드 계산 방법이 제시되었다. 응용 사례 및 실험, 알고리즘 분석을 통해 제시된 툴킷의 활용성 및 향상된 실시간성을 확인하였다.

• 한국디자인학회:학술대회논문집
• /
• 한국디자인학회 2003년도 봄 학술발표대회논문집
• /
• pp.6-7
• /
• 2003

• 대한의용생체공학회:학술대회논문집
• /
• 대한의용생체공학회 1997년도 추계학술대회
• /
• pp.71-74
• /
• 1997

MR acoustic sound or noise due to gradient pulsings has been one of the problems in MRI, both in patient scanning as well as in many areas of psychiatric and neuroscience research, such as brain fMRI. Especially in brain fMRI, sound noise is one of the serious noise sources which obscures the small signals obtainable from the subtle changes occurring in oxygenation status in the cortex and blood capillaries. Therefore, we have studied the effects of acoustic or sound noise arising in fMR imaging of the auditory, motor and visual cortices. The results show that the acoustical noise effects on motor and visual responses are opposite. That is, for the motor activity, it shows an increased total motor activation while for the visual stimulation, corresponding (visual) cortical activity has diminished substantially when the subject is exposed to a loud acoustic sound. Although the current observations are preliminary and require more experimental confirmation, it appears that the observed acoustic-noise effects on brain unctions, such as in the motor and visual cortices, are new observations and could have significant consequences in data observation and interpretation in future fMRI studies.