• Smart Media Journal
• /
• v.10 no.1
• /
• pp.70-78
• /
• 2021

The auditory information is used for urgent notification or warning in vehicle because it is not restricted by the direction compared to the visual. However, since the hearing impaired drivers cannot recognize sound signal, various methods of visualizing the auditory information have been attempted to replace it. When visualizing auditory information, only important information should be selected and provided to prevent cognitive overload concentrated on the vision. For this purpose, analysis of the type of auditory information in vehicle should be given in advance. In this study, the types of auditory information in vehicle were analyzed based on the user experience of hearing impaired drivers. Through the observation of the driving behavior of hearing impaired drivers, 33 auditory informations experienced in vehicle were collected. The collected auditory informations were classified into 12 groups through open card sorting by an expert group, and the types of auditory information in vehicle consisting of four levels were presented through a relative comparison of importance between groups. The presented type of auditory information in vehicle can be used as a guideline for selecting important information when the auditory information is converted into visual or tactile. This study is meaningful in that the user experience analysis was conducted by observing actual driving in daily life of hearing impaired drivers.

• Journal of the Korean Society for Precision Engineering
• /
• v.24 no.1 s.190
• /
• pp.101-109
• /
• 2007

In situations of spatio-temporal perception about visuo-auditory stimulus, researches propose optimal integration hypothesis that perceptual process is optimized to the interaction of the senses for the precision of perception. So, when the visual information considered generally dominant over any other sense is ambiguous, the information of the other sense like auditory stimulus influences the perceptual process in interaction with visual information. Thus, we performed two different experiments to certain the conditions of the interacting senses and influence of the condition. We consider the interaction of the visuo-auditory stimulation in the free space, the color of visual stimulus and sex difference of testee with normal people. In first experiment, 12 participants were asked to judge the change in the frequency of audio-visual stimulation using a visual flicker and auditory flutter stimulation in the free space. When auditory temporal cues were presented, the change in the frequency of the visual stimulation was associated with a perceived change in the frequency of the auditory stimulation as the results of the previous studies using headphone. In second experiment, 30 male and 30 female were asked to judge the change in the frequency of audio-visual stimulation using a color of visual flicker and auditory flutter stimulation. In the color condition using red and green. Both male and female testees showed same perceptual tendency. male and female testees showed same perceptual tendency however, in case of female, the standard deviation is larger than that of male. This results implies that audio-visual asymmetry effects are influenced by the cues of visual and auditory information, such as the orientation between auditory and visual stimulus, the color of visual stimulus.

• Korean Journal of Cognitive Science
• /
• v.20 no.2
• /
• pp.109-124
• /
• 2009

When visual and auditory information is presented simultaneously, we perceive visual information dominantly over auditory information. This effect is called the visual dominance effect. This study was to examine the influence of semantic congruence of visual and auditory information on the visual dominance effect. The semantic congruence of visual and auditory information was manipulated. The results showed that the visual dominance effect obtained in error rates was not modulated by semantic congruence, whereas the effect in RT was. It is suggested that this modulation of the influence of semantic congruence on the visual dominance effect would be due to the task type.

• Journal of Audiology & Otology
• /
• v.24 no.4
• /
• pp.174-179
• /
• 2020

Background and Objectives: The integration of auditory-visual speech information improves speech perception; however, if the auditory system input is disrupted due to hearing loss, auditory and visual inputs cannot be fully integrated. Additionally, temporal coincidence of auditory and visual input is a significantly important factor in integrating the input of these two senses. Time delayed acoustic pathway caused by the signal passing through digital signal processing. Therefore, this study aimed to investigate the effects of hearing loss and hearing aid digital delay circuit on sound-induced flash illusion. Subjects and Methods: A total of 13 adults with normal hearing, 13 with mild to moderate hearing loss, and 13 with moderate to severe hearing loss were enrolled in this study. Subsequently, the sound-induced flash illusion test was conducted, and the results were analyzed. Results: The results showed that hearing aid digital delay and hearing loss had no detrimental effect on sound-induced flash illusion. Conclusions: Transmission velocity and neural transduction rate of the auditory inputs decreased in patients with hearing loss. Hence, the integrating auditory and visual sensory cannot be combined completely. Although the transmission rate of the auditory sense input was approximately normal when the hearing aid was prescribed. Thus, it can be concluded that the processing delay in the hearing aid circuit is insufficient to disrupt the integration of auditory and visual information.

• Journal of Biomedical Engineering Research
• /
• v.25 no.3
• /
• pp.195-200
• /
• 2004

The Auditory Brainstem Response (ABR) with a click stimulation in guinea pigs was used to examine the auditory neuro-pathway from the cochlear nucleus to brain. Using multi-channel active electrodes, the 3-dimensional auditory pathway was examined from the cochlea to the inferior colliculus through the brainstem. These results are similar to the well-known neuro-pathway. This study on the multi-channel ABR shows that the positions of the ABR generators move to the central brain and the contralateral pathway. It is generally agreed that the ABR is generated by some structures along the auditory pathway. This study provides some information on the neuro-pathway where the ABR peak is generated.

• Proceedings of the Korean Society for Noise and Vibration Engineering Conference
• /
• 2006.11a
• /
• pp.41-47
• /
• 2006

In this study, the influences of environmentally friendly visual and auditory information on traffic noise perception were surveyed by the using electroencephalogram Green rural region image and CBD image in urban city were used as visual informations. And traffic noise, signal and environmental music were used to detect the impact on electroencephalogram variance. It was revealed that green rural region image caused a-wave ratio increase about 10% and environmental music increased $\alpha$-wave ratio approximately $40{\sim}50%$. The results of this study improved that environmentally friendly visual and auditory information had an effect on decreasing traffic noise loudness to some extents.

• Transactions of the Korean Society for Noise and Vibration Engineering
• /
• v.17 no.2 s.119
• /
• pp.160-167
• /
• 2007

In this study, the influences of environmentally friendly visual and auditory information on traffic noise perception were surveyed by the using electroencephalogram. Green rural region image and CBD (central business district) image in urban city were used as visual informations. And traffic noise, signal and environmental music were used to detect the impact on electroencephalogram variance. It was revealed that green rural region image caused ${\alpha}-wave$ ratio increase about 10% and environmental music increased ${\alpha}-wave$ ratio approximately $40{\sim}50%$. The results of this study improved that environmentally friendly visual and auditory information had an effect on decreasing traffic noise loudness to some extents.

• Korean Journal of Audiology
• /
• v.24 no.4
• /
• pp.174-179
• /
• 2020

Background and Objectives: The integration of auditory-visual speech information improves speech perception; however, if the auditory system input is disrupted due to hearing loss, auditory and visual inputs cannot be fully integrated. Additionally, temporal coincidence of auditory and visual input is a significantly important factor in integrating the input of these two senses. Time delayed acoustic pathway caused by the signal passing through digital signal processing. Therefore, this study aimed to investigate the effects of hearing loss and hearing aid digital delay circuit on sound-induced flash illusion. Subjects and Methods: A total of 13 adults with normal hearing, 13 with mild to moderate hearing loss, and 13 with moderate to severe hearing loss were enrolled in this study. Subsequently, the sound-induced flash illusion test was conducted, and the results were analyzed. Results: The results showed that hearing aid digital delay and hearing loss had no detrimental effect on sound-induced flash illusion. Conclusions: Transmission velocity and neural transduction rate of the auditory inputs decreased in patients with hearing loss. Hence, the integrating auditory and visual sensory cannot be combined completely. Although the transmission rate of the auditory sense input was approximately normal when the hearing aid was prescribed. Thus, it can be concluded that the processing delay in the hearing aid circuit is insufficient to disrupt the integration of auditory and visual information.

• International Journal of Advanced Culture Technology
• /
• v.4 no.4
• /
• pp.64-69
• /
• 2016

Currently on the school education site, various multimedia contents are used to effectively deliver knowledge to the students and increase interest in class. The majority of the multimedia contents currently used in classes are composed of visual and auditory information. This paper intends to maximize actuality and immersion in the content by adding olfactory information to the existing visual and auditory data. Tangible contents were developed based on the details of aromatic plants learned in the fifth grade of elementary school. The shape and explanation of the aromatic plants are displayed with visual and auditory information, and an aroma spraying application is used to allow the students to smell the aromatic plants. After conducting the class using the developed contents, the students' satisfaction of the class, as well as their overall academic understanding, were investigated. Upon doing so, it was discovered that the students' academic understanding and satisfaction increased in comparison to classes comprised of only visual and auditory contents.

• Archives of design research
• /
• v.20
• /
• pp.123-132
• /
• 1997

These days we live in society which the expanion and variety f information continuse with the evolution of technology. However, because much information exists in a black box, we have difficulty in using information embodied in products. For example, companies do not consider that much the position of users in using information and they thnd to tely too much on LCDs. But the limitation of monitors' screen and the tendency of miniaturization cause users some burden in obtaining visual information. Accordingly, the objective of this paper is to study an extent to which the auditory information is able to support userinterface, to compare it with the visual information, and eventually to find the way of suing auditory information as a means of expression.