• Proceedings of the Korean Society for Emotion and Sensibility Conference
• /
• 2000.04a
• /
• pp.173-178
• /
• 2000

Subjective correspondence among visual variables, auditory variables and vibratory feedback to a hand was experimentally examined to improve usability of a remote controller. First, we studied the correspondence among visual variables represented on a screen or auditory variables and the duration of vibratory stimulus to the subjects' hand by subjective evaluation. Subjective rating method was used in ten items; suitability, comprehensibility, ease-to-use, naturalness, variety, activity, usualness, interest, wish-to-use and feeling of pleasure. Second, to show the effects of multi-modal interface using visual sense, the sense of auditory and vibratory sense, we combined positive stereotype of visual variables and auditory variables provided with the first experiment. The results showed some stereotype between visual variables or auditory variables and duration of vibratory stimulus. Some of the variables such as size, direction of motion, hue, brightness of color and volume of sound had high correspondence with the duration of vibration.

• Journal of the Korean Society for Precision Engineering
• /
• v.24 no.1 s.190
• /
• pp.101-109
• /
• 2007

In situations of spatio-temporal perception about visuo-auditory stimulus, researches propose optimal integration hypothesis that perceptual process is optimized to the interaction of the senses for the precision of perception. So, when the visual information considered generally dominant over any other sense is ambiguous, the information of the other sense like auditory stimulus influences the perceptual process in interaction with visual information. Thus, we performed two different experiments to certain the conditions of the interacting senses and influence of the condition. We consider the interaction of the visuo-auditory stimulation in the free space, the color of visual stimulus and sex difference of testee with normal people. In first experiment, 12 participants were asked to judge the change in the frequency of audio-visual stimulation using a visual flicker and auditory flutter stimulation in the free space. When auditory temporal cues were presented, the change in the frequency of the visual stimulation was associated with a perceived change in the frequency of the auditory stimulation as the results of the previous studies using headphone. In second experiment, 30 male and 30 female were asked to judge the change in the frequency of audio-visual stimulation using a color of visual flicker and auditory flutter stimulation. In the color condition using red and green. Both male and female testees showed same perceptual tendency. male and female testees showed same perceptual tendency however, in case of female, the standard deviation is larger than that of male. This results implies that audio-visual asymmetry effects are influenced by the cues of visual and auditory information, such as the orientation between auditory and visual stimulus, the color of visual stimulus.

• Archives of design research
• /
• v.14 no.2
• /
• pp.15-25
• /
• 2001

With the rapid development of current internet, digital age make human beings intangible. Haptic sense was recognized less important than visual sense and auditory sense, but it plays an important role in determining the quality of products. The goals of this study are embodying haptics using Visual and Auditory preception and designing Visual-Auditory Haptic interface, in the case of actual touching is required but impossible. This study was carried out 3 steps. Firstly, developing the concept of Visual-Auditory Haptic Interface(VAHI) was carried out to make it certain the direction of this study. To get common factors of VAHI, this study researched physical-mechanism of visual, auditory, and haptics senses, and psychological-mechanism. Secondly, identifying factors of V/A haptic sense was analysed by web-evaluation test, to be categorized 11 Emotional Haptic Factors(EHF) and some Design Haptic Factors(DHF). The relation of EHF and DHF was analysed and summarized to VAHI design check sheet. Finally, Applying DHF to VAHI by EHF according to VAHI design check sheet was validated by web-evaluation test, to be resulted 13% increase in reliability and the same in usability. Conclusively, the possibility of embodying haptics using Visual and Auditory preception was resulted to be valid. And this concept can be applied to an interface, such a internet shopping mall and virtual reality, which requires actual touching to perceive haptic information, but it is impossible.

• Journal of Audiology & Otology
• /
• v.24 no.4
• /
• pp.174-179
• /
• 2020

Background and Objectives: The integration of auditory-visual speech information improves speech perception; however, if the auditory system input is disrupted due to hearing loss, auditory and visual inputs cannot be fully integrated. Additionally, temporal coincidence of auditory and visual input is a significantly important factor in integrating the input of these two senses. Time delayed acoustic pathway caused by the signal passing through digital signal processing. Therefore, this study aimed to investigate the effects of hearing loss and hearing aid digital delay circuit on sound-induced flash illusion. Subjects and Methods: A total of 13 adults with normal hearing, 13 with mild to moderate hearing loss, and 13 with moderate to severe hearing loss were enrolled in this study. Subsequently, the sound-induced flash illusion test was conducted, and the results were analyzed. Results: The results showed that hearing aid digital delay and hearing loss had no detrimental effect on sound-induced flash illusion. Conclusions: Transmission velocity and neural transduction rate of the auditory inputs decreased in patients with hearing loss. Hence, the integrating auditory and visual sensory cannot be combined completely. Although the transmission rate of the auditory sense input was approximately normal when the hearing aid was prescribed. Thus, it can be concluded that the processing delay in the hearing aid circuit is insufficient to disrupt the integration of auditory and visual information.

• English & American cultural studies
• /
• v.9 no.1
• /
• pp.113-139
• /
• 2009

Such is an elective affinity between literary studies and psychoanalysis that the latter sometime serves as a form of literary pedagogy. The affinity mainly consists in their shared concern for language. The signification of language in psychoanalysis is much similar to that of literature. Many of psychoanalytic terms and theoretical tenets bear witness to its dependence clinically on speech phenomena and theoretically on language in general. It is most true of Sigmund Freud, for whom the unconscious is in effect the linguistic unconscious. The Freudian unconscious, compressing and displacing through images and ideas, works as a text for psychoanalysis, which approach has not only paved one of the ways to poststructuralist anti-essentialism but with which literary studies also feel uncanny familiarity. Freudian psychoanalysis, starting empirically from clinical observations, discovers that words exist independent of meanings in the form of things in the unconscious system. Out of the various sensory elements of a word-thing, in psychoanalytic terms, the auditory is central. Now with the auditory imagination cultivated in the clinic, Freud figures out compression and displacement as the chief unconscious works, of which my main argument is that they are based phonetically on heteronym and homonym associations respectively. Compression and displacement work to be masks, which excites Freud's sense of challenge: his is a kind of poststructuralist approach, in the sense that the closed interrelatedness of words without external referents determines the signification in a given situation. But the works of compression and displacement, viewed in auditory terms rather than mapped on to metaphor and metonymy, can provide a new insight for a literary reading of Freud. Pursuing Freud's auditory imagination is not only an attempt to read his writing as literary text rather than for theoretical discussion, but also an experiment with the possibility of literary reading of a theoretical text in the age of after-theory.

• Journal of International Academy of Physical Therapy Research
• /
• v.7 no.2
• /
• pp.994-998
• /
• 2016

The purpose of this study was to examine the effects of sensory stimulation type on the learning of the elderly. The study implemented elderly verbal learning test by evenly dividing a total of 40 elderly people into auditory stimulation followed by visual stimulation group(AVG), visual stimulation followed by auditory stimulation group(VAG), simultaneous visual and auditory stimulation group(SG), and auditory stimulation group(AG). The result are as follows. SSG showed highest results in most of the test, followed by AVG, VAG, and AG. In particular, SG showed a statistically significant difference in immediate recall total score and short delay free recall score(p<.05). In the post-hoc test results of immediate recall total score, SG showed highest score with a statistical significance. AVG showed the second highest score, followed by VAG and AG and all showed a statistic significance(p<.05).In the post-hoc test results of short delay free recall score, SG and AVG showed a statistically significantly higher score than AG(p<.05). The results suggest that simultaneous stimulation of visual and auditory sense is more effective for improving the learning of the elderly people than visual stimulation followed by auditory stimulation or auditory stimulation followed by visual stimulation.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.3 no.4
• /
• pp.227-232
• /
• 2002

Electronic Travel Aids (ETA) developed for the blind such as sonicguide, mowat sensor and bionic C-5 laser cane have many problems like technical deficiency and high cost. Moreover, these systems have need for more training to perceive obstacle around. Therefore, In this study, we studied the blind's obstacle perception characteristics by human auditory sense, and development of ultrasonic ETA which have more simple usage, low cost and immediate usableness than present ETAs.

• Korean Journal of Audiology
• /
• v.24 no.4
• /
• pp.174-179
• /
• 2020

Background and Objectives: The integration of auditory-visual speech information improves speech perception; however, if the auditory system input is disrupted due to hearing loss, auditory and visual inputs cannot be fully integrated. Additionally, temporal coincidence of auditory and visual input is a significantly important factor in integrating the input of these two senses. Time delayed acoustic pathway caused by the signal passing through digital signal processing. Therefore, this study aimed to investigate the effects of hearing loss and hearing aid digital delay circuit on sound-induced flash illusion. Subjects and Methods: A total of 13 adults with normal hearing, 13 with mild to moderate hearing loss, and 13 with moderate to severe hearing loss were enrolled in this study. Subsequently, the sound-induced flash illusion test was conducted, and the results were analyzed. Results: The results showed that hearing aid digital delay and hearing loss had no detrimental effect on sound-induced flash illusion. Conclusions: Transmission velocity and neural transduction rate of the auditory inputs decreased in patients with hearing loss. Hence, the integrating auditory and visual sensory cannot be combined completely. Although the transmission rate of the auditory sense input was approximately normal when the hearing aid was prescribed. Thus, it can be concluded that the processing delay in the hearing aid circuit is insufficient to disrupt the integration of auditory and visual information.

• Journal of Korea Multimedia Society
• /
• v.19 no.3
• /
• pp.642-649
• /
• 2016

This paper presents a method for conversion of muscular sense into both visual and auditory senses based on synesthetic perception. Muscular sense can be defined by rotation angles, direction changes and motion degrees of human body. Synesthetic interconversion can be made by learning, so that it can be possible to create intentional synesthetic phenomena. In this paper, the muscular sense was converted into both color and sound signals which comprise the great majority of synesthetic phenomena. The measurement of muscular sense was performed by using the AHRS(attitude heading reference system). Roll, yaw and pitch signals of the AHRS were converted into three basic elements of color as well as sound, respectively. The proposed method was finally applied to a wearable device, Samsung gear S, successfully.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.24 no.5
• /
• pp.462-469
• /
• 2014

As a basic study on both engineering applications and representation methods of synesthesia, this paper aims at building basic system which converts a muscular sense into both visual and auditory elements. As for the building method, data of the muscular sense can be acquired through roll and pitch signals which are calculated from both three-axis acceleration sensor and the two-axis gyro sensor. The roll and pitch signals are then converted into both visual and auditory information as outputs. The roll signals are converted into both intensity elements of the HSI color model and octaves as one of auditory elements. In addition, the pitch signals are converted into both hue elements of the HSI color model and scales as another one of auditory elements. Each of the extracted elements of the HSI color model is converted into each of the three elements of the RGB color model respectively, so that the real-time output color signals can be obtained. Octaves and scales are also converted and synthesized into MIDI signals, so that the real-time sound signals can be obtained as anther one of output signals. In experiments, the results revealed that normal color and sound output signals were successfully obtained from roll and pitch values that represent muscular senses or physical movements, depending on the conversion relationship based on the similarity between color and sound.