• Title/Summary/Keyword: Auditory Interaction

Search Result 61, Processing Time 0.035 seconds

Speech signal processing in the auditory system (청각 계통에서의 음성신호처리)

  • 이재혁;심재성;백승화;박상희
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1987.10b
    • /
    • pp.680-683
    • /
    • 1987
  • The speech signal processing in the auditory system can be analysized based on two representations : Average discharge rate and Temporal discharge pattern. But the average discharge rate representation is restricted by the narrow dynamic range because of the rate saturation and the two tone suppression phenomena, and the temporal discharge pattern representation needs a sophisticate frequency analysis and synchrony measure. In this paper, a simple representation is proposed : using a model considering the interaction of Cochlear fluid-BM movement and a haircell model, the feature of speech signals (formant frequency and pitch of vowels) is easily estimated in the Average Synchronized Rate.

  • PDF

Effects of auditory feedback and task difficulty on the cognitive load and virtual presence in a virtual reality dental simulation

  • Kim, Byunggee;Yang, Eunbyul;Choi, Namki;Kim, Seonmi;Ryu, Jeeheon
    • The Journal of the Korean dental association
    • /
    • v.58 no.11
    • /
    • pp.670-682
    • /
    • 2020
  • This research examined the difference in cognitive load and the virtual presence depending on auditory feedback and task difficulty in haptic-based dental simulation. In the field of dental education, practice-centered training using handpiece has been crucial because a practitioner's psychomotor experience has a significant impact on the mastery of treatment skills. For the novice, it is necessary to reduce errors in dental treatment to enhancing skill acquisition in the haptic practice. In the training process, the force-feedback is crucial to elaborate subtle movement to guide what to do and how it should be hard or soft. However, It is not easy to add force-feedback to generate kinetic experience training. As an alternative method, we examined that auditory feedback can help learners' skill training. In this study, we analyzed how the presence/absence of auditory feedback at the different levels of task difficulty impacts learners' psychological demand and virtual presence in the virtual reality simulation. For this study, 29 dental college students participated in a dental simulation. The participants were grouped into two conditions that are with and without auditory feedback. Additionally, two consecutive tooth preparation tasks with different levels of difficulty were used in the simulation. The auditory feedback condition gives alarms to a learner when he treats a non-targeted tooth with a virtual handpiece. The user's cognitive load and virtual presence were measured to examine the effects of auditory feedback. The results revealed that the main effect was found in cognitive loads. Also, a significant interaction effect was shown in the virtual presence. We discussed the effective design methods for the virtual reality-based dental simulation through the result of this study.

  • PDF

Cognitive Experiment on Auditory Sounds for Integrated Ship Bridge Alarm System (통합 선교 알람 시스템을 위한 알람 인지에 대한 기초 실험)

  • Lee, Bong-Wang;Kim, Hong-Tae;Yang, Chan-Su;Yang, Young-Hoon
    • Journal of the Korean Society of Marine Environment & Safety
    • /
    • v.11 no.1 s.22
    • /
    • pp.11-16
    • /
    • 2005
  • A ship can be considered as a large human-machine system and the interaction between worker and system affects the work performance and its efficiency. In the bridge if a ship, there exist many auditory signals as well as visual signals. However, only a few studies have been performed related to human recognition to alarm systems in the bridge. In this study, auditory icons and abstract sounds are compared to find more effective means if alarm systems. The study result shows that auditory icons are recognized faster than n abstract sounds. The result is expected to be use as a basic data for developing performance criteria q auditory display inside bridge and for designing integrated ship bridge alarm system.

  • PDF

A Basic Study of Warming Sounds for Integrated Ship Bridge Alarm System (통합 선교 알람 시스템을 위한 Warning Sounds에 대한 기초 연구)

  • Lee Bong-Wang;Kim Hongtae;Yang Chan-Su;Yang Young-Hoon;Gong In-Young;Yang Won-Jae
    • Proceedings of KOSOMES biannual meeting
    • /
    • 2005.05a
    • /
    • pp.7-12
    • /
    • 2005
  • A ship can be considered as a large human-machine system and the interaction between worker and system affects the work performed and its efficiency. Inside the bridge of a ship, there exist many auditory signals as well as visual signals. However, only a few studies have been performed related to human recognition to alarm systems in bridge. In this study, auditory icons and abstract sounds are compared to find more effective means of alarm systems. the study result shows tint auditory icons are recognized faster than abstract sounds. This result is expected to be used as a basic data for developing performance criteria of auditory display inside bridge and for designing integrated ship bridge alarm system.

  • PDF

Comparison of Motor Skill Acquisition according to Types of Sensory-Stimuli Cue in Serial Reaction Time Task

  • Kwon, Yong Hyun;Lee, Myoung Hee
    • The Journal of Korean Physical Therapy
    • /
    • v.26 no.3
    • /
    • pp.191-195
    • /
    • 2014
  • Purpose: The purpose of this study is to investigate whether types of sensory-stimuli cues in terms of visual, auditory, and visuoauditory cues can be affected to motor sequential learning in healthy adults, using serial reaction time task. Methods: Twenty four healthy subjects participated in this study, who were randomly allocated into three groups, in terms of visual-stimuli (VS) group, auditory-stimuli (AS) group, and visuoauditory-stimuli (VAS) group. In SRT task, eight Arabic numbers were adopted as presentational stimulus, which were composed of three different types of presentational modules, in terms of visual, auditory, and visuoauditory stimuli. On an experiment, all subjects performed total 3 sessions relevant to each stimulus module with a pause of 10 minutes for training and pre-/post-tests. At the pre- and post-tests, reaction time and accuracy were calculated. Results: In reaction time, significant differences were founded in terms of between-subjects, within-subjects, and interaction effect for group ${\times}$ repeated factor. In accuracy, no significant differences were observed in between-group and interaction effect for groups ${\times}$ repeated factor. However, a significant main effect of within-subjects was observed. In addition, a significant difference was showed in comparison of differences of changes between the pre- and post-test only in the reaction time among three groups. Conclusion: This study suggest that short-term sequential motor training on one day induced behavioral modification, such as speed and accuracy of motor response. In addition, we found that motor training using visual-stimuli cue showed better effect of motor skill acquisition, compared to auditory and visuoauditory-stimuli cues.

The Meaning of P50 Suppression : Interaction of Gamma and Alpha Waves

  • Lee, Kyungjun;Kang, Ung Gu
    • Korean Journal of Biological Psychiatry
    • /
    • v.21 no.4
    • /
    • pp.168-174
    • /
    • 2014
  • Objectives Sensory gating dysfunctions in patients with schizophrenia and bipolar disorder have been investigated through two similar methods ; P50 suppression and prepulse inhibition paradigms. However, recent studies have demonstrated that the two measures are not correlated but rather constitute as distinct neural processes. Recent studies adopting spectral frequency analysis suggest that P50 suppression reflects the interaction between gamma and other frequency bands. The aim of the present study is to investigate which frequency component shows more significant interaction with gamma band. Methods A total of 108 mood disorder patients and 36 normal subjects were included in the study. The P50 responses to conditioning and test stimuli with an intra-pair interval of 500 msec were measured in the study population. According to P50 ratio (amplitude to the test stimulus/amplitude to the conditioning stimulus), the subjects with P50 ratio less than 0.2 were defined as suppressed group (SG) ; non-suppressed group (NSG) consisted of P50 ratio more than 0.8. Thirty-five and 25 subjects were included in SG and NSG, respectively. Point-to-point correlation coefficients (PPCCs) of both groups were calculated between two time-windows : the first window (S1) was defined as the time-window of one hundred millisecond after the conditioning auditory stimulus and the second window (S2) was defined as the time-window of 100 msec after the test auditory stimulus. Spectral frequency analysis was performed to investigate which frequency band results in the difference of PPCC between SG and NSG. Results Significant reduction of PPCC between S1 and S2 was observed in the SG (Pearson's r = 0.24), compared to PPCC of the NSG (r = 0.58, p < 0.05). In spectral frequency analysis, gamma band showed "phase-reset" and similar responses after the two auditory stimuli in suppressed and non-suppressed group. However in the case of alpha band, comparison showed significantly low PPCC in SG (r = -0.14) compared to NSG (r = 0.36, p < 0.05). This may be reflecting "phase-out" of alpha band against gamma band at approximately 50 msecs after the test stimulus in the SG. Conclusions Our study suggests that normal P50 suppression is caused by phase-out of alpha band against gamma band after the second auditory stimulus. Thus it is demonstrated that normal sensory gating process is constituted with attenuated alpha power, superimposed on consistent gamma response. Implications of preserved gamma and decreased alpha band in sensory gating function are discussed.

Listener Auditory Perception Enhancement using Virtual Sound Source Design for 3D Auditory System

  • Kang, Cheol Yong;Mariappan, Vinayagam;Cho, Juphil;Lee, Seon Hee
    • International journal of advanced smart convergence
    • /
    • v.5 no.4
    • /
    • pp.15-20
    • /
    • 2016
  • When a virtual sound source for 3D auditory system is reproduced by a linear loudspeaker array, listeners can perceive not only the direction of the source, but also its distance. Control over perceived distance has often been implemented via the adjustment of various acoustic parameters, such as loudness, spectrum change, and the direct-to-reverberant energy ratio; however, there is a neglected yet powerful cue to the distance of a nearby virtual sound source that can be manipulated for sources that are positioned away from the listener's median plane. This paper address the problem of generating binaural signals for moving sources in closed or in open environments. The proposed perceptual enhancement algorithm composed of three main parts is developed: propagation, reverberation and the effect of the head, torso and pinna. For propagation the effect of attenuation due to distance and molecular air-absorption is considered. Related to the interaction of sounds with the environment, especially in closed environments is reverberation. The effects of the head, torso and pinna on signals that arrive at the listener are also objectives of the consideration. The set of HRTF that have been used to simulate the virtual sound source environment for 3D auditory system. Special attention has been given to the modelling and interpolation of HRTFs for the generation of new transfer functions and definition of trajectories, definition of closed environment, etc. also be considered for their inclusion in the program to achieve realistic binaural renderings. The evaluation is implemented in MATLAB.

A Study on Visual and Auditory Inducement of VR Image Contents and the Inducement Components of for Immersion Improvement (몰입감 향상을 위한 VR 영상 콘텐츠의 시청각 유도와 구성요소에 관한 연구)

  • Lee, Lang-Goo;Chung, Jean-Hun
    • Journal of Digital Convergence
    • /
    • v.14 no.11
    • /
    • pp.495-500
    • /
    • 2016
  • Since 2016, the VR market has been on the rapid growth. The most critical and arising issue in the VR market is VR contents. That is because it is necessary to develop making techniques and various VR contents to satisfy users' immersion and interaction as much as possible. Therefore, this study focused on VR image contents, conducted domestic and foreign cases of the components of visual and auditory inducement to keep and improve immersion, and thereby tried to find a right direction of visual and auditory inducement. As a result, the visual and auditory components of visual and auditory inducement were found to be photographing, edition, lighting, stitching, graphics, effect, voice actor's narration, dubbing, character voice, background sound, and sound effect; its technical and content components were found to be photographing technique, edition technique, lighting, stitching, graphics and effect, sound and sound effect, and theatric direction based on Mise-en-Scene, lines and narration of characters, and movements of characters and objets. For VR image contents, not only visual and auditory components, but technical and content components are necessary to improve immersion. In the future, it will be necessary to continue to research them.

Perceived Auditory Feedback and User Experience in Mobile Game: A Mediation Analysis of Enjoyment (모바일 게임 속 청각적 피드백 인지와 사용자 경험: 재미의 매개효과 분석)

  • Ahn, Jisoo;Heo, Ji-Yeon;Noh, Ghee Young
    • Journal of Korea Game Society
    • /
    • v.19 no.2
    • /
    • pp.135-144
    • /
    • 2019
  • This study examined the role of enjoyment in the relationship between perceived auditory feedback (PAF), which provides information about the situation during game play, and user experience factors. 100 undergraduates played a mobile game, 'Classy Royale' and took a survey about their user experience. As a result of analyzing the available data from 98 participants, PROCESS MACRO showed that PAF was positively associated with enjoyment, immersion, and intention to use; enjoyment mediated the effects of PAF on immersion and intention. These results can help game research and development regarding the functional value of audio factors.