• 제목/요약/키워드: Auditory Interaction

검색결과 61건 처리시간 0.04초

청각 계통에서의 음성신호처리 (Speech signal processing in the auditory system)

  • 이재혁;심재성;백승화;박상희
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 1987년도 한국자동제어학술회의논문집; 한국과학기술대학, 충남; 16-17 Oct. 1987
    • /
    • pp.680-683
    • /
    • 1987
  • The speech signal processing in the auditory system can be analysized based on two representations : Average discharge rate and Temporal discharge pattern. But the average discharge rate representation is restricted by the narrow dynamic range because of the rate saturation and the two tone suppression phenomena, and the temporal discharge pattern representation needs a sophisticate frequency analysis and synchrony measure. In this paper, a simple representation is proposed : using a model considering the interaction of Cochlear fluid-BM movement and a haircell model, the feature of speech signals (formant frequency and pitch of vowels) is easily estimated in the Average Synchronized Rate.

  • PDF

Effects of auditory feedback and task difficulty on the cognitive load and virtual presence in a virtual reality dental simulation

  • Kim, Byunggee;Yang, Eunbyul;Choi, Namki;Kim, Seonmi;Ryu, Jeeheon
    • 대한치과의사협회지
    • /
    • 제58권11호
    • /
    • pp.670-682
    • /
    • 2020
  • This research examined the difference in cognitive load and the virtual presence depending on auditory feedback and task difficulty in haptic-based dental simulation. In the field of dental education, practice-centered training using handpiece has been crucial because a practitioner's psychomotor experience has a significant impact on the mastery of treatment skills. For the novice, it is necessary to reduce errors in dental treatment to enhancing skill acquisition in the haptic practice. In the training process, the force-feedback is crucial to elaborate subtle movement to guide what to do and how it should be hard or soft. However, It is not easy to add force-feedback to generate kinetic experience training. As an alternative method, we examined that auditory feedback can help learners' skill training. In this study, we analyzed how the presence/absence of auditory feedback at the different levels of task difficulty impacts learners' psychological demand and virtual presence in the virtual reality simulation. For this study, 29 dental college students participated in a dental simulation. The participants were grouped into two conditions that are with and without auditory feedback. Additionally, two consecutive tooth preparation tasks with different levels of difficulty were used in the simulation. The auditory feedback condition gives alarms to a learner when he treats a non-targeted tooth with a virtual handpiece. The user's cognitive load and virtual presence were measured to examine the effects of auditory feedback. The results revealed that the main effect was found in cognitive loads. Also, a significant interaction effect was shown in the virtual presence. We discussed the effective design methods for the virtual reality-based dental simulation through the result of this study.

  • PDF

통합 선교 알람 시스템을 위한 알람 인지에 대한 기초 실험 (Cognitive Experiment on Auditory Sounds for Integrated Ship Bridge Alarm System)

  • 이봉왕;김홍태;양찬수;양영훈
    • 해양환경안전학회지
    • /
    • 제11권1호
    • /
    • pp.11-16
    • /
    • 2005
  • 선박은 하나의 거대한 인간-기계시스템으로써 작업자와 시스템간의 상호 작용이 얼마나 잘 이루어지는가에 따라 수행하고자 하는 직무와 수행도에 영향을 미치게 된다. 선교 내에는 시각표시장치뿐만 아니라 청각표시장치로부터 나오는 많은 신호들이 존재한다. 그 중 장비의 알람에 대한 인간의 인지능력에 대한 연구는 미흡한 상태이다. 본 연구에서는 청각적 아이콘과 함축적 소리를 비교$\cdot$평가하여 알람에 대한 작업자의 인지에 대해 연구 하였다. 실험결과 청각적 아이콘이 함축적 소리를 사용한 경우 보다 더 빠르고 정확하게 인지 할 수 있는 것으로 나타났다. 본 연구의 결과는 선교 내 청각표시장치의 성능 기준 그리고 현재 논의 되고 있는 통합선교알람시스템을 위한 기초 자료로 이용될 수 있을 것이라 생각된다.

  • PDF

통합 선교 알람 시스템을 위한 Warning Sounds에 대한 기초 연구 (A Basic Study of Warming Sounds for Integrated Ship Bridge Alarm System)

  • 이봉왕;김홍태;양찬수;양영훈;공인영;양원재
    • 해양환경안전학회:학술대회논문집
    • /
    • 해양환경안전학회 2005년도 춘계학술발표회
    • /
    • pp.7-12
    • /
    • 2005
  • 선박은 하나의 거대한 인간-기계시스템으로써 작업자와 시스템간의 상호 작용이 얼마나 잘 이루어지는가에 따라 수행하고자 하는 직무와 수행도에 영항을 미치게 된다. 선교 내에는 시각 표시 장치뿐만 아니라 청각 표시 장치로부터 나오는 많은 신호들이 존재한다. 그 중 장비의 알람(alarm)에 대한 인간의 인지능력에 대한 연구는 부족한 상태이다. 본 연구에서는 auditory icons과 sounds의 비교 평가를 통하여 알람에 대한 작업자의 인지에 대한 연구를 하였다. 실험결과 auditory icons를 사용한 경우 sounds 보다 더 빠르고 정확하게 인지 할 수 있는 것으로 나타났다 선교 내 청각적 표시장치의 성능 기준 그리고 현재 논의 되고 있는 통합 선교 알람 시스템을 위한 기초 자료로 본 연구의 결과가 이용될 수 있을 것이라 생각된다.

  • PDF

Comparison of Motor Skill Acquisition according to Types of Sensory-Stimuli Cue in Serial Reaction Time Task

  • Kwon, Yong Hyun;Lee, Myoung Hee
    • The Journal of Korean Physical Therapy
    • /
    • 제26권3호
    • /
    • pp.191-195
    • /
    • 2014
  • Purpose: The purpose of this study is to investigate whether types of sensory-stimuli cues in terms of visual, auditory, and visuoauditory cues can be affected to motor sequential learning in healthy adults, using serial reaction time task. Methods: Twenty four healthy subjects participated in this study, who were randomly allocated into three groups, in terms of visual-stimuli (VS) group, auditory-stimuli (AS) group, and visuoauditory-stimuli (VAS) group. In SRT task, eight Arabic numbers were adopted as presentational stimulus, which were composed of three different types of presentational modules, in terms of visual, auditory, and visuoauditory stimuli. On an experiment, all subjects performed total 3 sessions relevant to each stimulus module with a pause of 10 minutes for training and pre-/post-tests. At the pre- and post-tests, reaction time and accuracy were calculated. Results: In reaction time, significant differences were founded in terms of between-subjects, within-subjects, and interaction effect for group ${\times}$ repeated factor. In accuracy, no significant differences were observed in between-group and interaction effect for groups ${\times}$ repeated factor. However, a significant main effect of within-subjects was observed. In addition, a significant difference was showed in comparison of differences of changes between the pre- and post-test only in the reaction time among three groups. Conclusion: This study suggest that short-term sequential motor training on one day induced behavioral modification, such as speed and accuracy of motor response. In addition, we found that motor training using visual-stimuli cue showed better effect of motor skill acquisition, compared to auditory and visuoauditory-stimuli cues.

The Meaning of P50 Suppression : Interaction of Gamma and Alpha Waves

  • Lee, Kyungjun;Kang, Ung Gu
    • 생물정신의학
    • /
    • 제21권4호
    • /
    • pp.168-174
    • /
    • 2014
  • Objectives Sensory gating dysfunctions in patients with schizophrenia and bipolar disorder have been investigated through two similar methods ; P50 suppression and prepulse inhibition paradigms. However, recent studies have demonstrated that the two measures are not correlated but rather constitute as distinct neural processes. Recent studies adopting spectral frequency analysis suggest that P50 suppression reflects the interaction between gamma and other frequency bands. The aim of the present study is to investigate which frequency component shows more significant interaction with gamma band. Methods A total of 108 mood disorder patients and 36 normal subjects were included in the study. The P50 responses to conditioning and test stimuli with an intra-pair interval of 500 msec were measured in the study population. According to P50 ratio (amplitude to the test stimulus/amplitude to the conditioning stimulus), the subjects with P50 ratio less than 0.2 were defined as suppressed group (SG) ; non-suppressed group (NSG) consisted of P50 ratio more than 0.8. Thirty-five and 25 subjects were included in SG and NSG, respectively. Point-to-point correlation coefficients (PPCCs) of both groups were calculated between two time-windows : the first window (S1) was defined as the time-window of one hundred millisecond after the conditioning auditory stimulus and the second window (S2) was defined as the time-window of 100 msec after the test auditory stimulus. Spectral frequency analysis was performed to investigate which frequency band results in the difference of PPCC between SG and NSG. Results Significant reduction of PPCC between S1 and S2 was observed in the SG (Pearson's r = 0.24), compared to PPCC of the NSG (r = 0.58, p < 0.05). In spectral frequency analysis, gamma band showed "phase-reset" and similar responses after the two auditory stimuli in suppressed and non-suppressed group. However in the case of alpha band, comparison showed significantly low PPCC in SG (r = -0.14) compared to NSG (r = 0.36, p < 0.05). This may be reflecting "phase-out" of alpha band against gamma band at approximately 50 msecs after the test stimulus in the SG. Conclusions Our study suggests that normal P50 suppression is caused by phase-out of alpha band against gamma band after the second auditory stimulus. Thus it is demonstrated that normal sensory gating process is constituted with attenuated alpha power, superimposed on consistent gamma response. Implications of preserved gamma and decreased alpha band in sensory gating function are discussed.

Listener Auditory Perception Enhancement using Virtual Sound Source Design for 3D Auditory System

  • Kang, Cheol Yong;Mariappan, Vinayagam;Cho, Juphil;Lee, Seon Hee
    • International journal of advanced smart convergence
    • /
    • 제5권4호
    • /
    • pp.15-20
    • /
    • 2016
  • When a virtual sound source for 3D auditory system is reproduced by a linear loudspeaker array, listeners can perceive not only the direction of the source, but also its distance. Control over perceived distance has often been implemented via the adjustment of various acoustic parameters, such as loudness, spectrum change, and the direct-to-reverberant energy ratio; however, there is a neglected yet powerful cue to the distance of a nearby virtual sound source that can be manipulated for sources that are positioned away from the listener's median plane. This paper address the problem of generating binaural signals for moving sources in closed or in open environments. The proposed perceptual enhancement algorithm composed of three main parts is developed: propagation, reverberation and the effect of the head, torso and pinna. For propagation the effect of attenuation due to distance and molecular air-absorption is considered. Related to the interaction of sounds with the environment, especially in closed environments is reverberation. The effects of the head, torso and pinna on signals that arrive at the listener are also objectives of the consideration. The set of HRTF that have been used to simulate the virtual sound source environment for 3D auditory system. Special attention has been given to the modelling and interpolation of HRTFs for the generation of new transfer functions and definition of trajectories, definition of closed environment, etc. also be considered for their inclusion in the program to achieve realistic binaural renderings. The evaluation is implemented in MATLAB.

몰입감 향상을 위한 VR 영상 콘텐츠의 시청각 유도와 구성요소에 관한 연구 (A Study on Visual and Auditory Inducement of VR Image Contents and the Inducement Components of for Immersion Improvement)

  • 이랑구;정진헌
    • 디지털융복합연구
    • /
    • 제14권11호
    • /
    • pp.495-500
    • /
    • 2016
  • 2016년을 기점으로 VR 시장이 급속도로 성장하고 있으며, 현재 VR 시장에서 가장 중요한 이슈로 떠오르고 있는 것은 VR 콘텐츠이다. 사용자의 몰입감과 상호작용을 최대한 충족시킬 수 있는 제작 기법과 좀 더 다양한 VR 콘텐츠가 필요하기 때문이다. 본 연구는 VR 콘텐츠 중 VR 영상 콘텐츠를 중심으로 몰입감을 지속할 수 있게 하고 향상할 수 있는 시청각 유도의 구성요소들을 국내외 사례 분석을 통해 시청각 유도의 올바른 방향성을 찾아보았다. 그 결과 시청각 유도의 시각적 청각적 구성요소로는 촬영, 편집, 조명, 스티칭, 그래픽, 이펙트, 성우 내레이션, 더빙, 등장인물의 음성, 배경음악 및 효과음 등이 있었고, 다시 기술적 내용적 요소로는 촬영기법, 편집기법, 조명, 스티칭, 그래픽과 이펙트, 사운드 및 효과음, 미장센 중심의 연극적 연출, 등장인물의 대사 및 내레이션, 등장인물과 오브제의 움직임 등으로 나타났으며, 더불어 향후 VR 영상 콘텐츠는 몰입감을 향상할 수 있는 시청각적 구성요소들과 함께 기술적 내용적인 구성요소들이 필요하며 지속적인 연구가 병행되어야 할 것이다.

모바일 게임 속 청각적 피드백 인지와 사용자 경험: 재미의 매개효과 분석 (Perceived Auditory Feedback and User Experience in Mobile Game: A Mediation Analysis of Enjoyment)

  • 안지수;허지연;노기영
    • 한국게임학회 논문지
    • /
    • 제19권2호
    • /
    • pp.135-144
    • /
    • 2019
  • 본 연구는 게임 상황에 대한 정보를 제공해주는 청각적 피드백에 대한 사용자의 인지 정도와 사용자 경험 요소들의 관계에서 재미의 역할을 살펴보았다. 대학생 100명을 대상으로 모바일 게임 '클래시 로얄'을 플레이 한 후 이 게임에 대한 사용자 경험을 조사했다. 프로세스 매크로를 통해 98명의 데이터를 분석한 결과, 청각적 피드백을 인지할수록 재미와 몰입, 지속적 이용의도가 늘어났고, 재미는 몰입과 지속적 이용의도에 대한 인지된 청각적 피드백의 영향을 매개했다. 이러한 연구 결과는 게임 정보의 제공이라는 음향 효과의 기능적 가치에 대한 게임 연구와 개발에 도움이 될 것이다.