• Title/Summary/Keyword: auditory user interface

Search Result 20, Processing Time 0.033 seconds

Perception Ability of Synthetic Vowels in Cochlear Implanted Children (모음의 포먼트 변형에 따른 인공와우 이식 아동의 청각적 인지변화)

  • Huh, Myung-Jin
    • MALSORI
    • /
    • no.64
    • /
    • pp.1-14
    • /
    • 2007
  • The purpose of this study was to examine the acoustic perception different by formants change for profoundly hearing impaired children with cochlear implants. The subjects were 10 children after 15 months of experience with the implant and mean of their chronological age was 8.4 years and Standard deviation was 2.9 years. The ability of auditory perception was assessed using acoustic-synthetic vowels. The acoustic-synthetic vowel was combined with F1, F2, and F3 into a vowel and produced 42 synthetic sound, using Speech GUI(Graphic User Interface) program. The data was deal with clustering analysis and on-line analytical processing for perception ability of acoustic synthetic vowel. The results showed that auditory perception scores of acoustic-synthetic vowels for cochlear implanted children were increased in F2 synthetic vowels compaire to those of F1. And it was found that they perceived the differences of vowels in terms of distance rates between F1 and F2 in specific vowel.

  • PDF

32-Channel EEG and Evoked Potential Mapping System (32채널 뇌파 및 뇌유전발전위 Mapping 시스템)

  • 안창범;박대준
    • Journal of Biomedical Engineering Research
    • /
    • v.17 no.2
    • /
    • pp.179-188
    • /
    • 1996
  • A clinically oriented 32-channel electroencephalogram (EEG) and evoked potential (EP) mapping system has been developed EEG and EP signals acquired from 32-channel electrodes attached on the heroid surface are amplified by a pre-amplifier which is separated from main amplifier and is located near the patient to reduce signal attenuation and noise contamination between electrodes and the amplifier. The amplified signals are further amplified by a main amplifier where various filtering and gain contr61 are achieved An automatic artifact rejection scheme is employed using neural network-based EEG and artifact classifier, by which examination time is substantially reduce4 The continuously measured EEG sigrlals are used for spectral mapping, and auditory and visual evoked potentials measured in synchronous to the auditory and visual stimuli are used for temporal evoked potential mapping. A user-friendly graphical interface based on the Microsoft Window 3.1 is developed for the operation of the system. Statistical databases for comparisons of group and individual are included to support a statistically-based diagnosis.

  • PDF

Tele-Manipulation of ROBHAZ-DT2 for Hazard Environment Applications

  • Ryu, Dong-Seok;Lee, Jong-Wha;Yoon, Seong-Sik;Kang, Sung-Chul;Song, Jae-Bok;Kim, Mun-Sang
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2003.10a
    • /
    • pp.2051-2056
    • /
    • 2003
  • In this paper, a tele-manipulation in explosive ordnance disposal(EOD) applications is discussed. The ROBHAZ-DT2 is developed as a teleoperated mobile manipulator for EOD. In general, it has been thought that the robot must have appropriate functions and accuracy enough to handle the complicated and dangerous mission. However, the research on the ROBHAZ-DT2 revealed that the teleoperation causes more restrictions and difficulties in EOD mission. Thus to solve the problem, a novel user interface for the ROBHAZ-DT2 is developed, in which the operator can interact with various human senses (i.e. visual, auditory and haptic sense). It enables an operator to control the ROBHAZ-DT2 simply and intuitively. A tele-manipulation control scheme for the ROBHAZ-DT2 is also proposed including compliance control via force feedback. It makes the robot adapt itself to circumstances, while the robot faithfully follows a command of the operator. This paper deals with a detailed description on the user interface and the tele-manipulation control for the ROBHAZ-DT2. An EOD demonstration is conducted to verify the validity of the proposed interface and the control scheme.

  • PDF

Brain Correlates of Emotion for XR Auditory Content (XR 음향 콘텐츠 활용을 위한 감성-뇌연결성 분석 연구)

  • Park, Sangin;Kim, Jonghwa;Park, Soon Yong;Mun, Sungchul
    • Journal of Broadcast Engineering
    • /
    • v.27 no.5
    • /
    • pp.738-750
    • /
    • 2022
  • In this study, we reviewed and discussed whether auditory stimuli with short length can evoke emotion-related neurological responses. The findings implicate that if personalized sound tracks are provided to XR users based on machine learning or probability network models, user experiences in XR environment can be enhanced. We also investigated that the arousal-relaxed factor evoked by short auditory sound can make distinct patterns in functional connectivity characterized from background EEG signals. We found that coherence in the right hemisphere increases in sound-evoked arousal state, and vice versa in relaxed state. Our findings can be practically utilized in developing XR sound bio-feedback system which can provide preference sound to users for highly immersive XR experiences.

Encoding Method for Olfactory Information (후각 정보의 부호화 방법)

  • Lee, Keun-Hee;Lee, Sang-Wook;Kim, Eung-Soo
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.11 no.7
    • /
    • pp.1275-1282
    • /
    • 2007
  • With the rapid spread of smart mobile products and practical use of wireless network, it became possible to offer the computing environment people can use anytime anywhere and it is predicted that portable computer as the next generation computing is to be put to practical use. This computer will be expected to have the new interface which provides realistic service through human's five senses as well as the interface through the visual and auditory senses. Accordingly, in this study, we are going to talk about the technology that expresses and reproduces what is based on olfactory information - closely related with memory among honan's five senses - in order to embody the lifelike user interface.

The Tactile Illusion evoked by a synchronous Visual Stimulus on Virtual and Real Hand (가상과 실제 손의 동기화를 통한 촉각환상 유발연구)

  • Jeonghun Ku;Kim, Hosung;Kim, Kwanguk;Wonyoung Hahn;Lee, Jang-Han;Kim, Sun I.
    • Proceedings of the Korean Society for Emotion and Sensibility Conference
    • /
    • 2003.05a
    • /
    • pp.84-89
    • /
    • 2003
  • The virtual reality(VR) technology can provide various stimuli, including, visual and auditory stimuli, simultaneously in the virtual environment and encourage the user to interact. Virtual reality is a set of computer technologies, which when combined, provide an interactive interface to a computer generated world. In this world the subject can see, hear and navigate in a dynamically changing environment in which he participates as an active player, by modifying the environment according to his will. Moreover, the subject can get a feeling for the virtual environment in much the same way as one feels real life situations. In the real world, a plethora of information from various modalities may be in conflict, and modulate each other to form an illusion. In this study we investigated whether a tactile illusion on a real hand could be evoked by a virtual stimulus, the time required to generate this illusion and its duration. This study shows that the illusion occurred, and that was correlated with presence score in the virtual environment.

  • PDF

Development of Online Speller using Non-contact Blink Detection Glasses (비접촉 눈 깜박임 측정 안경형 디바이스를 이용한 실시간 스펠러의 구현)

  • Lee, Jeong Su;Lee, Hong Ji;Lee, Won Kyu;Lim, Yong Gyu;Park, Kwang Suk
    • Journal of Biomedical Engineering Research
    • /
    • v.36 no.6
    • /
    • pp.283-290
    • /
    • 2015
  • We proposed blink based online speller for the locked-in syndrome (LIS) patients, paralyzed in nearly all voluntary muscles expect for the eyes, with a simple and easy-to-use eye blink detection glasses. Electrooculogram (EOG) is the golden standard method of eye movement or blink measurement with Ag/AgCl electrodes. However, this method has several drawbacks such as skin irritation and dehydration of conductive gel. To resolve the shortcomings, we used a blink detection system based on a transparent capacitively coupled electrode, which is conductive indium tin oxide (ITO) films. The films make it possible to measure eye blink without direct skin contact and obstruction of field of view. We finally developed user-friendly blink based online speller with the blink detection system. To classify voluntary and non-voluntary blink, we used the double blink for command of the speller. The online speller experiment result with six healthy subjects shows that mean accuracy is 98.96% and letter per minute (LPM) is 4.73, which are better result by comparison with conventional P300 or auditory brain-computer interface (BCI) paradigm. The result of the experiment demonstrates the possibility of applying the proposed system as a communication method for the LIS patients.

Real-Time Stereoscopic Visualization of Very Large Volume Data on CAVE (CAVE상에서의 방대한 볼륨 데이타의 실시간 입체 영상 가시화)

  • 임무진;이중연;조민수;이상산;임인성
    • Journal of KIISE:Computing Practices and Letters
    • /
    • v.8 no.6
    • /
    • pp.679-691
    • /
    • 2002
  • Volume visualization is an important subarea of scientific visualization, and is concerned with techniques that are effectively used in generating meaningful and visual information from abstract and complex volume datasets, defined in three- or higher-dimensional space. It has been increasingly important in various fields including meteorology, medical science, and computational fluid dynamics, and so on. On the other hand, virtual reality is a research field focusing on various techniques that aid gaining experiences in virtual worlds with visual, auditory and tactile senses. In this paper, we have developed a visualization system for CAVE, an immersive 3D virtual environment system, which generates stereoscopic images from huge human volume datasets in real-time using an improved volume visualization technique. In order to complement the 3D texture-mapping based volume rendering methods, that easily slow down as data sizes increase, our system utilizes an image-based rendering technique to guarantee real-time performance. The system has been designed to offer a variety of user interface functionality for effective visualization. In this article, we present detailed description on our real-time stereoscopic visualization system, and show how the Visible Korean Human dataset is effectively visualized on CAVE.

Methodologies for Enhancing Immersiveness in AR-based Product Design (증강현실 기반 제품 디자인의 몰입감 향상 기법)

  • Ha, Tae-Jin;Kim, Yeong-Mi;Ryu, Je-Ha;Woo, Woon-Tack
    • Journal of the Institute of Electronics Engineers of Korea CI
    • /
    • v.44 no.2 s.314
    • /
    • pp.37-46
    • /
    • 2007
  • In this paper, we propose technologies for enhancing the immersive realization of virtual objects in AR-based product design. Generally, multimodal senses such as visual/auditory/tactile feedback are well known as a method for enhancing the immersion in case of interaction with virtual objects. By adapting tangible objects we can provide touch sensation to users. A 3D model of the same scale overlays the whole area of the tangible object so the marker area is invisible. This contributes to enhancing immersion. Also, the hand occlusion problem when the virtual objects overlay the user's hands is partially solved, providing more immersive and natural images to users. Finally, multimodal feedback also creates better immersion. In our work, both vibrotactile feedback through page motors, pneumatic tactile feedback, and sound feedback are considered. In our scenario, a game-phone model is selected, by way of proposed augmented vibrotactile feedback, hands occlusion-reduced visual effects and sound feedback are provided to users. These proposed methodologies will contribute to a better immersive realization of the conventional AR system.