• Science of Emotion and Sensibility
• /
• v.10 no.3
• /
• pp.307-320
• /
• 2007

In this study, we attempted to provide a distinctive cognitive, emotional 'Auditory User Interface (AUI) Design Guideline' according to home appliance groups and their functions. It is an effort to apply a new design method to practical affairs to overcome the limit of GUI centered appliance design and reflect user multimodal properties by presenting a guideline possible to generate auditory signals intuitively associable with the operational functions. The reason why this study is required is because of frequent instances given rise to annoyance as not systematic application of AUI, but arbitrary mapping. This study tried to provide a useful guideline of AUI in home appliances by extracting the relations with cognitive, emotional properties of a certain device or function induced by several properties of auditory signal and showing the empirical data on the basic mechanism of such relations.

• Journal of Institute of Control, Robotics and Systems
• /
• v.10 no.11
• /
• pp.961-970
• /
• 2004

Tactile sensation is one of the most important sensory functions along with the auditory sensation for the visually impaired since it replaces the visual one of the persons with sight. In this paper, we present a tactile display device as a dynamic Braille display that is the unique tool f3r exchanging information among them. The tactile cell of the Braille display proposed is based on the dielectric elastomer, which is one of the electroactive polymers. It has advantageous features over the existing ones with respect to intrinsic softness, ease of fabrication, cost effectiveness and miniaturization. We introduce a new idea for actuation as well as additional considerations such as the driving circuit that makes it possible to drive multiple tactile cells in a high speed. Also, we describe the actuating mechanism of the Braille pin in details capable of realizing the enhanced spatial density of the tactile cells. Finally, results of psychophysical experiments are given to evaluate its effectiveness.

• Journal of the Ergonomics Society of Korea
• /
• v.16 no.2
• /
• pp.101-122
• /
• 1997

Our recent work on virtual environments and virtual displays is reviewed, including our efforts to establish the Virtual Environment Research, Interactive Technology, And Simulation (VERITAS) facility and our research on spatial hearing. VERITAS is a state-of -the-art multisensory facility, built around the ${CAVE}^{TM}$ technology. High-quality 3D audio is included and haptic interfaces are planned. The facility will support technical and non-technical users working in a wide variety of application areas. Our own research emphasizes the importance of auditory stimulation in virtual environments and complex display systems. Experiments on auditory-aided visual target acquistion, sensory conflict, sound localization in noise, and loxalization of speech stimuli are discussed.

• Journal of Sensor Science and Technology
• /
• v.21 no.4
• /
• pp.249-255
• /
• 2012

Among the human senses, olfactory information still does not have a proper data presentation method unlike that regarding vision and auditory information. It makes presenting the sense of smell into multimedia information impossible, which may be an exploratory field in human computer interaction. In this paper, we propose an olfactory information presentation method, which is a way to use smell as multimedia information, and show an application for scent generation and odor display using a web service. The olfactory information can present smell characteristics such as intensity, persistence, hedonic tone, and odor description. The structure of data format based on olfactory information can also be organized according to data types such as integer, float, char, string, and bitmap. Furthermore, it can be used for data transmitting via a web service and for odor display using a scent generator. The scent generator, which can display information of smell, is developed to generate 6 odors using 6 aroma solutions and a diluted solution with 14 micro-valves and a micropump. Throughout the experiment, we confirm that the remote user can grasp information of smell transmitted by messenger service and request odor display to the computer controlled scent generator. It contributes to enlarge existing virtual reality and to be proposed as a standard reference method regarding olfactory information presentation for future multimedia technology.

• 한국HCI학회:학술대회논문집
• /
• 2007.02a
• /
• pp.881-886
• /
• 2007

This study was to develope a vibrotactile display system using windows media player from digital audio signal. WMPlayer10SDK system which was plug-in tool by microsoft windows media player provided its video and audio signal information. The audio signal was tried to be change into vibrotactile display. Audio signal had 4 sections such as 8bit, 16bit, 24bit, and 32bit. Each section was computed its frequency and vibrato scale. And data was transferred to 38400bps network port(COM1) for vibration. Using this system was able to develop the music suit which presented tactile feeling of music beyond sound. Therefore, it may provide cross modal technology for fusion technology of human senses.

• Journal of the HCI Society of Korea
• /
• v.1 no.1
• /
• pp.29-36
• /
• 2006

Tactile displays can provide useful information without disturbing others and are particularly useful for people with visual or auditory impairments. They can also complement other displays. In this paper, we present a new vibrotactile display device for wearable, mobile, and ubiquitous computing environments. The proposed vibrotactile device has a $5{\times}5$ array configuration for displaying complex information such as letters, numbers, and haptic patterns as well as simple directional ques and situation awareness alarms. Commercially available coin-type vibration motors are embedded vertically in flexible mounting pads in order to best localize vibrations on the skin. An embedded microprocessor controls the motors sequentially with an advanced tracing mode to increase recognition rate. User studies with the vibrotactile device on the top of the foot show 86.7% recognition rate for alphabet characters after some training. In addition, applying vibrotactile device to driving situation shows 83.9% recognition rate. We also propose some potentially useful application scenarios including Caller Identification for mobile phones and Navigation Aids for GPS systems while driving.

• Journal of rehabilitation welfare engineering & assistive technology
• /
• v.4 no.1
• /
• pp.63-70
• /
• 2010

Research and development of Assistive Technology (AT) for blind people is primarily focused on assisting mobility and improving access to information. Some particularly useful devices for aiding access to information and communication are DAISY players used with talking books, screen readers for reading screens, video magnifiers to aid low vision, Braille displays, and Braille PDAs. These essential devices have been successfully commercialized and have assisted many visually impaired people. Assistive technology devices for visually impaired people are called sensory substitution devices, because these devices substitute tactile or auditory functions for visual functions. The tactile interfaces of sensory substitution devices such as Braille displays and Braille PDAs have a bimorph type of piezoelectric actuator that forms a Braille (pin) of the Braille cells by moving up and down. KGS Corporation of Japan has more than 80% share of the worldwide market for these Braille cell actuators. Commercializing it for the first time in the world. This paper reviews the various endeavors in Japan in the research and development of tactile displays, such as Braille displays and Braille PDAs. Furthermore, it discusses sensory substitution devices that use tactile displays, focusing especially on the rotating Braille display we have developed.

• Transactions of the Korean Society of Automotive Engineers
• /
• v.21 no.4
• /
• pp.62-69
• /
• 2013

Visual demands associated with in-vehicle display usage and text messaging distract a driver's visual attention from the roadway. To minimize eyes-off-the-road demands, voice interaction systems are widely introduced. Under cognitively distracted condition, however, awareness of the operating environment will be degraded although the driver remains oriented to the roadway. It is also know that the risk of inattentive driving varies with age, thus systematic analysis of driving risks is required for the older drivers. This paper aims to understand the age-related driving performance degradation and visual attention changes under auditory cognitive demand which consists of three graded levels of cognitive complexity. In this study, two groups, aged 25-35 and 60-69, engaged in a delayed auditory recall task, so called N-back task, while driving a simulated highway. Comparisons of younger and older drivers' driving performance including mean speed, speed variability and standard deviation of lane position, and gaze dispersion changes, which consist of x-axis and y-axis of visual attention, were conducted. As a result, it was observed that gaze dispersion decreased with each level of demand, demonstrating that these indices can correctly rank order cognitive workload. Moreover, gaze dispersion change patterns were quite consistent in younger and older age groups. Effects were also observed on driving performance measures, but they were subtle, nonlinear, and did not effectively differentiate the levels of cognitive workload.

• 한국HCI학회:학술대회논문집
• /
• 2007.02a
• /
• pp.591-597
• /
• 2007

웨어러블 컴퓨팅의 지속적인 발전과 함께, 이들이 지원하는 기능은 점점 다양화되고 전문화되었다. 하지만 기기의 종류와 기능이 늘어나면서 각 기기의 상태를 확인하는 작업 자체가 복잡하고 불필요한 시간을 소요하기도 한다. 또한 이를 시각 디스플레이에만 의존하면, 디스플레이 크기의 한계와 더불어 시각적인 과부하가 발생할 수 있다. 본 연구에서는 이러한 문제를 극복하기 위해 웨어러블 각 기기의 상태정보 피드백으로서 소리를 이용하였다. 실험의 순서는 먼저 시각정보에 더하여 청각정보를 추가적으로 제시하는 방식의 유용성을 검증한 다음, 기기 특정적인 청각 아이콘(Auditory Icon)의 효과를 확인하였다. 청각정보의 유용성을 확인하는 단계에서는 참가자에게 특정 기기의 위치와 그 상태에 관한 정보를 시각 디스플레이를 통해 제시하면서, 조건에 따라 다양한 형태의 청각 디스플레이를 제시하고 기기 및 상태정보 확인에 소요되는 시간을 측정하였다. 시각디스플레이의 방식은 다양하지만, 본 연구에서는 사람의 몸을 나타내는 그림 위에 기기가 장착된 위치를 붉은 점으로 표시하고, 그 상태를 텍스트로 표시하는 방식(실험 1)과 텍스트를 통해 기기의 종류와 상태를 알려주는 방식(실험 2)을 적용하였다. 기기 확인에 소요되는 반응시간을 기록한 실험결과는 시각디스플레이를 통해서만 제시하는 조건보다 시각디스플레이와 청각디스플레이를 동시에 제시하는 조건에서 나은 수행을 보여주며, 정보의 내용이 일정 범위 내에서 구체적으로 제시될 수록 수행이 증가하는 경향을 보여주고 있다. 이어지는 기기 특정적인 청각 아이콘의 효과를 확인하는 단계에서는, 소리의 높낮이를 통해 기기의 위치를 표현하는 대신, 소리만 듣고 기기가 무엇인가를 알려줄 수 있도록, 참가자 평정을 통해 기기 특정적인 청각 아이콘을 선정하고, 이를 상태정보 디스플레이에 추가하였다. 기기의 수와 제시조건은 앞선 실험과 동일하였으며, 역시 기기 및 상태정보 확인에 소요되는 반응시간을 체크하였다. 실험결과는 이전의 실험과 비슷하게 시각과 청각 디스플레이의 중복제시 조건에서 높은 수행을 보였으며, 청각 아이콘의 사용으로 인한 수행의 증가도 확인할 수 있었다. 실험 2에서는 추가적으로 청각 디스플레이의 내용에 대한 주관적인 평정을 실시 하였는데, 기기 특정적인 청각 아이콘은 참가자에게 편의성, 효용성, 적합성, 확신도에서도 높은 점수를 얻었다. 이러한 결과는 청각 피드백을 이용한 정보의 디스플레이는 착용자의 시선을 자유롭게 함으로써 일상생활의 수행을 높이고, 웨어러블 컴퓨터 디스플레이 크기의 제약을 해결하는 방법이 될 수 있는 동시에 주관적인 사용성 측면에서 발전가능성이 있음을 보여준다.

• Journal of the Institute of Electronics and Information Engineers
• /
• v.53 no.12
• /
• pp.161-168
• /
• 2016

Thanks to mass production and provision of smartphones and the HMD (head mounted display), VR (virtual reality) is now being applied to various areas. The VR HMD is the interface equipment which allows users to have realistic experiences through human sensory organs such as vision and auditory sense. Since the majority of VR equipment is operated by the display for both eyes, 360-degree video content and the depth information, the VR mechanism is closely related to human senses, especially vision. Previous studies have focused on how to minimize negative impact such as motion sickness or visual fatigue. Little attention has been paid on research about the visual treatment. Therefore, the focus of this study is to develop technical elements for utilization of vision therapy with the VR HMD and explore possible areas to apply it. To this end, we analyzed the past case studies and technical elements to identify 16 areas for vision therapy. We also developed the optical parameters for utilization of the VR HMD visual targets. The result of this study is expected to be utilized for development of visual targets for vision therapy based on the VR HMD.