• Title/Summary/Keyword: Auditory Interaction

Search Result 61, Processing Time 0.032 seconds

A study of effective contents construction for AR based English learning (AR기반 영어학습을 위한 효과적 콘텐츠 구성 방향에 대한 연구)

  • Kim, Young-Seop;Jeon, Soo-Jin;Lim, Sang-Min
    • Journal of The Institute of Information and Telecommunication Facilities Engineering
    • /
    • v.10 no.4
    • /
    • pp.143-147
    • /
    • 2011
  • The system using augmented reality can save the time and cost. It is verified in various fields under the possibility of a technology by solving unrealistic feeling in the virtual space. Therefore, augmented reality has a variety of the potential to be used. Generally, multimodal senses such as visual/auditory/tactile feed back are well known as a method for enhancing the immersion in case of interaction with virtual object. By adapting tangible object we can provide touch sensation to users. a 3D model of the same scale overlays the whole area of the tangible object; thus, the marker area is invisible. This contributes to enhancing immersive and natural images to users. Finally, multimodal feedback also creates better immersion. In this paper, sound feedback is considered. By further improving immersion learning augmented reality for children with the initial step learning content is presented. Augmented reality is in the intermediate stages between future world and real world as well as its adaptability is estimated more than virtual reality.

  • PDF

Evaluation of Haptic Seat for Vehicle Navigation System (자동차 네비게이션 시스템을 위한 햅틱 시트의 평가에 관한 연구)

  • Chang, Won-suk;Kim, Seok-Hwan;Pyun, Jong-Kweon;Ji, Yong-Gu
    • Journal of the Ergonomics Society of Korea
    • /
    • v.29 no.4
    • /
    • pp.625-629
    • /
    • 2010
  • This study has confirmed that subjective positive and negative aspects a driver feels by applying haptic seat on a vehicle to substantiate vehicle navigation system. Our experiment with total twenty subjects provides that the reaction time (RT) is superior in haptic interface than visual or auditory interface but subjective satisfaction, which subjects feel, and workload is less low in a simulator environment. Although, the difference of individuals and unfamiliarity is relatively high inasmuch as the experiment of absolutely new technology, but overall satisfaction of haptic seat is high. The result of study provides some consideration and direction to need in implementation of a haptic seat and it also confirms their possibility meaningfully. We expect the interaction between a driver and a vehicle and safety improvement potentially through applied haptic seat on actual vehicles.

Development of three-dimensional sound effects system for virtual reality (가상환경용 3차원 입체음향 시스템 개발)

  • Yang, Si-Young;Kim, Dong-Hyung;Jeong, Je-Chang
    • Journal of Broadcast Engineering
    • /
    • v.13 no.5
    • /
    • pp.574-585
    • /
    • 2008
  • 3D sound is of central importance for the virtual reality system, and is becoming increasingly important for the auditory displays and for the human-computer interaction. In this paper, we propose a novel real-time 3D sound representation system for virtual reality. At first, we propose a calculation method of the impulse response for virtual space. To transmit the information of the virtual space, we propose an enhanced DXF file type that contains the material information. And then, we implement the multi-channel sound panning system. we perform the experiment based on computer simulation and prove the utility of the proposed method.

Multiple Vibration Signal Feedback for Mobile Devices (모바일 기기에서의 다중 진도 신호 피드백)

  • Yoo, Yongjae;Hwang, Inwook;Seo, Jongman;Choi, Seungmoon
    • Smart Media Journal
    • /
    • v.1 no.4
    • /
    • pp.8-17
    • /
    • 2012
  • In this paper, we introduce the appoaches that aim to improve user experience in mobile device by the use of multiple vibration signal feedback, conducted by Haptics and Virtual Reality laboratory at POSTECH. We introduce current progresses of our 'Vibrotactile flow using multiple vibration actuators' and 'Real-time dual-channel haptic music player.' The 'Vibrotactile flow using multiple vibration actuators' produces vibrotactile flow sensations by using multiple actuators and that improves the information transfer on mobile devices. The 'Real-time dual-channel haptic music player' generates vibrotactile sensation by transforming auditory signal, which improves the user experience of mobile devices. These approaches can be good examples to fulfill the demands of better information transfer capability and user experience on mobile devices.

  • PDF

Harmony Matters in Alarm Design: Investigating the Impact of Consonance on Alarm System

  • Ilgang Mukko Lee;Yunsun Alice Hong;Juhyun Jay Lee;Kwanghee Han
    • International Journal of Advanced Culture Technology
    • /
    • v.11 no.4
    • /
    • pp.406-416
    • /
    • 2023
  • Alarm system performance is a critical aspect of safety. While existing research has extensively examined the influence of acoustic attributes on alarm performance, consonance's impact remains largely uncharted territory. This study bridges this research gap by investigating the effect of consonance on alarm systems. We extend our investigation to encompass not only the sound characteristics of the alarm but also the acoustic qualities of the surrounding environment, recognizing their potential impact on alarm efficacy. Prior studies consistently link consonance to annoyance levels, resulting in a negative user experience. Thus, we explore the relationship between consonance and alarm system performance, with a particular focus on modulating annoyance as an explanatory factor. Utilizing an oddball paradigm, we categorized standard and oddball sounds into consonant and dissonant types, creating four sound combinations. Participants were asked to respond to the irregularly presented oddball sounds while ignoring the constantly presented standard sounds. Our results reveal significant differences between groups, with the Standard Consonant/Oddball Dissonant (SC/OD) group displaying notably slower response times than the Standard Dissonant/Oddball Consonant (SD/OC) group. This reaction time variation aligns with differences in annoyance levels, as the SC/OD group reports higher annoyance, suggesting that reaction time discrepancies may be linked to increased arousal due to heightened annoyance.

The effect of the human voice that is consistent with context and the mechanical melody on user's subjective experience in mobile phones (휴대전화 상황에서 맥락과 일치하는 사람음과 단순 기계음이 사용자의 주관적 경험에 미치는 영향)

  • Cho, Yu-Suk;Eom, Ki-Min;Joo, Hyo-Min;Suk, Ji-He;Han, Kwang-Hee
    • Science of Emotion and Sensibility
    • /
    • v.12 no.4
    • /
    • pp.531-544
    • /
    • 2009
  • In the past, objective usability was one of the most important aspects when user used system. But nowadays user's subjective experiences are getting more critical element than objective usability in HCI(human-computer interaction). Most people own their mobile phone and use it frequently these days. It is especially important to make user's subjective experiences more positive when using devices like mobile phones people frequently carry and interact with. This study investigates whether the interfaces which express the emotion give more positive experiences to users. Researchers created mobile phone prototypes to compare the effect of mechanical melody feedback(the major auditory feedbacks on mobile phones) and emotional voice feedback(recorded human voice). Participants experienced four kinds of mobile phone prototypes(no feedback, mechanical melody feedback, emotional voice feedback and dual feedback) and evaluated their experienced usability, hedonic quality and preference. The result suggests that person's perceptional fun and hedonic quality were getting increased in the phone which gave the emotional voice feedback than the mechanical melody feedback. Nevertheless, the preference was evaluated lower in the emotional voice feedback condition than the others.

  • PDF

Hand Proximity Effect on Task Switching Performance Through Cue Modality (손 근접성이 단서양상에 따라 과제전환 수행에 미치는 효과)

  • Choi, Jeongyoon;Han, Kwanghee
    • Science of Emotion and Sensibility
    • /
    • v.21 no.2
    • /
    • pp.73-88
    • /
    • 2018
  • The present study examined how processing features of visual information near the hand would affect task switching. Recent studies reported enhanced cognitive control of visual information presented the near hands. To investigate the enhancement of cognitive control based on the relationship between hand proximity and attention, we implemented 2 experiments. In the task switching performance experiment, the hand proximity effect depended on modality of cue and target. The first experiment showed that stimuli near the hand received greater cognitive control than stimuli far from the hand, resulting in smaller switch cost. The result could rule out the feature-binding problem, which identifies reduced switch cost as the cause instead of hand proximity. Our results show that hand proximity actually reduced switch cost. In the second experiment, we examined the effects of hand nearness, modality, and their interaction on switch cost. In task switching, the target was always visual, and the cue was presented either visually or auditorily. In addition, we manipulated the cue-target interval to observe the preparation effect of cue. The results showed that a visual cue near the hand reduced switch cost by shortening task preparation time. Also, modality switching between an auditory cue and visual target was remarkable in a hand-near condition. The results for the visual cue could be interpreted as a benefit of rapid visual attention orienting. On the other hand, the results for the auditory cue could be interpreted as the cost of interference of modality switching by slower attentional disengagement of stimuli near the hands. Finally, modulation of switch cost by attention induced by hand nearness was discussed.

A Study of the spatial perception by audio-visual information (시각과 청각에 의한 공간적 지각에 관한 연구)

  • Lee, Chai-Bong;Kang, Dae-Gee
    • Journal of the Institute of Convergence Signal Processing
    • /
    • v.11 no.2
    • /
    • pp.132-136
    • /
    • 2010
  • Psychophysical experiment was performed to investigate how audio-visual spatial disparity affects on perceptual space in peripheral vision. In the experiment, participants were exposed to two stimuli of vision and sound which comes simultaneously from different directions, respectively. The visual stimulus was implemented by 7 white LEDs which were located at an equal distance with 7 different angles of $-70^{\circ}$, $-40^{\circ}$, $-20^{\circ}$, $0^{\circ}$, $20^{\circ}$, $40^{\circ}$, and $70^{\circ}$ from the right front. Those audial stimuli were also implemented by loudspeakers which were placed at 9 different directions equally spaced by $5^{\circ}$ ranged from $-20^{\circ}$ to $20^{\circ}$. Each participant then evaluated spatial disparity between visual and audial stimuli with 5 levels of response, in which the higher level indicates the larger gap. When the visual stimulus is applied from the right, the results show that the response level gets higher for a larger angle between visual and auditory stimuli. A similar tendency for the visual stimulus with $0^{\circ}$ orientation was also be observed. On the other hand, when the visual stimulus is applied from the left, the response level gets lower for the larger angle.

Clinical Study for YMG-1, 2's Effects on Learning and Memory Abilities (육미지황탕가감방-1, 2가 학습과 기억능력에 미치는 영향에 관한 임상연구)

  • Park Eun Hye;Chung Myung Suk;Park Chang Bum;Chi Sang Eun;Lee Young Hyurk;Bae Hyun Su;Shin Min Kyu;Kim Hyun taek;Hong Moo Chang
    • Journal of Physiology & Pathology in Korean Medicine
    • /
    • v.16 no.5
    • /
    • pp.976-988
    • /
    • 2002
  • The aim of this study was to examine the memory and attention enhancement effect of YMG-1 and YMG-2, which are modified herbal extracts from Yukmijihwang-tang (YMJ). YMJ, composing six herbal medicine, has been used for restoring the normal functions of the body to consolidate the constitution, nourishing and invigorating the kidney functions for hundreds years in Asian countries. A series of studies reported that YMJ and its components enhance memory retention, protects neuronal cell from reactive oxygen attack and boost immune activities. Recently the microarray analysis suggested that YMG-1 protects neurodegeneration through modulating various neuron specific genes. A total of 55 subjects were divided into three groups according to the treatment of YMG-1 (n=20), YMG-2 (n=20) and control (C; n=15) groups. Before treatments, all of subjects were subjected to the assessments on neuropsychological tests of K-WAIS test, Rey-Kim memory test, and psychophysiological test of Event-Related Potential (ERP) during auditory oddball task and repeated word recognition task. They were repeatedly assessed with the same methods after drug treatment for 6 weeks. Although no significant effect of drug was found in Rey-Kim memory test, a significant interaction (P = .010, P < 0.05) between YMG-2 and C groups was identified in the scores digit span and block design, which are the subscales of K-WAIS. The very similar but marginal interaction (P = .064) between YMG-1 and C groups was found too. In ERP analysis, only YMG-1 group showed decreasing tendency of P300 latency during oddball task while the others tended to increase, and it caused significant interaction between session and group (p= .004). This result implies the enhancement of cognitive function in due to consideration of relationship between P300 latency and the speed of information processing. However, no evidence which could demonstrate the significant drug effect was found in neither amplitude or latency. These results come together suggest that YMG-1, 2 may enhance the attention, resulting in enhancement of memory processing. For elucidating detailed mechanism of YMG on learning and memory, the further studies are necessary.

Analysis of Requirements Using Quality Function Deployment (QFD) in Virtual Reality(VR) (가상현실(VR)에서 품질기능전개(QFD)를 활용한 요구사항 분석)

  • Park, Jihye;Kim, Mincheol
    • Journal of Distribution Science
    • /
    • v.17 no.2
    • /
    • pp.101-107
    • /
    • 2019
  • Purpose - The purpose of this study is to analyze the user requirements and developer requirements in virtual reality(VR), and suggest ways to increase the satisfaction of users who experience virtual reality. Specifically, focused on experience store of VR as a distribution retailer, user requirements were analyzed according to the results of previous research that the characteristics of Affordance, Presence, and Head Mounted Display (HMD) affect user satisfaction. Research, design, data, and methodology - Based on previous studies, in this study, we analyzed the importance of immerse, interaction, perception, and presence for the satisfaction of the user through the questionnaire, and the user experiences virtual reality (VR) The importance of HMD, Presence, Affordance, and experience satisfaction were analyzed. Based on this, we analyzed the user requirements and the developer requirements based on the questionnaires and interviews of the experts, starting from the user's desire or preference using QFD technique. Results - As a result of the analysis, the development factors that occupied a big part in the virtual reality field appeared to be visual. In detail, this showed that there was a lack of sense of presence for users. This should be improved. This paper shows that the requirements for visual, auditory, and tactile development are necessary. For the satisfaction of the users of virtual reality (VR) users, it is necessary to develop them according to their priority in consideration of importance and difficulty in the future. Conclusions - In this study, it was suggested that development according to priority should be considered, considering the difficulty level. Based on the results of this study, the following suggestions are made. First, we tried to search the list of user requirements as much as possible, but it is likely to change due to the development of VR technology. Therefore, it is necessary for developers to continually supplement user requirements with recent research literature. Second, development priorities according to difficulty level should be considered. This aspect should be considered in the actual VR development process, so if the numerical value of the difficulty is calculated, it should be presented in the research.