• Title/Summary/Keyword: Auditory Display

Search Result 38, Processing Time 0.023 seconds

A Study on VR Convergence Contents Creation Process ink painting (수묵화를 이용한 VR 융합콘텐츠 제작공정 연구)

  • Hou, Zheng-Dong;Choi, Chul-Young
    • Journal of the Korea Convergence Society
    • /
    • v.9 no.7
    • /
    • pp.193-198
    • /
    • 2018
  • Applying VR technology to animation areas is emerging as a trend of recent years. So if you use this VR technology in traditional ink animation, 2D art piece is expected to be equipped with a new narrative style and visual and auditory language, making it a new animation genre. There's a lot of technical difficulties in putting the existing 2D ink image on a 360 degree display. VR ink animation has been created that gives depth to VR space by using layer extraction method based on depth of distance and placing layers extracted on curved surface that is aligned with depth in 360-degree space in the image of ink painting, which is the background of traditional ink animation. In the text, we took an overview on problems generated in extracting layers of distant view, close-range view and middle distant view from the existing image of ink painting and made suggestions of an effective way to approach them.

Influence on Driver Behavior According to Providing Collision Avoidance Information on Highway (고속도로의 전방 장해물 충돌방지정보 제공이 운전행동에 미치는 영향)

  • Jeon, Yong-Uk;Dae, Mun-Su
    • Journal of Korean Society of Transportation
    • /
    • v.27 no.4
    • /
    • pp.137-143
    • /
    • 2009
  • It is necessary to develop driving assistant information in order to prevent a rear-end collision with a crashed car which is at the blind curve on highway. Laboratory experiments were performed using a driving simulator to keep the traffic environment constant. This research was evaluated the effect of driver behavior according to providing collision avoidance information which was consisted of advisory, caution, and warning information by the dangerous degree of traffic situation. Driver behavior was evaluated to analyze the collision avoidance with a crashed car, and glance behavior was examined to measure the eye movements to the display on which provided the collision avoidance information. After experiment, the significance was evaluated on provided collision avoidance information. As the result of this research, the number of collision accident is reduced when the phased information was provided. In addition, it is clear that auditory information is more important than visual information in the case of providing the second information.

Nonverbal Expressions in New Media Art -Case Studies about Facial Expressions and Sound (뉴미디어 아트에 나타난 비언어적 표현 -표정과 소리의 사례연구를 중심으로)

  • Yoo, Mi;An, KyoungHee
    • The Journal of the Korea Contents Association
    • /
    • v.19 no.10
    • /
    • pp.146-156
    • /
    • 2019
  • New media art moves out of place and time constraints, sublimates the benefits of technology into art, and presents a new way of communication with the audience. This paper analyses the tendency of nonverbal communication methods by analysing examples of facial expressions and sound used in new media art from early times. As a result, it can be seen that the digital paradigm in the new media art has a nonlinear thinking, which makes a perceptual reduction of immersion and dispersion. The facial expression in new media art made it possible not only to overcome the limit of space and time of various expressions through 'visual distortions, enlargement, and virtualisation', but also to enable new ways of communication to display facial parts combined or separated in the digital environment. The sound in new media art does not stay in auditory sense, but pursues multi-sensory and synesthesia by cooperating with visual and tactile, evolves by revealing characteristics of space expansion and sensibility and interaction of audience.

Effect of robot arm reach training on upper extremity functional movement in chronic stroke survivors: a preliminary study

  • Cho, Ki Hun;Song, Won-Kyung
    • Physical Therapy Rehabilitation Science
    • /
    • v.8 no.2
    • /
    • pp.93-98
    • /
    • 2019
  • Objective: The purpose of this study was to investigate the effect of robot arm reach training on upper extremity functional movement in chronic stroke survivors. Design: One group pretest-posttest design. Methods: Thirteen chronic stroke survivors participated in this study. Robot arm reach training was performed with a Whole Arm Manipulator (WAM) and a 120-inch projective display to provide visual and auditory feedback. During the robotic arm reach training, WAM provided gravity compensation and assist-as-needed (AAN) force according to the robot control mode. When a participant could not move the arm toward the target for more than 2 seconds, WAM provided AAN force to reach the desired targets. All patients participated in the training for 40 minutes per day, 3 times a week, for 4 weeks. Main outcome measures were the Fugl-Meyer Assessment (FMA), Action Research Arm Test (ARAT) and Box and Block Test (BBT) to assess upper extremity functional movement. Results: After 4 weeks, significant improvement was observed in upper extremity functional movement (FMA: 42.15 to 46.23, BBT: 12.23 to 14.00, p<0.05). In the subscore analysis of the FMA upper extremity motor function domains, significant improvement was observed in upper extremity and coordination/speed units (p<0.05). However, there were no significant differences in the ARAT. Conclusions: This study showed the positive effects of robot arm reach training on upper extremity functional movement in chronic stroke survivors. In particular, we confirmed that robot arm reach training could have a positive influence by leading to improvement of motor recovery of the proximal upper extremity.

The development of training platform for CiADS using cave automatic virtual environment

  • Jin-Yang Li ;Jun-Liang Du ;Long Gu ;You-Peng Zhang;Xin Sheng ;Cong Lin ;Yongquan Wang
    • Nuclear Engineering and Technology
    • /
    • v.55 no.7
    • /
    • pp.2656-2661
    • /
    • 2023
  • The project of China initiative Accelerator Driven Subcritical (CiADS) system has been started to construct in southeast China's Guangdong province since 2019, which is expected to be checked and accepted in the year 2025. In order to make the students in University of Chinese Academy of Sciences (UCAS) better understand the main characteristic and the operation condition in the subcritical nuclear facility, the training platform for CiADS has been developed based on the Cave Automatic Virtual Environment (CAVE) in the Institute of Modern Physics Chinese Academy of Sciences (IMPCAS). The CAVE platform is a kind of non-head mounted virtual reality display system, which can provide the immersive experience and the alternative training platform to substitute the dangerous operation experiments with strong radioactivity. In this paper, the CAVE platform for the training scenarios in CiADS system has been presented with real-time simulation feature, where the required devices to generate the auditory and visual senses with the interactive mode have been detailed. Moreover, the three dimensional modeling database has been created for the different operation conditions, which can bring more freedom for the teachers to generate the appropriate training courses for the students. All the user-friendly features will offer a deep realistic impression to the students for the purpose of getting the required knowledge and experience without the large costs in the traditional experimental nuclear reactor.

Comparison of Head-related Transfer Function Models Based on Principal Components Analysis (주성분 분석법을 이용한 머리전달함수 모형화 기법의 성능 비교)

  • Hwang, Sung-Mok;Park, Young-Jin;Park, Youn-Sik
    • Transactions of the Korean Society for Noise and Vibration Engineering
    • /
    • v.18 no.6
    • /
    • pp.642-653
    • /
    • 2008
  • This study deals with modeling of head-related transfer functions(HRTFs) using principal components analysis(PCA) in the time and frequency domains. Four PCA models based on head-related impulse responses(HRIRs), complex-valued HRTFs, augmented HRTFs, and log-magnitudes of HRTFs are investigated. The objective of this study is to compare modeling performances of the PCA models in the least-squares sense and to show the theoretical relationship between the PCA models. In terms of the number of principal components needed for modeling, the PCA model based on HRIR or augmented HRTFs showed more efficient modeling performance than the PCA model based on complex-valued HRTFs. The PCA model based on HRIRs in the time domain and that based on augmented HRTFs in the frequency domain are shown to be theoretically equivalent. Modeling performance of the PCA model based on log-magnitudes of HRTFs cannot be compared with that of other PCA models because the PCA model deals with log-scaled magnitude components only, whereas the other PCA models consider both magnitude and phase components in linear scale.

Design and Implementation of Sandcastle Play Guide Application using Artificial Intelligence and Augmented Reality (인공지능과 증강현실 기술을 이용한 모래성 놀이 가이드 애플리케이션 설계 및 구현)

  • Ryu, Jeeseung;Jang, Seungwoo;Mun, Yujeong;Lee, Jungjin
    • Journal of the Korea Computer Graphics Society
    • /
    • v.28 no.3
    • /
    • pp.79-89
    • /
    • 2022
  • With the popularity and the advanced graphics hardware technology of mobile devices, various mobile applications that help children with physical activities have been studied. This paper presents SandUp, a mobile application that guides the play of building sand castles using artificial intelligence and augmented reality(AR) technology. In the process of building the sandcastle, children can interactively explore the target virtual sandcastle through the smartphone display using AR technology. In addition, to help children complete the sandcastle, SandUp informs the sand shape and task required step by step and provides visual and auditory feedback while recognizing progress in real-time using the phone's camera and deep learning classification. We prototyped our SandUp app using Flutter and TensorFlow Lite. To evaluate the usability and effectiveness of the proposed SandUp, we conducted a questionnaire survey on 50 adults and a user study on 20 children aged 4~7 years. The survey results showed that SandUp effectively helps build the sandcastle with proper interactive guidance. Based on the results from the user study on children and feedback from their parents, we also derived usability issues that can be further improved and suggested future research directions.

Methodologies for Enhancing Immersiveness in AR-based Product Design (증강현실 기반 제품 디자인의 몰입감 향상 기법)

  • Ha, Tae-Jin;Kim, Yeong-Mi;Ryu, Je-Ha;Woo, Woon-Tack
    • Journal of the Institute of Electronics Engineers of Korea CI
    • /
    • v.44 no.2 s.314
    • /
    • pp.37-46
    • /
    • 2007
  • In this paper, we propose technologies for enhancing the immersive realization of virtual objects in AR-based product design. Generally, multimodal senses such as visual/auditory/tactile feedback are well known as a method for enhancing the immersion in case of interaction with virtual objects. By adapting tangible objects we can provide touch sensation to users. A 3D model of the same scale overlays the whole area of the tangible object so the marker area is invisible. This contributes to enhancing immersion. Also, the hand occlusion problem when the virtual objects overlay the user's hands is partially solved, providing more immersive and natural images to users. Finally, multimodal feedback also creates better immersion. In our work, both vibrotactile feedback through page motors, pneumatic tactile feedback, and sound feedback are considered. In our scenario, a game-phone model is selected, by way of proposed augmented vibrotactile feedback, hands occlusion-reduced visual effects and sound feedback are provided to users. These proposed methodologies will contribute to a better immersive realization of the conventional AR system.