• 제목/요약/키워드: Visual and Auditory Feedback

Search Result 50, Processing Time 0.022 seconds

User Needs for Haptic Communication of VR Fashion Product Shopping

  • Kim, Jongsun;Ha, Jisoo
    • Fashion & Textile Research Journal
    • /
    • v.21 no.4
    • /
    • pp.401-411
    • /
    • 2019
  • Non-contact judgment and evaluation for products are increasingly needed along with a rapid environmental change in fashion that sows urgency in the need to implement services that allows users to judge and experience a tactile sense in a fashion product without actual contact. Technological development is required to provide users with syn-aesthetic experiences that integrate the visual, tactile and the auditory. There is also a need to conduct research to increase immersion that provides users with ICT-related experiences communicated through fashion images. The study analyzed demands for haptic communication technology by Korean users in immersive VR fashion product shopping. Accordingly, it defined haptic communication through literature research, investigated immersion in the VR environment and conducted in-depth interviews for haptic communication applicable to VR shopping. Findings show that hedonic reactions by fantasy, emotion and fun function are an important motive in selecting VR shopping. VR fashion product shopping steps were divided into 4: move to store, search in store, search of product and purchase based on offline store shopping experience. It defined the haptic communication by steps and analyzed the types of the haptic feedback to be implemented. The study results provide basic data for developing haptic communication technology that can enhance e a sense of the presence and immersion experiences that can help lay a groundwork for pilot studies on the convergence of the virtual and the real.

Challenges in neuro-machine interaction based active robotic rehabilitation of stroke patients

  • Song, Aiguo;Yang, Renhuan;Xu, Baoguo;Pan, Lizheng;Li, Huijun
    • Advances in robotics research
    • /
    • v.1 no.2
    • /
    • pp.155-169
    • /
    • 2014
  • Study results in the last decades show that amount and quality of physical exercises, then the active participation, and now the cognitive involvement of patient in rehabilitation training are known of crux to enhance recovery outcome of motor dysfunction patients after stroke. Rehabilitation robots mainly have been developing along this direction to satisfy requirements of recovery therapy, or focusing on one or more of the above three points. Therefore, neuro-machine interaction based active rehabilitation robot has been proposed for assisting paralyzed limb performing designed tasks, which utilizes motor related EEG, UCSDI (Ultrasound Current Source Density Imaging), EMG for rehabilitation robot control and feeds back the multi-sensory interaction information such as visual, auditory, force, haptic sensation to the patient simultaneously. This neuro-controlled and perceptual rehabilitation robot will bring great benefits to post-stroke patients. In order to develop such kind of robot, some key technologies such as noninvasive precise detection of neural signal and realistic sensation feedback need to be solved. There are still some grand challenges in solving the fundamental questions to develop and optimize such kind of neuro-machine interaction based active rehabilitation robot.

Perceptual, Acoustical, and Physiological Tools in Ataxic Dysarthria Management: A Case Report (운동실조형 마비성구음장애에 적용되는 지각적, 음향학적, 생리학적 도구에 관하여 - 환자사례를 중심으로 -)

  • Kim Hyang Hui
    • Proceedings of the KSPS conference
    • /
    • 1996.02a
    • /
    • pp.9-22
    • /
    • 1996
  • Among the various dysarthric subtypes, diagnosis of ataxic dysarthria is rendered when the speech characteristics include imprecise and irregular articulatory breakdowns, marked degree of speech rate impairment, overall monopitch and monoloudness, and respiratory-articulatory incoordination. Traditionally, speech pathologists have relied only upon their ‘ears’ to describe and evaluate the dysarthric speech. A statement of percentage of correct words identified by a listener do not provide so much more than an index of severity. Within the same perceptual dimension, a carefully constructed speech intelligibility test can specify patterns of errors. The patterns can contain a diagnostic value as well as Provide strategies for remediation. The phonetically transcribed texts on single words and a standard passage, 'kail' produced by an ataxic dysarthria are presented in this report, with an emphasis of the articulatory error analysis. Furthermore,, acoustic tools [e.g., spectrography to measure formant transitions, segment durations, consonant spectra, etc.] are utilized to serve as basic measures that objectively document patients' speech intelligibility, Finally, the treatment methods [e.g., spectrography as a visual feedback, gestural reorganization using pacing method, DAF (Delayed Auditory Feedback)] to modify the dysarthric behaviors are presented.

  • PDF

A study of effective contents construction for AR based English learning (AR기반 영어학습을 위한 효과적 콘텐츠 구성 방향에 대한 연구)

  • Kim, Young-Seop;Jeon, Soo-Jin;Lim, Sang-Min
    • Journal of The Institute of Information and Telecommunication Facilities Engineering
    • /
    • v.10 no.4
    • /
    • pp.143-147
    • /
    • 2011
  • The system using augmented reality can save the time and cost. It is verified in various fields under the possibility of a technology by solving unrealistic feeling in the virtual space. Therefore, augmented reality has a variety of the potential to be used. Generally, multimodal senses such as visual/auditory/tactile feed back are well known as a method for enhancing the immersion in case of interaction with virtual object. By adapting tangible object we can provide touch sensation to users. a 3D model of the same scale overlays the whole area of the tangible object; thus, the marker area is invisible. This contributes to enhancing immersive and natural images to users. Finally, multimodal feedback also creates better immersion. In this paper, sound feedback is considered. By further improving immersion learning augmented reality for children with the initial step learning content is presented. Augmented reality is in the intermediate stages between future world and real world as well as its adaptability is estimated more than virtual reality.

  • PDF

Effects of a Posture Correction Feedback System on Upper Body Posture, Muscle Activity, and Fatigue During Computer Typing

  • Subin Kim;Chunghwi Yi;Seohyun Kim;Gyuhyun Han;Onebin Lim
    • Physical Therapy Korea
    • /
    • v.30 no.3
    • /
    • pp.221-229
    • /
    • 2023
  • Background: In modern society, the use of computers accounts for a large proportion of our daily lives. Although substantial research is being actively conducted on musculoskeletal diseases resulting from computer use, there has been a recent surge in interest in improving the working environment for prevention. Objects: This study aimed to examine the effects of posture correction feedback (PCF) on changes in neck posture and muscle activation during computer typing. Methods: The participants performed a computer typing task in two sessions, each lasting 16 minutes. The participant's dominant side was photographed and analyzed using ImageJ software to verify neck posture. Surface electromyography (EMG) was used to confirm the participant's cervical erector spinae (CES) and upper trapezius muscle activities. The EMG signal was analyzed using the percentage of reference voluntary contraction and amplitude probability distribution function (APDF). In the second session, visual and auditory feedback for posture correction was provided if the neck was flexed by more than 15° in the initial position during computer typing. A 20-minute rest period was provided between the two sessions. Results: The neck angle (p = 0.014), CES muscle activity (p = 0.008), and APDF (p = 0.015) showed significant differences depending on the presence of the PCF. Furthermore, significant differences were observed regarding the CES muscle activity (p = 0.001) and APDF (p = 0.002) over time. Conclusion: Our study showed that the feedback system can correct poor posture and reduces unnecessary muscle activation during computer work. The improved neck posture and reduced CES muscle activity observed in this study suggest that neck pain can be prevented. Based on these results, we suggest that the PCF system can be used to prevent neck pain.

Desigining a Feedback for Exercises Using a Wearable Device (웨어러블 디바이스를 활용한 운동 중 피드백 방식 연구 - 근력 운동에 대한 멀티 모달 피드백 적용을 중심으로 -)

  • Yoo, Hyunjin;Maeng, Wookjae;Lee, Joongseek
    • Journal of the HCI Society of Korea
    • /
    • v.11 no.3
    • /
    • pp.23-30
    • /
    • 2016
  • The landscape of the current fitness trackers is not only limited to the aerobic exercises but also the weight training is comparatively excluded. Recently, a few weight training fitness tracker was released, human-computer interaction was not well designed due to the lack of considering the context. Because body movement would be intense while doing exercises, having exercise performers hold or operate a device makes a negative experience. As the wearable device is always inseparable to body, it could provide effective feedback because holding or operating a device is not necessary. Therefore, this study aims to make the exercise performers feel a natural feedback through the wearable device to do effective exercises. As a result, this study identified three findings. First, the information which exercise performers most needed was 'during exercise.' and the most necessary information for exercise performers through wearable device's sensory feedback was about 'pace control' with counting and motivation. Second, the order of the most preferred presentation type of sensory feedback was auditory feedback, haptic feedback and visual feedback. Third, the satisfaction, utility, usefulness score of sensory feedback as same as the personal trainer's feedback. In conclusion, this study illustrated the feedback design implications using a wearable device while doing weight training and the possibilities that wearable device could be substitute for personal trainer.

A Study of virtual experiential marketing factors in the Internet shopping mall (Focused on the Schmitt's experiential marketing factors) (인터넷쇼핑몰 가상체험마케팅 요소에 관한 연구 (Schmitt 체험마케팅 요소를 중심으로))

  • Youn, Soung-Jung
    • Journal of Digital Convergence
    • /
    • v.10 no.9
    • /
    • pp.151-158
    • /
    • 2012
  • This study aims to suggest ways of experiential marketing management plan that the virtual tour service in the internet shopping mall is as a agents and the role of the physical interface of the internet virtual experience. It is a empirical analysis to analyze the relationship among Schmitt's five experiential Marketing elements. By the result, the rankings for high impact experiential marketing feedback relationship of cognitive creativity, composition, relationship between social intimacy, behavioral lifestyle, providing a sense of the acoustic auditory effect, a sense of dimensional visual effects in order. This result means that the intimacy and creativity, giving feedback that the opinion of consumers actively prefer internet shopping mall. In addition, it means more visual rather than auditory experience to provide marketing services and provide the lifestyle behaviors that the customer want in the Internet shopping mall. It is needs to make virtual experiential marketing relationships, strengthen the recognition specificity of these results because of experiential marketing relationship's ultimate purpose is to make the relationship between brand and customer service satisfaction of the Internet shopping mall through strengthening the relationship.

Changes in EEG According to Attention and Concentration Training Programs with Performed Difference Tasks (주의·집중훈련 프로그램의 두 가지 과제수행에 따른 뇌파 변화)

  • Chae, Jung-Byung
    • PNF and Movement
    • /
    • v.12 no.2
    • /
    • pp.97-106
    • /
    • 2014
  • Purpose: The purpose of this study was to investigate changes in EEG through attention. Concentration training and performing tasks are important factors in the improvement of motor learning ability. Methods: In the experiment, 22 healthy people were divided into two groups: the trail making test (TMT) group and the computerized neurocognitive function test (CNT) group. A one-way Neuro Harmony M test to see whether there was a significant difference among the groups. Results: The TMT group showed a significant increase in ${\alpha}$ wave, ${\alpha}$ wave sequence, and ${\beta}$ wave sequence; however, there were no significant differences in SMR wave, SMR wave sequence, and ${\beta}$ wave. The CNT group showed increases in ${\alpha}$ wave, ${\alpha}$ wave sequence, SMR wave, SMR wave sequence, and ${\beta}$ wave sequence; however, there was no significant difference in ${\beta}$ wave. In EEGs before and after two performance tasks were changed, there were significant differences in ${\beta}$ wave, SMR wave, SMR wave sequence; however, there were no significant differences in ${\alpha}$ wave sequence, ${\beta}$ wave, and ${\beta}$ wave sequence. Conclusion: Attention training and concentration training offer feedback and repetition for constant stimulus and response. Moreover, attention training and concentration training can contribute to new studies and motivation by developing fast sensory and motor skills through acceptable visual and auditory stimulation.

Tele-Manipulation of ROBHAZ-DT2 for Hazard Environment Applications

  • Ryu, Dong-Seok;Lee, Jong-Wha;Yoon, Seong-Sik;Kang, Sung-Chul;Song, Jae-Bok;Kim, Mun-Sang
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2003.10a
    • /
    • pp.2051-2056
    • /
    • 2003
  • In this paper, a tele-manipulation in explosive ordnance disposal(EOD) applications is discussed. The ROBHAZ-DT2 is developed as a teleoperated mobile manipulator for EOD. In general, it has been thought that the robot must have appropriate functions and accuracy enough to handle the complicated and dangerous mission. However, the research on the ROBHAZ-DT2 revealed that the teleoperation causes more restrictions and difficulties in EOD mission. Thus to solve the problem, a novel user interface for the ROBHAZ-DT2 is developed, in which the operator can interact with various human senses (i.e. visual, auditory and haptic sense). It enables an operator to control the ROBHAZ-DT2 simply and intuitively. A tele-manipulation control scheme for the ROBHAZ-DT2 is also proposed including compliance control via force feedback. It makes the robot adapt itself to circumstances, while the robot faithfully follows a command of the operator. This paper deals with a detailed description on the user interface and the tele-manipulation control for the ROBHAZ-DT2. An EOD demonstration is conducted to verify the validity of the proposed interface and the control scheme.

  • PDF

Immersive Smart Balance Board with Multiple Feedback (다중 피드백을 지원하는 몰입형 스마트 밸런스 보드)

  • Seung-Yong Lee;Seonho Lee;Junesung Park;Min-Chul Shin;Seung-Hyun Yoon
    • Journal of the Korea Computer Graphics Society
    • /
    • v.30 no.3
    • /
    • pp.171-178
    • /
    • 2024
  • Exercises using a Balance Board (BB) are effective in developing balance, strengthening core muscles, and improving physical fitness and concentration. In particular, the Smart Balance Board (SBB), which integrates with various digital content, provides appropriate feedback compared to traditional balance boards, maximizing the effectiveness of the exercise. However, most systems only offer visual and auditory feedback, failing to evaluate the impact on user engagement, interest, and the accuracy of exercise postures. This study proposes an Immersive Smart Balance Board (I-SBB) that utilizes multiple sensors to enable training with various feedback mechanisms and precise postures. The proposed system, based on Arduino, consists of a gyro sensor for measuring the board's posture, a communication module for wired/wireless communication, an infrared sensor to guide the user's foot placement, and a vibration motor for tactile feedback. The board's posture measurements are smoothly corrected using a Kalman Filter, and the multi-sensor data is processed in real-time using FreeRTOS. The proposed I-SBB is shown to be effective in enhancing user concentration and engagement, as well as generating interest, by integrating with diverse content.