• 제목/요약/키워드: Visual and auditory feedback

검색결과 50건 처리시간 0.024초

User Needs for Haptic Communication of VR Fashion Product Shopping

  • Kim, Jongsun;Ha, Jisoo
    • 한국의류산업학회지
    • /
    • 제21권4호
    • /
    • pp.401-411
    • /
    • 2019
  • Non-contact judgment and evaluation for products are increasingly needed along with a rapid environmental change in fashion that sows urgency in the need to implement services that allows users to judge and experience a tactile sense in a fashion product without actual contact. Technological development is required to provide users with syn-aesthetic experiences that integrate the visual, tactile and the auditory. There is also a need to conduct research to increase immersion that provides users with ICT-related experiences communicated through fashion images. The study analyzed demands for haptic communication technology by Korean users in immersive VR fashion product shopping. Accordingly, it defined haptic communication through literature research, investigated immersion in the VR environment and conducted in-depth interviews for haptic communication applicable to VR shopping. Findings show that hedonic reactions by fantasy, emotion and fun function are an important motive in selecting VR shopping. VR fashion product shopping steps were divided into 4: move to store, search in store, search of product and purchase based on offline store shopping experience. It defined the haptic communication by steps and analyzed the types of the haptic feedback to be implemented. The study results provide basic data for developing haptic communication technology that can enhance e a sense of the presence and immersion experiences that can help lay a groundwork for pilot studies on the convergence of the virtual and the real.

Challenges in neuro-machine interaction based active robotic rehabilitation of stroke patients

  • Song, Aiguo;Yang, Renhuan;Xu, Baoguo;Pan, Lizheng;Li, Huijun
    • Advances in robotics research
    • /
    • 제1권2호
    • /
    • pp.155-169
    • /
    • 2014
  • Study results in the last decades show that amount and quality of physical exercises, then the active participation, and now the cognitive involvement of patient in rehabilitation training are known of crux to enhance recovery outcome of motor dysfunction patients after stroke. Rehabilitation robots mainly have been developing along this direction to satisfy requirements of recovery therapy, or focusing on one or more of the above three points. Therefore, neuro-machine interaction based active rehabilitation robot has been proposed for assisting paralyzed limb performing designed tasks, which utilizes motor related EEG, UCSDI (Ultrasound Current Source Density Imaging), EMG for rehabilitation robot control and feeds back the multi-sensory interaction information such as visual, auditory, force, haptic sensation to the patient simultaneously. This neuro-controlled and perceptual rehabilitation robot will bring great benefits to post-stroke patients. In order to develop such kind of robot, some key technologies such as noninvasive precise detection of neural signal and realistic sensation feedback need to be solved. There are still some grand challenges in solving the fundamental questions to develop and optimize such kind of neuro-machine interaction based active rehabilitation robot.

운동실조형 마비성구음장애에 적용되는 지각적, 음향학적, 생리학적 도구에 관하여 - 환자사례를 중심으로 - (Perceptual, Acoustical, and Physiological Tools in Ataxic Dysarthria Management: A Case Report)

  • 김향희
    • 대한음성학회:학술대회논문집
    • /
    • 대한음성학회 1996년도 2월 학술대회지
    • /
    • pp.9-22
    • /
    • 1996
  • Among the various dysarthric subtypes, diagnosis of ataxic dysarthria is rendered when the speech characteristics include imprecise and irregular articulatory breakdowns, marked degree of speech rate impairment, overall monopitch and monoloudness, and respiratory-articulatory incoordination. Traditionally, speech pathologists have relied only upon their ‘ears’ to describe and evaluate the dysarthric speech. A statement of percentage of correct words identified by a listener do not provide so much more than an index of severity. Within the same perceptual dimension, a carefully constructed speech intelligibility test can specify patterns of errors. The patterns can contain a diagnostic value as well as Provide strategies for remediation. The phonetically transcribed texts on single words and a standard passage, 'kail' produced by an ataxic dysarthria are presented in this report, with an emphasis of the articulatory error analysis. Furthermore,, acoustic tools [e.g., spectrography to measure formant transitions, segment durations, consonant spectra, etc.] are utilized to serve as basic measures that objectively document patients' speech intelligibility, Finally, the treatment methods [e.g., spectrography as a visual feedback, gestural reorganization using pacing method, DAF (Delayed Auditory Feedback)] to modify the dysarthric behaviors are presented.

  • PDF

AR기반 영어학습을 위한 효과적 콘텐츠 구성 방향에 대한 연구 (A study of effective contents construction for AR based English learning)

  • 김영섭;전수진;임상민
    • 정보통신설비학회논문지
    • /
    • 제10권4호
    • /
    • pp.143-147
    • /
    • 2011
  • The system using augmented reality can save the time and cost. It is verified in various fields under the possibility of a technology by solving unrealistic feeling in the virtual space. Therefore, augmented reality has a variety of the potential to be used. Generally, multimodal senses such as visual/auditory/tactile feed back are well known as a method for enhancing the immersion in case of interaction with virtual object. By adapting tangible object we can provide touch sensation to users. a 3D model of the same scale overlays the whole area of the tangible object; thus, the marker area is invisible. This contributes to enhancing immersive and natural images to users. Finally, multimodal feedback also creates better immersion. In this paper, sound feedback is considered. By further improving immersion learning augmented reality for children with the initial step learning content is presented. Augmented reality is in the intermediate stages between future world and real world as well as its adaptability is estimated more than virtual reality.

  • PDF

Effects of a Posture Correction Feedback System on Upper Body Posture, Muscle Activity, and Fatigue During Computer Typing

  • Subin Kim;Chunghwi Yi;Seohyun Kim;Gyuhyun Han;Onebin Lim
    • 한국전문물리치료학회지
    • /
    • 제30권3호
    • /
    • pp.221-229
    • /
    • 2023
  • Background: In modern society, the use of computers accounts for a large proportion of our daily lives. Although substantial research is being actively conducted on musculoskeletal diseases resulting from computer use, there has been a recent surge in interest in improving the working environment for prevention. Objects: This study aimed to examine the effects of posture correction feedback (PCF) on changes in neck posture and muscle activation during computer typing. Methods: The participants performed a computer typing task in two sessions, each lasting 16 minutes. The participant's dominant side was photographed and analyzed using ImageJ software to verify neck posture. Surface electromyography (EMG) was used to confirm the participant's cervical erector spinae (CES) and upper trapezius muscle activities. The EMG signal was analyzed using the percentage of reference voluntary contraction and amplitude probability distribution function (APDF). In the second session, visual and auditory feedback for posture correction was provided if the neck was flexed by more than 15° in the initial position during computer typing. A 20-minute rest period was provided between the two sessions. Results: The neck angle (p = 0.014), CES muscle activity (p = 0.008), and APDF (p = 0.015) showed significant differences depending on the presence of the PCF. Furthermore, significant differences were observed regarding the CES muscle activity (p = 0.001) and APDF (p = 0.002) over time. Conclusion: Our study showed that the feedback system can correct poor posture and reduces unnecessary muscle activation during computer work. The improved neck posture and reduced CES muscle activity observed in this study suggest that neck pain can be prevented. Based on these results, we suggest that the PCF system can be used to prevent neck pain.

웨어러블 디바이스를 활용한 운동 중 피드백 방식 연구 - 근력 운동에 대한 멀티 모달 피드백 적용을 중심으로 - (Desigining a Feedback for Exercises Using a Wearable Device)

  • 유현진;맹욱재;이중식
    • 한국HCI학회논문지
    • /
    • 제11권3호
    • /
    • pp.23-30
    • /
    • 2016
  • 현재 피트니스 트래커(fitness tracker)시장은 유산소 운동에만 초점을 맞춰 근력 운동 분야는 상대적으로 소외되어 있다. 최근 근력 운동 피트니스 트래커가 소수 출시되고 있으나, 운동 상황에 대한 고려가 부족하여 사람-기기 간 인터랙션에 불편함을 초래한다. 특히, 운동 중에는 신체의 움직임이 활발하므로, 손으로 기기를 휴대하거나 기기를 조작하는 상황은 사용자에게 부정적 경험을 유발한다. 웨어러블 디바이스는 항시적인 착용이 가능하므로, 손과 발의 사용이 자유로워 운동 중 피드백 제공에 효과적이다. 따라서, 이 연구에서는 웨어러블 디바이스를 통해 피드백을 감각하게 함으로써, 운동 수행자가 효과적인 운동을 할 수 있도록 하는 것을 목적으로 한다. 이 연구에서는 다음 세 가지 연구 문제를 검증하였다. 1) 운동 상황에서 필요한 정보는 무엇인가? 2) 근력 운동 중, 어떤 감각 피드백이 선호되는가? 3) 근력 운동 중, 감각 피드백의 가치는 무엇인가? 그 결과, 첫째, 운동 수행자는 운동 단계 중, '운동 중'에 해당하는 정보가 가장 필요하다고 하였으며 '페이스 조절(횟수 카운팅, 동기 부여)'과 '자세 지도(문제점 진단, 자세 교정)'에 해당하는 정보를 가장 필요로 하였다. 둘째, 운동 중 선호되는 감각 피드백에 대해서는 청각 피드백, 촉각 피드백, 시각 피드백 순으로 만족도가 높았으며, 운동 강도가 높을수록 감각 피드백에 대한 만족도가 더 높았다. 셋째, 감각 피드백과 기기 피드백의 가치에 대해 비교한 결과, 기기 피드백과 사람이 제공하는 피드백에 대한 만족도, 유용성, 효용성이 비슷하게 나타났다. 결론적으로, 이 연구에서는 근력 운동 중, 웨어러블 디바이스를 활용한 감각 피드백의 디자인 가이드라인을 도출하였으며, 웨어러블 디바이스의 감각 피드백이 사람이 제공하는 피드백을 대체할 수 있다는 가능성을 확인하였다.

인터넷쇼핑몰 가상체험마케팅 요소에 관한 연구 (Schmitt 체험마케팅 요소를 중심으로) (A Study of virtual experiential marketing factors in the Internet shopping mall (Focused on the Schmitt's experiential marketing factors))

  • 윤성중
    • 디지털융복합연구
    • /
    • 제10권9호
    • /
    • pp.151-158
    • /
    • 2012
  • 본 연구는 가상체험마케팅서비스가 인터넷쇼핑몰의 물리적인 인터페이스환경에서 고객 에이전트 서비스를 하고 있다고 보고, 가상체험마케팅 환경에서의 Schmitt 체험마케팅요소 5가지를 실증분석 하고 이 요소간의 관계를 분석하여 인터넷쇼핑몰 체험마케팅 관리방안을 제시하는데 목적을 두고 있다. 분석결과, 감각변수는 평면적 시각효과 음향적 청각효과, 인지변수는 창의성 서비스, 행동변수는 라이프스타일 제공과 사용모습 모델제시, 관계변수는 사용모습 모델 제시 항목으로 인식 되었고 감성은 어떤 항목으로도 인식되지 않았다. 이러한 결과는 대전지역 대학생들은 인터넷쇼핑몰에서 고객에게 제공하는 가상체험마케팅 서비스의 중요한 요소로서 라이프스타일을 제공하고 청각적인 효과와 모델을 제시하는 창의적인 서비스가 제공되기를 원하는 것을 의미한다. 따라서 인터넷쇼핑몰 사이트 마케팅관리자는 급변하는 인터넷환경에서의 스마트하고 다양한 고객의 욕구 변화에 대응할 수 있는 가상체험서비스 시스템 구축에 적극적으로 투자하고 가상체험마케팅 요소 중에서 특히 행동과 감각 그리고 인지분야에 초점을 두어 고객의 잠재욕구를 발견하기 위한 과학적인 가상체험마케팅조사를 실시하여 고객이 플로우(flow)를 느낄 수 있는 수준의 가상체험마케팅 환경을 구축하기 위한 전략 수립이 필요하다.

주의·집중훈련 프로그램의 두 가지 과제수행에 따른 뇌파 변화 (Changes in EEG According to Attention and Concentration Training Programs with Performed Difference Tasks)

  • 채정병
    • PNF and Movement
    • /
    • 제12권2호
    • /
    • pp.97-106
    • /
    • 2014
  • Purpose: The purpose of this study was to investigate changes in EEG through attention. Concentration training and performing tasks are important factors in the improvement of motor learning ability. Methods: In the experiment, 22 healthy people were divided into two groups: the trail making test (TMT) group and the computerized neurocognitive function test (CNT) group. A one-way Neuro Harmony M test to see whether there was a significant difference among the groups. Results: The TMT group showed a significant increase in ${\alpha}$ wave, ${\alpha}$ wave sequence, and ${\beta}$ wave sequence; however, there were no significant differences in SMR wave, SMR wave sequence, and ${\beta}$ wave. The CNT group showed increases in ${\alpha}$ wave, ${\alpha}$ wave sequence, SMR wave, SMR wave sequence, and ${\beta}$ wave sequence; however, there was no significant difference in ${\beta}$ wave. In EEGs before and after two performance tasks were changed, there were significant differences in ${\beta}$ wave, SMR wave, SMR wave sequence; however, there were no significant differences in ${\alpha}$ wave sequence, ${\beta}$ wave, and ${\beta}$ wave sequence. Conclusion: Attention training and concentration training offer feedback and repetition for constant stimulus and response. Moreover, attention training and concentration training can contribute to new studies and motivation by developing fast sensory and motor skills through acceptable visual and auditory stimulation.

Tele-Manipulation of ROBHAZ-DT2 for Hazard Environment Applications

  • Ryu, Dong-Seok;Lee, Jong-Wha;Yoon, Seong-Sik;Kang, Sung-Chul;Song, Jae-Bok;Kim, Mun-Sang
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 2003년도 ICCAS
    • /
    • pp.2051-2056
    • /
    • 2003
  • In this paper, a tele-manipulation in explosive ordnance disposal(EOD) applications is discussed. The ROBHAZ-DT2 is developed as a teleoperated mobile manipulator for EOD. In general, it has been thought that the robot must have appropriate functions and accuracy enough to handle the complicated and dangerous mission. However, the research on the ROBHAZ-DT2 revealed that the teleoperation causes more restrictions and difficulties in EOD mission. Thus to solve the problem, a novel user interface for the ROBHAZ-DT2 is developed, in which the operator can interact with various human senses (i.e. visual, auditory and haptic sense). It enables an operator to control the ROBHAZ-DT2 simply and intuitively. A tele-manipulation control scheme for the ROBHAZ-DT2 is also proposed including compliance control via force feedback. It makes the robot adapt itself to circumstances, while the robot faithfully follows a command of the operator. This paper deals with a detailed description on the user interface and the tele-manipulation control for the ROBHAZ-DT2. An EOD demonstration is conducted to verify the validity of the proposed interface and the control scheme.

  • PDF

다중 피드백을 지원하는 몰입형 스마트 밸런스 보드 (Immersive Smart Balance Board with Multiple Feedback)

  • 이승용;이선호;박준성;신민철;윤승현
    • 한국컴퓨터그래픽스학회논문지
    • /
    • 제30권3호
    • /
    • pp.171-178
    • /
    • 2024
  • 밸런스 보드 (Balance Board, BB)를 활용한 운동은 균형 감각 발달, 코어 근육 강화 등 신체 운동 능력 향상과 집중력 증진에 효과적이다. 특히, 다양한 디지털 콘텐츠와 연동되는 스마트 밸런스 보드 (Smart Balance Board, SBB)는 기존 밸런스 보드에 비해 적절한 피드백을 제공하여 운동 효과를 극대화한다. 그러나 대부분의 시스템들은 시/청각적인 피드백만 제공하여 사용자의 운동 몰입도 및 흥미 그리고 운동 자세의 정확성에 미치는 영향을 평가하지 못한다. 본 연구에서는 멀티 센서를 활용하여 다양한 피드백과 정확한 자세로 훈련이 가능한 몰입형 스마트 밸런스 보드 (Imemersive-SBB, I-SBB)를 제안한다. 제안된 시스템은 아두이노 기반으로 보드의 자세을 측정하는 자이로 센서, 유/무선 통신을 위한 통신 모듈, 사용자의 정확한 발 위치를 유도하는 적외선 센서, 촉각 피드백을 위한 진동 모터로 구성되어 있다. 측정된 보드의 자세는 칼만 필터 (Kalman Filter)를 이용하여 부드럽게 보정되고, 멀티 센서 데이터는 FreeRTOS를 활용해 실시간으로 병렬처리된다. 제안된 I-SBB는 다양한 콘텐츠와 연동하여 사용자의 집중도 및 몰입도 향상과 흥미 유발에 효과적임을 보인다.