• Title/Summary/Keyword: Visual Modality

Search Result 113, Processing Time 0.025 seconds

Effects of Multi-modality Cues on Personal Navigation in Wearable Computing (웨어러블 컴퓨터 환경의 개인 네비게이션 수행에 다중양식 단서가 미치는 영향)

  • Jeon, Ha-Young;Chae, Haeng-Suk;Hong, Ji-Young;Han, Kwang-Hee
    • Journal of the Ergonomics Society of Korea
    • /
    • v.26 no.4
    • /
    • pp.1-7
    • /
    • 2007
  • Navigation system or way finding in Wearable computer help disabled and impaired persons and it is impossible to be safe and efficient for drivers as well as pedestrian. Wearable computing situation must be multi-tasking simultaneously and users need minimal attention. In this paper, we used virtual environment as real way-finding similarly. The direction cues of navigation system are investigated as visual only, visual & auditory, and visual & speech. In the paper, the trial demonstrates the difference of performance in detection of directing and performance of motor and subjective satisfaction of user.

Measuring Visual Attention Processing of Virtual Environment Using Eye-Fixation Information

  • Kim, Jong Ha;Kim, Ju Yeon
    • Architectural research
    • /
    • v.22 no.4
    • /
    • pp.155-162
    • /
    • 2020
  • Numerous scholars have explored the modeling, control, and optimization of energy systems in buildings, offering new insights about technology and environments that can advance industry innovation. Eye trackers deliver objective eye-gaze data about visual and attentional processes. Due to its flexibility, accuracy, and efficiency in research, eye tracking has a control scheme that makes measuring rapid eye movement in three-dimensional space possible (e.g., virtual reality, augmented reality). Because eye movement is an effective modality for digital interaction with a virtual environment, tracking how users scan a visual field and fix on various digital objects can help designers optimize building environments and materials. Although several scholars have conducted Virtual Reality studies in three-dimensional space, scholars have not agreed on a consistent way to analyze eye tracking data. We conducted eye tracking experiments using objects in three-dimensional space to find an objective way to process quantitative visual data. By applying a 12 × 12 grid framework for eye tracking analysis, we investigated how people gazed at objects in a virtual space wearing a headmounted display. The findings provide an empirical base for a standardized protocol for analyzing eye tracking data in the context of virtual environments.

The Implementation of Real-Time Speaker Localization Using Multi-Modality (멀티모달러티를 이용한 실시간 음원추적 시스템 구현)

  • Park, Jeong-Ok;Na, Seung-You;Kim, Jin-Young
    • Proceedings of the KIEE Conference
    • /
    • 2004.11c
    • /
    • pp.459-461
    • /
    • 2004
  • This paper presents an implementation of real-time speaker localization using audio-visual information. Four channels of microphone signals are processed to detect vertical as well as horizontal speaker positions. At first short-time average magnitude difference function(AMDF) signals are used to determine whether the microphone signals are human voices or not. And then the orientation and distance information of the sound sources can be obtained through interaural time difference and interaual level differences. Finally visual information by a camera helps get finer tuning of the speaker orientation. Experimental results of the real-time localization system show that the performance improves to 99.6% compared to the rate of 88.8% when only the audio information is used.

  • PDF

The Clinical Study on the Effect of Acupotomy in Shoulder Disease (침도침 시술이 견관절 질환에 미치는 영향에 관한 임상적 고찰)

  • Kim, Yeon-Mi;Hong, Kwon-Eui
    • Journal of Acupuncture Research
    • /
    • v.25 no.4
    • /
    • pp.141-148
    • /
    • 2008
  • Objectives : The purpose of this study is to report the effect of acupotomy for patients with shoulder disease. Methods : We treated Five patients who have shoulder disease with acupotomy. To check the effect and satisfaction of acupotomy we used visual analog scale(VAS) and Five-point Likert scale. At the same time, we measured Change of shoulder range of motion(ROM). Results : After treatment pain were improved, VAS score decreased significantly to 2.5. The Likert scale point were checked 4.4, the patients were satisfied with the effect of acupotomy. Conclusions : This study shows acupotomy has useful effect on shoulder disease. An acupotomy is an alternative effective treatment modality for shoulder disease.

  • PDF

The Clinical Study on the Effect of Acupotomy on Chronic Arthritis of Ankle (침도침 시술을 시행한 만성 족관절 염좌 환자 2례에 대한 증례보고)

  • Kim, Min-Jung;Hong, Kwon-Eui
    • Journal of Acupuncture Research
    • /
    • v.25 no.4
    • /
    • pp.157-162
    • /
    • 2008
  • Objectives : The purpose of this study is to report the effect of acupotomy for patients with chronic arthritis of ankle. Methods : We treated Two patients who have chronic arthritis of ankle with acupotomy. To check the effect and satisfaction of acupotomy we used visual analog scale(VAS) and Five-point Likert scale. At the same time, we measured Change of ankle range of motion(ROM). Results : As a result of evaluation by using VAS, after treatment VAS score decreased(VAS3, VAS5). ROM of ankle widened. And the Likert scale point were checked 3 and 4. Conclusions : This study shows acupotomy has useful effect on chronic arthritis of ankle. An acupotomy is an alternative effective treatment modality for chronic arthritis of ankle.

  • PDF

Effect of 8 Direction Incline and Rotation Exercise on Pain and Dynamic Balance in the Patients with Chronic Low Back Pain (8방향 경사와 회전 운동이 만성요통환자의 통증과 동적균형에 미치는 영향)

  • Goo, Bong-Oh;Park, Min-Chull;Song, Yoo-Yik;Cho, Ye-Rim
    • The Journal of the Korea Contents Association
    • /
    • v.10 no.9
    • /
    • pp.285-292
    • /
    • 2010
  • The purpose of this study is to investigate the effect of 8 direction incline and rotation exercise on pain and dynamic balance in the patients with chronic low back pain(CLBP). 20 patients who were diagnosed with CLBP were included for the study. 10 patients(experimental group) were treated by modality{Hot Pack(H/P), Transcutaneous Electric Nerve Stimulation(TENS), Ultra Sound(U/S)} and then performed 8 direction incline and rotation exercise. The other 10 patients(control group) were only treated by modality. The therapeutic intervention was taken three times a week for 6 weeks. Dynamic balance was assessed by Star Excursion Balance Test(SEBT) and pain was assessed by Visual Analog Scale(VAS). VAS scores of both groups were decreased. However, the experimental group was more significantly decreased than the control group. The dynamic balance of both groups was significantly increased in anterior, posterior, medial, lateral direction. But experimental group was more significantly increased than the control group. In conclusion, 8 direction incline and rotation exercise was effective on pain and dynamic balance in CLPB.

A New Training System for Improving Postural Balance Using a Tilting Bed

  • Yu, Chang-Ho;Kwon, Tae-Kyu;Ryu, Mun-Ho;Kim, Nam-Gyun
    • Journal of Biomedical Engineering Research
    • /
    • v.28 no.1
    • /
    • pp.117-126
    • /
    • 2007
  • In this paper, we propose an early rehabilitation training system for the improvement of postural balance with multi-modality on a tilting bed. The integration of the visual, somatosensory and vestibular functions is significant to for maintaining the postural control of the human body. However, conventional rehabilitation systems do not provide multi-modality to trainees. We analyzed the characterization of postural control at different tilt angles of an early rehabilitation training system, which consists of a tilting bed, a visual feedback, a computer interface, a computer, and a force plate. The software that we developed for the system consists of the training programs and the analysis programs. To evaluate the characterization of postural control, we conducted the first evaluation before the beginning of the training. In the following four weeks, 12 healthy young and 5 healthy elderly subjects were trained to improve postural control using the training programs with the tilting bed. After four weeks of training, we conducted the second evaluation. The analysis programs assess (center of pressure) COP moving time, COP maintaining time, and mean absolute deviation of the trace before and after training at different tilt angles on the bed. After 4 weeks, the COP moving time was reduced, the COP maintaining time was lengthened, and the mean absolute deviation of the trace was lowered through the repeated use of vertical, horizontal, dynamic circle movement training programs. These results show that this system improves postural balance and could be applied to clinical use as an effective training system.

Emotion Recognition Implementation with Multimodalities of Face, Voice and EEG

  • Udurume, Miracle;Caliwag, Angela;Lim, Wansu;Kim, Gwigon
    • Journal of information and communication convergence engineering
    • /
    • v.20 no.3
    • /
    • pp.174-180
    • /
    • 2022
  • Emotion recognition is an essential component of complete interaction between human and machine. The issues related to emotion recognition are a result of the different types of emotions expressed in several forms such as visual, sound, and physiological signal. Recent advancements in the field show that combined modalities, such as visual, voice and electroencephalography signals, lead to better result compared to the use of single modalities separately. Previous studies have explored the use of multiple modalities for accurate predictions of emotion; however the number of studies regarding real-time implementation is limited because of the difficulty in simultaneously implementing multiple modalities of emotion recognition. In this study, we proposed an emotion recognition system for real-time emotion recognition implementation. Our model was built with a multithreading block that enables the implementation of each modality using separate threads for continuous synchronization. First, we separately achieved emotion recognition for each modality before enabling the use of the multithreaded system. To verify the correctness of the results, we compared the performance accuracy of unimodal and multimodal emotion recognitions in real-time. The experimental results showed real-time user emotion recognition of the proposed model. In addition, the effectiveness of the multimodalities for emotion recognition was observed. Our multimodal model was able to obtain an accuracy of 80.1% as compared to the unimodality, which obtained accuracies of 70.9, 54.3, and 63.1%.

Physiological manifestations of the modulation of post-stress recovery process by emotion-inducing stimulation of auditory and visual modality (시각자극에 의해 유발된 스트레스 생리반응의 회복과정에 미치는 정서청각자극의 효과)

  • Estate Sokhadze
    • Proceedings of the Korean Society for Emotion and Sensibility Conference
    • /
    • 1998.04a
    • /
    • pp.44-56
    • /
    • 1998
  • Effects of the music and white noise on recovery of the autonomic and cortical responses evoked by aversive visual stimulation were analyzed in 20 subjects. It was suggested that the music is able to exert modulatory influence on the physiological activity resulted from exposure to unpleasant IAPS based stimuli. Spectral power of DDG, heart rate(HR)respiration rate (RSR) and electrodermal activity(EDA)were recorded and analyzed for each experimental condition. It was observed HR and RSR deceleration, increased EDA and electrocortical activation expressed in decreased alpha power and increase of delta activity ao occipital and frontal areas. Obtained results suggest that audutory stimulation both with pleasant and sad music lead to restoration of pre-stimulation activation levels of most physiological parameters during listenning to music and in post-stimulation period. White noise evoked short-term physiological responses typical for orienting reaction and quite distinct from changes produced by music. Available data to differentiate effeces among pleasant and sad music, due toqualitative similarities of physilolgical patterns, but suppert an assumption that music is capable to facilitate the process of recovery of physilolgical responses elicited by visual stimulation of negative valence, thus positively modulate post-stress state.

  • PDF

Alarm substance Detection and Fright Reaction in Giant Danio (Danio malabaricus)

  • Sung Hwaon Cho
    • Journal of Aquaculture
    • /
    • v.12 no.1
    • /
    • pp.63-69
    • /
    • 1999
  • A series of experiments were conducted to examine on what stimulus giant danio (Danio malabaricus) were mainly responsible for detecting alarm substance. When 0.15 ml alarm substance (10 ppm) was introduced into the tank, fish showed no notable change in swimming pattern. However, the introduction of 1.5 ml alarm substance (100 ppm) could induce fright reaction about in 6 minutes. Further, when 15 ml alarm substance (1,000 ppm) was introduced into the tank, fish showed the following fright reaction in a few seconds; suppressing to feed diet, no swimming, strong chasing, and visual alertness. In detecting alarm substance, fish were mainly depending on the chemical stimulus (nares) rather than the vision stimulus (eyes) because fish detected alarm substance by the chemical cue showed the significantly stronger fright reaction than by the visual cue. The time for fish to show the initial fright reaction after detecting alarm substance by the chemical cue was shorter than by the visual cue. Also after alarm substance was introduced into the tank, olfaction-deprived fish showed significantly weaker fright reaction and less frequency of chasing than the normal fish which detected alarm substance by both olfaction and gustation stimulus. These results indicated that chemical stimulus, especially olfaction might be the primary sensory modality used in the detection of the alarm substance for giant danio.

  • PDF