• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2009.01a
• /
• pp.664-667
• /
• 2009

There is strong demand to create wearable PC systems that can support the user outdoors. When we are outdoors, our movement makes it impossible to use traditional input devices such as keyboards and mice. We propose a hand gesture interface based on image processing to operate wearable PCs. The semi-transparent PC screen is displayed on the head mount display (HMD), and the user makes hand gestures to select icons on the screen. The user's hand is extracted from the images captured by a color camera mounted above the HMD. Since skin color can vary widely due to outdoor lighting effects, a key problem is accurately discrimination the hand from the background. The proposed method does not assume any fixed skin color space. First, the image is divided into blocks and blocks with similar average color are linked. Contiguous regions are then subjected to hand recognition. Blocks on the edges of the hand region are subdivided for more accurate finger discrimination. A change in hand shape is recognized as hand movement. Our current input interface associates a hand grasp with a mouse click. Tests on a prototype system confirm that the proposed method recognizes hand gestures accurately at high speed. We intend to develop a wider range of recognizable gestures.

• The Journal of the Korea Contents Association
• /
• v.18 no.1
• /
• pp.487-492
• /
• 2018

The purpose of the study is discovering the effects of different VR devices in learning. For this purpose, this study conducted experiments in HMD and Tablet PC learning environments to analyze differences in device characteristics according to technological evolution. In the experimentation, 37 test subject members were involved and Talklish program, English education service, were used as a learning content. The results showed that the learning method using HMD VR has a higher level of immersion, social consciousness, and learning motivation than Tablet PC methods.

• Journal of the Korea Institute of Military Science and Technology
• /
• v.23 no.3
• /
• pp.257-266
• /
• 2020

It is very important to share tactical information such as video, images, and text messages among soldiers for situational awareness. Under the wireless environment of the battlefield, the available bandwidth varies dynamically and is insufficient to transmit high quality images, so it is necessary to minimize the distortion of the area of interests such as targets. A natural operating method for soldiers is also required considering the difficulty in handling while moving. In this paper, we propose a natural ROI(region of interest) setting and image compression method for effective image sharing among soldiers. We verify the proposed method through prototype system design and implementation of eye gaze detection and ROI-based image compression.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2015.07a
• /
• pp.524-526
• /
• 2015

본 논문은 자유 시점조절과 깊이감 조절이 가능한 단일렌즈 양안시 3D 내시경과 Head-mounted display 를 사용한 새로운 로봇수술 시스템을 제안한다. 최근 들어서 여러 양안식 입체영상장치가 의료 영역에 적용되고 있다. 그러나 3D 의료 장비들은 zooming 과 자유로운 시점조절, 그리고 접사를 하는 데에 한계가 존재한다. 입체영상 장비에서 필연적으로 발생하는 이러한 문제점들은 3D 영화를 찍기 위해서 사용되는 것과 같은 2 대의 카메라와 2 개의 렌즈를 사용하는 데에서 원인을 찾을 수 있다. 이러한 문제점들은 Da Vinci 로봇 수술 시스템과 같은 가장 최신의 시스템에서도 해결되지 못하였다. 본 논문에서 제안하는 새로운 시스템은 지금까지 제시된 문제점들을 해결하고, 현재 존재하는 로봇 수술 시스템에 몰입 입체영상 수술이나 증강 현실 수술을 가능하게 하기 위한 목적으로 제안되었다.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2018.10a
• /
• pp.889-891
• /
• 2018

가상현실 (Virtual Reality, VR) 컨텐츠가 다양해지면서 사용자들의 관심도 높아지고 있다. 초기 VR 컨텐츠는 헤드 마운티드 디스플레이 (Head Mounted Display, HMD)와 컨트롤러만 사용한다. 사용자의 요구가 높아지면서 현실적인 컨텐츠 구현을 위해서 사용자의 신체 움직임으로 제어하는 풀 바디 트래킹(Full Body Tracking) 기술이 도입되고 있다. 머리에 착용하는 HMD와 양손으로 제어하는 두 개의 컨트롤러 뿐만 아니라 모션캡쳐장비, 트래커 장비를 사용자의 다양한 위치에 착용시켜, 세밀한 움직임 트래킹이 가능해졌다. 본 연구에서 서브 모션 기반의 움직임 추적 방법과 이를 기반한 서브모션 시스템을 제안한다. 서브모션 시스템은 VR 컨텐츠에 사용되는 사용하는 센서 위치를 VR캐릭터의 대응되는 위치에 출력하는 방식이 아닌, 사용자의 움직임에 따라 다양한 센서 위치 변화를 인식하고, 이를 기반으로 VR에서 사전에 지정된 모션을 인식 및 출력한다. 사용자의 움직임을 세분화하여 각각의 연속된 서브모션들로 인식하고, 각각의 서브 모션에서 연속적으로 인식 가능한 서브 모션을 분기를 통해 정의하고 인식함으로써 다양하고 자유도 높은 모션 처리가 가능하다. 선행 기술들의 문제점인 고정된 데미지 방식 및 부자연스러운 모션을 해결하고 사용자에게 실제와 같은 동작을 취하도록 유도하여 몰입감등을 부여할 수 있다. 서브 모션들을 자동적으로 생성하는 시스템을 통해 풀 바디 트래킹 VR 컨텐츠에 적용 가능한 엔진을 연구 및 개발하여 해당 산업의 발전에 이바지하고자 한다.

• Journal of radiological science and technology
• /
• v.44 no.2
• /
• pp.123-131
• /
• 2021

In this study, safety education contents for medical radiation workers were produced based on Mixed Reality(MR). Currently, safety training for radiation workers is based on theory. This is insufficient in terms of worker satisfaction and efficiency. To address this, we created ICT(Information and Communication Technologies)-based MR radiation worker safety education content. The expected effect of Mixed Reality worker safety education content is that education is possible without space and time constraints, realistic education is possible without on-site training, and interaction between images is possible through reality-based 3D images, enabling self-directed learning Is that. In addition, learning in a virtual space expressed through HMD(Head Mounted Display) is expected to make education more enjoyable and increase concentration, thereby increasing the efficiency of education. A quantitative evaluation was conducted by an accredited institution and a qualitative evaluation was performed on users, which received excellent evaluation. The MR safety education conducted in this study is expected to be of great help to the education of medical radiation workers, and is expected to develop into a new educational paradigm as online education in accordance with Corona 19 progresses.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.15 no.7
• /
• pp.2531-2546
• /
• 2021

For several years, virtual reality (VR) and augmented reality (AR) technologies have been improving. However, some hurdles remain that slow down the distribution of VR and AR devices, such as head-mounted display (HMD), and related consumer content. One issue is VR motion sickness, which has been experienced by users using 360 degree VR content via HMD. This paper discusses the related international standardization work that classifies the factors causing VR sickness, and proposes the process for VR sickness level evaluation. Among the factors causing VR sickness, many research institutes regard minimizing MTP (Motion-to-Photon) latency as the key enabler to mitigate VR sickness. Thus, this paper introduces research trends of MTP latency measurement and MTP latency mitigation. This paper categorizes the research on MTP latency measurement into 2 categories of hardware-based approach and software code-level approach. The 2 approaches have different pros and cons depending on use-case, purpose, and architecture of each multimedia system. The pros and cons are addressed in this paper. Additionally, the research on mitigating MTP latency with diverse strategies such as proactive computing, caching, and edge server technology is explained, and compared to conventional technologies, shows improved performance.

• Journal of Korea Multimedia Society
• /
• v.24 no.3
• /
• pp.355-372
• /
• 2021

Recently, high-performance HMDs (Head-Mounted Display) are becoming wireless due to the growth of virtual reality technology. Accordingly, environmental constraints on the hardware usage are reduced, enabling multiple users to experience virtual reality within a single space simultaneously. Existing multi-user virtual reality platforms use the user's location tracking and motion sensing technology based on vision sensors and active markers. However, there is a decrease in immersion due to the problem of overlapping markers or frequent matching errors due to the reflected light. Goal of this study is to develop a multi-user virtual reality moving platform in a single space that can resolve sensing errors and user immersion decrease. In order to achieve this goal hybrid sensing technology was developed, which is the convergence of vision sensor technology for position tracking, IMU (Inertial Measurement Unit) sensor motion capture technology and gesture recognition technology based on smart gloves. In addition, integrated safety operation system was developed which does not decrease the immersion but ensures the safety of the users and supports multimodal feedback. A 6 m×6 m×2.4 m test bed was configured to verify the effectiveness of the multi-user virtual reality moving platform for four users.

• Proceedings of the Korea Water Resources Association Conference
• /
• 2023.05a
• /
• pp.110-110
• /
• 2023

기후변화, 도시화 등 다양한 요인에 의하여 도시 침수 위험성은 더욱 커지고 있다. 높은 인구밀도와 더불어 학교, 병원 등 인프라가 집중된 도시지역의 경우 대규모 홍수가 발생할 경우 수많은 인적, 경제적 피해로 이어지게 된다. 도시지역 내 침수 위험성을 최소화하기 위해 정확하고 빠른 도시침수모형의 개발과 더불어 사전에 이를 최소화하기 위한 방재교육의 중요성이 더욱 강조되고 있다. 가상현실 (Virtual Reality, VR) 기술은 높은 몰입감을 통해 사용자의 자발적 참여를 유도하여 기존의 교육매체 대비 높은 교육적 효과를 보이고 있다. 특히 침수 등 인명피해 위험성을 내재한 재해에의 VR 적용은 위험성을 동반하지 않아 더욱 효과적이다. 종래의 VR 기반 침수 방재교육은 침수의 동수역학적 거동과 대상 지역의 지리적 특성을 적절히 고려하지 못하여 방재교육에는 효과적이나 방재시스템으로의 활용엔 한계가 있다. 본 연구는 몰입형 파랑해석모형인 Celeris Base를 토대로 몰입형 도시 침수 수치모형을 개발하였다. Unity3D로 개발된 Celeris Base는 가상현실 장비인 HMD (Head Mounted Display) 기술을 이용하여 실시간 모의결과를 360도 가상현실 공간 내에 가시화할 수 있다. 도시지역 내 강우에 의한 침수를 모의하기 위해 연속방정식 내에 강우, 침투 항을 고려하였다. 침투모형으로는 도시지역 내 침수모의에 일반적으로 사용되는 NRCS-CN 방법을 사용하였다. 본 연구는 개발모형을 이용하여 2022년 8월 발생한 집중호우에 의한 강남역 일대 침수 사상을 수치적으로 재현하고, 이를 가상현실 모의환경 내에 가시화하였다. 모의결과는 집중호우 발생 시 지형적 특성에 따라 강남역과 역삼역 인근에서 집중적으로 침수피해가 발생하였음을 확인하였다.

• International Journal of Advanced Culture Technology
• /
• v.11 no.3
• /
• pp.302-309
• /
• 2023

This study aimed to develop a VR-based digital therapeutic intervention for the diagnosis and treatment of ADHD. The research combined medical data with virtual reality technology to develop an algorithm for ADHD diagnostic scales and implemented a VR-based digital therapeutic platform using a head-mounted display (HMD). This platform can be used for the diagnosis and treatment of ADHD in children and adolescents. Additionally, we four VR games were developed, including archery timing, Antarctic exploration, grocery shopping, and rhythm-based drumming(RBD), incorporating various psychiatric treatment techniques based on cognitive-behavioral therapy(CBT). To evaluate the usability of this digital therapeutic intervention, a group of experts specialized in counseling psychology participated in the study. The evaluations received highly positive feedback regarding the ability to access the system menu while wearing the HMD, the consistency of terminology used in menus and icons, the usage of actual size for 3D graphic elements, and the support for shortcut key functionality. The assessments also indicated that the games could improve attention, working memory, and impulse control, suggesting potential therapeutic effects for ADHD. This intervention could provide a daily treatment method for families experiencing financial constraints that limit hospital-based therapies, thereby reducing the burden.