• Proceedings of the Korea Information Processing Society Conference
• /
• 2018.10a
• /
• pp.686-689
• /
• 2018

3D 손 포즈 추정(Hand Pose Estimation, HPE)은 스마트 인간 컴퓨터 인터페이스를 위해서 중요한 기술이다. 이 연구에서는 딥러닝 방법을 기반으로 하여 단일 RGB-Depth 카메라로 촬영한 양손의 3D 손 자세를 실시간으로 인식하는 손 포즈 추정 시스템을 제시한다. 손 포즈 추정 시스템은 4단계로 구성된다. 첫째, Skin Detection 및 Depth cutting 알고리즘을 사용하여 양손을 RGB와 깊이 영상에서 감지하고 추출한다. 둘째, Convolutional Neural Network(CNN) Classifier는 오른손과 왼손을 구별하는데 사용된다. CNN Classifier 는 3개의 convolution layer와 2개의 Fully-Connected Layer로 구성되어 있으며, 추출된 깊이 영상을 입력으로 사용한다. 셋째, 학습된 CNN regressor는 추출된 왼쪽 및 오른쪽 손의 깊이 영상에서 손 관절을 추정하기 위해 다수의 Convolutional Layers, Pooling Layers, Fully Connected Layers로 구성된다. CNN classifier와 regressor는 22,000개 깊이 영상 데이터셋으로 학습된다. 마지막으로, 각 손의 3D 손 자세는 추정된 손 관절 정보로부터 재구성된다. 테스트 결과, CNN classifier는 오른쪽 손과 왼쪽 손을 96.9%의 정확도로 구별할 수 있으며, CNN regressor는 형균 8.48mm의 오차 범위로 3D 손 관절 정보를 추정할 수 있다. 본 연구에서 제안하는 손 포즈 추정 시스템은 가상 현실(virtual reality, VR), 증강 현실(Augmented Reality, AR) 및 융합 현실 (Mixed Reality, MR) 응용 프로그램을 포함한 다양한 응용 분야에서 사용할 수 있다.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2019.10a
• /
• pp.1137-1140
• /
• 2019

가상현실(Virtual Reality, VR), 증강현실(Augmented Reality, AR), 혼합현실(Mixed Reality, MR) 분야에 유용한 인간 컴퓨터 인터페이스 기술은 필수적이다. 특히 휴먼 손동작 인식 기술은 직관적인 상호작용을 가능하게 하여, 다양한 분야에서 편리한 컨트롤러로 사용할 수 있다. 본 연구에서는 뎁스 영상 기반의 1 인칭 시점 손동작 인식을 위하여 손동작 데이터베이스 생성 시스템을 구축하여, 손동작 인식기 학습에 필요한 1 인칭(Egocentric View Point) 데이터베이스를 촬영하여 제작한다. 그리고 모바일 Head Mounted Device(HMD) VR 을 위한 뎁스 영상 기반 1 인칭 시점 손동작 인식(Hand Pose Recognition, HPR) 딥러닝 Deep Residual Network 를 구현한다. 최종적으로, 안드로이드 모바일 디바이스에 학습된 Residual Network Regressor 를 이식하고 모바일 VR 에 실시간 손동작 인식 시스템을 구동하여, 모바일 VR 상 실시간 3D 손동작 인식을 가상 물체와의 상호작용을 통하여 확인 한다.

• The Journal of Korean Physical Therapy
• /
• v.36 no.1
• /
• pp.39-44
• /
• 2024

Purpose: Cybersickness is a type of motion sickness induced by virtual reality (VR) or augmented reality (AR) environments that presents symptoms including nausea, dizziness, and headaches. This study aimed to investigate how cathodal transcranial direct current stimulation (tDCS) alleviates motion sickness symptoms and modulates brain activity in individuals experiencing cybersickness after exposure to a VR environment. Methods: This study was performed on two groups of healthy adults with cybersickness symptoms. Subjects were randomly assigned to receive either cathodal tDCS intervention or sham tDCS intervention. Brain activity during VR stimulation was measured by 38-channel functional near-infrared spectroscopy (fNIRS). tDCS was administered to the right temporoparietal junction (TPJ) for 20 minutes at an intensity of 2mA, and the severity of cybersickness was assessed pre- and post-intervention using a simulator sickness questionnaire (SSQ). Result: Following the experiment, cybersickness symptoms in subjects who received cathodal tDCS intervention were reduced based on SSQ scores, whereas those who received sham tDCS showed no significant change. fNIRS analysis revealed that tDCS significantly diminished cortical activity in subjects with high activity in temporal and parietal lobes, whereas high cortical activity was maintained in these regions after intervention in subjects who received sham tDCS. Conclusion: These findings suggest that cathodal tDCS applied to the right TPJ region in young adults experiencing cybersickness effectively reduces motion sickness induced by VR environments.

• Journal of the HCI Society of Korea
• /
• v.8 no.2
• /
• pp.21-27
• /
• 2013

Recently, the use of floating hologram has increased in many different aspects, such as exhibitions, education, advertisements, and so on. Especially, the floating hologram that makes use of half-mirror is widely used. Nevertheless, half-mirror, unfortunately, cannot lead users to the perfect three dimensional hologram experience. Even though it can make the vision look to be up on the air, it does not have the capacity to display itself up on the air, which is the ultimate goal of hologram. In addition, it looks inconsistent when a real object is located behind the half-mirror in order to show the convergence of the two (object and the half-mirror). In this paper, we did the study on comparison of 3D space perception for the stereoscopic AR holography. At first, we applied stereoscopic technology to the half-mirror hologram system for the accurate and realistic AR environment. Then, the users can feel as if the real 3D object behind half-mirror and the reflected virtual image are converged much better in the 3D space. Furthermore, by using depth camera, the location and direction of graphics can be controlled to change depending on the user's point of view. This is the effective way to produce augmented stereoscopic images simply and accurately through half-mirror film without any additional devices. What we saw from the user test were applying 3D images and user interaction leads the users to have 3D spatial awareness and realism more effectively and accurately.

• Journal of Korea Entertainment Industry Association
• /
• v.14 no.8
• /
• pp.513-523
• /
• 2020

This study has derived the patents of the technology that have been filed and registered so far to investigate the trends of virtual reality(VR) experience contents technology, and analyzed them focusing on core patent technologies. The patents of Korea, USA, Japan, Europe and PCT, which were released until June 2020, were targeted, and patent search was conducted using WISDOMAIN search DB. The keywords for patent search were related to experience technology using VR, and a total of 1,013 data were obtained after creating a search formula by combining the derived keywords. Among them, a total of 65 data were extracted from the result of selecting valid patents, and a political analysis was conducted on them. Looking at the overall application trend, most of Korean patent applications accounted for, and noise patents are system-related devices to implement VR technology. The United States and Europe are focused on developing augmented reality(AR) technology, the study found. The technology of VR experience has increased rapidly since 2017, and the technology growth stage is the period from the beginning to the growth stage. As a result of examining the valid patents related to VR experience, technology was searched in various fields such as rural tour, exhibition, education, and performance, and patents for contents writing and general virtual experience related technology were also searched. If we predict the possibility of development of VR industry in the future, it is necessary to respond to preemption of intellectual property rights by proceeding technology development and patent application for more diverse fields.

• Land and Housing Review
• /
• v.15 no.2
• /
• pp.125-137
• /
• 2024

A conventional Design for Safety (DfS), introduced to eliminate potential hazards in the design phase proactively, has encountered persistent challenges, such as perfunctory risk assessments and hazard identifications based on 2D drawings and inefficient workflow processes. This study proposes a BIM-based approach to Design for Safety (DfS) to address the limitations of conventional methods, aiming to enhance efficiency and achieve practical safety management benefits. The proposed workflow process for BIM-based DfS has been refined and validated for on-site applicability through various case studies, including risk assessments during the design phase and field applications for safety management activities during the construction phase. Specifically, the critical process of risk assessment within the DfS methodology has also been transitioned to a BIM-based approach. This BIM-based risk assessment process has been evaluated through case studies, encompassing safety reviews for structural design, construction equipment operation, and construction methodology with sequence in design projects. Additionally, the proposed BIM-based DfS has demonstrated exceptional on-site applicability and efficiency, as validated by the application of a BIM deliverable embedded in DfS information for CDE-based daily activity briefing, VR-based safety training, AR-based mitigation measures inspections, and other safety management activities in the construction phase.

• Journal of the Korea Computer Graphics Society
• /
• v.30 no.3
• /
• pp.61-69
• /
• 2024

Mixed reality(MR) technology combines the advantages of virtual reality(VR) and augmented reality(AR) technology, allowing MR users to interact with virtual objects against the background of the real world. In addition, since virtual objects interact with the real world, users can experience a higher immersion. This study proposes electric circuit practical training content using Meta Quest Pro to produce immersive MR content based on reality. To this end, first, the development process for producing MR content by linking Meta Quest Pro equipment with the Unity 3D engine is organized. Then, based on the traditional electric circuit practical training method used in elementary school science classes, virtual electric circuit practical training content with the same training method and operation process is produced based on MR. Finally, survey experiments are conducted to analyze the presence and experience of the MR-based educational environment provided using the produced content. Through this, the usability of the proposed practical training content is evaluated and future research directions are suggested.

• Proceedings of the Korean Information Science Society Conference
• /
• 2006.06b
• /
• pp.55-57
• /
• 2006

본 논문에서는 컬러코드를 이용하여 증강현실 시스템에 사용 가능한 태그를 탐지하는 알고리즘을 설계하고 차단 현상에 강인한 알고리즘을 제안하였다. 기존의 ARToolkit에서 태그의 일부분이 사용자 또는 다른 물체에 의해 가려지게 될 경우 증강되었던 객체가 순간 사라져 버리는 불안정성 (Instability) 문제를 해결하기 위한 방법에 초점을 맞춘다. 불안정성의 문제는 이미지 안에 태그가 존재하지만 해당하는 객체를 증강시키지 못하는 False Negative 에러와 태그가 존재하지 않는 곳에 잘못된 객체를 증강시키는 False Positive 에러로 분류 될 수 있다. 제안된 탐지 알고리즘으로 특정 컬러 영역을 분리하여 모서리 여부를 판별하고 모서리인 경우 가려진 꼭지점의 위치를 추출하여 태그가 차단에 의하여 가려졌을 때에도 객체를 안정적으로 증강시킬 수 있다. 기존 AR 시스템들의 태그를 가지고 Daylight 65, Illuminant A. CWF, TL84의 4가지의 표준 조명하에 컬러코드 4종류, ARToolkit 태그 4개, ARTag 4개를 이용하여 실험을 진행하여 차단 현상이 발생하면 전혀 객체를 증강시킬 수 없었던 ARToolkit에서도 DayLight65의 경우 50%의 False Negative. False Positive rate을 보여 기존 증강현실 시스템에서 보였던 불안정성 문제를 개선하였다.

• Journal of Korea Society of Digital Industry and Information Management
• /
• v.14 no.2
• /
• pp.1-9
• /
• 2018

Currently, the record of part-timer is mainly written in handwriting or using excel work schedule, paper work recorder, and time attendance program using POS program. And, work table, commute records, paycheck are managed separately. Time-attendance information is not linked and is managed separately, and payment of wages is often not done accurately. And, it is difficult to pay the wages because it is not able to accurately grasp the state of attendance of part-timer. Therefore, it is necessary to have a transparent wage and work management system based on the trust between the owner and the part-timer. In this paper, we design a system that can perform real-time commute check using beacon, transparent wage management, wage calculation by automatic calculation, and smooth communication between owner and the part-timer. We have also implemented a store management mobile application using Android Studio 2.3, Eclipse, Android 5.1 and Beacon devices in a MySQL environment.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.15 no.2
• /
• pp.383-403
• /
• 2021

With the development of mobile edge computing (MEC), some late-model application technologies, such as self-driving, augmented reality (AR) and traffic perception, emerge as the times require. Nevertheless, the high-latency and low-reliability of the traditional cloud computing solutions are difficult to meet the requirement of growing smart cars (SCs) with computing-intensive applications. Hence, this paper studies an efficient offloading decision and resource allocation scheme in collaborative vehicular edge computing networks with multiple SCs and multiple MEC servers to reduce latency. To solve this problem with effect, we propose a context-aware offloading strategy based on differential evolution algorithm (DE) by considering vehicle mobility, roadside units (RSUs) coverage, vehicle priority. On this basis, an autoregressive integrated moving average (ARIMA) model is employed to predict idle computing resources according to the base station traffic in different periods. Simulation results demonstrate that the practical performance of the context-aware vehicular task offloading (CAVTO) optimization scheme could reduce the system delay significantly.