• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2022.05a
• /
• pp.584-586
• /
• 2022

In this paper, we proposed an augmented reality(AR) service for the Great Gilt-bronze Incense Burner of Beakje - one of Korea's national treasures - using smart glasses. The proposed AR service was developed using Microsoft's HoloLens 2, MRTK, and Unity programs. The proposed service starts when the user wears HoloLens 2 and looks at a QR code next to the displayed the Great Gilt-bronze Incense Burner. Then, the proposed service visually provides users with the historical explanation of the Great Gilt-bronze Incense Burner and the objects in it. In particular, the proposed service augments virtual 5 musicians of the Great Gilt-bronze Incense Burner so that users can experience the performance culture of the Baekje era. Therefore, we can provide users with the value and meaning of the cultural heritage of the Baekje era as an expanded experience by using the virtual 5 musicians to overcome the current temporal and spatial constraints. We can confirm whether the proposed AR service is provided to users through HoloLens 2, in harmony with the Great Gilt-bronze Incense Burner of Baekje, a cultural heritage.

• KSCI Review
• /
• v.24 no.2
• /
• pp.1-5
• /
• 2016

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2022.07a
• /
• pp.577-580
• /
• 2022

본 논문에서는 마이크로소프트(Microsoft, MS) 홀로렌즈v2를 이용하여 물리 기반 애니메이션은 유체와 로프를 제어할 수 있는 새로운 방법에 대해 소개한다. 물리 기반 시뮬레이션 혼합현실, 메타버스, 게임 등 다양한 콘텐츠에서 몰입감을 개선하기 위해 활용되고 있는 기술이다. 하지만, 계산양이 크고 사용자가로 인한 직관적인 제어 시스템의 부재로 많은 시장에 활용되기에는 어려운 구조이다. 이러한 문제를 완화하기 위해 본 논문에서는 혼합현실 환경에서 무선으로 사용자 인터페이스를 구현한 홀로렌즈v2를 이용하여 물리 애니메이션을 제어하고자 한다. 이러한 도전은 혼합현실에서도 사용자의 손동작, 음성, 눈 추적 등 다양한 인터페이스를 통해 시뮬레이션을 제어할 수 있다는 가능성을 열어줌으로써, 관련시장도 확장 될 수 있다. 본 논문에서는 대표적으로 유체와 로프 시뮬레이션을 홀로렌즈를 통해 제어하는 결과를 보여준다.

• Journal of the Korea Society of Computer and Information
• /
• v.26 no.4
• /
• pp.39-46
• /
• 2021

In this paper, we propose a method for the motion recognition method required in the industrial field in mixed reality. In industrial sites, movements (grasping, lifting, and carrying) are required throughout the upper full-body, from trunk movements to arm movements. In this paper, we use a method composed of sensors and wearable devices that are not vision-based such as Kinect without using heavy motion capture equipment. We used two IMU sensors for the trunk and shoulder movement, and used Myo arm band for the arm movements. Real-time data coming from a total of 4 are fused to enable motion recognition for the entire upper body area. As an experimental method, a sensor was attached to the actual clothes, and objects were manipulated through synchronization. As a result, the method using the synchronization method has no errors in large and small operations. Finally, through the performance evaluation, the average result was 50 frames for single-handed operation on the HoloLens and 60 frames for both-handed operation.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2023.07a
• /
• pp.423-424
• /
• 2023

본 논문에서 우리의 HMD는 Microsoft의 HoloLens 2와 국내 XR 기업을 비롯한 AR, XR을 이용하여 박물관 관람 지원 콘텐츠를 제시하고자 한다. 증강현실과 더불어 확장 현실의 기술 확장을 보이며 사용자는 박물관이란 공간 내에서 HMD를 착용하고 관람하며 설명 판에 QR코드를 인식하여 인터페이스와 더불어 각 주제에 맞는 애니메이션을 제공하여 시각적으로의 추가적 요소를 제공한다. 또한 사용자가 기존의 일반적이던 박물관 관람에서 XR이란 새로운 기술의 융합을 접목함으로 시각적 흥미를 갖게 하고 지역마다 특수한 역사, 배경에 맞춘 콘텐츠로서 지역을 알려 더 넓게 사회문제의 하나인 인구 저하에 따른 지역소멸에 지역홍보 차원이나 콘텐츠의 제공, 나아가 XR의 상용화까지 기대할 수 있는 콘텐츠를 기대한다.

• Korean Journal of Construction Engineering and Management
• /
• v.25 no.2
• /
• pp.69-80
• /
• 2024

Currently rebar spacing inspection is carried out by human inspectors who heavily rely on their individual experience, lacking a guarantee of objectivity and accuracy in the inspection process. In addition, if incorrectly placed rebars are identified, the inspector need to correct them. Recently, laser scanning and AR technologies have been widely used because of their merits of measurement accuracy and visualization. This study proposes a technology for rebar spacing inspection and fixing by combining laser scanning and AR technology. First, scan data acquisition of rebar layers is performed and the raw scan data is processed. Second, AR-based visualization and fixing are performed by comparing the design model with the model generated from the scan data. To verify the developed technique, performance comparison test is conducted by comparing with existing drawing-based method in terms of inspection time, error detection rate, cognitive load, and situational awareness ability. It is found from the result of the experiment that the AR-based rebar inspection and fixing technology is faster than the drawing-based method, but there was no significant difference between the two groups in error identification rate, cognitive load, and situational awareness ability. Based on the experimental results, the proposed AR-based rebar spacing inspection and fixing technology is expected to be highly useful throughout the construction industry.

• Nuclear Engineering and Technology
• /
• v.56 no.6
• /
• pp.2428-2435
• /
• 2024

Training for radiation protection and control requires a visual understanding of radiation, which cannot be perceived by the human senses. Trainees must also master the effective use of measuring instruments. Traditionally, such training has exposed trainees to radiation sources. Here, we present a novel e-training strategy that enables safe, exposure-free handling of a radiation measuring tool called a survey meter. Our mixed reality radiation-training system merges the physical world with a digital one. Collaborating with a mixed reality headset (HoloLens 2), this system constructs a mock-up of a survey meter in real-world space. The HoloLens 2 employs a browser-based application to visualize radiation and to simulate/share the use of the survey meter, including its physical movements. To provide a dynamic learning experience, the system adjusts the survey-meter mock-up readings according to the operator's movements, distance from the radiation source, the response time of survey meter, and shielding levels. Through this approach, we expect that trainees will acquire practical skills in interpreting survey-meter readings and gain a visual understanding of radiation in real-world situations.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2017.10a
• /
• pp.83-85
• /
• 2017

Generally, the current organ projection systems are the MRI and the CT. The MRI and the CT, (MRI) allow the surgeon to see the internal organs without incising the human body. However, since the images generated by the machines are 2D, it is difficult for doctors to observe the internal organs in three dimension. In this paper, we develop the augmented projection system for internal organs by using the augmented reality technology. The developed system shows the internal organs of the body using a holographic lens as a stereoscopic image and allows for doctors to examine the internal organs in detail.

• Cartoon and Animation Studies
• /
• s.46
• /
• pp.181-206
• /
• 2017

In the near future, we are expected to live in a Mixed Reality environment where reality and virtuality coexist as today we live using the Internet and smartphones in our daily lives. The relevant content based on the idea of Mixed Reality crystallizing is currently expanding, and it is time for research on it. This study examines the current situation and the development direction of mixed reality contents. Typical mixed reality contents can be classify by wearability. We analyzed HoloLens, a mixed reality wearable device that is worn on a head, which is a example of wearable device. As an example of unwearable device, we also analyzed the Room2Room which is a communication system that combines video with augmented reality-based telepresence avatar. Mixed Reality content will develop in the direction of implementing expanded use of information and more natural realism through the interactive combination of Reality, Virtual Reality, and Augmented Reality. As head-mounted wearable technology develops, Mixed Reality content is expected to become popular by increasing the number of Mixed Reality device users if convenience and price competitiveness are secured. The way of unifying Mixed Reality wearable devices must be established in order to increase convenience, and the environment based on Mixed Reality will be created through diversifying leisure activity content. Telepresence Avatar is expected to develop into Mobile Hologram Avar as Mixed Reality content accessible anywhere and at anytime beyond space limits. Another potential for development of Telepresence Avatar is the combination of Avatar moving on user's thought, Augmented Human technology and Mixed Reality.

• KIPS Transactions on Software and Data Engineering
• /
• v.12 no.7
• /
• pp.315-324
• /
• 2023

A simple and accurate whole body rehabilitation interaction technology using immersive digital content is needed for elderly patients with steadily increasing age-related diseases. In this study, we introduce whole-body interaction technology using HoloLens and Kinect for this purpose. To achieve this, we propose three coordinate transformation methods: mesh feature point-based transformation, AR marker-based transformation, and body recognition-based transformation. The mesh feature point-based transformation aligns the coordinate system by designating three feature points on the spatial mesh and using a transform matrix. This method requires manual work and has lower usability, but has relatively high accuracy of 8.5mm. The AR marker-based method uses AR and QR markers recognized by HoloLens and Kinect simultaneously to achieve a compliant accuracy of 11.2mm. The body recognition-based transformation aligns the coordinate system by using the position of the head or HMD recognized by both devices and the position of both hands or controllers. This method has lower accuracy, but does not require additional tools or manual work, making it more user-friendly. Additionally, we reduced the error by more than 10% using RANSAC as a post-processing technique. These three methods can be selectively applied depending on the usability and accuracy required for the content. In this study, we validated this technology by applying it to the "Thunder Punch" and rehabilitation therapy content.