• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2017.10a
• /
• pp.83-85
• /
• 2017

Generally, the current organ projection systems are the MRI and the CT. The MRI and the CT, (MRI) allow the surgeon to see the internal organs without incising the human body. However, since the images generated by the machines are 2D, it is difficult for doctors to observe the internal organs in three dimension. In this paper, we develop the augmented projection system for internal organs by using the augmented reality technology. The developed system shows the internal organs of the body using a holographic lens as a stereoscopic image and allows for doctors to examine the internal organs in detail.

• Journal of Korea Multimedia Society
• /
• v.24 no.4
• /
• pp.601-609
• /
• 2021

This article combines literature and empirical research based on space perception theory and the case study of mixed reality game "The Fragment." It is concluded that the mixed reality scene under space perception has a three-level visual definition. This definition carries out a corresponding level analysis of the scenes of the "The Fragment" game and draws up the constituent factors of the mixed reality game scene characteristics. Finally, through questionnaire data investigation and analysis, it is verified that the three factors of virtual reality coexistence, human-computer interaction, and local serviceability can better explain the characteristics of mixed reality game scenes. At the end of the study, it is concluded that the definition of three levels of visual hierarchy and the constituent factors of mixed reality game scenes can provide reference and help for other mixed-reality game designs and a brief description of future research plans.

• Proceedings of the Korean Institute of Building Construction Conference
• /
• 2022.11a
• /
• pp.233-234
• /
• 2022

In Korea, various policies are implemented so that the socially disadvantaged (disabled, elderly, pregnant women, temporary disabled, etc.) can easily access individual facilities and areas. As the nation's interest in the socially disadvantaged increases, the need for BF certification is also emerging in buildings in private facilities. However, this system requires a lot of cost and time in the examination process, so if certification fails, social costs and time losses are high. To solve this problem, this paper presents a measurement plan for mixed reality devices using HoloLens, a mixed reality device hardware that can pre-check BF certification based on augmented reality, and Unity 3D, MRTK, a development tool.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2023.01a
• /
• pp.381-384
• /
• 2023

본 논문에서는 마이크로소프트의 홀로렌즈를 이용한 손 위치 추적 및 모션 인식과 아두이노를 통해 상황에 맞는 무게감을 사용자에게 전달할 수 있는 VR 인터페이스를 제안한다. 홀로렌즈는 혼합현실을 체험할 수 있지만 홀로렌즈를 이용해 가상의 물체를 잡았을 때 현실과의 물리적인 상호작용이 없기 때문에 현실감이 떨어져 몰입을 저하하는 원인이 된다. 본 논문에서는 혼합현실에서 사용자의 몰입을 개선하기 위해 아두이노를 이용하여 사용자에게 무게감을 효율적으로 전달하여 현실과 같은 몰입을 줄 수 있는 도르래 방식의 VR 인터페이스를 제안한다.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2023.01a
• /
• pp.345-347
• /
• 2023

본 논문에서는 마이크로소프트(Microsoft, MS) 홀로렌즈를 이용한 초몰입형(혹은 과몰입형) 캐주얼 공게임을 제안한다. 일반적인 가상현실콘텐츠는 시각적인 몰입만을 전달하지만, 경우에 따라서는 과몰입형 콘텐츠도 매우 중요하며, 본 논문에서는 XR환경에서 사용자에게 과몰입을 전달할 수 있는 새로운 프레임워크를 제안한다. 특히, 어린 아이들이 체험하는 형태의 콘텐츠들은 대부분 과몰입형적인 특징을 가지며, 본 논문에서는 실제 그와 유사한 공 게임을 XR환경에서 제작함으로써 사용자가의 몰입을 개선시킨다.

• Cartoon and Animation Studies
• /
• s.46
• /
• pp.181-206
• /
• 2017

In the near future, we are expected to live in a Mixed Reality environment where reality and virtuality coexist as today we live using the Internet and smartphones in our daily lives. The relevant content based on the idea of Mixed Reality crystallizing is currently expanding, and it is time for research on it. This study examines the current situation and the development direction of mixed reality contents. Typical mixed reality contents can be classify by wearability. We analyzed HoloLens, a mixed reality wearable device that is worn on a head, which is a example of wearable device. As an example of unwearable device, we also analyzed the Room2Room which is a communication system that combines video with augmented reality-based telepresence avatar. Mixed Reality content will develop in the direction of implementing expanded use of information and more natural realism through the interactive combination of Reality, Virtual Reality, and Augmented Reality. As head-mounted wearable technology develops, Mixed Reality content is expected to become popular by increasing the number of Mixed Reality device users if convenience and price competitiveness are secured. The way of unifying Mixed Reality wearable devices must be established in order to increase convenience, and the environment based on Mixed Reality will be created through diversifying leisure activity content. Telepresence Avatar is expected to develop into Mobile Hologram Avar as Mixed Reality content accessible anywhere and at anytime beyond space limits. Another potential for development of Telepresence Avatar is the combination of Avatar moving on user's thought, Augmented Human technology and Mixed Reality.

• KIPS Transactions on Software and Data Engineering
• /
• v.12 no.7
• /
• pp.315-324
• /
• 2023

A simple and accurate whole body rehabilitation interaction technology using immersive digital content is needed for elderly patients with steadily increasing age-related diseases. In this study, we introduce whole-body interaction technology using HoloLens and Kinect for this purpose. To achieve this, we propose three coordinate transformation methods: mesh feature point-based transformation, AR marker-based transformation, and body recognition-based transformation. The mesh feature point-based transformation aligns the coordinate system by designating three feature points on the spatial mesh and using a transform matrix. This method requires manual work and has lower usability, but has relatively high accuracy of 8.5mm. The AR marker-based method uses AR and QR markers recognized by HoloLens and Kinect simultaneously to achieve a compliant accuracy of 11.2mm. The body recognition-based transformation aligns the coordinate system by using the position of the head or HMD recognized by both devices and the position of both hands or controllers. This method has lower accuracy, but does not require additional tools or manual work, making it more user-friendly. Additionally, we reduced the error by more than 10% using RANSAC as a post-processing technique. These three methods can be selectively applied depending on the usability and accuracy required for the content. In this study, we validated this technology by applying it to the "Thunder Punch" and rehabilitation therapy content.

• Smart Media Journal
• /
• v.13 no.4
• /
• pp.114-123
• /
• 2024

This paper proposes AR stone tower content, an experiential content based on wearable augmented reality (AR). Although wearable augmented reality is gaining attention, the acceptance of the technology is still focused on specialized applications such as industrial sites. On the other hand, the proposed AR stone tower content is based on the material of 'stone tower' so that general users can relate to it and easily participate in it, and it is organized to utilize space in a moving environment and find and stack stones based on natural hand gestures. The proposed AR stone tower content was implemented in the HoloLens 2 environment and evaluated by general users through a pilot exhibition in a small art museum. The evaluation results showed that the overall satisfaction with the content averaged 3.85, and the content appropriateness for the stone tower material was very high at 4.15. In particular, users were highly satisfied with content comprehension and sound, but somewhat less satisfied with object recognition, body adaptation, and object control. The above user evaluations confirm the resonance and positive response to the material, but also highlight the difficulties of the average user in experiencing and interacting with the wearable AR environment.

• Imaging Science in Dentistry
• /
• v.52 no.2
• /
• pp.225-230
• /
• 2022

Purpose: This report presents the first known use of a rigid endoscope with augmented reality technology for the removal of an odontogenic cyst that penetrated the maxillary sinus and illustrates its practical use in a patient. Materials and Methods: In the preoperative period, cone-beam computed tomography was performed in a specially designed marker holder frame, and the contours of the cyst and the nearest anatomical formations were segmented in the 3D Slicer program. During the operation, a marker was installed on the patient's head, as well as on the tip of the endoscope, which made it possible to visualize the mass and the movement of the endoscope. The surgical intervention was performed with the support of augmented reality in HoloLens glasses (Microsoft Corporation, Redmond, WA, USA). Results: The use of this technology improved the accuracy of surgical manipulations, reduced operational risks, and shortened the time of surgery and the rehabilitation period. Conclusion: With the help of modern technologies, a navigation system was created that helped to track the position of the endoscope in mixed reality in real time, as well as to fully visualize anatomical formations.

• Journal of Navigation and Port Research
• /
• v.46 no.5
• /
• pp.458-470
• /
• 2022

As the 4th industrial revolution progresses, the application of several cutting-edge technologies such as the Internet of Things, big data, and mixed reality (MR) in relation to autonomous ships is being considered in the maritime logistics field. The aim of this study was to apply the concept of a digital twin model based on Human Machine Interaction (HMI) including a digital twin model and the role of an operator to a ship. The role of the digital twin is divided into information provision, support, decision, and implementation. The role of the operator is divided into operation, decision-making, supervision, and standby. The system constituting the ship was investigated. The digital twin system that could be applied to the ship was also investigated. The cloud-based digital twin system architecture that could apply investigated applications was divided into ship data collection (part 1), cloud system (part 2), analysis system/ application (part 3), and MR/mobile system (part 4). A Mixed Reality device HoloLens was used as an HMI equipment to perform a simulation test of a digital twin system of an 8 m battery-based electric propulsion ship.