• Smart Media Journal
• /
• v.13 no.4
• /
• pp.114-123
• /
• 2024

This paper proposes AR stone tower content, an experiential content based on wearable augmented reality (AR). Although wearable augmented reality is gaining attention, the acceptance of the technology is still focused on specialized applications such as industrial sites. On the other hand, the proposed AR stone tower content is based on the material of 'stone tower' so that general users can relate to it and easily participate in it, and it is organized to utilize space in a moving environment and find and stack stones based on natural hand gestures. The proposed AR stone tower content was implemented in the HoloLens 2 environment and evaluated by general users through a pilot exhibition in a small art museum. The evaluation results showed that the overall satisfaction with the content averaged 3.85, and the content appropriateness for the stone tower material was very high at 4.15. In particular, users were highly satisfied with content comprehension and sound, but somewhat less satisfied with object recognition, body adaptation, and object control. The above user evaluations confirm the resonance and positive response to the material, but also highlight the difficulties of the average user in experiencing and interacting with the wearable AR environment.

• Imaging Science in Dentistry
• /
• v.52 no.2
• /
• pp.225-230
• /
• 2022

Purpose: This report presents the first known use of a rigid endoscope with augmented reality technology for the removal of an odontogenic cyst that penetrated the maxillary sinus and illustrates its practical use in a patient. Materials and Methods: In the preoperative period, cone-beam computed tomography was performed in a specially designed marker holder frame, and the contours of the cyst and the nearest anatomical formations were segmented in the 3D Slicer program. During the operation, a marker was installed on the patient's head, as well as on the tip of the endoscope, which made it possible to visualize the mass and the movement of the endoscope. The surgical intervention was performed with the support of augmented reality in HoloLens glasses (Microsoft Corporation, Redmond, WA, USA). Results: The use of this technology improved the accuracy of surgical manipulations, reduced operational risks, and shortened the time of surgery and the rehabilitation period. Conclusion: With the help of modern technologies, a navigation system was created that helped to track the position of the endoscope in mixed reality in real time, as well as to fully visualize anatomical formations.

• Journal of Navigation and Port Research
• /
• v.46 no.5
• /
• pp.458-470
• /
• 2022

As the 4th industrial revolution progresses, the application of several cutting-edge technologies such as the Internet of Things, big data, and mixed reality (MR) in relation to autonomous ships is being considered in the maritime logistics field. The aim of this study was to apply the concept of a digital twin model based on Human Machine Interaction (HMI) including a digital twin model and the role of an operator to a ship. The role of the digital twin is divided into information provision, support, decision, and implementation. The role of the operator is divided into operation, decision-making, supervision, and standby. The system constituting the ship was investigated. The digital twin system that could be applied to the ship was also investigated. The cloud-based digital twin system architecture that could apply investigated applications was divided into ship data collection (part 1), cloud system (part 2), analysis system/ application (part 3), and MR/mobile system (part 4). A Mixed Reality device HoloLens was used as an HMI equipment to perform a simulation test of a digital twin system of an 8 m battery-based electric propulsion ship.

• International conference on construction engineering and project management
• /
• 2022.06a
• /
• pp.1138-1145
• /
• 2022

While pursuing digitalization and paperless projects, the construction industry needs to settle on how to make the most of digitized data and information. On-site workers, who currently rely on paper documents to check and review design and construction plans, will need alternative ways to efficiently access the information without using any paper. Augmented Reality is a potential solution where the information customized to a user is aligned with the physical world. This paper proposes the Augmented Reality framework to deliver the information on on-site resources (e.g., workers and equipment) using head-mounted devices. The proposed framework was developed by interoperating Augmented Reality-supported devices and a digital twin platform in which all information related to ongoing tasks is accumulated in real-time. On-site resources appearing in the user's field of view are automatically detected by an object detection algorithm and then assigned to the corresponding information by matching the data in the digital twin platform. Preliminary experiments show the feasibility of the proposed framework. Worker detection results can be visualized on HoloLens 2 in near real-time, and the matching process obtained the accuracy greater than 88%.

• Journal of the Korean Society of Radiology
• /
• v.15 no.1
• /
• pp.45-54
• /
• 2021

This study was written to create educational content in non-destructive fields based on Mixed Reality. Currently, in the field of radiation, there is almost no content for educational Mixed Reality-based educational content. And in the field of non-destructive inspection, the working environment is poor, the number of employees is often 10 or less for each manufacturer, and the educational infrastructure is not built. There is no practical training, only practical training and safety education to convey information. To solve this, it was decided to develop non-destructive worker education content based on Mixed Reality. This content was developed based on Microsoft's HoloLens 2 HMD device. It is manufactured based on the resolution of 1280 ⁎ 720, and the resolution is different for each device, and the Side is created by aligning the Left, Right, Bottom, and TOP positions of Anchor, and the large image affects the size of Atlas. The large volume like the wallpaper and the upper part was made by replacing it with UITexture. For UI Widget Wizard, I made Label, Buttom, ScrollView, and Sprite. In this study, it is possible to provide workers with realistic educational content, enable self-directed education, and educate with 3D stereoscopic images based on reality to provide interesting and immersive education. Through the images provided in Mixed Reality, the learner can directly operate things through the interaction between the real world and the Virtual Reality, and the learner's learning efficiency can be improved. In addition, mixed reality education can play a major role in non-face-to-face learning content in the corona era, where time and place are not disturbed.