• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2022.05a
• /
• pp.569-570
• /
• 2022

Failure situations occur frequently in the industry, and the existing 2D-based manual for this purpose is not intuitive to understand and it is difficult to immediately interact with maintenance experts. In this paper, we propose a technology that enables workers to perform maintenance in real time with the help of experts without restrictions in time and place based on augmented reality when a failure situation occurs at a remote location. A local virtual human-based expert diagnoses a failure situation based on an adapted panoramic image of a remote failure situation while wearing an HMD headset, and gives instructions to a remote operator. In addition, in an augmented reality (AR) environment in a remote location, for the interaction between the operator and the expert, the HMD's microphone is used to create the expert's hand as well as verbal communication. You can use to point or draw a picture. If this technology is used, it is possible to overcome the limitations of the existing 2D-based manual, and to provide assistance in performing maintenance smoothly remotely even if an expert does not directly visit a remote location.

• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.41 no.2
• /
• pp.137-148
• /
• 2004

In this paper, we propose a new camera calibration method for rotating multi-view cameras to generate image-based panoramic 3D Virtual Environment. Since calibration accuracy worsens with an increase in distance between camera and calibration pattern, conventional camera calibration algorithms are not proper for panoramic 3D VE generation. To remedy the problem, a geometric relationship among all lenses of a multi-view camera is used for intra-camera calibration. Another geometric relationship among multiple cameras is used for inter-camera calibration. First camera parameters for all lenses of each multi-view camera we obtained by applying Tsai's algorithm. In intra-camera calibration, the extrinsic parameters are compensated by iteratively reducing discrepancy between estimated and actual distances. Estimated distances are calculated using extrinsic parameters for every lens. Inter-camera calibration arranges multiple cameras in a geometric relationship. It exploits Iterative Closet Point (ICP) algorithm using back-projected 3D point clouds. Finally, by repeatedly applying intra/inter-camera calibration to all lenses of rotating multi-view cameras, we can obtain improved extrinsic parameters at every rotated position for a middle-range distance. Consequently, the proposed method can be applied to stitching of 3D point cloud for panoramic 3D VE generation. Moreover, it may be adopted in various 3D AR applications.

• Journal of the Institute of Electronics and Information Engineers
• /
• v.53 no.12
• /
• pp.175-179
• /
• 2016

Recent advances in technology of medical image have made surgical simulation that is helpful to diagnosis, operation plan, or education. Improving and enhancing the medical imaging have led to the availability of high definition images and three-dimensional (3D) visualization, it allows a better understanding in the surgical and educational field. The Real human field of view is stereoscopic. Therefore, with just 2D images, stereoscopic reconstruction process through the surgeon's head, is necessary. To reduce these process, 3D images have been used. 3D images enhanced 3D visualization, it provides significantly shorter time for surgeon for judgment in complex situations. Based on 3D image data set, virtual medical simulations, such as virtual endoscopy, surgical planning, and real-time interaction, have become possible. This article describes principles and recent applications of newer imaging techniques and special attention is directed towards medical 3D reconstruction techniques. Recent advances in technology of CT, MR and other imaging modalities has resulted in exciting new solutions and possibilities of shoulder imaging. Especially, three-dimensional (3D) images derived from medical devices provides advanced information. This presentation describes the principles and potential applications of 3D imaging techniques, simulation and printing in shoulder and elbow practice.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.21 no.9
• /
• pp.25-31
• /
• 2020

In this study, for the safe use of a portable ultrasonic skin-beauty device, an android app was developed to show the irradiation locations of focused ultrasound to a user through augmented reality (AR) and enable stable self-surgery. The utility of the app was assessed through testing. While the user is making a facial treatment with the beauty device, the user's face and the ultrasonic irradiation location on the face are detected in real-time with a smart-phone camera. The irradiation location is then indicated on the face image and shown to the user so that excessive ultrasound is not irradiated to the same area during treatment. To this end, ML-Kit is used to detect the user's face landmarks in real-time, and they are compared with a reference face model to estimate the pose of the face, such as rotation and movement. After mounting a LED on the ultrasonic irradiation part of the device and operating the LED during irradiation, the LED light was searched to find the position of the ultrasonic irradiation on the smart-phone screen, and the irradiation position was registered and displayed on the face image based on the estimated face pose. Each task performed in the app was implemented through the thread and the timer, and all tasks were executed within 75 ms. The test results showed that the time taken to register and display 120 ultrasound irradiation positions was less than 25ms, and the display accuracy was within 20mm when the face did not rotate significantly.

• Journal of the Institute of Electronics and Information Engineers
• /
• v.52 no.6
• /
• pp.79-84
• /
• 2015

In a distribution of digital image, there is a serious problem that is a distribution of the altered image by a forger. For the problem solution, this paper proposes a median filtering (MF) image forensic decision algorithm using a feature vector according to the pixel value's gradients. In the proposed algorithm, AR (Autoregressive) coefficients are computed from pixel value' gradients of original image then 1th~6th order coefficients to be six feature vector. And the reconstructed image is produced by the solution of Poisson's equation with the gradients. From the difference image between original and its reconstructed image, four feature vector (Average value, Max. value and the coordinate i,j of Max. value) is extracted. Subsequently, Two kinds of the feature vector combined to 10 Dim. feature vector that is used in the learning of a SVM (Support Vector Machine) classification for MF (Median Filtering) detector of the altered image. On the proposed algorithm of the median filtering detection, compare to MFR (Median Filter Residual) scheme that had the same 10 Dim. feature vectors, the performance is excellent at Unaltered, Averaging filtering ($3{\times}3$) and JPEG (QF=90) images, and less at Gaussian filtering ($3{\times}3$) image. However, in the measured performances of all items, AUC (Area Under Curve) by the sensitivity and 1-specificity is approached to 1. Thus, it is confirmed that the grade evaluation of the proposed algorithm is 'Excellent (A)'.

• The Journal of the Convergence on Culture Technology
• /
• v.7 no.3
• /
• pp.577-582
• /
• 2021

Recently, with the development of AR, VR, and smart device technologies, the demand for services based on non-face-to-face environments is also increasing in the fitness industry. The non-face-to-face online home training service has the advantage of not being limited by time and place compared to the existing offline service. However, there are disadvantages including the absence of exercise equipment, difficulty in measuring the amount of exercise and chekcing whether the user maintains an accurate exercise posture or not. In this study, we develop a standard exercise program that can compensate for these shortcomings and propose a new non-face-to-face home training application by using a deep learning-based body posture estimation image processing algorithm. This application allows the user to directly watch and follow the trainer of the standard exercise program video, correct the user's own posture, and perform an accurate exercise. Furthermore, if the results of this study are customized according to their purpose, it will be possible to apply them to performances, films, club activities, and conferences

• The Journal of the Korea institute of electronic communication sciences
• /
• v.18 no.6
• /
• pp.1321-1330
• /
• 2023

This study attempts to address the problem of 3D pose estimation for multiple human objects through a single image generated during the character development process that can be used in augmented reality. In the existing top-down method, all objects in the image are first detected, and then each is reconstructed independently. The problem is that inconsistent results may occur due to overlap or depth order mismatch between the reconstructed objects. The goal of this study is to solve these problems and develop a single network that provides consistent 3D reconstruction of all humans in a scene. Integrating a human body model based on the SMPL parametric system into a top-down framework became an important choice. Through this, two types of collision loss based on distance field and loss that considers depth order were introduced. The first loss prevents overlap between reconstructed people, and the second loss adjusts the depth ordering of people to render occlusion inference and annotated instance segmentation consistently. This method allows depth information to be provided to the network without explicit 3D annotation of the image. Experimental results show that this study's methodology performs better than existing methods on standard 3D pose benchmarks, and the proposed losses enable more consistent reconstruction from natural images.

• Journal of Korean Society of Forest Science
• /
• v.96 no.3
• /
• pp.235-244
• /
• 2007

Potentials of AR CDM project in North Korea are assessed and feasible land area for AR CDM project is estimated. According to our estimation, There could be 515,000 hectares of forest lands deforested before 1990 in North Korea and 8,854 hectares at the regional level of Gae-sung City, which are eligible for AR CDM project, based on researches of satellite image analyses conducted from 1980's to 1990's. A baseline scenario assumed 44.73 tones of carbon stored in soil per hectare with no vegetation above ground remained during the project period following the default value of IPCC's Good Practice Guidance for LULUCF considering soil structure, climate and land use of the project area. The scenario also assumes that black rocust (Robinia pseudoacacia) is planted and the CDM project is implemented for 20 years. The costs for producing greenhouse gases CER (certified emission reduction) credits include costs of tree planting and forest management, and costs of project negotiation and transactions for issuing the credits. It is estimated that 376 tones of carbon dioxide per hectare can be accumulated and 503 temporary CER credits per hectare and 265 long-term CER credits per hectare could be produced during the project period. It is estimated to cost US$ 4.04 and US$ 7.67 to provide one unit of temporary credit and long-term credit, respectively. These values can be regarded as the cost of conferring emission commitment of a country or a private entity. However, it is not clear which option is better economically because the replacement periods are different in these two cases.

• The Journal of the Korea Contents Association
• /
• v.18 no.6
• /
• pp.353-363
• /
• 2018

According to the Digi Capital forecast, the global augmented reality market is expected to grow rapidly by 2020 to reach 150 billion dollars. In particular, high value added effects are expected in education. As ICT advances, digital textbooks are also leading innovative education by adding interactive functions. Advanced countries, including the U.S., are already using digital textbooks that use augmented reality technology in their classes. In line with this technological outlook, the ministry proposed a design plan that applies augmented reality technology to middle school science 1 digital textbooks. A study on middle school science 1 digital textbooks showed that each unit provided short videos. In addition, an investigation into the augmented reality class case showed that it was difficult to establish experimental equipment, lack of equipment (devices), and 3D design contents that did not continue despite the excellence of learning effects. Based on this demand, we designed an augmented reality scenario and system configuration to be applied to the instrument-specific experiments of middle school science 1 digital textbooks to explore and explore the contents of augmented reality by students. This research will replace the dangerous experiments and time consuming experiments for teachers and students by applying augmented reality to science subjects that are essential for the development of digital textbooks.

• Journal of Digital Contents Society
• /
• v.19 no.2
• /
• pp.309-318
• /
• 2018

We proposed a marketing plan for the performing arts venue using realistic contents(VR, AR, and MR). The venue is a place where the audience can experience the performance directly. The marketing plan of the performance venue is as follows. Firstly, it is a marketing strategy that utilizes an arrangement of venue seats. It is possible to predict for watching a performance at angle and sight in performance venue seats that audience want through VR. This allows the theatre seats to be experienced in advance with the VR contents inducing the reservation of the seats with a high sense of immersion. Secondly, it is a marketing using PR and AD of performing arts through MR in the space with a large transient population. It is possible to promote dynamic promotion utilizing the sense of the presence of performing arts compared with existing static promotion means. Thirdly, it is a marketing strategy that utilizes actor characters in performance. The audience could be interested in the performing arts in advance via a preview of the AR contents of the pamphlet. Fourthly, it is a way to communicate with customers directly by establishing a VR social network to manage venue members. This will help attract an audience to revitalize the theatre venue.