• Journal of Internet Computing and Services
• /
• v.12 no.3
• /
• pp.119-129
• /
• 2011

Vision-based Human computer interaction is an emerging field of science and industry to provide natural way to communicate with human and computer. Especially, recent increasing demands for mobile augmented reality require the development of efficient interactive technologies between the augmented virtual object and users. This paper presents a novel approach to construct marker-less mobile augmented reality object and control the object. Replacing a traditional market, the human hand interface is used for marker-less mobile augmented reality system. In order to implement the marker-less mobile augmented system in the limited resources of mobile device compared with the desktop environments, we proposed a method to extract an optimal hand region which plays a role of the marker and augment object in a realtime fashion by using the camera attached on mobile device. The optimal hand region detection can be composed of detecting hand region with YCbCr skin color model and extracting the optimal rectangle region with Rotating Calipers Algorithm. The extracted optimal rectangle region takes a role of traditional marker. The proposed method resolved the problem of missing the track of fingertips when the hand is rotated or occluded in the hand marker system. From the experiment, we can prove that the proposed framework can effectively construct and control the augmented virtual object in the mobile environments.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2021.10a
• /
• pp.427-428
• /
• 2021

Recently, various augmented reality(AR) methods for monitoring situations in a remote factory have been proposed. The 2D manual with a classic method is not intuitive to understand and has limitations to provide to interact with objects to be repaired in the remote factory. In our paper, we present a guide method based on a virtual human expressed in augmented reality for the remote environment. Also, the remote factory environment was periodically captured through 3D reconstruction, our virtual human was adaptively matched to the built 3D environment. According to this paper, our method makes it possible to perform repairs quickly with the feeling of being with an expert. and it is possible to provide a visualized guide for troubleshooting in various fields such as factories, offices, medical facilities, and schools in remote environments.

• Journal of Digital Contents Society
• /
• v.17 no.6
• /
• pp.531-536
• /
• 2016

This study highlights the effectiveness of analyzing the feelings children have when interacting with robots in a dramatic play setting using augmented reality in Human Robot Interaction (HRI). Existing dramatic play activities using robots by QR-markers were edited, and their weaknesses have been corrected so that children could interact more effectively with robots. Additionally, children's levels of interest and engagement in dramatic play activities, the accuracy of robotic props, and the smartness of robots were analyzed throughout children's interactions during such activities using augmented reality. Younger participants were more likely to find robots interesting and intelligent, and participants with no previous experience with robots had relatively higher levels of interest in robots and tended to notice changes in robots' costumes.

• Journal of the Institute of Electronics Engineers of Korea SC
• /
• v.48 no.5
• /
• pp.7-12
• /
• 2011

In this papwer, we propose a new feature extraction method, named as Class-augmented Kernel Principal Component Analysis (CA-KPCA), which can extract nonlinear features for classification. Among the subspace method that was being widely used for feature extraction, Class-augmented Principal Component Analysis (CA-PCA) is a recently one that can extract features for a accurate classification without computational difficulties of other methods such as Linear Discriminant Analysis (LDA). However, the features extracted by CA-PCA is still restricted to be in a linear subspace of the original data space, which limites the use of this method for various problems requiring nonlinear features. To resolve this limitation, we apply a kernel trick to develop a new version of CA-PCA to extract nonlinear features, and evaluate its performance by experiments using data sets in the UCI Machine Learning Repository.

• Journal of the Korean Society for Aviation and Aeronautics
• /
• v.27 no.2
• /
• pp.54-69
• /
• 2019

The primary objective of this paper is to introduce the application of Human-Machine Interface (HMI) and Augmented Reality (AR) technologies in flight operations. These include: self-check-in, baggage handling, airport security and surveillance, airport operations monitoring, In-Flight Entertainment and Connectivity (IFEC), cockpit design, and cabin crew support. This paper investigates the application status and development trends of HMI and AR technologies for airports and aircraft. These technologies can provide more efficient in-flight passenger service and experience by using AR devices. This paper also discusses the developments such as; the Integrated Control Application (ICA) for the IFEC interface, AR flight simulation training program using the fixed-based simulator, and the AR aircraft cabin interior concept test program. These applications present how HMI and AR techniques can be utilized in actual flight operations. The developed programs in this paper can be applied to their purpose within aircraft interiors and services to enhance efficiency, comfort, and experience.

• Journal of Korea Game Society
• /
• v.21 no.5
• /
• pp.41-48
• /
• 2021

This paper introduces a mobile augmented visualization technology that augments a three-dimensional virtual human body on a mannequin model using two pose(position and rotation) tracking sensors. The conventional camera tracking technology used for augmented visualization has the disadvantage of failing to calculate the camera pose when the camera shakes or moves quickly because it uses the camera image, but using a pose tracking sensor can overcome this disadvantage. Also, even if the position of the mannequin is changed or rotated, augmented visualization is possible using the data of the pose tracking sensor attached to the mannequin, and above all there is no load for camera tracking.

• Journal of the Semiconductor & Display Technology
• /
• v.17 no.4
• /
• pp.101-104
• /
• 2018

Augmented Reality (AR) is an emerging technology and the applications of technology are still not fully unveiled. This paper explores a new application of augmented reality for new direction in art exhibitions, which aims to bring interactive learning experience to life. The project takes printed images on book or exhibiting arts to the next level by applying AR technology to provide a unique fascinating experience to its readers on mobile devices. AR technology composing with animation brings new digital entertainment experience to the user of art exhibitions. The key feature of this paper uses the technology presents auxiliary information in the field of view of an object on art exhibitions automatically without human intervention.

• KIPS Transactions on Software and Data Engineering
• /
• v.10 no.5
• /
• pp.179-186
• /
• 2021

Manipulation of complex objects with an anthropomorphic robot hand like a human hand is a challenge in the human-centric environment. In order to train the anthropomorphic robot hand which has a high degree of freedom (DoF), human demonstration augmented deep reinforcement learning policy optimization methods have been proposed. In this work, we first demonstrate augmentation of human demonstration in deep reinforcement learning (DRL) is effective for object manipulation by comparing the performance of the augmentation-free Natural Policy Gradient (NPG) and Demonstration Augmented NPG (DA-NPG). Then three DRL policy optimization methods, namely NPG, Trust Region Policy Optimization (TRPO), and Proximal Policy Optimization (PPO), have been evaluated with DA (i.e., DA-NPG, DA-TRPO, and DA-PPO) and without DA by manipulating six objects such as apple, banana, bottle, light bulb, camera, and hammer. The results show that DA-NPG achieved the average success rate of 99.33% whereas NPG only achieved 60%. In addition, DA-NPG succeeded grasping all six objects while DA-TRPO and DA-PPO failed to grasp some objects and showed unstable performances.

• Journal of information and communication convergence engineering
• /
• v.21 no.1
• /
• pp.98-102
• /
• 2023

This paper presents a study on how augmenting semi-synthetic image data improves the performance of human detection algorithms. In the field of object detection, securing a high-quality data set plays the most important role in training deep learning algorithms. Recently, the acquisition of real image data has become time consuming and expensive; therefore, research using synthesized data has been conducted. Synthetic data haves the advantage of being able to generate a vast amount of data and accurately label it. However, the utility of synthetic data in human detection has not yet been demonstrated. Therefore, we use You Only Look Once (YOLO), the object detection algorithm most commonly used, to experimentally analyze the effect of synthetic data augmentation on human detection performance. As a result of training YOLO using the Penn-Fudan dataset, it was shown that the YOLO network model trained on a dataset augmented with synthetic data provided high-performance results in terms of the Precision-Recall Curve and F1-Confidence Curve.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2010.05a
• /
• pp.683-685
• /
• 2010

Augmented reality is a technology for showing virtual objects overlapped with the real world as seen from the eyes of users. Studies are being conducted on effective communication methods using hand movements in augmented reality. Hand movements are an important means of human communication along with writing and voice. Space arrangement technology and hand tracking technology using markers to acquire virtual information in augmented reality have many limitations. This paper proposes tracking hand area for augmented object. The augmented objects change viewpoints by hand positions which improves the sense of three dimensions and immersion.