• Journal of Korea Multimedia Society
• /
• v.22 no.10
• /
• pp.1142-1148
• /
• 2019

Reconstruction of the three-dimensional (3D) environment is a key aspect of augmented reality and augmented virtuality, which utilize and incorporate a user's surroundings. Such reconstruction can be easily realized by employing a Kinect device. However, multiple Kinect devices are required for enhancing the reconstruction density and for spatial expansion. While employing multiple Kinect devices, they must be calibrated with respect to each other in advance, and a marker is often used for this purpose. However, a marker needs to be placed at each calibration, and the result of marker detection significantly affects the calibration accuracy. Therefore, a user-friendly, efficient, accurate, and marker-less method for calibrating multiple Kinect devices is proposed in this study. The proposed method includes a joint tracking algorithm for approximate calibration, and the obtained result is further refined by applying the iterative closest point algorithm. Experimental results indicate that the proposed method is a convenient alternative to conventional marker-based methods for calibrating multiple Kinect devices. Hence, the proposed method can be incorporated in various applications of augmented reality and augmented virtuality that require 3D environment reconstruction by employing multiple Kinect devices.

• Journal of Advanced Navigation Technology
• /
• v.16 no.6
• /
• pp.1032-1037
• /
• 2012

Augmented reality (AR) is augmented virtual information on the real world with real-time. And user can interact with information. In this paper, Marker-less tracking algorithm has been studied, for implement the augmented reality system on a mobile environment. In marker-less augmented reality, users do not need to attach the markers, and constrained the location. So, it's convenient to use. For marker-less tracking, I use the SURF algorithm based on feature point extraction in this paper. The SURF algorithm can be used on mobile devices because of the computational complexity is low. However, the SURF algorithm optimization work is not suitable for mobile devices. Therefore, in this paper, in order to the suitable tracking in mobile devices, the SURF algorithm was tested in a variety of environments. And ways to optimize has been studied.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2011.10a
• /
• pp.621-624
• /
• 2011

Recently, augmented reality is divided into broadly marker based and markerless based as part of HCI (Human Computer Interaction). Markerless based is augmented object using natural features in real-world environment. On the other hand, Marker based is use to calculate easily the coordinates and exactly augmented object using flat marker of rectangular. However, marker-based image is provided due to the presence of the marker in a markerless, giving users a more less realistic and immersive view. In this paper, We research about combined diminished reality and augmented reality for Marker-Based Augmented Reality System Structure using Object Removal Tchnique in order to increase realistic and immersive view.

• Journal of Advanced Navigation Technology
• /
• v.16 no.2
• /
• pp.264-270
• /
• 2012

e-Training focusing on the experience and practice accelerates actual-active learning and enforces the learning effects against the existing theory based education. The most typical hans-on training system is augmented reality. Especially, in the training field installed augmented reality system, the automobile maintenance trainee experiences effective training with the immediate information, which is indicating the location of parts and the procedure of repairing. The tracking is the core technology of the augmented reality system. The performance of augmented reality system depends on the tracking technology. Therefore, this paper suggests the tracking technology which is proper to the e-Training augmented reality service technology for the car mechanics.

• Journal of the Korea Society of Computer and Information
• /
• v.17 no.7
• /
• pp.155-166
• /
• 2012

This paper proposes a new method of estimating the hand pose through the Mean-Shift tracking algorithm using the fusion of color and depth information for marker-less augmented reality. On marker-less augmented reality, the most of previous studies detect the hand region using the skin color from simple experimental background. Because finger features should be detected on the hand, the hand pose that can be measured from cameras is restricted considerably. However, the proposed method can easily detect the hand pose from complex background through the new Mean-Shift tracking method using the fusion of the color and depth information from 3D sensor. The proposed method of estimating the hand pose uses the gravity point and two random points on the hand without largely constraints. The proposed Mean-Shift tracking method has about 50 pixels error less than general tracking method just using color value. The augmented reality experiment of the proposed method shows results of its performance being as good as marker based one on the complex background.

• Journal of Internet Computing and Services
• /
• v.12 no.3
• /
• pp.119-129
• /
• 2011

Vision-based Human computer interaction is an emerging field of science and industry to provide natural way to communicate with human and computer. Especially, recent increasing demands for mobile augmented reality require the development of efficient interactive technologies between the augmented virtual object and users. This paper presents a novel approach to construct marker-less mobile augmented reality object and control the object. Replacing a traditional market, the human hand interface is used for marker-less mobile augmented reality system. In order to implement the marker-less mobile augmented system in the limited resources of mobile device compared with the desktop environments, we proposed a method to extract an optimal hand region which plays a role of the marker and augment object in a realtime fashion by using the camera attached on mobile device. The optimal hand region detection can be composed of detecting hand region with YCbCr skin color model and extracting the optimal rectangle region with Rotating Calipers Algorithm. The extracted optimal rectangle region takes a role of traditional marker. The proposed method resolved the problem of missing the track of fingertips when the hand is rotated or occluded in the hand marker system. From the experiment, we can prove that the proposed framework can effectively construct and control the augmented virtual object in the mobile environments.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.4 no.4
• /
• pp.618-632
• /
• 2010

This paper presents a novel approach to control the augmented reality (AR) objects robustly in a marker-less AR system by fingertip tracking and hand pattern recognition. It is known that one of the promising ways to develop a marker-less AR system is using human's body such as hand or face for replacing traditional fiducial markers. This paper introduces a real-time method to manipulate the overlaid virtual objects dynamically in a marker-less AR system using both hands with a single camera. The left bare hand is considered as a virtual marker in the marker-less AR system and the right hand is used as a hand mouse. To build the marker-less system, we utilize a skin-color model for hand shape detection and curvature-based fingertip detection from an input video image. Using the detected fingertips the camera pose are estimated to overlay virtual objects on the hand coordinate system. In order to manipulate the virtual objects rendered on the marker-less AR system dynamically, a vision-based hand control interface, which exploits the fingertip tracking for the movement of the objects and pattern matching for the hand command initiation, is developed. From the experiments, we can prove that the proposed and developed system can control the objects dynamically in a convenient fashion.

• Journal of Digital Convergence
• /
• v.12 no.8
• /
• pp.467-474
• /
• 2014

Augmented reality in the smart environments is the interaction between the user and the media through the expansion of a variety of experiences is provided. How to use the location information, how to use markers, utilizing real-time marker-less interaction with the real world and the virtual world, such as the mapping method intermediary situated in real-time. Expansion of the elements of experience, and augmented reality as a tool of information being utilized. Educational Edutainment AR card to take advantage in terms of content was a real-time marker-less approach to create an image map image map was constructed urbanization. Stereoscopic 3D environment, taking advantage of the object produced by combining augmented reality and way of interaction, educational content. Help in terms of active and passive involvement pra realistic interest leads to a way of giving tangible.

• KSCE Journal of Civil and Environmental Engineering Research
• /
• v.35 no.4
• /
• pp.961-968
• /
• 2015

As BIM has been increasingly applied to building project recently, its application to civil engineering project is also on the rise. As construction structures have been expanded and complicated in a size and type, the information for handling maintenance process has also increased. Thus, to actively utilize the BIM information created at the design stage, this study has been carried out to establish a maintenance system using a marker-less based augmented reality method, by presenting a maintenance system for the construction structures using augmented reality. A SURF algorithm is used to link the 3D objects in the design and construction phases to the maintenance phase. The presented method in this study can increase the utilization of 3D information created at the design stage, by offering an augmented reality technology at the maintenance stage. The method could also improve the efficiency of visual inspection on construction structures by augmenting 3D model of a bridge structure.

• Journal of the Semiconductor & Display Technology
• /
• v.15 no.3
• /
• pp.46-50
• /
• 2016

Recently, Depending on expectancy effect and ripple effect of augmented reality, the convergence between augmented reality and culture & arts are being actively conducted. This paper proposes a learning method for effective object tracking in 3D storytelling augmented reality in cultural properties. The proposed system is based on marker-less tracking, and there are four modules that are recognition, tracking, detecting and learning module. Recognition module is composed of SURF and LSH, and then this module generates standard object information. Tracking module tracks an object using object tracking based on reliability. This information is stored in Learning module along with learned time information. Detecting module finds out the object based on having the best possible knowledge available among the learned objects information, when the system fails to track. Also, it proposes a method for robustly implementing a 3D storytelling augmented reality in cultural properties in the future.