• Journal of the HCI Society of Korea
• /
• v.11 no.1
• /
• pp.39-45
• /
• 2016

Effective and efficient estimation of camera poses is a core method in implementing augmented reality systems or applications. The most common one is using markers, e.g., ARToolkit. However, use of markers suffers from a notorious problem that is vulnerable to occlusion. To overcome this, this paper proposes a top-down method that iteratively estimates the current camera pose by using particle swarm optimization. Through experiments, it was confirmed that the proposed method enables to implement augmented reality on severely-occluded markers.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.4 no.4
• /
• pp.618-632
• /
• 2010

This paper presents a novel approach to control the augmented reality (AR) objects robustly in a marker-less AR system by fingertip tracking and hand pattern recognition. It is known that one of the promising ways to develop a marker-less AR system is using human's body such as hand or face for replacing traditional fiducial markers. This paper introduces a real-time method to manipulate the overlaid virtual objects dynamically in a marker-less AR system using both hands with a single camera. The left bare hand is considered as a virtual marker in the marker-less AR system and the right hand is used as a hand mouse. To build the marker-less system, we utilize a skin-color model for hand shape detection and curvature-based fingertip detection from an input video image. Using the detected fingertips the camera pose are estimated to overlay virtual objects on the hand coordinate system. In order to manipulate the virtual objects rendered on the marker-less AR system dynamically, a vision-based hand control interface, which exploits the fingertip tracking for the movement of the objects and pattern matching for the hand command initiation, is developed. From the experiments, we can prove that the proposed and developed system can control the objects dynamically in a convenient fashion.

• IEMEK Journal of Embedded Systems and Applications
• /
• v.13 no.6
• /
• pp.321-328
• /
• 2018

This paper presents an automatic target tracking flight system using a PID controller based on velocity command of a multirotor UAV. The automatic flight system includes marker based onboard target detection and an automatic velocity command generation replacing manual controller. A quad-rotor UAV is equipped with a camera and an image processing computer to detect the marker in real time and to estimate the relative distance from the target. The marker tracking system consists of PID controller and generates velocity command based on the relative distance. The generated velocity command is used as the input of the UAV's original flight controller. The operation of the proposed system was verified through actual flight tests using a marker on top of a moving vehicle and tracks it to successfully demonstrate its capability using a quad-rotor UAV.

• Journal of KIISE:Software and Applications
• /
• v.37 no.1
• /
• pp.29-38
• /
• 2010

We propose an interactive projection technique to display details of a large image in a high resolution and brightness by tracking a portable projector. A closed-loop based tracking method is presented to update the projected image while a user changes the position of the detail area by moving the portable projector. A marker is embedded in the large image to indicate the position to be occupied by the detail image projected by the portable projector. The marker is extracted in sequential images acquired by a camera attached to the portable projector. The marker position in the large display image is updated under a constraint that the center positions of marker and camera frame coincide in every camera frame. The image and projective transformation for warping are calculated using the marker position and shape in the camera frame. The marker's four corner points are determined by a four-step segmentation process which consists of camera image preprocessing based on HSI, edge extraction by Hough transformation, quadrangle test, and cross-ratio test. The interactive projection system implemented by the proposed method performs at about 24fps. In the user study, the overall feedback about the system usability was very high.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2017.05a
• /
• pp.297-299
• /
• 2017

Recently, the application fields of augmented reality(AR) are rapidly increasing, and related contents are also increasing in demand. In this way, object-based marker recognition is required for service of AR contents in mobile environment. At this time, in order to provide information corresponding to the marker, a technique of generating and servicing a virtual object corresponding to a specific marker is used. However, when a virtual object corresponding to a marker is held on the AR screen, a phenomenon occurs that an object of the marker unstably shakes due to various reasons such as camera shake and camera movement. As described above, the AR service based on the mobile device has a problem that it is difficult to represent objects stably. In this paper, we propose a stable marker recognition and tracking technique by applying the filtering technique according to the physical state change of the device when recognizing fixed markers in mobile AR environment.

• Journal of the Korea Society of Computer and Information
• /
• v.24 no.2
• /
• pp.119-126
• /
• 2019

As interest in augmented reality has increased recently, attempts have been made to incorporate augmented reality into various fields. In implementing augmented reality, the method by which markers are used is to extract feature points of markers to recognize 3D coordinates and, in some cases, it is necessary to recognize multiple markers simultaneously. Therefore, this paper proposes optimization methods for recognising multiple markers at the same time. Unity 3D and augmented reality library Vuforia are used to implement the experimental environment. The augmented reality program produced was implemented in an application form and tested using a mobile camera. We looked for optimization methods for manufacturing markers directly and for recognizing multiple markers through changes in the experimental environment. The results of the experiment can provide a higher recognition rate in an environment where multiple marker recognition is required later.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.48 no.4
• /
• pp.49-58
• /
• 2011

Typically, vision-based AR systems operate on the basis of prior knowledge of the environment such as a square marker. The traditional marker-based AR system has a limitation that the marker has to be located in the sensing range. Therefore, there have been considerable research efforts for the techniques known as real-time camera tracking, in which the system attempts to add unknown 3D features to its feature map, and these then provide registration even when the reference map is out of the sensing range. In this paper, we describe a real-time camera tracking framework specifically designed to track a monocular camera in a desktop workspace. Basic idea of the proposed scheme is that a real-time camera tracking is achieved on the basis of a plane tracking algorithm. Also we suggest a method for re-detecting features to maintain registration of virtual objects. The proposed method can cope with the problem that the features cannot be tracked, when they go out of the sensing range. The main advantage of the proposed system are not only low computational cost but also convenient. It can be applicable to an augmented reality system for mobile computing environment.

• International Journal of Fuzzy Logic and Intelligent Systems
• /
• v.13 no.2
• /
• pp.140-146
• /
• 2013

In this paper, we describe a vision sensor-based driving algorithm for indoor automatic guided vehicles (AGVs) that facilitates a path tracking task using two mono cameras for navigation. One camera is mounted on vehicle to observe the environment and to detect markers in front of the vehicle. The other camera is attached so the view is perpendicular to the floor, which compensates for the distance between the wheels and markers. The angle and distance from the center of the two wheels to the center of marker are also obtained using these two cameras. We propose five movement patterns for AGVs to guarantee smooth performance during path tracking: starting, moving straight, pre-turning, left/right turning, and stopping. This driving algorithm based on two vision sensors gives greater flexibility to AGVs, including easy layout change, autonomy, and even economy. The algorithm was validated in an experiment using a two-wheeled mobile robot.

• Journal of Korea Multimedia Society
• /
• v.21 no.10
• /
• pp.1162-1170
• /
• 2018

This paper presents an augmented reality system for multiple users. The proposed system performs ar image-based pose estimation of users and pose of each user is shared with other uses via a network server. For camera-based pose estimation, we install multiple markers in a pre-determined space and select the marker with the best appearance. The marker is detected by corner point detection and for robust pose estimation. the marker's corner points are tracked by optical flow tracking algorithm. Experimental results show that the proposed system successfully provides an augmented reality application to multiple users even when users are rapidly moving and some of markers are occluded by users.

• 한국HCI학회:학술대회논문집
• /
• 2009.02a
• /
• pp.493-496
• /
• 2009

Many AR (Augmented Reality) applications have been interested in a marker-less tracking since the tracking methods give camera poses without attaching explicit markers. In this paper, we propose a new marker-less page recognition and tracking algorithm for an AR book application such as DigilogBook. The proposed method only requires orthogonal images of pages, which need not to be trained for a long time, and the algorithm works in real-time. The page recognition is done in two steps by using SIFT (Scale Invariant Feature Transform) descriptors and the comparison evaluation function. And also, the method provides real-time tracking with 25fps ~ 30fps by separating the page recognition and the frame-to-frame matching into two multi-cores. The proposed algorithm will be extended to various AR applications that require multiple objects tracking.