• Journal of the HCI Society of Korea
• /
• v.11 no.1
• /
• pp.39-45
• /
• 2016

Effective and efficient estimation of camera poses is a core method in implementing augmented reality systems or applications. The most common one is using markers, e.g., ARToolkit. However, use of markers suffers from a notorious problem that is vulnerable to occlusion. To overcome this, this paper proposes a top-down method that iteratively estimates the current camera pose by using particle swarm optimization. Through experiments, it was confirmed that the proposed method enables to implement augmented reality on severely-occluded markers.

• The KIPS Transactions:PartA
• /
• v.17A no.4
• /
• pp.189-196
• /
• 2010

This paper presents an improved marker detection algorithm using hybrid features such as corner, line segment, region, and adaptive threshold values, etc. In usual augmented reality environments, there are often marker occlusion and poor illumination. However, existing ARToolkit fails to recognize the marker in these situations, especially, partial concealment of marker by user, large change of illumination and dim circumstances. In order to solve these problems, the adaptive threshold technique is adopted to extract a marker region and a corner extraction method based on line segments is presented against marker occlusions. In addition, a compensating method, corresponding the marker size and center between registered and extracted one, is proposed to increase the template matching efficiency, because the inside marker size of warped images is slightly distorted due to the movement of corner and warping. Therefore, experimental results showed that the proposed algorithm can robustly detect the marker in severe illumination change and occlusion environment and use similar markers because the matching efficiency was increased almost 30%.

• Journal of Korea Game Society
• /
• v.20 no.2
• /
• pp.183-192
• /
• 2020

Due to the problem of matching between virtual world space and real-world space, the reality of augmented reality content is rather low. There are many reasons for this result, firstly virtual object is rendered without considering relation between real-world space and virtual world space. Secondly, virtual objects rely too much on the marker to reduce reality. We propose two schemes to improve the reality of augmented reality, one is people occlusion, the other is to reduce the dependence of virtual objects on the marker.

• The Journal of the Korea institute of electronic communication sciences
• /
• v.12 no.5
• /
• pp.883-890
• /
• 2017

Among the augmented reality services, the most frequently used services are marker based augmented reality services. However, there is a problem that the augmented reality service can not be provided in an environment in which the marker image can not be recognized. In this paper, we propose a method to provide more stable service by estimating the user's posture even if the marker image can not be correctly recognized due to occlusion, obstacle or marker damage in the marker based augmented reality. In the proposed method, when a failure occurs in the provision of a marker based augmented reality, the attitude of the user is estimated using the 3-dimensional coordinates measured through communication between the three beacons and the user, and it allows the user to receive the augmented reality service continuously. We describe the scenario of augmented reality technique using proposed marker recognition and beacon communication, and present the results of experiments based on the degree of occlusion and damage.

• Journal of Korea Multimedia Society
• /
• v.16 no.6
• /
• pp.720-734
• /
• 2013

In this paper, we suggest an augmented reality authoring tool system that users can easily make augmented reality contents using hand gesture and marker-based interaction methods. The previous augmented reality authoring tools are focused on augmenting a virtual object and to interact with this kind of augmented reality contents, user used the method utilizing marker or sensor. We want to solve this limited interaction method problem by applying marker based interaction method and gesture interaction method using depth sensing camera, Kinect. In this suggested system, user can easily develop simple form of marker based augmented reality contents through interface. Also, not just providing fragmentary contents, this system provides methods that user can actively interact with augmented reality contents. This research provides two interaction methods, one is marker based method using two markers and the other is utilizing marker occlusion. In addition, by recognizing and tracking user's bare hand, this system provides gesture interaction method which can zoom-in, zoom-out, move and rotate object. From heuristic evaluation about authoring tool and compared usability about marker and gesture interaction, this study confirmed a positive result.

• The Transactions of The Korean Institute of Electrical Engineers
• /
• v.66 no.1
• /
• pp.121-126
• /
• 2017

Tracking system is essential for Image Guided Surgery(IGS). Optical Tracking System(OTS) is widely used to IGS for its high accuracy and easy usage. However, OTS doesn't work when occlusion of marker occurs. In this paper sensor data fusion with OTS and Inertial Navigation System(INS) is proposed to solve this problem. The proposed system improves the accuracy of tracking system by eliminating gaussian error of the sensor and supplements the disadvantages of OTS and IMU through sensor fusion based on Kalman filter. Also, sensor calibration method that improves the accuracy is introduced. The performed experiment verifies the effectualness of the proposed algorithm.

• Journal of the Semiconductor & Display Technology
• /
• v.11 no.1
• /
• pp.79-83
• /
• 2012

We use adaptive method and determine threshold coefficient so that the algorithm could decide a suitable binarization threshold coefficient of the image to detecting a marker; therefore, we solve the light influence on the shadow area and dark region. In order to improve the speed for reducing computation we created Integral Image. The algorithm detects an outline of the image by using canny edge detection for getting damage or obscured markers as it receives the noise removed picture. The strength of the line of the outline is extracted by Hough transform and it extracts the candidate regions corresponding to the coordinates of the corners. Markers extracted using the equation of a straight edge to find the coordinates. By using the equation of straight the algorithm finds the coordinates the corners. of extracted markers. As a result, even if all corners are obscured, the algorithm can find all of them and this was proved through the experiment.

• Journal of Institute of Control, Robotics and Systems
• /
• v.22 no.8
• /
• pp.579-584
• /
• 2016

When surgical instruments are tracked in an image-guided surgical navigation system, a stereo vision system with high accuracy is generally used, which is called optical tracker. However, this optical tracker has the disadvantage that a line-of-sight between the tracker and surgical instrument must be maintained. Therefore, to complement the disadvantage of optical tracking systems, an internal vision sensor is attached to a surgical instrument in this paper. Monitoring the target marker pattern attached on patient with this vision sensor, this surgical instrument is possible to be tracked even when the line-of-sight of the optical tracker is occluded. To verify the system's effectiveness, a series of basic experiments is carried out. Lastly, an integration experiment is conducted. The experimental results show that rotational error is bounded to max $1.32^{\circ}$ and mean $0.35^{\circ}$, and translation error is in max 1.72mm and mean 0.58mm. Finally, it is confirmed that the proposed tool tracking method using an internal vision sensor is useful and effective to overcome the occlusion problem of the optical tracker.

• Journal of KIISE:Computing Practices and Letters
• /
• v.16 no.11
• /
• pp.1131-1135
• /
• 2010

This paper presents a method to capture the posture of the human lower-limbs on the 3D space by using a single camera and a planar mirror. The system estimates the pose of the camera facing the mirror by using four coplanar IR markers attached on the planar mirror. After that, the training space is set up based on the relationship between the mirror and the camera. When a patient steps on the weight board, the system obtains relative position between patients' feet. The markers are attached on the sides of both legs, so that some markers are invisible from the camera due to the self-occlusion. The reflections of the markers on the mirror can partially resolve the above problem with a single camera system. The 3D positions of the markers are estimated by using the geometric information of the camera on the training space. Finally the system estimates and visualizes the posture and motion of the both legs based on the 3D marker positions.

• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.44 no.2 s.314
• /
• pp.37-46
• /
• 2007

In this paper, we propose technologies for enhancing the immersive realization of virtual objects in AR-based product design. Generally, multimodal senses such as visual/auditory/tactile feedback are well known as a method for enhancing the immersion in case of interaction with virtual objects. By adapting tangible objects we can provide touch sensation to users. A 3D model of the same scale overlays the whole area of the tangible object so the marker area is invisible. This contributes to enhancing immersion. Also, the hand occlusion problem when the virtual objects overlay the user's hands is partially solved, providing more immersive and natural images to users. Finally, multimodal feedback also creates better immersion. In our work, both vibrotactile feedback through page motors, pneumatic tactile feedback, and sound feedback are considered. In our scenario, a game-phone model is selected, by way of proposed augmented vibrotactile feedback, hands occlusion-reduced visual effects and sound feedback are provided to users. These proposed methodologies will contribute to a better immersive realization of the conventional AR system.