• International conference on construction engineering and project management
• /
• 2022.06a
• /
• pp.904-911
• /
• 2022

Occlusion is one of the most challenging problems for computer vision-based construction monitoring. Due to the intrinsic dynamics of construction scenes, vision-based technologies inevitably suffer from occlusions. Previous researchers have proposed the occlusion handling methods by leveraging the prior information from the sequential images. However, these methods cannot be employed for construction object detection in non-sequential images. As an alternative occlusion handling method, this study proposes a data augmentation-based framework that can enhance the detection performance under occlusions. The proposed approach is specially designed for rebar occlusions, the distinctive type of occlusions frequently happen during construction worker detection. In the proposed method, the artificial rebars are synthetically generated to emulate possible rebar occlusions in construction sites. In this regard, the proposed method enables the model to train a variety of occluded images, thereby improving the detection performance without requiring sequential information. The effectiveness of the proposed method is validated by showing that the proposed method outperforms the baseline model without augmentation. The outcomes demonstrate the great potential of the data augmentation techniques for occlusion handling that can be readily applied to typical object detectors without changing their model architecture.

• Journal of Broadcast Engineering
• /
• v.17 no.6
• /
• pp.1040-1047
• /
• 2012

In this paper, we propose a ball tracking algorithm robust against occlusion in broadcasting soccer video sequences. Soccer ball tracking is a challenging task due to occlusion, fast motion and fast direction changes. Many works have been proposed based on ball trajectory. However, this approach requires heavy computational complexity. We propose a ball tracking algorithm with occlusion handling capability. Initial ball location is calculated using the circular hough transform. Then, the ball is tracked using template matching. Occlusion is handled by matching score. In occlusion cases, we generate a set of ball candidates. The ball candidates which exist in the previous frame were removed. On the other hand, the new appearing candidate is determined as the ball. Experiments with several broadcasting soccer video sequences show that the proposed method efficiently handles the occlusion cases.

• Journal of Sensor Science and Technology
• /
• v.24 no.1
• /
• pp.54-61
• /
• 2015

In recent years, there has been increasing use of automatic surveillance and monitoring systems based on vision sensors. Humans are often the most important target in the systems, but processing human images is difficult due to the small sizes and flexible motions. Particularly, occlusion among pedestrians in camera images brings practical problems. In this paper, we propose a novel method to separate image regions of occluded pedestrians. A camera equipped with a wide angle lens is attached to the ceiling of a building corridor for sensing pedestrians with a wide field of view. The output images of the camera are processed for the human detection, tracking, identification, distortion correction, and occlusion handling. We resolve the occlusion problem adaptively depending on the angles and positions of their heads. Experimental results showed that the proposed method is more efficient and accurate compared with existing methods.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.13 no.4
• /
• pp.2094-2112
• /
• 2019

Focusing on the issue that the conventional Kernel Correlation Filter (KCF) algorithm has poor performance in handling scale change and obscured objects, this paper proposes an anti-occlusion and scale adaptive tracking algorithm in the basis of KCF. The average Peak-to Correlation Energy and the peak value of correlation filtering response are used as the confidence indexes to determine whether the target is obscured. In the case of non-occlusion, we modify the searching scheme of the KCF. Instead of searching for a target with a fixed sample size, we search for the target area with multiple scales and then resize it into the sample size to compare with the learnt model. The scale factor with the maximum filter response is the best target scaling and is updated as the optimal scale for the following tracking. Once occlusion is detected, the model updating and scale updating are stopped. Experiments have been conducted on the OTB benchmark video sequences for compassion with other state-of-the-art tracking methods. The results demonstrate the proposed method can effectively improve the tracking success rate and the accuracy in the cases of scale change and occlusion, and meanwhile ensure a real-time performance.

• Journal of the HCI Society of Korea
• /
• v.11 no.1
• /
• pp.39-45
• /
• 2016

Effective and efficient estimation of camera poses is a core method in implementing augmented reality systems or applications. The most common one is using markers, e.g., ARToolkit. However, use of markers suffers from a notorious problem that is vulnerable to occlusion. To overcome this, this paper proposes a top-down method that iteratively estimates the current camera pose by using particle swarm optimization. Through experiments, it was confirmed that the proposed method enables to implement augmented reality on severely-occluded markers.

• Journal of the Institute of Electronics and Information Engineers
• /
• v.54 no.2
• /
• pp.99-105
• /
• 2017

Generally, stereo matching methods are used to estimate depth information based on color and spatial similarity. However, most depth estimation methods suffer from the occlusion region because occlusion regions cause inaccurate depth information. Moreover, they do not consider the temporal dimension when estimating the disparity. In this paper, we propose a temporal stereo matching method, considering occlusion and disregarding inaccurate temporal depth information. First, we apply a global stereo matching algorithm to estimate the depth information, we segment the image to occlusion and non-occlusion regions. After occlusion detection, we fill the occluded region with a reasonable disparity value that are obtained from neighboring pixels of the current pixel. Then, we apply a temporal disparity estimation method using the reliable information. Experimental results show that our method detects more accurate occlusion regions, compared to a conventional method. The proposed method increases the temporal consistency of estimated disparity maps and outperforms per-frame methods in noisy images.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.37 no.6A
• /
• pp.458-463
• /
• 2012

In this paper, we propose a direct depth map acquisition method for the convergence camera array as well as the parallel camera array. The conventional methods perform image rectification to reduce complexity and improve accuarcy. However, image rectification may lead to unwanted consequences for the convergence camera array. Thus, the proposed method excludes image rectification and directly extracts depth values using the epipolar constraint. In order to acquire a more accurate depth map, occlusion detection and handling processes are added. Reasonable depth values are assigned to the obtained occlusion region by the distance and color differences from neighboring pixels. Experimental results show that the proposed method has fewer limitations than the conventional methods and generates more accurate depth maps stably.

• IEIE Transactions on Smart Processing and Computing
• /
• v.1 no.2
• /
• pp.73-77
• /
• 2012

This paper reports a combined depth- and model-based face detection and tracking approach. The proposed algorithm consists of four functional modules; i) color-based candidate region extraction, ii) generation of the depth histogram for handling occlusion, iii) rotation-invariant face region detection using ellipse fitting, and iv) face tracking based on motion prediction. This technique solved the occlusion problem under complicated environment by detecting the face candidate region based on the depth-based histogram and skin colors. The angle of rotation was estimated by the ellipse fitting method in the detected candidate regions. The face region was finally determined by inversely rotating the candidate regions by the estimated angle using Haar-like features that were robustly trained robustly by the frontal face.

• Journal of the Korea Computer Graphics Society
• /
• v.21 no.4
• /
• pp.11-17
• /
• 2015

As the needs of real-time visual object tracking are increasing in various kinds of application fields such as surveillance, entertainment, etc., kernel-based mean-shift tracking has received more interests. One of major issues in kernel-based mean-shift tracking is to be robust under partial or full occlusion status. This paper presents a real-time mean-shift tracking which is robust in partial occlusion by applying multi-mode local kernel weight. In the proposed method, a kernel is divided into multiple sub-kernels and each sub-kernel has a kernel weight to be determined according to the location of the sub-kernel. The experimental results show that the proposed method is more stable than the previous methods with multi-mode kernels in partial occlusion circumstance.

• International Journal of Fuzzy Logic and Intelligent Systems
• /
• v.12 no.1
• /
• pp.60-65
• /
• 2012

This paper presents a method for occluded object based motion estimation and tracking system in dynamic image sequences using particle filter with 3D reconstruction. A unique characteristic of this study is its ability to cope with partial occlusion based continuous motion estimation using particle filter inspired from the mirror neuron system in human brain. To update a prior knowledge about the shape or motion of objects, firstly, fundamental 3D reconstruction based occlusion tracing method is applied and object landmarks are determined. And optical flow based motion vector is estimated from the movement of the landmarks. When arbitrary partial occlusions are occurred, the continuous motion of the hidden parts of object can be estimated by particle filter with optical flow. The resistance of the resulting estimation to partial occlusions enables the more accurate detection and handling of more severe occlusions.