• Journal of the Korean Society of Manufacturing Technology Engineers
• /
• v.24 no.6
• /
• pp.703-709
• /
• 2015

In this work, a robot aimed at grapping and delivering an object by using a simple finger-pointing command from a hand- or arm-handicapped person is introduced. In this robot system, a Leap Motion sensor is utilized to obtain the finger-motion data of the user. In addition, a Kinect sensor is also used to measure the 3D (Three Dimensional)-position information of the desired object. Once the object is pointed at through the finger pointing of the handicapped user, the exact 3D information of the object is determined using an image processing technique and a coordinate transformation between the Leap Motion and Kinect sensors. It was found that the information obtained is transmitted to the robot controller, and that the robot eventually grabs the target and delivers it to the handicapped person successfully.

• The Transactions of The Korean Institute of Electrical Engineers
• /
• v.65 no.3
• /
• pp.477-486
• /
• 2016

This paper presents the area classification, identification, and tracking for multiple moving objects with the similar colors. To do this, first, we use the GMM(Gaussian Mixture Model)-based background modeling method to detect the moving objects. Second, we propose the use of the binary and morphology of image in order to eliminate the shadow and noise in case of detection of the moving object. Third, we recognize ROI(region of interest) of the moving object through labeling method. And, we propose the area classification method to remove the background from the detected moving objects and the novel method for identifying the classified moving area. Also, we propose the method for tracking the identified moving object using Kalman filter. To the end, we propose the effective tracking method when detecting the multiple objects with the similar colors. Finally, we demonstrate the feasibility and applicability of the proposed algorithms through some experiments.

• Journal of Information Processing Systems
• /
• v.19 no.1
• /
• pp.80-88
• /
• 2023

RGB-thermal (RGB-T) tracking using unmanned aerial vehicles (UAVs) involves challenges with regards to the similarity of objects, occlusion, fast motion, and motion blur, among other issues. In this study, we propose dynamic tracking aggregation (DTA) as a unified framework to perform object detection and data association. The proposed approach obtains fused features based a transformer model and an L1-norm strategy. To link the current frame with recent information, a dynamically updated embedding called dynamic tracking identification (DTID) is used to model the iterative tracking process. For object association, we designed a long short-term tracking aggregation module for dynamic feature propagation to match spatial and temporal embeddings. DTA achieved a highly competitive performance in an experimental evaluation on public benchmark datasets.

• Journal of Institute of Control, Robotics and Systems
• /
• v.17 no.3
• /
• pp.229-235
• /
• 2011

To make a robust object tracking and identifying system for an intelligent robot and/or home system, heterogeneous sensor fusion between visible ray system and infrared ray system is proposed. The proposed system separates the object by combining the ROI (Region of Interest) estimated from two different images based on a heterogeneous sensor that consolidates the ordinary CCD camera and the IR (Infrared) camera. Human's body and face are detected in both images by using different algorithms, such as histogram, optical-flow, skin-color model and Haar model. Also the pose of human body is estimated from the result of body detection in IR image by using PCA algorithm along with AdaBoost algorithm. Then, the results from each detection algorithm are fused to extract the best detection result. To verify the heterogeneous sensor fusion system, few experiments were done in various environments. From the experimental results, the system seems to have good tracking and identification performance regardless of the environmental changes. The application area of the proposed system is not limited to robot or home system but the surveillance system and military system.

• Proceedings of the Korean Institute of Building Construction Conference
• /
• 2021.05a
• /
• pp.40-41
• /
• 2021

The construction industry has the highest occupational accidents/injuries among all industries. Korean government installed surveillance camera systems at construction sites to reduce occupational accident rates. Construction safety managers are monitoring potential hazards at the sites through surveillance system; however, the human capability of monitoring surveillance system with their own eyes has critical issues. Therefore, this study proposed to build a deep learning-based safety monitoring system that can obtain information on the recognition, location, identification of workers and heavy equipment in the construction sites by applying multiple-object tracking with instance segmentation. To evaluate the system's performance, we utilized the MS COCO and MOT challenge metrics. These results present that it is optimal for efficiently automating monitoring surveillance system task at construction sites.

• Proceedings of the IEEK Conference
• /
• 2008.06a
• /
• pp.915-916
• /
• 2008

We propose a clustering based object feature matching for identification of same object in multi-camera system. The method is focused on ease to system initialization and extension. Clustering is used to estimate parameters of Gaussian mixture models of objects. A similarity measure between models are determined by Kullback-Leibler divergence. This method can be applied to occlusion problem in tracking.

• Transactions of the Korean Society of Mechanical Engineers A
• /
• v.37 no.10
• /
• pp.1219-1227
• /
• 2013

A new type of wearable robot is developed for a disabled person with disabled limbs, that is, a person who cannot intentionally move his/her legs and arms. This robot can enable the disabled person to grip an object using eye movements. A gaze tracking algorithm is employed to detect pupil movements by which the person observes the object to be gripped. By using this gaze tracking 2D information, the object is identified and the distance to the object is measured using a Kinect device installed on the robot shoulder. By using several coordinate transformations and a matching scheme, the final 3D information about the object from the base frame can be clearly identified, and the final position data is transmitted to the DSP-controlled robot controller, which enables the target object to be gripped successfully.

• Journal of the Korean Institute of Telematics and Electronics B
• /
• v.32B no.11
• /
• pp.1405-1416
• /
• 1995

An effective algorithm for implementation of unmanned surveillance system which detects moving object from image sequences, predicts the direction of it, and drives the camera in real time is proposed. Outputs of proposed algorithm are coordinates of location of moving object, and they are converted to the values according to camera model. As a pre- processing, extraction of moving object and shape discrimination are performed. Existence of the moving object or scene change is detected by computing the temporal derivatives of consecutive two or more images in a sequence, and this result of derivatives is combined with the edge map from one original gray level image to obtain the position of moving object. Shape discri-mination(Target identification) is performed by analysis of distribution of projection profiles in x and y directions. To reduce the prediction error due to the fact that the motion cha- racteristic of walking man may have an abrupt change of moving direction, an order adaptive lattice structured linear predictor is proposed.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2009.10a
• /
• pp.285-288
• /
• 2009

동영상에서 물체를 추적하기 위한 많은 방법들은 각 방법마다 다양한 요소들을 이용한다. 하지만 다양한 요소들은 그 관계를 명확히 나타낼 수 없다. 본 논문에서는 동영상에서 물체 추적을 위해 시각적 기본 요소의 동일성을 나타내고 설명하기 위한 방법을 제안한다. 시각적 기본 요소란 이미지에서 얻을 수 있는 순수한 시각적 기본 요소들인 색상, 명암, 윤곽선 정보를 말하며 이 정보를 이용하여 연속된 프레임을 비교해 동일한 물체인지를 판단한다. 그리하여 판단된 정보를 가지고 추적에 사용되는 요소들의 지속적인 갱신을 통해 대상을 모델 없이 추적하고 인식 과정에 대하여 제어가 가능하도록 한다.

• The Journal of the Korea Contents Association
• /
• v.7 no.2
• /
• pp.40-50
• /
• 2007

In this paper, we propose an efficient method for detecting and tracking multiple moving objects based on morphological region merging from real-time video sequences. The proposed approach consists of adaptive threshold extraction, morphological region merging and detecting and tracking of objects. Firstly, input frame is separated into moving regions and static regions using the difference of images between two consecutive frames. Secondly, objects are segmented with a reference background image and adaptive threshold values, then, the segmentation result is refined by morphological region merge algorithm. Lastly, each object segmented in a previous step is assigned a consistent identification over time, based on its spatio-temporal information. The experimental results show that a proposed method is efficient and useful in terms of real-time multiple objects detecting and tracking.