• Title/Summary/Keyword: Multi-object Tracking

Search Result 164, Processing Time 0.028 seconds

Training of a Siamese Network to Build a Tracker without Using Tracking Labels (샴 네트워크를 사용하여 추적 레이블을 사용하지 않는 다중 객체 검출 및 추적기 학습에 관한 연구)

  • Kang, Jungyu;Song, Yoo-Seung;Min, Kyoung-Wook;Choi, Jeong Dan
    • The Journal of The Korea Institute of Intelligent Transport Systems
    • /
    • v.21 no.5
    • /
    • pp.274-286
    • /
    • 2022
  • Multi-object tracking has been studied for a long time under computer vision and plays a critical role in applications such as autonomous driving and driving assistance. Multi-object tracking techniques generally consist of a detector that detects objects and a tracker that tracks the detected objects. Various publicly available datasets allow us to train a detector model without much effort. However, there are relatively few publicly available datasets for training a tracker model, and configuring own tracker datasets takes a long time compared to configuring detector datasets. Hence, the detector is often developed separately with a tracker module. However, the separated tracker should be adjusted whenever the former detector model is changed. This study proposes a system that can train a model that performs detection and tracking simultaneously using only the detector training datasets. In particular, a Siam network with augmentation is used to compose the detector and tracker. Experiments are conducted on public datasets to verify that the proposed algorithm can formulate a real-time multi-object tracker comparable to the state-of-the-art tracker models.

Multi-channel Video Analysis Based on Deep Learning for Video Surveillance (보안 감시를 위한 심층학습 기반 다채널 영상 분석)

  • Park, Jang-Sik;Wiranegara, Marshall;Son, Geum-Young
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.13 no.6
    • /
    • pp.1263-1268
    • /
    • 2018
  • In this paper, a video analysis is proposed to implement video surveillance system with deep learning object detection and probabilistic data association filter for tracking multiple objects, and suggests its implementation using GPU. The proposed video analysis technique involves object detection and object tracking sequentially. The deep learning network architecture uses ResNet for object detection and applies probabilistic data association filter for multiple objects tracking. The proposed video analysis technique can be used to detect intruders illegally trespassing any restricted area or to count the number of people entering a specified area. As a results of simulations and experiments, 48 channels of videos can be analyzed at a speed of about 27 fps and real-time video analysis is possible through RTSP protocol.

Clustering based object feature matching for multi-camera system (멀티 카메라 연동을 위한 군집화 기반의 객체 특징 정합)

  • Kim, Hyun-Soo;Kim, Gyeong-Hwan
    • Proceedings of the IEEK Conference
    • /
    • 2008.06a
    • /
    • pp.915-916
    • /
    • 2008
  • We propose a clustering based object feature matching for identification of same object in multi-camera system. The method is focused on ease to system initialization and extension. Clustering is used to estimate parameters of Gaussian mixture models of objects. A similarity measure between models are determined by Kullback-Leibler divergence. This method can be applied to occlusion problem in tracking.

  • PDF

Multiple Object Tracking with Color-Based Particle Filter for Intelligent Space (공간지능화를 위한 색상기반 파티클 필터를 이용한 다중물체추적)

  • Jin, Tae-Seok;Hashimoto, Hideki
    • The Journal of Korea Robotics Society
    • /
    • v.2 no.1
    • /
    • pp.21-28
    • /
    • 2007
  • The Intelligent Space(ISpace) provides challenging research fields for surveillance, human-computer interfacing, networked camera conferencing, industrial monitoring or service and training applications. ISpace is the space where many intelligent devices, such as computers and sensors, are distributed. According to the cooperation of many intelligent devices, the environment, it is very important that the system knows the location information to offer the useful services. In order to achieve these goals, we present a method for representing, tracking and human following by fusing distributed multiple vision systems in ISpace, with application to pedestrian tracking in a crowd. And the article presents the integration of color distributions into particle filtering. Particle filters provide a robust tracking framework under ambiguity conditions. We propose to track the moving objects by generating hypotheses not in the image plan but on the top-view reconstruction of the scene. Comparative results on real video sequences show the advantage of our method for multi-object tracking. Also, the method is applied to the intelligent environment and its performance is verified by the experiments.

  • PDF

Tracking of Multi-targets in CCD/IR Multi-sensor system for ITS application (CCD/IR 영상에서의 다중 센서 다중 표적 추적)

  • 이일광;고한석
    • Proceedings of the IEEK Conference
    • /
    • 2001.09a
    • /
    • pp.359-362
    • /
    • 2001
  • 본 논문에서는 광학센서와 적외선 센서를 사용하는 Multi-sensor 시스템에서 영상 정보를 통한 물체의 추적 및 인식에 필요한 영상을 분리하는데 필요한 전처리와 object 기반의 추적 방법을 제안하였다. 일반적인 추적 알고리즘의 목표는 consistency를 유지하는데 있다. 그러나 인식에 필요한 영상을 분리하기 위해서는 물체의 범위를 정확히 판단 할 수 있는 능력이 중요하다. 이를 위해 CCD와 IR영상에 동시에 적용 가능한 전처리 기법과 object 기반의 two-step 추적 알고리즘을 통해 consistency외에도, 물체의 범위를 estimation하여 인식에 필요한 범위를 분리해 낸다. 본 논문에서는 ITS 의 ETCS application을 위해 이종 센서인 CCD와 IR의 야간 차량 영상정보를 이용하여 알고리즘을 test 하였다.

  • PDF

A Study on Multi-Object Tracking Method using Color Clustering in ISpace (컬러 클러스터링 기법을 이용한 공간지능화의 다중이동물체 추척 기법)

  • Jin, Tae-Seok;Kim, Hyun-Deok
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.11 no.11
    • /
    • pp.2179-2184
    • /
    • 2007
  • The Intelligent Space(ISpace) provides challenging research fields for surveillance, human-computer interfacing, networked camera conferencing, industrial monitoring or service and training applications. ISpace is the space where many intelligent devices, such as computers and sensors, are distributed. According to the cooperation of many intelligent devices, the environment, it is very important that the system knows the location information to offer the useful services. In order to achieve these goals, we present a method for representing, tracking and human following by fusing distributed multiple vision systems in ISpace, with application to pedestrian tracking in a crowd. This paper described appearance based unknown object tracking with the distributed vision system in intelligent space. First, we discuss how object color information is obtained and how the color appearance based model is constructed from this data. Then, we discuss the global color model based on the local color information. The process of learning within global model and the experimental results are also presented.

Moving Object Tracking Using MHI and M-bin Histogram (MHI와 M-bin Histogram을 이용한 이동물체 추적)

  • Oh, Youn-Seok;Lee, Soon-Tak;Baek, Joong-Hwan
    • Journal of Advanced Navigation Technology
    • /
    • v.9 no.1
    • /
    • pp.48-55
    • /
    • 2005
  • In this paper, we propose an efficient moving object tracking technique for multi-camera surveillance system. Color CCD cameras used in this system are network cameras with their own IP addresses. Input image is transmitted to the media server through wireless connection among server, bridge, and Access Point (AP). The tracking system sends the received images through the network to the tracking module, and it tracks moving objects in real-time using color matching method. We compose two sets of cameras, and when the object is out of field of view (FOV), we accomplish hand-over to be able to continue tracking the object. When hand-over is performed, we use MHI(Motion History Information) based on color information and M-bin histogram for an exact tracking. By utilizing MHI, we can calculate direction and velocity of the object, and those information helps to predict next location of the object. Therefore, we obtain a better result in speed and stability than using template matching based on only M-bin histogram, and we verified this result by an experiment.

  • PDF

Implementation of augmented reality and object tracking using multiple camera (다중 카메라를 이용한 객체추적과 증강현실의 구현)

  • Kim, Hag-Hee
    • Journal of the Korea Society of Computer and Information
    • /
    • v.16 no.6
    • /
    • pp.89-97
    • /
    • 2011
  • When examining current process of object tracking and search, objects were tracked by extracting them from image that was inputted through fixed single camera and objects were recognized through Zoom function to know detailed information on objects tracked. This study proposed system that expresses information on area that can seek and recognize object tracked as augmented reality by recognizing and seeking object by using multi camera. The result of experiment on proposed system showed that the number of pixels that was included in calculation was remarkably reduced and recognition rate of object was enhanced and time that took to identify information was shortened. Compared with existing methods, this system has advantage of better accuracy that can detect the motion of object and advantage of shortening time that took to detect motion.

Robust Multi-person Tracking for Real-Time Intelligent Video Surveillance

  • Choi, Jin-Woo;Moon, Daesung;Yoo, Jang-Hee
    • ETRI Journal
    • /
    • v.37 no.3
    • /
    • pp.551-561
    • /
    • 2015
  • We propose a novel multiple-object tracking algorithm for real-time intelligent video surveillance. We adopt particle filtering as our tracking framework. Background modeling and subtraction are used to generate a region of interest. A two-step pedestrian detection is employed to reduce the computation time of the algorithm, and an iterative particle repropagation method is proposed to enhance its tracking accuracy. A matching score for greedy data association is proposed to assign the detection results of the two-step pedestrian detector to trackers. Various experimental results demonstrate that the proposed algorithm tracks multiple objects accurately and precisely in real time.

Real-time Multi-Objects Recognition and Tracking Scheme (실시간 다중 객체 인식 및 추적 기법)

  • Kim, Dae-Hoon;Rho, Seung-Min;Hwang, Een-Jun
    • Journal of Advanced Navigation Technology
    • /
    • v.16 no.2
    • /
    • pp.386-393
    • /
    • 2012
  • In this paper, we propose an efficient multi-object recognition and tracking scheme based on interest points of objects and their feature descriptors. To do that, we first define a set of object types of interest and collect their sample images. For sample images, we detect interest points and construct their feature descriptors using SURF. Next, we perform a statistical analysis of the local features to select representative points among them. Intuitively, the representative points of an object are the interest points that best characterize the object. in addition, we make the movement vectors of the interest points based on matching between their SURF descriptors and track the object using these vectors. Since our scheme treats all the objects independently, it can recognize and track multiple objects simultaneously. Through the experiments, we show that our proposed scheme can achieve reasonable performance.