• Title/Summary/Keyword: Pedestrian tracking

Search Result 76, Processing Time 0.028 seconds

Anomalous Trajectory Detection in Surveillance Systems Using Pedestrian and Surrounding Information

  • Doan, Trung Nghia;Kim, Sunwoong;Vo, Le Cuong;Lee, Hyuk-Jae
    • IEIE Transactions on Smart Processing and Computing
    • /
    • v.5 no.4
    • /
    • pp.256-266
    • /
    • 2016
  • Concurrently detected and annotated abnormal events can have a significant impact on surveillance systems. By considering the specific domain of pedestrian trajectories, this paper presents two main contributions. First, as introduced in much of the work on trajectory-based anomaly detection in the literature, only information about pedestrian paths, such as direction and speed, is considered. Differing from previous work, this paper proposes a framework that deals with additional types of trajectory-based anomalies. These abnormal events take places when a person enters prohibited areas. Those restricted regions are constructed by an online learning algorithm that uses surrounding information, including detected pedestrians and background scenes. Second, a simple data-boosting technique is introduced to overcome a lack of training data; such a problem particularly challenges all previous work, owing to the significantly low frequency of abnormal events. This technique only requires normal trajectories and fundamental information about scenes to increase the amount of training data for both normal and abnormal trajectories. With the increased amount of training data, the conventional abnormal trajectory classifier is able to achieve better prediction accuracy without falling into the over-fitting problem caused by complex learning models. Finally, the proposed framework (which annotates tracks that enter prohibited areas) and a conventional abnormal trajectory detector (using the data-boosting technique) are integrated to form a united detector. Such a detector deals with different types of anomalous trajectories in a hierarchical order. The experimental results show that all proposed detectors can effectively detect anomalous trajectories in the test phase.

Development of Evaluation Metrics for Pedestrian Flow Optimization in a Complex Service Environment Based on Behavior Observation Method

  • Bahn, Sang-Woo;Lee, Chai-Woo;Kwon, Sang-Hyun;Yun, Myung-Hwan
    • Journal of the Ergonomics Society of Korea
    • /
    • v.29 no.4
    • /
    • pp.647-654
    • /
    • 2010
  • In a service environment, the spatial layout is an important factor that has a great impact on customers' behavioral characteristics including wayfinding and purchasing. Previous studies have shown a gap between marketing, focusing solely on profitability and satisfaction, and architecture, looking only into efficiency of pedestrian flow. To balance such disparity, this study suggests an integrated approach for assessing behavioral patterns in complex service environments. With the objective that complex service environments should aim to increase its profitability and efficiency while guaranteeing customer satisfaction, quantitative metrics was developed for evaluation. The metrics was defined to use data from behavior observation including path tracking, population counting, and gaze analysis, while previous studies have relied on abstract survey methods that were prone to sampling errors and loss of data. For validation of the metrics in a real world setting, a case study was conducted at 4 train stations in Korea. In the case study, experiments were conducted to gather the required data in all 4 train stations, while their physical layouts were also analyzed. With the results from the case study, comparative evaluation of the 4 train stations in terms of behavioral efficiency was possible, together with a discussion on the effect of their physical settings.

Multiple Pedestrians Detection and Tracking using Color Information from a Moving Camera (이동 카메라 영상에서 컬러 정보를 이용한 다수 보행자 검출 및 추적)

  • Lim, Jong-Seok;Kim, Wook-Hyun
    • The KIPS Transactions:PartB
    • /
    • v.11B no.3
    • /
    • pp.317-326
    • /
    • 2004
  • This paper presents a new method for the detection of multiple pedestrians and tracking of a specific pedestrian using color information from a moving camera. We first extract motion vector on the input image using BMA. Next, a difference image is calculated on the basis of the motion vector. The difference image is converted to a binary image. The binary image has an unnecessary noise. So, it is removed by means of the proposed noise deletion method. Then, we detect pedestrians through the projection algorithm. But, if pedestrians are very adjacent to each other, we separate them using RGB color information. And we track a specific pedestrian using RGB color information in center region of it. The experimental results on our test sequences demonstrated the high efficiency of our approach as it had shown detection success ratio of 97% and detection failure ratio of 3% and excellent tracking.

Vision and Lidar Sensor Fusion for VRU Classification and Tracking in the Urban Environment (카메라-라이다 센서 융합을 통한 VRU 분류 및 추적 알고리즘 개발)

  • Kim, Yujin;Lee, Hojun;Yi, Kyongsu
    • Journal of Auto-vehicle Safety Association
    • /
    • v.13 no.4
    • /
    • pp.7-13
    • /
    • 2021
  • This paper presents an vulnerable road user (VRU) classification and tracking algorithm using vision and LiDAR sensor fusion method for urban autonomous driving. The classification and tracking for vulnerable road users such as pedestrian, bicycle, and motorcycle are essential for autonomous driving in complex urban environments. In this paper, a real-time object image detection algorithm called Yolo and object tracking algorithm from LiDAR point cloud are fused in the high level. The proposed algorithm consists of four parts. First, the object bounding boxes on the pixel coordinate, which is obtained from YOLO, are transformed into the local coordinate of subject vehicle using the homography matrix. Second, a LiDAR point cloud is clustered based on Euclidean distance and the clusters are associated using GNN. In addition, the states of clusters including position, heading angle, velocity and acceleration information are estimated using geometric model free approach (GMFA) in real-time. Finally, the each LiDAR track is matched with a vision track using angle information of transformed vision track and assigned a classification id. The proposed fusion algorithm is evaluated via real vehicle test in the urban environment.

Smart Control System Using Fuzzy and Neural Network Prediction System

  • Kim, Tae Yeun;Bae, Sang Hyun
    • Journal of Integrative Natural Science
    • /
    • v.12 no.4
    • /
    • pp.105-115
    • /
    • 2019
  • In this paper, a prediction system is proposed to control the brightness of smart street lamps by predicting the moving path through the reduction of consumption power and information of pedestrian's past moving direction while meeting the function of existing smart street lamps. The brightness of smart street lamps is adjusted by utilizing the walk tracking vector and soft hand-off characteristics obtained through the motion sensing sensor of smart street lamps. In addition, the motion vector is used to analyze and predict the pedestrian path, and the GPU is used for high-speed computation. Pedestrians were detected using adaptive Gaussian mixing, weighted difference imaging, and motion vectors, and motions of pedestrians were analyzed using the extracted motion vectors. The preprocessing process using linear interpolation is performed to improve the performance of the proposed prediction system. Fuzzy prediction system and neural network prediction system are designed in parallel to improve efficiency and rough set is used for error correction.

Development of Tracking Application Based on Pedestrian Dead-Reckoning System (보행자 추측항법 시스템기반 위치추적 어플리케이션 구현)

  • Park, Ji-Won;Park, Tae-Oh;Jo, Chan-Woong;Lee, Chae-Woo
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2016.10a
    • /
    • pp.141-142
    • /
    • 2016
  • 본 논문은 보행자의 이동경로 추적을 위해 PDR(Pedestrian Dead Reckoning) 알고리즘을 탑재한 임베디드 모듈과 연결 가능한 안드로이드 어플리케이션을 구현하였다. 임베디드 모듈은 IMU센서를 통해 얻은 값을 통해 보행자의 위치를 구하고 어플리케이션에 전송한다. 어플리케이션은 임베디드 모듈로부터 위치 값을 받아 스마트폰 화면에 실시간으로 사용자의 위치를 디스플레이 한다. 어플리케이션을 구현하여 필드 테스트를 진행한 결과 보행자의 이동경로를 비교적 정확하게 추적하였다.

Gait State Classification by HMMS for Pedestrian Inertial Navigation System (보행용 관성 항법 시스템을 위한 HMMS를 통한 걸음 단계 구분)

  • Park, Sang-Kyeong;Suh, Young-Soo
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.58 no.5
    • /
    • pp.1010-1018
    • /
    • 2009
  • An inertial navigation system for pedestrian position tracking is proposed, where the position is computed using inertial sensors mounted on shoes. Inertial navigation system(INS) errors increase with time due to inertial sensor errors, and therefore it needs to reset errors frequently. During normal walking, there is an almost periodic zero velocity instance when a foot touches the floor. Using this fact, estimation errors are reduced and this method is called the zero velocity updating algorithm. When implementing this zero velocity updating algorithm, it is important to know when is the zero velocity interval. The gait states are modeled as a Markov process and each state is estimated using the hidden Markov model smoother. With this gait estimation, the zero or nearly zero velocity interval is more accurately estimated, which helps to reduce the position estimation error.

Modified HOG Feature Extraction for Pedestrian Tracking (동영상에서 보행자 추적을 위한 변형된 HOG 특징 추출에 관한 연구)

  • Kim, Hoi-Jun;Park, Young-Soo;Kim, Ki-Bong;Lee, Sang-Hun
    • Journal of the Korea Convergence Society
    • /
    • v.10 no.3
    • /
    • pp.39-47
    • /
    • 2019
  • In this paper, we proposed extracting modified Histogram of Oriented Gradients (HOG) features using background removal when tracking pedestrians in real time. HOG feature extraction has a problem of slow processing speed due to large computation amount. Background removal has been studied to improve computation reductions and tracking rate. Area removal was carried out using S and V channels in HSV color space to reduce feature extraction in unnecessary areas. The average S and V channels of the video were removed and the input video was totally dark, so that the object tracking may fail. Histogram equalization was performed to prevent this case. HOG features extracted from the removed region are reduced, and processing speed and tracking rates were improved by extracting clear HOG features. In this experiment, we experimented with videos with a large number of pedestrians or one pedestrian, complicated videos with backgrounds, and videos with severe tremors. Compared with the existing HOG-SVM method, the proposed method improved the processing speed by 41.84% and the error rate was reduced by 52.29%.

Fusion of Local and Global Detectors for PHD Filter-Based Multi-Object Tracking (검출기 융합에 기반을 둔 확률가정밀도 (PHD) 필터를 적용한 다중 객체 추적 방법)

  • Yoon, Ju Hong;Hwang, Youngbae;Choi, Byeongho;Yoon, Kuk-Jin
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.22 no.9
    • /
    • pp.773-777
    • /
    • 2016
  • In this paper, a novel multi-object tracking method to track an unknown number of objects is proposed. To handle multiple object states and uncertain observations efficiently, a probability hypothesis density (PHD) filter is adopted and modified. The PHD filter is capable of reducing false positives, managing object appearances and disappearances, and estimating the multiple object trajectories in a unified framework. Although the PHD filter is robust in cluttered environments, it is vulnerable to false negatives. For this reason, we propose to exploit local observations in an RFS of the observation model. Each local observation is generated by using an online trained object detector. The main purpose of the local observation is to deal with false negatives in the PHD filtering procedure. The experimental results demonstrated that the proposed method robustly tracked multiple objects under practical situations.

Background and Local Histogram-Based Object Tracking Approach (도로 상황인식을 위한 배경 및 로컬히스토그램 기반 객체 추적 기법)

  • Kim, Young Hwan;Park, Soon Young;Oh, Il Whan;Choi, Kyoung Ho
    • Spatial Information Research
    • /
    • v.21 no.3
    • /
    • pp.11-19
    • /
    • 2013
  • Compared with traditional video monitoring systems that provide a video-recording function as a main service, an intelligent video monitoring system is capable of extracting/tracking objects and detecting events such as car accidents, traffic congestion, pedestrian detection, and so on. Thus, the object tracking is an essential function for various intelligent video monitoring and surveillance systems. In this paper, we propose a background and local histogram-based object tracking approach for intelligent video monitoring systems. For robust object tracking in a live situation, the result of optical flow and local histogram verification are combined with the result of background subtraction. In the proposed approach, local histogram verification allows the system to track target objects more reliably when the local histogram of LK position is not similar to the previous histogram. Experimental results are provided to show the proposed tracking algorithm is robust in object occlusion and scale change situation.