• ETRI Journal
• /
• v.46 no.4
• /
• pp.671-682
• /
• 2024

Violence can be committed anywhere, even in crowded places. It is hence necessary to monitor human activities for public safety. Surveillance cameras can monitor surrounding activities but require human assistance to continuously monitor every incident. Automatic violence detection is needed for early warning and fast response. However, such automation is still challenging because of low video resolution and blind spots. This paper uses ResNet50v2 and the gated recurrent unit (GRU) algorithm to detect violence in the Movies, Hockey, and Crowd video datasets. Spatial features were extracted from each frame sequence of the video using a pretrained model from ResNet50V2, which was then classified using the optimal trained model on the GRU architecture. The experimental results were then compared with wavelet feature extraction methods and classification models, such as the convolutional neural network and long short-term memory. The results show that the proposed combination of ResNet50V2 and GRU is robust and delivers the best performance in terms of accuracy, recall, precision, and F1-score. The use of ResNet50V2 for feature extraction can improve model performance.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2021.07a
• /
• pp.17-20
• /
• 2021

본 연구는 인원 계수에 딥러닝 알고리즘을 적용한다. 인원 계수는 안전 관리 분야, 상업 분야에 적용될 수 있다. 예를 들어, 건물 내 화재 발생 시, 계수된 인원을 활용하여 인명 피해를 최소화할 수 있다. 다른 예로, 유동인구 데이터를 기반으로 상권을 분석하여 경제적 효율성을 극대화할 수 있다. 이처럼 인원 데이터의 중요성이 증가함에 따라 인원 계수 연구도 활발하다. 그 예로, 객체 탐지(Object Detection) 같은 딥러닝 기반 인원 계수, 센서 기반 인원 계수 등이 있다. 본 연구에선 딥러닝 알고리즘인 VGGNet을 사용하여 인원을 계수했다. 결과로 Mean Absolute Percentage Error(이하 MAPE)는 약 5.9%의 오차율을 보였다. 결과 확인 방법으로는 설명 가능한 인공지능(XAI) 알고리즘 중 하나인 Grad-CAM을 적용했다.

• The Journal of The Korea Institute of Intelligent Transport Systems
• /
• v.23 no.2
• /
• pp.69-78
• /
• 2024

Recently, the use of CCTV to prevent crowd accidents has been promoted, but research is needed to compensate for the spatial limitations of CCTV. In this study, pedestrian density was measured using drone footage, and based on a review of existing literature, a threshold of 6.7 people/m² was selected as the cutoff risk level for crowd accidents. In addition, we conducted a preliminary study to determine drone parameters and found that the pedestrian recognition rate was high at a drone altitude of 20 meters and an angle of 60°. Based on a previous study, we selected a target area with a high concentration of pedestrians and measured pedestrian density, which was found to be 0.27~0.30 per m². The study shows it is possible to measure risk levels by determining pedestrian densities in target areas using drone images. We believe drone surveillance will be utilized for crowd safety management in the near future.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.15 no.4
• /
• pp.1426-1447
• /
• 2021

The payoff game between task publishers and users in the mobile crowdsensing environment is a hot topic of research. A optimal payoff selection model based on stochastic evolutionary game is proposed. Firstly, the process of payoff optimization selection is modeled as a task publisher-user stochastic evolutionary game model. Secondly, the low-quality data is identified by the data quality evaluation algorithm, which improves the fitness of perceptual task matching target users, so that task publishers and users can obtain the optimal payoff at the current moment. Finally, by solving the stability strategy and analyzing the stability of the model, the optimal payoff strategy is obtained under different intensity of random interference and different initial state. The simulation results show that, in the aspect of data quality evaluation, compared with BP detection method and SVM detection method, the accuracy of anomaly data detection of the proposed model is improved by 8.1% and 0.5% respectively, and the accuracy of data classification is improved by 59.2% and 32.2% respectively. In the aspect of the optimal payoff strategy selection, it is verified that the proposed model can reasonably select the payoff strategy.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.38 no.3
• /
• pp.247-257
• /
• 2020

Livestock epidemics, such as foot and mouth disease, are causing enormous economic losses due to their strong infectious power. Early detection of infectious diseases in livestock is very important, but it is difficult to diagnose early in individual farms, and there are frequent cases of transmission through inter-farm movement such as veterinarians and feeding vehicles. In this study, we studied the technology that enables rapid diagnosis without veterinarian farm visits and prevents further spread by automatically monitoring the body temperature of livestock using ubiquitous-based information and communication technology in the early stage of onset and sending it in real time. We have presented a technique for systematically managing livestock epidemics at the farm level, regional level, and national level by using the community mapping technique by using the remote medical treatment system linked to the automatically collected information. In this process, community mapping items for each step and stakeholders were derived for crowd sourcing based spatial information technology.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.6 no.12
• /
• pp.3315-3337
• /
• 2012

Crowded scenes analysis is a challenging topic in computer vision field. How to detect diverse motion patterns in crowded scenarios from videos is the critical yet hard part of this problem. In this paper, we propose a novel approach to mining motion patterns by utilizing motion information during both long-term period and short interval simultaneously. To capture long-term motions effectively, we introduce Motion History Image (MHI) representation to access to the global perspective about the crowd motion. The combination of MHI and optical flow, which is used to get instant motion information, gives rise to discriminative spatial-temporal motion features. Benefitting from the robustness and efficiency of the novel motion representation, the following motion pattern mining is implemented in a completely unsupervised way. The motion vectors are clustered hierarchically through automatic hierarchical clustering algorithm building on the basis of graphic model. This method overcomes the instability of optical flow in dealing with time continuity in crowded scenes. The results of clustering reveal the situations of motion pattern distribution in current crowded videos. To validate the performance of the proposed approach, we conduct experimental evaluations on some challenging videos including vehicles and pedestrians. The reliable detection results demonstrate the effectiveness of our approach.

• Journal of the Optical Society of Korea
• /
• v.14 no.4
• /
• pp.451-457
• /
• 2010

Increasing demands on the safety of public train services have led to the development of various types of security monitoring systems. Most of the surveillance systems are focused on the estimation of crowd level in the platform, thereby yielding too many false alarms. In this paper, we present a novel security monitoring system to detect critically dangerous situations such as when a passenger falls from the station platform, or when a passenger walks on the rail tracks. The method is composed of two stages of detecting dangerous situations. Objects falling over to the dangerous zone are detected by motion tracking. 3D depth information retrieved by the stereo vision is used to confirm fallen events. Experimental results show that virtually no error of either false positive or false negative is found while providing highly reliable detection performance. Since stereo matching is performed on a local image only when potentially dangerous situations are found; real-time operation is feasible without using dedicated hardware.

• Proceedings of the Korean Information Science Society Conference
• /
• 2011.06c
• /
• pp.347-350
• /
• 2011

감시카메라 환경에서의 비정상 집단행동 탐지란 감시카메라로부터 유입되는 영상에서 다중 객체가 위험에 처한 상황을 신속하고 정확하게 탐지 및 인식하는 분야를 말한다. 본 논문에서는 CCTV 등과 같은 감시카메라 환경에서 움직임 벡터와 SVDD를 이용하여 집단내의 비정상 상황을 탐지하는 프로토타입 시스템을 제안한다. 제안된 시스템은 움직임 벡터를 이용하여 영상내의 움직임 정보를 추출 표현하였으며, 비정상 집단행동의 판별 문제를 실용적 차원의 단일 클래스 분류 문제로 재해석하여 단일 클래스 SVM의 대표적 모델인 SVDD를 탐지자로 설계하였다. 공개적으로 사용 가능한 벤치마크 데이터 셋인 PETS 2009와 UMN을 이용하여 본 논문에서 제안한 비정상 집단행동 탐지 시스템의 성능을 실험적으로 검증한다.

• Journal of the Korea Society of Computer and Information
• /
• v.26 no.4
• /
• pp.11-19
• /
• 2021

An abnormal object refers to a person, an object, or a mechanical device that performs abnormal and unusual behavior and needs observation or supervision. In order to detect this through artificial intelligence algorithm without continuous human intervention, a method of observing the specificity of temporal features using optical flow technique is widely used. In this study, an abnormal situation is identified by learning an algorithm that translates an input image frame to an optical flow image using a Generative Adversarial Network (GAN). In particular, we propose a technique that improves the pre-processing process to exclude unnecessary outliers and the post-processing process to increase the accuracy of identification in the test dataset after learning to improve the performance of the model's abnormal behavior identification. UCSD Pedestrian and UMN Unusual Crowd Activity were used as training datasets to detect abnormal behavior. For the proposed method, the frame-level AUC 0.9450 and EER 0.1317 were shown in the UCSD Ped2 dataset, which shows performance improvement compared to the models in the previous studies.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.9 no.8
• /
• pp.3005-3027
• /
• 2015

Spam has become one of the top threats of micro-blogging networks as the representations of rumor spreading, advertisement abusing and malware distribution. With the increasing popularity of micro-blogging, the problems will exacerbate. Prior detection tools are either designed for specific types of spams or not robust enough. Spammers may escape easily from being detected by adjusting their behaviors. In this paper, we present a novel model to quantitatively evaluate information diffusion in micro-blogging networks. Under this model, we found that spam posts differ wildly from the non-spam ones. First, the propagations of non-spam posts mostly result from their followers, but those of spam posts are mainly from strangers. Second, the non-spam posts relatively last longer than the spam posts. Besides, the non-spam posts always get their first reposts/comments much sooner than the spam posts. With the features defined in our model, we propose an RBF-based approach to detect spams. Different from the previous works, in which the features are extracted from individual profiles or contents, the diffusion features are not determined by any single user but the crowd. Thus, our method is more robust because any single user's behavior changes will not affect the effectiveness. Besides, although the spams vary in types and forms, they're propagated in the same way, so our method is effective for all types of spams. With the real data crawled from the leading micro-blogging services of China, we are able to evaluate the effectiveness of our model. The experiment results show that our model can achieve high accuracy both in precision and recall.