• Journal of Information Processing Systems
• /
• v.19 no.6
• /
• pp.730-744
• /
• 2023

The topic of this paper is the recognition of human activities using egocentric vision, particularly captured by body-worn cameras, which could be helpful for video surveillance, automatic search and video indexing. This being the case, it could also be helpful in assistance to elderly and frail persons for revolutionizing and improving their lives. The process throws up the task of human activities recognition remaining problematic, because of the important variations, where it is realized through the use of an external device, similar to a robot, as a personal assistant. The inferred information is used both online to assist the person, and offline to support the personal assistant. With our proposed method being robust against the various factors of variability problem in action executions, the major purpose of this paper is to perform an efficient and simple recognition method from egocentric camera data only using convolutional neural network and deep learning. In terms of accuracy improvement, simulation results outperform the current state of the art by a significant margin of 61% when using egocentric camera data only, more than 44% when using egocentric camera and several stationary cameras data and more than 12% when using both inertial measurement unit (IMU) and egocentric camera data.

• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.45 no.6
• /
• pp.194-203
• /
• 2008

Though conventional video surveillance systems such as CCTV depended on operators, recently developed intelligent surveillance systems no longer needed operators. However, these new intelligent surveillance systems have their own problems such as Occlusion, changing scale of target object, and affine. This paper handled information damage caused by changing the scale of the target object among other objects. Due to the change of the scale, the inaccurate information of target can be obtained when we update the background information. To handle this problem, we introduce a solution for information damage caused by problem of changing scale of target object located among other objects. Specifically, we suggest multi-stage sampling particle filter based advanced MSER for object tracking system. Through this method, the problem caused by changing scale of target can be avoided.

• International Journal of Fuzzy Logic and Intelligent Systems
• /
• v.11 no.2
• /
• pp.118-123
• /
• 2011

Video based object tracking normally deals with non-stationary image streams that change over time. Robust and real time moving object tracking is considered to be a problematic issue in computer vision. Multiple object tracking has many practical applications in scene analysis for automated surveillance. In this paper, we introduce a specified object tracking based particle filter used in an environment of multiple moving objects. A differential image region based tracking method for the detection of multiple moving objects is used. In order to ensure accurate object detection in an unconstrained environment, a background image update method is used. In addition, there exist problems in tracking a particular object through a video sequence, which cannot rely only on image processing techniques. For this, a probabilistic framework is used. Our proposed particle filter has been proved to be robust in dealing with nonlinear and non-Gaussian problems. The particle filter provides a robust object tracking framework under ambiguity conditions and greatly improves the estimation accuracy for complicated tracking problems.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.12 no.7
• /
• pp.3220-3226
• /
• 2011

In order to monitor internal risk factors such as fire, terror, etc. on the subway station, the surveillance systems using CCTV and various kinds of sensors have been implemented and recently, introduction of surveillance systems using an advanced IT technology, sensor network technology is tried on several areas. Since 2007, Korean government has made an effort to develop the intelligent surveillance and monitoring system, which can monitor fire, intrusion, passenger congestion, health-state of structure, etc., by using wireless sensor network technology and intelligent video analytic technique. For that purpose, this study carried out field wireless communication environment test on Chungmuro Station of Seoul Metro on the basis of ZigBee that is considered as a representative wireless sensor network before field application of the intelligent integrated surveillance system being developed, arranged and analyzed and ZigBee based wireless communication environment test results on the platform and waiting room of Chungmuro Station on this paper. Results of wireless spectrum analysis on the platform and waiting room showed that there is no radio frequency overlapped with that of ZigBee based sensor network and no frequency interference with adjacent frequencies separated 10MHz or more. As results of wireless data transmission test using ZigBee showed that data transmission is influenced by multi-path fading effect from the number and flow rate of passengers on the platform or the waiting room rather than effects from entrance and exit of the train to/from the platform, it should be considered when implementing the intelligent integrated surveillance system on the station.

• The Journal of The Korea Institute of Intelligent Transport Systems
• /
• v.19 no.3
• /
• pp.129-136
• /
• 2020

In this paper, we propose a thermal imagery-based object detection algorithm for low-light level nighttime surveillance system. Many features selected by Haar-like feature selection algorithm and existing Adaboost algorithm are often vulnerable to noise and problems with similar or overlapping feature set for learning samples. It also removes noise from the feature set from the surveillance image of the low-light night environment, and implements it using the lightweight extended Haar feature and adaboost learning algorithm to enable fast and efficient real-time feature selection. Experiments use extended Haar feature points to recognize non-predictive objects with motion in nighttime low-light environments. The Adaboost learning algorithm with video frame 800*600 thermal image as input is implemented with CUDA 9.0 platform for simulation. As a result, the results of object detection confirmed that the success rate was about 90% or more, and the processing speed was about 30% faster than the computational results obtained through histogram equalization operations in general images.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2009.05a
• /
• pp.661-664
• /
• 2009

Recently, intelligent surveillance camera systems are needed popularly. However, current researches are focussed on improvement of a single module rather than implementation of an integrated system. In this paper, we implemented a moving wireless surveillance camera system which is composed of face detection, and using motion sensor. In our implementation, we used a camera module from SHARP, a pair of wireless video transmission module from ECOM, body of moving robot used for A4WD1 Combo kit for RC, a pair of ZigBee RF wireless transmission module from ROBOBLOCK, and a motion sensor module (AMN14111) from PANASONIC. We used OpenCV library for face dection and MFC for implement software. We identified real-time operations of face detection, PTT control, and motion sensor detecton. Thus, the implemented system will be useful for the applications of remote control, human detection, and using motion sensor.

• Journal of Electrical Engineering and Technology
• /
• v.10 no.4
• /
• pp.1910-1914
• /
• 2015

Human posture recognition is an attractive and challenging topic in computer vision due to its promising applications in the areas of personal health care, environmental awareness, human-computer-interaction and surveillance systems. Human posture recognition in video sequences consists of two stages: the first stage is training and evaluation and the second is deployment. In the first stage, the system is trained and evaluated using datasets of human postures to ‘teach’ the system to classify human postures for any future inputs. When the training and evaluation process is deemed satisfactory as measured by recognition rates, the trained system is then deployed to recognize human postures in any input video sequence. Different classifiers were used in the training such as Multilayer Perceptron Feedforward Neural networks, Self-Organizing Maps, Fuzzy C Means and K Means. Results show that supervised learning classifiers tend to perform better than unsupervised classifiers for the case of human posture recognition.

• IEIE Transactions on Smart Processing and Computing
• /
• v.6 no.4
• /
• pp.262-268
• /
• 2017

Intelligent video surveillance systems have been developed to monitor global areas and find specific target objects using a large-scale database. However, person re-identification presents some challenges, such as pose change and occlusions. To solve the problems, this paper presents an improved person re-identification method using sparse representation and saliency-based dictionary construction. The proposed method consists of three parts: i) feature description based on salient colors and textures for dictionary elements, ii) orthogonal atom selection using cosine similarity to deal with pose and viewpoint change, and iii) measurement of reconstruction error to rank the gallery corresponding a probe object. The proposed method provides good performance, since robust descriptors used as a dictionary atom are generated by weighting some salient features, and dictionary atoms are selected by reducing excessive redundancy causing low accuracy. Therefore, the proposed method can be applied in a large scale-database surveillance system to search for a specific object.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.19 no.2
• /
• pp.161-168
• /
• 2019

Recently, video equipments such as CCTV, which is spreading rapidly, is being used as a means to monitor and cope with abnormal situations in almost governments, companies, and households. However, in most cases, since recognizing the abnormal situation is carried out by the monitoring person, the immediate response is difficult and is used only for post-analysis. In this paper, we present the results of the development of video surveillance system that automatically recognizing the abnormal situations and sending such events to the smartphone immediately using the latest deep learning technology. The proposed system extracts skeletons from the human objects in real time using Openpose library and then recognizes the human behaviors automatically using deep learning technology. To this end, we reconstruct Openpose library, which developed in the Caffe framework, on Darknet framework to improve real-time processing. We also verified the performance improvement through experiments. The system to be introduced in this paper has accurate and fast behavioral recognition performance and scalability, so it is expected that it can be used for video surveillance systems for various applications.

• Journal of the Korea Society of Computer and Information
• /
• v.24 no.8
• /
• pp.19-28
• /
• 2019

In this paper, an online video summarization algorithm based on multiple object detection is proposed. As crime has been on the rise due to the recent rapid urbanization, the people's appetite for safety has been growing and the installation of surveillance cameras such as a closed-circuit television(CCTV) has been increasing in many cities. However, it takes a lot of time and labor to retrieve and analyze a huge amount of video data from numerous CCTVs. As a result, there is an increasing demand for intelligent video recognition systems that can automatically detect and summarize various events occurring on CCTVs. Video summarization is a method of generating synopsis video of a long time original video so that users can watch it in a short time. The proposed video summarization method can be divided into two stages. The object extraction step detects a specific object in the video and extracts a specific object desired by the user. The video summary step creates a final synopsis video based on the objects extracted in the previous object extraction step. While the existed methods do not consider the interaction between objects from the original video when generating the synopsis video, in the proposed method, new object clustering algorithm can effectively maintain interaction between objects in original video in synopsis video. This paper also proposed an online optimization method that can efficiently summarize the large number of objects appearing in long-time videos. Finally, Experimental results show that the performance of the proposed method is superior to that of the existing video synopsis algorithm.