• 한국멀티미디어학회논문지
• /
• 제25권6호
• /
• pp.807-818
• /
• 2022

In order to further improve the accuracy and time efficiency of behavior recognition in intelligent monitoring scenarios, a human behavior recognition algorithm based on YOLO combined with LSTM and CNN is proposed. Using the real-time nature of YOLO target detection, firstly, the specific behavior in the surveillance video is detected in real time, and the depth feature extraction is performed after obtaining the target size, location and other information; Then, remove noise data from irrelevant areas in the image; Finally, combined with LSTM modeling and processing time series, the final behavior discrimination is made for the behavior action sequence in the surveillance video. Experiments in the MSR and KTH datasets show that the average recognition rate of each behavior reaches 98.42% and 96.6%, and the average recognition speed reaches 210ms and 220ms. The method in this paper has a good effect on the intelligence behavior recognition.

• 제어로봇시스템학회논문지
• /
• 제16권1호
• /
• pp.69-76
• /
• 2010

The segmentation of moving object in video sequence is a core technique of intelligent image processing system such as video surveillance, traffic monitoring and human tracking. A typical method to segment a moving region from the background is the background subtraction. The steps of background subtraction involve calculating a reference image, subtracting new frame from reference image and then thresholding the subtracted result. One of famous background modeling is Gaussian mixture model (GMM). Even though the method is known efficient and exact, GMM suffers from a problem that includes false pixels in ROI (region of interest), specifically shadow pixels. These false pixels cause fail of the post-processing tasks such as tracking and object recognition. This paper presents a method for removing false pixels included in ROT. First, we subdivide a ROI by using shape characteristics of detected objects. Then, a method is proposed to classify pixels from using histogram characteristic and comparing difference of energy that converts the color value of pixel into grayscale value, in order to estimate whether the pixels belong to moving object area or shadow area. The method is applied to real video sequence and the performance is verified.

• 한국멀티미디어학회논문지
• /
• 제19권8호
• /
• pp.1361-1370
• /
• 2016

To reduce huge losses in pig farms, weaning pigs with weak immune systems are required to be carefully supervised. Even if various researches have been performed for pig monitoring environment, segmenting each pig from touching-pigs is still entrenched as a difficult problem. In this paper, we propose a segmentation method for touching-pigs by using concave-points and edge information in a video surveillance system. Especially, we interpret the segmentation problem as a time-series analysis problem in order to identify the concave-points generated by touching-pigs. Based on the experimental results with the videos obtained from a domestic pig farm, we believe that the proposed method can accurately segment the touching-pigs.

• 한국화재소방학회논문지
• /
• 제32권6호
• /
• pp.40-45
• /
• 2018

전방위 감시카메라에는 어안렌즈를 이용하여 광대역감시가 가능하도록 물체감지알고리즘으로 물체를 단위별 레벨링한 다음 전방위 감시카메라와 추적(PTZ)카메라로 구성된 시스템으로 연동하여 현장실험한 것이다. 전방위 감시카메라가 움직이는 물체를 정확히 감지하며 사각표시를 하였고 추적카메라와 유기적으로 연동하며 확대 추적하였다. 감지카메라와 화염감지 및 온도에 대한 현장실험에서는 오토스캔 중 화염이 감지되면 멈추며, 해당 화점부분을 화면의 중심부분으로 이동시켜 온도가 표출되었다. 또한 화염이격거리별 검지에 필요한 발열량의 인정기준인 1 km 2,340 kcal를 초과한 1.5 km에서도 가능하였다. 거리에 따른 화염감지성능시험에서는 거리 1 km일 때 폭 56 cm ${\times}$ 높이 90 cm를 초과한 1.5 km에서도 가능하여 산불화재에도 적응성이 충분하였다. 향후 석유 가스비축시설 및 저유소에 설치하면 자체는 물론 주위 화재예방 및 침입감시 등의 안전에 매우 유용할 것으로 기대된다.

• 한국측량학회지
• /
• 제28권4호
• /
• pp.403-411
• /
• 2010

This research demonstrates a 3D virtual visualization of urban environment and video fusion for effective damage prevention and surveillance system using open standard. We present the visualization and interaction simulation method to increase the situational awareness and optimize the realization of environmental monitoring through the CCTV video and 3D virtual environment. New camera prototype was designed based on the camera frustum view model to project recorded video prospectively onto the virtual 3D environment. The demonstration was developed by the X3D, which is royalty-free open standard and run-time architecture, and it offers abilities to represent, control and share 3D spatial information via the internet browsers.

• 정보처리학회논문지:소프트웨어 및 데이터공학
• /
• 제4권10호
• /
• pp.473-478
• /
• 2015

최근, 축산 농가에서 돈사 내 개별 돼지들의 자동 영상 모니터링 기법이 중요한 이슈로 떠오르고 있다. 현재까지 이를 위한 다양한 연구들이 소개되어 왔지만, 아직도 추가적인 연구 노력이 요구된다. 특히, 혼잡한 돈방에서 움직이는 근접한 돼지들의 객체 식별을 위한 연구가 영상처리 분야 입장에서 요구된다. 본 논문에서는 감시카메라 환경에서 움직이는 근접한 돼지들의 객체 식별을 위한 해법으로써 시공간 정보와 영역 확장 기법을 이용한 효율적인 영상 분할 방법론을 새롭게 제안한다. 실제로 세종에 위치한 한 돈사에서 취득한 영상 정보를 이용하여 본 논문에서 제안한 시스템의 성능을 실험적으로 검증하였다.

• 제어로봇시스템학회논문지
• /
• 제15권5호
• /
• pp.505-510
• /
• 2009

In recent years the space where a robot works has been expanding to the human space unlike traditional industrial robots that work only at fixed positions apart from humans. A human in the recent situation may be the owner of a robot or the target in a robotic application. This paper deals with the latter case; when a robot vision system is employed to monitor humans for a surveillance application, each person in a scene needs to be identified. Humans, however, often move together, and occlusions between them occur frequently. Although this problem has not been seriously tackled in relevant literature, it brings difficulty into later image analysis steps such as tracking and scene understanding. In this paper, a probabilistic neural network is employed to learn the patterns of the best dividing position along the top pixels of an image region of partly occlude people. As this method uses only shape information from an image, it is simple and can be implemented in real time.

• 디지털콘텐츠학회 논문지
• /
• 제18권6호
• /
• pp.1009-1015
• /
• 2017

최근 범죄, 테러, 교통, 보안등의 이유로 카메라의 설치가 더욱 많아짐에 따라 비디오 감시가 점점 일반화 되어가고 있다. 설치된 카메라로부터 입력된 비디오는 중앙관제센터에서 멀티스크린으로 모니터링 되고 있고, 처한 상황이나 위험 등으로부터 빠르게 대응하기 위해 실시간으로 여러 화면을 동시에 감시는 것이 필수 요소가 되고 있다. 그러나 멀티스크린 화면으로 스마트폰과 같은 모바일 환경에서 모니터링할 때, 하드웨어 스펙이나, 네트워크 대역폭의 문제로 적용되지 못하고 있다. 따라서 본 논문에서는 스마트폰 환경에서 실시간으로 멀티스크린화면을 감시할 수 있는 시스템을 제안한다. 사용자가 원하는 멀티스크린 화면을 트랜스코딩을 통해 재구성하였고, 스마트폰 환경에서 끊김 없이 복수의 카메라를 모니터링하여, 이동하면서도 감시할 수 있는 장점을 가질 수 있다.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제8권10호
• /
• pp.3475-3489
• /
• 2014

Here we present a simple flame detection method for an infrared (IR) thermal camera based real-time fire surveillance digital signal processor (DSP) system. Infrared thermal cameras are especially advantageous for unattended fire surveillance. All-weather monitoring is possible, regardless of illumination and climate conditions, and the data quantity to be processed is one-third that of color videos. Conventional IR camera-based fire detection methods used mainly pixel-based temporal correlation functions. In the temporal correlation function-based methods, temporal changes in pixel intensity generated by the irregular motion and spreading of the flame pixels are measured using correlation functions. The correlation values of non-flame regions are uniform, but the flame regions have irregular temporal correlation values. To satisfy the requirement of early detection, all fire detection techniques should be practically applied within a very short period of time. The conventional pixel-based correlation function is computationally intensive. In this paper, we propose an IR camera-based simple flame detection algorithm optimized with a compact embedded DSP system to achieve early detection. To reduce the computational load, block-based calculations are used to select the candidate flame region and measure the temporal motion of flames. These functions are used together to obtain the early flame detection algorithm. The proposed simple algorithm was tested to verify the required function and performance in real-time using IR test videos and a real-time DSP system. The findings indicated that the system detected the flames within 5 to 20 seconds, and had a correct flame detection ratio of 100% with an acceptable false detection ratio in video sequence level.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제10권6호
• /
• pp.2483-2503
• /
• 2016

Traffic congestion is a severe problem in many modern cities around the world. Real-time and accurate traffic congestion identification can provide the advanced traffic management systems with a reliable basis to take measurements. The most used data sources for traffic congestion are loop detector, GPS data, and video surveillance. Video based traffic monitoring systems have gained much attention due to their enormous advantages, such as low cost, flexibility to redesign the system and providing a rich information source for human understanding. In general, most existing video based systems for monitoring road traffic rely on stationary cameras and multiple vehicle tracking method. However, most commonly used multiple vehicle tracking methods are lack of effective track initiation schemes. Based on the motion of the vehicle usually obeys constant velocity model, a novel vehicle recognition method is proposed. The state of recognized vehicle is sent to the GM-PHD filter as birth target. In this way, we relieve the insensitive of GM-PHD filter for new entering vehicle. Combining with the advanced vehicle detection and data association techniques, this multiple vehicle tracking method is used to identify traffic congestion. It can be implemented in real-time with high accuracy and robustness. The advantages of our proposed method are validated on four real traffic data.