Browse > Article
http://dx.doi.org/10.3745/KIPSTB.2011.18B.6.365

Using the fusion of spatial and temporal features for malicious video classification  

Jeon, Jae-Hyun (한국과학기술원 전기 및 전자공학과)
Kim, Se-Min (한국과학기술원 정보통신공학과)
Han, Seung-Wan (한국전자통신연구원)
Ro, Yong-Man (한국과학기술원 전기 및 전자공학과)
Abstract
Recently, malicious video classification and filtering techniques are of practical interest as ones can easily access to malicious multimedia contents through the Internet, IPTV, online social network, and etc. Considerable research efforts have been made to developing malicious video classification and filtering systems. However, the malicious video classification and filtering is not still being from mature in terms of reliable classification/filtering performance. In particular, the most of conventional approaches have been limited to using only the spatial features (such as a ratio of skin regions and bag of visual words) for the purpose of malicious image classification. Hence, previous approaches have been restricted to achieving acceptable classification and filtering performance. In order to overcome the aforementioned limitation, we propose new malicious video classification framework that takes advantage of using both the spatial and temporal features that are readily extracted from a sequence of video frames. In particular, we develop the effective temporal features based on the motion periodicity feature and temporal correlation. In addition, to exploit the best data fusion approach aiming to combine the spatial and temporal features, the representative data fusion approaches are applied to the proposed framework. To demonstrate the effectiveness of our method, we collect 200 sexual intercourse videos and 200 non-sexual intercourse videos. Experimental results show that the proposed method increases 3.75% (from 92.25% to 96%) for classification of sexual intercourse video in terms of accuracy. Further, based on our experimental results, feature-level fusion approach (for fusing spatial and temporal features) is found to achieve the best classification accuracy.
Keywords
Malicious Video; Spatial Feature; Temporal Feature; Data Fusion;
Citations & Related Records
연도 인용수 순위
  • Reference
1 A. W. M. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain, "Content-based image retrieval at the end of the early years," IEEE Tran. On Pattern Analysis and Machine Intelligence, Vol.22, No.12, pp.1349-1380, Dec., 2000.   DOI   ScienceOn
2 S. J. Yang, S. K. Kim, and Y. M. Ro, "Semantic home photo categorization," IEEE Transactions on Circuits and System for Video Technology, Vol.17, No.3, pp.324-335, Mar., 2007.   DOI   ScienceOn
3 B. Li, J. H. Errico, H. Pan, I. Sezan, "Bridging the semantic gap in sports video retrieval and summarization," Journal of Visual Communication and Image Representation, Vol.15, Issue 3, pp.393-424, Sep., 2004.   DOI   ScienceOn
4 S. M. Lee, H. G. Lee, and T. K. Nam, "A comparative study of the objectionable video classification approaches using single and group frame features," The 16th International Conference on Artificial Neural Networks (ICANN 2006), pp.613-623, 2006.
5 H. G. Lee, S. M. Lee and T. K. Nam, "Implementation of high performance objectionable video classification system," International Conference on Advanced Communication Technology (ICACT 2006), pp.959-962, 2006.
6 S. M. Lee, W. C. Shim, and S. H. Kim, "Hierarchical system for objectionable video detection," IEEE Transactions on Consumer Electronics, Vol.55, No.2, pp.677-684, May, 2009.   DOI   ScienceOn
7 S. M. Kim, H. S. Min, J. H. Jeon, Y. M. Ro, and S. W. Han, "Malicious content filtering based on semantic features," The ACM International Conference Proceeding 2009, pp.802-806, 2009.
8 J. H. Jeon, S. M. Kim, J. Y. Choi, H. S. Min, and Y. M. Ro, "Semantic detection of adult image using semantic features," The 4th International Conference on Multimedia and Ubiquitous Engineering (MUE 2010), pp.1-4, 2010.
9 J. Yang, J. Y. Yang, D. Zhang, and J. F. Lu, "Feature fusion: parallel strategy vs. serial strategy," Pattern Recognition, Vol.36, Issue 6, pp.1369-1381, June, 2003.   DOI   ScienceOn
10 X. Zhou, and B. Bhanu, "Integrating face and gait for human recognition at a distance in video," IEEE Transactions on Systems, Man, and Cybernetics—Part B: Cybernetics, Vol.37, No.5, pp.1119-1137, Oct., 2007.   DOI   ScienceOn
11 X. Zhou, and B. Bhanu, "Feature fusion of side face and gait for video-based human identification," Pattern Recognition Vol.41, Issue 3, pp.778-795, Mar., 2008.   DOI   ScienceOn
12 Z. Qu, L. Ren, A. Guo, and J. Yu, "Implementation of pornographic videos detection system," 2nd International Congress on Image and Signal Processing (CISP 2009), pp.1-4, 2009.
13 H. T. Lin, C. J. Lin, and R. C. Weng, "A note on platt's probabilistic outputs for support vector machines," Dept. Comp. Sci., National Taiwan Univ., 2003 ([online]. Available: http://www.csie.ntu.deu/tw/-cjlin/papers/plattprob.ps,Tech. Rep)
14 N. Rea, G. Lacey, C. Lambe, and R. Dahyot, "Multimodal periodicity analysis for illicit content detection in videos," The 3rd European Conference on Visual Media Production (CVMP 2006), pp.106-114, 2006.
15 C. Y. Kim, O. J. Kwon, W. G. Kim, and S. R. Choi, "Automatic system for filtering obscene video," The 10th International Conference on Advanced Communication Technology (ICACT 2008), pp.1435-1438, 2008.
16 A. P. B. Lopes, S. E. F. de Avila, A. N. A. Peixoto, R. S. Oliveira, M. de M. Coelho, and A. de A. Araujo, "Nude detection in video using bag-of-visual-features," XXII Brazilian Symposium on Computer Graphics and Image Processing, pp.224-231, 2009.
17 Z. Y. Qu, Y. Liu, Y. M. Liu, and L. N. Zhang, "A pornographic videos detection method based on optical flow direction's statistical histogram," International Symposium on Computer Network and Multimedia Technology (CNMT 2009), pp.1-4, 2009.
18 Q. Zhiyi, L. Yanmin, L. Ying, J. Kang, and C. Yong, "A method for reciprocating motion detection in porn video based on motion features," 2nd IEEE International Conference on Broadband Network & Multimedia Technology (IC-BNMT '09), pp.183-187, 2009.
19 C. Jansohn, A. Ulges, and T. M. Breuel, "Detecting pornographic video content by combining image features with motion information," ACM Multimedia 2009, pp.601-604, 2009.
20 Z. QU, Y. Liu, Y. Liu, K. Jiu, and Yo. Chen, "A porn video detection method based on motion features using HMM," Second International Symposium on computational Intelligence and Design (ISCID '09), pp.461-464, 2009.