Browse > Article

Major Character Extraction using Character-Net  

Park, Seung-Bo (인하대학교 정보공학과)
Kim, Yoo-Won (인하대학교 정보공학과)
Jo, Geun-Sik (인하대학교 컴퓨터정보공학과)
Publication Information
Journal of Internet Computing and Services / v.11, no.1, 2010 , pp. 85-102 More about this Journal
Abstract
In this paper, we propose a novel method of analyzing video and representing the relationship among characters based on their contexts in the video sequences, namely Character-Net. As a huge amount of video contents is generated even in a single day, the searching and summarizing technologies of the contents have also been issued. Thereby, a number of researches have been proposed related to extracting semantic information of video or scenes. Generally stories of video, such as TV serial or commercial movies, are made progress with characters. Accordingly, the relationship between the characters and their contexts should be identified to summarize video. To deal with these issues, we propose Character-Net supporting the extraction of major characters in video. We first identify characters appeared in a group of video shots and subsequently extract the speaker and listeners in the shots. Finally, the characters are represented by a form of a network with graphs presenting the relationship among them. We present empirical experiments to demonstrate Character-Net and evaluate performance of extracting major characters.
Keywords
Character-Net; Context; Face recognition; Major character; Social network;
Citations & Related Records
연도 인용수 순위
  • Reference
1 J.R. Cozar, N. Guil, J.M. Gonzalez-Linares, E.L. Zapata, E. Izquierdo, "Logotype detection to support semantic-based video annotation," Signal Processing: Image Communication, Volume 22, Issues 7-8, pp. 669-679, Aug.-Sep. 2007.   DOI   ScienceOn
2 S. H. Khatoonabadi, M. Rahmati, "Automatic soccer players tracking in goal scenes by camera motion elimination," Image and Vision Computing, Vol. 27, Issue 4, pp. 469-479, 3 Mar. 2009.   DOI   ScienceOn
3 Mehmet Emin Donderler, Ediz Saykol, Umut Arslan, Ozgur Ulusoy and Ugur Gudukbay, "BilVideo: Design and Implementation of a Video Database Management System", Kluwer Academic Pub, pp.20-21, 2003
4 J. Yang, R. Yan, A.G. Hauptmann, "Multiple instance learning for labeling faces in broadcasting news video," in: Proceedings of the ACM International Conference on Multimedia, pp. 31-40, 2005.
5 V. Roth, "Content-based retrieval from digital video," Image and Vision Computing, Vol. 17, no. 7, pp. 531-540, 1999.   DOI   ScienceOn
6 M. Everingham, J. Sivic, A, Zisserman, "Hello! My name is… Buffy" ? automatic naming of characters in TV video," Proceedings of the 17th British Machine Vision Conference, Edinburgh, UK, pp. 889-908, 2006.
7 L. Liang, G. Haifeng, L. Li, and W. Liang. "Semantic event representation and recognition using syntactic attribute graph grammar," Pattern Recognition Letters, Vol. 30, Issue 2, pp. 180-186, 15 Jan. 2009.   DOI   ScienceOn
8 박승보, 김유원, 조근식, "얼굴인식을 이용한 동영상 상황정보 어노테이션," 한국지능정보 시스템학회, 2008 추계학술대회 논문집, pp.319-324, 2008.11.28.
9 D. Cristinacce and T.F. Cootes, "Feature Detection and Tracking with Constrained Local Models," Proc. 17th British Machine Vision Conf., pp. 929-938, 2006.
10 B. Leibe, E. Seemann, B. Schiele, "Pedestrian detection in crowded scenes," Computer Vision and Pattern Recognition, CVPR 2005. IEEE Computer Society Conference on, Vol. 1, pp. 878 - 885, 20-25 June 2005.
11 P. Buehler, M. Everingham, D.P. Huttenlocher, A. Zisserman, "Long Term Arm and Hand Tracking for Continuous Sign Language TV Broadcasts," Proceedings of the British Machine Vision Conference, 2008.
12 손동원, "사회 네트워크 분석," pp.25-38, 161, 242-244, 경문사, 서울, 2002.
13 Y. Rui, T.S. Huang, S. Mehrotra, "Constructing Table-of-Content for Videos," to appear in ACM Multimedia Systems Journal, Special Issue Multimedia Systems on Video Libraries, Sep. 1999.
14 Menzo Windhouwer, "Feature Grammar Systems", Incremental Maintenance of Indexes to Digital Media Warehouses, pp. 32-33, Nov. 2003
15 F. Nack, A. Parkes, "The Application of Video Semantics and Theme Representation in Automated Video Editing," Multimedia Tools and Applications, Vol. 4, No. 1, pp. 57-83, Jan. 1997.   DOI   ScienceOn
16 M. Everingham, J. Sivic, A. Zisserman, "Taking the bite out of automated naming of characters in TV video," Image and Vision Computing, In Press, Corrected Proof, Available online, 4 May 2008.
17 ISO, "MPEG-7 Overview", Oct. 2004.
18 R. Lienhart, S. Pfeiffer, W. Effelsberg, "Video abstracting," Communications of the ACM, Vol. 40, pp. 54-62, Dec. 1997.