Browse > Article
http://dx.doi.org/10.9717/kmms.2016.19.8.1564

Extraction of Highlights and Search Indexes of Digital Media by Analyzing Online Activity Data  

Ha, Seyong (Dept. of Computer Science, University of Toronto)
Kim, Dongwhan (Dept. of Communication, Seoul National University)
Lee, Joonhwan (Dept. of Communication, Seoul National University)
Publication Information
Journal of Korea Multimedia Society / v.19, no.8, 2016 , pp. 1564-1573 More about this Journal
Abstract
With the spread of social media and mobile devices, people spend more time on online than ever before. As more people participate in various online activities, much research has been conducted on how to make use of the time effectively and productively. In this paper, we propose two methods which can be used to extract highlights and make searchable media indexes using online social data. For highlight extraction, we collected the comments from the online baseball broadcasting website. We adopted peak-finding algorithm to analyze the frequency of comments uploaded on the comments section of the website. For each indexes, we collected postings from soap opera forums provided by a popular web service called DCInside. We extracted all the instances when a character's name is mentioned in postings users upload after watching TV, which can be used to create indexes when the character appears on screen for the given episode of the soap opera The evaluation results shows the possibility of the crowdsourcing-based media interaction for both highlight extraction and index building.
Keywords
Social Computing; Digital Media Interaction; Highlight; Media Indexing;
Citations & Related Records
연도 인용수 순위
  • Reference
1 NIELSEN: State of the Media: The Social Media Report Q3 2011, http://www.nielsen.com/us/en/reports/2011/social-media-report-q3.html, (accessed Nov., 30, 2012 ).
2 J. Howe, The Rise of Crowdsourcing, Wired Magazine, Vol. 14, No. 6, pp. 1-4, 2006.
3 L.V. Ahn, "Human Computation," Proceeding of Design Automation Conference, pp. 418-419, 2009.
4 M.S. Bernstein, G. Little, R.C. Miller, B. Hartmann, M.S. Ackerman, D.R. Karger, et al., "Soylent: A Word Processor with a Crowd Inside," Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology, pp. 313-322, 2010.
5 A. Tang and S. Boring, "#EpicPlay: Crowdsourcing Sports Video Highlights," Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1569-1572, 2012.
6 P. England, R.B. Allen, and M. Sullivan, "I/Browse: the Bellcore Video Library Tool Kit," Proceeding of Electronic Imaing: Science & Technology, pp. 254-264, 1996.
7 M. Gelgon and P. Bouthemy, Determining a Structured Spatio-temporal Representation of Video Content for Efficient Visualization and Indexing, Springer, Berlin Heidelberg, 1998.
8 K. McPherson, K. Huotari, F. Cheng, D. Humphery, C. Cheshire, and A.L. Brooks, "Glitter: A Mixed-Methods Study of Twitter Use During Glee Broadcasts," Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work Companion, pp. 167-170, 2012.
9 J. Giles, "Internet Encyclopaedias Go Head to Head," Journal of Nature, Vol. 438, No. 7070, pp. 900-901, 2005.   DOI
10 L.V. Ahn and L. Dabbish, "Labeling Images with a Computer Game," Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 319-326, 2004.
11 L.V. Ahn, B. Maurer, C. McMillen, D. Abraham, and M. Blum, "Recaptcha: Humanbased Character Recognition via Web Security Measures," Journal of Science, Vol. 321, No. 5859, pp. 1465-1468, 2008.   DOI
12 L.V. Ahn, M. Blum, N. Hopper, and J. Langford, "CAPTCHA: Using Hard AI Problems for Security," Proceeding of Advances in Cryptology-EUROCRYPT, pp. 646-646, 2003.
13 A. Marcus, M.S. Bernstein, O. Badar, D.R. Karger, S. Madden, and R.C. Miller, "Twitinfo: Aggregating and Visualizing Microblogs for Event Exploration," Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 227-236, 2011.
14 G.W. Allport, "Change and Decay in the Visual Memory Image," British Journal of Psychology General Section, Vol. 12, Issue 2, pp. 133-148, 1930.   DOI
15 E. Averbach and A.S. Coriell, "Short-term Memory in Vision," Bell System Technology Journal, Vol. 40, Issue 1, pp. 309-328, 1961.   DOI
16 D.E. Broadbent, Perception and Communication, Pergamon Press, London, 1958.
17 J. Lee, C. Rim, W. Kim. "A Study of Design and Implementation of Software Player for XML Data Based Interactive Digital TV Service," Journal of Korea Multimedia Society, Vol. 7, Issue 11, pp. 1564-1570, 2004.