Journal of Information Technology Services (한국IT서비스학회지)

Korea Society of IT Services (한국IT서비스학회)
권호 표지
DOI QR코드

DOI QR Code

WalkieTagging : Efficient Speech-Based Video Annotation Method for Smart Devices

워키태깅 : 스마트폰 환경에서 음성기반의 효과적인 영상 콘텐츠 어노테이션 방법에 관한 연구

  • 박준영 (한국과학기술원 IT융합연구소 지식융합팀) ;
  • 이수빈 (한국과학기술원 IT융합연구소 지식융합팀) ;
  • 강동엽 (한국과학기술원 IT융합연구소 지식융합팀) ;
  • 석영태 (SK텔레콤 솔루션 사업본부 솔루션 개발팀)
  • Received : 2013.01.26
  • Accepted : 2013.03.17
  • Published : 2013.03.31
Download PDF
⟨ Previous Next ⟩

Abstract

The rapid growth and dissemination of touch-based mobile devices such as smart phones and tablet PCs, gives numerous benefits to people using a variety of multimedia contents. Due to its portability, it enables users to watch a soccer game, search video from YouTube, and sometimes tag on contents on the road. However, the limited screen size of mobile devices and touch-based character input methods based on this, are still major problems of searching and tagging multimedia contents. In this paper, we propose WalkieTagging, which provides a much more intuitive way than that of previous one. Just like any other previous video tagging services, WalkieTagging, as a voice-based annotation service, supports inserting detailed annotation data including start time, duration, tags, with little effort of users. To evaluate our methods, we developed the Android-based WalkieTagging application and performed user study via a two-week. Through our experiments by a total of 46 people, we observed that experiment participator think our system is more convenient and useful than that of touch-based one. Consequently, we found out that voice-based annotation methods can provide users with much convenience and satisfaction than that of touch-based methods in the mobile environments.

Keywords

References

  1. 이경희, 이종우, 임순범, "디지털 말하기 책을 위한 음성 주석달기 시스템", 한국정보과학회논문지, 컴퓨팅의 실제 및 레터, 제18권, 제4호(2012), pp.276-281.
  2. 이연호, 오경진, 신위살, 조근식, "링크드 데이터를 이용한 협업적 비디오 어노테이션 및 브라우징 시스템", 한국지능정보시스템학회, 제17권, 제3호(2011), pp.203-219.
  3. Harrison, B. and R. Baecker, "Designing video annotation and analysis systems", Proceedings of the conference on Graphics interface, (1992), pp.157-166.
  4. Pakucs, B., "Butler : A Universal Speech Interface for Mobile Environments", MOBILEHCI, Lecture Notes in Computer Science, Vol3160(2004), pp.399-403.
  5. Yeo, B. and M. Yeung, "Retrieving and visualizing video", Communications of the ACM, Vol.40, No.12(1997), pp.43-52.
  6. Guo-Jun, Q. et al., "Correlative multi-label video annotation", In proc. of the 15th international conference on Multimedia (MULTIMEDIA), (2007), pp.17-26.
  7. Weher, K. and A. Poon, "Marquee : a tool for real-time video logging", In proc. of the SIGCHI conference on Human factors in computing : celebrating interdependence (CHI), (1994), pp.58-64.
  8. Ames, M. and M. Naaman, "Why we tag : motivations for annotation in mobile and online media", In proc. of the SIGCHI conference on Human factors in computing systems(CHI), (2007), pp.971-980.
  9. Costa, M. N. Correia, and N. Guimaraes, "Annotations as multipleperspectives of video content", In proc. of the tenth ACM international conference on Multimedia (MULTIMEDIA), (2002), pp.283-286.
  10. Motaz, E.-S., X.-J. Wang, N. Hasan, M. Bassiouny, and M. Refaat, "Seamless annotation and enrichment of mobile captured video streams in real-time", IEEE Internation Conference on Multimedia and Expo (ICME), 2011.
  11. Rosenfeld, R., D. Olsen, and A. Rudnicky, "Universal speech interface", Interactions, Vol.8, No.6(2001), pp.34-44. https://doi.org/10.1145/384076.384085
  12. Volkmer, T., J. Smith, and A. Natsev, "A web-based system for collaborative annotation of large image and video collections : an evaluation and user study", In proc. of the 13th annual ACM international conference on Multimedia(MULTIMEDIA), (2005), pp.892-901.
  13. Anguera, X., J. Xu, and N. Oliver, "MAM I : Multimodal Photo Annotation and Retrieval on a Mobile Phone", In Proc. ACM International Conference on Multimedia Information Retrieval(MIR), Vancouver, Canada, 2008.
  14. Zhiwen, Y. et al., "Supporting Context-Aware Media Recommendations for Smart Phones", IEEE Pervasive Computing, Vol.5, No.3 (2006), pp.68-75, doi:10.1109/MPRV.2006.61.
  15. AnViAnno Video Annotations Tool http://to sini.informatik.rwth-aachen.de:8134/media/anvianno/.
  16. Mobile Applications Ranking Informations http://bgr.com/2013/01/23/mobile-appsrankings-google-303777/.
  17. Most Popular Video Apps Ranking http://wearesocial.sg/blog/2012/02/social-asia-tu esday-tuneup-14-2/most-popular-videowebsite-by-country-appappeal/.
  18. Research and Markets : Worldwide Smartphone Markets : 2011 to 2015 http://www.businesswire.com/news/home/20110826005231/en/Research-Markets-Worldwide-Smartphone-Markets-2011-2015.
  19. Scribbeo Video Annotations Tool, http://scribbeo.com/.
  20. VideoAnnEx Annotation Tool, http://www.research.ibm.com/VideoAnnEx/.
  21. YouTube Capture Video Annotations Tool, http://www.youtube.com/capture.
  22. YouTube Video Annotations Tool, http://www.youtube.com/watch?v = UxnopxbOdic.