Browse > Article

Real-time Style Transfer for Video  

Seo, Sang Hyun (성결대학교 공과대학 미디어소프트웨어학부)
Publication Information
Smart Media Journal / v.5, no.4, 2016 , pp. 63-68 More about this Journal
Abstract
Texture transfer is a method to transfer the texture of an input image into a target image, and is also used for transferring artistic style of the input image. This study presents a real-time texture transfer for generating artistic style video. In order to enhance performance, this paper proposes a parallel framework using T-shape kernel used in general texture transfer on GPU. To accelerate motion computation time which is necessarily required for maintaining temporal coherence, a multi-scaled motion field is proposed in parallel concept. Through these approach, an artistic texture transfer for video with a real-time performance is archived.
Keywords
Real-time Processing; Artistic Style Transfer; Video Texture Transfer;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 J. S. De Bonet. "Multiresolution sampling procedure for analysis and synthesis of texture images," in Proc. of the 24th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH97, pp.361-368, 1997.
2 A. A. Efros and W. T. Freeman. "Image quilting for texture synthesis and transfer," in Proc. of the 28th annual conference on Computer graphics and interactive techniques, pp.341-346. ACM, 2001.
3 C. Eisenacher, S. Lefebvre, and M. Stamminger. "Texture synthesis from photographs," Computer Graphics Forum, vol.27, pp.419-428. Wiley Online Library, 2008.   DOI
4 S. Lefebvre and H. Hoppe. "Appearance-space texture synthesis," ACM Trans. Graph., vol.25, no.3, pp.541-548, July 2006.   DOI
5 L. Liang, C. Liu, Y.-Q. Xu, B. Guo, and H.-Y. Shum. "Real-time texture synthesis by patch-based sampling," ACM Trans. Graph., vol.20, no.3, pp.127-150, July 2001.   DOI
6 M. Ashikhmin. "Synthesizing natural textures," in Proc. of the 2001 Symposium on Interactive 3D Graphics, pp.217-226, New York, NY, USA, 2001.
7 M. Ashikhmin. "Fast texture transfer," Computer Graphics and Applications, IEEE, 23(4), pp.38-43, 2003.
8 H. Lee, S. Seo, and K. Yoon. "Directional texture transfer with edge enhancement," Computers & Graphics, pp.81-91, 2011.
9 N. Ye, T. Sim, and X. Miao. "Video stylization by single image example," in Proc. of ICIP 2010 pp.3993-3996. 2010.
10 D. Kang, P. Kong, K. Yoon, and S. Seo. "Directional texture transfer for video," Multimedia Tools and Applications, , vol. 74, no. 1, pp.245-258, 2015.   DOI
11 C. Nvidia. Compute unified device architecture programming guide. 2007.
12 G. Bradski and A. Kaehler. "Learning OpenCV: Computer vision with the OpenCV library," O'ReillyMedia, Inc.", 2008.
13 J. Marzat, Y. Dumortier, and A. Ducrot. "Real-time dense and accurate parallel optical flow using cuda," 2009.
14 김정인, 최창, 김판구, "비디오 내 이동 객체의 색인 정보를 이요한 궤적 유사도 측정 기법", 스마트미디어학회논문지 제1권 3호, pp. 43-47, 2012년 9 월.
15 홍택은,김정인,신주현, "인스타그램 이미지와 텍스트 분석을 통한 사용자 감정 분류 ", 스마트미디어학회논문지 제5권 1호, pp. 61-68, 2016년 3월.