Browse > Article

Motion Map Generation for Maintaining the Temporal Coherence of Brush Strokes in the Painterly Animation  

Park Youngs-Up (중앙대학교 컴퓨터공학과)
Yoon Kyung-Hyun (중앙대학교 컴퓨터공학과)
Publication Information
Journal of KIISE:Computer Systems and Theory / v.33, no.8, 2006 , pp. 536-546 More about this Journal
Abstract
Painterly animation is a method that expresses painterly images with a hand-painted appearance from a video, and the most crucial element for it is the temporal coherence of brush strokes between frames. A motion map is proposed in this paper as a solution to the issue of maintaining the temporal coherence in the brush strokes between the frames. A motion map is the region that frame-to-frame motions have occurred. Namely, this map refers to the region frame-to-frame edges move by the motion information with the motion occurred edges as a starting point. In this paper, we employ the optical flow method and block-based method to estimate the motion information. The method that yielded the biggest PSNR using the motion information (the directions and magnitudes) acquired by various methods of motion estimation has been chosen as the final motion information to form a motion map. The created motion map determine the part of the frame that should be re-painted. In order to express painterly images with a hand- painted appearance and maintain the temporal coherence of brush strokes, the motion information was applied to only the strong edges that determine the directions of the brush strokes. Also, this paper seek to reduce the flickering phenomenon between the frames by using the multiple exposure method and the difference map created by the difference between images of the source and the canvas. Maintenance of the coherence in the direction of the brush strokes was also attempted by a local gradient interpolation to maintain the structural coherence.
Keywords
painterly rendering & animation; motion map; temporal coherence; local gradient interpolation; strong edge;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Y.S. Park and K.H. Yoon, 'Adaptive Brush Stroke Generation for Painterly Rendering,' EG'2004 Short Presentations, pp.65-68, 2004
2 T. Beier, S. Neely, 'Feature Based Image Metamorphosis,' SIGGRAPH'92, pp.35-42, 1992   DOI
3 A. Hertzmann, K. Perlin, 'Painterly Rendering for Video and Interaction,' NPAR'2000, pp.7-12, 2000   DOI
4 J. Hays and I. Essa, 'Image and Video Based Painterly Animation,' NPAR'2004, pp.113-120, 2004   DOI
5 P. Litwinowicz, 'Processing Images and Video An Impressionist Effect,' SIGGRAPH'97, pp.407-414, 1997   DOI
6 A. Hertzmann, 'Painterly rendering with curved brush strokes of multiple sizes,' SIGGRAPH'98, pp.453-460, 1998   DOI
7 T. Koga, K. Iinuma, A. Hirano, Y. Iijima and T. Ishiguro, 'Motion-compensated interframe coding for video,' NTC'81, pp. G.5.3.1-G.5.3.4, 1981
8 A.M. Tekalp, Digital Video Processing, pp.72-116, Prentice-Hall, 1995
9 Y. Deng, B.S. Manjunath and H. Shin, 'Color Image Segmentation,' CVPR'99, pp.2446-2451, 1999   DOI
10 M. BLANK and P. Anandan, 'Robust dynamic motion estimation over time,' CVPR'91, pp.296-203, 1991   DOI
11 Y. Deng, C. Kenney, M.S. Moore and B.S. Manjunath, 'Peer group filtering and perceptual color image quantization,' ISCAS'99, pp. IV21 - IV24, 1999   DOI
12 K. Layboume, Animation Book, Three Rivers Press, 1998