A Study on Saliency-based Stroke LOD for Painterly Rendering

회화적 렌더링을 위한 세일리언시 기반의 스트로크 단계별 세부묘사 제어에 관한 연구

  • Published : 2009.06.15

Abstract

In this paper, we suggest a stroke level of detail (LOD) based on a saliency density. On painter]y rendering, the stroke LOD has an advantage of making the observer concentrate on the main object and improving accuracy of expression. For the stroke LOD, it is necessary to classify the detailed and abstracted area. We divide the area on the basis of saliency distribution and the level of detailed expression is controlled based on the saliency information. 'We define that the area of which the saliency distribution is high is a major subject that an artist tries to express, it is described in detail. The area of which the saliency distribution is low is abstractly described. Each divided area has the abstraction level. And by adapting the brushes of which sizes are appropriate to each level, it is possible to express the area which needs to be expressed in details from the one which needs to be expressed abstractly.

본 논문은 세일리언시 밀도에 기반한 스트로크의 단계별 세부묘사(Level of Detail:LOD) 표현 알고리즘을 제안한다. 회화적 렌더링에서 스트로크 LOD는 주된 대상에 대한 관찰자의 시선을 집중시키며 표현의 정확성을 높일 수 있는 장점을 가진다. 이를 위해 세밀하게 묘사된 부분과 추상적 묘사가 될 영역을 구분할 필요가 있다. 본 논문에서는 세일리언시 분포를 기준으로 공간 분할 후, 그 데이터에 기반하여 세밀한 표현의 정도를 제어한다. 세일리언시 분포가 높은 영역은 작가가 표현하고자 하는 주된 대상으로 가정하여 세밀한 묘사가 되도록 하며 밀도가 낮은 영역은 상대적으로 추상적인 표현을 한다. 우리의 알고리즘을 통해 쉽고 명확하게 스트로크 LOD를 제어, 표현 할 수 있다.

Keywords

References

  1. A. Hertzmann, "Tutorial: A survey of strokebased rendering," IEEE Computer Graphics & Appl. 23, pp. 70-81, 2003.
  2. W. Baxter, J. Wendt, and M. Lin, "IMPaSTo: A Realistic, Interactive Model for Paint," Proc. 3nd Ann. Symp. Non-Photorealistic Animation and Rendering (NPAR 2004), pp. 45-56, 2004.
  3. S. Lee, S. C. Olsen, B. Gooch, "Interactive 3D fluid jet painting," Proc. 4nd Ann. Symp. Non-Photorealistic Animation and Rendering (NPAR 2006), pp. 97-104, 2006.
  4. B. J. Meier. Painterly rendering for animation, Proc. Siggraph 96, ACM Press, pp. 453-460, 1998.
  5. H. Lee, Y. Park, K. Yoon. A Study on the Dynamic Painterly Stroke Generation for 3D Animation, ICCSA, pp. 317-325, 2003.
  6. P. Haeberli, "Paint by Numbers: Abstract Image Representation," Computer Graphics (Proc. Sig-graph), Vol.24, No.4, pp. 207-214, Aug. 1990. https://doi.org/10.1145/97880.97902
  7. P. Litwinowicz, "Processing Images and Video for an Impressionist Effect," Proc. Siggraph 97, ACM Press, pp. 407-414, 1997.
  8. A. Hertzmann, "Painterly Rendering with Curved Brush Strokes of Multiple Sizes," Proc. Siggraph 98, ACM Press, pp. 453-460, 1998.
  9. A. Hertzmann, "Paint by relaxation," Proc, Computer GRaphic Internation, pp. 47-54. 2001.
  10. B. Gooch, G. Coombe and P. Shirley, "Artistic Vision: Painterly Rendering Using Computer Vision Techniques," Proc. 2nd Ann. Symp. Non-Photorealistic Animation and Rendering (NPAR 2002), ACM Press, pp. 83-90, 2002.
  11. A. Hertzmann, "Fast Paint Texture," Proc. 2nd Ann. Symp. Non-Photorealistic Animation and Rendering (NPAR 2002), ACM Press, pp. 91-96, 161, 2002.
  12. J. Hays, I. Essa, "Image and Video Based Painterly Animation," 3rd Ann. Symp. Non-Photorealistic Animation and Rendering(NPAR2004), pp. 120-133.
  13. Y. Park, K. Yoon, "Painterly animation using motion maps," Graphical Models, Vol.70, pp. 1-15, Jan. 2008. https://doi.org/10.1016/j.gmod.2007.06.001
  14. Zeki, S., Inner Vision: An Exploration of Art and the Brain. Oxford University Press, 1999.
  15. A. Santella, D. DeCarlo "Abstracted Painterly Rendering Using Eye-Tracking Data," Proc. 2nd Ann. Symp. Non-Photorealistic Animation and Rendering (NPAR 2002), ACM Press, pp. 75-82, 2002.
  16. D. DeCarlo, A. Santella, "Stylization and abstraction of photographs," In Proceedings of SIGGRAPH, pp. 769-776, 2002.
  17. L. Kovacs, T. Sziranyi, "2D Multilayer Painterly Rendering with Automatic Focus Extraction," Proc. WSCG 2006, ISBN 80-86943-03-8, pp. 141-145, Plzen, 2006.
  18. 이호창, 박영섭, 윤경현, "에지밀도를 이용한 회화적 렌더링", 멀티미디어학회논문지, 제10권, 제2호, pp. 187-199, 2007.
  19. A. Shashua and S. Ullman, "Structural Saliency: The Detection of Globally Salient Structures Using a Locally Connected Network," IEEE Transactions on PAMI, Vol.7, No.1, pp. 90-94, 1988.
  20. L. Itti, C. Koch, E. Niebur, "A Model of Saliency-Based Visual Attention for Rapid Scene Analysis," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.20, No.11, pp. 1254-1259, Nov 1998. https://doi.org/10.1109/34.730558
  21. Y. Ma, H. Zhang, "Contrast-based Image Attention Analysis by Using Fuzzy Growing," ACM Multimedia, pp. 374-381, 2003.
  22. Y.F. Ma and H.J. Zhang, Contrast-based Image Attention Analysis by Using Fuzzy Growing, In proceeding of 11th ACM international conference on Multimedia, pp. 374-381, 2003.
  23. J. P. Collomosse, P. M. Hall, "Painterly Rendering using Image Salience," Proc. 20th Eurographic UK Conference, pp. 122-128.
  24. J. Park, B. Koo, R. Barry, S. Hong, K. Yoon, "Painterly rendering with designed imperfection," SIGGRAPH 2006 Sketches, ACM Press, pp.99, 2006.