한국정보과학회논문지:시스템및이론 (Journal of KIISE:Computer Systems and Theory)

한국정보과학회 (Korean Institute of Information Scientists and Engineers)
권호 표지

사용자 제어가 용이한 이차원 영상의 추상화된 라인 드로잉 생성

User-Guidable Abstract Line Drawing of 2D Images

  • 투고 : 2009.09.17
  • 심사 : 2009.12.18
  • 발행 : 2010.04.15
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

본 논문은 이차원 영상으로부터 시각적으로 효과적인 정보를 제공할 수 있는 라인 드로잉 영상을 생성하는 방법을 제시한다. 본 방법은 기존의 단순한 에지 추출 방법과 달리 사람의 라인 드로잉 과정을 적용하여 직관적이면서 효과적인 결과를 생성하며, 크게 라인 추출, 라인 렌더링, 사용자 지시의 세단계로 구성된다. 라인 추출 단계에서는 우도 함수를 이용하여 물체의 중요한 경계 부분을 효과적으로 예측함으로써 라인을 추출한다. 추출된 라인을 실제 렌더링하는 라인 렌더링 단계에서는, 중요한 라인과 세부 라인의 구분 및 초점의 정확도를 표현하기 위하여 라인의 특징 크기와 번짐 정도를 고려하고, 이를 다양한 스타일로 표현하기 위해 텍스쳐 형태의 라인 영상을 적용한다. 마지막으로 사용자 지시 단계에서는 자동으로 생성된 라인의 모양이나 위치를 사용자 상호작용으로 수정할 수 있다. 이 때 사용자 입력에 대한 즉각적인 반응을 위해 라인 추출의 대부분의 과정이 GPU 상에서 구현된다. 제시된 방법의 결과로 사용자는 이차원 영상으로부터 중요한 부분과 초점이 맞는 부분의 표현 및 스타일을 원하는 대로 조절한 라인 드로잉을 얻을 수 있고, 또한 이를 자유롭게 수정할 수 있다.

We present a novel scheme for generating line drawings from 2D images, aiming to facilitate effective visual communication. In contrast to conventional edge detectors, our technique imitates the human line drawing process to generate lines effectively and intuitively. Our technique consists of three parts: line extraction, line rendering, and user guidance. In line extraction, we extract lines by estimating a likelihood function to effectively find the genuine shape boundaries. In line rendering, we consider the feature scale and the blurriness of lines with which the detail and the focus-level of lines are controlled. We also employ stroke textures to provide a variety of illustration styles. User guidance is allowed to modify the shapes and positions of lines interactively, where immediate response is provided by GPU implementation of most line extraction operations. Experimental results demonstrate that our technique generates various kinds of line drawings from 2D images enabled by the control over detail, focus, and style.

키워드

과제정보

연구 과제번호 : Development of Computational Photography Technologies for Image and Video Contents

연구 과제 주관 기관 : MKE/MCST/KEIT, Korea Ministry of Education, Science and Technology(MEST)/National Research Foundation of Korea(KRF)

참고문헌

  1. L. Markosian, M. A. Kowalski, S. J. Trychin, L. D. Bourdev, D. Goldstein, and J. F. Hughes, "Real-time nonphotorealistic rendering," ACM Computer Graphics (Proc. SIGGRAPH '97), pp.415- 420, 1997.
  2. A. Hertzmann and D. Zorin, "Illustrating smooth surfaces," ACM Computer Graphics (Proc. SIGGRAPH 2000), pp.517-526, July 2000.
  3. T. Isenberg, B. Freudenberg, N. Halper, S. Schlechtweg, and T. Strothotte, "A developer's guide to silhouette algorithms for polygonal models," IEEE Computer Graphics and Applications, vol.23, no.4, pp.28-37, 2003. https://doi.org/10.1109/MCG.2003.1210862
  4. D. DeCarlo, A. Finkelstein, S. Rusinkiewicz, and A. Santella, "Suggestive contours for conveying shape," ACM Computer Graphics (Proc. SIGGRAPH 2003), pp.848-855, July 2003.
  5. R. D. Kalnins, P. L. Davidson, L. Markosian, and A. Finkelstein, "Coherent stylized silhouettes," ACM Computer Graphics (Proc. SIGGRAPH 2003), pp. 856-861, July 2003.
  6. M. Sousa and P. Prusinkiewicz, "A few good lines: Suggestive drawing of 3D models," Computer Graphics Forum (Proc. Eurographics 2003), vol.22, no.3, 2003.
  7. M. Pauly, R. Keiser, and M. Gross, "Multi-scale feature extraction on point-sampled surfaces," Computer Graphics Forum (Proc. Eurographics 2003), vol.22, no.3, pp.281-289, 2003.
  8. H. Xu, N. Gossett, and B. Chen, "Pointworks: Abstraction and rendering of sparsely scanned outdoor environments," in Proc. Eurographics Symposium on Rendering, pp.45-52, 2004.
  9. M. Son and S. Lee, "Line drawings from 2D images," Journal of KIISE : Computer Systems and Theory, vol.34, no.12, pp.656-673, 2007, in Korean.
  10. M. Son, H. Kang, Y. Lee, and S. Lee, "Abstract line drawings from 2D images," in Proc. Pacific Graphics 2007, pp.333-342, 2007.
  11. P. Litwinowicz, "Processing images and video for an impressionist effect," ACM Computer Graphics (Proc. SIGGRAPH '97), pp.151-158, 1997.
  12. C. Curtis, S. Anderson, J. Seims, K. Fleischer, and D. Salesin, "Computer-generated watercolor," ACM Computer Graphics (Proc. SIGGRAPH '97), pp.421-430, 1997.
  13. A. Hertzmann, "Painterly rendering with curved brush strokes of multiple sizes," ACM Computer Graphics (Proc. SIGGRAPH '98), pp.453-460, 1998.
  14. B. Gooch, G. Coombe, and P. Shirley, "Artistic vision: Painterly rendering using computer vision techniques," in Proc. Non-Photorealistic Animation and Rendering, pp.83-90, 2002.
  15. A. Hertzmann, "Paint by relaxation," in Proc. Computer Graphics International, pp.47-54, 2001.
  16. J. Hays and I. Essa, "Image and video-based painterly animation," in Proc. Non-Photorealistic Animation and Rendering, pp.113-120, 2004.
  17. H. Kang, C. Chui, and U. Chakraborty, "A unified scheme for adaptive stroke-based rendering," The Visual Computer, vol.22, no.9, pp.814-824, 2006. https://doi.org/10.1007/s00371-006-0066-7
  18. M. Salisbury, S. Anderson, R. Barzel, and D. Salesin, "Interactive pen-and-ink illustration," ACM Computer Graphics (Proc. SIGGRAPH '94), pp.101-108, 1994.
  19. M. Salisbury, C. Anderson, D. Lischinske, and D. Salesin, "Scale-dependent reproduction of penand- ink illustrations," ACM Computer Graphics (Proc. SIGGRAPH '96), pp.461-468, 1996.
  20. M. Salisbury, M. Wong, J. Hughes, and D. Salesin, "Orientable textures for image-based pen-and-ink illustration," ACM Computer Graphics (Proc. SIGGRAPH '97), pp.401-406, 1997.
  21. M. Sousa and J. Buchanan, "Observational models of graphite pencil materials," Computer Graphics Forum, vol.19, no.1, pp.27-49, 2000. https://doi.org/10.1111/1467-8659.00386
  22. F. Durand, V. Ostromoukhov, M. Miller, F. Duranleau, and J. Dorsey, "Decoupling strokes and high-level attributes for interactive traditional drawing," in Proc. 12th Eurographics Workshop on Rendering, London, June 2001, pp.71-82.
  23. V. Ostromoukhov, "Digital facial engraving," ACM Computer Graphics (Proc. SIGGRAPH '99), pp. 417-424, 1999.
  24. D. DeCarlo and A. Santella, "Stylization and abstraction of photographs," ACM Computer Graphics (Proc. SIGGRAPH 2002), pp.769-776, 2002.
  25. J. Canny, "A computational approach to edge detection," IEEE Trans. Pattern Analysis and Machine Intelligence, vol.8, no.6, pp.679-698, November 1986. [Online]. Available: http://portal.acm. org/citation.cfm? id=11275
  26. D. Comaniciu and P. Meer, "Mean shift: A robust approach toward feature space analysis," IEEE Trans. Pattern Analysis and Machine Intelligence, vol.24, no.5, pp.603-619, 2002. https://doi.org/10.1109/34.1000236
  27. J. Wang, Y. Xu, H.-Y. Shum, and M. Cohen, "Video tooning," ACM Computer Graphics (Proc. SIGGRAPH 2004), pp.574-583, 2004.
  28. J. P. Collomosse, D. Rowntree, and P. M. Hall, "Stroke surfaces: Temporally coherent non-photorealistic animations from video," IEEE Trans. Visualization and Computer Graphics, vol.11, no.5, pp.540-549, 2005. https://doi.org/10.1109/TVCG.2005.85
  29. F. Wen, Q. Luan, L. Liang, Y.-Q. Xu, and H.-Y. Shum, "Color sketch generation," in Proc. Non- Photorealistic Animation and Rendering, pp.47-54, 2006.
  30. J. Fischer, D. Bartz, and W. Strasser, "Stylized augmented reality for improved immersion," in Proc. IEEE VR, pp.195-202, 2005.
  31. B. Gooch, E. Reinhard, and A. Gooch, "Human facial illustrations," ACM Trans. Graphics, vol.23, no.1, pp.27-44, 2004. https://doi.org/10.1145/966131.966133
  32. D. Marr and E. C. Hildreth, "Theory of edge detection," in Proc. Royal Soc. London, pp.187-217, 1980.
  33. H. Winnemöller, S. C. Olsen, and B. Gooch, "Real-time video abstraction," ACM Computer Graphics (Proc. SIGGRAPH 2006), pp.1221-1226, 2006.
  34. J. Shen and S. Castan, "An optimal linear operator for step edge detection," Graphical Models and Image Processing, vol.54, no.2, pp.112-133, 1992. https://doi.org/10.1016/1049-9652(92)90060-B
  35. C. Rothwell, J. Mundy, W. Hoffman, and V. l Nguyen, "Driving vision by topology," in Proc. International Symposium on Computer Vision, pp.395-400, 1995.
  36. L. Iverson and S. Zucker, "Logical/linear operators for image curves," IEEE Trans. Pattern Analysis and Machine Intelligence, vol.17, no.10, pp.982-996, 1995. https://doi.org/10.1109/34.464562
  37. S. Smith and J. Brady, "Susan - a new approach to low-level image processing," International Journal of Computer Vision, vol.23, no.1, pp.45-78, 1997. https://doi.org/10.1023/A:1007963824710
  38. P. Meer and B. Georgescu, "Edge detection with embedded confidence," IEEE Trans. Pattern Analysis and Machine Intelligence, vol.23, no.12, pp. 1351-1365, 2001. https://doi.org/10.1109/34.977560
  39. O. Schall, A. Belyaev, and H.-P. Seidel, "Robust filtering of noisy scattered point data," in Proc. IEEE/Eurographics Symposium on Point-Based Graphics, pp.71-77, 2005.
  40. N. J. Mitra and A. Nguyen, "Estimating surface normals in noisy point cloud data," in Proc. SCG '03: Nineteenth Annual Symposium on Computational Geometry.1em plus 0.5em minus 0.4emNew York, NY, USA: ACM Press, pp.322-328, 2003.
  41. F. Bergholm, "Edge focusing," IEEE Trans. Pattern Analysis and Machine Intelligence, vol.9, no.6, pp.726-741, 1987.
  42. J. H. Elder and S. W. Zucker, "Local scale control for edge detection and blur estimation," IEEE Trans. Pattern Analysis and Machine Intelligence, vol.20, no.7, pp.699-716, 1998. https://doi.org/10.1109/34.689301
  43. T. Lindeberg, "Edge detection and ridge detection with automatic scale selection," Intl. J. of Computer Vision, vol.30, pp.117-154, 1998. https://doi.org/10.1023/A:1008097225773
  44. A. Orzan, A. Bousseau, P. Barla, and J. Thollot, "Structure-preserving manipulation of photographs," in Non-Photorealistic Animation and Rendering (Proc. NPAR 2007), 2007, pp.103-110. [Online]. Available: http://artis.imag.fr/Publications/2007/OBBT07
  45. H. Kang, S. Lee, and C. Chui, "Coherent line drawing," in Proc. Non-Photorealistic Animation and Rendering, 2007.