Image-Based Relighting - Luminance Mapping Based on Lighting Functions

  • 발행 : 2012.04.01

초록

The paper proposes a method for generating a sequence of images with smooth transition of illumination from two input images with different lighting conditions. Our relighting approach is image-based, such as the light field rendering. We store the luminances (pixel RGB values) into "lighting functions" consisting of a couple of parameters related to normal vectors. Images with different light positions are rendered by interpolating the luminances retrieved from the lighting functions. The proposed method is a promising technique for many applications requiring a scene with variety of lighting effects, such as movies, TV games, and so on.

키워드

참고문헌

  1. S. Gortler, R. Grzeszczuk, R. Szeliski, and M. Cohen, M. (1996), "The Lumigraph," Proc. SIGGRAPH, '96, ACM, 43-54.
  2. M. Levoy and P. Hanrahan. (1996), "Light Field Rendering," Proc. SIGGRAPH, '96, ACM, 31-42.
  3. Y. Dobashi, K. Kaneda, H. Nakatani, and H. Yamashita. (1995), "A Quick Rendering Method Using Basis Functions for Interactive Lighting Design," Computer Graphics Forum, 14(3): C229-C240. https://doi.org/10.1111/j.1467-8659.1995.cgf143_0229.x
  4. P. P. Sloan, J. Kautz, and J. Snyder. (2002), "Precompute Radiance Transfer for Real-time Rendering in Dynamic, Low-frequency Lighting Environments," ACM Tran. on Graphics, 21(3): 527-536.
  5. R. Ng, R. Ramamoorthi, and P. Hanrahan. (2003), "All- Frequency Shadows using Non-Linear Wavelet Lighting Approximation," ACM Transactions on Graphics, 22(3): 376-381. https://doi.org/10.1145/882262.882280
  6. K. Zhou, Y. Hu, S. Liu, B. Guo, and H. Y. Shum. (2005), "Precomputed Shadow Fields," ACM Trans. on Graphics, 24(3): 1196-1201. https://doi.org/10.1145/1073204.1073332
  7. W. Sun and A. Mukherjee. (2006), "Generalized Wavelet Product Integral for Rendering Dynamic Glossy Objects," ACM Transactions on Graphics, 25(3): 477-487.
  8. T. Annen, Z. Dong, T. Mertens, P. Bekaert, H. P. Seidel, and J. Kautz. (2008), "Real-time, All-Frequency Shadows in Dynamic scenes," ACM Trans. on Graphics, 27(3): Article 34.
  9. T. Ritschel, T. Grosch, M. H. Kim, H. P. Seidel, C. Dachsbacher, and J. Kautz. (2008), "Imprefect Shadow Maps for Efficient Computation of In direct Illumination," ACM Transactions on Graphics, 27(5): Article 129.
  10. Hara, K., Nishino, K., and Ikeuchi, K. (2008), Mixture of Spherical Distributions for Single-View Relighting, IEEE Trans. PAMI, 30(1): 25-35. https://doi.org/10.1109/TPAMI.2007.1164
  11. Mukaigawa, Y., Miyaki, H., Mihashi, S., and Shakunaga, T. (2001), Photomeric Image-Based Rendering for Image Generation in Arbitrary Illumination, Proc. ICCV 2001, II-652-659.
  12. Choudhury, B., and Chandran, S. (2007), A Survey of Image-Based Relighting Techniques, J. Virtual Reality and Broadcasting, 4(7): unr:nbn:de:0009-6-21208.
  13. Georghiades, A.S., Belhumeur, P.N., and Kriegman, D.J. (2001), From few to many: Illumination cone models for face recognition under variable lighting and pose, IEEE Trans. PAMI, 23(6): 643-660. https://doi.org/10.1109/34.927464
  14. Hawkins, T., Wenger, A., Tchou, C., Gardner, A., Goransson, F., and Debevec, P. (2004), Animatable Facial Reflectance Fields, Proc. The 15th Eurographics Workshop on Rendering Techniques, 309-321.
  15. Hengel, A., Sale, D., and Dick A. R. (2009), SecondSkin: An Iinteractive Method for Appearance Transfer, Computer Graphics Forum, 28(7): 1735-1744. https://doi.org/10.1111/j.1467-8659.2009.01550.x
  16. T. Manabe, K. Kaneda, H. Yamashita, and I. Shibabayashi. (2002), "A Method for Interpolating Illumination Distribution due to In-between Light Source Position under Interreflective Environment Using Isophotic Line Warping," The Journal of the Institute of Image Electronics Engineer of Japan, 31(4): 487-495.
  17. T. Manabe, T. Betsumiya, and K. Kaneda. (2005), "Illumination Morphing: Smooth Transition of Luminance Distributions between Two Images," Proc. 9th CAD/ Graphics, 517-524.
  18. T. Manabe, B. Raytchev, T. Tamaki and K. Kaneda. (2012), "Illumination Morphing: Generating a Smooth Change of illumination between Two Color Images," Int. J Software Informatics, (to appear)
  19. J. Blinn. (1997), "Models of light reflection for computer synthesized pictures," Computer Graphics, 11(2), 192-198.
  20. K. Hara, K. Nishino, and K. Ikeuchi. (2005), "Light Source Position and Reflectance Estimation from a Single View without the Distant Illumination Assumption," IEEE Transactions on PAMI , 27(4): 493-505. https://doi.org/10.1109/TPAMI.2005.82