Browse > Article

Regeneration of Plausible Lighting using a Specular Sphere in Augmented Reality  

Lee, Seok-Jun (School of Computer Science and Engineering, College of IT Engineering, Kyungpook National University)
Jung, Soon-Ki (School of Computer Science and Engineering, College of IT Engineering, Kyungpook National University)
Publication Information
Journal of the Korea Computer Graphics Society / v.17, no.3, 2011 , pp. 21-31 More about this Journal
Abstract
This paper presents a practical method to estimate the directions of light sources in real environment, using a mirror sphere placed on a set of known natural features in augmented reality. For the stable result of static lighting, we take the multiple images around the sphere and estimate the principal light directions of the vector clusters for each light source in realtime. We also estimate the moving illuminant for changes of the scene illumination, and augment the virtual objects onto the real image with the proper highlighting and shadows. The proposed method of this paper can be applied to augmented reality visualization without any previous information respecting the environmental illuminations.
Keywords
Augmented Reality; Multiple Illuminant; Virtual Lighting;
Citations & Related Records
연도 인용수 순위
  • Reference
1 F. N athan, "A survey of light source detection methods," Mini-Project for CMPUT 603, (Online-published), 2003.
2 Q. H. Jin-tao Ma, Ya Zhou and Y Zhang, "Marker cube and probe sphere based illuminant detection algorithm," in Int. Symp. Photoelectronic Detection and Imaging, 2007.
3 ARToolKit, HIT Lab. [Online]. Available: http://www.hitl.washington.edu/artoolkit/
4 S. Lee and S. K. Jung, "Estimation of illuminants for plausible lighting in augmented reality," in Int. Symp. on Ubiquitous Virtual Reality (ISUVR '11), 2011.
5 D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vision, vol. 60, pp. 91-110, November 2004.
6 R. I. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, 2nd ed. Cambridge University Press, ISBN: 0521540518, 2004.
7 이석준, 장재석, and 정순기, "동영상 프레임간의 상호일관성을 이용한 단일 카메라 자세 안정화 기법," in 한국HCI학회 학술대회(HCI'11), 2011.
8 M. Kanbara and N. Yokoya, "Real-time estimation of light source environment for photorealistic augmented reality," in 17th Int. Conf. on Pattern Recognition (ICPR '04), ser. ICPR '04, vol. 2. Washington, DC, USA: IEEE Computer Society, 2004, pp. 911-914. [Online]. Available: http://dx.doi.org/10.1109/ICPR.2004.735
9 M. H. Peter Supan, Ines Stuppacher, "Image based shadowing in real-time augmented reality," Virtual Reality, vol. 5, pp. 1-7, 2006.
10 M. Knecht, C. Traxler, O. Mattausch, W. Purgathofer, and M. Wimmer, "Differential instant radiosity for mixed reality," in Proc. 9th IEEE Int. Symp. on Mixed and Augmented Reality (ISMAR '10), 2010.
11 M. Hailer, S. Drab, and W. Hartmann, "A real-time shadow approach for an augmented reality application using shadow volumes," in Proc. the ACM Symp. on Virtual Reality Software and Technology, ser. VRST '03. New York, NY, USA: ACM, 2003, pp. 56-65.
12 M. N. Claus B. Madsen, "Towards probe-less augmented reality," in Int. Con! on Graphics Theory and Applications(GRAPP), 2008, pp. 255-261.
13 J. M. Frahm, K. Koeser, D. Grest, and R. Koch, "Markerless augmented reality with light source estimation for direct illumination," in Conf. on Visual Media Production CVMP, 2005.
14 Y. Zhang and Y.-H. Yang, "Multiple illuminant direction detection with application to image synthesis," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 23, pp. 915-920, August 2001.   DOI   ScienceOn
15 Y. Feng, "Estimation of light source environment for illumination consistency of augmented reality," in Proc. the 2008 Congress on Image and Signal Processing, vol. 3. IEEE Computer Society, 2008, pp. 771-775.
16 M. Aittala, "Inverse lighting and photorealistic rendering for augmented reality," Visual Computer, vol. 26, pp. 669-678, June 2010.   DOI   ScienceOn
17 P. Debevec, "Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography," in Proc. the 25th Annual Conference on Computer Graphics and Interactive Techniques, ser. SIGGRAPH '98. ACM, 1998, pp. 189-198.
18 T. Okatani and K. Deguchi, "Estimation of illumination distribution using a specular sphere," in Proc. 15th Int. Conf. on Pattern Recognition, vol. 3, 2000, pp. 592 -595 vol.3.