The Robust Augmented Reality System in The Rapid change of Brightness Using The Histogram Specification and Kalman Filter

히스토그램 명세화와 칼만 필터를 이용한 급격한 밝기 변화에 강건한 증강현실 시스템

  • Kim, Kee-Baek (Dept. of Image Engineering, Graduate School, of Advanced Image Science, Multimedia, and film, Chung-Ang University) ;
  • Lee, Seok-Han (Dept. of Image Engineering, Graduate School, of Advanced Image Science, Multimedia, and film, Chung-Ang University) ;
  • Choi, Jong-Soo (Dept. of Image Engineering, Graduate School, of Advanced Image Science, Multimedia, and film, Chung-Ang University)
  • 김기백 (중앙대학교 첨단영상대학원 영상학과) ;
  • 이석한 (중앙대학교 첨단영상대학원 영상학과) ;
  • 최종수 (중앙대학교 첨단영상대학원 영상학과)
  • Received : 2010.06.04
  • Accepted : 2010.10.10
  • Published : 2011.03.25

Abstract

In this paper, we propose the algorithm for the AR(Augmented Reality) system, which is robust to the brightness change of light. In the proposed method, the histogram specification is achieved using the sample histogram, obtained from the frames in which the target objects could be detected successful. And When the object key-points couldn't be detected by the displacement of camera positions, the positions of non-detected key-points ware estimated using the linear KF(Kalman Filter). When the proposed algorithm is applied in the AR systems, the object key-points can be detected three times as much as the existing others. In addition, to prove the more efficiency of the proposed algorithm, we implemented the AR game, and could know that the performance is the more advanced than the others. The proposed algorithm can be used for the AR environments, which high efficiency is required such as the AR game, or the implementation of AR systems which are robust to the change of lights, etc.

본 논문은 조명 밝기 변화에 강건한 증강현실 시스템을 구현하기 위한 알고리즘을 제안한다. 본 논문에서 제안하는 방법은 미리 객체를 검출한 프레임으로부터 최적의 표본 밝기를 구해 모델링 한 후, 이를 이용하여 히스토그램 명세화를 수행한다. 또한 카메라 변위에 따라 유실된 객체의 특징 정보는 선형 칼만 필터로 추적하였다. 제안된 방법을 사용하였을 때 기존의 방법보다 약 3배 이상 객체 검출률이 향상되었으며, 객체 검출에 실패한 프레임 또한 선형 칼만 필터를 통해 위치 정보를 매우 정확하게 예측할 수 있었다. 본 알고리즘의 효율성을 증명하기 위해 실제 증강 현실을 이용한 게임 시스템에 적용한 결과 기존의 다른 방법보다 성능이 향상됨을 확인 할 수 있었다. 본 알고리즘은 게임 환경이나, 조명 변화가 심한 환경에서도 강건한 증강 현실 시스템의 구현에 적용될 것이라 판단된다.

Keywords

References

  1. Ronald T.Azuma, "Recent Advances in Augmented Reality", IEEE Computer Graphic and Applications, pp34-47, 2001
  2. Yan Feng, "Estimation of Light Source Environment for Illumination Consistency of Augmented Reality", Congress on Image and Signal Processing 2008, 771-775, 2008.
  3. Kusuma Agusanto, Li Li, Zhu Chuangui, Ng Wan Sing, "Photorealistic rendering for augmented reality using environment illumination",the second IEEE and ACM International Symposium Mixed and Augmented Reality, 208-216, 2003.
  4. Coltuc, D., Bolon, P, Chassery, J.-M., "Exact histogram specification ", IEEE Transcation on Image Processing, vol 15, issue 5, 1143-1152, 2006. https://doi.org/10.1109/TIP.2005.864170
  5. D. Leibowitz, A. Criminisi, and A. Zisserman, "Creating Architectural Models from Images," Proc. EuroGraphics'99 vol.18, No.3, Sep. 1999.
  6. A. Criminisi, I. Reid, and A. Zisserman, "Single View Metrology," Int'l J. Computer Vision, vol. 40, no. 2, pp. 123-148, 2000. https://doi.org/10.1023/A:1026598000963
  7. O. Faugeras, "Three-Dimensional Computer Vision, " The MIT Press, 1993.
  8. R. Hartley and A. Zisserman, "Multiple View Geometry in Computer Vision," Cambridge Univ. Press, 2003.
  9. G. Golub and C. Loan, "Matrix Computations: 3rd ed.," Johns Hopkins Univ. Press, 1996.
  10. Z. Zhang, "Flexible New Technique for Camera Calibration," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 1330-1334, Nov. 2000.
  11. 이석한, 최종수, "단일 카메라를 이용한 보행자의 높이 및 위치추적 기법," 대한전자공학회논문지, 45권 SC편 제 3호, p20-p31, May 2008년.
  12. B.K.P. Horn, B.G. Schunk. "Determining Optical Flow". Artificial Intelligence. 17:185-203, 1979.
  13. B.K.P. Horn, B.G. Schunk. "Determining Optical Flow": a retrospective. Artificial Intelligence. 59:81-87, (1993). https://doi.org/10.1016/0004-3702(93)90173-9
  14. Chi, Y.M., Tran, T.D., Etienne-Cummings, R.,"Optical Flow Approximation of Sub-Pixel Accurate Block Matching for Video Coding", IEEE International Conference on Acoustics, Speech and Signal Processing, 1017-1020, 2007.
  15. Bouguet, J.-Y. "Pyramidal Implementation of the Lucas Kanade Feature Tracker Description of the algorithm", Intel Corporation Microprocessor Research Labs, 2000.
  16. J.L.Barron, N.A.Thacker, "Computing 2D and 3D Optical Flow", Tina-Vision, 2005.
  17. Brown, R. G. and P. Y. C. Hwang. 1992. Introduction to Random Signals and Applied Kalman Filtering, Second Edition, John Wiley & Sons, Inc.
  18. Kalman, R. E., "A New Approach toLinear Filtering and Prediction Problems," Transaction of the ASME-Journal of Basic Engineering, pp. 35-45 ,March 1960.
  19. J. Gomez, G. Simon, and M. Berger, "Calibration Errors in Augmented Reality: a Practical Study," Proc. IEEE and ACM Int'l Symposium on Mixed and Augmented Reality, pp. 154-163, June. 2005.
  20. 박형민, 이재영, 이석한, 최종수, "반 깜박임 선택을 이용한 응시 상호작용과 AR시스템," 대한전자공학회논문지, 46권 SP편 제 5호, p91-p100, SEP 2009년.Processing, pp. 2529-2532, Munich, Germany, May 1997.