Browse > Article
http://dx.doi.org/10.6109/jkiice.2012.16.8.1642

Generation of an eye-contacted view using color and depth cameras  

Hyun, Jee-Ho (광운대학교 전자공학과)
Han, Jae-Young (광운대학교 전자공학과)
Won, Jong-Pil (LG전자기술원 연구원)
Yoo, Ji-Sang (광운대학교 전자공학과)
Publication Information
Journal of the Korea Institute of Information and Communication Engineering / v.16, no.8, 2012 , pp. 1642-1652 More about this Journal
Abstract
Generally, a camera isn't located at the center of display in a tele-presence system and it causes an incorrect eye contact between speakers which reduce the realistic feeling during the conversation. To solve this incorrect eye contact problem, we newly propose an intermediate view reconstruction algorithm using both a color camera and a depth camera and applying for the depth image based rendering (DIBR) algorithm. In the proposed algorithm, an efficient hole filling method using the arithmetic mean value of neighbor pixels and an efficient boundary noise removal method by expanding the edge region of depth image are included. We show that the generated eye-contacted image has good quality through experiments.
Keywords
Eye-contacted; DIBR; depth camera; depth; tele-presence; hole filling;
Citations & Related Records
Times Cited By KSCI : 3  (Citation Analysis)
연도 인용수 순위
1 Z. Zhang, "A flexible new technique for camera calibration," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.22, pp.1330-1334, Nov. 2000.   DOI   ScienceOn
2 Z. Zhang, "Camera calibration with one-dimensional objects," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.26, pp.892-899, July 2004.   DOI   ScienceOn
3 P. F. Sturm and S. J. Maybank, "On plane-based camera calibration: A general algorithm, singularities, applications," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.1, June 1999.
4 현지호, 한재영, 유지상, "이종 카메라를 이용한 eye-contacted 영상 생성 기법," 한국방송공학회추계학술대회, 2011.
5 A. Telea, "An image inpainting technique based on the fast marching method," Journal of Graphics Tools, vol.9, pp.25-36, 2004.
6 ITU-R Recommendation BT.500-11, Methodology for subjective assessment of the quality of television picture, Mar. 2011.
7 서용석, 유지상, "영상 분할을 이용한 다이내믹 프로그래밍 기반의 스테레오 정합," 한국통신학회 논문지, 제35권, 제8호, pp.680-688, 2010.   과학기술학회마을
8 김태준, 유지상, "영상의 컬러 정보를 이용한 계층적 스테레오 정합," 한국통신학회 논문지, 제34 권, 제3호, pp.279-287, 2009.   과학기술학회마을
9 최미남, 윤정환, 유지상, "다시점 동영상의 중간 시점영상 생성을 위한 변이 예측 기법," 한국방송공학회 논문지, 제13권, 제6호, pp.915-929, 2008.
10 김태준, 장은영, 허남호, 김진웅, 유지상, "다시점 카메라 모델의 기하학적 특성을 이용한 가상시점 영상 생성 기법," 한국통신학회 논문지, 제34권, 제12호, pp.1154-1166, 2009.
11 O. Faugeras, Three-Dimensional Computer Vision: a Geometric Viewpoint, MIT Press, 1993.
12 A. Kolb, E. Barth, R. Koch, and R. Larsen, "Time-of-flight sensors in computer graphics," Eurographics State of the Art Reports, vol.1, Mar. 2009.
13 R. Keys, "Cubic convolution interpolation for digital image processing," IEEE Transactions on Acoustics, Speech and Signal Processing, vol.29, pp.1153-1160, Dec. 1981.   DOI
14 J. Canny, "A computational approach to edge detection," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.6, pp.679-698, Nov. 1986.
15 H. R. Bakken, G. B. Eilertsen, U. G. Matus, and H. J. Nilsen, "Semi-automatic camera calibration using coplanar control points," Proceedings of NIK, 2009.
16 T. Svoboda, D. Martinec, and T. Pajdla, "A convenient multi camera self-calibration for virtual environments," Presence: Teleoperators & Virtual Environments, vol.14, pp.407-422, Aug. 2005.   DOI   ScienceOn
17 Y. J. Bouguet, "Camera calibration toolbox for matlab," Computational Vision at CALTECH, 2010.
18 R. Stokes, "Human factors and appearance design considerations of the mod II PICTUREPHONE(R) station set," IEEE Transactions on Communication Technology, vol.17, pp.318-323, Apr. 1969.   DOI   ScienceOn
19 M. N. Do, Q. H. Nguyen, H. T. Nguyen, D. Kubacki, and S. J. Patel, "Immersive visual communication," IEEE Signal Processing Magazine, vol.28, pp.58-66, Jan. 2011.   DOI   ScienceOn
20 M. Tanimoto, M. P. Tehrani, T. Fujii, and T. Yendo, "Free-viewpoint TV," IEEE Signal Processing Magazine, vol.28, pp.67-76, Jan. 2011.   DOI   ScienceOn
21 F. Solina, and R. Ravnik, "Fixing missing eye-contact in video conferencing systems," ITI 2011 33rd International Conference on, pp.233-236, June 2011.
22 Y. Mori, N. Fukushima, T. Yendo, T. Fujii, and M. Tanimoto, "View generation with 3D warping using depth information for FTV," Signal Processing: Image Communication, vol.24, pp.65-72, Jan. 2009.   DOI   ScienceOn
23 Q. H. Nguyen, M. N. Do, and S. J. Patel, "Depth image-based rendering from multiple cameras with 3D propagation algorithm," Proceedings of the 2nd International Conference on Immersive Telecommunications, pp.1-6, May 2009.