Browse > Article
http://dx.doi.org/10.6109/jkiice.2021.25.5.637

A method of improving the quality of 3D images acquired from RGB-depth camera  

Park, Byung-Seo (Department of Electronic Materials Engineering, Kwangwoon University)
Kim, Dong-Wook (Department of Electronic Materials Engineering, Kwangwoon University)
Seo, Young-Ho (Department of Electronic Materials Engineering, Kwangwoon University)
Publication Information
Journal of the Korea Institute of Information and Communication Engineering / v.25, no.5, 2021 , pp. 637-644 More about this Journal
Abstract
In general, in the fields of computer vision, robotics, and augmented reality, the importance of 3D space and 3D object detection and recognition technology has emerged. In particular, since it is possible to acquire RGB images and depth images in real time through an image sensor using Microsoft Kinect method, many changes have been made to object detection, tracking and recognition studies. In this paper, we propose a method to improve the quality of 3D reconstructed images by processing images acquired through a depth-based (RGB-Depth) camera on a multi-view camera system. In this paper, a method of removing noise outside an object by applying a mask acquired from a color image and a method of applying a combined filtering operation to obtain the difference in depth information between pixels inside the object is proposed. Through each experiment result, it was confirmed that the proposed method can effectively remove noise and improve the quality of 3D reconstructed image.
Keywords
RGB-Depth camera; Pointcloud; Volumetric; Depth enhancement;
Citations & Related Records
연도 인용수 순위
  • Reference
1 R. Schafer, P. Kauff, R. Skupin, Y. Sanchez, and C. Weissig, "Interactive Steaming of Panoramas and VR Worlds," in SMPTE Motion Imaging Journal, vol. 126, no. 1, pp. 35-42, Jan. 2017.   DOI
2 Z. Zhan, G. Zhou, and X. Yang, "A Method of Hierarchical Image Retrieval for Real-Time Photogrammetry Based on Multiple Features," in IEEE Access, vol. 8, pp. 21524-21533, 2020.   DOI
3 Photogrammetry [Internet]. Available: https://en.wikipedia.org/wiki/Photogrammetry.
4 K. Guo, P. Lincoln, P. Davidson, J. Busch, and X. Yu, "The Relightables: Volumetric Performance Capture of Humans with Realistic Relighting," ACM Transactions on Graphics, vol. 38, no. 6, pp. 1-19, Nov. 2019.
5 M. Dou, P. Davidson, S. R. Fanello, S. Khamis, A. Kowdle, C. Rhemann, V. Tankovich, and S. Izadi, "Motion2fusion: real-time volumetric performance capture," ACM Transactions on Graphics, vol. 35, no. 4, pp. 1-16, Jul. 2016.
6 M. Dou, S. Khamis, Y. Degtyarev, P. Davidson, S. R. Fanello, A. Kowdle, S. O. Escolano, C. Rhemann, D. Kim, J. Taylor, P. Kohli, V. Tankovich, and S. Izadi, "Fusion4D: real-time performance capture of challenging scenes," ACM Transactions on Graphics, vol. 36, no. 6, pp. 1-13, Nov. 2017.
7 Open Source Computer Vision. Detection of ChArUco Corners [Internet]. Available: https://docs.opencv.org/3.4/df/d4a/tutorial_charuco_detection.html.
8 Open Source Computer Vision, Calibration with ArUco and ChArUco [Internet]. Available: https://docs.opencv.org/master/da/d13/tutorial_aruco_calibration.html.
9 P. Rathnayaka, S. Baek, and S. Park, "Calibration of a Different Field-of-view Stereo Camera System using an Embedded Checker- board Pattern," International Conference on Computer Vision Theory and Applications, pp. 294-300, 2017.
10 K. Kim, B. Park, J. Kim, D. Kim, and Y. Seo, "Holographic augmented reality based on three-dimensional volumetric imaging for a photorealistic scene," Optics Express, vol. 28, pp. 35972-35985, 2020.   DOI
11 S. Ruder, "An overview of gradient descent optimization algorithms," arXiv preprint, 2016.
12 G. An, S. Lee, M. Seo, K. Yun, W. Cheong, and S. Kang, "Charuco Board-Based Omnidirectional Camera Calibration Method," in Electronics, vol. 7, no. 12, pp. 421-436, 2018.   DOI
13 G. H. An, S. Lee, M. Seo, K. Yun, W. Cheong, and S. Kang, "Charuco board-based omnidirectional camera calibration method," Electronics, vol. 7, no. 12, pp. 421, 2018.   DOI