Browse > Article
http://dx.doi.org/10.5909/JBE.2021.26.6.714

Rendering Quality Improvement Method based on Depth and Inverse Warping  

Lee, Heejea (Department of Computer Science, Hanyang University)
Yun, Junyoung (Department of Computer Science, Hanyang University)
Park, Jong-Il (Department of Computer Science, Hanyang University)
Publication Information
Journal of Broadcast Engineering / v.26, no.6, 2021 , pp. 714-724 More about this Journal
Abstract
The point cloud content is immersive content recorded by acquiring points and colors corresponding to the real environment and objects having three-dimensional location information. When a point cloud content consisting of three-dimensional points having position and color information is enlarged and rendered, the gap between the points widens and an empty hole occurs. In this paper, we propose a method for improving the quality of point cloud contents through inverse transformation-based interpolation using depth information for holes by finding holes that occur due to the gap between points when expanding the point cloud. The points on the back are rendered between the holes created by the gap between the points, acting as a hindrance to applying the interpolation method. To solve this, remove the points corresponding to the back side of the point cloud. Next, a depth map at the point in time when an empty hole is generated is extracted. Finally, inverse transform is performed to extract pixels from the original data. As a result of rendering content by the proposed method, the rendering quality improved by 1.2 dB in terms of average PSNR compared to the conventional method of increasing the size to fill the blank area.
Keywords
Pointcloud; Rendering; Inverse warping;
Citations & Related Records
연도 인용수 순위
  • Reference
1 ROSENTHAL, Paul; LINSEN, Lars. Image-space point cloud rendering. In: Proceedings of Computer Graphics International. 2008. p. 136-143.
2 Schuetz, Markus, and Michael Wimmer. "Progressive realtime rendering of unprocessed point clouds." ACM SIGGRAPH 2018 Posters. 2018. 1-2.
3 Zwicker, Matthias, et al. "EWA splatting." IEEE Transactions on Visualization and Computer Graphics 8.3 (2002): 223-238.   DOI
4 Eugene d'Eon, Bob Harrison, Taos Myers, and Philip A. Chou, "8i Voxelized Full Bodies, version 2 - A Voxelized Point Cloud Dataset," ISO/IEC JTC1/SC29 Joint WG11/WG1 (MPEG/JPEG) input documentm40059/M74006, Geneva, January 2017.
5 ZWICKER, Matthias, et al. EWA splatting. IEEE Transactions on Visualization and Computer Graphics, 8.3: 223-238, 2002.   DOI
6 YU, Lequan, et al. Pu-net: Point cloud upsampling network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, p. 2790-2799, 2018.
7 SCHUETZ, Markus; WIMMER, Michael. Progressive real-time rendering of unprocessed point clouds. In: ACM SIGGRAPH 2018 Posters, p. 1-2, 2018.
8 MIELEKAMP, Pieter Maria; HOMAN, Robert Johannes Frederik. Visualization of 3D images in combination with 2D projection images. U.S. Patent No 7,991,105, 2011.
9 SCHAUFLER, Gernot; PRIGLINGER, Markus. Efficient displacement mapping by image warping. In: Eurographics Workshop on Rendering Techniques. Springer, Vienna, 1999. p. 175-186.
10 WU, Enhua; ZHENG, Xin. Composition of novel views through an efficient image warping. The Visual Computer, 2003, 19.5: 319-328.   DOI
11 HOUSHIAR, Hamidreza; NUCHTER, Andreas. 3D point cloud compression using conventional image compression for efficient data transmission. In: 2015 XXV International Conference on Information, Communication and Automation Technologies (ICAT). IEEE, p. 1-8, 2015.
12 Call for Proposals for Point Cloud Compression v2, Standard ISO/IECJTC1/SC29/WG11 MPEG2017/N16763, Hobart, AU, Apr. 2017.
13 DAVIS, Philip J. Interpolation and approximation. Courier Corporation, 1975.
14 MIAO, Yongwei; PAJAROLA, Renato; FENG, Jieqing. Curvature-aw are adaptive re-sampling for point-sampled geometry. Computer-Aided Design, 2009, 41.6: 395-403, 2009.   DOI
15 HUYNH-THU, Quan; GHANBARI, Mohammed. Scope of validity of PSNR in image/video quality assessment. Electronics letters, 2008, 44. 13: 800-801.   DOI
16 BOTSCH, Mario, et al. Polygon mesh processing. CRC press, 2010.
17 YUN, Junyoung; KIM, Jongwook; PARK, Jong-Il. Circular Splats Based Visualization for Point Cloud Contents. In: Proceedings of the Korean Society of Broadcast Engineers Conference. The Korean Institute of Broadcast and Media Engineers, 2020. p. 276-278.
18 WANG, Weidong; GRINSTEIN, Georges G. A survey of 3D solid reconstruction from 2D projection line drawings. In: Computer Graphics Forum. Edinburgh, UK: Blackwell Science Ltd, 1993. p. 137-158.
19 BHAYANI, Sam B.; ANDRIOLE, Gerald L. Three-dimensional (3D) vision: does it improve laparoscopic skills? An assessment of a 3D head-mounted visualization system. Reviews in urology, 7.4: 211, 2005.
20 D. B. Payne and J. R. Stern, "Wavelength-switched passively coupled single-mode optical network," in Proc. IOOC-ECOC, Boston, MA, USA, pp. 585-590, 1985.
21 MITRA, Niloy J., et al. Registration of point cloud data from a geometric optimization perspective. In: Proceedings of the 2004 Eurographics/ACM SIGGRAPH symposium on Geometry processing, p. 22-31, 2004.