Browse > Article
http://dx.doi.org/10.5909/JBE.2021.26.3.258

A Progressive Rendering Method to Enhance the Resolution of Point Cloud Contents  

Lee, Heejea (Department of Computer Science, Hanyang University)
Yun, Junyoung (Department of Computer Science, Hanyang University)
Kim, Jongwook (Department of Computer Science, Hanyang University)
Kim, Chanhee (Department of Computer Science, Hanyang University)
Park, Jong-Il (Department of Computer Science, Hanyang University)
Publication Information
Journal of Broadcast Engineering / v.26, no.3, 2021 , pp. 258-268 More about this Journal
Abstract
Point cloud content is immersive content that represents real-world objects with three-dimensional (3D) points. In the process of acquiring point cloud data or encoding and decoding point cloud data, the resolution of point cloud content could be degraded. In this paper, we propose a method of progressively enhancing the resolution of sequential point cloud contents through inter-frame registration. To register a point cloud, the iterative closest point (ICP) algorithm is commonly used. Existing ICP algorithms can transform rigid bodies, but there is a disadvantage that transformation is not possible for non-rigid bodies having motion vectors in different directions locally, such as point cloud content. We overcome the limitations of the existing ICP-based method by registering regions with motion vectors in different directions locally between the point cloud content of the current frame and the previous frame. In this manner, the resolution of the point cloud content with geometric movement is enhanced through the process of registering points between frames. We provide four different point cloud content that has been enhanced with our method in the experiment.
Keywords
point cloud; rendering; deformable registration; progressive;
Citations & Related Records
연도 인용수 순위
  • Reference
1 CARDANI, Darrin. Adventures in hsv space. Laboratorio de Robotica, Instituto Tecnologico Autonomo de Mexico, 2001.
2 H.Lee, J.Yun, J.Kim, J.Park, "ICP based Point Cloud Contents Quality Improvement Method," The Korean Institute of Broadcast and Media Engineers, p. 200-201, 2020.
3 Rusinkiewicz, Szymon; Marc Levoy (2001). Efficient Variants of the ICP Algorithm. Proceedings Third International Conference on 3-D Digital Imaging and Modeling. Quebec City, Quebec, Canada. pp. 145-152. doi:10.1109/IM.2001.924423.   DOI
4 Pomerleau, Francois; Colas, Francis; Siegwart, Roland (2015). "A Review of Point Cloud Registration Algorithms for Mobile Robotics". Foundations and Trends in Robotics. 4 (1): 1-104. CiteSeerX 10.1.1.709.2212. doi:10.1561/2300000035.   DOI
5 LOW, Kok-Lim. Linear least-squares optimization for point-to-plane icp surface registration. Chapel Hill, University of North Carolina, 2004, 4.10: 1-3.
6 AOKI, Yasuhiro, et al. Pointnetlk: Robust & efficient point cloud registration using pointnet. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, p. 7163-7172, 2019.
7 SEGAL, Aleksandr; HAEHNEL, Dirk; THRUN, Sebastian. Generalized-icp. In: Robotics: science and systems. p. 435. 2009
8 Francois Pomerleau, Francis Colas, Roland Siegwart, and Stephane Magnenat. Comparing ICP Variants on Real-World Data Sets. In Autonomous Robots, 34(3), pages 133-148, April 2013.   DOI
9 MEN, Hao; GEBRE, Biruk; POCHIRAJU, Kishore. Color point cloud registration with 4D ICP algorithm. In: 2011 IEEE International Conference on Robotics and Automation. IEEE, p. 1511-1516, 2011.
10 Holz, Dirk; Ichim, Alexandru E.; Tombari, Federico; Rusu, Radu B.; Behnke, Sven (2015). "Registration with the Point Cloud Library: A Modular Framework for Aligning in 3-D". IEEE Robotics Automation Magazine. 22 (4): 110-124.   DOI
11 SCHUETZ, Markus; WIMMER, Michael. Progressive real-time rendering of unprocessed point clouds. In: ACM SIGGRAPH 2018 Posters, p. 1-2, 2018.
12 HE, Jun; YAO, Xin. Drift analysis and average time complexity of evolutionary algorithms. Artificial intelligence, 127.1: 57-85, 2001.   DOI
13 ZWICKER, Matthias, et al. EWA splatting. IEEE Transactions on Visualization and Computer Graphics, 8.3: 223-238, 2002.   DOI
14 WU, Huikai; ZHANG, Junge; HUANG, Kaiqi. Point cloud super resolution with adversarial residual graph networks. arXiv preprint arXiv:1908.02111, 2019.
15 PUNET, Xavier, et al. Enhanced cell-material interactions through the biofunctionalization of polymeric surfaces with engineered peptides. Biomacromolecules, 14.8: 2690-2702, 2013.   DOI
16 ZHANG, Zhiyuan; DAI, Yuchao; SUN, Jiadai. Deep learning based point cloud registration: an overview. Virtual Reality & Intelligent Hardware, 2.3: 222-246, 2020.   DOI
17 POMERLEAU, Francois, et al. Challenging data sets for point cloud registration algorithms. The International Journal of Robotics Research, 31.14: 1705-1711, 2012.   DOI
18 YU, Lequan, et al. Pu-net: Point cloud upsampling network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, p. 2790-2799, 2018.
19 HOUSHIAR, Hamidreza; NuCHTER, Andreas. 3D point cloud compression using conventional image compression for efficient data transmission. In: 2015 XXV International Conference on Information, Communication and Automation Technologies (ICAT). IEEE, p. 1-8, 2015.
20 MIAO, Yongwei; PAJAROLA, Renato; FENG, Jieqing. Curvature-aware adaptive re-sampling for point-sampled geometry. Computer-Aided Design, 2009, 41.6: 395-403, 2009.   DOI
21 SHI, Shaoshuai; WANG, Xiaogang; LI, Hongsheng. Pointrcnn: 3d object proposal generation and detection from point cloud. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, p. 770-779, 2019.
22 Call for Proposals for Point Cloud Compression v2, Standard ISO/IECJTC1/SC29/WG11 MPEG2017/N16763, Hobart, AU, Apr. 2017.
23 RHYU, Sungryeul, et al. Contextual Homogeneity-Based Patch Decomposition Method for Higher Point Cloud Compression. IEEE Access, 8: 207805-207812, 2020.   DOI
24 RUSINKIEWICZ, Szymon; LEVOY, Marc. Efficient variants of the ICP algorithm. In: Proceedings third international conference on 3-D digital imaging and modeling. IEEE, p. 145-152, 2001.
25 MIELEKAMP, Pieter Maria; HOMAN, Robert Johannes Frederik. Visualization of 3D images in combination with 2D projection images. U.S. Patent No 7,991,105, 2011.
26 D. B. Payne and J. R. Stern, "Wavelength-switched passively coupled single-mode optical network," in Proc. IOOC-ECOC, Boston, MA, USA, pp. 585-590, 1985.
27 SARAVANAN, G.; YAMUNA, G.; NANDHINI, S. Real time implementation of RGB to HSV/HSI/HSL and its reverse color space models. In: 2016 International Conference on Communication and Signal Processing (ICCSP). IEEE, p. 0462-0466, 2016.
28 Zhang, Zhengyou (1994). "Iterative point matching for registration of free-form curves and surfaces". International Journal of Computer Vision. 13 (12): 119-152.   DOI
29 BHAYANI, Sam B.; ANDRIOLE, Gerald L. Three-dimensional (3D) vision: does it improve laparoscopic skills? An assessment of a 3D head-mounted visualization system. Reviews in urology, 7.4: 211, 2005.
30 MITRA, Niloy J., et al. Registration of point cloud data from a geometric optimization perspective. In: Proceedings of the 2004 Eurographics/ACM SIGGRAPH symposium on Geometry processing, p. 22-31, 2004.
31 Arun, Somani; Thomas S. Huang; Steven D. Blostein (1987). "Least-square fitting of two 3-D point sets". IEEE Pattern Analysis and Machine Intelligence, 1987
32 Chen, Yang; Gerard Medioni (1991). "Object modelling by registration of multiple range images". Image Vision Computing. 10(3): 145-155. doi:10.1016/0262-8856(92)90066-C.   DOI
33 Besl, Paul J.; N.D. McKay (1992). "A Method for Registration of 3-D Shapes". IEEE Transactions on Pattern Analysis and Machine Intelligence. 14 (2): 239-256. doi:10.1109/34.121791.   DOI