Browse > Article
http://dx.doi.org/10.7236/IJASC.2020.9.3.192

Object Detection with LiDAR Point Cloud and RGBD Synthesis Using GNN  

Jung, Tae-Won (Department of Realistic Convergence Contents KwangWoon University Graduate School)
Jeong, Chi-Seo (Department of Information System KwangWoon University Graduate School)
Lee, Jong-Yong (Ingenium College of liberal arts, Kwangwoon University)
Jung, Kye-Dong (Ingenium College of liberal arts, Kwangwoon University)
Publication Information
International journal of advanced smart convergence / v.9, no.3, 2020 , pp. 192-198 More about this Journal
Abstract
The 3D point cloud is a key technology of object detection for virtual reality and augmented reality. In order to apply various areas of object detection, it is necessary to obtain 3D information and even color information more easily. In general, to generate a 3D point cloud, it is acquired using an expensive scanner device. However, 3D and characteristic information such as RGB and depth can be easily obtained in a mobile device. GNN (Graph Neural Network) can be used for object detection based on these characteristics. In this paper, we have generated RGB and RGBD by detecting basic information and characteristic information from the KITTI dataset, which is often used in 3D point cloud object detection. We have generated RGB-GNN with i-GNN, which is the most widely used LiDAR characteristic information, and color information characteristics that can be obtained from mobile devices. We compared and analyzed object detection accuracy using RGBD-GNN, which characterizes color and depth information.
Keywords
3D Point Cloud; Graph Neural Network; RGBD; LiDAR intensity; Depth camera;
Citations & Related Records
Times Cited By KSCI : 7  (Citation Analysis)
연도 인용수 순위
1 Budiman, Sutanto Edward; Lee, Suk-Ho. Virtual Reality Image Shooting for Single Person Broadcasting with Multiple Smartphones. International Journal of Internet, Broadcasting and Communication, 2019, 11.2: 43-49. DOI: https://doi.org/10.7236/IJIBC.2019.11.2.43   DOI
2 Yi, Chuho; Cho, Jungwon. A Real-time Plane Estimation in Virtual Reality Using a RGB-D Camera in Indoors. Journal of Digital Convergence, 2016, 14.11: 319-324. DOI: https://doi.org/10.14400/JDC.2016.14.11.319   DOI
3 Kim, Jinsoo; Cho, Jungho. YOLO-based real-time object detection through RGB image and LiDAR point cloud synthesis. Journal of the Korean Society of Information Technology, 2019, 17.8: 93-105. DOI: https://doi.org/10.14801/jkiit.2019.17.8.93
4 Kim, J.; Kwon, K. K.; Lee, Su In. Trends and applications on LiDAR sensor technology. Electronics and Telecommunications Trends, 2012, 27.6: 134-143.
5 Premebida, Cristiano, et al. High-resolution lidar-based depth mapping using bilateral filter. In: 2016 IEEE 19th international conference on intelligent transportation systems (ITSC). IEEE, 2016. p. 2469-2474. DOI: https://doi.org/10.1109/ITSC.2016.7795953
6 Robinson, Rod, et al. Infrared differential absorption Lidar (DIAL) measurements of hydrocarbon emissions. Journal of environmental monitoring, 2011, 13.8: 2213-2220. DOI: https://doi.org/10.1039/c0em00312c   DOI
7 Scarselli, Franco, et al. The graph neural network model. IEEE Transactions on Neural Networks, 2008, 20.1: 61- 80. DOI: https://doi.org/10.1109/TNN.2008.2005605   DOI
8 Teney, Damien; Liu, Lingqiao; Van Den Hengel, Anton. Graph-structured representations for visual question answering. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2017. p. 1-9. DOI: https://doi.org/10.1109/CVPR.2017.344
9 Shi, Weijing; Rajkumar, Raj. Point-gnn: Graph neural network for 3d object detection in a point cloud. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2020. p. 1711-1719.
10 Kwon, Soon Chul, et al. A Study on Depth Information Acquisition Improved by Gradual Pixel Bundling Method at TOF Image Sensor. International Journal of Internet, Broadcasting and Communication, 2015, 7.1: 15-19. DOI: https://doi.org/10.7236/IJIBC.2015.7.1.15   DOI
11 A project of Karlsruhe Institute of Technology and Toyota Technological Institute at Chicago, "The KITTI Vision Benchmark Suite", http://www.cvlibs.net/datasets/kitti/
12 Kim, Jeong-Hwan; Shin, Yong-Hyeon. A Study on Deep Learning-based Pedestrian Detection and Alarm System. The Journal of The Korea Institute of Intelligent Transport Systems, 2019, 18.4: 58-70. DOI: https://doi.org/10.12815/kits.2019.18.4.58