Framework for Reconstructing 2D Data Imported from Mobile Devices into 3D Models

  • Shin, WooSung (Dankook Univ. Deparment of Electronics and Electrical Engineering) ;
  • Min, JaeEun (Dankook Univ. Deparment of Applied Computer Engineering) ;
  • Han, WooRi (Satreci) ;
  • Kim, YoungSeop (Dankook Univ. Deparment of Electronics and Electrical Engineering)
  • Received : 2021.09.09
  • Accepted : 2021.12.13
  • Published : 2021.12.31

Abstract

The 3D industry is drawing attention for its applications in various markets, including architecture, media, VR/AR, metaverse, imperial broadcast, and etc.. The current feature of the architecture we are introducing is to make 3D models more easily created and modified than conventional ones. Existing methods for generating 3D models mainly obtain values using specialized equipment such as RGB-D cameras and Lidar cameras, through which 3D models are constructed and used. This requires the purchase of equipment and allows the generated 3D model to be verified by the computer. However, our framework allows users to collect data in an easier and cheaper manner using cell phone cameras instead of specialized equipment, and uses 2D data to proceed with 3D modeling on the server and output it to cell phone application screens. This gives users a more accessible environment. In addition, in the 3D modeling process, object classification is attempted through deep learning without user intervention, and mesh and texture suitable for the object can be applied to obtain a lively 3D model. It also allows users to modify mesh and texture through requests, allowing them to obtain sophisticated 3D models.

Keywords

Acknowledgement

This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korean government (MSIP: Ministry of Science, ICT and Future Planning) (NRF-2020R1A2C 2009717).

References

  1. Guangcai Zhang, Yu Jiao, Wang Zhihao, Gao Xiuqian, He Jirong, (2020). Visual 3D Reconstruction System Based on RGBD Camera, 10.1109/ITNEC48623.2020.9085048
  2. J. Pena Qieralta, F. Yuhong, L. Salomaa, L. Qingqing, T. N. Gia, Z. Zou, H. Tenhunen, and T. Westerlund, (2019). FPGA-based Architecture for a Low-Cost 3D Lidar Design and Implementation from Multiple Rotating 2D Lidars for ROS, 10.1109/SENSORS43011.2019.8956928
  3. Qian-Yi Zhou, Jaesik Park, Vladlen Koltun Open3D: A Modern Library for 3D Data Processing
  4. Android web Viewer. Retrieved from https://developer.android.com/guide/webapps/webview