Browse > Article
http://dx.doi.org/10.5392/JKCA.2021.21.01.147

Reconstruction Of Photo-Realistic 3D Assets For Actual Objects Combining Photogrammetry And Computer Graphics  

Yan, Yong (중앙대학교 첨단영상대학원)
Publication Information
The Journal of the Korea Contents Association / v.21, no.1, 2021 , pp. 147-161 More about this Journal
Abstract
Through photogrammetry techniques, what current researches can achieve at present is rough 3D mesh and color map of objects, rather than usable photo-realistic 3D assets. This research aims to propose a new method to create photo-realistic 3D assets that can be used in the field of visualization applications. The new method combines photogrammetry with computer graphics modeling. Through the description of the production process of three objects in the real world - "Bullet Box", "Gun" and "Metal Beverage Bottle," it introduces in details the concept, functions, operating skills and software packages used in the steps including the photograph object, white balance, reconstruction, cleanup reconstruction, retopology, UV unwrapping, projection, texture baking, De-Lighting and Create Material Maps. In order to increase the flexibility of the method, alternatives to the software packages are also recommended for each step. In this research, 3D assets are produced that are accurate in shape, correct in color, easy to render and can be physically interacted with dynamic lighting in texture. The new method can obtain more realistic visual effects at a faster speed. It does not require large-scale teams, expensive equipment and software packages, therefore it is suitable for small studios and independent artists and educational institutions.
Keywords
Reconstruction Of Photo-Realistic 3D Assets; Photogrammetry; De-Lighting; White Balance;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Yamafune Kotaro, Using Computer Vision Photogrammetry (Agisoft PhotoScan) to Record and Analyze Underwater Shipwreck Sites, PhD Thesis, Texas A&M University, 2016.
2 Timothy J. Orr, Jennica L. Bellanca, Jason Navoyski, Brendan Macdonald, William Helfrich, and Brendan Demich, "Development of Visual Elements for Accurate Simulation," International Conference on Applied Human Factors and Ergonomics, pp.287-299, 2019.
3 Geert J. Verhoeven, "Computer Graphics Meets Image Fusion : The Power of Texture Baking to Simultaneously Visualise 3D Surface Features and Colour," ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol.IV-2/W2, pp.295-302, 2017.   DOI
4 Eric Patterson, Jessica Baron, and Devin Simpson, "Landmark-Based Re-topology of Stereo-Pair Acquired Face Meshes," ICCVG 2018, LNCS, Vol.11114, pp.425-437, 2018.
5 Christopher Dostal and Kotaro Yamafune, "Photogrammetric Texture Mapping: A Method for Increasing the Fidelity of 3D Models of Cultural Heritage Materials," Journal of Archaeological Science: Reports, Vol.18, pp.430-436, 2018.   DOI
6 Elena Ippoliti and Michele Calvano, "Enhancing the Cultural Heritage Between Visual Technologies and Virtual Restoration: Case Studies to Models for Visual Communication," Digital Curation: Breakthroughs in Research and Practice, pp.309-348, 2019.
7 De-Lighting in Unity, https://github.com/Unity-Technologies/DeLightingTool/blob/master/Assets/DeLightingTool/Documentation/De-LightingTool.pdf, 2020.8.1.
8 Matt Pharr, Wenzel Jakob, and Greg Humphreys, Physically Based Rendering, From Theory to Implementation, Morgan Kaufmann, 2016.
9 Stephen Se and Piotr Jasiobedzki, "Photo-Realistic 3D Model Reconstruction," Proceedings 2006 IEEE International Conference on Robotics and Automation, pp.3076-3082, 2006.
10 Eugene Hsu, Tom Mertens, Sylvain Paris, Shai Avidan, and Fredo Durand, "Light Mixture Estimation for Spatially Varying White Balance," ACM SIGGRAPH 2008 Papers, No.70, pp.1-7, 2008.
11 A Digital Workflow for Raw Processing Part Three: White Balance, https://www.adobe.com/digitalimag/pdfs/ps_workflow_sec3.pdf, 2020.8.4.
12 Martin Evening, Adobe Photoshop CC for Photographers, Focal Press, 2013.
13 Unity Photogrammetry Workflow, https://unity3d.com/files/solutions/photogrammetry/Unity-Photogrammetry-Workflow_2017-07_v2.pdf, 020.7.20.
14 Shaun Foster, David Halbstein, Integrating 3D Modeling, Photogrammetry and Design, Springer-Verlag London, 2014.
15 P. Jasmine Katatikarn and Michael Tanzillo, Lighting for Animation A The Art of Visual Storytelling, Focal Press, 2016.
16 Dirk Hähnel, Wolfram Burgard, and Sebastian Thrun, "Learning Compact 3D Models of Indoor and Outdoor Environments with a Mobile Robot," Robotics and Autonomous Systems, Vol.44, No.1, pp.15-27, 2003.   DOI
17 Diego Ortin and Fabio Remondino, "Occlusion-Free Image Generation for Realistic Texture Mapping," International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol.XXXVI(5/W17), 2005.
18 박재민, "포토그래메트리 기술을 이용한 정원 3D 모델링 구현," 청주대학교산업과학연구소, 제37권, 제2호, pp.1-9, 2020.
19 이준상, 이임건, "드론 촬영 기반 사진 스캐닝 기술을 활용한 3D 모델링데이터 생성방법에 관한 연구," 한국정보통신학회, 제22권, 제6호, pp.874-880, 2018.   DOI
20 전지혜, 임현규, 김찬우, "객체관찰 시점을 위한 사진 측량 기술 기반의 동적 3D 모델링 연구," 한국통신학회, 제36권, 제12호, pp.38-44, 2019.
21 Joel Ryan, "Photogrammetry for 3D Content Development in Serious Games and Simulations," MODSIM: San Francisco, CA, USA, No.13, pp.1-9, 2019.
22 Brian L. Murph and Robert D. Morrison, Introduction to Environmental Forensics, Academic Press, 2014.
23 Ami Chopine, 3D Art Essentials: The Fundamentals of 3D Modeling, Texturing, and Animation, Focal Press, 2011.
24 James S. Aber, Irene Marzolff, and Johannes Ries, Small-Format Aerial Photography: Principles, Techniques and Geoscience Applications, Elsevier Science, 2010.
25 Statham Nataska, "Use of Photogrammetry in Video Games:A Historical Overview," Games and Culture, Vol.15, No.3, pp.289-307, 2020.   DOI
26 Roger Grosse, M. K. Johnson, Edward H. Adelson, and William T. Freeman, "Ground Truth Dataset and Baseline Evaluations for Intrinsic Image Algorithms," 2009 IEEE 12th International Conference on Computer Vision, pp.2335-2342, 2009.