Journal of the Korea Academia-Industrial cooperation Society (한국산학기술학회논문지)

The Korea Academia-Industrial cooperation Society (한국산학기술학회)
권호 표지
DOI QR코드

DOI QR Code

A Study on the Marker Tracking for Virtual Construction Simulation based Mixed-Reality

융합현실 기반의 가상건설 시뮬레이션을 위한 마커 추적 방식에 관한 연구

  • Received : 2018.10.01
  • Accepted : 2018.12.07
  • Published : 2018.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

The main object of this study was to find a way to operate the marker for simulating a virtual construction using a MR(mixed reality) device. The secondary object was to find a way to extract the form-data from BIM data, and to represent the virtual object by the MR device. A tiny error of scale causes large errors of length because the architectural objects are very large. The scale was affected by the way that the camera of the MR device recognizes the marker. The method of installing and operating the marker causes length errors in the virtual object in the MR system. The experimental results showed that the error factor of the Virtual object's length was 0.47%. In addition, the distance between the markers can be decided through the results of an experiment for the multi-marker tracking system. The minimum distance between markers should be more than 5 m, and the error of length was approximately 23mm. If the represented virtual object must be less than 20mm in error, the particular mark should be installed within a 5 m radius of it. Based on this research, it is expected that utilization of the MR device will increase for the application of virtual construction simulations to construction sites.

본 연구는 융합현실(MR; Mixed Reality) 장비를 이용하여 가상건설 시뮬레이션을 수행하기 위한 마커 운용방법을 알아보는 것을 목적으로 한다. 부수적으로 BIM 데이터를 이용하여 형상 데이터를 추출하고 이를 MR장비를 통하여 재현하는 프로세스를 검토하도록 한다. 건축물은 규모가 매우 큰 오브젝트이기 때문에, 축척의 오차에 따른 길이의 오차가 매우 크다. 축척은 MR 장비의 카메라가 마커를 인식하는 방법에 영향을 받는다. 따라서 마커를 설치하고 운용하는 방법에 따라 오브젝트의 오차가 달라질 수 있다. 실험결과에 따르면 MR 장비를 이용한 가상 건설 시뮬레이션 운용 시 마커 추적 방식에 따른 가상 오브젝트의 길이의 오차율은 약 0.47% 정도로 나타났으며, 이를 바탕으로 시뮬레이션을 위한 요구 오차한계에 따른 설치 마커 간의 거리를 구할 수 있었다. 또한 MR 장비의 마커 인식거리를 고려하여 마커간의 최소 설치 간격은 5M이상으로 설정할 필요가 있으며 이때 약 23mm의 길이 오차가 발생함을 고려해야한다. 가상 오브젝트를 20mm 이하의 오차에서 정밀하게 재현하고 하고자 할 때는 해당 오브젝트를 기준으로 반경 5M내에 해당 오브젝트를 위한 별도의 마커를 설치할 필요가 있는 것으로 나타났다. 본 연구를 바탕으로 가상 건설 시뮬레이션의 건설현장 적용에 MR의 활용도가 높아지길 기대한다.

Keywords

SHGSCZ_2018_v19n12_660_f0001.png 이미지

Fig. 1. Milgram’s Reality-Virtuality Continuum

SHGSCZ_2018_v19n12_660_f0002.png 이미지

Fig. 2. Difference in VR, AR and MR

SHGSCZ_2018_v19n12_660_f0003.png 이미지

Fig. 3. Marker Tracking

SHGSCZ_2018_v19n12_660_f0004.png 이미지

Fig. 4. Top Criteria for BIM S/W

SHGSCZ_2018_v19n12_660_f0005.png 이미지

Fig. 5. Hololens

SHGSCZ_2018_v19n12_660_f0006.png 이미지

Fig. 7. Workflow of Method 1

SHGSCZ_2018_v19n12_660_f0007.png 이미지

Fig. 8. Imported Model in Unity3d of Method 1

SHGSCZ_2018_v19n12_660_f0008.png 이미지

Fig. 9. Workflow of Method 2

SHGSCZ_2018_v19n12_660_f0009.png 이미지

Fig. 10. Imported Model in Unity3d of Method 2

SHGSCZ_2018_v19n12_660_f0010.png 이미지

Fig. 11. Binary Marker

SHGSCZ_2018_v19n12_660_f0012.png 이미지

Fig. 12. Model in Revit

SHGSCZ_2018_v19n12_660_f0013.png 이미지

Fig. 13. Position of Mark

SHGSCZ_2018_v19n12_660_f0014.png 이미지

Fig. 16. Image of Test 1 (Single Marker)

SHGSCZ_2018_v19n12_660_f0015.png 이미지

Fig. 17. Image of Test 2 (Multiple Marker)

SHGSCZ_2018_v19n12_660_f0016.png 이미지

Fig. 6. Principle of Hololens

SHGSCZ_2018_v19n12_660_f0017.png 이미지

Fig. 14. Picture of Virtual Object & Real Wold

SHGSCZ_2018_v19n12_660_f0018.png 이미지

Fig. 15. Picture of Measuring

Table 1. Hololens Hardware Details

SHGSCZ_2018_v19n12_660_t0001.png 이미지

Table 2. Test Result of Detection rate By Marker’s Size and Distance

SHGSCZ_2018_v19n12_660_t0002.png 이미지

Table 3. List of Length Measurements (Single Marker)

SHGSCZ_2018_v19n12_660_t0003.png 이미지

Table 4. List of Length Measurements (Multiple Marker-5M)

SHGSCZ_2018_v19n12_660_t0004.png 이미지

Table 5. List of Length Measurements (Multiple Marker-10M)

SHGSCZ_2018_v19n12_660_t0005.png 이미지

Table 6. List of Length Measurements (Multiple Marker-15M)

SHGSCZ_2018_v19n12_660_t0006.png 이미지

Table 7. Average Error & Error Factor of Test

SHGSCZ_2018_v19n12_660_t0007.png 이미지

References

  1. J. H. Lee, J. W. Choi, H. C. Seo, J. H. Kim, J. J. Kim, "A Basic Study on the BIM-based AR(Augmented Reality) System for Safety Management", Journal of the Korea Institute of Building Construction, Vol12, No.1, pp.147-148, 2012.
  2. S. Y, Moon, S. Y, Yun, H. S, Kim, L. S, Kang, "Improved Method for Increasing Maintenance Efficiency of Construction Structure Using Augmented Reality by Marker-Less Method", Journal of the Korean Society of Civil Enineers, Vol.35, No.4, pp.961-968, 2015. DOI: https://doi.org/10.12652/ksce.2015.35.4.0961
  3. Ryu, J. R., Choo, S. Y. and Jo, J. S. "An Application Method of Augmented Reality Technology for Layout Planning of Housing Complex." Journal of the Korean Housing Association, The Korean Housing Association, Vol. 21, No. 4, pp.89-97, 2010. DOI: https://doi.org/10.6107/jkha.2010.21.4.089
  4. S. Y. Kim, H. S. Kim, H. S. Moon, L. S. Kang, "Field Applicability of Augmented Reality Technology by Marker Mapping for Construction Project (Focused on Measurement Process of Rebar Work)", Journal of the Korean Society of Civil Enineers, Vol.33, No.6, pp.2509-2518, 2013 DOI: https://doi.org/10.12652/ksce.2013.33.6.2509
  5. S. S, Jung, J, Heo, S. K, Woo, "Development of Building Monitoring Techniques Using Augmented Reality", Korean journal of construction engineering and management, Vol.10, No.6, pp.3-12, 2009.
  6. HIRASAWA Gakuhito, "Mixed Reality in AEC Industry [in Japanese]", Journal of the Japan Society for Precision Engineering, Vol.83, No.6, pp.509-513, 2017. https://doi.org/10.2493/jjspe.83.509
  7. Adrien Fonnet, Nelson Alves, Nuno Sousa, Miguel Guevara, Luis Magalhaes, "Heritage BIM integration with mixed reality for building preventive maintenance", 2017 $24^{\circ}$ Encontro Portugues de Computacao Grafica e Interacao (EPCGI), pp.168-178, 2017. DOI: https://doi.org/10.1109/EPCGI.2017.8124304
  8. Chalhoub Jad, Ayer Steven K, "Using Mixed Reality for electrical construction design communication", Automation In Construction, Vol.86, pp.1-10, 2018. DOI: https://doi.org/10.1016/j.autcon.2017.10.028
  9. Milgram, p., H.Takemura, "Augumented Reality : A Class of Displays on the Reality-Virtuality Continuum, SPIE: Telemanipulator and Telepresence Technologies", MA, Boston, pp.282-292, 1995. DOI: https://doi.org/10.1117/12.197321
  10. J. Y. Lee, M. R. Seo, B. S. Son, "A Study on the Exchange Method of Building Information Model between BIM Solutions using IFC File Format", Journal of the Architectural Institute of Korea Planning & Design, Vol.25, No.3, pp.29-38, 2009.
  11. Sanni Siltanen, "Theory and Applications of Marker-Based Augmented Reality", JULKAISIJA - UTGIVARE, pp.38-40, 2012.
  12. Mariano Alcaniz, Jorge Dorribo Camba, Manuel Contero, Jeffrey Otey, "Visualization and Engineering Design Graphics with Augmented Reality", SDC, England, 2014.
  13. Xiangyu Wang, Marc Aurel Schnabel, "Mixed Reality In Architecture, Design, And Construction", Springer, USA, 2008.
  14. Yuichi Ohta, Hideyuki Tamura, "Mixed Reality: Merging Real and Virtual Worlds", Springer, USA, 2013.