Journal of the Korean Association of Geographic Information Studies (한국지리정보학회지)

The Korean Association of Geographic Information Studies (한국지리정보학회)
권호 표지
DOI QR코드

DOI QR Code

Serialization Method for large spatial data transmission of High Definition Map

정밀도로지도의 대용량 공간데이터 교환을 위한 직렬화 기법 설계

  • Received : 2022.10.24
  • Accepted : 2022.11.10
  • Published : 2022.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

This study presented a spatial data serialization technique that can efficiently store and transmit large amounts of spatial data for precision road maps was designed and implemented. For efficient serialization, a binary spatial data structure is defined, and a coordinate value encoding technique without loss of information is designed using the Zigzag-Z-order curve. The spatial data serialization technique designed for precision road maps was tested, and the data size and encoding/decoding speed after encoding were compared with Protocol buffer and Geobuff. As a result, it was confirmed that the designed serialization method was excellent in data weight reduction performance and encoding speed. However, the decoding speed was inferior to other serialization techniques in linestring and polygon type spatial data. Through this study, it was confirmed that spatial data can be efficiently encoded, stored, and transmitted using binary serialization techniques.

공간데이터의 활용 범위와 서비스가 늘어나면서 정밀한 공간데이터를 필요로 하는 기술들이 많아지고 있다. 특히 정밀도로지도는 3차원 공간데이터를 수집, 가공, 처리하는 것이 필수적이며 이를 통해 자율주행 지원이 가능하다. 본 연구에서는 정밀도로지도를 대상으로 대용량의 공간데이터를 효율적으로 저장 및 전송할 수 있는 공간데이터 직렬화 기법을 설계하고 구현하였다. 효율적인 직렬화를 위해 바이너리 형태의 공간데이터 구조를 정의하였으며 Zigzag-Z-order 곡선을 활용하여 정보의 손실 없는 좌표 값 인코딩 기법을 설계하였다. 설계한 공간데이터 직렬화 기법을 정밀도로지도 대상으로 구현 및 적용하여 Protocol buffer, Geobuf와 인코딩 후 데이터 크기, 인코딩/디코딩 속도를 비교하였다. 그 결과 경량화 성능과 인코딩 속도는 모든 유형의 공간데이터에서 설계한 직렬화 방식이 우수한 것을 확인하였다. 하지만 디코딩 속도는 선과 면 유형의 공간데이터에서 다른 직렬화 기법의 성능이 우수하였다. 본 연구를 통해 바이너리 형식의 직렬화 기법으로 공간데이터를 효율적으로 인코딩하여 저장 및 전송할 수 있다는 것을 확인하였다.

Keywords

Acknowledgement

이 논문은 2022년도 정부(경찰청)의 재원으로 과학치안진흥센터의 지원을 받아 수행된 연구임 (No.092021C28S02000, 협력적 교통제어전략 도입을 위한 교통정보 음영구간 정보 생성 및 운영관리 기술개발)

References

  1. Apache Avro 1.10.0 Documentation. https://avro.apache.org/docs/1.10.0/. Apache
  2. Baek C.Y., Park. S.H., and Kang Y.B. 2019. Korean HD Map Data Model Design for Autonomous Vehicles. Journal of Korean Society for Geospatial Information Science. 27(6):13-25. https://doi.org/10.7319/kogsis.2019.27.6.013
  3. Bittl, S., Gonzalez, A. A., & Heidrich, W. 2014. Performance comparision of encoding schemes for ETSI ITS C2X communication systems. In Third International Conference on Advances in Vehicular Systems, Technologies and Applications. pp.58-63.
  4. Bray, T., Paoli, J., Sperberg-McQueen, C. M., Maler, E., & Yergeau, F. 2000. Extensible markup language (XML) 1.0.
  5. Ecma International. 2017. The JSON Data Interchange Syntax (ECMA-404).
  6. Eriksson, M., & Hallberg, V. 2011. Comparison between JSON and YAML for data serialization. The School of Computer Science and Engineering Royal Institute of Technology, 1-25.
  7. International Oranization for Standardization. 2016. Intelligent transport systems -- Extension of map database specifications for applications of cooperative ITS (ISO 14296:2016).
  8. International Oranization for Standardization. 2018. Intelligent transport systems -- Co-operative ITS -- Local dynamic map (ISO 18750:2018).
  9. International Oranization for Standardization. 2004. Geographic information -- Simple feature access -- Part 1: Common architecture (ISO 19125-1:2004).
  10. International Oranization for Standardization. 2020. Intelligent transport systems -- Geographic Data Files(GDF) -- GDF 5.1 -- Part 1: Application independent map data shared between multiple sources (ISO 20524-1:2020).
  11. International Oranization for Standardization. 2019. Intelligent transport systems -- Dynamic data and map database specification for connected and automated driving system applications -- Part 1: Architecture and logical data model for harmonization of static map data (ISO/AWI TS 22726-1)
  12. Jang, J., Jung, S. J., Jeong, S., Heo, J., Shin, H., Ham, T. J., & Lee, J.W. 2020. A specialized architecture for object serialization with applications to big data analytics. In 2020 ACM/IEEE 47th Annual International Symposium on Computer Architecture (ISCA) pp.322-334. IEEE.
  13. Kang J.H., Kim H.D., and Kim J.T. 2018. Improving Compatibility Method of New Vworld 3D Data Using the Serialization Technique. Journal of the Korean Association of Geographic Information Studies, 21 (1):96-105. https://doi.org/10.11108/KAGIS.2018.21.1.096
  14. Krijnen, T., & Beetz, J. 2017. An IFC schema extension and binary serialization format to efficiently integrate point cloud data into building models. Advanced Engineering Informatics, 33:473-490.
  15. Maeda, K. 2012. Performance evaluation of object serialization libraries in XML, JSON and binary formats. In 2012 Second International Conference on Digital Information and Communication Technology and it's Applications (DICTAP) pp.177-182. IEEE.
  16. Navigation Data Standard PSF Physical Storage Format -- Open Lane Model Documentation version 1.0, Navigation Data Standard
  17. National Geographic Information Institue. 2019. High Definition Map building manual
  18. National Geographic Information Institue. 2018.
  19. Proos, D. P., & Carlsson, N. 2020. Performance comparison of messaging protocols and serialization formats for digital twins in IoV. In 2020 IFIP Networking Conference (Networking) pp.10-18. IEEE.
  20. Petersen, B., Bindner, H., You, S., & Poulsen, B. 2017. Smart grid serialization comparison: Comparision of serialization for distributed control in the context of the Internet of Things. In 2017 Computing Conference pp.1339-1346. IEEE.
  21. Protocol Buffers. https://developers.google.com/protocol-buffers. google
  22. SAE International. 2016. Dedicated Short Range Communications (DSRC) Message Set Dictionary J2375 "Schema evolution in Avro, Protocol Buffers and Thrift". 2012. Martin Kleppmann blog. Martin Kleppmann. https://martin.kleppmann.com/2012/12/05/schema-evolution-in-avro-protocol-buffers-thrift.html.
  23. Yang I.C., Jeon W.H., and Lee H.M. 2017. Study on Dynamic Map Data Provision System for Automated Vehicle. The journal of the Korea Institute of intelligent transport systems. 16(6):208-218. https://doi.org/10.12815/kits.2017.16.6.208
  24. Yang I.C., and Jeon W.H. 2018. Digital road event management system using high-precision map. The Journal of Contents Computing. 19(11):2219-2226.