The Journal of the Korea institute of electronic communication sciences (한국전자통신학회논문지)

Korea Institute of Electronic Communication Science (한국전자통신학회)
권호 표지
DOI QR코드

DOI QR Code

Large Storage Performance and Optimization Study using blockwrite

blockwrite를 이용한 대형 스토리지 성능 측정 및 최적화 연구

  • 김효령 (한국천문연구원 전파천문본부) ;
  • 송민규 (한국천문연구원 전파천문본부) ;
  • 강용우 (한국천문연구원 전파천문본부)
  • Received : 2021.10.18
  • Accepted : 2021.12.17
  • Published : 2021.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

In order to optimize the performance of 1.4P large storage, the characteristics of each chunk mode were investigated, and the chunk 512K mode was selected in terms of I/O speed. NVME storage system was configured and used to measure data server performance of large storage. By measuring the change in throughput according to the number of threads of the 1.4P large storage, the characteristics of the large storage system were identified, and it was confirmed that the performance was up to 133Gbps with a block size of 32KB. As a result of data transmission/reception experiment using globus-url-copy of GridFTP, it was found that this large storage has a throughput of 33Gbps.

1.4P 대형 스토리지의 성능을 최적화하기 위하여 청크모드별 특성을 조사하고, I/O 속도면에서 청크 512K 모드를 선택하였다. NVME 스토리지 시스템을 구성하여 대형 스토리지의 데이터 서버 성능 측정에 활용하였다. 1.4P 대형 스토리지의 쓰레드 수에 따른 스루풋의 변화를 측정하여 대형 스토리지 시스템의 특성을 파악하였으며, 스루풋의 최대값은 블록크기 32KB에서 133Gbps 성능을 보임을 확인하였다. GridFTP 방식의 globus-url-copy를 이용하여 데이터 송수신 실험을 수행한 결과, 이 대형 스토리지는 33Gbps의 스루풋을 가지고 있음을 알 수 있었다.

Keywords

Acknowledgement

이 논문은 2021년 한국천문연구원 기관고유사업의 지원에 의한 논문임

References

  1. Y. Kang, M. Song, S. Wi, S. Lee, and S. Kim, "Development and Observation Result of High Speed Digital Conversion System of Astronomical Radio Signal," J. of the Korea Institute of Electronic Communication Sciences, vol. 12, no. 6, Dec. 2017, pp. 1009-1018. https://doi.org/10.13067/JKIECS.2017.12.6.1009
  2. M. Song, Y. Kang, and H. Kim, "The Study on the Design and Optimization of Storage for the Recording of High Speed Astronomical Data," J. of the Korea Institute of Electronic Communication Sciences, vol. 12, no. 1, Feb. 2017, pp. 75-84. https://doi.org/10.13067/JKIECS.2017.12.1.75
  3. M. Lee and K. Yoo, "Implementation of a Platform for the Big Scientific Data Trsnsfers," J. of the Korea Institute of Electronic Communication Sciences, vol. 13, no. 4, Aug. 2018, pp. 881-886. https://doi.org/10.13067/JKIECS.2018.13.4.881
  4. M. Song, H. Kim, Y. Kang, D. Je, S. Wi, and S. Lee, "Implementation of Ring Buffer basd Massive VLBI Data Stream Input/Output over the Wide Area Network," J. of the Korea Institute of Electronic Communication Sciences, vol. 14, no. 6, Dec. 2019, pp. 1109-1120. https://doi.org/10.13067/JKIECS.2019.14.6.1109
  5. M. Song, H. Kim, and Y. Kang, "A Study on the Performance Monitoring and Optimization of a High Speed Network for the Transfer of Massive VLBI Data," J. of the Korea Institute of Electronic Communication Sciences, vol. 14, no. 6, Dec. 2019, pp. 1097-1108. https://doi.org/10.13067/JKIECS.2019.14.6.1097
  6. M. Song, Y. Kang, and H. Kim, "Performance Evaluation of Big Stream based High Speed Data Storage," J. of the Korea Institute of Electronic Communication Sciences, vol. 12, no. 5, Oct. 2017, pp. 817-828. https://doi.org/10.13067/JKIECS.2017.12.5.817
  7. M. Song, and H. Kim, "A Study on Ring Buffer for Efficiency of Mass Data Transmission in Unstable Network Environment," J. of the Korea Institute of Electronic Communication Sciences, vol. 15, no. 6, Dec. 2020, pp. 1045-1054. https://doi.org/10.13067/JKIECS.2020.15.6.1045
  8. M. Song, "Multidrop Ethernet based IoT Architecture Design for VLBI System Control and Monitor," J. of the Korea Institute of Electronic Communication Sciences, vol. 15, no. 6, Dec. 2020, pp. 1159-1168. https://doi.org/10.13067/JKIECS.2020.15.6.1159
  9. H. Kim, and M. Song, "Development and Application of HDD I/O Measurement Utility Blockwrite," J. of the Korea Institute of Electronic Communication Sciences, vol. 15, no. 6, Dec. 2020, pp. 1151-1158. https://doi.org/10.13067/JKIECS.2020.15.6.1151
  10. J. Ahn, C. Hyun, and D. Lee, "Persistent Page Table and File System Journaling Scheme for NVM Storage," J. inst. Korean. electr. electron. eng. vol. 23, no. 1, Mar. 2019, pp. 80-90.
  11. T. Zhao and Y. Lee, "Join Query Performance Optimization Based on Convergence Indexing Method," J. of the Korea Institute of Electronic Communication Sciences, vol. 16, no. 1, Feb. 2021, pp. 109-116. https://doi.org/10.13067/JKIECS.2021.16.1.109