The Journal of the Korea institute of electronic communication sciences (한국전자통신학회논문지)

Korea Institute of Electronic Communication Science (한국전자통신학회)
권호 표지
DOI QR코드

DOI QR Code

Implementation of a Platform for the Big Scientific Data Transfers

대용량 과학데이터 전송을 위한 플랫폼 구현

  • 이민선 (충남대학교 컴퓨터공학과) ;
  • 유관종 (충남대학교 컴퓨터공학과)
  • Received : 2018.07.13
  • Accepted : 2018.08.15
  • Published : 2018.08.31
Download PDF
⟨ Previous Next ⟩

Abstract

Over the last several decades, the advances in computer engineering technology have led a new paradigm of data-intensive research in the field of scientific applications. A collaborative work environment for storing, sharing and analyzing data is required for researchers of geographical distance. The Korean government supports the Research & Education network(KREONET) and the Global Science experimental Data hub Center(GSDC) to strengthen the nation's competitiveness. The KREONET has upgraded its backbone to 100Gbps to accommodate demand to transfer data fast among the global major experimental sites. This paper introduces the test result between high performance nodes reserved for big data transfer.

지난 수십 년간, 컴퓨터 기술의 발전은 응용연구의 데이터집약형 연구라는 새로운 패러다임으로 변화를 가져왔다. 지리적으로 떨어진 연구자들에게 대용량 실험 데이터를 저장, 공유, 분석하는 환경이 요구되고, 우리나라는 연구 경쟁력 강화를 위해 국가과학기술연구망(KREONET)과 대용량데이터센터 등 국가 차원의 인프라를 서비스하고 있다. 특히, KREONET는 2016년부터 세계 주요 연구지까지 최대 100Gbps의 속도로 연결하는 네트워크를 제공하고 있다. 본 논문에서는 국제간 협업을 지원하는 초고속 장거리 전송의 연구 환경으로서, 고성능 전송 노드와 계산 자원을 고속의 네트워크에 연동한 대용량 데이터전용의 전송플랫폼 시연 결과를 소개하고자 한다.

Keywords

References

  1. G. Moore, "Cramming more components onto integrated circuits," Electronics Mag., vol. 38, no. 8, 1965, pp. 114-117.
  2. M. Song, Y. Kang, and H. Kim, "The study on the design and optimization of storage for the recording of high speed astronomical data," J. of the Korea Institute of Electronic Communication Sciences, vol. 12, no. 1, Feb. 2017, pp. 75-84. https://doi.org/10.13067/JKIECS.2017.12.1.75
  3. H. Yoon, "Development of Contents on the Marine meteorology service by meteorology and climate big data," J. of the Korea Institute of Electronic Communication Sciences, vol. 11, no. 2, Feb. 2016, pp. 125-138. https://doi.org/10.13067/JKIECS.2016.11.2.125
  4. W. Stallings, "Software-defined networks and Openflow," The internet protocol Journal, vol. 16, no. 1, Mar. 2013, pp. 2-14.
  5. H. Newman, A. Barczyk, A. Mughal, S. Rozsa, R. Voicu, I. Legrand, S. Lo, D. Kcira, R. Sobie, I. Gable, C. Brown, Y. Savard, T. Tam, M. Hay, S. Mckee, R. Hocket, B. Meekhof, and S. Timoteo, "Efficient LHC Distribution across 100Gbps networks," In SC Companion: High performance computing, Salt Lake City, USA, Nov. 2012, pp. 1594-1599.
  6. E. Dart, L. Rotman, B. Tierney, M. Hester, and J. Zurawski, "The Science DMZ: A Network Design Pattern for Data-Intensive Science," In Proc. of the Int. Conf. on High Performance Computing, Networking, Storage and Analysis, Denver, USA, Nov. 2013, pp. 1-10.
  7. J. Park, S. Kim, and M. Noh, "Performance enhancement method through Science DMZ data transfer node tuning parameters," Trans. on Computer and Communication Systems, vol. 7, no. 2, 2018, pp. 33-40.
  8. J. Moon and M. Lee, "A Study to Data-intensive Science data transfer over Science DMZ," In Proc. of Korea Computer Congress, Jeju, Korea, 2016, pp. 1359-1361.
  9. Z. Maxa, B. Ahmed, D. Kcira, I. Legrand, A. Mughal, M. Thomas, and R. Voicu, "Powering physics data transfers with FDT," J. of Physics : Conference series, vol. 331, no. 5, 2011, pp. 1-6.
  10. M. Lee, "A study on the throughput guarantee with TCP traffic control," J. of the Korea Institute of Electronic Communication Sciences, vol. 11, no. 3, Mar. 2016, pp. 303-308. https://doi.org/10.13067/JKIECS.2016.11.3.303
  11. W. Seok, W. Hong, J. Kwak, and J. Moon, "DTN-aware Store-and-Forward Data Transfer for Exabyte scale science big-data," J. of Korean Institute of Communications and Information Sciences, vol. 42, no. 10, 2017, pp. 1991-1998. https://doi.org/10.7840/kics.2017.42.10.1991