• Title/Summary/Keyword: Kim youngrang

Search Result 4, Processing Time 0.021 seconds

Empirical Performance Evaluation of Communication Libraries for Multi-GPU based Distributed Deep Learning in a Container Environment

  • Choi, HyeonSeong;Kim, Youngrang;Lee, Jaehwan;Kim, Yoonhee
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.15 no.3
    • /
    • pp.911-931
    • /
    • 2021
  • Recently, most cloud services use Docker container environment to provide their services. However, there are no researches to evaluate the performance of communication libraries for multi-GPU based distributed deep learning in a Docker container environment. In this paper, we propose an efficient communication architecture for multi-GPU based deep learning in a Docker container environment by evaluating the performances of various communication libraries. We compare the performances of the parameter server architecture and the All-reduce architecture, which are typical distributed deep learning architectures. Further, we analyze the performances of two separate multi-GPU resource allocation policies - allocating a single GPU to each Docker container and allocating multiple GPUs to each Docker container. We also experiment with the scalability of collective communication by increasing the number of GPUs from one to four. Through experiments, we compare OpenMPI and MPICH, which are representative open source MPI libraries, and NCCL, which is NVIDIA's collective communication library for the multi-GPU setting. In the parameter server architecture, we show that using CUDA-aware OpenMPI with multi-GPU per Docker container environment reduces communication latency by up to 75%. Also, we show that using NCCL in All-reduce architecture reduces communication latency by up to 93% compared to other libraries.

High-quality data collection for machine learning using block chain (블록체인을 활용한 양질의 기계학습용 데이터 수집 방안 연구)

  • Kim, Youngrang;Woo, Junghoon;Lee, Jaehwan;Shin, Ji Sun
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.23 no.1
    • /
    • pp.13-19
    • /
    • 2019
  • The accuracy of machine learning is greatly affected by amount of learning data and quality of data. Collecting existing Web-based learning data has danger that data unrelated to actual learning can be collected, and it is impossible to secure data transparency. In this paper, we propose a method for collecting data directly in parallel by blocks in a block - chain structure, and comparing the data collected by each block with data in other blocks to select only good data. In the proposed system, each block shares data with each other through a chain of blocks, utilizes the All-reduce structure of Parallel-SGD to select only good quality data through comparison with other block data to construct a learning data set. Also, in order to verify the performance of the proposed architecture, we verify that the original image is only good data among the modulated images using the existing benchmark data set.

Determining Groundwater-surface Water Interaction at Coastal Lagoons using Hydrogeochemical Tracers (수리화학적 환경 추적자를 이용한 강원도 석호지역에서의 지하수-지표수 상호작용에 대한 연구)

  • Dong-Hun Kim;Jung-Yun Lee;Soo Young Cho;Hee Sun Moon;Youn-Young Jung;Yejin Park;Yong Hwa Oh
    • Journal of Soil and Groundwater Environment
    • /
    • v.28 no.2
    • /
    • pp.1-11
    • /
    • 2023
  • Groundwater-surface water interaction was evaluated using water quality parameters (temperature and electrical conductivity), distributions of stable water isotopes (δ2H and δ 18O), and Rn-222 in lagoon water, groundwater, and seawater at three coastal lagoons (Songji (SJ), Youngrang (YR), and Sunpo (SP) Lagoon) in South Korea. From the results of composition and distributions of δ2H and δ18O, it was found that groundwater fraction of lagoon water in YR Lagoon (76%) was slightly higher than those of SJ (42%), and SP (63%) Lagoon. Based on Rn-222 mass balance model, groundwater discharge into SJ Lagoon in summer 2020 was estimated to be (3.2±1.1)×103 m3 day-1, which showed a similar or an order of magnitude higher than the results of previous studies conducted in coastal lagoons. This study can provide advanced techniques to evaluate groundwater-surface water interaction in coastal lagoons, wetlands, and lakes, and help to determine the effects of groundwater on coastal ecosystems.