DOI QR코드

DOI QR Code

Priority Data Handling in Pipeline-based Workflow

파이프라인 기반 워크플로우의 우선 데이터 처리 방안

  • 전원표 (국민대학교 컴퓨터공학과) ;
  • 허대영 (국민대학교 컴퓨터공학과) ;
  • 황선태 (국민대학교 소프트웨어융합대학)
  • Received : 2017.09.08
  • Accepted : 2017.10.31
  • Published : 2017.12.15

Abstract

Volcanic ash has been predicted to be the main source of damage caused by a potential volcanic disaster around Mount Baekdu and the regions of the Korean peninsula. Computer simulations to predict the diffusion of volcanic ash should be performed according to prevalent meteorological situations within a predetermined time. Therefore, a workflow using pipelining is proposed to parallelize the software used for this computation. Due to the nature of volcanic calamities, the simulations need to be carried out for various plausible conditions given that the parameters cannot be precisely determined during the simulations, even at the time of a volcanic eruption. Among the given conditions, computations need to be first performed for the condition with the highest probability so that a response to the volcanic disaster can be provided using these results. Further action can then be performed later based on subsequent results. The computations need to be performed using a volcanic disaster damage prediction system on a computing server with limited computing performance. Hence, an optimal distribution of the computing resources is required. We propose a method through which specific data can be provided first to the proposed pipeline-based workflow.

백두산 및 한반도 주변의 화산재해에 의한 피해는 화산재에 의한 것으로 예상된다. 따라서 기 상장 상황에 따른 화산재 확산 상황을 컴퓨터 시뮬레이션을 통해서 예측하는데 정해진 시간 안에 계산을 끝내야 하므로 계산에 사용되는 소프트웨어들을 파이프라인 방식으로 병렬화하는 워크플로우가 제안되었다. 또한 화산재해의 특성 상 화산 폭발이 발생한 순간에도 시뮬레이션을 위한 정확한 파라미터 값이 정해지지 않으므로 여러 가지 가능한 조건의 시뮬레이션을 모두 수행해야 한다. 만일 이 중에 가장 가능성이 높은 조건의 계산을 먼저 수행할 수 있으면 화산재해에 대해 이를 토대로 일단 대응하고 후속 계산 결과에 의해 추후 보완하는 것이 가능해질 것이다. 그런데 이런 계산 들은 화산재해 피해예측 시스템의 제한된 성능의 계산 서버에서 수행되므로 계산 자원을 적절히 분배하는 일이 필요하다. 이를 위해서 기존에 제안되었던 파이프라인 기반의 워크플로우에 특정 데이터를 먼저 생성하는 기능을 추가하는 방안을 제안한다.

Keywords

Acknowledgement

Supported by : 재난안전기술개발사업단

References

  1. Michalakes, J., et al., "The weather research and forecast model: software architecture and performance," Proc. of the Eleventh ECMWF Workshop on the Use of High Performance Computing in Meteorology. World Scientific, Vol. 25, pp. 29, 2004.
  2. Folch, Arnau, Antonio Costa, and Giovanni Macedonio, "FALL3D: A computational model for transport and deposition of volcanic ash," Computers & Geosciences, Vol. 35, No. 6, pp. 1334-1342, Jun. 2009. https://doi.org/10.1016/j.cageo.2008.08.008
  3. D. Heo, D. Lee and S. Hwang, "Workflow Based on Pipelining for Performance Improvement of Volcano Disaster Damage Prediction System," Journal of KIISE, Vol. 42, No. 3, pp. 281-288, Mar. 2015. (in Korean) https://doi.org/10.5626/JOK.2015.42.3.281
  4. Christopher G. Newhall, Stephen Self, "The volcanic explosivity index (VEI) an estimate of explosive magnitude for historical volcanism," Journal of Geophysical Research, Vol. 87, Issue C2, pp. 1231- 1238, Feb. 1982. https://doi.org/10.1029/JC087iC02p01231
  5. Thain, Douglas, Todd Tannenbaum, and Miron Livny, "Distributed computing in practice: the Condor experience," Concurrency and computation: practice and experience, Vol. 17, Issue. 2-4, pp. 323-356, Feb. 2005. https://doi.org/10.1002/cpe.938
  6. Zhou Songnian, Zheng Xiaohu, Wang Jingwen, Delisle Pierr, "Utopia: A load sharing facility for large, heterogeneous distributed computer systems," Software: Practice and Experience, pp. 1305-1336, Vol. 23, No. 12, 1993. https://doi.org/10.1002/spe.4380231203
  7. A. Prenneis, Jr, "LoadLeveler: Workload Management for Parallel and Distributed Computing Environments," Proc. of Supercomputing Europe (SUPEUR), 1996.
  8. Feng, Hanhua, Vishal Misra, and Dan Rubenstein, "PBS: a unified priority-based scheduler," ACM SIGMETRICS Performance Evaluation Review, Vol. 35, No. 1, 2007.
  9. W. Gentzsch, "Sun Grid Engine: towards creating a compute power grid," Proc. First IEEE/ACM International Symposium on Cluster Computing and the Grid, pp. 35-36, 2001.
  10. Altintas, C. Berkley, E. Jaeger, M. Jones, B. Ludascher and S. Mock, "Kepler: an extensible system for design and execution of scientific workflows," Proc. 16th International Conference on Scientific and Statistical Database Management (SSDBM'04), pp. 423-424, 2004.