A Meta Scheduling Framework for Workflow Service on the Grid

그리드 환경에서 워크플로우 서비스를 제공하기 위한 메타 스케줄링 프레임워크

  • Published : 2004.10.01

Abstract

The Grid is new infrastructure to provide computing environment for grand challenge research by sharing large-scale resources. Currently the Globus becomes a de facto standard middleware to construct Grid and supports core services such as resource management, security, data transfer, information services, and so on. However, it still needs more works and researches to satisfy requirements from various grid applications. A workflow management is becoming a main service as one of the important grid services for complex grid applications. We propose a Meta Scheduling Framework (MSF) in this paper. The MSF provides a XML-based Job Control Markup Language (JCML) for describing information and procedures of grid applications, and a workflow management service for scheduling the job using the JCML and for processing the job effectively.

그리드는 대규모의 독립된 자원을 공유하여 과학 연구와 같은 문제를 해결하기 위한 컴퓨팅 환경을 제공한다. Globus는 그리드를 구축할 수 있는 표준적인 미들웨어로서 자원 관리, 보안, 데이타, 정보 서비스 등의 핵심적인 서비스를 제공하지만 어플리케이션에서 필요한 다양한 요구를 충족시키기에는 아직 많은 연구가 필요하다. 그 중에서도 워크플로우 서비스는 복잡한 어플리케이션을 위한 중요한 서비스로 부각되고 있다. 본 논문에서는 워크플로우 서비스를 지원하는 메타 스케줄링 프레임워크 (MSF)를 제안한다. 메타 스케줄링 프레임워크는 그리드 작업에서 요구하는 내용과 작업 절차를 표현할 수 있는 XML 기반의 작업 제어 언어 (JCML)를 제공하며, 이를 바탕으로 복잡한 작업 처리를 효과적으로 관리할 수 있는 워크플로우 관리 서비스를 제공한다.

Keywords

References

  1. I. Foster, C Kesselman, The Grid: Blueprint for a New Computing Infrastructure, Morgan Kaufmann, 1999
  2. I. Foster and C. Kesselman, 'Globus: A Metacomputing Infrastructure Toolkit,' The International Journal of Supercomputer Applications and High Performance Computing, Vol. 11, No. 2, pp. 115-128, Oct. 1997 https://doi.org/10.1177/109434209701100205
  3. L. Fisher (eds), Workflow Handbook, Workflow Management Coalition, 2002
  4. J. Cao, S. A. Jarvis, S. Saini, G. R. Nudd, 'Gird- Flow: Workflow Management for Grid Computing,' Proceeding of the 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid, pp. 12-15, 2003 https://doi.org/10.1109/CCGRID.2003.1199369
  5. R. Stevens, A. Robinson and C. Goble, 'myGrid: Personalised bioinformatics on the information grid, Bioinformatics,' Vol. 19, Suppl. 1, pp. 302-304, 2003 https://doi.org/10.1093/bioinformatics/btg1041
  6. J. Geiriget, H. Bivens, S. Humphreys, W. Johnson, R. Rhea, 'Constructing the ASCI Computational Grid,' http://vir.sandla.org/drmweb/docs/grid-hpdc00.pdf
  7. J. Frey, T. Tannenbaum, I. Foster, M. Livny, S. Tuecke, 'Condor-G: A Computation Management Agent for Multi-Institutional Grids,' Cluster Computing, Vol. 5, No. 3, pp. 237-246, 2002 https://doi.org/10.1023/A:1015617019423
  8. S. Krishnan, P. Wagstrom, G. Laszewski, 'GSFL: A Workflow Framework for Grid Services,' http://www.globus.org/cog/papers/gsfl-paper.pdf
  9. I. Foster, C. Kesselman, J. Nick, S. Tuecke, 'The Physiology of the Grid: An open Grid Services Architecture for Distributed Systems Integration,' Global Grid Forum, June 2002
  10. JSDL, JOb Submission Description Language Working Group, Global Grid Forum, 2003
  11. GGF, Global Grid Forum, http://www.ggf.org/
  12. K. Czajkowski, S. Fitzgerald, I. Foster, C. Kesselman, 'Grid Information Services for Distributed Resource Sharing,' Proceeding of the 10th IEEE International Symposium on High-Performance Distributed Computing, 2001 https://doi.org/10.1109/HPDC.2001.945188
  13. R. Wolski, N. spring, J. Hayes, 'The Network Weather Service: A Distributed Resource Perfromance Forecasting Service for Metacomputing,' Future Generation Computing Systems, Vol. 15, No. 5-6, pp. 757-768, 1999 https://doi.org/10.1016/S0167-739X(99)00025-4
  14. Richard C. Hoft, Andreas Winter, 'A Short Introduction to the GXL Software Exechange Format,' Proceeding of the 7th Working Conference on Reverse Engineering, 2000 https://doi.org/10.1109/WCRE.2000.891486
  15. A. Cichocki, A. S. Helal, M. Rusinkiewicz, D. Woelk, Workflow and Process Automation: Concepts and Technology, Kluwer, 1998
  16. AutoDock, http://www.scripps.edu/pub/olson-web/autodock/