Journal of KIISE:Computing Practices and Letters (한국정보과학회논문지:컴퓨팅의 실제 및 레터)

Korean Institute of Information Scientists and Engineers (한국정보과학회)
권호 표지

A Relative Performance Index-based Job Migration in Grid Computing Environment

그리드 컴퓨팅 환경에서의 상대성능지수에 기반한 작업 이주

  • 김영균 (금옥공과대학교 전자공학과) ;
  • 오길호 (금오공과대학교 컴퓨터공학부) ;
  • 조금원 (한국과학기술정보연구원 슈퍼컴퓨팅응용실) ;
  • 고순흠 (서울대학교 기계항공공학부)
  • Published : 2005.08.01
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we research on job migration in a grid computing environment with cactus and MPICH-C2 based on Globus. Our concepts are to perform job migration by finding the site with plenty of computational resources that would decrease execution time in a grid computing environment. The Migration Manager recovers the job from the checkpointing files and restarts the job on the migrated site. To select a migrating site, the proposed method considers system's performance index, cpu's load, network traffic to send migration job tiles and the execution time predicted on a migration site. Then it selects a site with maximal performance gains. By selecting a site with minimum migration time and minimum execution time. this approach implements a more efficient grid computing environment. The proposed method Is proved by effectively decreasing total execution time at the $K\ast{Grid}$.

본 논문에서는 글로버스(Globus) 기반의 MPICH-G2와 Cactus를 갖는 그리드 컴퓨팅 환경에서 작업 마이그레이션(Job Migration)에 대해 연구를 수행하였다. 그리드 컴퓨팅 환경에서 연산의 실행시간을 단축시킬 수 있는 연산자원이 풍부한 사이트를 찾아 작업을 마이그레이션 한다. 마이그레이션 사이트에서 체크 포인팅 파일에 기반 하여 연산의 수행이 중단된 지점부터 복구하여 연산을 재개한다. 마이그레이션 사이트를 선택하기 위해 사이트의 정적인 성능 지수와 CPU의 부하, 마이그레이션 작업을 전송하기 위한 네트워크의 부하를 고려한 작업 전송시간, 마이그레이션 사이트에서의 실행시간 예측 값을 사용하여 마이그레이션 이득이 큰 사이트로 작업을 마이그레이션 한다. 작업의 마이그레이션 시간과 실행시간 예측 값이 최소로 하는 사이트를 선택함으로서 보다 효율적인 그리드 컴퓨팅을 수행할 수 있도록 한다. 제안한 방법은 $K\ast{Grid}$ 환경에서 전체 연산 시간을 효과적으로 단축함을 입증하였다.

Keywords

References

  1. NEESgrid, http://it.nees.org
  2. The Grid Physics Network, http://www.griphyn. org
  3. K*Grid, http://www.gridcenter.or.kr
  4. Nicholas T. Karonis, Brian Toonen, Ian Foster, 'MPICH-G2: A Grid-Enabled Implementation of the Message Passing Interface,' In Proceedings of ASCM/IEEE SC'98 Conference, ACM press, 1998
  5. Garbrielle Allen, Werner Benger, Thomas Dramlitsch, Tom Goodale, Hans-Christian Hege, Gerd Lanfermann, Andre Merzky, Thomas Radke, Edward Seidel, John Shalf, 'Cactus Tools for Grid Applications,' Cluster Computing, Vol.4(3), pp. 179-188, 2001 https://doi.org/10.1023/A:1011491422534
  6. Cactus, An open source problem solving environment, http://www.cactuscode.org
  7. Garbrielle Allen, Thomas Dramlitsch, Ian Foster, Nicholas T. Karonis, Matei Ripeanu, Edward Seidel, Brian Toonen, 'Supporting Efficient Execution in Heterogeneous Distributed Computing Environments with Cactus and Globus,' SC2001 November 2001, Denver https://doi.org/10.1109/SC.2001.10007
  8. Garbrielle Allen, David Angulo, Ian Foster, Gerd Lanfermann, Chuang Liu, Thomas Radke, Ed Seidel, John Shalf, 'The Cactus Worm: Experiments with Dynamic Resource Discovery and Allocation in a Grid Envrionment,' The International Journal of High-Performance Computing Applications and Supercomputing 15(4), Winter, 2001 https://doi.org/10.1177/109434200101500402
  9. Sathish S. Vadhiyar, Jack J. Dongarra, 'Self Adaptivity in Grid Computing,' CONCURRENCY AND COMPUTATION: PRACTICE AND EXPERIENCE' Concurrency Computat. : Pract. Exper. 2004; 00:1-26 https://doi.org/10.1002/cpe.927
  10. Carsten Ernemann, Volker Hamscher, Achim Streit, Ramin Yahyapour, 'Enhanced Algorithms for Multi-Site Scheduling,' In 3rd Int'l Workshop on Grid Computing, pp. 219-231, 2002
  11. C. Liu, L. Yang, I. Foster, and D. Angulo, 'Design and Evaluation of a Resource Selection Framework for Grid Applications,' Proceedings of the 11th IEEE Symposium on High-Performance Distributed Computing, pp. 63-72, July 2002 https://doi.org/10.1109/HPDC.2002.1029904
  12. I. Foster, C. Kesselman, and S. Tuecke, 'The Anatomy of the Grid: Enabling Scalable Virtual Organizations,' Journal of the International Supercomputer Applications, vol. 15, no. 3, pp. 200-222, 2001 https://doi.org/10.1177/109434200101500302
  13. I. Foster and C. Kesselman. editors. The Grid: Blueprint for a New Computing Infrastructure. Morgan Kaufmann Publishers, 1999
  14. P. Roe, C. Szyperski, 'Transplanting in Gardens: Efficient Heterogeneous Task Migration for Fully Inverted Software Architectures', Proceedings of the Fourth Australasian Computer Architecture Conference, Auckland, New Zealand, January 18-21, 1999
  15. Gabrielle Allen, Tom Goodale, Michael Russell, Edward Seidel and John Shalf, 'Classifying and enabling grid applications,' CONCURRENCY-PRACTICE AND EXPERIENCE, Concurrency: Pract. Exper. 2000; 00:1-7
  16. Sriram Krishnan, Dennis Gannon, 'Checkpoint and Restart for Distributed Components in XCAT3,' In Proceedings of the fifth IEEE/ ACM International Workshop on Grid Computing, pp. 281-288, Pittsburgh, Pennsylvania, 8 November, 2004 https://doi.org/10.1109/GRID.2004.15
  17. I. Foster and C. Kesselman, 'Globus: A Metacomputing Infrastructure Toolkit,' The International Journal of Supercomputer Applications and High Performance Computing, Vol. 11, No. 2, pp. 115-128, Oct. 1997 https://doi.org/10.1177/109434209701100205
  18. S. Fitzgerald, I. Foster, C. Kesselman, G. von Laszewski, W. Smith, and S. Tuecke. 'A directory service for configuring high-performance distributed computations,' In Proc. 6th IEEE Symp. on High Performance Distributed Computing, pages 365-375. IEEE Computer Society Press, 1997 https://doi.org/10.1109/HPDC.1997.626445
  19. K. Czajkowski, I. Foster, N. Karonis, C. Kesselman, S. Martin, W. Smith, and S. Tuecke, 'A resource management architecture for metacomputing systems,' In The 4th Workshop on Job Scheduling Strategies for Parallel Processing,' 1998 https://doi.org/10.1007/BFb0053977
  20. Karl Czajkowski, Ian Foster, and Carl Kesselman, 'Co-allocation services for computational grids,' In Proc. 8th IEEE Symp. on High Performance Distributed Computing. IEEE Computer Society Press, 1999
  21. Joseph Bester, Ian Foster, Carl Kesselman, Jean Tedesco, and Steven, Tuecke, 'GASS: A data movement and access service for wide area computing systems,' In Proc. IOPADS'99. ACM Press, 1999 https://doi.org/10.1145/301816.301839
  22. D. Abramson, K. Power, L. Kolter, 'High performance parametric modelling with Nimrod/G: A killer application for the global Grid', In Proceedings of the International Parallel and Distributed Processing Symposium, Cancun, Mexico, 2000, pp. 520-528 https://doi.org/10.1109/IPDPS.2000.846030
  23. Triana, An open source problem solving environment, http://www.triana.co.kr
  24. Kyu Hong Kim, Chongam Kim and Oh Hyun Rho, 'Accurate Computations of Hypersonic Flows Using AUSMPW+ Scheme and Shock-alignedgrid Technique,' AIAA 98-2422, 1998
  25. Yoon, S., and Jameson, A, 'Lower-Upper SymmerticGauss-Seidel Method for the Euler and Navier-Stokes Equations,' AIAA Journla, Vol 26, No.9, pp. 1025-1026, 1988 https://doi.org/10.2514/3.10007