Journal of KIISE:Information Networking (한국정보과학회논문지:정보통신)

Korean Institute of Information Scientists and Engineers (한국정보과학회)
권호 표지

Dynamic Resource Ranking and Grouping Algorithm for Grid Computing

그리드 컴퓨팅을 위한 동적 자원 랭킹 및 그룹핑 알고리즘

  • 이진성 (LG전자 MC사업본부) ;
  • 박기진 (아주대학교 산업정보시스템공학부) ;
  • 최창열 (아주대학교 정보통신전문대학원) ;
  • 김성수 (아주대학교 정보통신대학)
  • Published : 2005.08.01
Download PDF
⟨ Previous Next ⟩

Abstract

The high-speed network permits Grid computing to handle large problem of management areas and share various computational resources. As there are many resources and changes of them in Grid computing, the resources should be detected effectively and matched correctly with tasks to provide high performance. In this paper, we propose a mechanism that maximizes the performance of Grid computing systems. According to a priority, grade and site of heterogeneous resources, we assign tasks to those resources. Initially, a volunteer's priority and ranking are determined by static information like as CPU speed, RAM size, storage size and network bandwidth. And then, the rank of resources is decided by considering dynamic information such as correctness, response time, and error rate. We find that overall Grid system performance is improved and high correctness using resource reallocation mechanism is achieved.

고속 네트워크의 등장으로 관리 영역을 초월한 계산 자원의 공유가 가능한 그리드 컴퓨팅 개념이 등장하게 되었다. 그리드 컴퓨팅 환경에 포함된 각 자원들은 이질적이기 때문에 고성능을 얻기 위해서는 효과적인 자원 발견 및 자원 선택이 중요하다. 본 논문에서는 그리드 컴퓨팅에서 다양하고 이질적인 자원들을 각 응용 프로그램에서 효율적으로 이용할 수 있도록, 각 참여자들에게 순위를 부여하고 각 작업(Task)에 적절한 자원을 할당하여 전반적인 시스템 성능을 극대화시키는 메커니즘을 제안하였다. 각 참여자의 순위는 초기에 각 참여자별 자원의 시스템 사양(예:CPU 속도, RAM 크기)등 정적 요소를 고려하여 결정되며, 추후에는 각 참여자들이 작업을 마친 후 제공되는 반환 값의 정확도, 응답시간과 같은 요소를 고려하여 동적으로 수행될 수 있도록 하였다. 이러한 순위에 따른 작업 재분배 메커니즘은 전체적인 시스템 성능을 향상시키고 정확도를 높인다.

Keywords

References

  1. I. Foster and C. Kesselman, 'Globus: A Metacomputing Infrastructure Toolkit,' The International Journal of Supercomputer Applications and High Performance Computing, Vol. 11, No. 2, pp. 115-128, Oct. 1997 https://doi.org/10.1177/109434209701100205
  2. K. Krauter, R. Buyya, and M. Maheswaran, 'A Taxonomy and Survey of Grid Resource Management Systems for Distributed Computing,' Software Practice and Experience Journal, Vol. 32, No. 2, pp. 135-164, Feb. 2002 https://doi.org/10.1002/spe.432
  3. I. Foster, C. Kesselman, J. Nick, and S. Teucke, 'Grid Services for Distributed System Integration,' IEEE Computer, Vol. 35, No. 6, pp. 37-46, June 2002 https://doi.org/10.1109/MC.2002.1009167
  4. K. Czajkowski, I. Foster, and C. Kesselman, 'Resource Co-Allocation in Computational Grids,' Proceedings of the 8th IEEE International Symposium on High Performance Distributed Computing, pp. 219-228, Aug. 1999
  5. C. Liu, L. Yang, I. Foster, and D. Angulo, 'Design and Evaluation of a Resource Selection Framework for Grid Applications,' Proceedings of the 11th IEEE Symposium on High-Performance Distributed Computing, pp. 63-72, July 2002 https://doi.org/10.1109/HPDC.2002.1029904
  6. J.P. Goux, S. Kulkarni, M. Yoder, and J. Linderoth, 'An Enabling Framework for Master-Worker Applications on the Computational Grid,' Proceedings of the 9th IEEE International Symposium on High Performance Distributed Computing, pp. 214-217, Aug. 2000
  7. E. Heymann, M.A. Senar, E. Luque, and M. Livny, 'Evaluation of an Adaptive Scheduling Strategy for Master-Worker Applications on Clusters of Workstations,' Proceedings of the 7th International Conference on High Performance Computing, pp. 310-319, Dec. 2000
  8. L. Sarmenta, 'Sabotage-Tolerance Mechanisms for Volunteer Computing Systems,' Proceedings of the 1st ACM/IEEE International Symposium on Cluster Computing and the Grid, pp. 337-346, May 2001 https://doi.org/10.1109/CCGRID.2001.923211
  9. R. Oldfield and D. Katz, 'Armada: a Parallel File System for Computational Grids,' Proceedings of the 1st ACM/IEEE International Symposium on Cluster Computing and the Grid, pp. 194-201, May 2001 https://doi.org/10.1109/CCGRID.2001.923193
  10. F. Truck, S. Vanhaste, B. Volckaert, and P. Demeester, 'A Generic Middleware-based Platform for Scalable Cluster Computing,' Future Generation Computer Systems, Vol. 18(4), pp. 549-560, 2002 https://doi.org/10.1016/S0167-739X(01)00078-4
  11. Q. Snell, K. Tew, J. Ekstrom, and M. Clement, 'An Enterprise-Based Grid Resource Management System,' Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing. pp. 83-92, July 2002 https://doi.org/10.1109/HPDC.2002.1029906
  12. L. Sarmenta, 'Studying Sabotage-Tolerance Mechanisms through Web-based Parallel Parametric Analysis and Monte Carlo Simulation,' Proceedings of the International Conference on Internet Computing, Vol. 2, pp. 557-563, June 2001
  13. L. Sarmenta, S. Hirano, and S. Ward, 'Towards Bayanihan: Building an Extensible Framework for Volunteer Computing Using Java,' ACM Workshop on Java for High-Performance Network Computing in Concurrency: Practice and Experience, Vol. 10(11-13), pp. 1015-1019, 1998 https://doi.org/10.1002/(SICI)1096-9128(199809/11)10:11/13<1015::AID-CPE410>3.0.CO;2-C
  14. L. Sarmenta, 'An Adaptive, Fault-Tolerant Implementation of BSP for Java-based Volunteer Computing Systems,' Proceedings of the 13th International Parallel Processing Symposium on Parallel and Distributed Computing, LNCS 1586, pp. 763-780, Apr. 1999 https://doi.org/10.1007/BFb0097965
  15. L. Sarmenta, 'Bayanihan: Web-Based Volunteer Computing Using Java,' Proceedings of the 2nd International Conference on World-Wide Computing and its Applications, pp. 444-461, Mar. 1998
  16. Z. Xu, X. Hou, and J. Sun, 'Ant Algorithm-based Task Scheduling in Grid Computing,' IEEE Canadian Conference on Electrical and Computer Engineering, Vol. 2, pp. 1107-1110, May 2003 https://doi.org/10.1109/CCECE.2003.1226090
  17. C. Chu, J. Gu, X. Hou, and Q. Gu, 'A Heuristic Ant Algorithm for Solving QoS Multicast Routing Problem,' Proceedings of the 2002 Congress on Evolutionary Computation, Vol. 2, pp. 1630-1635, May 2002
  18. K. Subramoniam, M. Maheswaran, and M. Toulouse, 'Towards a Micro- Economic Model for Resource Allocation in Grid Computing Systems,' IEEE Canadian Conference on Electrical and Computer Engineering, Vol. 2, pp. 782-785, May 2002 https://doi.org/10.1109/CCECE.2002.1013041
  19. J. Cao, D.P. Spooner, S.A. Jarivs, S. Saini, and G.R. Nudd, 'Agent-Based Grid Load Balancing using Performance-driven Task Scheduling,' Proceedings of the 17th IEEE International Parallel and Distributed Processing Symposium, pp. 49-58, Apr. 2003 https://doi.org/10.1109/IPDPS.2003.1213139
  20. J. Cao, S.A. Jarvis, D.P. Spooner, J.D. Turner, D.J. Kerbyson, and G.R. Nudd, 'Performance Prediction Technology for Agent-based Resource Management in Grid Environments,' Proceedings of the 16th IEEE International Parallel and Distributed Processing Symposium, pp. 86-99, Apr. 2002
  21. S. Corsava and V. Getov, 'Agent-based Service Management in Large Datacenters and Grids,' Proceedings of the 3rd ACM/IEEE International Symposium on Cluster Computing and the Grid, pp. 633-640, May 2003
  22. J. Cao, D.J. Kerbyson, and G.R. Nudd, 'Performance Evaluation of an Agent-based Resource Management Infrastructure for Grid Computing,' Proceedings of the 1st ACM/IEEE International Symposium on Cluster Computing and the Grid, pp. 311-318, 2001 https://doi.org/10.1109/CCGRID.2001.923208
  23. D.P. Spooner, S.A. Jarvis, J. Cao, S. Saini, and G.R. Nudd, 'Local Grid Scheduling Techniques using Performance Prediction,' IEEE Computer and Digital Techniques, Vol. 150, pp. 87-96, Mar. 2003 https://doi.org/10.1049/ip-cdt:20030280