Browse > Article

Comparing Cilk and MPI on a heterogeneous cluster system  

Lee, Kyu-Ho (School of Electrical and Electronics Engineering, Chung-Ang University)
Kim, Jun-Seong (School of Electrical and Electronics Engineering, Chung-Ang University)
Publication Information
Abstract
Recently cluster system built from personal computers and network devices are easily and economically constructed. Rapid technological change discloses new processors on the market yielding cluster systems heterogeneity. A parallel system in heterogeneous environment needs work managers for utilizing the full power of the heterogeneous cluster system. In this paper, we compare MPI and Cilk in a heterogeneous cluster system in terms of performance and code complexity. Experimental results show that Cilk is better than MPI with small sizes of data transfers while MPI outperforms Cilk with big sizes of data transfers. Also, We find that Cilk requires less programming efforts to write a parallel program.
Keywords
heterogeneous cluster system; MPI; Cilk; parallel programming; code complexity;
Citations & Related Records
연도 인용수 순위
  • Reference
1 S. Baek, K. Lee, J. Kim and J. Morris, 'Heterogeneous Network of Workstations', Lecture Note on Computing Science, Vol. 3189, Springer-Verilag, pp. 426-439, 2004
2 S. VanderWiel, D. Nathanson and D. J. Lilja, 'Complexity and Performance in Parallel Programming Languages', International Workshop on High-Level Parallel Programming Models and Supportive Environments, pp. 3-12, April 1997
3 Y. K. Kwok, 'On exploiting heterogeneity for cluster based parallel multithreading using task duplication', Journal of Supercomputing, 2003
4 M. Snir, 'MPI: The complete reference', MIT Press, MA: Cambridge, USA, 1996
5 W. Gropp, E. Lusk, N. Doss, and A. Skjellum, 'A high-performance, portable implementation of the MPI message passing interface standard,' Parallel Computing, vol. 22, no. 6, pp. 789–828, Sep 1996
6 L. T. Yang and M. Guo, 'High-Performance Computing: Paradigm and Infrastructure', John Wiley & Sons, 2006
7 K. Lee and J. Kim, 'Performance and Complexity of Prallel Programming', Joint Conference on Communications and Information, pp75, 2005
8 R. D. Blumofe, C. F. Joerg, B. C. Kuszmaul, C. E. Leiserson, K. H. Randall, and Y. Zhou, 'Cilk: an efficient multithreaded runtime system,' in PPoPP'95, Santa Barbara, 1995
9 R. Buyya, 'High-Performance Cluster Computing: Architectures and Systems', Prentice Hall PTR, 1999