The KIPS Transactions:PartA (정보처리학회논문지A)

Korea Information Processing Society (한국정보처리학회)
권호 표지
DOI QR코드

DOI QR Code

A Synchronous/Asynchronous Hybrid Parallel Power Iteration for Large Eigenvalue Problems by the MPMD Methodology

MPMD 방식의 동기/비동기 병렬 혼합 멱승법에 의한 거대 고유치 문제의 해법

  • Published : 2004.02.01
Download PDF
⟨ Previous Next ⟩

Abstract

Most of today's parallel numerical schemes use synchronous algorithms, where some processors that have finished their tasks earlier than others must wait at synchronization points for correct computation. Hence overall performance of the system is dependent upon the speed of the slowest processor. In this paper, we det·ise a synchronous/asynchronous hybrid algorithm to accelerate convergence of the solution for finding the dominant eigenpair of a large matrix, by reducing the idle times of faster processors using MPMD programming methodology.

대부분의 병렬 알고리즘은 동기 알고리즘으로, 올바른 계산을 위해 작업을 일찍 끝낸 빠른 프로세서들은 동기점에서 느린 프로세서를 기다려야 하는데, 프로세서들의 성능이 다를 경우 연산 속도는 가장 느린 프로세서에 의해 결정된다. 본 논문에서는 거대 고유치 문제의 주요 고유쌍을 구하는 문제에 있어서 빠른 프로세서의 유휴 시간을 줄여 수렴 속도를 가속한 수 있는 동기/비동기 혼합 알고리즘을 고안하고 이를 MPMD 프로그래밍 방식을 사용하여 구현하였다.

Keywords

References

  1. 박필성, 신순철, '비동기 알고리즘을 이용한 분산 메모리 시스템에서의 초대형 선형 시스템 해법의 성능 향상', 정보처리학회논문지A, 제8A, pp.439-446, 2001
  2. B. Baran, E. Kaszkurewicz and A. Bhaya, 'Parallel asynchronous team algorithms : Convergence and performance analysis,' IEEE Transactions on Parallel & Distributed Systems, Vol.7, pp.677-688, 1996 https://doi.org/10.1109/71.508248
  3. R. Bro, V. Migallon, J. Penades and D. B. Szyld, 'Parallel, synchronous and asynchronous two-stage multi splitting methods,' Electronic Transactions on Numerical Analysis, Vol.3, pp.24-38, 1995
  4. C. Chang, G. Czajkowski, T. von Eicken and C. Kesselman, 'Evaluating the performance limitation of MPMD communication,' In Proceedings of SC '97, San Jose, CA, pp.15-91, November, 1997 https://doi.org/10.1109/SC.1997.10040
  5. R. Cole, and Z. Ofer, 'An asynchronous parallel algorithm for undirected graph connectivity,' TR-546, Dept., of Computer Science, New York University, Feb., 1991
  6. I. T. Foster, 'Designing and building parallel programs,' Addison-Wesley Publishing Company, Reading, Massachusetts, 1995
  7. I. Foster, C. Kesselman and S. Tuecke, 'The anatomy of the Grid: Enabling scalable virtual organizations,' J. Supercomputer Applications, 15(3), 2001 https://doi.org/10.1177/109434200101500302
  8. A. Frommer, H. Schwandt and D. B. Szyld, 'Asynchronous weighted additive Schwarz methods,' Electronic Transactions on Numerical Analysis, Vol.5, pp.48-67, 1997
  9. L. Kaufman, 'Matrix methods for queuing problems,' SIAM Journal on Scientific & Statistical Computing, Vol.4, pp.525-552, 1983 https://doi.org/10.1137/0904037
  10. Ohio Supercomputing Center, 'MPI Primer/Developing with LAM,' 1996
  11. D. B. Szyld, 'Different models of parallel asynchronous iterations with overlapping blocks,' Computational and Applied Mathematics, Vol.17, pp.101-115, 1998
  12. A. Uresin and M. Dubois, 'Parallel asynchronous algorithms for discrete data,' Journal of ACM, Vol.37, pp.588-606, 1990 https://doi.org/10.1145/79147.79162