초고속 Myrinet 통신망에서의 PVM 성능 개선

PVM Performance Enhancement over a High-Speed Myrinet

  • 김인수 (한국전자통신연구원) ;
  • 심재홍 (아주대학교 대학원 정보 및 컴퓨터공학부) ;
  • 최경희 (아주대학교 정보 및 컴퓨터공학부) ;
  • 정기현 (아주대학교 전기전자공학부) ;
  • 문경덕 (한국전자통신연구원) ;
  • 김태근 (한국전자통신연구원)
  • 발행 : 2000.01.01

초록

본 논문에서는 초고속 통신망인 Myrinet을 기반으로 하는 워크스테이션 연동(network of workstations) 환경하에서 병렬 프로그래밍 모델을 지원하는 PVM (parallel virtual machine)의 통신 성능 개선 방안을 제시한다. PVM을 위해 새로이 제안하는 Myrinet 기반 통신 모델은 커널을 경유하는 기존의 UDP/IP 프로토콜을 이용하는 통신 모델과 Myrinet API를 직접 이용하는 통신 모델을 혼합한 복합 통신 모델이다. 제안된 복합 통신 모델은 사용자 영역(커널)에서 커널(사용자) 버퍼로의 메시지 복사 부하를 제거하고 커널내의 프로토콜 스택 처리를 위한 통신 지연 요인을 감소시키므로, Myrinet상에서 보다 빠른 PVM 테스크간의 데이터 전송 속도를 보장한다. 또한, UDP/IP를 사용하는 기존 PVM에 본 논문에서 제안된 Myrinet 기반 복합 통신 모델을 적용시킨 EPVM (Enhanced PVM)을 구현하고, 이의 성능을 측정하였다. 실험 결과 EPVM의 통신 성능이 기존 PVM 보다 평균 1.5배 정보 우수하다는 것을 확인하였다.

PVM (parallel virtual machine) provides a programming environment that allows a collection of networked workstations to appear as a single parallel computational resource. The performance of parallel applications in this environment depends on the performance of data transfers between tasks. In this paper, we present a new Myrinet-based communication model of PVM that improves PVM communication performance over a high-speed Myrinet LAN. The proposed PVM communication model adopts a communication mechanism that allows any user-level process to directly access the network interface board without going through UDP/IP protocol stacks in the kernel. This mechanism provides faster data transfers between PVM tasks over the Myrinet since it avoids data copy overhead from kernel (user space) to user space (kernel) and reduces communication latency due to network protocol software layers. We implemented EPVM (Enhanced PVM), our updated version of the traditional PVM using UDP/IP, that is based on the proposed communication model over the Myrinet. Performance results show EPVM achieves communication speed-up of one to two over the traditional PVM.

키워드

참고문헌

  1. A. Geist, A. Beguelin, J.Dongarra, W.Jiang,R. Manchek, and V. Sunderamm, 'PVM 3 User's Guide and Reference manual,' Oak Ridge National Laboratory, Oak Ridge, Tennesee 37831, Sept. 1994
  2. R. J. Manchek, 'Design and Implementation of PVM Version 3,' Master Thesis, University of Tennessee, Knoxville, May 1994
  3. N. Boden, D. Cohen, R. Felderman, A. Kulawik, C. Seitz, J. Seizovic, and W. K. Su, 'Myrinet: A Gigabit-per-Second Local Area Network,' IEEE Micro, Vol.15, No.1, pp.29-36, Feb. 1995 https://doi.org/10.1109/40.342015
  4. Myricom, 'Myrinet Performance Measurements,' http://www.myri.com/myrinet/performance/index.html
  5. H. Zhou and A. Geist, 'Faster Message Passing in PVM,' 9th International Parallel Processing Symposium : Workshop on High Speed Network Computing, Santa Barbara, April 1995
  6. J. M. Blum, T. M. Warschko, and W. F. Tichy, 'PSPVM : Implementing PVM on a high-speed Interconnect for Workstation Clusters,' Technical Report 17/95, University of Karlsruhe, Dept. of Informatics Postfach, Karlsruhe, Germany, 1996
  7. T. M. Warschko, J. M. Mum, and W. F. Tichy, 'The ParaPC/ParaStation Project: Efficient Parallel Computing by Clustering Workstations,' Technical Report 13/95, University of Karlsruhe, Dept. of Informatics Postfach, Karlsruhe. Germany, 1996
  8. H. Xu and T. Fisher, 'Improving PVM Performance Using the ATOMIC User-Level Protocol,' The High-Speed Network Computing Workshop '95, 1995
  9. S. L. Chang, David H.C. Du, J. Hsieh, M. Lin, and R. P. Tsang, 'Enhanced PVM Communications over a High-Speed Local Area Network,' IEEE Parallel & Distributed Technology, pp.20-32, Fall 1991 https://doi.org/10.1109/M-PDT.1995.414841
  10. J. Hsieh, David H C. Du, N. J. Troullier and M Lin, 'Enhanced PVM Communications over a HIPPI Local Area Network,' Proceedings of the 2nd International Workshop on High-Speed Network Computing (HiNet '96), Honolulu, April 1996
  11. A. Basu, M. Welsh, and T. von Eicken, 'Incorporating Memory Management into User-Level Network Interfaces,' Department of Computer Science, Cornell University, Submitted for publication, Nov. 1996
  12. M. Welsh, A. Basu, and T. von Eicken, 'Low-Latency Communication over Fast Ethernet,' Proceedings of Euro-Par '96, Lyon, France, Aug. 1996
  13. A. Basu, V. Buch, W. Vogels, and T. von Eicken, 'U-Net : A User-Level Network Interface for Parallel and Distributed Computing,' Proceedings of the 15th ACM Symposium on Operating System Principles (SOSP), Copper Moutain, Colorado, Dec. 1995
  14. S. Pakin, V. Karamcheti, and A. Chien, 'Fast Messages : Efficient, Portable Communication for Workstation Clusters and Massively-Parallel Processors,' IEEE Concurrency, 1997 https://doi.org/10.1109/4434.588295
  15. H. Tezuka, F. O'Carroll, A. Ron, and Y. Ishikawa, 'Pin-down Cache: A Virtual Memory Management Technique for Zero-copy Communication,' Technical Report, Tsukuba Research Center, Real World Computing Partnership, 1997
  16. T. von Eicken, D. E. Culler, S. C. Goldstein, and K. E. Schauser, 'Active Messages: a Mechanism for Integrated Communication and Computation,' Proceedings of the 19th Annual International Symposium on Computer Architecture, May 1992 https://doi.org/10.1145/139669.140382
  17. M. Beck, R. Bohme, M. Dziadzka, U. Kunitz, R. Magnus, and D. Verworner, 'Linux Kernel lnternaIs,' Addison-Wesley, 1996
  18. M. K. McKusick, K. Bostic, M. J. Karels, and J. S. Quarterman, 'The Design and Implementation of the 4.4 BSD Operating System,' Addison-Wesley, pp. 137-146, 1996
  19. T. E. Anderson, D. E. Culler, and D. A. Patterson, 'A Case for NOW (Network of Workstations),' IEEE Micro, Vol.15, No.1, pp.54-64, Feb. 1995 https://doi.org/10.1109/40.342018
  20. H. Tezuka, A. Hori, and Y. Ishikawa, 'PM: A High-Performance Communication Library for Multiuser Parallel Environments,' Technical Report TR-96-015, Tsukuba Research Center, Real World Computing Partnership, Japan, Nov. 1996