Browse > Article

A VIA-based RDMA Mechanism for High Performance PC Cluster Systems  

Jung In-Hyung (삼성전자 무선사업부)
Chung Sang-Hwa (부산대학교 컴퓨터공학과)
Park Sejin (부산대학교 컴퓨터공학과)
Publication Information
Journal of KIISE:Computer Systems and Theory / v.31, no.11, 2004 , pp. 635-642 More about this Journal
Abstract
The traditional communication protocols such as TCP/IP are not suitable for PC cluster systems because of their high software processing overhead. To eliminate this overhead, industry leaders have defined the Virtual Interface Architecture (VIA). VIA provides two different data transfer mechanisms, a traditional Send/Receive model and the Remote Direct Memory Access (RDMA) model. RDMA is extremely efficient way to reduce software overhead because it can bypass the OS and use the network interface controller (NIC) directly for communication, also bypass the CPU on the remote host. In this paper, we have implemented VIA-based RDMA mechanism in hardware. Compared to the traditional Send/Receive model, the RDMA mechanism improves latency and bandwidth. Our RDMA mechanism can also communicate without using remote CPU cycles. Our experimental results show a minimum latency of 12.5${\mu}\textrm{s}$ and a maximum bandwidth of 95.5MB/s. As a result, our RDMA mechanism allows PC cluster systems to have a high performance communication method.
Keywords
VIA; RDMA; Gigabit Ethernet; PC Clustering;
Citations & Related Records
연도 인용수 순위
  • Reference
1 ftp://ftp.compaq.com/pub/supportinformation/papers/tc000602wp.pdf
2 '고성능 클러스터 시스템을 위한 VIA 기반 네트워크 카드의 구현', 박세진, 정상화, 윤인수, 정인형, 이소명, 한국정보과학회 병렬처리시스템연구회, 2003. 11
3 http://www.nersc.gov/research/FTG/via
4 http://www.millennium.berkeley.edu/via.php3, P. Buonadonna, A. Begel, D. Gay, and D. Culler, 'An Analysis of VI Architecture Primitives in Support of Parallel and Distributed Communication,' Apr. 2000
5 Emulex Corporation, Hardware-based (ASIC) implementation of the Virtual Interface standard, http://www.emulex.com/products/legacy/vi/clan1000.html
6 Myricom, The GM Message Passing System, 10/16/1999
7 Various. Infiniband tutorials. In Proceedings of the I/O Technology Forum and Expo and Server I/O 2000, Monterey, CA, February 2000. http://www.sresearch.com
8 C. Dubnicki, A. Bilas, K. Li, and J. Philbin, 'Design and Implementation of Virtual Memory-Mapped communication on Myrinet,' presented at Proceedings of the International Parallel Processing Symposium, pp, 388-396, 1997   DOI
9 S. Pakin, M. Lauria, and A. Chien. 'High Performance Messaging on Workstations: Illinois Fast Messages(FM) for Myrinet,' Proc. of the Supercomputing'95, December 3-8, 1995   DOI
10 Virtual Interface Architecture Specification. http://www.viarch.org/
11 T. von Eicken, D. E. Culler, S. C. Goldstein, and K. E. Schauser, 'Active Messages: A Mechanism for Integrated Communication and Computation,' 19th International Symposium on Computer Architecture, May 1992   DOI
12 T. von Eicken, A. Basu, V. Buch, and W. Vogels. 'U-Net: A User-level Network Interface for Parallel and Distributed Computing,' Proc, of the 15th ACM Symposium on Operating Systems Principles (SOSP), Colorado, December 3-6, 1995   DOI
13 J. Kay and J. Pasquale, 'Profiling and Reducing Processing Overheads in TCP/IP,' IEEE/ACM Transactions on Networking, Vol. 4, No.6, pp, 817-828, Dec. 1996   DOI   ScienceOn
14 R. A.F. Bhoedjang, T. Ruhl, and H. E. Bal, 'User-Level Network Interface Protocols,' IEEE Computer, Vol. 31, No. 11, pp, 53-60, Nov. 1998   DOI   ScienceOn
15 IEEE: Standard for Scalable Coherent Interface (SCI) IEEE Std.l596-1992, IEEE Computer Society, Aug. 1993
16 D. D. Clark, V. Jacobson, J. Romkey, H. Salwen, 'An Analysis of TCP Processing Overhead,' IEEE Communications Magazine , pp. 23-29, June 1989   DOI   ScienceOn
17 N. J. Boden, D. Cohen, R. E. Felderman, A. E. Kulawik, C. L. Seitz, J. N. Seizovic, W. Su, 'Myrinet A Gigabit per second Local Area Network,' IEEE Micro, 1995   DOI   ScienceOn