Browse > Article

VIA-Based PC Cluster System for Efficient Information Retrieval  

Kang, Na-Young (삼성전자 무선사업부)
Chung, Sang-Hwa (부산대학교 컴퓨터공학과)
Jang, Han-Kook (부산대학교 컴퓨터공학과)
Abstract
PC cluster-based Information Retrieval (IR) systems improve their performances by parallel processing of query terms using cluster nodes. However TCP/IP based communication used to exchange data between cluster nodes prevents the performance from being improved further. The user-level communication mechanisms solve the problem by eliminating the time-consuming kernel access in exchanging data between cluster nodes. The Virtual Interface Architecture (VIA) is one of the representative user-level communication mechanisms which provide low latency and high bandwidth. In this paper, we propose a VIA-based parallel IR system on a PC cluster. The IR system is implemented using the following three communication methods: Sealable Coherent Interface (SCI) based VIA, MPI on SCI based VIA, MPI on Fast Ethernet based VIA. Through experiments, the performances of the three methods are analyzed in various aspects.
Keywords
IR; VIA; SCI; MPI; PC Cluster; Parallel Processing;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 Sharma, R., 'A Generic Machine for Parallel Information Retrieval,' Information Processing and Management, Vol. 25, No.3, pp. 223-235, 1989   DOI   ScienceOn
2 Cringean, J. K., England, R., Manson, G. A. and Willett, P., 'Network Design for the Implementation of Text Searching Using a Multicomputer,' Information Processing & Management, Vol. 27, No.4, pp. 265-283, 1991   DOI   ScienceOn
3 Stanfill, C and Thau, R., 'Information Retrieval on the Connection Machine: 1 to 8192 Gigabytes,' Information processing & Management, Vol. 27, No.4, pp. 285-310, 1991   DOI   ScienceOn
4 http://www.qlogic.com/products/sanblade/sanblade_ 2300.asp
5 Chung, S., Kwon, B., Ryu, K., Jang, B., Kim, J, and Choi, C, 'Parallel Information Retrieval on an SCI-Based PC-NOW,' Lecture Notes in Computer Science, 1800, pp. 81-90, May 2000
6 Buonadonna, P., Geweke, A. and Culler, A., 'An Implementation and Analysis of the Virtual Interface Architecture,' Proceedings of SC98, Orlando, Florida, United States, November 1998   DOI
7 http://www.nersc.gov/research/FTG/mvich/index.html
8 Chung, S., Kwon, H., Ryu, K., Chung, Y., jang, B. and Choi, C, 'Information Retrieval on an SCI-Based PC Cluster,' Journal of Supercomputing, Vol. 19, Issue 3, pp. 251-265, July 2001   DOI
9 http://www.emulex.com/products/vi/clan1000.html
10 Trams, M., Schlosser, R. and Rehm, W., 'Design Choices and First Results of Our VIA-Capable PCI-SCI Bridge,' Proceedings of CLUSTER 2000, pp. 349-350, Chemnitz, Germany, November 2000
11 Giacomini, F., Amundsen, T., Bogaerts, A., Hauser, R., Johnsen, B. D., Kohmann, B., Nordstrom, R. and Werner, P., 'Esprit Project 23174 - Software Infrastructure for SCI (SISC/), Version 2.1.1,' White Paper, Dolphin Interconnect Solutions, 1999
12 http://www.nersc.gov/research/FTG/via
13 Shin, J., Chung, S. and Hahn, W., 'An SCI-based Software VIA System for PC Clustering,' 2001 IEEE International Conference on Cluster Computing, Newport Beach, United States, October 2001   DOI
14 Microprocessor and Microcomputer Standards Subcommittee, 'IEEE Standard for Scalable Coherent Interface,' IEEE Std 1596-1992, IEEE Computer Society, August 1993
15 Basu, A., Buch, V., Vogels, W. and von Eiken, T., 'UrNet: A User-Level Network Interface for Parallel and Distributed Computing,' Proceeding of the 15th ACM Symposium on Operating Systems Principles, pp. 40-53, Copper Mountain, Colorado, United States, December 1995   DOI
16 Blumrich, M., Dubnichi, C., Felten, E. W. and Li, K., 'Virtual Memory-Mapped Network Interfaces,' IEEE Micro, pp. 21-28, February 1995   DOI   ScienceOn
17 Mainwaring, A. and Culler, C., 'Active Message Applications Programming Interface and Communication Subsystem Organization,' Technical Document, 1995
18 Pakin, S., Kararncheti, V. and Chien, A. A., 'Fast Messages (FM): Efficient, Portable Communication for Workstation Clusters and Massively-Parallel Processors,' IEEE Concurrency, Vol. 5, No.2, pp. 60-73, 1997   DOI