Design of Web-based Parallel Processing System using Performance-based Task Allocation

성능 기반 태스크 할당을 이용한 웹 기반 병렬처리 시스템의 설계

  • 한연희 (고려대학교 컴퓨터학과) ;
  • 박찬열 (고려대학교 컴퓨터학과) ;
  • 정영식 (원광대학교 컴퓨터정보통신학부) ;
  • 황종선 (고려대학교 컴퓨터학과)
  • Published : 2000.03.15

Abstract

Recent advances of technologies make easy sharing various information and utilizing system resources on the Internet. Especially, code migration using applets of Java supports the distribution of programs on the web environment, and also browsers executing the applets guarantee the reliability of a migrated codes. In this paper, we describe the design and implementation of a web-based parallel processing system, which distributes migratable codes of a large job, makes the distributed codes to execute in parallel, and controls and gathers the results of each execution. The hosts participate in the computation reside on the Internet, spreaded out geographically, and the heterogeneity and the variability among them are severe. Thus, task allocation considering the performance differences and the adaptability to the severe variability are necessary. We present an adaptive task allocation algorithm applied to our system and the performance evaluation.

최근 인터넷 환경에서의 기술 향상으로 인하여 다양한 정보를 공유하고, 네트워크로 연결된 여러 시스템 자원을 이용하는 것이 용이하게 되었다. 특히, 자바의 애플릿(applet)을 이용한 코드 이동(code migration) 기술은 인터넷의 웹 환경에서 프로그램의 분산을 용이하게 하며, 그 애플릿을 수행하는 브라우저는 이동된 코드의 신뢰성을 보장해준다. 본 논문은 웹 환경에서 이동 가능 코드를 분산시키고, 대량의 연산수행을 지닌 작업을 분배하여 병렬적으로 수행시킨 뒤, 그 결과를 취합하는 웹 기반 병렬 시스템의 설계 및 구현에 관하여 기술한다. 또한, 이 시스템에 참여하는 이질적인 다수의 호스트들은 인터넷이라는 환경에서 지리적으로 떨어져 연결되어 있으므로 성능의 차이 및 가변성을 예상하기 힘들다. 그러므로, 그들 간의 성능 차이를 고려한 태스크 할당 알고리즘 및 심각한 가변성에 대한 적응력이 요구된다. 이 논문에서는 시스템의 구현에 사용될 적응성 향상 기법을 제시하고, 시스템의 작업 처리 성능 및 제안하는 알고리즘들의 효율을 나타내는 성능 평가 결과를 제시한다.

Keywords

References

  1. R. A. Whiteside and J. S. Leichter, 'Using Linda for Supercomputing on a Local Area Network,' Technical Report YALEU/DCS/TR-638, Department of Computer Science, Yale Univ., New Haven, Connecticut, 1988
  2. J. Eric Baldeshwieler, Robert D. Blumofe, and Eric A. Brewer, 'ATLAS : An Infrastructure for Global Computing,' In Proc. of the 7th ACM SIGOPS European Workshop on System Support for World wide Applications, 1996 https://doi.org/10.1145/504450.504482
  3. K. M. Chandy, B. Dimitrov, H. Le, J. Mandleson, M. Richardson, A. Rifkin, P. A. G. Sivilotti, W. Tanaka, and L. Weisman, 'A World-Wide Distributed System Using Java and the Internet,' In Proc. of the 5th IEEE inn Symposium on High Performance Distributed Computing, Syracuse, NY, Aug., 1996
  4. A. Vahdat, P.Eastham, C.Yoshikawa, E.Belani, T.Anderson, D.Culler, and M.Dahlin, 'WebOS : Operating System Services For Wide Area Applications,' Technical Report CSD-97-938, UC Berkeley, 1997
  5. V. Sunderam, G. Geist, J. Dongarra, and R. Manchek, 'The PVM concurrent system: Evolution, experiences, and trends,' Parallel Computing, 1994 https://doi.org/10.1016/0167-8191(94)90027-2
  6. W. Gropp, E. Lusk, and A. Skiellum. Using MPI: Portable Parallel Programming with the Message- Passing-Interface, MIT Press, 1994
  7. A. Ferrari, 'JPVM - The Java Parallel Virtual Machine,' In the ACM Workshop on Java for High-Performance Network Computing, Feb., 1998
  8. Kenji Imasaki, 'JAPE The Java Parallel Environment,' In the 1997 International Scientific Computing in Object-Oriented Parallel Environments Conference, California, December, 1997
  9. Michael Philippsen and Matthias Zenger, 'JavaParty-Transparent Remote Objects in Java,' In the ACM Workshop on Java for Science and Engineering Computation, 1997
  10. Nataraj Nagaratnam, Arvind Srinivasan, and Doug Lea, 'Remote Objects in java(tm),' In the Proc. of IASTED International Conference on Networks, Jan., 1996
  11. Tim Brecht, Harjinder Sandhu, Meijuan Shan, and Jimmy Talbot, 'ParaWeb: Towards World-Wide Supercomputing,' In the Proc. of the 7th ACM SIGOPS European Workshop, pp.181-188, Sep., 1996 https://doi.org/10.1145/504450.504484
  12. Arash Baratloo, Mehmet Karaul, Zvi Kedem, and Peter Wyckoff, 'Charlotte : Metacomputing on the Web,' In Proc. of the 9th Int'l Conf. on Parallel and Distributed Computing Systems, Sep., 1996
  13. Bernd O. Christiansen, Peter C. Japello, Mithai F. Ionescu, Michael O. Neary, Klaus E. Shauser, and Danieal Wu, 'Javelin: Internet-based parallel computing using java,' In the ACM Workshop on Java for Science and Engineering Computation, 1997
  14. A. Alexandrov, M. Ibel, K. E. Schauser, and C. Scheiman, 'SuperWeb: Research Issues In Java-Based Global Computing,' In the Proc. of Concurrency: Practice and Experience, Jun., 1997
  15. Hernani Pedroso, Luis Silva, Jose M. Tavares and Joao Gabriel Silva, 'Web-based Metacomputing with JET,' In the ACM Workshop on Java for Science and Engineering Computation, 1997
  16. Noam Nisan, Shmulik London, Ori Regev, Noam Camiel, 'Globally Distributedcomputation over the internet - The POPCORN project,' the 6th Int'l World Wide Web Conference, Santa-Clara, Apr., 1997
  17. J. Dongarra, J. Bunch, D. Moler, and G. W. Stewart, 'LINPACK User's Guide,' SIAM, Philadelphia, PA, 1979
  18. J. Dongarra, 'Performance of Varios Computers Using Standard Linear Equations Software,' http://www.netlib.org/benchrnark/performance.ps. Aug., 1998 https://doi.org/10.1145/141868.141871
  19. R. L. Devaney, Chaos, Fractals, and Dynamics : Computer Experiments In Mathematics, Addison-Wesley, 1990
  20. F. Soares, L. M. Silva, and J. G. Silva, 'How to Get Volunteers for Web-based Metacomputing,' In Proc. of the Distributed Computing on the Web (DCW'98), Rostock, Germany. Jun., 1998
  21. 박지민, 명혜선, 한탁돈, 김신덕, 네트워크로 연결된 자바스테이션 상에서의 웹 컴퓨팅, 한국 정보과학회 봄 학술발표논문집, Vol. 25, No. 1, pp. 647-649, 1998