Browse > Article
http://dx.doi.org/10.3745/KIPSTB.2006.13B.6.615

The Parallel ANN(Artificial Neural Network) Simulator using Mobile Agent  

Cho, Yong-Man (해양센서네트워크시스템 기술연구센터)
Kang, Tae-Won (강릉대학교 컴퓨터공학과)
Publication Information
The KIPS Transactions:PartB / v.13B, no.6, 2006 , pp. 615-624 More about this Journal
Abstract
The objective of this paper is to implement parallel multi-layer ANN(Artificial Neural Network) simulator based on the mobile agent system which is executed in parallel in the virtual parallel distributed computing environment. The Multi-Layer Neural Network is classified by training session, training data layer, node, md weight in the parallelization-level. In this study, We have developed and evaluated the simulator with which it is feasible to parallel the ANN in the training session and training data parallelization because these have relatively few network traffic. In this results, we have verified that the performance of parallelization is high about 3.3 times in the training session and training data. The great significance of this paper is that the performance of ANN's execution on virtual parallel computer is similar to that of ANN's execution on existing super-computer. Therefore, we think that the virtual parallel computer can be considerably helpful in developing the neural network because it decreases the training time which needs extra-time.
Keywords
Artificial Neural Networks; Error Back-Propagation; Parallel ANN Simulator; Mobile Agents; Parallel Distributed Computing;
Citations & Related Records
연도 인용수 순위
  • Reference
1 D. Chess, C. Harrison, A. Kershenbaum, 'Mobile Agents: Are they a good idea?', IBM T,J Watson Research Center, 1995
2 David Kotz, Robert S. Gray, 'Mobile Agents and the Future of the Internet', http://www.cs.dartmouth.edu, 1999
3 N. Sundararajan, 'Parallel Architectures for Artificial Neural Networks: Paradigms and Implementations', wiley, pp. 49. 2002
4 Oh-Kyoung Kwon , Jaegyoon Halun, Sangwan Kim, and jongsuk Lee , 'A Grid Resource Allocation System for Scientific Application: Grid Resource Allocation Services Package (GRASP)' Mardi Gras Conference, 2005
5 A. Zell, N. Mache, T. Sommer and T. Korb, 'Recent Developments of the SNNS Neural Network Simulator', Proc. Applications of Neural Networks Conference SPIE:, 708-719, 1991
6 C. R. Rosenberg and G. Blelloch, 'An hnplementation of Network Learning on the CM', Proc. Joint Conference Artificial Intelligence, 329-340, 1987
7 D. A. Pomerleau, G. L. Gusciora, D. S. Touretzxy and H. T. Kung, 'Neural Network Simulations at Warp Speed: How We Got 17 Million Connections per Second', Proc. IEEE lCNN. San Diego, 143-150, 1988   DOI
8 J-H. Chung, H. Yoon and S. R. Maeng, 'A Systolic array Exploiting the Inherent Parallelism of Artificial Neural Networks', Microprocessing and Microprogramming, Vol. 33, No.3, 145-159, 1991/92   DOI   ScienceOn
9 R. Straub, D. Schwarz and E. Schoneburg, 'Simulation of backpropagation networks on transputers', Neurocomputing, Vol. 2, No. 5&6, 199-208, 1991
10 O. Badawy,: A. Alrnotwaly, 'Combining neural network knowledge in a mobile collaborating multi-agent system' Electrical, Electronic and Computer Engineering, 2004. ICEEC apos; 04, 2004
11 Manavendra Misra, 'Parallel Environments for Implementing Neural Networks', Neural Computing Surveys Vol. 1, 48-60, 1997. http://www.icsi.berkeley.edu/~jagota/NCS
12 Gerd Kock and Nikola B. Serbedzija, 'Simulation of Artificial Neural Networks', SAMS, Vol. 27, 15-59, 1996
13 Erich Schikuta, 'Structural Data Parallel Neural Network Simulation', 1997, http://citeseer.nj.nec.com/29242.html.
14 X. Zhang, M. Mckenna, J. P. Mesrov and D. L. Waltz, 'The backpropagation algorithm on grid and hypercube architectures', Parallel Computing, Vol. 14, No. 3, 317-327, 1990   DOI   ScienceOn
15 ？？Nikola B. Serbedzija, 'Simulating Artificial Neural Networks on Parallel Architectures', Computer, Vol. 29, No.3, 56-133, 1996   DOI   ScienceOn
16 Mario Tokoro, 'Agents: Towards a Society in Which Humans and Computers Cohabitate', in Distributed Software Agents and Applications, Springer, pp. 1-10., 1995
17 Pacheco P., Parallel Programming with MPI, Morgan Kaufmann, 1997
18 William Gropp, Ewing Lusk, Anthony Skjellum, Using MPI: Portable Parallel Programming with the Message-Passing Interface, MIT Press, 1996
19 Danny B.L., Mitsuru O., Programming and Deploying Java Mobile Agents with Agelets, Addison-Wesley, 1998
20 T. R. Ioerger, R. A. Volz, J. Yen, 'Modeling Cooperative, Reactve Behaviors on the Battlefield Using Intelligent Agents.', Proceedings of the Ninth Conference on Computer Generated Forces (9th CGF) , pp. 13-23, 2000
21 M. Miller, J. Yin, R.A. Volz, T.R. Ioerger, J. Yen, 'Training Teams with Collaborative Agents.', Proceedings of the Fifth International Conference on Intelligent Tutoring Systems, (ITS-2000, pp. 63-72, 2000