Browse > Article
http://dx.doi.org/10.3745/KIPSTB.2004.11B.6.735

Implementation of Neural Networks using GPU  

Oh Kyoung-su (숭실대학교 미디어학부)
Jung Keechul (숭실대학교 미디어학부)
Publication Information
The KIPS Transactions:PartB / v.11B, no.6, 2004 , pp. 735-742 More about this Journal
Abstract
We present a new use of common graphics hardware to perform a faster artificial neural network. And we examine the use of GPU enhances the time performance of the image processing system using neural network, In the case of parallel computation of multiple input sets, the vector-matrix products become matrix-matrix multiplications. As a result, we can fully utilize the parallelism of GPU. Sigmoid operation and bias term addition are also implemented using pixel shader on GPU. Our preliminary result shows a performance enhancement of about thirty times faster using ATI RADEON 9800 XT board.
Keywords
Graphics Processing Unit : GPU; Neural Network : NN; Multi-layer Perceptron : MLP; Text Detection; Image Processing;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Nazeih M. Botros and M. Abdul-Aziz, 'Hardware Implementation of an Artificial Neural Network Using Field programmable Gate Array(FPGA's)' IEEE Transactions on Industrial Electronics, Vol.41, No.6, December, 1994   DOI   ScienceOn
2 G. -P. K. Economou, E. P. Mariatos, N. M. Economopoulos, D. Lymberopoulos and C. E. Goutis, 'FPGA Implementation of Artificial Neural Networks : An Application on Medical Expert Systems,' 4th International Conference on Microelectronics for Neural Networks and Fuzzy Systems, Torino, Italy, pp.287-293, September, 1994   DOI
3 K. Jung, K. I. Kim and A. K. Jain, 'Text Information Extraction in Images and Video: A Survey,' International Journal of Pattern Recognition, Vol.37, Issue 5, pp.977-997, May, 2004   DOI   ScienceOn
4 D. Manocha, 'Interactive Geometric & Scientific Computations using Graphics Hardware,' SIGGRAPH 2003 Tutorial Course #11, 2003
5 Y. Zhong, H. Zhang and A. K. Jain, 'Automatic Caption Localization in Compressed Video,' IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.22, No.4, 2000   DOI
6 H. Li, D. Doerman and O. Kia, 'Automatic Text Detection and Tracking in Digital Video,' IEEE Transactions on Image Processing, Vol.9, No.1, pp.147-156, 2000   DOI   ScienceOn
7 J. Zhu and P. Sutton, 'FPGA Implementation of Neural Networks - a Survey of a Decade of Progress,' Proceedings of 13th International Conference on Field Programmable Logic and Applications (FPL 2003), 2003
8 Haykin, Neural Networks, Prentice Hall, 1999
9 Biebelmann, E., Koppen, M. and Nickolay, B., 'Practical Applications of Neural Networks in Texture Analysis,' Neurocomputing, Vol.13, pp.261-279, 1996   DOI   ScienceOn
10 R. Yang and G. Welch. 'Fast Image Segmentation and Smoothing Using Commodity Graphics Hardware,' the Journal of Graphics Tools, Vol.7, No.4, pp.91-100, 2003   DOI   ScienceOn
11 M. M. Trentacoste, 'Implementing Performance Libraries on Graphics Hardware,' Carnegie Mellon University Undergraduate Thesis, 2003
12 J. D. Hall, N. A. Carr and J. C. Hart, 'Cache and Bandwidth Aware Matrix Multiplication on the GPU,' Technical Report UIUCDCS-R-2003-2328, University of Illinois Dept. of Computer Science, Mar., 2003
13 Antonio d'Acierno, 'Back-Propagation Learning Algorithm and Parallel Computers: The CLEPSYDRA Mapping Scheme,' Neurocomputing, Vol.31, pp.67-85, 2000   DOI   ScienceOn
14 A. Moravanszky, 'Linear Algebra on the GPU,' in : W. F. Engel (Ed), Shader X2, Wordware Publishing, 2003
15 J. Kruger and R. Westermann, 'Linear Algebra Operators for GPU Implementation of Numerical Algorithms,' SIG-GRAPH 2003, 2003   DOI
16 K. Oh, B. Shin and Y. G. Shin, 'Mobility Culling-An Efficient Rendering Algorithm Using Temporal Coherence,' The Journal of Visualization and Computer Animation, Vol.12, Issue 3, pp.159-166, 2001   DOI   ScienceOn
17 E. S. Larsen and D. McAllister, 'Fast Matrix Multiplies using Graphics Hardware,' Proceedings of the 2001 ACM/IEEE Conference on Supercomputing, pp.55-55, 2001   DOI
18 K. Jung, 'Neural network-based Text Location in Color Images,' Pattern Recognition Letters, Vol.22, No.14, pp.1503-1515, 2001   DOI   ScienceOn
19 K. Y. Jeong, K. Jung, E. Y. Kim and H. J. Kim, 'Neural Network-based Text Location for News Video Indexing,' Proceedings of International Conference of Image Processing, 1999   DOI
20 A. K. Jain, B. Yu, 'Automatic Text Location in Images and Video Frames,' Pattern Recognition, Vol. 31, No. 12, pp. 2055-2076, 1998   DOI   ScienceOn