The Magazine of the IEIE (전자공학회지)

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지

뉴럴 네트워크의 뉴로모픽 하드웨어와 소프트웨어 공동설계

  • Published : 2017.06.25
Download PDF
⟨ Previous Next ⟩

Abstract

Keywords

References

  1. LeCun, Y., Bengio, Y., & Hinton, G., (2015), "Deep learning", Nature, 521(7553), pp. 436-444. https://doi.org/10.1038/nature14539
  2. Krizhevsky, A., Sutskever, I., and Hinton, G. E., 2012, "Imagenet classification with deep convolutional neural networks", Advances in neural information processing systems, pp.1097-1105.
  3. Alsharif, O., and Pineau, J., 2013, "End-to-end text recognition with hybrid HMM maxout models", arXiv preprint arXiv:1310.1811.
  4. Sharif R. A., Azizpour, H., Sullivan, J., and Carlsson, S., 2014, "CNN features off-the-shelf: an astounding baseline for recognition", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 806-813.
  5. Taigman, Y., Yang, M., Ranzato, M. A., and Wolf, L., 2014, "Deepface: Closing the gap to human-level performance in face verification", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp.1701-1708.
  6. LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., and Jackel, L. D, (1989), "Backpropagation applied to handwritten zip code recognition", Neural computation, 1(4), pp. 541-551. https://doi.org/10.1162/neco.1989.1.4.541
  7. Schemmel, J., Briiderle, D., Griibl, A., Hock, M., Meier, K., and Millner, S., 2010, "A wafer-scale neuromorphic hardware system for large-scale neural modeling", Proceedings of 2010 IEEE International Symposium on Circuits and Systems, pp. 1947-1950.
  8. Kim, Y. D., Park, E. H., Yoo, S.J., Choi, T. L., Yang, L., and Shin, D. J., 2015, "Compression of deep convolutional neural networks for fast and low power mobile applications", arXiv preprint arXiv:1511.06530.
  9. Wu, J., Leng, C., Wang, Y., Hu, Q., and Cheng, J., 2015, "Quantized Convolutional Neural Networks for Mobile Devices", arXiv preprint arXiv:1512.06473.
  10. Maas, A. L., Hannun, A. Y., and Ng, A. Y., 2013, "Rectifier nonlinearities improve neural network acoustic models", In Proc. ICML, 30(1).
  11. Han, S., Liu, X., Mao, H., Pu, J., Pedram, A., Horowitz, M. A., and Dally, W. J., 2016, "EIE: efficient inference engine on compressed deep neural network", arXiv preprint arXiv:1602.01528.
  12. Merolla, P. A. et al., (2014), "A million spiking-neuron integrated circuit with a scalable communication network and interface", Science, 345(6197), pp. 668-673. https://doi.org/10.1126/science.1254642
  13. Chung, J. Y., and Shin, T. H., and Kang, Y. S., 2015, "INsight: A Neuromorphic Computing System for Evaluation of Large Neural Networks", arXiv preprint arXiv:1508.01008.
  14. Chung, J. Y., and Shin, T. H., 2016, "Simplifying deep neural networks for neuromorphic architectures", Proceedings of the 53rd Annual Design Automation Conference. ACM, pp.126.
  15. Misha, D., Babak, S., Laurent, D., Marcaurelio, R., and Nando, D. F., 2013, "Predicting parameters in deep learning", In Advances in Neural Information Processing Systems, pp. 2148-2156.
  16. Wenlin, C., James, T. W., Stephen, T., Kilian, Q. W., Yixin, C., 2015, "Compressing convolutional neural networks", arXiv preprint arXiv:1506.04449.
  17. Emily, L. D., Wojciech, Z., Joan, B., Yann, L., and Rob, F., 2014, "Exploiting linear structure within convolutional networks for ecient evaluation", In Advances in Neural Information Processing Systems, pp. 1269-1277.
  18. Han, S., Jepp, P., John, T., and William, D., 2015, "Learning both weights and connections for efficient neural network", Advances in Neural Information Processing Systems, pp. 1135-1143.
  19. http://caffe.berkeleyvision.org/
  20. Tara, N. S., Brian, K., Vikas, S., Ebru, A., and Bhuvana, R., 2013, "Low-rank matrix factorization for deep neural network training with high-dimensional output targets", In Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing, pp. 6655-6659.
  21. Jian, X., Jinyu, L., and Yifan G., 2013, "Restructuring of deep neural network acoustic models with singular value decomposition", In INTERSPEECH, pp. 2365-2369.
  22. http://www.boost.org/
  23. http://viennacl.sourceforge.net/
  24. 조용연, 배덕호, 김상욱, (2013), "GPU 기반의 외적을 통한 희소행렬 곱셈방안", 정보과학회논문지, 19(10), pp. 524-528.
  25. Baskaran, M. M., and Bordawekar, R., (2008), "Optimizing Sparse Matrix-Vector Multiplication on GPUs", IBM Research Report, RC24704 (W0812-047).