FIGURE 1. The outputs of a network which separates [-1, 1]
FIGURE 2. Inputs and First outputs of a network which separates the first quadrant
FIGURE 3. Separation of a triangular region and a circular region
FIGURE 4. Parametrization of networks
FIGURE 5. Separation of the union of two disjoint disks solid line: the level curve of
References
- D. Barber, Bayesian Reasoning and Machine Learning, Cambridge University Press, 2012.
- P.T. de Boer, S. Mannor, R.Y. Rubinstein, A Tutorial on the Cross-Entropy Method, Annals of Operation Research 134 (2005), 19-67. https://doi.org/10.1007/s10479-005-5724-z
- G.W. Flake and B.A. Pearlmuter, Differentiating functions of the jacobian with respect to the weights, in Advances in Neural Information Processing Systems, Vol. 12, The MIT Press, 2000.
- R. Hahnloser, R. Sarpeshkar, M.A. Mahowald, R.J. Douglas, H.S. Seung, Digital selection and analogue amplification coexist in a cortex-inspired silicon circuit, Nature 405 (2000), 947-951. https://doi.org/10.1038/35016072
- D.E. Rumelhart, G.E. Hinton and R.J. Williams, Learning Internal Representations by Error Propagation in Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Vol. 1:Foundations, MIT Press, 1986.
- D.E. Rumelhart, G.E. Hinton and R.J. Williams, Learning representations by back-propagating errors, Nature 323 (1986), 533-536. https://doi.org/10.1038/323533a0
- J. Schmidhuber, Deep learning in neural networks: An overview, Neural Networks 61 (2015), 85-117. https://doi.org/10.1016/j.neunet.2014.09.003