What is Feedback Neural Networks

Since 1943, the neuropshychologist Warren McCulloch and the mathematician Walter Pitts published the paper “A Logical Calculus of the Ideas Immanent in Nervous Activity” establishing the foundation of the neural networks. The transition from the biological neuron to the artificial one, from the perceptron to the multi-layer perceptron, from Hopfield networks to Kohonen networks, from bi-directional associative memories to Boltzmann machines, from basic radial functions to Hamming networks, all of these represent a strong proof of the long journey in the study of the neural networks. Using the characteristics of a neural network, an overview of the works in the neural computing are included in the paperwork, namely a taxonomy of the neural networks based on a number of criteria. The paperwork includes the conclusion of the research. at the end, possible further research directions are highlighted.