Back Propagation Training
As with other neural networks, the network feed forward training is done in order to calculate the weights so that at the end of the training will be obtained good weights. During the training process, the weights iteratively adjusted to minimize error that occurs.
Error is calculated based on the mean squared error (MSE). The mean squared error is also used as the basis for calculating the performance of the activation function. Most of the training for feed forward network using a gradient of activation function to determine how to adjust the weights in order to minimize the performance. This gradient is determined by using a technique called back propagation.
Basically, the standard back propagation training algorithm will move the weight with a negative gradient direction. The basic principle of back propagation algorithm is to improve the network weights with the direction that makes the activation function to be falling rapidly
Back propagation training includes three phases as follows.