BACK PROPAGATION LEARNING THEORY

Submitted to Presented by
Dr. Vishal Sahani Puneet Kr Singh
M.Tech(2nd sem)
Full Time

P K Singh , F O E , D E I http://pksingh.webstarts.com/student_community.html
 BACKPROPAGATION NEURAL NETWORK

 One of the most commonly used supervised ANN model

is back propagation network that uses back propagation
learning algorithm.

 These elements or nodes are arranged into different

layers: input, middle and output.

 The output from a back propagation neural network is

computed using a procedure known as the forward pass

P K Singh , F O E , D E I 2
 The input layer propagates a particular input
vector’s components to each node in the middle
layer.

 Middle Layer nodes compute output values, which

becomes input to the nodes of output layer.

 The output layer nodes compute the network

output for the particular input vector.

P K Singh , F O E , D E I 3
Multi-layer neural network using
back propagation

P K Singh , F O E , D E I 4
P K Singh , F O E , D E I 5
 Artificial Neuron:
Classical Activation Functions
Linear activation Logistic activation

 z   z  z  
1
1  e  z
1

z
z
0

Threshold activation Hyperbolic tangent activation

1  e  2 u
 1,
  z   sig n ( z )  
if z  0,
 u   tanh  u  
  1, if z  0. 1  e  2 u
1
1

z 0 z
-1
-1
P K Singh , F O E , D E I 6
Xk

P K Singh , F O E , D E I 7
BACKPROPAGATION WEIGHT UPDATE PROCEDURE

P K Singh , F O E , D E I 8
BACKPROPAGATION WEIGHT UPDATE PROCEDURE

P K Singh , F O E , D E I 9
P K Singh , F O E , D E I 10
P K Singh , F O E , D E I 11
P K Singh , F O E , D E I 12
FUNCTION APPROXIMATION

P K Singh , F O E , D E I 13
STEP REPRESENTATION

P K Singh , F O E , D E I 14
P K Singh , F O E , D E I 15
P K Singh , F O E , D E I 16
P K Singh , F O E , D E I 17
P K Singh , F O E , D E I 18
P K Singh , F O E , D E I 19
P K Singh , F O E , D E I 20
P K Singh , F O E , D E I 21
P K Singh , F O E , D E I 22
P K Singh , F O E , D E I 23
P K Singh , F O E , D E I 24
P K Singh , F O E , D E I 25
P K Singh , F O E , D E I 26
P K Singh , F O E , D E I 27
P K Singh , F O E , D E I 28
P K Singh , F O E , D E I 29
P K Singh , F O E , D E I 30
P K Singh , F O E , D E I 31
P K Singh , F O E , D E I 32
P K Singh , F O E , D E I 33
 Thanks For Your
Attention!!!
P K Singh , F O E , D E I http://pksingh.webstarts.com/student_community.html