Professional Documents
Culture Documents
Perceptrons
1 if w
0
+w
1
x
1
+. . . +w
n
x
n
> 0
1 otherwise
1 if
n
i=0
w
i
x
i
> 0
1 otherwise
Perceptrons
Week 5: Neural Networks
Christof Monz
9
If t = o then (t o)x
i
= 0 and w
i
= 0, i.e.
the weight for w
i
remains unchanged, regardless
of the learning rate and the input values (i.e. x
i
)
E
w
0
,
E
w
1
, . . . ,
E
w
n
w
i
(t
d
o
d
)
2
=
1
2
dD
2(t
d
o
d
)
w
i
(t
d
o
d
)
=
dD
(t
d
o
d
)
w
i
(t
d
o
d
)
E
w
i
=
dD
(t
d
o
d
) (x
id
)
Gradient Descent
Week 5: Neural Networks
Christof Monz
19
koutputs
(t
kd
o
kd
)
2
k
o
k
(1o
k
)(t
k
o
k
)
3. For each hidden unit h calculate its error
h
:
h
o
h
(1o
h
)
koutputs
w
kh
k
4. Update each network weight w
ji
:
w
ji
w
ji
+w
ji
where w
ji
=
j
x
ji
Note: x
ji
is the value from unit i to j and w
ji
is
the weight of connecting unit i to j,
Backpropagation Algorithm
Week 5: Neural Networks
Christof Monz
33
Text to speech
Fraud detection
Automated vehicles
Game playing
Handwriting recognition
Summary
Week 5: Neural Networks
Christof Monz
35
Backpropagation algorithm