Chng 2: Mng noron RBF

2.1 Lch s pht trin

Cui th k 19 u th k 20, mt s nghin cu v vt l, tm l v h thn kinh
ca cc nh khoa hc Herman, Ernst Mach v Ivan Ivalov a ra cc l thuyt v qu
trnh hc, s tng tng, s quyt nh ca h thn kinh lm tin cho vic
nghin cu mng nron.
Nm 1943, Warren McCulioch v Walter Pitts nghin cu ba c s l thuyt:
Trit hc c bn v chc nng ca cc nron thn kinh; phn tch v cc mnh logic
ca Russell v Whitehead; thuyt d on ca Turning. Cui cng h xut m hnh
nron nhn to m mi nron c trng bi hai trng thi tt v bt. y l im
khi u ca lnh vc mng nron.
Nm 1949, Donald Hebb a ra mt c ch gii thch cho qu trnh hc din ra
trong cc noron sinh hc.
Nm 1950-1953, Claude Shannon v Alan Turning vit chng trnh nh c
theo cch m Von Newman sng ch ra my tnh.
Nm 1958, McCarthy nh ngha ngn ng bc cao Lisp, v n tr thnh ngn
ng lp trnh cho cc mng tr tu nhn to ni chung.
Cui thp nin 50 u thp nin 60, Frank Rosenblatt a ra mng Perceptron
c lut hc dng nhn dng mu. Rosenblatt chng minh rng thut ton m ng
nghin cu c th thm vo nhng kh nng ca nhn thc ph hp vi bt c d liu u
vo no. Cng lc , Bernard Widrow v Ted Hoff gii thiu mt thut ton hc
(learning algorithm) v s dng n hun luyn (training) cc mng nron tip hp
tuyn tnh vi phn t nron tuyn tnh thch ng Adaline (Adaptive Linear Element).
Nm 1969, Minskey v Papert l hai nh ton hc ni ting ch ra nhng hn
ch ca mng Perceptron ca Rosenblatt v mng Widrow-Hoff lm nhiu ngi ngh
rng nghin cu v mng noron s i vo ng ct. Hn na vo thi gian ny cha c
nhng my tnh s mnh thc nghim mng noron nn cc nghin cu v mang noron
b tr hon gn mt thp k.
Nm 1972, Teuvo Kohonen v James Anderson c lp pht trin cc mng nron
mi vi kh nng nh (memory) v kh nng t t chc (self-organizing).
u nhng nm 80, nhng ng gp to ln cho mng nron giai on ny phi
k n Grossberg, Kohonen, Rumelhart v Hopfield. ng gp chnh ca Hopfield l hai
m hnh mng phn hi: Mng ri rc nm 1982 v mng lin tc nm 1984. c bit, ng
d kin nhiu kh nng tnh ton ln ca mng m mt nron n khng th c c.
T nm 1990 n nay, hng lot cc lnh vc khc nhau u nghin cu v a
mng nron i vo ng dng, em li nhiu kt qu ng khch l.
2.2 Noron nhn to
2.2.1 nh ngha
Noron nhn to l s m phng n gin ca neron sinh hc. Mi noron nhn to
thc hin hai chc nng l chc nng tng hp u vo v chc nng to u ra.
Mi noron nhn to c mt s u vo v mt u ra. Mi u vo c gn mt h s
nhn gi l trng s (weigh) c ngha nh mc lin kt ti khp ni trong mng
noron. Trng s c th l dng hay m.

Mi noron c mt gi tr ngng. Chc nng u vo chnh l tng cc trng s

cc tn hiu vo kt hp vi ngng to ra tn hiu u vo. Chc nng to u ra c
th hin bng hm truyn t. Hm ny s nhn tn hiu u vo v to tn hiu u ra ca
mng noron.
2.2.2 M hnh noron
2.2.2.1 M hnh noron sinh hc
Trc khi i vo tm hiu m hnh mng nron nhn to, ta tm hiu mng nron
sinh hc trc v mt mng nron nhn to c hc t mng nron sinh hc.
11
B no ngi c mng li gm khong 10
t bo thn kinh (gi l noron)
lin kt phc tp vi nhau. Mi t bo thn kinh gm 3 thnh phn chnh:
Cc nhnh v r: L cc b phn nhn thng tin. Khi cc u vo c s chnh lch
nng ion th xy ra hin tng thm thu t ngoi vo trong qua mt mng
thm c bit. Ty vo mc thm thu, thng tin s c a vo cc li vo
khc nhau, ng vi cc lin kt khc nhau. Mc thm thu c gi l trng
(weight).
Thn thn kinh (soma): Cha nhn v c quan tng hp protein. Khi nng ion
t n mt gi tr nht nh th s xy ra qu trnh pht xung kch thch. Xung tn
hiu c a ra cc dy thn kinh.
Dy thn kinh (axon): a tn hiu ra v truyn ti cc nron khc qua cc khp
kt ni.
Khp kt ni (synape): L b phn tip xc ca cc u ra nron vi r, nhnh ca
cc nron khc.

Hnh 2.1: M hnh noron sinh vt

2.2.2.2 M hnh noron nhn to
Mng nron nhn to (Artificial Neural Network) l m hnh ton hc c xy
dng da trn cc mng nron sinh hc. N gm cc nt (nron nhn to) ni vi nhau,
x l thng tin bng cch truyn theo cc kt ni v tnh cc gi tr ti cc nt.
Hnh 2.1b: M hnh noron nhn to
Trong :
uk l cc u vo ngoi.
bk l trng lin kt cc u vo ngoi.
I l ngng.
w l trng lin kt cc u vo trong.
y(t) l u ra nron.

Mt mng nron nhn to gm ba phn chnh l: Tng cc lin kt u vo v(t), ng

hc tuyn tnh x(t), phi tuyn khng ng hc g(.).
Tng cc lin kt u vo.
n

v ( t )=wy ( t ) + b k u k ( t ) + I

1
22E
quati
on
Cha
pter
2
Secti
on 22
22\*
ME
RGE
FOR
MAT
(.)

k=1

Phn ng hc tuyn tnh

Ta s dng ton t Laplace m t phn ng hc tuyn tnh nh mt hm truyn t:
X(s)=H(s)V(s)

323\*
MER
GEF
ORM
AT (.)

Di y l mt s hm H(s) thng dng cho nron nhn to:

Bng 2.1. Mt s hm H(s) thng dng cho nron nhn to
H(s)

Quan h vo v(t)=x(t)
ra

1
s
v ( t )=

1
1sT
dx( t)
dt

v ( t )=T

(sT )

e
dx (t)
+ x(t)
dt

v(t-T)=x(t)

Phn phi tuyn

u ra ca cc nron sinh hc l cc xung v thng c gii hn chn v th nn trong
mng nron nhn to, n nh u ra, ta dng cc hm chn li ra cho cc tn hiu,
thng dng phi tuyn vi hm g(.). Nh vy u ra mng nron nhn to c th c
vit nh sau:
y g x t

4
24\*
ME
RG
EF

OR
MA
T (.)

Mt s hm phi tuyn thng dng nh trnh by trong bng 2.2.

2.2.3 c im noron nhn to
Tnh phi tuyn: Mt nron c th tnh ton mt cch tuyn tnh hay phi tuyn. Mt
mng nron, cu thnh bi s kt ni cc nron phi tuyn th t n s c tnh phi
tuyn. Hn na, iu c bit l tnh phi tuyn ny c phn tn trn ton mng.
Tnh phi tuyn l mt thuc tnh rt quan trng, nht l khi cc c ch vt l sinh
ra cc tn hiu u vo (v d tn hiu ting ni) vn l phi tuyn
Tnh cht tng ng u vo-u ra: Mc d khi nim hc hay hun luyn
(training) cha c bn n nhng hiu c mi quan h u vo - u ra
ca mng nron, chng ta s cp s qua v khi nim ny. Mt m hnh hc ph
bin c gi l hc c gim st lin quan n vic thay i cc trng s lin kt
u vo ngoi ca mng nron bng vic p dng mt tp hp cc mu hun
luyn. Mi mt mu bao gm mt tn hiu u vo v mt u ra mong mun
tng ng. Mng nron nhn mt mu ly mt cch ngu nhin t tp hp ni trn
ti u vo ca n, v cc trng s lin kt u vo ngoi (cc tham s t do) ca
mng c bin i sao cho c th cc tiu ho s sai khc gia u ra mong
mun v u ra thc s ca mng theo mt tiu chun thng k thch hp. S hun
luyn ca mng c lp li vi nhiu mu trong tp hp cho ti khi mng t ti
mt trng thi n nh m khng c mt s thay i ng k no ca cc
trng s lin kt u vo. Cc mu hun luyn c p dng trc c th c p
dng li trong thi gian ca phin tch lu nhng theo mt th t khc. Nh vy
mng nron hc t cc mu ny bng cch xy dng nn mt tng ng u vo u ra cho vn cn gii quyt
Tnh cht thch nghi: Cc mng nron c mt kh nng mc nh l bin i cc
trng s lin kt u vo tu theo s thay i ca mi trng xung quanh. c
bit, mt mng nron c tch lu hot ng trong mt mi trng xc nh
c th c hun luyn li mt cch d dng khi c nhng thay i nh ca cc
iu kin mi trng hot ng. Hn na, khi hot ng trong mt mi trng
khng n nh (cc s liu thng k thay i theo thi gian), mt mng nron c
th c thit k sao cho c kh nng thay i cc trng s lin kt u vo ca n
theo thi gian thc. Kin trc t nhin ca mt mng nron cho vic phn loi
mu, x l tn hiu, v cc ng dng iu khin lun i i vi kh nng thch nghi
ca mng, to cho n mt phng tin hu hiu trong vic phn loi mu thch
nghi, x l tn hiu thch nghi, v iu khin thch nghi. Nh mt quy tc chung,
c th ni rng chng ta to ra mt h thng cng c kh nng thch nghi th tnh
nng ca n s cng mnh khi h thng cn phi hot ng trong mt mi trng
khng n nh. Tuy nhin, cn nhn mnh rng tnh thch nghi khng phi lc no
cng em n sc mnh; n c th lm iu ngc li. V d, mt h thng thch
nghi vi nhng hng s thi gian nh c th bin i rt nhanh v nh vy l c xu
hng phn ng li nhng s nhiu lon gi to, v s gy ra s suy gim mnh v
tnh nng h thng. th hin y li ch ca tnh thch nghi, cc hng s thi
gian ca h thng nn ln h thng c th b qua c s nhiu lon v cng
nh phn ng c vi nhng thay i c ngha ca mi trng.
Tnh cht a ra li gii c bng chng: Trong ng cnh phn loi mu, mt mng
nron c th c thit k a ra thng tin khng ch v mu c phn loi,
m cn v s tin cy ca quyt nh c thc hin. Thng tin ny c th c
s dng loi b cc mu m h hay nhp nhng.

 Tnh cht chp nhn sai st: Mt mng nron, c ci t di dng phn cng,
vn c kh nng chp nhn li, vi ngha l tnh nng ca n ch thoi ho (ch
khng v) khi c nhng iu kin hot ng bt li. V d, nu mt nron hay
cc lin kt kt ni ca n b hng, vic nhn dng li mt mu c lu tr s suy
gim v cht lng. Tuy nhin, do bn cht phn tn ca thng tin lu tr trong
mng nron, s hng hc cng c tri ra trn ton mng. Nh vy, v c bn,
trong trng hp ny mt mng nron s th hin mt s thoi ho v tnh nng
hn l s v trm trng
Kh nng ci t VLSI (Very-large-scale-intergrated): Bn cht song song s
ca mt mng nron lm cho n rt nhanh trong tnh ton i vi mt s cng
vic. c tnh ny cng to ra cho mt mng nron kh nng ph hp cho vic ci
t s dng k thut VLSI. K thut ny cho php xy dng nhng mch cng tnh
ton song song quy m ln. Chnh v vy m u im ni bt ca VLSI l mang li
nhng phng tin hu hiu c th x l c nhng hnh vi c phc tp
cao.
Tnh cht ng dng trong phn tch v thit k: V c bn, cc mng nron c
tnh cht chung nh l cc b x l thng tin. Chng ta nu ra iu ny vi cng
ngha cho tt c cc lnh vc c lin quan ti vic ng dng mng nron. c tnh
ny th hin mt s im nh sau:
o Cc nron, di dng ny hoc dng khc, biu din mt thnh phn chung
cho tt c cc mng nron
o Tnh thng nht ny em li kh nng chia s cc l thuyt v cc thut ton
hc trong nhiu ng dng khc nhau ca mng nron.
o Cc mng t hp (modular) c th c xy dng thng qua mt s tch
hp cc m hnh khc nhau
2.3 Cu trc mng noron
2.3.1 Cu trc chung
Trong b no con ngi, cc t bo thn kinh lin kt vi nhau thng qua cc khp ni
thn kinh to thnh nhng mng li vi kin trc v cng phc tp v a dng. i vi
cc mng nron nhn to, chng ta c ba lp kin trc c bn sau:
Lp u vo (input layer): Thc hin tip nhn cc tn hiu vo.
Lp n (hidden layer): Nhn d liu u vo cc lp trc , x l chng v
cho ra mt kt qu duy nht. Kt qu x l ca mt nron c th lm u vo cho
cc nron khc. Mt mng nron c th c nhiu lp n.
Lp ra (output layer): Thc hin a tn hiu ra.

Hnh 2.2. Kin trc chung ca mng nron

Trong : PE l Processing Element l mt nron, mi nron nhn cc d liu vo, x l

chng v cho ra mt kt qu duy nht. Kt qu x l ca mt nron c th lm u vo
cho cc nron khc.
2.3.2 Phn loi

Da vo cc phng thc truyn tn hiu, ta c th chia mng nron thnh cc loi nh

sau:
Mng truyn thng : Trong mng ny tn hiu u vo c truyn thng qua cc
lp ti u ra.
Mng phn hi : Trn hng i ti u ra, tn hiu c a hi tip tr v u vo
ca nron (hi quy).
Mng t t chc : Cu trc mng nron thay i ty theo s thay i ca mi
trng xung quanh tc ng ln mng.
Hnh 2.3. Cch phn loi in hnh mng nron nhn to
2.4 Mng noron RBF