Professional Documents
Culture Documents
BPRNBP
RNBP BP
*
1.
2.
3.
*
Tel: (02)2938-7478, Fax(02)-2939-0251, E-mail: jachang@nccu.edu.tw
()
1
(Artificial Neural Networks)
U
1
()
2
Weights
generalization
1.
2.
BP
BP Rumelhart (1986)BP
non-decreasing(semi-linear)
internal
representationBP
BP generalized delta rule
BP
1.
1. 1
(Yoon, Swales & Margavio, 1993)
(,1993)
2. 23
4
BP
BP BP
1. RN
weight-and-structure-change
RN BP 1
2. RN
5
RN BP 2 RN
6
3. RN
stopping criterion
BP
7
RN BP
RN 2 2-classes categorization
1 -1 categoricalTsaih(1993)
RN 1 -1
Tsaih(1994,1997) RN 1 -1
Tsaih(1996) RN
RNBP
(real value) BP
RN
8 RN
(binary value) RNBP
RN BP RNBP RN
BP BP
9
Tsaih(1993)Tsaih(1994) Tsaih(1996)
RN
7
E(Z) E(Z)BP
E(Z)||E(Z)||
8
()
BP
5
()
79 ~82
79~82
79
2
1
3
28
38
0
7
19
16
20
4
24
162
80
37
3
23
94
153
3
33
88
49
80
15
118
696
81
47
1
45
126
189
1
88
80
73
124
12
120
906
82
57
6
59
108
171
7
107
86
75
148
15
184
1023
143
11
130
356
551
11
235
273
213
372
46
446
2787
(
)
3
10
0.5
1
100 5
11
10
0.250.50.751
0.51
11
(1)
(2)(3)(4)
(5)
6
Ti
N
(1)
i =1 2787
i Ti i N
N=
(100 )
0.5
(1264 )
(1164 )
(2687 )
(1523 )
1 0.5 100
1.
; 2.
; 3. 1
0.5 100
100
50 12 5
1.
12
2.
50 13
DFFITS 14 2
929
486
22
631
719
850
444
19
577
664
12 3
13
50 100
14
COOKD
8
0.5
()
100
1
()
100
()
100
0.5
()
50
1
()
50
()
50
()
50
()
50
()
50
()
50
()
50
()
50
1264
2103
2787
1264
2103
2787
446
551
631
411
506
577
4 12.5
13 19
()
1.
15
(1)
() Di1 ~ Di 4
k =1
k =1
ln(d i ) = ik Dik + ik b ik + i
(2)
d i i ; Dik i k
( Di1 1 0); b ik i
k 16(
); ik
15
(1995pp. 16-21
16
(1995pp. 43-87
9
; ik
(2)
ln(d i ) = ik b ik + i
(3)
k =1
2.
=(+)/2BP
4 RNBP
:
(1)
(2) ik
4
0-0.07087
-0.07087
P-
0
1
0.000
-0.07087
2
0.0001
-0.28197
4
0.0001
-0.29041
5
0.0001
-0.23458
3
0.0001
(2)
1 -1
17(
17
1 -1
10
) 1.5 18
RN
1 -1 RN
RN 1-1
()
1.
(AMRE)(AAE) AMRE
AAE
N
(oi d i ) / d i
AMRE= i =1
(4)
oi di
AAE= i =1
(5)
o i i
2.
18
1.5
11
()
5 6 7
5 6 AMRE BP RNBP
AMRE AAERNBP
BP
PLF RNBP
RNBP
PGT
RNBP BP
BP RNBP
BP
RNBP
RNBP BP RNBP
RNBP
RNBP
RNBP RNBP
BP RN ()
RNBP
BP RNBP
BP
1.
2.
12
5BP RNBP
AMRE
AAE
PGT
PLF
BP
RNBP
* 5%
6BP RNBP
AMRE
AAE
PGT
PLF
BP
RNBP
* 5%
7BP RNBP
AMRE
AAE
PGT
PLF
0.1864*
169.288
0.3567
0.1811
365.839
9956.4
0.0972
BP
0.2179*
169.785
0.4131
0.1656
209.5
2437.6
0.0532
RNBP
0.2305
179.283
0.4213
0.1905
220.463
2451.8
0.0512
* 5%
()
AMRE 8 5
9 6 10 7
100 BP 50
RNBP AMRE BP AAE
13
8BP RNBP
AMRE
AAE
PGT
PLF
BP
RNBP
0.0671 0.2634
0.176
50.49 201.128* 134.099*
0.0273 0.5688 0.3277
0.4353 0.0171 0.2033
49.161 179.987 157.274
529.1
2021
2021
0.0904 1.3865 0.0904
* 5%
9BP RNBP
BP
RNBP
0.021
5.267
0.021
0.0458 12.4493 0.0458 0.0373 1.1077 0.0373
* 5%
10BP RNBP
AMRE
AAE
PGT
PLF
0.1864*
169.288
0.3567
0.1811
365.839
9956.4
0.0972
BP
0.2179*
169.785
0.4131
0.1656
209.5
2437.6
0.0532
RNBP
0.2305
179.283
0.4213
0.1905
220.463
2451.8
0.0512
* 5%
50 100 RNBP BP
14
()
11
19
11~
()
()
BP
RNBP
4
21
0.172*
0.177*
0.265
0.171*
AMRE
115.505* 108.121* 155.317* 200.090
AAE
0.316
0.311
0.419
0.325
PGT
0.182
0.207
0.321
0.214
PLF
296.85
149.121
229.246
320.596
BP
()
RNBP
4
0.178*
169.905
0.352
0.202
162.075
19
BP
RNBP
4
0.178*
0.175*
0.199*
0.215*
176.813 117.293* 118.122* 129.596*
0.372
0.299
0.343
0.432
0.229
0.208
0.183
0.244
178.795 179.732 132.673
154.17
16
0.058
0.295
0.125
858.611
0.06
* 5%
()
12 AMREAAEPGT PLF (
)
()
50
12~
AMRE
AAE
PGT
PLF
()
BP
RNBP
0.138*
80.292*
0.258
0.233
72.362
414.043
0.005
()
BP
RNBP
()
BP
RNBP
4
10
4
13
4
12
0.142* 0.214* 0.146*
0.182
0.196 0.134* 0.132*
0.13*
84* 119.031* 142.364 168.596 161.039 81.514* 75.863* 75.063*
0.313
0.447
0.289
0.353
0.349
0.23
0.225
0.243
0.286
0.235
0.173
0.186
0.226
0.271
0.363
0.185
89.761 128.143 127.677 145.172 168.77 73.275 72.792 82.951
515.667 754.04 719.378 936.25 1186.83 429.448 492.29 452.029
0.346
0.029
0.001
0.12
0.393
0.037
0.116
0.053
* 5%
19
AMRE
AAE
15
12 BP
RNBP AMRE AAE
()
~0.51
20
1. 0.50.650.81
2.
3. 100
4. 500 1300
300-800
BP 0.8
RNBP 0.650.5 RNBP
BP 0.65
BP 0.8
21
13 BP RNBP
AMRE
AAE
PGT
PLF
BP
RNBP
4
14
0.126*
0.124*
70.277*
68.601*
0.216
0.221
0.295
0.297
59.574
59.341
307.814
289.987
0.088
0.030
BP
RNBP
4
15
0.141
0.138
130.364
123.702
0.239899
0.242
0.214646
0.277
108.166
111.859
644.477
644.257
0.012
0.228
* 5%
13BP RNBP
BP RNBP
20
21
500 800
16
1.
AMRE AAE
2.
BP RNBP
BP RNBP
BP RNBP
RNBP RNBP
3.
100 50
5.
RNBP BP
1.
RNBP BP
17
2.
3.
overfitting
[]
(1997)
pp. 63-113
(1994)---
(1996)
34:2171-200
(1993)
(1995)
(1995)
[]
19