2013/11/22

2013/11/22

2013/11/22

Simon1983

Minsky (1985)

2013/11/22

2013/11/22

2013/11/22

........

2013/11/22

........

........
2013/11/22

..

2013/11/22

2013/11/22

10

2013/11/22

11

50

2013/11/22

12

1965

Samuel(1059-1963)

2013/11/22

13

60

WinstonARCH

2013/11/22

14

70

2013/11/22

15

2013/11/22

16

2013/11/22

17

2013/11/22

18

2013/11/22

19

2013/11/22

20

SOAR

2013/11/22

21

2013/11/22

22

2013/11/22

23

2013/11/22

24

()

2013/11/22

25

2013/11/22

26

2013/11/22

27

()

2013/11/22

28

(empirical inductive learning)

ID3

2013/11/22

29

--ID3

J.R.Quinlan1986
ID3

2013/11/22

30

-- ID3ID3

2013/11/22

31

-- ID3

ID3

ID3-

2013/11/22

32

analytic learning

2013/11/22

33

(case_based learning)

Case-Based Ressoning, CBR

2013/11/22

34

""
instant reasoning

2013/11/22

35

,
1)

2)

2013/11/22

36

--Case Based
LearningCBL
1)

2)
3)

2013/11/22

37

genetic algorithm,GA

()()

2013/11/22

38

genetic algorithm,GA
J.H.Holland70

GA

GA

2013/11/22

39

genetic algorithm,GA

SGA
2013/11/22

40

simple genetic algorithm,SGA

SGA01
SGA

SGA

2013/11/22

41

simple genetic algorithm,SGA

begin
1.
2.
3. While do
begin
1.
2.
3.
end
end
2013/11/22

42

simple genetic algorithm,SGA

SGA

2013/11/22

43

genetic algorithm

GA
GA

2013/11/22

44

2013/11/22

45

reinforcement learning
trial and error

2013/11/22

46

2013/11/22

47

2013/11/22

48

2013/11/22

49

(x1,,x2)

(y1,,y2)

[(x1,,x2),(y1,,y2)]

2013/11/22
50

2013/11/22

51

2013/11/22

52

2013/11/22

53

50

2013/11/22

54

2013/11/22

55

1
2
3
4

5
6

2013/11/22

56

2013/11/22

57

5
{(2, c), (3, c), (5, c), (J, c), (A, c)}, c
club

SUIT()RANK
A, 2, 3, , 10. J, Q, K, clubs(),
diamonds(), hearts, spades()

c1, c2, c3, c4, c5

SUIT(c1, x)SUIT(c2, x)SUIT(c3, x)SUIT(c4, x)SUIT(c5,
2013/11/22

x)

58

2013/11/22

59

P.221

RANK(c1, J), RANK(c2, K)

RANK(c3, Q)

2013/11/22

60

2013/11/22

61

2013/11/22

62

2
,
1 .[= ] [=
]
2 .[=] [=]

2013/11/22

63

2013/11/22

64


(Decision Tree)

2013/11/22

65

Hunt,MarinStone 1966CLS
1979, J.R. Quinlan ID319831986ID3

Schlimmer Fisher 1986ID3

ID4
1988Utgoff ID4ID5
1993Quinlan ID3C4.5
CARTC4.5CART

2013/11/22

66


C4.5
CART

(Multi-Variance Decision Tree MDT)

C4.5GA-NN-C4.5
SVM

2013/11/22

67

2013/11/22

68

2013/11/22

69

CARTClassification And Regression Tree

IFTHEN6-13

IF THEN
IF THEN
IF THEN

2013/11/22

70

(ID3)

2013/11/22

71

2013/11/22

72

2013/11/22

73

Shannon

Xai p(ai)aiai ai
I(ai)I(ai) = -logp(ai)

H ( X ) p(a1 ) I (a1 ) p(a 2 ) I (a 2) ... p(a r ) I (a r )

r

rX
p(ai ) log p(ai )
i 1

XYH(X|Y)YX
XaiYbjp(ai|bj)YbjXai

i 1

j 1

H ( X | Y )

p(a b ) log p(a | b )

YXI(X,
Y)
i

I ( X ,Y ) H ( X ) H ( X | Y )

2013/11/22

74

S {s1 , s 2 ,.. sT }
SiT
Si

s (a1 , a 2 ,..a m ; )
Si

x1 a1 x 2 a 2 ... x m a m
Xii

2013/11/22

75


simple genetic algorithm,SGA
SGA

2013/11/22

76


1.
GA
SGA01

GA

SGA

2013/11/22

77


1.

01
01
01

2013/11/22

78


2.

2013/11/22

79


3.

i
fii

fi / fi
fi

2013/11/22

80


3.
n
i
n* fi / fi = fi /f ,
f= fi /n fi /f

fi /f
fi /f2.7i70
2+1=3302

2013/11/22

81


3.
SGAroulette wheel

2* fi / fi
202

2013/11/22

82


4.

GA

SGA
L
1L-1

2013/11/22

83


4.

12
710
11000011111
21111111011
1'2'
1'1000011011
2'1111111111

PcPc01

2013/11/22

84


5.

0110
PmPm01

01

2013/11/22

85


5.

104
POP1
010
POP13669
0.5111.5
0112POP2
POP214
23

2013/11/22

86


5.
POP1

0000011100
1000011111
0110101011
1111111011
POP2

1000011111
0110101011
1111111011
1111111011
2013/11/22

3
6
6
9

6
6
9
9
87


5.
0.51
47POP3
0.05POP3402
2641
POP4
POP4
POP1POP2POP3

2013/11/22

88


5.
POP3

1000011011
0110101011
1111111011
1111111111
POP4

1000011011
0110111011
1111111011
0111111111
2013/11/22

5
6
9
10

5
7
9
9

89


5.
SGA30200
0.510.0010.05
GA

GA

2013/11/22

90

string rules

2013/11/22

91

1
2
3GA

2013/11/22

92

bucket brigadeBBA

,
2013/11/22

93

BBA

L
2LGA
, GA

2013/11/22

94

GAGA
GA
tGA
tGA
GA

2013/11/22

95

The End.

2013/11/22

96

The End.

2013/11/22

100