-

1

1997
2002

2005
CSLI (Center for the Study of Language and Information)
Stanley Peters
2007
2014

WebDeep Learning

2012 2014
2007WWWWWW2014

READYFOR
Pluga AI Asset Management



2
 Deep Learning
AI50

2013415 3
 DL

Google
Hinton
Google2013
Deep Learning
Deep Mind Technologies
4202014 Deep Learning workshop(2013)

Baidu
Deep Learning2013
Stanford Andrew NgDeep Learning300
2014)
Facebook
: New YorkYann LeCun2013
Vicarious4,0002014

AI19561960
...
AI1980
...
AI2013

6
AI

1956
ArScial Intelligence
John McCarthyMarvin MinskyAllen Newell Harbert Simon

cf) ENIAC (1946)10
1960 AIToy problem
19571963
1958DENDRAL1969,

1970

7


S
G

S
S A
D A
B C
D E I E B C
F
E I B E H
H
I
D B D H D I J E
J G
A H J F I D G


8
 Go to Shinjuku from u-Tokyo

at(u-tokyo). at(u-tokyo)
at(Hon3) :- at(u-tokyo), walk(u-tokyo,Hon3).
walk(u-tokyo,Hon3 walk(u-tokyo,Nezu)
at(Nezu) :- at(u-tokyo), walk(u-tokyo,Nezu).
at(u-tokyomae) :- at(u-tokyo), walk(u-tokyo,u-tokyomae).
at(Hon3) at(Nezu)
at(Shinjuku) :- at(Hon3), marunouchi(Hon3,Shinjuku).
at(Ikebukuro) :- at(Hon3), marunouchi(Hon3,Ikebukuro).
at(Shinjuku) :- at(Ikebukuro), JR(Ikebukuro,Shinjuku).
at(Ocha) :- at(Hon3), marunouchi(Hon3, Ocha).
at(Shinjuku) :- at(Ocha), JR(Ocha, Shinjuku).
at(ShinOcha) :- at(Nezu), chiyoda(Nezu, ShinOcha).
at(Ocha) :- at(ShinOcha), walk(Ocha, ShinOcha).
at(Yotsuya) :- at(u-tokyomae), nanboku(u-
tokyomae,Yotsuya).

at(Shinjuku) :- at(Yotsuya),
marunouchi(Yotsuya,Shinjuku).
1 :- at(Shinjuku). at(Shinjuku)

SoluSon: {walk(u-tokiyo,Hon3),
Marunouchi(Hon3,Shinjuku)}
9



STRIPSStanford Research InsStute Problem
Solver, 1971)
10

Minimax

Minimax

8001080

11


1966 ALPAC
1969 MinskyPerceptron
2

1970

12
AI

1980 AI

1981570
AI
1995 AI

13
 ELIZA(1964)


My head hurts "Why do you say your head hurts?
My mother hates me "Who else hates you?

1976








Twijer

Siri
CALODARPA

14
: MYCIN

197056



500

Q:
A:
Q:
A:
Q:
A:
Q:
A:
pseudomonas

15


(1960-)

Cyc(1984-)
20

(#$isa #$BillClinton #$UnitedStatesPresident)

"Bill Clinton belongs to the collecSon of U.S.
presidents

(#$genls #$Tree-ThePlant #$Plant)
"All trees are plants".

(#$capitalCity #$France #$Paris)
"Paris is the capital of France.

Cyc

haspart-of
16
1990-



(Gruber)

17
03
is-a part-of

part-of
31 part-of part-of 31 part-of
part-of part-of part-of
part-of






part-of

is-a is-a
part-of part-of

is-a part-of

18
HeavyLight
Heavy-weight ontology
Light-weight ontology

19
Wikipedia
 Watson(2006-)
IBM
20111
!Jeopardy!

Watson
IBM

1871

WatsonProVISION, 2011
20


He saw a woman in the garden with a telescope.

21
Dennej 1984

PULLOUT(VAGON, ROOM)


R2PULLOUTWAGON, ROOM




relevantirrelevant

22
Harnard 1990

23


AI

1995 AI

24
AI

1990
TREC(Text Retrieval Conference)(1992

Google(1998)
2000
1995120061


2010 AI

25
Machine learning)

26


Government

Science

Arts

27
Government

Government

Science

Arts

28


Nearest neighbor





C4.5

SVM

29


... 10

... 784

30
Yuta Kikuchihjp://kiyukuta.github.io/2013/09/28/casualdeeplearning4nlp.html
3(1957-)

31
Back PropagaSon(1974-)

W2
f= (corercti predictedi )2
iTraining

f
W2 W2 +
W1 W2
f W2
W1 W1 +
W2 W1

32


1

W2

W1 33

Feature engineering

, feature
SIFT

168 250
176 700
183 1200
155 400
174 180
163 5000

34



35


36
 Deep Learning
AI50

2013415 37
Auto-encoder(2006-)
Deep Learning



(
J. Hawkins

38
Auto-encoder

39
Deep

..
..
40
41
 Deep Learning
ILSVRC2012Large Scale Visual RecogniSon Challenge 2012

Deep
Learning

Feature
engineering

42
 DL

Google
Hinton
Google2013
Deep Learning
Deep Mind Technologies
4202014 Deep Learning workshop(2013)

Baidu
Deep Learning2013
Stanford Andrew NgDeep Learning300
2014)
Facebook
: New YorkYann LeCun2013
Vicarious4,0002014

43
Deep LearningAI

AI50




1980- 1990- 2000-




GPU

44

Deep learning

Deep Learning
Deep Learning 45


46

 WBA

AIAI

3WBA

20131219()100
20140130()230
20140329
20140422()193
20140602() 100
20140701 230
20140718 170
20140922 175
20141110 198
20150204 195
2015051410 450

47
WBA
AI

AI

1.

2.

48


Deep learning,
SOM,

49


50




EC


Pepper 1

2007 2014 2020 2025 2030


51

Deep LearningAI
52
 10)

Oxford(2013)
10
702

9

53
Frey, Carl Benedikt, and Michael A. Osborne. "The future of employment: how suscepSble are jobs to computerisaSon?." Sept 17 (2013): 2013.

5
AI

515


AI

15
AI

54




AIAI
0.9^1000=0 1.1^1000=

(IT)

55
Wikipedia

or





SF


20141215

201529
FLIFuture of Life InsStuteStanford AI100

20156113:00-15:00@
56


2014/11-
Rectuit InsStute of Technology2015/4-
2015/5-
5000
AI

...

ICT
NEDO
...

57


1995
Google
Amazon
Facebook

58

1. 1)
2. (3)Deep Mind
3. (2)RNN
4. (2)
5. (3)Deep Mind
6. (5)SHRDLUDL
7. (2)
8. (4)
9. (4)
10. (2)
11. (1-3)
12. (4)

13. (3)
14. (3)
15. (6)

59

60





AI





...

61


ICLR2015San Diego, 5/7-9)

NIPS, ICML
81922
100

CNNFFT

RNN, LSTM

DQNNueral turing machine

AutomaSc Image CapSoning

62


63