You are on page 1of 20

..1,2), ..

3),
..4), ..2)
1)

. .. , vityaev@math.nsc.ru
2)
, netid@ya.ru
3)
Harvard University, Air Force Research Laboratory, US, leonid@seas.harvard.edu
4)
Central Washington University, Ellensburg, WA 98926-7520, US, borisk@cwu.edu
. (.. )
,
.
. -
, .
.

1.
,

[9,25-27]. , ,

, , ,
, . ,
, . [20]


. :
, , ;
; .
: , [3,13,32-33].
[28,30]. ,

08-07-00272-;
47, 115, 119,
(
-3606.2010.1.)

, 2011, 5, 1

.., .., .., ..


. ,
, [20],
. [3-5,7].

2.

, [9,20]. 1950- 1960- , , ,
, [9]. . . , , , ,
, .
, ,
.
.
, , .. [1]. .

,
(- ). ,
, .. , , , .. . . ,
.
. [8]:
, . , .

. 4 2002-2009 Projic (Probability+Logic). 2002 : Artificial intelligence is one key discipline in which probability theory competes with other
logics for application. It is becoming vitally important to evaluate and integrate systems that are based on very different approaches to reasoning, and there is strong de-

, 2011, 5, 1


mand for theoretical understanding of the relationships between these approaches.
, ..
, , ,
. , [2]
,
.
, [3,32-33]
. , , [31]. ,
. .
, ,
. modus ponens , , . , .
[8]: modus ponens , , .
modus ponens,
,
, .
,
, , ..
.. [4]. ,
[7]. 4
, .

() [9,27]. , , . , , -- ,
[27].

[27].
, . .
. [18] , , , NP-.
: ,

, 2011, 5, 1

.., .., .., ..


. , ,
.
,
[9]. ,
, , .
- .
[19] ,
, .
.
. , (, ) , .
,
[20]. , . ,
, , .
.
, .. [12]:
, ...
, - ( ) ()
, ....
() ( .. ), ( .. )
.
, [12]: ,
, . , ,
(, 00), . ...
( , , 01) , ( , .. )... ...
,
... ,
..., (00 , , 01 .. ), . , , ...

, 2011, 5, 1


, - . ,
. ? ... .
...
,
, . ,...
. ...
( )
,
.
, ,
, , , ( ). ,

, ( ,
), ( , ).
- , ,
. , ,
,
, ,
. .

3. , , ,

. ( ) [7,
13,32-33].
-, A = {a1 ,..., a m }
x1 (a),..., x n (a) , a . x i Pji (a) = (x i (a) = x ij ), j = 1,..., n i ,
x i1 ,..., x ini x i , i = 1,..., n . -

() At.
a, b, c, . ,
, ,

, 2011, 5, 1

.., .., .., ..


a, b, c, ( ). L.
, [20]
( )
Data = A,{P11 ,..., Pn11 , P12 ,..., Pn22 ,..., P1k ,..., Pnkk } ,

A.
, At. , {R}
(a1 & ... & a k b), a1 ,..., a k , b L ,
(1)
{R}.
(1) Pr. , (1) Data, a1 ,..., a k Data
= {R} Data, Data.
, ,
. , ,
.
1. R1 = (a11 & a12 & ...& a1k1 c)
, R 2 = (b12 & b 22 & ...& b k2 2 c) , R1 f R 2 ,
, {a11 , a12 ,..., a1k1 } {b12 , b 22 ,..., b 2k 2 } , k1 < k 2
, k1 k 2 .


1.
(
).
, ( )
. , ,
, f
[20].
2. 1 = {R1i }
,
2 = {R 2j } , R 2 2

R1 1 ,

, 1 f 2 ,

R 2
2

R1 f R 2 , R1 1 \ 2 .
2.
.
2 , .
F, , At , , .

, 2011, 5, 1


3. F : F a [ 0,1] , [15]:

1.

2.

, ( ) = 1 ;

, ( ) = ( ) + ( ) .

R = (a1 & ...& a k c)


(R) = (c / a1 & ...& a k ) =

(a1 & ... & a k & c)


, (a1 & ...& a k ) > 0 .
(a1 & ... & a k )

(a1 & ...& a k ) = 0 , .


Pr, , Pr0 .
, , Data.
4.
R Pr0 , ( ), , .. R ' Pr0 , R ' f R , (R ') < (R) .
,
, . PL (Probabilistic Laws). ( ) ,
.
1. R Pr0 , , R ' PL , R ' f R
(R ') (R) .
5.
= {R}, R PL .
2. , , ' , ' .

PL.
6.
,
R1 , R 2 PL
(R 1 ) (R 2 ) .
, .

7. [3,13,32-33]
( ) . R k
.

.

, 2011, 5, 1

.., .., .., ..


8. 2 = {R 2j }
, 1 = {R 1i } ,
1 < 2 , , 1 f 2

R 2 2 R1 1 ,

R 2 ,
2

R1 1 \ 2 ,
.
,
1 2 , ()
.

.
,
- .

, .. .
9.
= {R} {(R), R }
.
3. 1 < 2 , 1 = {R 1i } , 2 = {R 2j } ,
{(R), R 2 } 2 {(R), R 1} -

1 , (R 2 ) {(R 2 ), R 2 2 }
(R 1 ) (R 2 ) ,
(R 1 ) < (R 2 ) , (R 1 ) {(R1 ), R1 1} .
, .
10. L : 1 2 1 2 ,
1 < 2 ,
1 2 .
Discovery, :
1) 0 = {R} (1) k N, ;
2) 0 , 1 = {R | R 0 , R PL} ;
3) L : i i +1 , i = 1, 2,... ,
. ,
. -

, 2011, 5, 1



.
[23] .
[3,23-24,29].

4.


[4],
.
[4]. , ,
: , , , , , ,
. .
. [6] , , . .,
.
,
, Pji (a) = (x i (a) = x ij ) ,
j = 1,..., n i , x i (a) , x ij

( ) a . ,
Pji (a) , ,
Pji (a) .
( ) a P0 (a) .
a ,
P0 (a) . ,
,
. ( ) P0
, .
, , .
, ()
[17]
. [11].
, , , a, b, c, L.

, 2011, 5, 1

.., .., .., ..


a 11 & a 12

a 13

a 13 & a 14

a 15 & ... & a 1k

a 12 & a 22 & a 32

a 24 & ... & a 2m

a 32 & a 33

a 34 & ... & a 3n

{R} (1):
(a1 & ... & a k b) , a1 ,..., a k , b L ,
a1 ,..., a k (/) (),
, b P0 (a) ,
() . , .. P0 (a) .

(a1 & ... & a k b) . n(a1 ,..., a k , b) , a1 ,..., a k , b /


a1 ,..., a k . ,
, [4,5].
n(a1 ,..., a k , b) n + (a1 ,..., a k , b) , , n (a1 ,..., a k , b) ,
. () (a1 & ...& a k b) :
n + (a1 ,..., a k , b) n (a1 ,..., a k , b)
.
n(a1 ,..., a k , b)

. [11].
(b / a1 ,..., a k ) =

, 2011, 5, 1

10


(), ,
.
, ,
( ) , .
( 6), , , .
( 7). . 1 , :
1
1
1
1
1
1
1. (b a 1 & a 2 ) l (b a 1 & a 2 & a 3 & a 4 ) l
l (b a11 & a12 & a13 & a14 & a15 &... & a1k )
2
2
2
2
2
2
2
2
2. (b a 1 & a 2 & a 3 ) l (b a 1 & a 2 & a 3 & a 4 & ... & a m )

3. (b a 1 ) l (b a 1 & a 2 & a 3 ) l (b a 1 & a 2 & a 3 & a 4 & ... & a n )


,
, ( 4). ,
, , ..
()
, .

1
1
1
1
1
1
R1 l R 2 ( 6), .. (b a 1 & a 2 ) l (b a 1 & a 2 & a 3 & a 4 ) .
3

1
1
, (b a 1 & a 2 ) -

a13 & a14 (b a11 & a12 & a13 & a14 ) ,
b .
, ,
( 5), P0 (a) .

( 8), ( ) ( 6).
.
,
.
( 9)
.
( 10)
,

, 2011, 5, 1

11

.., .., .., ..


, , . , , .
, , , , . . , , .
, , ,

.
, , ,
,
, , .
, 3, , 5,
,
.
[9,25-27]
.
,
. .
:
,
, , , ,
;
, , ( ), , .

5.

[24].
J. Ruiz, ,
[21,24]. Discovery [3,23-24] ,

, 2011, 5, 1

12


, .
1. . , . , .
: 1 v1 , 2 v 2 ,
..., n v n ,
?. v1 , v 2 ,..., v n .
.
, .
. 11
w1 , w 2 , w 3 , y1 , y 2 , y3 , y 4 , y5 , x 3 , x 4 , x 5 ( : 1 , 0
). , 11
:
x1 , w1 , w 2 , w 3 :
w1 / cm 3 ,
w 2 / cm3 ,
w 3 .
x 2 ,
y1 , y 2 , y3 , y 4 , y5 :
y1
y 2
y3
y 4
y5 .
x1 g(w1 , w 2 , w 3 )
x 2 x 2 = h(y1 , y 2 , y3 , y 4 , y5 ) , . :
f ( x1 , x 2 , x 3 , x 4 , x 5 ) = f g ( w1 , w 2 , w 3 ) , h ( y1 , y 2 , y3 , y 4 , y5 ) , x 3 , x 4 , x 5 .

2. .

(x1 , x 2 , x 3 , x 4 , x 5 ) . : (10110) (10100).
(10100) , , , , (10110) , 1, ,
.
f ( x1 , x 2 , x 3 , x 4 , x 5 ) h ( y1 , y 2 , y3 , y 4 , y5 ) .

, 2011, 5, 1

13

.., .., .., ..


6.
, , f h . [16,21].
, [21].
1. 2 3
f h , .
g ( w1 , w 2 , w 3 ) ,
. 32
x1 , x 2 , x 3 , x 4 , x 5 1. [21,24]. 1
(01100) < (11100) . 10 6 :
(00000) < (00001) < (00011) < (00111) < (01111) < (11111) .
1 10, , ,
1.2 . 2 3 ,
, , 1* (01100) 3 ,
( ) . 2 3
. f (01100) = 1 1.1 1.2, 6.3. 7.3 .
h ,
, , (10010) y1 , y 2 , y3 , y 4 , y5 . , .
4 5 , f h . 4 1 5 0 .
f (01100) = 0 (01100),
2 7.1 (00100) 8.1 (01000), 5. 7.1 8.1, ..
. f (01100) = 0 1.2 f (11100) ,
f (11100) . f (11100) = 0 , 5.1. 3.1, 5.
, (*) 2 3 13
12 . , 13 f ( x1 , x 2 , x 3 , x 4 , x 5 ) 12 h ( y1 , y 2 , y3 , y 4 , y5 ) . 37.5% 32 .
, 2 211 = 4096 .

, 2011, 5, 1

14


1.

f
h
5: 0 a 0
1
2
3
6
7
4: 1 a 1
1.2, 6.3, 7.3
7.1, 8.1
1
1.1
(01100) 1* 1*

(11100)

6.4, 7.4

5.1, 3.1

(01010)

0*

1*

2.2, 6.3, 8.3

6.1, 8.1

(11010)

1*

6.4, 8.4

3.1, 6.1

(11000)

1*

1*

3.2

8.1, 9.1

(11001)

7.4, 8.4

8.2, 9.2

(10010)

0*

1*

4.2, 9.3

6.1, 9.1

(10110)

1*

6.4, 9.4

6.2, 5.1

(10100)

1*

1*

5.2

7.1, 9.1

(10101)

7.4, 9.4

7.2, 9.2

(00010)

0*

6.2, 10.3

10.1

(00110)

1*

0*

6.3, 10.4

7.1

(01110)

6.4, 10.5

6.3

(11110)

10.6

6.4

(00100)

1*

0*

7.2, 10.4

(00101)

0*

7.3, 10.4

10.2

7.2

(01101)

1*

7.4, 10.5

8.2, 10.2

7.3

(11101)

5.6

(01000)

1*

8.2

10.1

(01001)

1*

8.3

10.2

8.2

(01011)

8.4

10.3

8.3

(11011)

10.6

9.3

8.4

(10000)

1*

9.2

10.1

(10001)

1*

9.3

10.2

9.2

(10011)

9.4

10.3

9.3

(10111)

10.6

10.4

9.4

(00000)

10.2

(00001)

0*

10.3

10.2

(00011)

1*

10.4

10.3

(00111)

1*

10.5

10.4

(01111)

10.6

10.5

(11111)

13

12

10.1

1.2
2

2.1
2.2

3.1
3.2

4.1

5.1

4.2
5.2
6

6.1
6.2

7.1

7.4
8

10

, 2011, 5, 1

8.1

9.1

10.1

10.6

15

.., .., .., ..


7. ()
f ( x1 , x 2 , x 3 , x 4 , x 5 ) h ( y1 , y 2 , y3 , y 4 , y5 ) 1
:
1. ;
2. ;
3. ( ) .
1 3
x 2 = h ( y1 , y 2 , y3 , y 4 , y5 ) = y 2 y3 y 2 y 4 y1 y 2 y1 y 4 y1 y3
y 2 y3 y5 y 2 y1 y3 y 4 y5 y 2 y1 y3 y 4 y5 .

g ( w1 , w 2 , w 3 ) = w 2 w1 w 3 23 = 8
. 1 2

()

f x = x 2 x 3 x1 x 2 x 4 x1 x 2 x1 x 3 x 4 x1 x 3 x 3 x 4 x 3
x 2 x 5 x1 x 5 x 4 x 5 x 1 x 2 x 3 ( x 2 x1 x 4 ) x 5

( w 2 w1w 3 ) ( y1 y 2 y3 y 4 y5 ) x 3
( y1 y 2 y3 y 4 y5 ) ( w 2 w1 w 3 ) x 4 x 5 .
8.
Discovery [3, 23-24,29],
. , .
0.01, 0.05
0.1. 156 (73 , 77 , 2 4 ) [24].
.
134 ( 22 ). 86%. 19 (14% ).
5.2% (7 ) 8.9% (12
).
2.
. : NUM
cm 3 ; VOL in cm 3 ; TOT ; DEN ; VAR ; SIZE
; IRR ; SHAPE
.
0.75,
0.85 0.95, ,

, 2011, 5, 1

16

.
, .
44
( f -) 0.05 0.75; 30 0.85; 18 0.95. 30 90% 18
96.6% 3 (3.4%).
, 0.75,
0.85 0.95 , 86%, 90% 96.6%
. Discovery ,
. Discovery.
[22-23]
Discovery .
. , (Brainmaker), 100% , 66 %. (
SIPINA) 7682 % .

9.

(), Discovery
(),
. ,

, 2011, 5, 1

17

.., .., .., ..


Discovery
.
, 30,
5 cm3
,
.
f - 0.05 . 100% .
, .

10 20
,
.
f - 0.05 . 100% .
.



.
f - 0.05 . 92.86% .
.
, , .
[24].

10.
- .
. , ,
, .

1. . . //
. .: , 1978. . 727.
2. .., .., .., .. . ., ., 2004, 704.
3. .. . . . . -. , 2006. 293 .
4. .., , .. .. // , 2008, 3,
1, . 25-78.
URL: http://www.niisi.ru/iont/ni/Journal/V3/N1/Vityaev.pdf
5. .. . -

, 2011, 5, 1

18

6.
7.
8.
9.
10.
11.
12.
13.
14.
15.
16.
17.
18.
19.
20.
21.
22.
23.
24.
25.
26.

// VIII - 2006, , , 2006, .24-30


. . .: , 1988.
. 462.
.., .., // , 2008, 3, 1, . 79-107.
URL: http://www.niisi.ru/iont/ni/Journal/V3/N1/DeminVityaev.pdf
.. // , 2010,
4, 1, . 1-30.
URL: http://www.niisi.ru/iont/ni/Journal/V4/N1/Novikov.pdf
.. :
// , 2006, 1, 2, pp. 175-196.
URL: http://www.niisi.ru/iont/ni/Journal/N2/Perlovsky.pdf
.. // , 2010, 4, 1, . 31-36.
URL: http://www.niisi.ru/iont/ni/Journal/V4/N1/Redko.pdf
.. // . .
. . . .. . 1977. . 27. . 941948.
. . . .: , 1981. . 140.
.., .. , :
// . .6,
... , 2009, . 340-365.
.. //
. : , , . .11, . 1 (2011), ( ).
Halpern J.Y. An analysis of first-order logics of probability // Artificial Intelligence, 46,
1990, pp. 311-350.
G. Hansel. Sur le nombre des fonctions Booleenes monotones de n variables. C.R. Acad.
Sci., Paris (in French), 262(20):1088-1090, 1966.
Hebb D.O. The organization of behavior. A neurophysiological theory. NY, 1949. 335 p.
L. Hyafil, R.L. Rivest, Constructing optimal binary decision trees is NP-Complete. Information Processing Letters 5:1 (1976), 15-17.
Jackendoff, R. Foundations of Language: Brain, Meaning, Grammar, Evolution. Oxford
Univ. Press, New York, NY, 2002.
Kovalerchuk B.,Ya., Perlovsky L.I. Dynamic logic of phenomena and cognition // IJCNN,
2008, pp. 3530-3537.
Kovalerchuk B, Triantaphyllou E, Despande A, Vityaev E (1996): Interactive Learning of
Monotone Boolean Function. Information Sciences 94 (1-4):87-118.
Kovalerchuk, B., Vityaev E. Discovering Lawlike Regularities in Financial Time Series,
Journal of Computational Intelligence in Finance, v.6, No.3, 1998 pp.12-26.
Kovalerchuk B.Ya., Vityaev E.E. Data mining in finance: advances in relational and hybrid
methods. Kluwer Academic Publisher, 2000.
Kovalerchuk B.Ya., Vityaev E.E., Ruiz J.F. Consistent and complete data and ``expert''
mining in medicine // Medical data mining and knowledge discovery, Springer, 2001,
pp.238-280.
Perlovsky L.I. Toward physics of the mind: concepts, emotions, consciousness, and symbols // Physics of Life Reviews, 3, 2006, pp. 23-55.
Perlovsky L.I. Neural Networks, Fuzzy Models and Dynamic Logic // R. Kohler and A.
Mehler, eds., Aspects of Automatic Text Analysis (Festschrift in Honor of Burghard Rieger), Springer, Germany, 2007, pp. 363-386.

27. Perlovsky, L.I. (1998). Conundrum of Combinatorial Complexity. IEEE Trans. PAMI, 20(6)

, 2011, 5, 1

19

.., .., .., ..


p.666-70.

28. Probabilistic models of cognition // Special issue of the journal: Trends in cognitive science, v.10, Issue 7, 2006, pp. 287-344
29. Scientific Discovery website \\ http://math.nsc.ru/AP/ScientificDiscovery
30. The Probabilistic Mind. Prospects for Bayesian cognitive science // Eds. Nick Chater, Mike
Oaksford, Oxfor University Press, 2008, pp.536
31. Turchin V.F. A constructive interpretation of the full set theory // Journal of Symbolic Logic, 1987. V. 52. No. 1. PP. 172 -201
32. Vityaev E.E. The logic of prediction // Mathematical Logic in Asia 2005, Proceedings of
the 9th Asian Logic Conference, eds. Goncharov S.S., Downey R. and Ono.H., August 1619, Novosibirsk, Russia, World Scientific, 2006, pp. 263-276.
33. Vityaev E.E., Smerdov S.O. New definition of prediction without logical inference // Proceedings of the IASTED international conference on Computational Intelligence (CI 2009),
ed. Kovalerchuk B., August 1719, Honolulu, Hawaii, USA, pp. 48-54.
34. Evgenii Vityaev, Boris Kovalerchuk, Leonid Perlovsky, Stanislav Smerdov, Probabilistic
Dynamic Logic of Phenomena and Cognition // WCCI 2010 IEEE World Congress on
Computational Intelligence July, 18-23, 2010 - CCIB, Barcelona, Spain, IJCNN, IEEE Catalog Number: CFP1OUS-DVD, ISBN: 978-1-4244-6917-8, pp. 3361-3366

, 2011, 5, 1

20

You might also like