,

. . , . .-. .2
-
Oleg_granichin@mail.ru


, , .. IEEE MSC2012. 
:
. , ,
, .

: , , , , , , , .

1948
,
-

.
. . , 1984 [1]

1.

I ,
.
1 
( 16.740.11.0042 01.09.2010).

2
c . . , 2012

 ,
, , ,
, ,
. ,  /. , .
c, . ,  
[2].
2.

, ,
,

. .
. .
2.1.

. 1:

, . . 
- ( ). - ( ).
4

  , . .

.
.

,
,

( ).
,   ,  , -
.
,
, -   [3].

 x,  u.


u = U(x),
(1)

U()  x. x . , (1) .
, . u
x, .

. 2.

. 2:

2.2.

: , .

.
, . ,  .
6

 .
. , . .
, , .  . f  , y  . . 3.

. 3:

( ).

, 
u = U(y).

(2)

.
,
.
,
[4].
.
,
.
7

, 
 38.5oC .
, , . .
,
,
.

y u, -
- .
. 
, . . .
.
  (), 
.

Data Mining.

(), U() (. 4).
, .
( )
  (), ,
, (. .
).
.
- (- ).
 , , , , . . 8

. 4:

U().

,
,
( ). , , -
. , . ..  : 
,
 [5]. ,
,
, ,
 .

, Data Mining. ,
 (underlying) .
9

 Data Mining, -
. Data Mining ,
.
. . -
( ) .
.
2.3.

, , x f , .
- , ,
, ? - ,
 .

.
?
,
, . .
  .
, . .
 t. f
t f (t), y(t)  , t.
. ,
  3 . 3
. , -

10

, y(t + ) y(t). = 1,   , .
t
, . .
. ,
(),
.
.  , . .
.
,
() [79].
f (t)
.
. . .

,
.
. .
?
.
?

. , , , ,

, -

. [6].

11

3.

,
,
- [10], , , [11], [12].

[13],
,
,
.
,
, .
,
.
3.1.

(. . 5).

(. . 6).

. 5:

f
, y
y = Af + v,

(3)
12

. 6:

A  , . ,
T  , m  , A m T .

. v ,
.
?
v v 0.
 ,
, . . v(t)
0 t .
. , v(t), t = 1, . . . , T,
Mv v .
13

 [14].
3.2.

t =
1, . . . , T  f (t),
y=

T
T
1 X
1 X
f (t) +
v(t).
T t=1
T t=1

(4)

(3)
PT
A = ( T1 , . . . , T1 )T v = T1 t=1 vt .
v(t)
, , , [13],
> 0 , (4) Mv , , . . .
y Mv
f (t), (4).
.
?
- f . ,
, . . , .

f .
, (
) .
 , . . .
3.3.

. .. [15]. ,

14

 .. [16], ,
,  [10].
v(t).
. [17], .
[17] vt .
.. [18, 19],
, .
[17].
[20, 21] , .. , () 1934 [22]
( )
() .

. [23],
.
4.
4.1.

XX

( ).
. , , . 15

 ,
.
, . .
Data Mining.

. - - . ,
- .
XXI , ,
. . [24,25].
. ,

XX .
- Data Mining.  ,  [26]. ,
I .,
. , I .
,  .: (Control
Theory), (Communication Theory) (Computer Science) = C 3 [27].
-
,
  (
)?
, !
16



:
.
.. .
-
(
).  . ,
, 
. .
1. , .
2. , - , .
, .

,
.
4.2.

() u(t)
y(t), , y(0) = 1
t = 1, 2
y(t) + y(t 1)x = u(t 1) + v(t)

(5)

v(t) x :
v(t) t: |v(t)| 1;
x : x
[1; 5], .

u(0) u(1).
 |y(2)|.
17


J = sup

sup

x[1;5] |v(1)|1,|v(2)|1

|y(2)|

min .

u(0),u(1)

(6)

,
.

) . (u(0), u(1)).
, u(0) u(1), (6) (5) x, v(1), v(2), u(0), u(1):
J = sup

sup

x[1;5] |v(1)|1,|v(2)|1

|x2 u(0)x + v(1)x + u(1) + v(2)|.

x, v(1) v(2),
u(0) u(1). u(0) u(1)
opt
u(0) = 7, u(1) = 12.25 Jpr
= 8.25.
b) . t = 1
y(1) u(0). u(0)
U1 (y(1), u(0)).
y(1) u(0) (5)
|v(1)| 1 :
|y(1) + x u(0)| 1.

,
b
X(1)
= [b
x ; x
b+ ] = [1; 5] [1 + u(0) y(1); 1 + u(0) y(1)],

(7)

:
x
b = max{1 + u(0) y(1); 1}, x
b+ = min{1 + u(0) y(1); 5}.

u(1), (5) (7),

(6)
!
J = sup

sup

x[1;5] |v(1)|1

sup

sup | y(1)x + u(1) + v(2)| ,

(8)

b
|v(2)|1
xX(1)

18

b
y(1) u(1). , X(1),
u(1)
u(1) = U1 (y(1), u(0)) =

(9) (8),
J = sup

sup

x[1,5] |v(1)|1

x
b+ + x
b
y(1).
2

(9)


x
b+ x
b
y(1) + 1 .
2

y(1) (5), , J u(0).

u(0)
u(0) = 3,

opt
Jcl
= 2.125.

:
opt
opt
Jcl
= 2.125 << Jpr
= 8.25.

[28].
, , [29, 30].

. , .
4.3.

.
, v(t) ()? , {v(t)} 
(. . ).
, -
19

 ( ), -
- .
. , () u. , , f t
u(t) x ( / )
f (t) = u(t)x.

(10)

(3) :
y(t) = u(t)x + v(t).

(11)

() u(t), t = 1, 2, . . . , T,
y(t) (. . 7).

. 7:

u(t) 1 x, .

, .
, ,
.
 ,
() ( ). ,
20

, , . . (
, ).
,
, . 8.

. 8:

, .

: (, - . .),
( -),  (,
 ). (-, . .), 
( ), .
x, ,
,
x :
, ,
. . (  ).
21

 v(t) -
x?
(11) , v(t) y(t), u(t),
. . u(t) (11).
, , .
- ?
, . 7.   u(t) y(t). x ( x
 ).
u(t), 
 (
u(t)).   v(t),    (
 , ).
. {u(t), y(t)} () x R - ()
{v(t)}.
x (11) (. . 9).
1. () u(t)
.
2. y(t).
3. x u(t), y(t)
b , (, , x
b(t) X(t)
x).
4. 13.

. . ,
22

. 9:

.
, .
.
1.
, , ,
()
.

. 10:

, x ,

.
() v(t),
[13],
u(t) 1, x
t

x
b(t) =

1X
y(i).
t i=1
23

 1:
t
u(t)

v(t) = rand() 0.5

y(t)
x
b(t)

2:

2.9

2.8

3.2

3.3

2.6

3.4

2.7

2.9

2.85

2.97

3.05

2.96

3.03

2.99

t
ut

vt = rand() 0.5 + Mv , Mv = 1
yt
x
b(t)

3.9

3.8

4.2

4.3

3.6

3.9

4.2

3.9

3.85

3.97

4.05

3.96

4.03

3.99

N = 7 , x 3, [0.5; 0.5] v(t),

. 1 ( 5).
x
b=x
b(7) = 2.99 x = 3.
  , (). ,
x .
,
Mv = Ev(t) (,
Mv = 1, . 2, 3) , , (. 2, 5)
x
b(7) = 3.99 x = 3.
x
, - .

, .

24

 x (11):
(
+1, 12 ,
u(t) =
(12)
1, 12 .
(u(t), y(t))
y(t) = u(t) y(t).


(11)
y(t) = u
(t) x + v(t),
u
(t) = u(t)2 v(t) = u(t) v(t).

. 11: .
, , v(t)  . v(t)
, , () 1.
,
E{
v (t)} = E{u(t) v(t)} = E{u(t)} E{v(t)} = 0 Mv = 0,

. . x (11), ,
()
1
25

 3:

t
u(t)

-1

-1

-1

v(t) = rand() 0.5 + Mv , Mv = 1

y(t)
u
(t)
y(t)
x
b(t)

-2.1

3.8

-1.8

4.3

3.6

4.4

-2.3

2.1

3.8

1.8

4.3

3.6

4.4

2.3

2.1

2.95

2.57

3.00

3.12

3.33

3.19

x, , . 1.
. 3
. 7, . 3, , 5, . 2,
5, . 1 , 
 v(t) v(t).

( ) x
v(t), ,
[31] (. [32, 33] ). , .
1. m = 10, (= m 1)
T1 , . . . , T9 .
P
2. 9 si = 14 jTi y(j), i = 1, . . . , 9.
3.

b = [min si ; max si ],
X
i1:9

i1:9

x c p = 80% (= 1 2 1/m).
,
. p = 80% , 80 100 x,
26

 , ,
{vt }.
{u(t), y(t)} . 3

0 1 1 1 1 0 0
3.375
s1

1 0 1 1 0 1 0
1

(2.1)
3.15
s2

0 1 1 0 1 1 0

3.8
3.4
s3

1 1 0 0 0 1 1 1 (1.8)
3.15
s4

1
= 3.075

1 4.3
s5 =
1 0 0 1 1 0 1

1 3.6
2.875
s6
0 1 1 0 1 0 1

1
0
0
1
1
0
1
1

4.4
3.275
s7

1 1 1 0 0 1 0
1 (2.3)
3.025
s8
1 0 0 1 0 1 1
3.275
s9

b = [2.875; 3.4] , X
x c p = 80%,
, . . x = 3. (m = 20)
s(i), ,
p = 90%, , ,
b.
X
, ,
.
, ,
.
5.

.
2. ,
,
,
. , P .
27


,
, .
P .
,
.
3. - p,
p.

: , 75%- .
, .
100%.  , , p ,
. p 3 , 0 1, ,
 .
, ,
[0; 1], .
5.1.

 [1], vt Q,

( ), . .
. . Q
vt , . . Q
28

 . , P ,
. P , , , ,
Q .
5.2.

.
.

,
.

. 
( ).
,  ,
. ,
.

, , , [13] [34].
6.

. , ,
,
.
29

 ,  , . 11 .
:
 ,
.

. . [35].
 .
.
,
.
, ,
. ,
, .
 ( ),
( , , ,
,
). () C2 . . |0i |1i, {0, 1} .
, , , . ( ), , , . ,
30

 , .
,
q-. ,
, r
, -. , r q- r
C2 . r. , r = 3 |0i |0i |0i
|000i. : |0i|0i|0i |00i|0i. , ,
, .
 .
,
 i k, k r. r
|i00 . . . 0i. , . , r
C2 .
X
x=
e |ei,
e

e r,
P
e C, e |e |2 = 1. e
, x |ei.
, .
( ).
 .
, U  

31

 u:
U|xi = hu, xi.

{|0i, |1i}. 
.

, . , . , ( ) .

 [36].
f : {0, 1} {0, 1}   , , 24 .
: f (u) ?
, , 48 .
 , f (u). , :
Uf : |ui|zi |ui|z f (u)i,

f 1. ,
f (0) = f (1)?  |0i
|1i, , ,
(u = 0 u = 1). ,
 !

:
1 X
(1)uz |uzi,
H : |ui
2 z
!
!


1 (|0i + |1i)
1
1
|0i
2
2
2
H :

.
, . . H =
1 (|0i |1i)
1
|1i
12
2
2
32

 ,
.
  (
) :

|0i

|1i

Uf

. 12: .
|0i|1i,
1
1
(|0i+|1i)(|0i|1i) [(1)f (0) |0i+(1)f (1) |1i](|0i|1i)
2
2
 i


1 h

(1)f (0) + (1)f (1) |0i + (1)f (0) (1)f (1) |1i
2
1
(|0i |1i).
2

|0i|1i

, ,
|0i , f (0) = f (1) (. . f 
) |1i , f (0) 6= f (1)
( ).

.
|0i |1i,
f (0) f (1), ,  
.
, . 12 . 11,
.

33

7.

7.1.

-, ,

- (), - , [37].
( ) ().
,
. -
, , .. [38].
-
. [39]
, .
, ,  , [4044].

.
.

.
.  , ,
34

 .
, , .. [45], .. [46], . .. [47].

[4851] [52],
.
7.2.

. [53]
. . , . , T. , .. , . [5457],
, , ,
, . , .. .. [58,59]
.
[6067].

.. [14]. , Simultaneous Perturbation Stochastic Approximation (SPSA),
[68], . [69], ..
.. [70], .-. , . . -
[71].  , ,
, .
35

 :
;
;
;
;
 .

[72, 73]. [74]. [75, 76] ,

, . [77, 78]
(). [79]
. [80]
SPSA .

.
,
  .
7.3.

,
,  . ,

, ,
(
36

).  .
, 1986 . .. [81] .. . [82]
(
). . , . [83]
. , . [84]
.
[33, 8587].
, 2012 [85]
.

P. , . . [88]. -
..
.. [8992].
7.4.

(2-D) (3-D)
.

(, , ).
1-D T = 103
, 106 2-D,
3-D  109 . -
(, Nyquist
Rate) , 37

 . ,
( , ) - ,
.
x RT y Rm m << T , , ,
.

--, ,
f : R R L2 (R)
,
, .
x
,
f . , ,
. /  ,

 .
.

compressive sensing ( ),
 (sparse) [93, 94]. y = Ux, x
, U 
, ,
m T .
`1 - [95]: x

||x||1 min .
{x:y=Ux}

[9699].
38

8.

,
. ,
,
.
, ,
. 
, 
. . ,
 ()
.
 (worst-case) 
,  .
, 
,
. .

[1] .. .  .: . 1984. 288 c.

[2] Rzevski G. Modelling large complex systems using multi-agent
technology // In Proc. of 13th ACIS International Conference
on Software Engineering, Articial Intelligence, Networking, and
Parallel/Distributed Computing (SNPD 2012), 2012. P. 434-437.
[3] . ,
.  .: . 1983. 344 .
[4] .. .  .: H. 1987. 712 .

39

[5] .. // .:
.  .: .
1972. C. 89108.
[6] .., .., .. //
. 2005. 1. . 2947.
[7] .., .., .., .., .. //
. 2011. 6. C. 3137.
[8] .., .. // . 2012.
11. C. 629.
[9] Amelin K., Amelina N., Granichin O., Granichina O. Multiagent stochastic systems with switched topology and noise
// In: Proc. of 13th ACIS International Conference on
Software Engineering, Articial Intelligence, Networking, and
Parallel/Distributed Computing, (SNPD 2012), 2012. P. 438443.
[10] .., .. .  .: . 1955.
408 .
[11] Gibbs J.W. Elementary Principles in Statistical Mechanics. 
Woodbridge, Connecticut. 1902.
[12] Lebesgue H. Integrale, Longueur, Aire.  Universite de Paris. 1902.
[13] .. .  .: . 1980. 574 .
[14] .., ..
.
.: . 2003. 293 .
[15] Fradkov A.L. Continuous-time averaged models of discrete-time
stochastic systems: survey and open problems // Proc. of IEEE
Conf. on Decision and Control. 2011. P. 20762081.
40

[16] ..
I, II // . 1972. 3. . 675. 5. . 63-67.
[17] Ljung L. Analysis of recursive stochastic algorithms // IEEE
Trans. Automat. Control. 1977. No. 4. P. 551575.
[18] .. // . .
I-1983. . 9. C. 102118. . II-1984. . 3. . 104113.
[19] .. ,
// . . 1985. 4(21).
. 4963.
[20] .., .. // .
1974. 1. . 6775.
[21] .., ..

// . . . 1975.
5. . 9399.
[22] .. // . . . - . .. .
1934. . 5. . 95124.
[23] Kushner H.J. Convergence of recursive adaptive and identication
procedures via weak convergence theory // IEEE Trans. Automat.
Control. 1977. No. 6. P. 921930.
[24] .. 48- 49-   (IEEE CDC/CCC 2009 CDC
2010) // . 2011. 12. C. 173178.
[25] .. 48-50-   (IEEE CDC/CCC 2009, CDC 2010
CDC-ECC 2011) // . 2012. 8(1). . 142151.
41

[26] .., .. 
// .
5- . .  
(-2008). 2008. . 115.
[27] .., ., ..
: , // . 2010. 4. C. 3499.
[28] .., .. // . . 1. 1986. .1. C. 2630.
[29] Sokolov V.F. daptive suboptimal control of a linear-system with
bounded disturbance // Systems & Control Letters. 6(2). 1985.
P. 9398.
[30] Sokolov V.F. Adaptive suboptimal control in the case of
constrained noise // Automation and remote control. 46(9). 1985.
P. 11311139.
[31] Campi M.C. Why is resorting to fate wise? A critical look
at randomized algorithms in systems and control // European
Journal of Control. 2010. 5. P. 419430.
[32] .., .. //
. 7. 2010. . 368.
[33] .H.
// . 2012. 1.
. 2435.
[34] Hoeding W. Probability inequalities for sums of bounded random
variables // J. Am. Stat. Assoc. 1963. 58. P. 1330.
[35] .., .. // . 2. 2006. . 219253.

42

[36] Deutsch D. Quantum theory, the Church-Turing principle and the

universal quantum computer // Proc. of the Royal Society of
London. Ser. A. 400. 1985. P. 97117.
[37] Metropolis N., Ulam S. The Monte Carlo Method // J. Amer.
Statistical Assoc. 44. No. 247. 1949. P. 335341.
[38] .. - . C.
 .  .:
 . 1971. 471 c.
[39] .., ..
// . 1. 2005. . 7380.
[40] .., .., ., . P //
. 2011. 4. . 8698.
[41] Granichin O., Morozkov M., Volkovich Z. Necessary conditions for
the condence level of the randomized algorithm of nding the true
number of clusters // Proc. of IEEE International Symposium on
Intelligent Control. 2011. P. 10021007.
[42] .. // .
7. 2011. . 6982.
[43] Morozkov M., Granichin O., Volkovich Z., Zhang X. Fast
algorithm for nding true number of clusters. Applications to
control systems // In Proc. of Chinese Control and Decision
Conference (CCDC), 2012. P. 20132018.
[44] Avros R., Granichin O., Shalymov D., Volkovich Z., Weber G.W. Randomized algorithm of nding the true number of clusters
based on Chebychev polynomial approximation (Chapter 6) //
Data Mining: Found. and Intell. Paradigms, D.E. Holmes, L.C.
Jain (Eds.), Berlin Heidelberg: Springer-Verlag, ISRL 23. Vol. 1.
2012. P. 131155.
[45] .. . .: .
1968. 376 .
43

[46] .. // .
 . . . 1972. 1. . 180185.
[47] .., .. . .: . 1991. 248 c.
[48] Metropolis N., Rosenbluth A.W., Rosenbluth M.N., Teller A.H.,
Teller E. Equation of state calculations by fast computer machines
// J. Chemical Physics. 21. 6. June 1953. P. 10871092.
[49] Kirkpatrick S., Gelatt Jr.C.D., Vecchi M.P. Optimization by
simulated annealing // Science. 220. 1983. P. 671680.
[50] .. //
. 2005. 1. . 133149.
[51] ..
(simulated annealing) // . 2009. 5. . 6590.
[52] Holland J.H. Adaptation in Natural and Articial Systems.
University of Michigan Press. Ann Arbor. 1975. 183 p.
[53] Fisher R.A. The Design of Experiments. Edinburgh: Oliver and
Boyd. 1935.
[54] . , . .: . 1977. 223 .
[55] .,  T. :
.  .: H. 1991. 431 .
[56] .. . .:
. 1995. 336 c.
[57] Young .. Recursive Estimation and Time-Series Analysis. An
Introduction.  BerlinHeidelberg: Springer. 1984. 300 p.
[58] .. //
. . 1. . 3. 1988. . 9293.
44

[59] Goldenshluger A.V., Polyak B.T. Estimation of regression

parameters with arbitrary noise // Mathematical Methods of
Statistics. 1993. 2(1). P. 1829.
[60] .., ..
// . 2(73). 2011. . 3850.
[61] .. // . 7. 2011.
. 93116.
[62] ..
// . 2002. 9. C. 125133.
[63] Granichin O.N. Linear Regression and Filtering under
Nonstandard Assumptions (Arbitrary noise) // IEEE Trans.
on Automat. Contr. 49(10). 2004. P. 18301835.
[64] Fedin D.S., Granichin O.N., Dedkov Yu.S., Molodtsov S.L.
Method of measurements with random perturbation: Application
in photoemission experiments // Review of Scientic Instruments.
79. 2008. 036103.
[65] Vakhitov A., Granichin O., Vlasov V. Adaptive control of
SISO plant with time-varying coecients based on random test
perturbation // Proc. of the American Control Conference. 2010.
P. 40044009.
[66] .., A.T.
// . 7. 2011. . 117128.
[67] Amelin K.S. Randomization in controls for the optimization of a
small UAV ight under unknown arbitrary wind disturbances //
Cybernetics and Physics. 1(2). 2012. P. 7988.
45

[68] .. ,
// . C. 1. 1989. 1(4). . 1921.
[69] Spall J.C. Multivariate stochastic aproximation using a
simultaneous perturbation gradient aproximation // IEEE
Trans. Automat. Contr. 37(3). 1992. P. 332341.
[70] .., .. // . 1990. 26. . 126133.
[71] Chen H.-F., Duncan T.E., Pasik-Duncan B.A Kiefer-Wolfowitz
Algorithm with Randomized Dierences // IEEE Trans. Automat.
Contr. 1999. 44(3). P. 442453.
[72] .. // . 2002. 2. C. 4455.
[73] .. // . 2003. 2.
C. 8899.
[74] .., ..
// . 2005. 8. C. 5263.
[75] .., .. , // . 1. 2005. . 1728.
[76] .. // . 6. 2010. . 344.
[77] .., .., ..
// . 2009. 11. C. 7079.
46

[78] Granichin O., Gurevich L., Vakhitov A. Discrete-time minimum

tracking based on stochastic approximation algorithm with
randomized dierences // In: Proc. of the Conference on Decision
and Control. 2009. P. 57635767.
[79] .., .., ..
// : , . 2009. 11.
C. 4553.
[80] Antal C., Granichin O., Levi S. Adaptive autonomous soaring of
multiple UAVs using SPSA // In: Proc. of the IEEE Conference
on Decision and Control. 2010. P. 36563661.
[81] .., .. // .
1986. 2. C. 100112.
[82] Chen H.-F., Guo L. Convergence rate of leastsquares stochastic
systems // Int. Journal of Control. 1986. 44(5). P. 14591477.
[83] Campi M.C., Weyer E. Non-asymptotic condence sets for the
parameters of linear transfer functions // IEEE Trans. Automat.
Control. 55(12). 2010. P. 27082720.
[84] Calaore G.C., Fagiano L. Robust model predictive control:
the random convex programming approach // Proc. of IEEE
International Symposium on Intelligent Control. 2011. P. 222227.
[85] Amelin K.S., Granichin O.N. Randomized controls for linear
plants and condence regions for parameters under external
arbitrary noise // In: Proc. of the American Control Conference.
2012. P. 851856.
[86] Amelin K., Amelina N., Granichin O., Granichina O. Two
procedures with randomized controls for the parameters'
condence region of linear plant under external arbitrary noise //
In: Proc. of IEEE International Symposium on Intelligent Control.
2012. P. 12261231.
[87] Amelin K., Amelina N., Granichin O., Granichina O. Combined
procedure with randomized controls for the parameters' condence
47

region of linear plant under external arbitrary noise // In: Proc. of

the IEEE Conference on Decision and Control. 2012. P. 21342139.
[88] Tempo R., Calaore G., Dabbene F. Randomized Algorithms for
Analysis and Control of Uncertain Systems, with Applications. 
London: Springer-Verlag. 2012.
[89] Calaore G., Polyak B.T. Stochastic algorithms for exact and
approximate feasibility of robust LMIs // IEEE Trans. Autom.
Control. 46. 2001. P. 17551759.
[90] Polyak B.T., Tempo R. Probabilistic robust design with linear
quadratic regulators // Syst. Control Lett. 43. 2001. P. 343-353.
[91] .., .. .  .: . 2002. 303 .
[92] .. // . 2009. 5. . 6590.
[93] Candes E., Romberg J., Tao T. Robust uncertainty principles:
exact signal reconstruction from highly incomplete frequency
information // IEEE Trans. Inform. Theory. 2006. 52(2). P. 489
509.
[94] Donoho D. Compressed sensing // IEEE Trans. Inform. Theory.
2006. 52(4). P. 12891306.
[95] .., .. // . 1984. 5. C. 3946.
[96] .., .. // . . 2007. 82. 6. C. 829837.
[97] .. `1 - //
. 5. 2009. . 323.
[98] .., .. `1 // .
2010. 1. . 513.
[99] .., .. `1 - ( ) () // . 2010. 11. . 328.
48