NHDT LTTT

HC VIN CNG NGH BU CHNH VIN THNG
Km10 ng Nguyn Tri, H ng-H Ty

Tel: (04).5541221; Fax: (04).5540587
Website: http://www.e-ptit.edu.vn; E-mail: dhtx@e-ptit.edu.vn
NGN HNG THI

Mn: L THUYT THNG TIN
S tn ch : 4
S DNG CHO NGNH IN T - VIN THNG V CNG NGH THNG TIN
H I HC T XA
CHNG I: NHNG VN CHUNG V KHI NIM C BN
1/ Chn cu ng sau :
a Tin lun c biu din di dng s
b Tm nh, bn nhc, bc th . . . khng phi l cc tin
c Tin l mt nh x lin tc n ngi nhn
d Tin l dng vt cht biu din hoc th hin thng tin.
2/ Chn pht biu ng trong nhng cu sau :
a Thng tin l nhng tnh cht xc nh ca vt cht m con ngi nhn c t th gii vt cht
bn ngoi
b Thng tin khng th xut hin di dng hnh nh
c Thng tin tn ti mt cch ch quan, ph thuc vo h th cm.
d Thng tin khng th xut hin di dng m thanh
3/ Mn l thuyt thng tin bao gm vic nghin cu:
a Vai tr ca thng tin trong k thut
b Cc qu trnh truyn tin v L thuyt m ha.
c L thuyt ton xc sut ng dng trong truyn tin.
d Cch chng nhiu phi tuyn trong v tuyn in
4/ Chn cu ng nht v ngun tin
a Ngun tin l ni sn ra tin
b Ngun tin l tp hp cc tin c xc sut v k hiu nh nhau
c Ngun tin lin tc sinh ra tp tin ri rc.
d Ngun tin ri rc sinh ra tp tin lin tc.
5/ Chn cu ng nht v ng truyn tin
a L mi trng Vt l, trong tn hiu truyn i t my pht sang my thu
b L mi trng Vt l m bo an ton thng tin
c L mi trng Vt l trong tn hiu truyn i t my pht sang my thu khng lm mt
thng tin ca tn hiu.
d ng truyn tin chnh l knh truyn tin.
6/ bin i mt tn hiu lin tc theo bin v theo thi gian thnh tn hiu s, chng ta cn
thc hin qu trnh no sau y:
a Ri rc ha theo trc thi gian v lng t ha theo trc bin
b Gii m d liu
c M ha d liu.
d Lng t ha theo trc thi gian v ri rc ha theo trc bin
1
CHNG II: TN HIU V NHIU

1/ Chn cu ng v tn hiu:
a Tn hiu l mt nh x lin tc n ngi nhn
b Tm nh, bn nhc, bc th . . . khng phi l cc tin
c Tin lun c biu din di dng s
d Tn hiu l qu trnh ngu nhin .
2/ Chn pht biu ng nht v c trng thng k :
a c trng cho cc qu trnh ngu nhin chnh l cc quy lut thng k v cc c trng thng
k
b K vng, phng sai, hm t tng quan, hm tng quan l cc quy lut thng k
c Cc hm phn b v mt phn b l nhng c trng thng k
d Tn hiu v nhiu khng phi l qu trnh ngu nhin theo quan im thng k
3/ Chn cu ng nht v hm t tng quan :
a Hm t tng quan l quy lut thng k th hin ca qu trnh ngu nhin.
b
Hm
tng
Rx (t1 , t2 ) = M
quan
{[ X (t ) m (t )] }
R x (t1, t 2 ) lun
tnh
bng
biu
thc
sau
Hm t tng quan R x (t1, t 2 ) c trng cho s ph thuc thng k gia hai gi tr hai thi
im thuc cng mt
Hm t tng quan R x (t1, t 2 ) lun bng phng sai Dx (t ) vi mi t
4/ Vic biu din mt tn hiu gii hp thnh tng ca hai tn hiu iu bin bin thin chm s lm
cho vic phn tch mch v tuyn in di tc ng ca n tr nn phc tp
a ng
b Sai
5/ Ngi ta gi tn hiu gii rng nu b rng ph ca n tho mn bt ng thc sau:
1
0
. Cc tn hiu iu tn, iu xung, iu xung ct, manip tn s, manip pha, l cc tn hiu
gii rng.
a Sai
b ng
6/ Chn cu ng v cng thc xc nh mt ph cng sut
ET =
xT
1
(t)dt =
S
T () d
2
l cng thc xc nh mt ph cng sut ca cc qu
trnh ngu nhin.

2
ST ()
= G T ()
l cng thc xc nh mt ph cng sut ca cc qu trnh ngu nhin.

2
G() = M {G x ()} = M lim
ST ()
T
trnh ngu nhin.

2
ST ()
G x () = lim G T () = lim
T
trnh ngu nhin.

7/ Chn cu ng v cng thc quan h gia mt ph cng sut v hm t tng quan
2
ST ()
G x () = lim G T () = lim
T
G() = M {G x ()} = M lim
ET =
xT
T
2
1
(t)dt =
S
T () d
2
G() =
ST ()
R()e
8/ Trong trng hp h thng tuyn tnh th ng c suy gim th nhng thi im t >> t 0 = 0 (thi
im t tc ng vo), qu trnh ngu nhin u ra s c coi l dng. Khi hm t tng quan
v mt ph cng sut ca qu trnh ngu nhin u ra s lin h vi nhau theo biu thc sau :
1
j
R ra () =
G ra ()e d
2
a
b
Sai
ng
*
9/ S a
( t ) l hm lin hp phc ca S a ( t ) : S a ( t ) = x ( t ) + j x ( t ) l tn hiu gii tch.
ng bao ca tn hiu gii tch c th biu din bng cng thc sau: A ( t ) = S a ( t ) .S*a ( t )
a
b
Sai
ng
10/ Mt mch v tuyn in tuyn tnh c tham s khng i v c tnh truyn t dng ch nht
(hnh di) chu tc ng ca tp m trng dng. Tm hm t tng quan ca tp m ra theo cng
thc
G
R ra ( ) = 0
2
K()
cos d
ta c kt qu no ?
| K() |
GV()
2N0
0
a.
b.
R ra () =
2
ra
2 cos
0
2
sin
1
1
R ra (0) = =
G
(
)d
P
K(
=
=
ra
ra
) G v ()d
2
2
1
R ra ( ) =
G ra ()e j d
Rra = 0
11/ Cho qu trnh ngu nhin dng c biu thc sau: X ( t ) = A cos ( 2 f0 t + )
Trong A = const, f0 = const, l i lng ngu nhin c phn b u trong khong ( , ) .

Tnh k vng M { X (t )} theo cng thc M { X (t )} =
a
M { x(t )} = 0
M { x(t )} = 2
M { x(t )} =1
M { x(t )} = 1
X (t )w( )d
ta c gi tr no di y
12/ Cho qu trnh ngu nhin dng c biu thc sau: X ( t ) = A cos ( 2 f0 t + ) Trong A =
const, f0 = const, l i lng ngu nhin c phn b u trong khong ( , ) . Tnh hm t

tng quan R (t1 , t2 ) theo biu thc R (t1 , t2 ) = M { X (t ). X (t + )} ta c gi tr no di y:
a
b
c
d
R (t1 , t2 ) = A2 cos 2 f 0
R (t1 , t2 ) = 0
1
R (t1 , t2 ) = A2 cos 2 f 0
2
R (t1 , t2 ) = A2 cos 2 f 0
13/ Tn hiu in bo ngu nhin X(t) nhn cc gi tr + a; - a vi xc sut nh nhau v bng 1/2. Cn
xc sut trong khong c N bc nhy l: P ( N, )
N
)
(
=
e
>0
N!
(theo phn b Poisson). T cc gi thit trn tnh c hm t tng quan Rx ( ) = a 2 e2 . Khi
mt ph cng sut Gx ( ) ca X(t) c tnh theo cng thc Gx ( ) = 2 Rx ( ) cos d ta c gi

0
tr no sau y:
a
b
c
4a 2
4 2 + 2
4a 2 +
Gx ( ) = 2
4 + 2
Gx ( ) = 0
Gx ( ) =
Gx ( ) =
4a 2
4 2 2
14/ Mt qu trnh ngu nhin dng c hm t tng quan: Rx ( ) = 2 e cos 0

Khi mt ph cng sut ca cc qu trnh ngu nhin trn l
2
2
+ 2
a Gx ( ) = 2 2
+ ( 0 ) + ( + 0 )
b
c
d
2
2
2
Gx ( ) = 2 2
+ ( 0 ) + ( + 0 )
1
1
2
Gx ( ) = 2 2
+ ( 0 ) + ( + 0 )
1
1
+ 2
Gx ( ) = 2 2
+ ( 0 ) + ( + 0 )
CHNG 3: C S L THUYT THNG TIN THNG K

1/ Khi nim lng tin c nh ngha da trn:
a
Nng lng ca tn hiu mang tin
b bt nh ca tin
c
ngha ca tin
d Nng lng ca tn hiu mang tin v ngha ca tin
2/ Chn pht biu ng nht v Entropy ca ngun tin, H(X):
a
L i lng c trng cho bt nh trung bnh ca ngun tin
b
c tnh theo cng thc H ( X ) = P( X ) log P( x)
x X
c
d
t cc tiu khi ngun l ng xc sut

t cc i khi ngun l ng xc sut
3/ Chn pht biu sai v bt nh

a
bt nh ca php chn t l nghch vi xc sut chn mt phn t
b bt nh gn lin vi bn cht ngu nhin ca php chn
c
bt nh ca mt phn t c gi tr 1 bit khi xc sut chn phn t l 1
d bt nh cn c gi l lng thng tin ring ca bin c tin
4/ Entropy ca ngun ri rc nh phn H(A) = p log p (1 p ) log (1 p )
Khi p=1/2 th H(A) t max Chn cu ng v H ( A) max

a H ( A) max =3/2 bt;
b H ( A) max =1/2 bt;
c
H ( A) max =1 bt ;
d H ( A) max =0
5/ Trong mt trn thi u bng Quc t, i tuyn Vit Nam thng i tuyn Brazin, thng tin ny
c bt nh l
a
bng 0 ;
b V cng ln
c
nh hn 0;
d ln hn 0
6/ Hc sinh A c thnh tch 12 nm lin t danh hiu hc sinh gii, hc sinh B lc hc km Thi tt
nghip ph thng trung hc, hc sinh A trt, hc sinh B th khoa Thng tin v hc sinh B th
khoa, hc sinh A trt c bt nh l:
a bng 0 ;
b V cng ln
c nh hn 0;
d ln hn 0
7/ Chn ngu nhin mt trong cc s t 0 n 7 c xc sut nh nhau Khi xc sut ca s c
chn ngu nhin l:
a 7
b 1/8
c 8
d -7
8/ Mt thit b v tuyn in gm 16 khi c tin cy nh nhau v c mc ni tip Gi s c mt

khi no b hng, khi xc sut ca mt khi hng l:
a 1/16
b 16
c -16
d -1/16
9/ B t l kh 52 qun (khng k fng teo), A rt ra mt qun bi bt k Xc sut v qun bi m A
rt l:
a
Bng 1/52
b Nh hn 5
c
Ln hn 5 nh hn 6
d Bng 1/52
10/ Chn cu sai trong cc cu sau :
a
bt nh s tr thnh thng tin khi n b th tiu
b bt nh chnh l thng tin
c
Lng thng tin = bt nh tin nghim + bt nh hu nghim
d Lng thng tin = bt nh tin nghim - bt nh hu nghim
11/ Chn cu ng sau :
a Lng thng tin = thng tin tin nghim - thng tin hu nghim
b Thng tin hu nghim chnh l thng tin ring
c Lng thng tin = thng tin hu nghim - thng tin tin nghim
d Lng thng tin = thng tin tin nghim + thng tin hu nghim
12/ Chn cu sai trong cc cu sau :
a Thng tin tin nghim (k hiu I( xk )) c xc nh theo cng thc sau:I( xk ) = log P( xk );
b Thng tin tin nghim cn gi l lng thng tin ring;
c Thng tin tin nghim (k hiu I( xk )) c xc nh theo cng thc sau:I( xk ) =- log P( xk );
d Thng tin tin nghim cn gi l lng thng tin ring c xc nh theo cng thc sau :
1
I( xk ) = log
;
P( xk )
13/ I ( xk , yl ) l lng thng tin cho v xk do yl mang li c tnh bng cng thc no sau y :
1
1
log
a log
P( xk )
P( x k / yl )
b I ( y j ) I ( y j / xk )
c
d
1
log P( x k / yl )
P( xk )
P( y l / xk )
log
P( y l )
log
14/ I ( xk / yl ) = log p( xk / yl ) l thng tin hu nghim v xk p ( xk / yl ) = 1 khi vic truyn tin khng
b nhiu. Chn cu sai trong nhng cu v I ( xk / yl ) di y:
a
b
c
d
I ( xk
I ( xk
I ( xk
I ( xk
/ yl ) =0 khi knh khng c nhiu

/ yl ) l lng tin b mt i do nhiu
/ yl ) l lng tin c iu kin
/ yl ) =1/2 khi knh khng c nhiu
15/ I ( xk / yl ) l thng tin hu nghim v xk p ( xk / yl ) = 1 khi vic truyn tin khng b nhiu Chn cu
sai trong nhng cu v I ( xk / yl ) di y:
a
I ( xk / yl ) l lng tin b tn hao do nhiu
b
I ( xk / yl ) = 0 khi knh khng c nhiu
c
I ( xk / yl ) >1/2 khi knh khng c nhiu
d
I ( xk / yl ) l lng thng tin v xk khi bit yl
16/ I ( xk / yl ) l lng thng tin ring ca xk khi bit yl v I ( xk / yl ) = 0 khi khng c nhiu Cu
ny ng hay sai ?
a ng
b Sai
17/ Chn cu sai trong nhng cu sau:
a
Lng tin cn li ca xk sau khi nhn c yl k hiu l I ( xk / yl )
b
I ( xk , yl ) l lng tin ring ca xk v yl
c
Lng tin I ( xk ) l lng tin ban u ca xk
d Lng tin I ( xk ) l lng tin ban u ca xk , Lng tin cn li ca xk sau khi nhn c
yl k hiu l I ( xk / yl )
18/ Cho tin xi c xc sut l P ( xi ) = 0,5 , lng tin ring I ( xi ) ca tin ny bng cc i lng no
di y :
a 4 bt
b 1 bt
c 1/4 bt
d 2 bt
19/ Cho tin xi c xc sut l P( xi ) = 1/ 4 , lng tin ring I ( xi ) ca tin ny bng cc i lng no
di y :
a
2 bt
b 4 bt
c 3 bt
d 1/2 bt
e 1/4 bt
20/ Cho tin xi c xc sut l P ( xi ) = 1/ 8 , lng tin ring I ( xi ) ca tin ny bng cc i lng no
di y :
a 5 bt
b 3 bt
c 4 bt
d 1/4 bt
21/ Cho tin xi c xc sut l P ( xi ) = 1/16 , lng tin ring I ( xi ) ca tin ny bng cc i lng no
di y:
a 1/4 bt
b 2 bt
c 3 bt
d 4 bt
di y:
a 2log7 bt
b Log1/9 bt;
c Log27 bt;
d Log1/27 bt;
di y :
a Log9 bt
b Log1/3 bt
c 2log3 bt
d Log1/9 bt
di y :
a Log2/5 bt
b 2log5 bt
c
Log1/25 bt
d - Log25 bt
25/ Tm cu sai trong nhng cu di y
a
bt ng ca tin xi trong ngun tin X N c tnh bng entropy ca lp tin xi trong ngun
tin X N
b bt nh ca tin v lng tin v ngha tri ngc nhau nhng v gi tr li bng nhau
c
bt nh ca tin v lng tin c ngha nh nhau nhng gi tr khc nhau
d Lng tin trung bnh c hiu l lng tin trung bnh trong mt tin bt k ca ngun tin
cho
26/ Lng thng tin ring ( bt nh) ca mt bin ngu nhin xk l I ( xk )
Chn biu thc sai trong cc biu thc di y
a I ( xk ) = ln p ( xk ) n v o l bit;
b
c
d
I ( xk ) = lg p ( xk ) n v o l hart;
I ( xk ) = ln p ( xk ) n v o l nat;
I ( xk ) = log 2 p ( xk ) n v o l bt
27/ Lng thng tin ring ( bt nh) ca mt bin ngu nhin xk l I ( xk ) c tnh bng biu thc
no di y :
a I ( xk ) = k ln p ( xk ) ;
b
c
d
I ( xk ) = ln p ( xk ) n v o l bit;
I ( xk ) = log 2 p ( xk ) n v o l nat;
I ( xk ) = lg p ( xk ) n v o l hart;
28/ Lng thng tin ring ( bt nh) ca mt bin ngu nhin xk l I ( xk ) c tnh nh sau
I ( xk ) = k ln p ( xk ) , trong k l h s t l Tm cu sai v cch chn k trong cc cu di y :

a
Chn k = 1 ta c I ( xk ) = ln p ( xk )
b
c
d
Chn k =-1 ta c I ( xk ) = ln p ( xk ) ;
1
ta c I ( xk ) = lg p ( xk ) ;
ln10
1
Chn k =
ta c I ( xk ) = log 2 p ( xk )
ln 2
Chn k =
29/ Entropy ca ngun tin ri rc A l trung bnh thng k ca lng thng tin ring ca cc tin thuc
A K hiu:
H1 ( A ) ;
H1 ( A ) = M I ( a i )
vi
a2
...
as
a1
A=
p ( a1 ) p ( a 2 ) ... p ( a s )
0 p (ai ) 1 ;
p ( a ) = 1 ; H ( A ) c tnh bng biu thc no di y:

i =1
H1 ( A ) = p ( a i ) log p ( a i )
(bt) ;
H1 ( A ) = p ( a i ) log p ( a i )
(bt) ;
H1 ( A ) = p ( a i ) log p ( a i )
(bt) ;
i =1
s 1
i =1
s
i =0
H1 ( A ) = p ( a i ) log p ( a i ) (bt) ;
i =1
A
a2
...
as
a1
p ( a1 ) p ( a 2 ) ... p ( a s )
K hiu: H1 ( A ) ; H1 ( A ) = M I ( a i )
0 p (ai ) 1 ;
a
p(a ) = 1
i =1
s
vi A =
H1 ( A ) c tnh bng biu thc no :
H1 ( A ) = p ( a i ) log p ( a i )
(bt) ;
H1 ( A ) = p ( a i ) log p ( a i )
(bt)
1
p (ai )
(bt)
i =1
s
i =0
s
H1 ( A ) = p ( a i ) log
i =1
s +1
H1 ( A ) = p ( a i ) log p ( a i )
(bt) ;
i =1
A
10
K hiu: H1 ( A ) ; H1 ( A ) = M I ( a i ) vi
0 p (ai ) 1 ;
s 1
p(a ) = 1
i
i =0
a1
...
a s1
a0
A=
p ( a 0 ) p ( a1 ) ... p ( a s1 )
H1 ( A ) c tnh nh sau:
H1 ( A ) = p ( a i ) log p ( a i ) (bt)
i =0
s 1
H1 ( A ) = p ( a i ) log p ( a i ) (bt)
i =1
s
H1 ( A ) = p ( a i ) log p ( a i ) (bt) ;
i =1
s 1
H1 ( A ) = p ( a i ) log p ( a i ) (bt);
i =0
32/ A v B l hai trng bin c bt k, Entropy ca 2 trng bin c ng thi C=AB l H(AB)
Trong cc tnh cht ca H(AB) di y, tnh cht no sai:
a
H ( AB ) = H ( A ) + H ( B A ) ;
b
H ( AB ) = H ( B ) + H ( A B ) ;
s
H1 ( A ) = p ( a i ) log p ( a i ) (bt) ;
i =1
s 1
H1 ( A ) = p ( a i ) log p ( a i ) (bt);
i =0
33/ Entropy c iu kin v 1 trng tin A khi r trng tin B l H(A/B)

Trong cc tnh cht ca H(A/B) di y, tnh cht no sai
a
H ( A B) H ( B / A ) ;
b
c
d
0 H ( A B) ;
H ( A ) H ( A B)
H ( A B) H ( A ) ;
34/ Entropy c iu kin v 1 trng tin B khi r trng tin A l H ( B / A ) , Tnh cht no ca
H ( B/ A ) di y l ng
a
0 H(B / A) ;
b
0 H(B / A) ;
c
H ( A B) H ( B / A ) ;
d
H(B / A) H(A) ;
35/ Entropy ca trng bin c ng thi H(AB) c tnh bng cng thc no sau y
a
H(A) + H(A/B);
b H(A) + H(B)
c
H(A) + H(B) - H(A/B) - H(B/A);
d H(B) + H(A/B);
11
36/ Lng thng tin cho trung bnh (k hiu l I(A,B) c cc tnh cht no sau y
a
I ( A,B ) = H ( A ) khi knh c nhiu;
b
c
d
0 I ( A,B ) H ( A ) ;
H ( A ) I ( A,B ) 0 ;
I ( A,B ) = H ( A )
khi knh c nhiu;
37/ Lng thng tin cho trung bnh (k hiu l I(A,B) Trong cc tnh cht di y, tnh cht no
sai:
a
I ( A,B ) H ( A ) ;
b
c
d
I ( A,B ) = H ( A )
0 I ( A,B ) ;
I ( A,B ) = H ( A )
khi knh c nhiu;

khi knh khng c nhiu;
38/ Lng thng tin cho trung bnh (k hiu l I(A,B) c cc tnh cht no sau y
a
I ( A, B ) = 1
khi knh b t;
b
c
d
0 I ( A,B ) v I ( A,B ) = 0 khi knh b t;

0 I ( A,B )
I ( A,B ) = H ( A )
khi knh c nhiu;
39/ Lng thng tin cho trung bnh (k hiu l I(A,B) ), trong cc tnh cht di y ca I(A,B), tnh
cht no sai
a
I ( A,B ) = H ( A )
khi knh khng c nhiu;
b
c
d
I ( A,B ) = 0
H ( A ) I ( A,B ) ;
I ( A, B ) 1
khi knh b t;
khi knh b t;
40/ Lng thng tin cho trung bnh (k hiu l I(A,B)) , tm biu thc sai trong cc biu thc di
y
a
I(A,B) = H(A) - H(A/B);
s
I(A,B) =
p ( a i b j ) log
i =1 j=1
c
d
p (ai b j )
p (ai )
I(A,B) = H(A) - H(B/A);

I(A,B) = H(B) - H(B/A) ;
41/ Mnh no sau y sai

a
H(A/B) H(A) ;
b H(A,B) H(A) + H(B)
c
I(A,B) = H(A) + H(B) + H(AB);
d I(A,B) = H(A) + H(B) - H(AB);
42/ Chn ngu nhin mt trong cc s t 0 n 7 c xc sut nh nhau bt nh ca s c
chn ngu nhin l
a
1/8 bt;
12
b
c
d
-3 bt;
3 bt;
8 bt;
43/ Mt thit b v tuyn in gm 16 khi c tin cy nh nhau v c mc ni tip Gi s c

mt khi no b hng, bt nh ca khi hng l:
a 1/16 bt;
b 16 bt;
c 1/4 bt;
d 4 bt;
44/ B t l kh 52 qun (khng k fng teo), A rt ra mt qun bi bt k bt nh v qun bi
m A rt l:
a
Nh hn 5 bt;
b Ln hn 5 nh hn 6 bt;
c
Bng 6 bt
d Ln hn 6 bt ;
45/ Mt hp c 8 ng tin kim loi , trong c 02 ng tin 500 ng; 02 ng tin 1000 ng, 2
ng tin 2000 v 2 ng tin 5000 ng Chn ngu nhin 1 trong 8 ng tin Khi xc sut ca
ng tin c chn ngu nhin l:
a
8 bt ;
b -1/2 bt;
c
1/8 bt;
d 1/4 bt ;
46/ Mt hp c 8 ng tin kim loi , trong c 02 ng tin 500; 02 ng tin 1000, 2 ng tin
2000 v 2 ng tin 5000 Chn ngu nhin 1 trong 8 ng tin Khi bt nh ca ng tin
c chn ngu nhin l:
a
1/4 bt;
b 8 bt ;
c
-1/2 bt;
d 2 bt;
47/ Cho ngun tin X = {x1, x2, x3} vi cc xc sut ln lt l {1/2, 1/4, 1/4}, Entropy ca ngun tin
H(X) c tnh l:
a
b
1
2
1
2
log2 +
log2 +
2
2
1
4
1
4
log2 +
log2 +
log4 +
log4 +
1
1
log4 +
log4 +
log8
log4
1
4
1
4
log4
log4
48/ Cho ngun tin X = {x1, x2, x3, x4, x5, x6, x7, x8, x9} vi cc xc sut ln lt l {1/4, 1/8, 1/8,
1/8, 1/16, 1/16, 1/8, 1/16, 1/16}. Trong cc kt qu tnh Entropy di y, kt qu no sai:
1
2
4
4
log4 + 4
log4 +
3
2
log4 + 4
log4 +
log8 + 4
1
8
log16
log2 + log2
log8 + 4
1
16
log16
log2 + log2
13
49/ Entropy H1 ( A ) ca ngun ri rc
a2
...
as
a1
A=
vi 0 p ( a i ) 1 ;
p ( a1 ) p ( a 2 ) ... p ( a s )
p(a ) = 1
i
i =1
Trong cc tnh cht ca H(A) di y tnh cht no l sai

a
Khi p ( a k ) = 1 , p ( a i ) = 0 vi i k th H1 ( A ) = H1 ( A ) min = 1
b
Ngun tin ri rc A c s du ng xc sut cho entropy cc i H1 ( A )max = logs

Khi p ( a k ) = 1 , p ( a i ) = 0 vi i k th H1 ( A ) = H1 ( A )min = 0
c
d
Entropy ca ngun ri rc A l mt i lng gii ni 0 H1 ( a ) logs
50/ Cho ngun ri rc A

s
a2
...
as
a1
A=
vi 0 p ( a i ) 1 ; p ( a i ) = 1
i =1
p ( a1 ) p ( a 2 ) ... p ( a s )
Gi entropy ca ngun A l H1 ( A ) , trong cc biu thc tnh H1 ( A max ) logs di y, biu
thc no sai:
s
H1 ( A max ) logs = p ( a i ) log

i =1
H1 ( A max ) logs =
1
+ logs
p(a i )
p ( a ) log p(a ) logs ;

i =1
1
p(a i )logs ;
p(a
)
i =1
i =1
i
s
1
logs ;
p(a
)
i =1
i
c
d
51/ Cho ngun ri rc A
a2
...
as
a1
A=
vi 0 p ( a i ) 1 ;
p ( a1 ) p ( a 2 ) ... p ( a s )
p(a ) = 1
i =1
Nu ngun A c s du ng xc sut , khi biu thc no di y l sai

s
1 s
+ p ( a i ) = 0
s
i =1
i =1
p(a i ) =
s
1
s
1 i s ;
s p ( a ) = 0 ;
i =1
i =1
H1 (A) log s 0 H1 (A) log s
52/ Kh nng thng qua ca knh ri rc C l gi tr cc i ca lng thng tin cho trung bnh
truyn qua knh trong mt n v thi gian ly theo mi kh nng c th c ca ngun tin A
C = max I ( A,B ) = v k max I ( A, B ) (bps);

'
'
C' = K .C
14
vi C = max I(A, B)
A
K biu th s du m knh truyn c (c truyn qua knh) trong mt n v thi gian

I(A,B) l lng thng tin truyn qua knh trong mt n v thi gian C c gi l kh nng
thng qua ca knh i vi mi du C c cc tnh cht no di y :
a
b
c
'
C 0, C = 0 khi A v B c lp ; C K log s , C = v k logs khi knh khng nhiu
C = 0 khi v ch khi A v B c nhiu
C' = v k logs khi knh c nhiu
C' = v k logs khi cc knh c lp
53/ I(A,B) l lng thng tin trung bnh c truyn qua knh ri rc c tnh cht : I(A,B) H(A)
V mt s nh ngha :
C' = max I' ( A,B ) = v k max I ( A, B ) ,

A
C' = K .C
vi C = max I(A, B)
A
K biu th s du m knh truyn c trong mt n v thi gian. T cc tnh cht v nh

ngha trn cho bit cc biu thc di y, biu thc no sai
a
b
c
d
K I(A,B) K H(A);
K I(A,B) K H(A);
K maxI(A,B) K maxH(A)
max( K I(A,B)) max( K H(A));
a2
a1
p(a1 ) p(a 2 )
54/ Cho ngun ri rc ch c hai du: A =
Ngun
ri
a1 "0"
a 2 "1"
rc
nh
phn
ngun
trn
tho
vi xc sut p(a1 ) = p
vi xc sut p(a 2 ) =1 p
Khi ngun ri rc nh phn A c th vit biu thc no

a
b
c
d
p 1 p
A=
a1 a 2
p
a
A= 1
a2 1 p
0
1
A=
p 1 p
a2
a
A= 1
p 1 p
a2
a
55/ A = 1
l ngun ri rc nh phn Tho mn iu kin
p 1 p
a1 "0"
a 2 "1"
vi xc sut p(a1 ) = p
vi xc sut p(a 2 ) =1 p
Khi Entropy H1 ( A ) c tnh bng cng thc no sau y

15
mn
iu
kin
sau
p log p (1 p ) log (1 p )
p log p (1 p ) log (1 p ) ;
p (1 p ) log (1 p ) p log ;
p log p (1 p ) log (1 p )
56/ H ( A / b l ) l lng thng tin tn hao trung bnh ca mi tin u pht khi u thu thu c
bj
; H(B / a i )
H ( A / bl ) = p ( a i / b l ) log p ( a i bl )
i =1
l lng thng tin ring trung bnh cha trong mi tin u thu khi u pht pht i mt tin
a i c tnh theo cng thc

t
H(B / a i ) = p(b j / a i )log p(b j / a i )

j =1
Trong trng hp knh b t (b nhiu tuyt i) ta c biu thc no di y l sai :

a
b
c
d
H ( A b j ) = H ( A ) + H(B)
H ( B a i ) = H ( B) ;
H ( B A ) = H ( B)
H ( A b j ) = H ( A ) = H ( A B)
bj
s
H ( A / bl ) = p ( a i / b l ) log p ( a i bl )
; H(B / a i ) l lng thng tin ring trung bnh cha
i =1
trong mi tin u thu khi u pht pht i mt tin c tnh theo cng thc:
t

j =1
Trong trng hp knh khng nhiu biu thc no di y l ng :

a
H ( A b k ) = H(A / A) = 0 ;
b
c
d
H ( A b k ) = H(B / A) = 0
H ( A b k ) = H(B / B) = 0 ;
H ( A b k ) = H(A / B) = 0 ;
s
bj . H ( A / bl ) = p ( a i / b l ) log p ( a i bl ) ; H(B / a i ) l lng thng tin ring trung bnh cha

i =1
trong mi tin u thu khi u pht pht i mt tin ai c tnh theo cng thc sau:
t

j =1
Trong trng hp b nhiu tuyt i, A v B l c lp nhau suy ra :

16
p(a i / b j ) = p(a i ) p(b j / a i ) = p(b j ) p(a i b j ) = p(a i ) p(b j )

;
, khi ta c biu thc no sau
y l ng:
a
i =1
j=1
H ( A / b j ) = p ( a i ) log p ( a i ) v H ( B/ a i ) = p ( b j ) log p ( b j )
t
H ( B / a i ) = p ( b j ) log p ( a j )
j=1
i =1
j=1
H ( A / b j ) = p ( a i ) log p ( bi ) v H ( B/ a i ) = p ( b j ) log p ( a j )
s
H ( A / b j ) = p ( a i ) log p ( bi )
i =1
59/ Entropy c iu kin v 1 trng tin A khi r trng tin B l H ( A B ) , c xc nh theo
cng thc sau:

s
H ( A B ) = p ( a i b j ) log p ( a i b j )
i =1 j=1
Trong trng hp b nhiu tuyt i, A v B l c lp nhau, suy ra :

;
, khi biu thc no sau y l
ng:
s
i =1 j=1
H ( A B ) = p ( b j ) p ( a i ) log p ( a i )
j=1
i =1
H ( A B ) = p ( a i / b j ) log p ( a i b j )
i =1 j=1
j=1
i =1
H ( A B ) = p ( b j ) p ( a i ) log p ( a i )
60/ Entropy c iu kin v 1 trng tin B khi r trng tin A l H ( B A ) , c xc nh theo
cng thc sau: H ( B/ A ) =
p ( b a ) log p ( b
i =1 j=1
j i
ai )
;
Khi biu thc no sau y l ng
a
b
i =1
j=1
j=1
i =1
H ( B / A ) = p ( a i ) p ( b j ) log p ( b j ) ;
H ( B/ A ) = p ( b j ) p ( a i ) log p ( a i ) ;
17
H ( B/ A ) = p ( a i b j ) log p ( a i b j ) ;
i =1 j=1
s
H ( B / A ) = p ( a i / b j ) log p ( a i b j )
i =1 j=1
cng thc sau: H ( A B ) =
p ( a b ) log p ( a
i =1 j=1
bj )

;
ng:
a
j=1
i =1
H ( A B ) = p ( b j ) p ( a i ) log p ( a i ) = H(A)
s
i =1 j=1
H ( A B ) = p ( a i b j ) log p ( a i b j ) = H(A)
H ( A B ) = p ( a i / b j ) log p ( a i b j ) = H(A)
i =1 j=1
j=1
i =1
H ( A B ) = p ( b j ) p ( a i ) log p ( a i ) = H(A)
62/ Entropy c iu kin v 1 trng tin B khi r trng tin A l H ( B A ) , c xc nh theo
cng thc sau:

s
H ( B / A ) = p ( b ja i ) log p ( b j a i )
i =1 j=1

;
ng:
s
H ( B / A ) = p ( a i / b j ) log p ( a i b j ) = H(B)
i =1 j=1
b
c
j=1
i =1
i =1
j=1
H ( B / A ) = p ( b j ) p ( a i ) log p ( a i ) = H(B)
H ( B / A ) = p ( a i ) p ( b j ) log p ( b j ) = H(B)
s
H ( B / A ) = p ( a i b j ) log p ( a i b j ) = H(B)
i =1 j=1
cng thc sau:

18
H ( A B ) = p ( a i b j ) log p ( a i b j ) vi p(a i / b j ) =
i =1 j=1
T cng thc ny c th khai trin H ( A B ) thnh cng thc no sau y:

s
p ( a b ) log p ( b
i
i =1 j=1
s
p(a i b j )
p(b j )
aj)
p ( a / b ) log p ( a ,b )
i
i =1 j=1
p(b j ) p ( a i / b j ) log p ( a i b j ) ;
j=1
i=1
p ( a i / b j ) log p ( a i b j ) ;
i =1 j=1
64/ Lng thng tin cho trung bnh (k hiu l I(A,B)) :
I(A, B) = M I(a i , b j )
I ( a i , b j ) = log
vi
p (ai b j )
p (ai )
Xc sut c thng tin
p(a i b j )
Do c th vit I(A,B)) bng cng thc no sau y:
s
p ( a i b j ) log
i =1 j=1
s
p ( a b ) log p ( a )
s
p ( a i / b j ) log
s
i =1 j=1
p (ai )
p (ai b j )
i =1 j=1
p ( aib j )
p (ai b j )
p (ai )
p (ai b j )
p ( a b ) log p ( a b )
i
i =1 j=1
65/ Lng thng tin cho trung bnh (k hiu l I(A,B)) c vit thnh :
s
I ( A,B ) = p ( a i b j ) log
i =1 j=1
I(A,B)=
p (ai )
p ( a b ) log p ( a
i =1 j=1
a
b
p (ai b j )
Khi c th khai trin I(A,B) thnh
b j ) log p ( a i )
Sai
ng
19
I(a i , b j )
I ( A,B ) = p ( a i b j ) log
p (ai b j )
I(A,B)=
p ( a i b j ) log p ( a i b j ) p ( a i b j ) logp ( a i )
i =1 j=1
a
b
p (ai )
i =1 j=1
i =1 j=1
ng
Sai
s
I ( A,B ) = p ( a i b j ) log
p (ai b j )
i =1 j=1
I(A,B)=
p ( a b ) log p ( a
i
i =1 j=1
a
b
p (ai )
b j ) p ( bi )
Sai
ng
s
I ( A,B ) = p ( a i b j ) log
p (ai b j )
Trong cc biu thc khai trin I(A,B) di y, biu thc
p (ai )
i =1 j=1
no sai
a
I(A,B) =
p ( a b ) log p ( a ) log p ( a
i
i =1 j=1
I(A,B) =
p ( a b ) log p ( a
s
I(A,B) =
i =1 j=1
p ( a i b j ) log p ( a i b j ) p ( a i b j ) logp ( a i ) ;
s
I(A,B) =
b j ) ;
b j ) + log p ( bi ) ;
i =1 j=1
i =1 j=1
p ( a b ) log p ( a
i
i =1 j=1
b j ) log p ( a i ) ;
s
I ( A,B ) = p ( a i b j ) log
i =1 j=1
p (ai b j )
p (ai )
Entropy c iu kin v 1 trng tin A khi r trng tin B l H ( A B ) , c xc nh theo cng

thc sau:
s
i =1 j=1
Khi trong cc kt qu tnh I(A,B), kt qu no sai

a
I(A,B) = H(A) - H(A/B) ;
b I(A,B) = H(A)+ H(A/B) ;
c
I(A,B) = H(A) + H(B) - H(AB);
d I(A,B) = H(B) - H(B/A);
20
b j
ai
i = 1,s ;B =
j = 1, t
p
a
p
b
(
)
(
)
i
j
Khi , trng s kin ng thi C = A.B Nu A v B l c lp th C c th vit thnh biu thc

70/ Xt 2 trng s kin A v B sau : A =
no di y:
a
a i / b j
C=
;
p
a
/
p
b
(
)
(
)
i
j
a i + b j
C=
p ( a i ) + p ( b j )
b j
a
C= i
;
p(a i ) p(b j )
a i b j
C=
;
p ( a i ) p ( b j )
b j
ai
i
1,s
;B
=
=
j = 1, t
p
a
p
b
(
)
(
)
i
j
71/ Xt 2 trng s kin A v B sau : A =
Trng s kin ng thi C = A.B c entropy H(C) c tnh bng cng thc no di y:
s
H ( C ) = p ( a i b j ) log p ( a i b j )
i =1 j=1
s
H ( C ) = p ( a i b j ) log p ( a i b j )
i =0 j=0
s 1 t 1
H ( C ) = p ( a i b j ) log p ( a i b j ) ;
i =1 j=1
s
H ( C ) = p ( a i b j ) log p ( a i b j ) ;
i =1 j=1
72/ Chn cu sai :

a
Xc sut xut hin cng ln, lng tin thu c cng ln
b Mt tin x c xc sut xut hin l p(x), nu p(x) cng nh th lng tin khi nhn c tin ny
cng s cng ln
c
Nu p(x) cng ln th 1/p(x) cng nh
d Mt tin x c xc sut xut hin l p(x), nu p(x) cng ln th lng tin khi nhn c tin ny
cng s cng nh
73/ Chn cu sai sau :
a
Xc sut xut p(x) cng ln th lng tin khi nhn c tin ny cng s cng ln
b Xc sut xut hin ca mt tin t l nghch vi bt ng khi nhn c mt tin
c
Xc sut xut p(x) cng ln th lng tin khi nhn c tin ny cng s cng nh
d Lng tin ca mt tin t l thun vi s kh nng ca mt tin v t l nghch vi xc sut
xut hin ca tin
21
74/ Lng tin c iu kin hu nghim v x K ( thng tin ring v x K sau khi c y ) c nh ngha
l I ( xk / yl ) = log p( xk / yl )
Chn cu sai trong cc cu sau :
a
Xc sut P( xk / yl ) = 1 ch xy ra khi knh truyn khng c nhiu
b Khi P ( xk / yl ) 1 th I ( xk / yl ) 1 v ngc li
c
Xc sut P( xk / yl ) = 1/ 2 I ( xk / yl ) = 1 bt ,
d Khi P ( xk / yl ) 1 th I ( xk / yl ) 0 v ngc li
p( xk / yl )
75/ Lng thng tin v x K khi r tin y l I ( xk , yl ) = log
p( xk )
Chn cu sai sau :
a
b
c
d
p ( xk / yl ) = 1 tc l l lng tin ca x K c truyn nguyn vn

1
Nu p( xk / yl ) = 0 suy ra I ( xk , yl ) = log
p( xk )
1
Nu p ( xk / yl ) = 1 suy ra I ( xk , yl ) = log
p( xk )
Nu p ( xk / yl ) = 1 , c ngha l khi y nhn c tin th chc chn x K pht
76/ Lng thng tin hu nghim v x K ( thng tin ring v x K sau khi c y ) c vit l :
1
1
I ( xk / yl ) = log
.
Lng thng tin ring v x K l I ( xk ) = log
p( xk / yl )
p( xk )
1
1
Lng thng tin cho v x K do y mang li l : I ( xk , yl ) = log
log
p( xk )
p( xk / yl )
Tm cu sai sau :
a
Lng thng tin ring bng tng lng thng tin cho v lng thng tin hu nghim
b Lng thng tin ring c th m
c
Tng lng thng tin cho v lng thng tin hu nghim bng lng thng tin ring
d Lng thng tin ring lun dng
77/ Cho 2 ngun tin A v B c cc xc sut tng ng l :
a2 a3 a4
b2
b3
b4
a
b1
A= 1
B
=
;
0,5 0,25 0,125 0,125

1/ 2 1/ 4 1/8 1/8
Entropy ca ngun A ( k hiu l H(A)), entropy ca ngun B ( k hiu l H(B)) c quan h theo cc
h thc no di y
a
H(A)=H(B);
b H(A) > H(B);
c
H(B)>H(A);
d H(A)=2H(B)
78/ Cho ngun tin A c cc xc sut tng ng l :
a2 a3 a4
a
A= 1
1/ 2 1/ 4 1/8 1/8 ; Khi Entropy ca ngun A ( k hiu l H(A)) bng cc i lng

no di y
a
H(A) = 1,85 bt;
b H(A) = 1,75 bt ;
22
c
d
H(A) = 1,7 bt;

H(A) = 1,65 bt ;
a2
a3
a4
a
A= 1
0.45 0.2 0.15 0.1
a5
;
0.1
Khi Entropy ca ngun A ( k hiu l H(A)) gn bng cc i lng no di y

a
H(A) = 2,75 bt;
b H(A) = 2,06 bt;
c
H(A) = 2,7 bt;
d H(A) = 2,85 bt;
a2
a3
a4
a
A= 1
0.4 0.25 0.15 0.1
a5
;
0.1

a
H(A) = 2,85 bt;
b H(A) = 2,7 bt;
c
H(A) = 2,75 bt;
d H(A) = 2,1 bt;
a2
a3
a4
a
A= 1
0.4 0.25 0.15 0.15
a5
;
0.05

a
H(A) = 2,85 bt;
b H(A) = 2,7 bt;
c
H(A) = 2,06 bt;
d
H(A) = 2,07 bt;
a2
a3 a 4
a
A= 1
0.4 0.25 0.2 0.1
a5
;
0.05

a
H(A) = 2,06 bt;
b H(A) = 2,85 bt;
c
H(A) = 2,04 bt;
d H(A) = 2,07 bt;
a2
a3
a4
a
A= 1
0.4 0.3 0.15 0.1
a5
;
0.05

a
H(A) = 2,04 bt;
b H(A) = 2,07 bt;
c
H(A) = 2,06 bt;
d H(A) = 2,01 bt;
23
84/ Gi s ngun tin A c cc xc sut tng ng l :
a2 a3
a4
a
A= 1
0.4 0.3 0.2 0.05
a5
;
0.05

a
H(A) = 1,95 bt;
b H(A) = 2,07 bt;
c
H(A) = 2,01 bt;
d H(A) = 2,04 bt;
a2
a3
a4
a
A= 1
0.35 0.35 0.2 0.05
a5
;
0.05
Khi Entropy ca ngun A (k hiu l H(A)) gn bng cc i lng no di y

a
H(A) = 2,04 bt;
b H(A) = 2,01 bt;
c
H(A) = 2,07 bt;
d H(A) = 1,96 bt;
a2
a3
a4
a
A= 1
0.35 0.3 0.25 0.05
a5
;
0.05

a
H(A) = 2,01 bt;
b H(A) = 1,9 bt;
c
H(A) = 1,98 bt;
d H(A) = 2,04 bt;
a2 a3 a4
a
A= 1
0.35 0.3 0.2 0.1
a5
;
0.05

a
H(A) = 2,06 bt;
b H(A) = 1,98 bt;
c
H(A) = 2,01 bt;
d H(A) = 1,9 bt;
a2 a3 a4
a
A= 1
0.3 0.3 0.2 0.1
a5
;
0.1

a
H(A) = 1,9 bt;
b H(A) = 2,06 bt;
c
H(A) = 2,17 bt;
d H(A) = 1,98 bt;
89/ Gi s ngun tin A v B c cc xc sut tng ng l :
24
a2
a3
a4
a5 a6
a7
a8
a
A= 1
;
1/ 4 1/ 8 1/16 1/16 1/ 4 1/ 8 1/16 1/16
b2
b3
b4
b5
b6
b7
b8
b
B= 1
0, 25 0,125 0, 0625 0, 0625 0, 25 0,125 0, 0625 0, 0625

Entropy ca ngun A ( k hiu l H(A)), entropy ca ngun B ( k hiu l H(B)) c quan h theo cc
h thc no di y
a
H(A) = 2H(B)
b H(A)=H(B) ;
c
H(B)>H(A);
d H(A) > H(B);
a2
a3
a4
a5 a6
a7
a8
a
A= 1
;
1/ 4 1/8 1/16 1/16 1/ 4 1/8 1/16 1/16
Khi Entropy ca ngun A ( k hiu l H(A)) bng cc i lng no di y
a
H(A) = 2,7 bt;
b H(A) = 2,75 bt;
c
H(A) = 2,85 bt;
d H(A) = 2,80 bt;
91/ Gi s ngun tin B c cc xc sut tng ng l :
b2
b3
b4
b5
b6
b7
b8
b
B= 1
0, 25 0,125 0,0625 0,0625 0, 25 0,125 0,0625 0,0625 ;

Khi Entropy ca ngun B ( k hiu l H(B)) bng cc i lng no di y
a
H(B) = 2,80 bt;
b H(B) = 2,7 bt;
c
H(B) = 2,75 bt;
d H(B) = 2,85 bt;
92/ Cho mt knh nh phn nh hnh bn:
p(b1/a1) = pd
a1
b1
p(b1/a2)
= ps
a2
b2
p(b2/a2) = pd
Trong :
Phn b xc sut ca tin u ra p( b1 )c tnh theo cng thc sau :
2
p(b1 ) = p(ai ) p(b1 / ai )

i =1
T cng thc ny, c th khai trin p( b1 ) thnh cng thc no di y:

a
b
c
p ( b1 ) = p ( a1 ) .p ( b1 a1 ) + p ( a1 ) .p ( b1 a 2 ) ;
p ( b1 ) = p ( a 2 ) .p ( b1 a1 ) + p ( a 2 ) .p ( b1 a 2 ) ;
p ( b1 ) = p ( a1 ) .p ( b1 a1 ) + p ( a 2 ) .p ( b1 a 2 ) ;
25
p ( b1 ) = p ( a 2 ) .p ( b1 a1 ) p ( a 2 ) .p ( b1 a 2 ) ;
93/ Cho mt knh nh phn nh hnh bn:

p(b1/a1) = pd
a1
b1
p(b1/a2)
= ps
a2
b2
p(b2/a2) = pd
Trong :
Phn b xc sut ca tin u ra p( b2 )c tnh theo cng thc sau :
2
p(b2 ) = p(ai ) p(b2 / ai )

i =1
T cng thc ny, c th khai trin p( b1 )thnh cng thc no di y:

a
b
c
d
p ( b 2 ) = p ( a 2 ) .p ( b1 a1 ) p ( a 2 ) .p ( b1 a 2 )
p ( b 2 ) = p ( a1 ) .p ( b 2 a1 ) + p ( a 2 ) .p ( b 2 a 2 )
p ( b 2 ) = p ( a 2 ) .p ( b 2 a1 ) + p ( a 2 ) .p ( b 2 a 2 )
p ( b 2 ) = p ( a 2 ) .p ( b1 a1 ) + p ( a 2 ) .p ( b1 a 2 )
94/ Cho knh i xng nh phn nh hnh bn:

p(b1/a1) = pd
a1
b1
p(b1/a2)
= ps
a2
b2
p(b2/a2) = pd
Bit :
p ( a1 ) = p
p ( a2 ) = 1 p
p ( b1 a2 ) = p ( b2 a1 ) = ps = 1 pd
p(b1/a1) = p(b2/a2) = pd
2
H ( B A ) = p ( a i ) p ( b j a i ) log p ( b j a i )
i =1 j=1
Khai trin H(B/A) theo pd

a
b
c
d
v ps s c kt qu no di y
H ( B A ) = p d log ps + (1 pd ) log (1 ps )
H ( B A ) = ps log ps + (1 ps ) log (1 ps ) ;
H ( B A ) = pd log ps + (1 p d ) log (1 ps )
H ( B A ) = ps log ps + (1 ps ) log (1 ps ) ;
26
95/ Cho knh i xng nh phn nh hnh bn:

p(b1/a1) = pd
a1
b1
p(b1/a2)
= ps
a2
b2
p(b2/a2) = pd
Bit
p ( a1 ) = p
p ( a2 ) = 1 p
p ( b1 a2 ) = p ( b2 a1 ) = ps = 1 pd
p(b1/a1) = p(b2/a2) = pd
H ( B A ) = ps log ps + (1 ps ) log (1 ps )
T truyn tn hiu cho knh vk = 1 T v C' =
1
1
max I ( A, B ) = max H ( B ) H ( B A )
A
T
T A
C'
c tnh theo biu thc no di y
Khi '
Cmax
a
C'
= 1 ps log ps + (1 ps ) log (1 ps )
C'max
C'
= 1 + ps log ps (1 ps ) log (1 ps )
C'max
C'
= 1 + ps log ps + (1 ps ) log (1 ps )
C'max
C'
= 1 + p d log pd + (1 p d ) log (1 pd )
C'max
27
CHNG 4: C S L THUYT M
1/ Chn cu ng v m ha
a
M ha l php bin i mi dng tn hiu thnh tn hiu lin tc
b M ha l nh x che du thng tin
c
d
M ha l mt nh x 1- 1 t tp cc tin ri rc a i ln tp cc t m i i ; f : a i i i
M ha l php bin i dng s nh phn thnh dng tn hiu ban u
2/ Chn cu ng v m :
a
M l mt tp cc t m c lp nn mt cch ngu nhin
b M l qu trnh phc hi tin tc
c
M l nh x che du thng tin
d M (hay b m) l sn phm ca php m ha
3/ Chn cu ng v m :
a
M l qu trnh phc hi tin tc
b M l mt tp cc t m c lp nn theo mt lut nh
c
M (hay b m) l sn phm ca php bin i tn hiu ri rc
d M (hay b m) l sn phm ca php bin i tn hiu lin tc
4/ di t m n i l s cc du m cn thit dng m ha cho tin a i Chn cu ng v di t
m
a
di t m n i l mt s phc
Nu n i = const vi mi i th mi t m u c cng di B m tng ng c gi l b

m u
di t m n i cng ln th php m ha cng ti u
di t m n i l mt s nguyn c th m hoc dng
5/ di t m n i l s cc du m cn thit dng m ha cho tin a i

Chn cu sai v di t m
a
Nu n i = const vi mi i , khi b m tng ng c gi l b m u
c
di t m n i l mt s nguyn lun ln hn hoc bng 1

Nu n i = const i c ngha l tt c cc t m u c cng di
di t m n i l mt s nguyn c th m
6/ di t m n i l s cc du m cn thit dng m ha cho tin a i

Chn cu ng v di t m
a
Nu n i n j th b m tng ng c gi l b m khng u
b
di t m n i cng ln th php m ha cng ti u
Nu n i = 1 th b m tng ng c gi l b m khng u
Nu n i = const i , c ngha l php m ha l ti u
7/ S cc du m khc nhau (v gi tr) c s dng trong b m c gi l c s m Ta k hiu

gi tr ny l m Chn cu sai v
cc du m m:
a
Nu m = 2 th b m tng ng c gi l m nh phn
28
b
c
d
Nu m = 3 th b m tng ng c gi l m tam phn

Nu m = 0 th b m tng ng c gi l m u
Nu m = p th b m tng ng c gi l m p phn
7
8/ Gi s c t m i = 0 1 1 0 1 0 1 Chn cu ng nht v t m i
7
T m i c di bng 4
T m i trong b m nh phn c m=2 ( tc l c 2 du m l 0 v 1) v c di l 7
T m i c 7 du m
T m i c 3 du m
7
7
9/ Gi s c t m i = 0 1 1 0 1 0 1 Chn cu ng v t m i
7
T m i c 7 du m
T m i trong b m nh phn c m=3, tc l c 3 du m l 0
T m i c di bng 7
T m i c di bng 3
7
7
7
10/ Chn cu ng v di t m
a
di trung bnh ca t m n l k vng ca i lng ngu nhin n i c xc nh nh

s
sau :
n = p ( ai ) ni
i =1
di trung bnh ca t m n l k vng ca i lng ngu nhin n i c xc nh nh

s
sau :
n = p ( a i ) n i
i =1
c
d
di t m n i l s cc du m cn thit dng gii m cho tin a i

di t m n i l S cc du m khc nhau (v gi tr) c s dng trong gii m
11/ Ni dung ca nh l m ho th nht ca Shannon (i vi m nh phn) c pht biu nh sau:

Lun lun c th xy dng c mt php m ho cc tin ri rc c hiu qu m di trung bnh
ca t m c th nh tu , nhng khng nh hn entropie xc nh bi cc c tnh thng k ca
ngun . Chn cu ng v di t m :
a
S t m nh nht
b S t m khng i
c
Chiu di trung bnh ca cc t m nh hn hoc bng entropy ca ngun
d Chiu di trung bnh cc t m nh nht trong tt c cc cch m ha
12/ Ni dung ca nh l m ho th nht ca Shannon (i vi m nh phn) c pht biu nh sau:
Lun lun c th xy dng c mt php m ho cc tin ri rc c hiu qu m di trung bnh
ca t m c th nh tu , nhng khng nh hn entropie xc nh bi cc c tnh thng k ca
ngun. Chn cu sai v di t m :
a
Chiu di trung bnh cc t m tho mn h thc n =
p(a ) n
i =1
b
c
H1 ( A )
Chiu di trung bnh cc t m nh nht trong tt c cc cch m ha

Chiu di trung bnh ca cc t m ln hn hoc bng entropy ca ngun
29
Chiu di trung bnh cc t m tho mn h thc n =
p(a ) n
i =0
= H1 ( A )
13/ Khong cch gia hai t m bt k i v j l s cc du m khc nhau tnh theo cng mt v
) Gi s i7 = 0 1 1 0 1 0 1 ; 7j = 1 0 0 1 1 1 0
n
n
Khong cch gia 2 t m i v j l d ( , ) bng cc i lng no di y
n
tr gia hai t m ny, k hiu d i , j
7
i
a
b
c
d
7
j
1;
6;
12;
14;
n
tr gia hai t m ny, k hiu d i , j . Tm biu thc sai v khong cch m d trong cc biu
thc sau:
n d in , nj ;
d in , nj 0
n
n
i , j
(
d (
d (
n
n
i , j
)
) d (
) = d (
)
)
n
n
j , i ;
n
n
j , i
tr gia hai t m ny, k hiu d i , j

thc sau:
a
b
c
d
(
) (
d ( , ) 0 ;
d ( , ) 0
n d ( , )
) Tm biu thc sai v khong cch m d trong cc biu
) (
d in , nj + d nj , nk d in , nk ;
n
i
n
j
n
i
n
j
n
i
n
j
tr gia hai t m ny, k hiu d i , j . Chn cu ng sau :

a
b
c
)
d ( , ) + d (
1 d ( , ) ;
0 d in , nj 1 ;
n
i
n
j
n
i
n
n
j , k
) = d (
n
n
i , k
n
j
30
d in , nj 0 ; d in , nj = 0 khi in nj ;
( )
n
17/ Trng s ca mt t m W i
( )
) w ( + )
l s cc du m khc khng trong t m
V d:
( )
i7 = 0 1 1 0 1 0 1 th W i7 = 4 . Chn cu ng v cc tnh cht ca trng s W in :
d in , nj
W in 0
d in , nj W in + nj ;
( )
(
d (
n
n
i , j
n
i
) (
) = W (
n
j
n
n
i +j
)
) v 0 W ( ) 1 ;
n
i
( ) l s cc du m khc khng trong t m Gi s

trng s W ( ) bng s no di y
n
18/ Trng s ca mt t m W i
i7 = 0 1 1 0 1 0 1 , th
7
i
4;
3;
5;
7;
a
b
c
d
19/ Coi mi t m i l mt vct n chiu trong mt khng gian tuyn tnh n chiu Vn , khi php
cng c thc hin gia hai t m tng t nh php cng gia hai vct tng ng c thc hin
trn trng nh phn GF(2) Php cng theo modulo 2 ny c m t nh sau:
Cho i = 0 1 1 0 1 0 1 ( 0, 1, 1, 0, 1, 0, 1)
7
7j = 1 0 0 1 1 1 0 (1, 0, 0, 1, 1, 1, 0 )
7
Khi k = i + j bng gi tr no di y
a
(0 1, 1, 1, 0, 1, 1);
b (1 1, 1, 1, 0, 1, 1);
c
(1 1, 1, 1, 1, 1, 1);
d (1 1, 1, 1, 0, 1, 0);
n
20/ Coi mi t m i l mt vct n chiu trong mt khng gian tuyn tnh n chiu Vn , khi php
cng c thc hin gia hai t m tng t nh php cng gia hai vct tng ng c thc hin
trn trng nh phn GF(2) Php cng theo modulo 2 ny c m t nh sau:
Cho
8i = 1 1 1 0 1 0 1 0 (1, 1, 1, 0, 1, 0, 1, 0 )
8j = 1 0 0 1 1 1 0 1 (1, 0, 0, 1, 1, 1, 0, 1)
31
Khi k = i + j bng gi tr no di y
a
(1 1, 1, 1, 0, 1, 1, 1 );
b (1 1, 1, 1, 0, 1, 0,1);
c
(0 1, 1, 1, 0, 1, 1, 1 );
d (1 1, 1, 1, 0, 1, 1, 1 );
21/ Chn cu ng v m tuyn tnh
a
M tuyn tnh l m m t m ca n c cc du m l phi tuyn
b M tuyn tnh di n l m m t m ca n c cc du m l cc dng tuyn tnh
c
M tuyn tnh l m m t m ca n va c cc du m l phi tuyn va ngu nhin
d M tuyn tnh di n l m m t m ca n c cc du m l cc dng ngu nhin
22/ Chn cu ng v m h thng tuyn tnh :
a
M h thng tuyn tnh (n,k) l m tuyn tnh di n trong ta c th ch ra c v tr ca
k-1 du thng tin trong t m
b M h thng tuyn tnh (n,k) l m tuyn tnh di n trong ta c th ch ra c v tr ca
k du thng tin trong t m
c
M h thng tuyn tnh (n,k) l m tuyn tnh di n trong ta c th ch ra c v tr ca
n-k du thng tin trong t m
d M h thng tuyn tnh (n,k) l m tuyn tnh di n trong ta c th ch ra c v tr ca
r= n - k du thng tin trong t m
23/ Chn cu ng v m tuyn tnh ngu nhin :
a
M tuyn tnh ngu nhin l m tuyn tnh c cc du m c chn ngu nhin t php nh
x trong khng gian phi tuyn
b M tuyn tnh ngu nhin l m tuyn tnh c cc du m c chn ngu nhin t cc dng
tuyn tnh c th c
c
M tuyn tnh ngu nhin l m tuyn tnh c php nh x phi tuyn ngu nhin
d M tuyn tnh ngu nhin l m ngu nhin c cc du m c chn tuyn tnh t cc dng
tuyn tnh c th c
24/ m t m tuyn tnh, c th s dng ma trn sinh G k,n Trong i s tuyn tnh ta bit rng
T
vi mi G k,n s tn ti ma trn H rn tha mn: G.H = 0 Chn cu ng sau :

a H c gi l ma trn kim tra ca m tuyn tnh (n,k) v H cha r vc t hng trc giao vi
cc vc t hng ca G
b
G k,n l ma trn kim tra n hng, r ct
c
d
H c gi l ma trn sinh ca m tuyn tnh (n,k)

G k,n khng nht thit l ma trn sinh
25/ Gi s sau khi thc hin m ha, tin ai c m ha thnh 1001, khi di t m ni ca tin
ny l :
a
4;
b 1;
c
2;
d 5;
26/ Sau khi thc hin m ha ngun ri rc A ( c entropy l H(A)=1,5 ) c th tnh c di
trung bnh n Vi mi cch m ha khc nhau s tnh c n khc nhau Trong cc kt qu m ha,
gi tr n no di y c gi l ti u:
n =1,45;
a
32
n =1,51;
n =1,35;
n =1,81;

gi tr n no di y c gi l ti u nht:
n =1,51;
a
b
n =1,45;
n =1,55;
n =1,75;
28/ Sau khi thc hin m ha ngun ri rc A (c entropy l H(A)=1,9) c th tnh c di trung
bnh n Vi mi cch m ha khc nhau s tnh c n khc nhau Trong cc kt qu m ha, gi tr
n no di y c gi l ti u nht:
n =1,975;
a
n =1,91;
n =1,905;
n =1,95;

gi tr n no di y c gi l ti u nht:
n =1,906;
a
b
n =1,907;
n =1,91;
n =1,95;
30/ Sau khi thc hin m ha ngun ri rc A (c entropy l H(A)=2,01 bt), c th tnh c di
gi tr n no di y c gi l ti u:
n =2,07;
a
b
n =2,11;
n =2,09;
n =202;
31/ Cho m Cyclic C(n, k) = C(7,4) c a thc sinh l g(x) th

a
g(x) c bc 4 ;
b g(x) l mt c ca x 7 + 4 + 1
c
g(x) c bc 5 ;
d T g(x) c th xc nh c ma trn sinh h thng G v ma trn kim tra H cho b m
32/ Cho m Cyclic C(n, k) = C(7,4), c a thc sinh g(x) l
33
a
b
c
d
g ( x) = 1 + x + x 4 ;
g ( x) = 1 + x + x 2 + x 4
g ( x) = 1 + x 2 + x3 ;
g ( x) = 1 + x 2 + x 3 + x 4

a
g ( x) = 1 + x + x 2 + x3 ;
b
g ( x) = 1 + x + x 3 ;
c
g ( x) = 1 + x 2 + x 4
d
g ( x) = 1 + x3 + x 4
34/ Cho m Cyclic C(n, k) = C(7,3) , tm cu sai v g(x)
7
a
g(x) khng l c ca x + 1 ;
b T g(x) c th xc nh c ma trn sinh h thng G v ma trn kim tra H cho b m
c
g(x) c bc 4 ;
7
d g(x) l mt c ca x + 1 ;
g ( x) = 1 + x + x 4
a
c
g ( x) = 1 + x + x 2 + x 4 ;
g ( x) = 1 + x 2 + x 3 + x 5
g ( x) = 1 + x 2 + x3 ;

g ( x) = 1 + x + x 5
a
b
g ( x) = 1 + x 2 + x 3 + x 5
g ( x) = 1 + x + x 4 ;
g ( x) = 1 + x + x 2 + x 4 ;
37/ Pht biu sau ng hay sai : Cho m Cyclic C(n, k) = C(7,3) , g(x) l a thc bc 4
a
Sai
b ng
38/ Cho m tuyn tnh (7,4) S nh cn thit nh b m l
a 7;
b 28;
c 4;
d 112;
39/ Cho m Xyclic (7,4) S cc nh cn thit nh b m l
a 7;
b 112
c 28;
d 8
40/ Cho m tuyn tnh (7,3) S nh cn thit nh b m l
a 7;
34
b
c
d
21;
3;
56;
41/ Cho m Xyclic (7,3) S cc nh cn thit nh b m l

a 3
b 56
c 21;
d 7;
42/ Cho m tuyn tnh (n,k) S nh cn thit nh b m l
k
a n.2
b kn;
c n+k;
d n;
43/ Cho m Xyclic (n,k) S cc nh cn thit nh b m l
a kn;
b n+k;
n.2k
c
d n7;
44/ Chn cu ng sau:
a Cc dng tuyn tnh ca k bin c lp x1, x2 , , xk l cc biu thc c dng:
k
f ( x1, , xk ) = ai xi Trong : ai F , F l mt trng

i =1
Cc dng tuyn tnh ca k bin c lp x1, x2 , , xk l cc biu thc c dng:

k
f ( x1, , xk ) = (ai + xi ) Trong : ai F , F l mt trng

i =1

k
f ( x1, , xk ) = ai - xi Trong : ai F , F l mt trng

i =1

k
f ( x1, , xk ) = ai x i Trong : ai F , F l mt trng

i =1
45/ Chn cu sai v m tuyn tnh :

a
b
c
2k cc vt khc nhau l tt c cc t hp tuyn tnh c th c ca k vct hng ny

G.H = 0 Trong : r = n k
Trong i s tuyn tnh ta bit rng vi mi G s tn ti ma trn H rn tha mn:
Trong i s tuyn tnh ta bit rng vi mi G s tn ti ma trn H rn tha mn:
35
m t m tuyn tnh, c th s dng ma trn sinh G k,n , ma trn ny cha k vct hng
T
c lp tuyn tnh to nn khng gian m V( n,k ) G.H = 0 Trong : r = n k

46/ m t m tuyn tnh, c th s dng ma trn sinh G k,n Trong i s tuyn tnh ta bit rng
T
vi mi G k,n s tn ti ma trn H rn tha mn: G.H = 0 Chn cu sai sau :

a G k,n l ma trn k hng, n ct
b
c
H T c gi l ma trn k hng, n ct ;
H rn l ma trn r hng, n ct ;
H T c gi l ma trn chuyn v ca H
47/ Khi xy dng mt m tuyn tnh ( n,k,d 0 ) ngi ta phi tm c cc m c tha nh nhng
li c kh nng khng ch sai ln. Ngi ta thng xy dng m ny da trn cc bi ton ti u Tm

cu sai trong cc cu di y:
a Vi k v d 0 xc nh, ta phi tm c m c di vi t m l ln nhtTng ng vi bi
ton ny ta c gii hn n = k
b Vi n v k xc nh, ta phi tm c m c khong cch d 0 l ln nht Tng ng vi bi
ton ny ta c gii hn Plotkin sau: n
k 1
20i
i=0
Vi k v d 0 xc nh, ta phi tm c m c di vi t m l nh nhtTng ng vi bi

ton ny ta c gii hn Griesmer sau: d 0
n.2k 1
2k 1
Vi n v s sai khi sa t xc nh, ta phi tm c m c s du thng tin k l ln nht (hay s

du tha l nh nht)Tng ng vi bi ton ny ta c gii hn Hamming
sau: 2
n k
Cin
i =0
48/ Chn nh ngha sai v m xyclic trong cc nh ngha sau

a
b
c
d
M xyclic (n, k) l Ideal I = g ( X ) ca vnh a thc Z2 [ x ] X + 1

M xyclic (n, k) l mt b m m a thc sinh c bc r = n+k
M xyclic l mt b m tuyn tnh
M xyclic l mt b m , m nu a ( X ) l mt t m th dch vng ca a ( X ) cng l mt t
n
m thuc b m ny
49/ Chn cu ng ca nh l v kh nng sa sai
a
M u nh phn c tha (D > 0) vi khong cch Hamming d 0 = 4 c kh nng sa c
d0 + 1
2
t sai tho mn iu kin: t

b
M u nh phn c tha (D > 0) vi khong cch Hamming d 0 > 1 c kh nng pht hin
t sai tho mn iu kin t d 0 1
36
M u nh phn c tha (D > 0) vi khong cch Hamming d 0 3 c kh nng sa c
d0 1
v c kh nng pht hin t sai tho mn iu kin
2
t d0 1
M u nh phn c tha (D > 0) vi khong cch Hamming d 0 1 c kh nng sa c
d0 1
2
50/ T nh l m ho th 1 ca Shannon i vi m nh phn ta c :
n = p ( a i ) n i H1 ( A )
i =1
T biu thc trn tm cu ng nht trong cc biu thc sau :

s
n = p ( a i ) log p ( a i ) ;
i =1
p ( a ) n = p ( a ) log p ( a ) ;
i =1
s
p ( a i ) n i p ( a i ) log p ( a i ) ;
i =1
i =1
p ( a i ) n i = p ( a i ) log p ( a i )
d
51/
i =1
Theo
nh
ho
i =1
i =1
th
ca
Shannon
vi
nh
phn
ta
c:
n = p ( a i ) n i H1 ( A ) = p ( a i ) log p ( a i )
T biu thc ny suy ra di t m n i v xc sut p ( a i ) lin h vi nhau: n i log
T (*)
a
b
c
d
1
(*)
p (ai )
tm cu ng sau v nguyn tc lp m tit kim:

Cc t m c di ln s c dng m ha cho cc tin c xc sut ln
Cc t m c di n t l thun vi xc sut P
Cc tin c xc sut xut hin ln c m ha bng cc t m c di nh v ngc li cc
tin c xc sut xut hin nh c m ha bng cc t m c di ln
Cc t m c di nh s c dng m ha cho cc tin c xc sut nh
52/ Cho ngun tin X = { x1 , x2 , x3 , x4 , x5 } vi cc xc sut ln lt l {1/2, 1/4, 1/8, 1/16, 1/16}
Bit x1 c m ha thnh 0, x2 c m ha thnh 10, x3 c m ha thnh 110, x4 c m ha

thnh 1110, x5 c m ha thnh 1111 B m ti u cho ngun trn c chiu di trung bnh tnh
theo cng thc : n =
p(x )n
i =1
a
b
c
d
l :
1,88
1,90
1,875
1,925
53/ Yu cu ca php m ha: nhng t m c di nh hn khng trng vi phn u ca t m c

di ln hn Cc tin c xc sut xut hin ln hn c m ha bng cc t m c di nh v
ngc li.
37
Cho ngun tin X = { x1 , x2 , x3 , x4 , x5 } vi cc xc sut ln lt l {1/2, 1/4, 1/8, 1/16, 1/16}

Bit x1 c m ha thnh 0, x2 c m ha thnh 10 Chn cu ng di y m ha cho x3
a 101
b 011
c 110
d 100
ngc li.Cho ngun tin X = { x1 , x2 , x3 , x4 , x5 } vi cc xc sut ln lt l {1/2, 1/4, 1/8, 1/16, 1/16}
Bit x1 c m ha thnh 0, x2 c m ha thnh 11, x3 c m ha thnh 100

Chn cu ng di y m ha cho x4
a 000
b 110
c 001
d 1010
ngc li Cho ngun tin X = { x1 , x2 , x3 , x4 , x5 } vi cc xc sut ln lt l {1/2, 1/4, 1/8, 1/16, 1/16}
Bit x1 c m ha thnh 0, x2 c m ha thnh 10, x3 c m ha thnh 110, x4 c m ha

thnh 1110. Chn cu ng di y m ha cho x5
a 1010
b 1111
c 101
d 110
56/ Cho m Cyclic C(7, 4) c a thc sinh l g ( x) = 1 + x + x3 v a thc sinh G sau :
x
G= 2
x
3
x
+ x +x3
+x2 +x4
+ x3 +x5
+ x 4 + x 6
Ma trn no sau y l mt ma trn sinh G ng vi m Cyclic C(7,4) trn

1101000
0110100
a
0011010
0001101
1010100
0101100
b
0010110
0001011
1000100
0100000
c
0011001
0001011
38
1010100
0101010
0010101
0001101
57/ Cho m Cyclic C(7, 4) c a thc sinh l g ( x) = 1 + x 2 + x 3 v a thc sinh G sau
x
G= 2
x
3
x
+ x 2 +x3
+x3 +x 4
+x 4 +x5
+ x 5 + x 6
Ma trn no sau y l mt ma trn sinh G ng vi m Cyclic C(7,4) trn

1010100
0101010
a
0010101
0001101
1011000
0101100
0010110
0001011
1010100
0101100
0010110
0001011
1000100
0100000
0011001
0001011
58/ Cho m Cyclic C(7, 4) c a thc sinh l : g ( x) = 1 + x + x3 v ma trn sinh G. T ma trn sinh G
tnh c ma trn kim tra H bn:
1 +x 2 +x3 +x 4
H = x +x3 +x 4 +x5
x2 +x 4 +x5 +x6
Chuyn ma trn kim tra H sang dng khng gian tuyn tnh. Ma trn no sau y l mt ma trn kim
tra H ( dng khng gian tuyn tnh)
1011100
a 0101110
0010111
39
1010100
0101010
0010101
1000100
0100000
0011001
1010100
0101100
0010110
59/ Cho m Cyclic C(7, 4) c a thc sinh l : g ( x) = 1 + x 2 + x 3 v ma trn sinh G T ma trn sinh G
tnh c ma trn kim tra H bn :
1 +x +x2 +x4
H = x +x2 +x3 +x5

x2 +x3 +x 4 +x6
Chuyn ma trn kim tra H sang dng khng gian tuyn tnh. Ma trn no sau y l mt ma trn kim
tra H ( dng khng gian tuyn tnh)
1110100
a 0111010
0011101
b
1010100
0101010
0010101
1010100
0101100
0010110
1000100
0100000
0011001
60/ Tin ri rc a i A ; RA: T m fi ( x ) tng ng vi a i Thut ton xy dng t m xyclic gm
theo 4 bc: M,N,P,Q c sp xp ngu nhin M: M t tin a i trong tp tin cn m ha (gm 2

tin) bng mt a thc a i ( X ) vi deg a i ( X ) k 1
N: Chia a i ( X ) .x
n k
cho a thc sinh g(X) tm phn d ri ( X )
P: Nng bc a i ( X ) bng cch nhn n vi x
n k
Q : Xy dng t m xyclic: fi ( x ) = a i ( X ) .x
+ ri ( X )
Chn cc sp xp th t ng thut ton xy dng t m xyclic:
a M-P-N-Q ;
b P-Q-M-N;
c M-N-P-Q;
n k
40
Q-M-N-P;
61/ Gi s sau khi thc hin m ha ngun ri rc A. Ta c kt qu m ho sau :

A1 A4 A5 A2 A3
Gii m cho dy bt nhn c c dng 11100011010111100 s c

00 10 110 1111 1110
kt qu no sau y:
a A3-A1-A5-A4-A2-A2;
b A3-A1-A5-A4-A2-A1;
c A3-A1-A5-A4-A2-A2;
d A3-A2-A5-A4-A2-A1;
62/ Gi s sau khi thc hin m ha ngun ri rc A
A1 A4 A5 A2 A3
Ta c kt qu m ho sau :
Gii m cho dy bt nhn c c dng
00 10 110 1111 1110
11110011010111100 s c. kt qu no sau y:
a A3-A1-A5-A4-A2-A2;
b A3-A2-A5-A4-A2-A1;
c A3-A1-A5-A4-A2-A1;
d A2-A1-A5-A4-A2-A1;
A1 A4 A5 A2 A3
00 10 110 1111 1110
1111001101011110010 s c kt qu no sau y:
a
A2-A1-A5-A4-A2-A1-A3;
b A3-A1-A5-A4-A2-A2;
c
A2-A1-A5-A4-A2-A1-A4
d A3-A1-A5-A4-A2-A1;
A1 A4 A5 A2 A3
00 10 110 1111 1110
11110011010111100110 s c kt qu no sau y:
a
A2-A1-A5-A4-A2-A1-A4
b A2-A1-A5-A4-A2-A1-A5;
c
A3-A1-A5-A4-A2-A1;
d A2-A1-A5-A4-A2-A1-A3;
A1 A4 A5 A2 A3
00 10 110 1111 1110
1111001101011110011000 s c kt qu no sau y:
a
A2-A1-A5-A4-A2-A1-A4
b A2-A1-A5-A4-A2-A1-A5-A1
c
A2-A1-A5-A4-A2-A1-A3;
d A3-A1-A5-A4-A2-A1;
66/ Gi s sau khi thc hin m ha, cc tin ai vi xc sut tng ng P (ai ) c m ha thnh cc
m nh phn c di m ni tng ng nh bng sau:
41
Tnh di m trung bnh theo biu thc n =
n ip ( a i ) ta c gi tr no :
i =1
a
b
c
d
4;
3;
2,1;
1,2;
m nh phn c di m ni tng ng nh bng sau:
n ip ( a i ) ta c gi tr no:
i =1
a
b
c
d
1,8;
4;
2,4;
3;
m nh phn c di m ni
tng ng nh bng sau :
i =1
a
b
c
d
1,8;
2,1;
4;
2,75;
m nh phn c di m ni
tng ng nh bng sau :
42
i =1
a
b
c
d
2,1 du m;
1,8 du m ;
2,75 du m;
2,45 du m;
m nh phn c di m ni tng ng nh bng sau :
i =1
a
b
c
d
2,5;
2,45;
1,8;
2,75;
71/ Mt dy tin X = { x1 , x2 ,..., xn } vi xi X ; i = 1 n Lng tin I(X) cha trong dy tin X s l:
I ( X ) = log
1
1
1
+ log
+ .... + log
P( x1 )
P( x2 )
P( xn )
Gi s cho ngun
X = { x1 , x2 , x3 , x4 , x5 }
vi cc xc
sut ln lt l {1/2, 1/4, 1/8, 1/16, 1/16}. Lng tin I(X) cha trong dy tin X= { x1 x2 x1 x1 x3 x4 x1 x1 x5 }
l:
a
b
c
d
17 bt ;
15 bt;
18 bt;
16 bt;
72/ Khi xy dng mt m tuyn tnh ( n,k,d 0 ) ngi ta phi tm c cc m c tha nh

nhng li c kh nng khng ch sai ln Ngi ta thng xy dng m ny da trn cc bi ton ti
u Tm cu sai trong cc cu di y:
a Vi k v d 0 xc nh, ta phi tm c m c di vi t m l ln nht. Tng ng vi bi
ton ny ta c gii hn n = k
b Vi k v d 0 xc nh, ta phi tm c m c di vi t m l nh nht. Tng ng vi bi
ton ny ta c gii hn Griesmer sau:
k 1
d
n 0i
i =0 2
c
Vi n v s sai khi sa t xc nh, ta phi tm c m c s du thng tin k l ln nht (hay s

du tha l nh nht) Tng ng
43
d0
d
n.2k 1
2k 1
Vi n v k xc nh, ta phi tm c m c khong cch d 0 l ln nht Tng ng vi bi

ton ny ta c gii hn Plotkin sau:
vi bi ton ny ta c gii hn Hamming sau:
n k
Cin
i =0
73/ Chn cu ng ca nh l v kh nng pht hin sai sau

a M u nh phn c tha (D > 0) vi khong cch Hamming d 0 = 1 c kh nng pht hin
t sai tho mn iu kin t d 0 + 1
t sai tho mn iu kin t d 0 v c
d0 1
2
t sai tho mn iu kin t d 0 1 kh nng sa c t sai tho mn iu kin: t

d
M u nh phn c tha (D > 0) vi khong cch Hamming d 0 3 c kh nng pht hin
d0 1
2
c t sai tho mn iu kin: t
74/ Thc hin m ha Shannon - Fano ngun ri rc A sau :

a5
a a a2 a3 a4
A= i = 1
s c kt qu no sau y:
p(ai ) 1/ 2 1/4 1/ 8 1/16 1/16
a
b
c
d
a1
0
a1
0
a1
0
a1
a2 a3
a4
a5
;
11 110 1110 1111
a2 a3 a4 a5
;
01 11 111 1111
a2 a3
a4
a5
10 111 1110 1111

a2 a3
a4
a5
10 110 1110 1111

a2 a3 a4 a5
a a
A= i = 1
s c kt qu no sau y:
p(ai ) 1/16 1/16 1/ 8 1/ 4 1/ 2
a
b
c
a1
0
a1
0
a1
a2 a3
a4
a5
;
10 110 1110 1111
a2 a3
a4
a5
;
11 110 1110 1111
a2 a3
a4
a5
10 111 1110 1111
44
a2
a3 a4 a5
a1
1111 1110 110 10 0

a5
a a a2 a3 a4
A= i = 1
s c kt qu no sau y:
p(ai ) 1/ 4 1/2 1/ 8 1/16 1/16
a
b
c
d
a1
10
a1
0
a1
0
a1
a2 a3
a4
a5
0 110 1110 1111

a2 a3
a4
a5
10 111 1110 1111

a2 a3 a4 a5
;
01 11 111 1111
a2 a3
a4
a5
;
10 110 1110 1111

a4
a5
a a a2 a3
A= i = 1
s c kt qu no sau y:
p(ai ) 1/ 8 1/4 1/ 2 1/16 1/16
a
b
c
d
a4
a5
a1 a2 a3
;
0 10 110 1110 1111
a5
a1 a2 a3 a4
110 10 0 1110 1111

a4
a5
a1 a2 a3
;
0 11 110 1110 1111
a1 a2 a3 a4 a5
;
0 01 11 111 1111

a2 a3 a4
a5
a a
A= i = 1
s c kt qu no sau y:
p(ai ) 1/16 1/4 1/ 8 1/ 2 1/16
a
b
c
d
a4
a5
a1 a2 a3
;
0 10 110 1110 1111
a1 a2 a3 a4 a5
1110 10 110 0 1111

a1 a2 a3 a4 a5
;
0 01 11 111 1111
a4
a5
a1 a2 a3
;
0 11 110 1110 1111

a a a2 a3 a4 a5
A= i = 1
p (ai ) 1/ 2 1/4 1/16 1/ 8 1/16 s c kt qu no sau y:
45
a
b
c
d
a1
0
a1
0
a1
0
a1
a2 a3
a4
a5
;
10 1110 110 1111
a2 a3 a4 a5
;
01 11 111 1111
a2 a3
a4
a5
;
11 110 1110 1111
a2 a3
a4
a5
10 111 1110 1111

a4
a5
a a a2 a3
A= i = 1
s c kt qu no sau y:
p(ai ) 1/ 2 1/8 1/ 4 1/16 1/16
a
b
c
d
a1
0
a1
0
a1
0
a1
a2 a3
a4
a5
;
10 110 1110 1111
a2 a3 a4 a5
;
11 01 111 1111
a2 a3
a4
a5
10 111 1110 1111

a2 a3
a4
a5
11 110 1110 1111

a2 a3 a4
a5
a a
A= i = 1
s c kt qu no sau y:
p(ai ) 1/ 2 1/16 1/ 8 1/ 4 1/16
a
b
c
d
a1
0
a1
0
a1
0
a1
a2 a3 a4 a5
;
01 11 111 1111
a2 a3
a4
a5
10 111 1110 1111

a2
a3 a4 a5
;
1110 110 10 1111
a2 a3
a4
a5
;
10 110 1110 1111

a4 a5
a a a2 a3
A= i = 1
s c kt qu no sau y:
p(ai ) 1/ 2 1/4 1/16 1/16 1/ 8
a
b
c
a1
0
a1
0
a1
a2 a3
a4
a5
10 1111 1110 110

a2 a3
a4
a5
;
10 110 1110 1111
a2 a3 a4 a5
;
01 11 111 1111
46
a4
a5
a1 a2 a3
;
0 11 110 1110 1111

a2 a3 a4
a5
a a
A= i = 1
s c kt qu no sau y:
p(ai ) 1/16 1/4 1/ 8 1/16 1/ 2
a
b
c
d
a4
a5
a1 a2 a3
;
0 10 110 1110 1111
a4
a5
a1 a2 a3
;
0 11 110 1110 1111
a1 a2 a3 a4 a5
;
0 01 11 111 1111
a4 a5
a1 a2 a3
1111 10 110 1110 0
84/ Gi s sau khi thc hin m ha Shannon - Fano ngun ri rc A :

a3
a a a4 a5 a2
A= i = 1
p(ai ) 1/ 2 1/4 1/ 8 1/16 1/16
a2
a3
a a a5
Ta c kt qu m ho sau : 1 4
di t m trung bnh n v entropy H(A)
0
10
110
1110
1111
c tnh theo biu thc

5
i =1
i =1
n = p ( a i ) n i v H ( A ) = p ( a i ) log p ( a i ) s c kt qu no sau y :
a
n =H(A)=2,875;
n =H(A)=1,875;
n =1,875 v H(A)=1,95;
n =1,95 v H(A)=1,875

a2
a3
a4
a5
a a
A= i = 1
s c kt qu no sau y:
p (ai ) 0.5 0.25 0.125 0.0625 0.0625
a
b
c
d
a1
0
a1
0
a1
0
a1
a2 a3 a4 a5
;
01 11 111 1111
a2 a3
a4
a5
10 110 1110 1111

a2 a3
a4
a5
10 111 1110 1111

a2 a3
a4
a5
;
11 110 1110 1111
47
a2
a3
a4
a5
a a
A= i = 1
s c kt qu no sau y:
p(ai ) 0.25 0.5 0.125 0.0625 0.0625
a4
a5
a1 a2 a3
a
;
0 11 110 1110 1111
b
c
d
a1 a2
10 0
a1 a2
0 10
a1 a2
0 10
a3
a4
a5
;
110 1110 1111
a3
a4
a5
110 1110 1111

a3
a4
a5
111 1110 1111

a2 a3
a4
a5
a a
A= i = 1
s c kt qu no sau y:
p(ai ) 0.125 0.25 0.5 0.0625 0.0625
a
b
c
d
a1 a2 a3
0 10 110
a1 a2 a3
110 10 0
a1 a2 a3
0 01 11
a1 a2 a3
0 10 111
a4
a5
1110 1111
a4
a5
1110 1111
a4 a5
;
111 1111
a4
a5
1110 1111

a2
a3
a4
a5
a a
A= i = 1
s c kt qu no sau y:
p (ai ) 0.0625 0.25 0.125 0.5 0.0625
a
b
c
d
a1 a2 a3 a4 a5
1110 10 110 0 1111

a1 a2 a3 a4 a5
;
0 01 11 111 1111
a4
a5
a1 a2 a3
;
0 11 110 1110 1111
a4
a5
a1 a2 a3
0 10 110 1110 1111

a2
a3
a4
a5
a a
A= i = 1
s c kt qu no sau y:
p (ai ) 0.0625 0.25 0.125 0.0625 0
a
b
a1
0
a1
a2
11
a2
10
a3
a4
a5
;
110 1110 1111
a3
a4
a5
110 1110 1111

48
c
d
a4 a5
a1 a2 a3
1111 10 110 1110 0

a1 a2 a3 a4 a5
;
0 01 11 111 1111

a2
a3
a4
a5
a a
A= i = 1
s c kt qu no sau y:
p (ai ) 0.5 0.125 0.25 0.0625 0.0625
a
b
c
d
a1
0
a1
0
a1
0
a1
a2 a3 a4 a5
;
01 11 111 1111
a2 a3
a4
a5
10 111 1110 1111

a2 a3
a4
a5
;
11 110 1110 1111
a2 a3 a4
a5
110 10 1110 1111

a2
a3
a4
a5
a a
A= i = 1
s c kt qu no sau y:
p (ai ) 0.5 0.0625 0.125 0.25 0.0625
a
b
c
d
a1
0
a1
1
a1
0
a1
a2 a3
a4
a5
;
11 110 1110 1111
a2 a3
a4
a5
00 010 0111 0101

a2 a3
a4
a5
10 111 1110 1111

a2
a3 a4 a5
1110 110 10 1111

a2
a3
a4
a5
a a
A= i = 1
s c kt qu no sau y:
p (ai ) 0.5 0.0625 0.125 0.0625 0.25
a
b
c
d
a1
0
a1
0
a1
0
a1
a2 a3
a4
a5
10 110 1110 1111

a2 a3
a4
a5
10 111 1110 1111

a2 a3 a4 a5
;
01 11 111 1111
a2
a3
a4 a5
;
1111 110 1110 10
49
a2
a3
a4
a5
a a
A= i = 1
s c kt qu no sau y:
p (ai ) 0.5 0.25 0.0625 0.125 0.0625
a1 a2 a3 a4 a5
a
;
0 01 11 111 1111
a4
a5
a a a3
b 1 2
0 10 110 1110 1111
c
d
a1
0
a1
a2
10
a2
11
a3
1110
a3
110
a4
a5
110 1111
a4
a5
;
1110 1111

a4
a5
a2
a3
a a
A= i = 1
p (ai ) 0.5 0.25 0.125 0.0625 0.0625
a2
a3
a a a5
0
10
110
1111
1110
c tnh theo biu thc n =
i =1
i =1
p ( a i ) n i v H ( A ) = p ( a i ) log p ( a i ) s c kt qu no sau
y :
a
n =H(A)=1,875;
n =H(A)=2,875;
n =1,95 v H(A)=1,875;
n =1,875 v H(A)=1,95;

a2
a3
a4
a5
a6
a7
a8
a a
A= i = 1
p(ai ) 0.25 0.125 0.0625 0.0625 0.25 0.125 0.0625 0.0625
a3
a4
a7
a8
a a a2 a6
00 01 100 101 1100 1101 1110 1111

di t m trung bnh n v entropy H(A) c tnh theo biu thc
n = p ( a i ) n i v
i =1
H ( A ) = p ( a i ) log p ( a i ) s c kt qu no sau y :
i =1
n =1,875 v H(A)=1,95;
n =1,95 v H(A)=1,875 ;
n =H(A)=1,875;
n =H(A)=2,75;

a2 a3
a4 a5 a6 a7
a8
a a
A= i = 1
p(ai ) 1/ 4 1/ 8 1/16 1/16 1/ 4 1/ 8 1/16 1/16
50
a3
a4
a7
a8
a a a2 a6
00 01 100 101 1100 1101 1110 1111

di t m trung bnh n v entropy H(A) c tnh theo biu thc
n = p ( a i ) n i v
i =1
H ( A ) = p ( a i ) log p ( a i ) s c kt qu no sau y :
i =1
n =1,95 v H(A)=1,875 ;
n =H(A)=2,75;
n =H(A)=1,875;
n =1,875 v H(A)=1,95;
97/ Gi s sau khi thc hin m ha ngun ri rc A :

a4
a5
a2
a3
a a
A= i = 1
p (ai ) 0.5 0.25 0.125 0.0625 0.0625
a2
a3
a a a5
0
10
110
1111
11100
c tnh theo biu thc: n =
i =1
i =1
y :
a
n =H(A)=2,875;
n =H(A)=1,875;
n =1,875 v H(A)=1,95;
n =1,9375 v H(A)=1,875;

a3
a a a4 a5 a2
A= i = 1
p(ai ) 1/ 2 1/4 1/ 8 1/16 1/16
a2
a3
a a a5
0
10
110
1111
11100
i =1
i =1
y :
a
n =1,875 v H(A)=1,95;
n =H(A)=1,875;
n =1,9375 v H(A)=1,875;
n =H(A)=2,875;

a3
a a a4 a5 a2
A= i = 1
p(ai ) 1/ 2 1/4 1/ 8 1/16 1/16
51
a2
a3
a a a5
00
10
110
1111
1110
i =1
i =1
y :
a
n =H(A)=1,75;
n =2,375 v H(A)=1,875;
n =H(A)=2,875;
n = H(A)=1,85

a3
a a a4 a5 a2
A= i = 1
p(ai ) 1/ 2 1/4 1/ 8 1/16 1/16
a5
a2
a3
a a
0
10
1100
1111
1110
i =1
i =1
y :
a
n =H(A)=1,95;
n =1,9375 v H(A)=1,75;
n =2 v H(A)=1,875;
n =1,87 v H(A)=1,87;

a4
a5
a2
a3
a a
A= i = 1
p (ai ) 0.5 0.25 0.125 0.0625 0.0625
a5
a2
a3
a a
0
10
1100
1111
1110
i =1
i =1
y :
a
n =1,87 v H(A)=2,1
n =H(A)=1,975
n =1,9375 v H(A)=1,275;
n =2 v H(A)=1,875;

a4
a5
a2
a3
a a
A= i = 1
p (ai ) 0.5 0.25 0.125 0.0625 0.0625
52
a2
a3
a a a5
00
10
110
1111
1110
i =1
i =1
y :
a
n =2,5 v H(A)=1,85;
n =1,9375 v H(A)=1,87;
n =2,375 v H(A)=1,875 ;
n =2 v H(A)=1,9;

a4
a5
a2
a3
a a
A= i = 1
p (ai ) 0.5 0.25 0.125 0.0625 0.0625
a5
a2
a3
a a
00
10
1100
1111
1110
i =1
i =1
y :
a
n =2,5 v H(A)=1,875;
n =2,375 v H(A)=1,975
n =2,55 v H(A)=1,775;
n =2 v H(A)=1,675;
104/ Cho m Cyclic C(7,4) c a thc sinh l g ( x) = 1 + x + x3
tng ng a thc thng tin
a ( x ) = x + x S dng thut ton 4 bc thit lp t m h thng ta c kt qu no di y :

3
a
b
c
d
1100101
0101010;
1000110;
0110111;
a ( x ) = 1+ x S dng thut ton 4 bc thit lp t m h thng ta c kt qu no di y:

2
a
b
c
d
0101010;
1000110;
0011010;
0110111;
a ( x ) = x + x S dng thut ton 4 bc thit lp t m h thng, s c kt qu no di y :

2
a
b
c
d
0101010;
1110010;
1000110;
0110111;
53
a ( x ) = 1+ x 3 S dng thut ton 4 bc thit lp t m h thng, s c kt qu no di y :

a
b
c
d
0101010;
1000110;
1110010;
0111001;
a ( x ) = x 2 + x 3 S dng thut ton 4 bc thit lp t m h thng, s c kt qu no di
y:
a
b
c
d
0111001;
1000110;
1110010;
0100011;
a ( x ) = 1+ x + x S dng thut ton 4 bc thit lp t m h thng, s c kt qu no di

2
y :
a
b
c
d
0100011;
0111001;
1110010;
1001011;
110/ Cho m Cyclic C(7,4) c a thc sinh l g ( x) = 1 + x + x3 tng ng a thc thng tin
a ( x ) = 1+ x S dng thut ton 4 bc thit lp t m h thng, s c kt qu no di y :

a
b
c
d
1001011;
0100011;
1011100;
1110010;

2
y :
a
b
c
d
1001011;
0101110;
1011100;
1110010;
a ( x ) = x + x 2 + x 3 S dng thut ton 4 bc thit lp t m h thng, s c kt qu no di
y :
a
b
c
d
1011100;
0101110;
1001011;
0010111;
a ( x ) = x 3 S dng thut ton 4 bc thit lp t m h thng, s c kt qu no di y :

54
a
b
c
d
0101110;
1001011;
1010001
1011100;
a ( x ) = x S dng thut ton 4 bc thit lp t m h thng, s c kt qu no di y :

a
b
c
d
0010111;
0110100;
0101110;
1011100;

a
b
c
d
1110010;
0101110;
0110100;
0010111;
116/ Cho m Cyclic C(7,4) c a thc sinh l g ( x) = 1 + x 2 + x 3
a ( x ) = x + x S dng thut ton 4 bc thit lp t m h thng ta c kt qu no di y:

3
a
b
c
d
0101110;
0110111;
1000101;
0101010;
a ( x ) = 1+ x S dng thut ton 4 bc thit lp t m h thng ta c kt qu no di y:

2
a
b
c
d
0011010;
1000110;
0101010;
0111010;
a ( x ) = x + x S dng thut ton 4 bc thit lp t m h thng, s c kt qu no di y :

2
a
b
c
d
1110010;
0110111;
1000110;
0010110;
a ( x ) = 1+ x 3 S dng thut ton 4 bc thit lp t m h thng, s c kt qu no di y :

a
b
c
d
1101001;
0101010;
0111001;
1000110;
55
a ( x ) = x 2 + x 3 S dng thut ton 4 bc thit lp t m h thng, s c kt qu no di
y:
a
b
c
d
1010011;
0111001;
1000110;
0100011;

2
y :
a
b
c
d
0001011;
0100011;
0111001;
1110010;
122/ Cho m Cyclic C(7,4) c a thc sinh l g ( x) = 1 + x 2 + x 3 tng ng a thc thng tin
a ( x ) = 1+ x S dng thut ton 4 bc thit lp t m h thng, s c kt qu no di y :

a
b
c
d
1110010;
1001011;
0101100;
0100011;
a ( x ) = 1+ x + x 2 S dng thut ton 4 bc thit lp t m h thng, s c kt qu no di
y :
a
b
c
d
1001011;
1001110;
1110010;
1011100;
a ( x ) = x + x 2 + x 3 S dng thut ton 4 bc thit lp t m h thng, s c kt qu no di
y :
a
b
c
d
1001011;
0100111;
1011100;
0101110;

3
a
b
c
d
1001011;
0111011
1011100;
0101110;

56
a
b
c
d
1110100;
1011100;
0010111;
0101110;

a
b
c
d
0101110;
0110100;
1110110;
0010111;
57
CHNG 5 : L THUYT THU TI U

1/ Thu tn hiu khi c nhiu l mt bi ton thng k:
a ng
b Sai
2/ Nhim v ca my thu l phi chn li gii, do my thu cn c gi l s gii Yu cu ca
s gii l phi tm li gii ng (pht i ta phi tm c i ) Trong thc t c rt nhiu s
gii Trong tt c cc s gii c th c th ti mt s bo m xc sut nhn ln phi ng l ln
nht (xc sut gii sai l b nht) S ny c gi l s gii ti u. Khi ngi ta gi My
thu xy dng theo s gii ti u c gi l my thu ti u Kt lun ny ng hay sai ?
a Sai
b ng
3/ l/i ( u ) >
i = 1, m
p ( i )
l quy tc gii ti u vit di dng hm hp l. Chn cu
Vi
p ( l )
i
l
ng trong cc cu sau:
a
Nu mi tn hiu gi i u ng xc sut th l/i ( u ) = 0 Vi i l
b Nu mi tn hiu gi i u ng xc sut th l/i ( u ) > 1 Vi i l
c
d
Nu mi tn hiu gi i u ng xc sut th l/i ( u ) < 1 Vi i l

Nu mi tn hiu gi i u ng xc sut th l/i ( u ) = 1 Vi i l
4/ nh ngha b lc phi hp tuyn tnh th ng : i vi mt tn hiu xc nh, mt mch tuyn

N
tnh th ng m bo t s ra = cc i mt thi im quan st no y s c gi l
S ra
mch lc phi hp tuyn tnh th ng ca tn hiu Trong ra l t s gia cng sut trung
bnh ca nhiu u ra b lc y v cng sut nh ca tn hiu nh ngha ny ng hay sai ?
a
Sai
b ng
5/ Qu trnh x l tn hiu trong my thu ti u c gi l x l ti u tn hiu X l nhn li gii

c xc sut sai b nht Chn cu ng nht v x l ti u cc tn hiu:
a Da vo cc tiu chun ti u, bng cng c thng k ton hc ngi ta xc nh c quy tc
gii ti u, do ngy nay l thuyt truyn tin cho php bng ton hc tng hp c my
thu ti u.
b Vic tng hp cc my thu (xy dng s gii) ch cn c vo cc tiu chun cht lng
mang tnh cht chc nng m khng mang tnh cht thng k.
c nh hng ca nhiu ln cht lng ca my thu ti u ch c tnh theo t s tn/tp
d Vic tng hp my thu ti u l da vo trc gic, kinh nghim, th nghim
6/ Gi s i l tn hiu gi i, c xc sut p ( i ) - c gi l xc sut tin nghim my thu ta
nhn c u ( t ) , t u ( t ) qua s gii ta s c li gii l no Nh vy l c gi i vi

mt xc sut p ( l / u ) - c gi l xc sut hu nghim. Do xc sut gii sai s l:
p ( sai / u, l ) = 1 p ( l / u )
Xt hai s gii:
- T u ( t ) cho ta 1 - gi l s (1)
58
- T u ( t ) cho ta 2 - gi l s (2)
Nu p ( sai / u, 1 ) < p ( sai / u, 2 ) ta rt ra kt lun s (2) ti u hn (1) Khng nh ny ng
hay sai ?
a
Sai
b ng
7/ Tn hiu tng qut c dng: Ci ( t ) = C0i ( t ) cos t + ( t ) + 0

Chn cu sai trong cc cu sau:
a
Vic x l ti u tn hiu khng ph thuc ng bao C0i ( t ) v tn s tc thi
i ( t ) = +
d ( t )
dt
d ( t )
dt
Khi x l ti u tn hiu ta cn bit ng bao C0i ( t ) v tn s tc thi i ( t ) = +
Nu vic thu Ci ( t ) cn bit 0 ( iu chnh h thng thu) th c gi l thu kt hp Nu
vic thu Ci ( t ) khng cn bit 0 ( iu chnh h thng thu) th c gi l thu khng kt

hp
Thc t khi thay i s lm cho 0 thay i ch bin thin t nhng cng lm cho 0
thay i rt mnh Khi ta phi chuyn sang thu khng kt hp.
8/ Cho u vo mch tuyn tnh th ng mt dao ng c dng: y ( t ) = Ci ( t ) + n ( t )
Trong
Ci ( t ) l th hin ca tn hiu pht i (cn c gi l tn hiu ti) n ( t ) l nhiu cng, trng, chun
Bi ton tng hp mch l tm biu thc gii tch ca hm truyn phc K i ( ) ca mch tuyn tnh
th ng sao cho mt thi im quan st (dao ng nhn c) no ra t max, p dng
1
cng thc bin i ngc Fourier tnh c ra
N0
Siv ( 2f ) df Trong Siv ( ) l mt
ph (bin) phc ca th hin tn hiu u vo mch tuyn tnh

E
(*)
Theo nh l Parseval, ta c: ra max = i
N0
trong Ei =
Siv ( 2f ) df l nng lng ca tn hiu ti
Chn cu sai trong nhng nhn xt sau :

S
a
T (*) chng t t s ra = ch ph thuc vo nng lng ca tn hiu v bi ton pht
N ra
hin dng ca tn hiu l khng quan trng
b T (*) chng t : T s gia cng sut nh ca tn hiu v cng sut trung bnh ca nhiu
u ra b lc y ch ph thuc vo nng lng
S
c
T (*) chng t t s ra = ch ph thuc vo nng lng ca tn hiu m hon ton
N ra
khng ph thuc vo dng ca n
S
d T (*) chng t t s ra = hon ton ph thuc vo dng ca n
N ra
ca tn hiu m hon ton khng ph thuc vo dng ca n.
59
9/ Cho knh nh phn, i xng, khng nh c nhiu cng, trng, chun theo m hnh sau:
p ( 1 ) =
1
2
p ( 1 / 1 )
1
p (1 / 2 )
p ( 2 ) =
1
2
1
p ( b 2 / 1 )
p ( 2 / 2 )
Xc sut sai ton phn p s ( xc sut sai khng iu kin) l
p s = p ( 1 ) .p ( 2 / 1 ) + p ( 2 ) .p ( 1 / 2 )
Gi s tnh c p ( 2 / 1 ) =
1
2
P T
4N 0

exp
2
d =
P T

2G 0
khi p s s bng biu thc no di y:

P T
a
ps = 1 +
2G
0
P T
1
ps = +
2G
2
0
1 1 P T
ps = +
2 2 2G 0
P T
ps = 1
2G
0
10/ Ti u vo b lc tuyn tnh tc ng tn hiu: x(t) = s(t) + n(t)

Trong n(t) l tp m trng, chun, dng Cn s(t) l xung th tn c lp vi n(t) v c dng:
A.e A( t T )
tT
s(t) =
t >T
0
Hm truyn K 0 (j) = kS* (j)e jT

*
j T
Hm truyn ca b lc ( K 0 (j) = kS (j)e
) sao cho t s tn trn tp u ra ca b lc t cc
i s l biu thc no di y
kA
a
K 0 (j) =
A + j
kA
b
K 0 (j) =
A + j
kA
c
K 0 (j) =
A j
kjA
d
K 0 (j) =
A + j
60

NHDT LTTT

Uploaded by

Document Information

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

NHDT LTTT

Uploaded by

Copyright:

Available Formats

HC VIN CNG NGH BU CHNH VIN THNG

Km10 ng Nguyn Tri, H ng-H Ty

NGN HNG THI

CHNG II: TN HIU V NHIU

Hm t tng quan R x (t1, t 2 ) lun bng phng sai Dx (t ) vi mi t

l cng thc xc nh mt ph cng sut ca cc qu

trnh ngu nhin.

l cng thc xc nh mt ph cng sut ca cc qu trnh ngu nhin.

G() = M {G x ()} = M lim

l cng thc xc nh mt ph cng sut ca cc qu

trnh ngu nhin.

l cng thc xc nh mt ph cng sut ca cc qu

trnh ngu nhin.

G() = M {G x ()} = M lim

( t ) l hm lin hp phc ca S a ( t ) : S a ( t ) = x ( t ) + j x ( t ) l tn hiu gii tch.

Trong A = const, f0 = const, l i lng ngu nhin c phn b u trong khong ( , ) .

const, f0 = const, l i lng ngu nhin c phn b u trong khong ( , ) . Tnh hm t

xc sut trong khong c N bc nhy l: P ( N, )

mt ph cng sut Gx ( ) ca X(t) c tnh theo cng thc Gx ( ) = 2 Rx ( ) cos d ta c gi

14/ Mt qu trnh ngu nhin dng c hm t tng quan: Rx ( ) = 2 e cos 0

CHNG 3: C S L THUYT THNG TIN THNG K

t cc tiu khi ngun l ng xc sut

3/ Chn pht biu sai v bt nh

Khi p=1/2 th H(A) t max Chn cu ng v H ( A) max

8/ Mt thit b v tuyn in gm 16 khi c tin cy nh nhau v c mc ni tip Gi s c mt

/ yl ) =0 khi knh khng c nhiu

I ( xk ) = k ln p ( xk ) , trong k l h s t l Tm cu sai v cch chn k trong cc cu di y :

p ( a ) = 1 ; H ( A ) c tnh bng biu thc no di y:

H1 ( A ) c tnh bng biu thc no :

33/ Entropy c iu kin v 1 trng tin A khi r trng tin B l H(A/B)

khi knh c nhiu;

0 I ( A,B ) v I ( A,B ) = 0 khi knh b t;

I(A,B) = H(A) - H(B/A);

41/ Mnh no sau y sai

43/ Mt thit b v tuyn in gm 16 khi c tin cy nh nhau v c mc ni tip Gi s c

49/ Entropy H1 ( A ) ca ngun ri rc

Trong cc tnh cht ca H(A) di y tnh cht no l sai

Ngun tin ri rc A c s du ng xc sut cho entropy cc i H1 ( A )max = logs

Entropy ca ngun ri rc A l mt i lng gii ni 0 H1 ( a ) logs

50/ Cho ngun ri rc A

H1 ( A max ) logs = p ( a i ) log

p ( a ) log p(a ) logs ;

H1 ( A max ) logs = p ( a i ) log

51/ Cho ngun ri rc A

Nu ngun A c s du ng xc sut , khi biu thc no di y l sai

H1 (A) log s 0 H1 (A) log s

C = max I ( A,B ) = v k max I ( A, B ) (bps);

K biu th s du m knh truyn c (c truyn qua knh) trong mt n v thi gian

C' = v k logs khi cc knh c lp

C' = max I' ( A,B ) = v k max I ( A, B ) ,

K biu th s du m knh truyn c trong mt n v thi gian. T cc tnh cht v nh

max( K I(A,B)) max( K H(A));

54/ Cho ngun ri rc ch c hai du: A =

Khi ngun ri rc nh phn A c th vit biu thc no

Khi Entropy H1 ( A ) c tnh bng cng thc no sau y

a i c tnh theo cng thc

H(B / a i ) = p(b j / a i )log p(b j / a i )

Trong trng hp knh b t (b nhiu tuyt i) ta c biu thc no di y l sai :

; H(B / a i ) l lng thng tin ring trung bnh cha

H(B / a i ) = p(b j / a i )log p(b j / a i )

Trong trng hp knh khng nhiu biu thc no di y l ng :

bj . H ( A / bl ) = p ( a i / b l ) log p ( a i bl ) ; H(B / a i ) l lng thng tin ring trung bnh cha

H(B / a i ) = p(b j / a i )log p(b j / a i )

Trong trng hp b nhiu tuyt i, A v B l c lp nhau suy ra :