Professional Documents
Culture Documents
CODING
5th SEM E&C
H(S) = = ( ) bits/symbol or H(S) = = ( ) bits/symbol or
H(S) = = ( ) bits/symbol
Hartleys or Decits.
= ( ) Hartleys or Decits
Nats or Neper.
= ( ) Nats or Neper.
Source redundancy
()
= 1- = (1 - ()
) X %
The average information content of the symbols emitted from the i th state.
=
= ( ) bits/symbol or
=
= ( ) bits/symbol
The average information content of the symbols emitted from the k th state.
=
= ( ) bits/symbol
Log properties
1. =
. =
. = ln (10)
FORMULAS FOR REFERENCE
Average length
L= = bits/symbol or L = = bits/symbol
Source or code efficiency
() ()
= X % or = X %
Source or code redundancy
() ()
= 1- = (1 -
) X % or = 1- = (1 -
) X %
Compute the number of stages required for the encoding operation, which is
given by
=
or =
The probability of 0s and 1s and 2 s in the code are found using the
formulas
P (0) = =[ "0" s in the code for ] [ ] or
P (0) = =[ "0" s in the code for ] [ ] .
P (1) = =[ "1" s in the code for ] [ ] or
P (1) =
=[ "1" s in the code for ] [ ] .
P (2) =
=[ "2" s in the code for ] [ ] or
P (2) = =[ "2" s in the code for ] [ ] .
() =
= quaternary digits / Msg- symbol
The entropy in ternary units/ message symbol is found by using equation
()
(S) = ternary units/ message symbol or
(S) = = ( ) ternary units/ message symbol or
(S) = = ( ) ternary units/ message symbol
( , )
Since P( / ) =
( )
And another formula
H (A/B) = H (A, B) H (B) bits/ message-symbol
( , )
Since P( / ) =
( )
And another formula
H (B/A) = H (A, B) H (A) bits/ message-symbol
=
Channel efficiency is given by
(,)
= x 100%
Channel redundancy is given by
Channel redundancy = (1- ) x 100%
Estimation of channel capacity by MUROGAS method
FORMULAS FOR REFERENCE
()
= [ ] or [ ]
HAMMING BOUND (perfect code or not)
=
Chapter-2 binary cyclic codes