Professional Documents
Culture Documents
JNTUK-R13
III/II
b) Consider a telegraph source having two symbols, dot and dash. The dot
duration is 0.2. The dash duration is 3 times the dot duration. The probability
of the dots occurring is twice that of the dash and the time between symbols
is 0.2 sec. Calculate the information rate of the telegraph source.
6. a) An analog signal band limited to 10HKz quantize is 8-lavels of PCM System
with probability of 1/4, 1/5, 1/4, 1/10, 1/20, 1/10, 1/20 and 1/10
respectively.
Find the entropy and rate of information.
b) The source X generates M message, then prove the following inequality for
source entropy H(x):0_H(X) _log M.
7. a) Explain the concept of information. Calculate the amount of information if
binary digits occur with equal likelihood in a binary PCM system.
b) Define information rate and mutual information.
UNIT-V: SOURCE CODING
Short Answer Questions
1. What are discrete memory less channels?
2. Verify that I(X; Y) =I(Y; X).
3. Explain about binary symmetric channel.
4. For a noiseless channel with m input symbols and m output symbols, prove that
H(X) =H(Y).
Essay Questions
1. a) Explain the trade-off between bandwidth and signal to noise ratio.
b) A DMS X has five symbols x1, x2, x3, x4 and x5 with respective probabilities
0.2, 0.15, 0.05, 0.1 and 0.5. Construct Huffman code and calculate the code
efficiency.
2. a) Explain about Huffman coding.
b) A discrete memory less source has five symbols x1, x2, x3, x4 and x5 with
probabilities 0.4, 0.19, 0.16, 0.15 and 0.15 respectively attached to every symbol.
Construct a Shannon Fano code for the source and calculate code efficiency.
3. a) Discuss in brief about continuous channel capacity.
b) Calculate the capacity of the discrete channel shown in Fig.1. Assume
rs=1symbol/sec
4. a) Consider five messages given by the probabilities 1/2, 1/4, 1/8, 1/16, 1/16.
i. Calculate H
ii. Use Shannon-Fano algorithm to develop an efficient code and for that
code, calculate the average number of bits/message. Compare with H.
b) Explain the trade-off between bandwidth and signal to noise ratio.
5. a) Discuss the channel capacity for discrete and analog channels.
b) Explain the Shannon Fano coding with example.
6. a) What is Shannon theorem? Obtain the channel capacity for Gaussian channel.
b) A discrete memory less source has an alphabet of seven symbols with
probability for its output, as described here:
Symbol
prob.
S1
0.25
S2
0.25
S3
0.125
S4
0.125
S5
0.125
S6
0.0625
S7
0.0625
(i)
Compute the Huffman code for this source and explain why the compute
source code has an efficiency of 100 percent.
(ii)
Calculate H.
7. a) Apply Shannon Fano coding for the 5 messages with probabilities 0.4, 0.15,
0.15, 0.15, 0.15 and find the coding efficiency.
b) What is binary symmetric channel and derive expression for its capacity.
UNIT-VI: LINEAR BLOCK CODES
Short Answer Questions
1. Explain about BCH codes
2. Compare linear block codes and cyclic codes.
3. What is the use of syndromes?
4. What is constraint length for convolution encoders? Explain.
Essay Questions
1. a) Explain sequential decoding for convolutional codes.
b) Draw the state diagram, tree diagram, and trellis diagram for k=3, rate 1/3
code
generated by g1(x) = 1+x2, g2(x) = 1+x and g3(x) = 1+x+x2.
2. a) Briefly describe about the Code tree, Trellis and State Diagram for a
Convolution Encoder.
b) The generator polynomial for a (15, 7) cyclic code is g(x) =1+x4 +x6 +x7+x8.
Find the code vector (in systematic form) for the message polynomial D(x) =
x2+x3 +x4. Assume that the first and last bits of the code vector V(x) for
D(x) =
x2+x3 +x4 suffer transmission errors. Find the syndrome of V(x).
3. a) Explain the viterbi algorithm for the decoding of convolutional codes.
b) The parity check bits of a (8, 4) block code are generated by
c5= d1+d2+d4
c6=d1+d2+d3
c7=d1+d3+d4
c8=d2+d3+d4
Where d1, d2, d3 and d4 are the message digits.
(i)
Find the generator matrix and parity check matrix for this
code
(ii)
Find the minimum weight of this code
(iii)
Find the error detecting capabilities of this code.
4. a) Explain matrix description of linear block codes.
b) Design an encoder for the (7,4) binary cyclic code generated by g(x) = 1 + x + x3
and verify its operation using the message vector (0 1 0 1).
5. a) What are hamming codes? Discuss the error correction and detection capability
of hamming code.
b) What are cyclic codes? List the advantages and disadvantages of it.
6. a) Consider (7, 4) linear code whose generator matrix is
1 0 0 0 : 1 0 1
0 1 0 0 : 1 1 1
G= 0 0 1 0 : 1 1 0
0 0 0 1 : 0 1 1
(i) Find all code vectors of this code.
(ii) Find the parity check matrix for this code.
(iii)
Find the minimum weight of this code.
(iv)Prove equation CHT=0
b) Describe the algebraic structure of the binary cyclic codes.
7. a) Give the matrix description of the linear block codes.
b) Compare linear block codes and cyclic codes with one example
CONVOLUTION CODES
Essay Questions
1. a) Explain the differences between the block codes and convolution codes.
b) Explain tree diagram, trellis diagram and state transition diagram of convolution
codes with an example.
2. a) What are the different methods of describing the structure of a convolution
encoder? Explain.
b) Assume a (2, 1) convolution coder with constraint length 6. Draw the tree
diagram and trellis diagram for the assumed coder.
3. a) What is meant by free distance of a convolution code? How does it affect the
number of errors that can be corrected and coding gain
b) Draw the block diagram of a half rate convolution encoder with constraint
length 3. Determine the generator polynomial of the encoder.
4. a) A particular convolution code is described as an (n, k, L) code. What do these
letters n, k and L represent? Explain.
b) The generators of a 1/3 rate convolution code are: g1= [1 0 0]; g2= [1 0 1]
and
g3= [111]. Draw the encoder circuit and Trellis diagram corresponding to
this
code.