Binary Symmetric Channel

Consider a symmetric memoryless channel used to

COMMUNICATION SYSTEMS transmit binary data.
Due to noise in the system, errors are possible, i.e.
Lecture # 14 transmitted symbol s0 and be detected by the receiver as
s1 and vice versa.
24th Mar 2007 The channel is symmetric in the sense that both type of
errors are equally probable.
The channel is termed as memoryless in the sense that
Instructor the channel output at any time depends only on the
WASEEM KHAN channel input at that time.

Centre for Advanced Studies in Engineering

Probabilities in BSC Probabilities in BSC

We define two sets of probabilities for this channel.
Probability of receiving s0 is given by
The a priori probabilities of sending s0 and s1 given by
P(A0) = p0 P(A1) = p1 P(B0) = P(B0|A0)P(A0) + P(B0|A1)P(A1)
where A0 and A1 are the events of sending s0 and s1 respectively. = (1-p)p0 + pp1
The conditional probabilities of error are given by
P(B1|A0) = P(B0|A1) = p Similarly probability of receiving s1 is given by
and the conditional probabilities of NO error are given by
P(B1) = P(B1|A1)P(A1) + P(B1|A0)P(A0)
P(B0|A0) = P(B1|A1) = 1 - p
= (1-p)p1 + pp0
A0 1 p B0

p
p

A1 1-p B1

The a postereori Probabilities in BSC Random Variable

When we perform a random
Applying Bayes rule, we get experiment, we are usually
P B 0 | A0 P ( A0 ) interested in some measurement
P A0 | B 0
P B0 or numerical attribute of the
(1 p ) p 0 outcome.
(1 p ) p 0 pp 1
This leads to the concept of
random variable.
P B 1 | A1 P ( A1 )
P A1 | B 1 A random variable X is a function
P B1
(1 p ) p 1 that assigns a real number X( ) to
(1 p ) p 1 pp 0 each outcome in a sample
space.

1
Random Variable Cumulative Distribution Function
The function that assigns values to each outcome is fixed The cumulative distribution function (cdf) FX(x) of a random
and deterministic; randomness is due to the argument of variable X is defined by as the probability of event {X x} .
the function. FX(x) = P(X x)
Random variable can be FX(a) = probability of the event {X a}

Discrete:
Colour of a ball selected from a jar containing balls with different
colours
The resulting number after rolling a dice
Continuous:
The weight of a sampled individual
The time before an electrical appliance fails

Properties of cdf Probability Density Function

The probability density function (pdf) of a continuous random
0 FX(x) 1 variable X is defined as the derivative of FX(x).
dF X ( x )
FX( ) = 1 f X (x)
dx
FX(- ) = 0 For discrete random variables, equivalent to the pdf is the
probability mass function (pmf)
FX(a) FX(b) if a b FX ( x)
f X (x)
FX(a) - FX(b) = P[a < X b] x

Probability Density Function Relation between pdf and cdf

2
Properties of pdf
fX(x) > 0

P[a < X b] = f X ( x ) dx
a
x

FX(x) = f X ( x )dx

f X ( x )dx 1

3
This document was created with Win2PDF available at http://www.daneprairie.com.
The unregistered version of Win2PDF is for evaluation or non-commercial use only.