Professional Documents
Culture Documents
LTI Systems
Motivation
LTI systems have been found to be characterized
by their impulse and frequency responses.
We have also seen how the frequency response
may sometimes be extended to (be realized in) a
complex domain using the z-transform. In
particular, for systems determined by LCCDE’s.
In this unit we will identify important properties of
frequency responses, and see how they are
parameterized by roots and poles of the system
function in the complex plane. This is a
fundamental approach to the design of both
discrete and continuous systems.
Topics
Frequency Response Characteristics
System Functions of LCCDE Systems
Frequency Responses of LCCDE Systems
Phase and Magnitude Interaction
Minimum-Phase Systems
General Linear Phase
Frequency Response Characteristics (1)
Recall that an LTI system is characterized as convolution with
the impulse response sequence :
y [ n ] = T { x [ n ]} = h ∗ x [ n ]
In the cases that we will be interested in, the Z - transform
H ( z ) of h [ n ] (called the system function) also characterizes
the system by acting as a multiplier in the complex plane.
= x [ n] Z H ( z)× Z −1 y [n]
= x [ n] F H ( e jω ) × F −1 y [ n]
∡H (ω ) ≈ −λ (ω0 ) ω + ∡H (ω0 )
If the sound is arriving from an off - axis source then the phase
of the pressure field will vary accross the transducer face,
resulting in a frequency response H (ω ) that varies in phase
and magnitude.
Frequency Response Characteristics (7)
Group Delay Example (continued) : The group delay for
this response determines the delays for narrow band
pulses with different center frequencies.
1
GroupDelay at ω1
0.8
0.6
0.4
0.2
-0.2
-0.4
-0.6
-0.8
-1
GroupDelay at ω2
-10 -8 -6 -4 -2 0 2 4 6 8 10
0.8
0.6
0.4
0.2
-0.2
-0.4
-0.6
-0.8
-1
-10 -8 -6 -4 -2 0 2 4 6 8 10
Topics
Frequency Response Characteristics
System Functions of LCCDE Systems
Frequency Responses of LCCDE Systems
Phase and Magnitude Interaction
Minimum-Phase Systems
General Linear Phase
System Functions of LTI Systems (1)
Recall that an LCCDE system is based on a linear equation :
N M
∑ a y [ n − k ] =∑ b x [ n − k ]
k =0
k
k =0
k
∑ k
a z −k
Y ( z ) = ∑ k X (z)
b z −k
k =0 k =0
System Functions of LTI Systems (2)
so that the ratio :
M N
H ( z ) = Y ( z ) X ( z ) = ∑ bk z − k ∑ k
a z −k
k =0 k =0
∑ bk z −k
∏
b0 1
−1
∏
b0 M − N 1
( z − ck )
H (z) = N
k =0
= = z
( )
N N
∏ ∏ ( )
a0 a0
∑k =0
a k z −k
1
1 − d k z −1
1
z − d k
where the d k 's are poles, the ck 's are zeros, and there may
be additional poles or zeros at z = 0, ∞ depending on M - N .
System Functions of LTI Systems (3)
Now we can take a different approach to finding the impulse
response function : compute the inverse Z - transform of H ( z ) .
Since H ( z ) is rational its inverse transform is usually not
unique because of the different choices for the ROC's. But
there are only a few possibilities determined by the finite
number of annular regions between the poles.
Non-Inverse
Inverse
Z-Transform
Z-Transform
Solutions
Solutions
Set of All Solutions
System Functions of LTI Systems (4)
Stability and Causality : A unique impulse response is
assigned requiring the system to be either stable or causal.
Criteria for Stability : The only inverse Z - transform of H ( z )
that is stable is the one whose ROC contains the unit circle.
Stability is important because only a stable inverse Z - transform
will have a well defined frequency response.
Criteria for Causality : The only inverse Z - transform of H ( z )
that is causal is the one whose ROC is the region beyond the
outermost pole. Causality is desirable because it is a natural
system characteristic and also because it is automatically
selected by use of rest - state initialization of the recursions.
System Functions of LTI Systems (5)
Stability and Causality (continued) : Stability and causality
are only compatible when all the poles of H ( z ) are inside
the unit circle. This is summarized in the statement :
X (ω ) = H correct (ω ) H meas (ω ) X (ω )
= ∏ (1 − ck z −1 ) ∏ (1 − d )
M N
b0 M N
H meas ( z ) = ∑ bk z − k ∑ k
a z −k
k z −1
k =0 k =0 a0 1 1
∏ (1 − d k z ) ∏( k )
N M N M
a0
H correct ( z ) = ∑ ak z −k
∑ bk z −k
= −1
1 − c z −1
k =0 k =0 b0 1 1
∏( k )
M M
∑ bk z −k
b0
1 − c z −1
H (z) = k =0
= 1
∏( k )
N N
a0
∑ k
a
k =0
z −k
1 − d z −1
∏( k )
M M
∑ bk e − jω
b0
1 − c e − jω
H (z) = k =0
= 1
∏( k )
N N
a0
∑ k
a
k =0
e − jω
1 − d e − jω
+ ∑ ∡ (1 − c1e − jω ) − ∑ ∡ (1 − d k e − jω )
M N
b
Phase =∡ 0
a0 k =1 k =1
M N
Group Delay = ∑ grd 1 − c1e
k =1
− jω
− ∑ grd 1 − d1e − jω
k =1
-10
-20
-30
Gain
0 1 2 3 4 5 6 7
-1
-2
Phase
0 1 2 3 4 5 6 7
10
-10
Group Delay
-20
0 1 2 3 4 5 6 7
-10
-20
-30
Gain
0 1 2 3 4 5 6 7
-2
-4
-6
-8
Phase
0 1 2 3 4 5 6 7
30
20
10
Group Delay
0
0 1 2 3 4 5 6 7
θ =π , r = 1 .95 , r = 1 .9 , r = 1 .7 , r = 1 .5
Frequency Responses of LCCDE Systems (9)
Graphical Interpretation : Letting z 0 = re jθ and z (ω ) = e jω
we find that
jθ − jω z0 z (ω ) − z0
1 − re e = 1− =
z (ω ) z (ω )
1 − re jθ e − jω = z (ω ) − z 0
⇒
( e ) = ∡ ( z (ω ) − z 0 ) − ∡z (ω )
jθ − jω
∡ 1 − re
• The magnitude of 1 − re jθ e − jω is the length of the ve ctor
joining the zero/pole z 0 to the point z (ω ) on the unit circle
(length of blue line in the diagram below).
• The phase of 1 − re jθ e − jω is the difference between the
angle of the vector joining z 0 to z (ω ) and the angle of z (ω )
(the red arrow in the diagram below).
Frequency Responses of LCCDE Systems (10)
Graphical Interpretation (continued) :
z (ω )
Phase
z0
Gain
Frequency Responses of LCCDE Systems (11)
Frequency Response for Two Conjugate Poles : Poles and
zeros are often chosen to appear in conjugate pairs. This
forces the frequency response function to satisfy H ( −ω ) = H (ω )
which insures that the impulse response is real. Let z0 = re jθ and
1
H (z) = .
(1 − z z )(1 − z z )
0
−1
0
−1
40
20
-20
Gain
0 1 2 3 4 5 6 7
-2
-4
Phase
0 1 2 3 4 5 6 7
20
10
Group Delay
-10
0 1 2 3 4 5 6 7
θ = π 6, r = .95
Frequency Responses of LCCDE Systems (14)
Frequency Response for Two Conjugate Poles :
The separate contributions from the two poles are evident.
•
•
×
×
• ×
×
×
•
•
Topics
Frequency Response Characteristics
System Functions of LCCDE Systems
Frequency Responses of LCCDE Systems
Phase and Magnitude Interaction
Minimum-Phase Systems
General Linear Phase
Magnitude and Phase Interaction (1)
Frequency Response Magnitude : Given a system function H ( z ) ,
The squared magnitude of the frequency response is :
H (e ) = H ( e iω ) × H * ( e iω ) which only uses values of H ( z ) on
2
iω
the unit circle. This function can be exte nded to the ROC of the
system function by simply replacing the argument e iω with z :
H ( z ) = H ( z ) × H * ( z ) , but this isn't a good extension because
2
z
•
∏ (1 − c z ) ∏ (1 − d )
M N
b0
H (z) = k
−1
k z −1
a0 k =1 k =1
Then
* M
Hɶ ( z ) = 0* ∏ (1 − ck* z ) ∏ (1 − d z )
N
b *
k
a0 k =1 k =1
2
b0 M
(1 − ck z )(1 − ck z ) ∏ (1 − d k z )(1 − d k z )
N
C (z) = ∏
a0 k =1
−1 *
k =1
−1 *
• All the zeros (poles) of C ( z ) come in pairs with one zero (pole)
of each pair from H ( z ) and the other from Hɶ ( z ) .
• Each pair is comprised of a complex number together
with its conjugate - reciprocal: ( ck ,1 ck* ) or ( d k ,1 d k* ) .
Magnitude and Phase Interaction (4)
Frequency Response Magnitude (continued) : The figure
shows a distribution of poles and zeros for C ( z ) . Blue and red
indicate assignment to H ( z ) and Hɶ ( z ) . Other assignments
could be made by swapping colors for some of the pairs.
•
×
× × ×
•
•
•
Magnitude and Phase Interaction (5)
All - pass Systems : An all - pass system has a frequency response
with unit magnitude for all frequencies. Given any system
function H ( z ) that has no zeros or poles on the unit circle, and
a ny integer K , an all - pass system can be formed by setting
K H (z)
ɶ
H ap ( z ) = z
H (z)
E.g., if H ( z ) = 1 − az −1 so that Hɶ ( z ) = 1 − a * z , and if K = -1 then :
−1
1 − a *
z z − a *
H ap ( z ) = z −1 −1
=
1 − az 1 − az −1
This is the simplest all - pass system (clearly there are no
a ll - pass systems with only a single zero or a single pole).
More complicated all - pass systems are formed by multiplying
(cascading) together several of these simple terms.
Magnitude and Phase Interaction (6)
All - pass System s (continued) : For instance,
N
z −1 − ak*
H ap ( z ) = ∏ −1
k =1 1 − ak z
×
× •
•
Magnitude and Phase Interaction (7)
All - pass Systems (continued) : If the impulse response and
recursion coefficients for the system are to be real then any
non - real zero/pole pairs must occur together with th eir
conjugates resulting in a general expansion is of the form :
Mr
H ap ( z ) = A∏
−1
z − dk Mc
( z − e )( z − e )
−1 * −1
∏ (1 − e z )(1 − e z )
k k
−1
k =1 1 − d k z k =1 k
−1 *
k
−1
Since the group delay is positive for a < 1 , in that case, the
phase must be consistently decreasing. This will remain true
for more complicated all - pass systems form ed by cascading
together simple terms of this type.
Magnitude and Phase Interaction (8)
All - pass Systems (continued) : Phase and group delay plots
z −1 − a *
−1 (
of the all - pass factor : , a = − r : i.e. negative real ) .
1 − az
2
1.5
0.5
Gain
0
0 1 2 3 4 5 6 7
-5
Phase
-10
0 1 2 3 4 5 6 7
40
20
Group Delay
-20
0 1 2 3 4 5 6 7
θ =π , r = 1 .95 , r = 1 .9 , r = 1 .7 , r = 1 .5
Topics
Frequency Response Characteristics
System Functions of LCCDE Systems
Frequency Responses of LCCDE Systems
Phase and Magnitude Interaction
Minimum-Phase Systems
General Linear Phase
Minimum Phase Systems (1)
A rational system whose zeros and poles are all inside the
unit circle is called a minimum - phase system. These systems
are stable and causal, and have inverses that are also stable
and causal.
∑ h [k ] = ∑ q [ k ] − aq [ k − 1]
2 2
k =0 k =0
n n
∑ g [k ] = ∑ q [ k − 1] − a q [ k ]
2 * 2
k =0 k =0
Minimum Phase Systems (7)
Minimum Energy - Delay Property ( continued) : In particular,
the difference in partial energies :
n n
∑ h [k ] − ∑ g [k ]
2 2
k =0 k =0
n
= ∑ q [ k ] + a q [ k − 1] − 2 Re aq * [ k ] q [ k − 1]
2 2 2
k =0
n
− ∑ a q [ k ] + q [ k − 1] − 2 Re aq * [ k ] q [ k − 1]
2 2 2
k =0
( ) q [k ] − (1 − a ) q [ k − 1] = (1 − a ) q [n ]
n
= ∑ 1− a
2 2 2
≥0
2 2 2
k =0
z −1 − a *
This shows that G ( z ) = H ( z ) −1
has an impulse response
1 − az
with partial energies that grow more slowly the energies of the
impules response for H ( z ) .
Minimum Phase Systems (7)
Minimum Energy - Delay Property (continued) : Thus, an
exchange of a zero of H ( z ) that is inside the unit circle
with it's conjugate reciprocal will cause the partial energies
of the resultin g impulse respo nse to grow more slowly . This
rate of energy growth is called energy - lag, and using this
terminology we can express the minimization principle :
• H min ( z ) has the smallest ene rgy - lag for all ω of all syste ms
with the same frequency response magnitude as H ( z ) that
are causal, stable, and have ∡ H ( e j 0 ) = 0.
Topics
Frequency Response Characteristics
System Functions of LCCDE Systems
Frequency Responses of LCCDE Systems
Phase and Magnitude Interaction
Minimum-Phase Systems
General Linear Phase
General Linear Phase (1)
Ideal frequency - selective filters have 0 phase, but this is
impossible to realize with causal filters (why?). An alternative
that is nearly as good is a phase factor of the form e -jαω ,
which is linear in ω , since this corresponds to a simple shift
of the (harmonically interpolated) signal. However, after
separating out this phase factor from the frequency response
function it is convenient to allow the remaining terms to
include a constant phase term e jβ and also sign changes.
Thus, the form of a general linear phas e frequency respo nse
is :
H (z) = A(z)e ( whe re A ( z ) is real
j β -αω )
General Linear Phase (2)
The objectives for our study of GLP responses are :
1. Give symmetry conditions that are sufficient
(though not necessary) to insure that H ( z ) has
general linear phase.
2. Identify how these symmetry conditions are met
by the placement of zeros in causal FIR system.
The causality requirement in item 2 is a natural restriction
for realizable filters. But causality automatically implies
the FIR restriction because causal IIR responses cannot
satisfy the reflection symmetries determined in item 1.
General Linear Phase (3)
Symmetry conditions that imply GLP fo r rea l h [ n ] :
I. h [ n ] is symmetric abo ut n0 : h [ n0 − k ] = h [ n0 + k ]
∞ ∞
H (ω ) = h [n]e h [ n0 + k ] e
− jω ( n0 + k )
∑
k =−∞
− jω n
= ∑
k =−∞
∞
jω k − jω n0
= h [ n0 ] + ∑ h [ n0 + k ] ( e − jω k
+ e ) e
k =1
Real
( )
∞
∞
H (ω ) = ∑ h [n
k = −∞
0 − k ]e
− jω ( n0 − k )
= ∑ h [ n0 − k ] e jω k + e − jω ( k +1) e − jω n0
k =1
∞
= ∑ h [ n0 − k ] e
k =1
(
jω ( k + 12 )
+e
e )
− jω ( k + 12 ) − jω ( n0 + 12 )
Real
General Linear Phase (4)
Symmetry conditions that imply GLP for real h [ n ] ( con tinued) :
III. h [ n ] is anti - symm etric about n0 : h [ n0 − k ] = -h [ n0 + k ]
∞ ∞
H (ω ) = h [ n ] e − jω n = h [ n0 + k ] e
− jω ( n0 + k )
∑
k =−∞
∑
k =−∞
∞
= ∑ h [ n0 + k ] ( e − jω k − e jω k ) e − jω n0
k =1
Imaginary
( )
∞
∞
H (ω ) = ∑ h [n
k = −∞
0 − k ]e
− jω ( n0 − k )
= ∑ h [ n0 − k ] e jω k − e − jω ( k +1) e − jω n0
k =1
∞
= ∑ h [ n0 − k ] e
k =1
(
jω ( k + 12 )
−e
e )
− jω ( k + 12 ) − jω ( n0 + 12 )
Imaginary
General Linear Phase (5)
Symmetry conditions that imply GLP for real h [ n ] (continued) :
Type I
n0
Type II
n0
Type III
n0
Type IV
n0
General Linear Phase (6)
Zero Locations for FIR Filters that imply GLP :
If h [ n ] is a real, causal FIR of length M with h [ 0 ] ≠ 0 then
H (z) = h [0 ] + h [1] z −1 + ⋯ + h [ M ] z − M
= z − M ( h [ 0 ] z M + h [1] z M −1 + ⋯ + h [ M ] ) = z −M
P (z)
• If h [ n ] has a half integer symmetry then M must be odd
• If h [ n ] has an integer symmetry then M must be even
• If h [ n ] is symmetric : P ( z −1 ) = z−M P ( z )
• If h [ n ] is anti - symmetric : P ( z −1 ) = − z − M P ( z )
• For all symmetries : if a ≠ 0 is a zero then so 1 a .
• Since h [ n ] is a real, complex zeros are in conjugate pairs.
• If h [ n ] is anti - symmetric and M is even then − 1 is a zero.
• If h [ n ] is symmetric and M is odd then − 1 is a zero.
General Linear Phase (7)
Example : The zero plot below shows the zeros groupings that
that will insure general linear phase.
• Complex zeros must appear in quadruples : a ,1 a, a * ,1 a
• General real zeros must appear in pairs : a ,1 a
• The zero 1 can appear by itself and must appear if P is anti - symmetric
• The zero -1 can appear by itself, and must appear if M is odd and P is
symmetric
•
•
•
• • • •
•
•
•
Summary
Using discrete sequences to approximate
continuous signals is fundamental to DSP.
Continuous effects such as (distortion,
transmission, etc.) are often modeled as
discrete systems
Some operations on discrete sequences (in
particular, changes in sample rate) rely on
associating the sequences with continuous
signals.