Chapter-4

Simulation Results

Channel equalization is a process of compensating the disruptive effects caused mainly by

Inter Symbol Interference in a band-limited channel and plays a vital role for enabling
higher data rate in digital communication. The development of new training algorithms,
structures and the selection of the design parameters for equalizers are active fields of
research which are exploiting the benefits of different signal processing techniques. Here in
our dissertation work for equalization we use the various adaptive algorithms like Least
Mean Square (LMS), Recursive Least Square (RLS), and Constant Modules Algorithms
(CMA) with 16-ary Quadrature amplitude modulation (QAM) and 16-ary Phase shift
keying (PSK) modulation technique and then compare the mean square error of all these
combinations of adaptive algorithms and modulation techniques. The simulation work has
been done on MATLAB -2008 Software.
To obtain the results we have create total number of 6 cases and they are described as follows

Case.1 : Quadrature amplitude modulation technique with 16-ary and LMS equalization.

Case.2 : Quadrature amplitude modulation technique with 16-ary and CMA equalization.

Case.3 : Quadrature amplitude modulation technique with 16-ary and RLS equalization.

Case.4 : Phase shift keying modulation technique with 16-ary and LMS equalization.

Case.5 : Phase shift keying modulation technique with 16-ary and CMA equalization.

Case.6 : Phase shift keying modulation technique with 16-ary and RLS equalization.

error output of the equalizer is stored in the workspace in the matlab and then calculates the mean
square error for first 50 terms. Here we find the complex error and this error is the difference
between desired output and actual output. We convert the complex error into mean square error.

Scatter plots before equalization and after equalization also showing here for all above mentioned
cases. By seeing the dust balls we can also conclude that which combination providing us the best
result
Fig.5.1. Block Diagram of QAM LMS linear equalizer and QAM CMA equalizer
Fig.5.2 Scatter plot of transmitted data when QAM modulation and LMS linear equalizer used

Fig.5.3 Scatter plot after equalization of data when QAM LMS linear equalizer used
 Table 5.1 Calculation of MSE for QAM Linear LMS

Real Error Imaginary

sqr(x) sqr (y) z
(x) Error (y)
0.5734 0.0719 0.3288 0.0052 0.5779
-0.8051 0.7043 0.6482 0.4961 1.0697
-0.7072 -0.5622 0.5002 0.3161 0.9035
0.0293 -0.3776 0.0009 0.1426 0.3788
-0.0201 -0.0359 0.0004 0.0013 0.0411
-0.0661 0.6226 0.0044 0.3877 0.6261
-0.2085 0.7278 0.0435 0.5297 0.7571
0.5359 -0.5346 0.2872 0.2858 0.7570
0.2765 0.1971 0.0765 0.0389 0.3396
0.2039 0.2158 0.0416 0.0466 0.2969
0.7368 -0.5994 0.5429 0.3593 0.9498
-0.7156 0.5707 0.5120 0.3257 0.9153
-0.1999 0.6365 0.0400 0.4051 0.6671
0.5421 0.5659 0.2939 0.3203 0.7837
0.0883 0.1345 0.0078 0.0181 0.1609
0.1351 0.5844 0.0183 0.3416 0.5999
-0.5604 0.5134 0.3141 0.2636 0.7600
-0.2072 0.4007 0.0429 0.1606 0.4511
0.1362 -0.7347 0.0185 0.5398 0.7472
-0.6369 -0.2181 0.4057 0.0476 0.6732
0.0698 0.2548 0.0049 0.0649 0.2642
0.2760 0.4999 0.0762 0.2499 0.5710
0.1866 -0.5486 0.0348 0.3009 0.5795
-0.5831 -0.6356 0.3400 0.4040 0.8625
-0.1203 -0.1733 0.0145 0.0300 0.2110
0.1692 0.5849 0.0286 0.3421 0.6089
-0.1456 -0.1477 0.0212 0.0218 0.2074
-0.0334 -0.0952 0.0011 0.0091 0.1009
0.5630 -0.2178 0.3170 0.0474 0.6037
0.5986 -0.6034 0.3583 0.3641 0.8500
0.6077 0.6368 0.3692 0.4055 0.8802
-0.5347 0.1752 0.2859 0.0307 0.5626
-0.2777 -0.1994 0.0771 0.0398 0.3419
0.0258 0.1138 0.0007 0.0130 0.1167
-0.1881 -0.6897 0.0354 0.4757 0.7149
0.0107 -0.0606 0.0001 0.0037 0.0616
0.1500 -0.1494 0.0225 0.0223 0.2117
0.4070 0.3171 0.1657 0.1005 0.5159
-0.1713 0.1441 0.0294 0.0208 0.2238
0.0273 -0.7734 0.0007 0.5982 0.7739
0.5329 0.5942 0.2840 0.3531 0.7982
-0.4633 -0.5803 0.2147 0.3368 0.7426
0.1948 -0.1497 0.0379 0.0224 0.2457
Mean square error 0.5707
 Fig.5.4 Scatter plot of transmitted data when QAM modulation and CMA algorithm used

Fig. 5.5 Scatter plot after equalization of data when QAM modulation and CMA algorithm used
 Table 5.2 Calculation of MSE for QAM CMA

Real Error (x) Imaginary Error (y) sqr(x) sqr (y) Mag. Of error

-0.2872 0.0844 0.0825 0.0071 0.2993

0.4392 0.4360 0.1929 0.1901 0.6189
0.2534 -0.0504 0.0642 0.0025 0.2583
-0.1390 0.0337 0.0193 0.0011 0.1430
-0.2104 0.2196 0.0442 0.0482 0.3041
0.2071 -0.2439 0.0429 0.0595 0.3200
0.3492 0.3645 0.1219 0.1328 0.5047
0.1643 -0.2144 0.0270 0.0460 0.2701
0.2370 0.0718 0.0562 0.0052 0.2476
0.2282 -0.0702 0.0521 0.0049 0.2388
0.0724 -0.0773 0.0052 0.0060 0.1059
-0.2546 0.0700 0.0648 0.0049 0.2641
0.2817 0.2501 0.0794 0.0625 0.3767
-0.1795 -0.1769 0.0322 0.0313 0.2520
0.3560 -0.3812 0.1267 0.1453 0.5216
0.0635 0.1875 0.0040 0.0352 0.1980
-0.2106 0.0731 0.0443 0.0053 0.2229
0.0466 0.1377 0.0022 0.0190 0.1454
0.0394 0.1077 0.0016 0.0116 0.1147
0.2138 0.2143 0.0457 0.0459 0.3027
0.1866 0.0672 0.0348 0.0045 0.1983
0.1826 -0.1839 0.0333 0.0338 0.2592
0.2736 -0.2694 0.0748 0.0726 0.3839
0.2117 -0.2062 0.0448 0.0425 0.2955
0.2347 0.0858 0.0551 0.0074 0.2499
0.2194 0.2243 0.0482 0.0503 0.3138
0.2761 0.2600 0.0762 0.0676 0.3792
-0.0637 -0.1934 0.0041 0.0374 0.2036
-0.3147 -0.3118 0.0990 0.0972 0.4430
0.0386 -0.1269 0.0015 0.0161 0.1327
0.2339 -0.0505 0.0547 0.0026 0.2393
0.2696 0.1694 0.0727 0.0287 0.3184
-0.0724 0.1942 0.0052 0.0377 0.2072
0.3421 -0.3732 0.1170 0.1393 0.5063
-0.3572 0.3499 0.1276 0.1225 0.5001
0.2087 0.2412 0.0436 0.0582 0.3190
-0.4174 -0.4144 0.1742 0.1717 0.5881
0.4298 -0.4142 0.1847 0.1716 0.5969
Mean square error 0.3040
Figure 5.6. Block Diagram QAM RLSand QAM RLS Adaptive equalizer
 Fig.5.7 Scatter plot of transmitted data when QAM RLS Adaptive equalizer used

Fig.5.8 Scatter plot after equalization of data when QAM RLS Adaptive equalizer used
 Table 5.3 Calculation of MSE for QAM RLS

Real Error (x) Imaginary Error (y) sqr(x) sqr (y) Mag. Of error

-1.0000 1.0000 1.0000 1.0000 1.4142

-0.0351 0.0281 0.0012 0.0008 0.0450
0.1136 0.7283 0.0129 0.5304 0.7371
-0.5817 0.1813 0.3384 0.0329 0.6093
0.1986 0.2570 0.0394 0.0660 0.3248
-0.6324 -0.1725 0.3999 0.0297 0.6555
0.2354 0.5947 0.0554 0.3537 0.6396
-0.3785 -0.1577 0.1433 0.0249 0.4101
-0.2519 -0.5624 0.0635 0.3163 0.6162
0.1958 0.5712 0.0383 0.3262 0.6038
0.6659 -0.1052 0.4434 0.0111 0.6742
0.0039 -0.0292 0.0000 0.0009 0.0294
0.1564 -0.0969 0.0245 0.0094 0.1840
-0.1739 0.2037 0.0302 0.0415 0.2678
-0.5919 -0.6036 0.3504 0.3644 0.8454
0.1765 0.5559 0.0312 0.3090 0.5833
0.2398 0.5772 0.0575 0.3332 0.6251
0.5501 0.1110 0.3026 0.0123 0.5612
-0.7102 0.6258 0.5044 0.3916 0.9465
-0.6887 -0.5544 0.4744 0.3073 0.8841
0.0625 -0.3784 0.0039 0.1432 0.3835
-0.0193 -0.0166 0.0004 0.0003 0.0255
-0.1103 0.6336 0.0122 0.4015 0.6432
-0.2218 0.6383 0.0492 0.4074 0.6757
0.5830 -0.6113 0.3398 0.3737 0.8447
0.2269 0.2125 0.0515 0.0451 0.3108
0.2782 0.1942 0.0774 0.0377 0.3393
0.6758 -0.5861 0.4567 0.3435 0.8945
-0.6685 0.5736 0.4469 0.3290 0.8808
-0.1908 0.6299 0.0364 0.3967 0.6581
0.5564 0.5954 0.3096 0.3545 0.8150
0.0771 0.1286 0.0059 0.0165 0.1499
0.1507 0.5978 0.0227 0.3573 0.6165
-0.5555 0.5339 0.3086 0.2851 0.7705
-0.2151 0.1979 0.0463 0.0392 0.2923
0.2041 -0.5825 0.0417 0.3393 0.6172
-0.6225 -0.2465 0.3875 0.0608 0.6696
0.1503 0.3059 0.0226 0.0935 0.3408
0.3112 0.5256 0.0968 0.2763 0.6108
0.2769 -0.5952 0.0767 0.3542 0.6564
-0.6363 -0.5389 0.4048 0.2905 0.8338
Mean square error 0.5679
Fig 9. Block Diagram of PSK LMS and PSK CMA Adaptive equalizer
Fig 10. Scatter plot of transmitted data when PSK modulation and LMS Linear algorithm used

Fig 11. Scatter plot after equalization of data when PSK LMS Linear algorithm used
 Table 5.4 Calculation of MSE for PSK Linear LMS

Real Error (x) Imaginary Error (y) sqr(x) sqr (y) Mag. of error

1.0000 0.0000 1.0000 0.0000 1.0000

-0.1595 0.3557 0.0254 0.1265 0.3898
0.0205 0.2078 0.0004 0.0432 0.2088
0.0385 -0.1794 0.0015 0.0322 0.1835
-0.0431 0.0490 0.0019 0.0024 0.0652
0.0891 -0.0140 0.0079 0.0002 0.0902
0.0034 -0.1637 0.0000 0.0268 0.1638
-0.0863 0.1038 0.0074 0.0108 0.1350
-0.0489 0.0047 0.0024 0.0000 0.0491
0.0241 -0.0327 0.0006 0.0011 0.0406
0.0033 -0.0040 0.0000 0.0000 0.0052
-0.0561 -0.0643 0.0031 0.0041 0.0853
0.0099 -0.0575 0.0001 0.0033 0.0584
0.0196 -0.0226 0.0004 0.0005 0.0299
0.0016 0.0014 0.0000 0.0000 0.0021
0.0053 -0.0099 0.0000 0.0001 0.0112
0.0097 -0.0077 0.0001 0.0001 0.0124
-0.0005 -0.0097 0.0000 0.0001 0.0097
-0.0053 -0.0014 0.0000 0.0000 0.0055
-0.0056 -0.0030 0.0000 0.0000 0.0063
0.0128 -0.0098 0.0002 0.0001 0.0161
0.0314 -0.0866 0.0010 0.0075 0.0921
-0.0432 -0.0354 0.0019 0.0013 0.0558
-0.0216 -0.0160 0.0005 0.0003 0.0269
-0.0039 0.0092 0.0000 0.0001 0.0100
0.0072 -0.0031 0.0001 0.0000 0.0079
0.0151 -0.0229 0.0002 0.0005 0.0274
0.0031 -0.0016 0.0000 0.0000 0.0035
-0.0096 -0.0026 0.0001 0.0000 0.0099
0.0042 0.0234 0.0000 0.0005 0.0238
-0.0054 0.0178 0.0000 0.0003 0.0186
-0.0587 0.0133 0.0034 0.0002 0.0602
0.0094 -0.0314 0.0001 0.0010 0.0328
0.0241 0.0026 0.0006 0.0000 0.0243
-0.0105 -0.0062 0.0001 0.0000 0.0121
0.0059 0.0002 0.0000 0.0000 0.0059
0.0064 0.0065 0.0000 0.0000 0.0092
-0.0057 -0.0028 0.0000 0.0000 0.0063
Mean square error 0.0641
Fig 12. Scatter plot of transmitted data when PSK modulation and CMA algorithm used

Fig 13 Scatter plot after equalization of data when PSK CMA algorithm used
 Table 5.5 Calculation of MSE for PSK CMA

Real Error (x) Imaginary Error (y) sqr(x) sqr (y) Mag. of error

0.0000 0.0000 0.0000 0.0000 0.0000

-0.0086 -0.0052 0.0001 0.0000 0.0101
0.0024 0.0120 0.0000 0.0001 0.0122
-0.0113 0.0075 0.0001 0.0001 0.0136
0.0043 0.0029 0.0000 0.0000 0.0051
-0.0165 0.0243 0.0003 0.0006 0.0294
0.0109 0.0165 0.0001 0.0003 0.0198
-0.0006 -0.0031 0.0000 0.0000 0.0031
-0.0007 -0.0010 0.0000 0.0000 0.0012
-0.0135 0.0201 0.0002 0.0004 0.0243
-0.0140 0.0095 0.0002 0.0001 0.0169
0.0066 0.0014 0.0000 0.0000 0.0067
0.0036 0.0023 0.0000 0.0000 0.0043
0.0031 0.0158 0.0000 0.0002 0.0161
-0.0043 0.0220 0.0000 0.0005 0.0225
0.0059 0.0012 0.0000 0.0000 0.0060
-0.0115 -0.0022 0.0001 0.0000 0.0117
0.0041 0.0027 0.0000 0.0000 0.0049
0.0076 0.0014 0.0001 0.0000 0.0077
0.0069 0.0014 0.0000 0.0000 0.0070
0.0025 0.0125 0.0000 0.0002 0.0127
-0.0077 0.0117 0.0001 0.0001 0.0140
0.0042 0.0009 0.0000 0.0000 0.0043
0.0004 0.0001 0.0000 0.0000 0.0004
0.0127 0.0024 0.0002 0.0000 0.0130
0.0053 -0.0079 0.0000 0.0001 0.0095
0.0023 0.0114 0.0000 0.0001 0.0117
0.0033 0.0163 0.0000 0.0003 0.0166
0.0227 -0.0043 0.0005 0.0000 0.0231
0.0005 -0.0022 0.0000 0.0000 0.0022
0.0004 0.0020 0.0000 0.0000 0.0021
-0.0037 0.0025 0.0000 0.0000 0.0045
0.0059 0.0039 0.0000 0.0000 0.0071
-0.0023 0.0115 0.0000 0.0001 0.0117
0.0050 0.0010 0.0000 0.0000 0.0051
0.0254 -0.0049 0.0006 0.0000 0.0259
0.0013 0.0009 0.0000 0.0000 0.0016
-0.0003 0.0014 0.0000 0.0000 0.0014
Mean square error 0.0104
Figure 14. Block Diagram PSK RLS Adaptive equalizer
 Fig 15. Scatter plot of transmitted data when PSK modulation and RLS algorithm used

Fig 16. Scatter plot after equalization of data when PSK modulation and RLS algorithm used
 Table 5.6 Calculation of MSE for PSK RLS

Imaginary Error
Real Error (x) sqr(x) sqr (y) Mag. of error
(y)

1.0000 0.0000 1.0000 0.0000 1.0000

0.1236 -0.1042 0.0153 0.0109 0.1617
-0.0548 -0.1987 0.0030 0.0395 0.2061
0.1971 0.1086 0.0388 0.0118 0.2251
0.0063 0.1117 0.0000 0.0125 0.1119
0.1172 -0.0887 0.0137 0.0079 0.1469
-0.1075 -0.2377 0.0115 0.0565 0.2609
0.0390 0.0541 0.0015 0.0029 0.0667
-0.0918 0.0377 0.0084 0.0014 0.0992
-0.0393 -0.0958 0.0015 0.0092 0.1035
-0.1033 -0.0017 0.0107 0.0000 0.1033
-0.1021 0.0784 0.0104 0.0061 0.1287
-0.0309 0.0233 0.0010 0.0005 0.0387
-0.1249 0.1730 0.0156 0.0299 0.2134
0.1217 -0.0375 0.0148 0.0014 0.1273
0.1409 0.2346 0.0199 0.0550 0.2736
-0.0066 0.0151 0.0000 0.0002 0.0165
0.0076 0.0327 0.0001 0.0011 0.0336
-0.0568 0.1186 0.0032 0.0141 0.1315
-0.0417 -0.0034 0.0017 0.0000 0.0419
0.1627 -0.0504 0.0265 0.0025 0.1704
0.1449 -0.2381 0.0210 0.0567 0.2787
0.0187 0.0334 0.0003 0.0011 0.0383
0.0277 -0.1428 0.0008 0.0204 0.1455
-0.0317 -0.0355 0.0010 0.0013 0.0476
-0.0520 0.0380 0.0027 0.0014 0.0644
-0.1423 0.2605 0.0203 0.0678 0.2968
-0.2087 -0.0560 0.0436 0.0031 0.2161
-0.1586 0.0187 0.0252 0.0003 0.1597
-0.0198 -0.1512 0.0004 0.0229 0.1525
0.1289 -0.0401 0.0166 0.0016 0.1350
-0.2002 0.0981 0.0401 0.0096 0.2229
-0.1797 0.0829 0.0323 0.0069 0.1979
-0.2108 0.1722 0.0444 0.0297 0.2722
0.1733 0.1301 0.0300 0.0169 0.2167
0.0730 -0.0125 0.0053 0.0002 0.0740
Mean square error 0.1756
Table 5.7 Comparison Table of Various Modulation and Adaptive Equalization Technique

S.NO Modulation Scheme Adaptive Equalization Mean Square Error

Scheme
1
Linear LMS 0.5707

2
QAM CMA 0.3040

3
RLS 0.5679

4
Linear LMS 0.0641

5 PSK
CMA 0.0104

6
RLS 0.1756

Here we can see the performance of various adaptive equalizers under various modulation schemes.
Here in our dissertation work we are using LMS, RLS and CMA algorithms and modulation
schemes are 16- QAM and 16-PSK. The measure of performance criteria is the Mean Square Error.

Here we can see the performance of various adaptive equalizers under various modulation
schemes. Here in our dissertation work we are using LMS, RLS and CMA algorithms and
modulation schemes are 16- QAM and 16-PSK. The measure of performance criteria is the
Mean Square Error

We can analyze by table 5.7 that in the case of QAM, CMA algorithm has least error i.e.
0.3040 and the Linear LMS equalizer has the highest error rate i.e. 0.5707

Similarly by table 5.7 that in the case of PSK, RLS algorithm has most error rate i.e. 0.1756
and the CMA equalizer has the least error rate i.e. 0.9386.

In comparison between both two modulation techniques the performance of PSK is better
than QAM.