Professional Documents
Culture Documents
MTN Nigeria
Cellcite Solutions
MTN Nigeria
TABLE OF CONTENTS
1 SECTION 1: Introduction.....3 1.1Best Performing Network per KPI...4 1.2 Drive Test Route...5 2 SECTION 2: Voice Call....................6 2.1 Voice Accessibility6 2.2 Call Drop Rate...7 2.3 Block Error Rate8 2.4 Soft Handover Success Rate..9 3 SECTION 3: Coverage/Video........................11 3.1 Call Setup Success Rate...11 3.2 Call Drop Rate.12 3.3 Soft Handover Success Rate13 3.4 Network Coverage..........................................................................................15 4 SECTION 4: SMS...22 4.1 SMS Success Rate..22 4.2 Some Findings and recommendation..22 5. SECTION 5: Appendices24 5.1 Key Performance Indicator General Descriptions..24 5.2 List of Abbreviations29
Cellcite Solutions
MTN Nigeria
1 SECTION INTRODUCTION The main purpose of conducting a competitive network benchmarking in Lekki phase 1 was to determine the quality of UMTS voice provided by MTN Nigeria when compare with other network service providers in the area. Benchmarking is a technique, in which a company accurately measures its performance against that of best in a class of companies, determines how those companies achieved their performance levels and uses the information to improve its own performance and excel the competitors. Subjects that can be benchmarked include strategies, operations and processes. In telecom sector, the basic theme to do benchmarking is to compare your network with its competitors by using different parameters in the big cities of the country. From benchmarking, companies can also check the health of its network. This report contains five (5) major sections in which many of them are divided into subsections. Section 1 is an introduction of the report which presents an overview of the tests performed, observations taken and the results generated. It has an executive summary which is a comprehensive information regarding the network health and the services and KPIs monitored over a decided drive route. Section 2 has the details regarding the network Coverage/Voice Calls. Section 3 has the details regarding Video Calls. Section 4 shows SMS analysis. Section 5 contains a list of Appendices. Equipments Used TEMS Investigation, Version 12.0.1 (with Dongle) HP Laptop, GPS Receiver: 2 Sets of Mobiles
Cellcite Solutions
MTN Nigeria
Item No. 1 2 3 4 5 6 7 8 9 10 11 12 13
Voice Call KPIs Call Setup Success Rate (CSSR) Call Drop Rate (CDR) Call Success Rate (CSR) DL BLER <=2% Soft Handover Success Rate (SHO SR) Video Call KPIs Call Setup Success Rate (CSSR) Call Drop Rate (CDR) Call Success Rate (CSR) DL BLER <=2% Soft Handover Success Rate (SHO SR) Coverage KPIs RSCP above -95 dBm EcNo above -12 dB UETxPower below 0 dBm
MTN 100% 0% 100% 81.84% 100% 100% 0% 100% 86.01 99.46% 95.25% 84.35% 92.37%
Airtel 66.67% 50% 50% 75.8% 97.42% 100% 6.35% 73.65% 89.73% 97.08% 99.9% 97.29% 94.46%
Cellcite Solutions
MTN Nigeria
Note: The Drive test route is not plotted yet because of unavailability of the route plan.
Figure 1:
Cellcite Solutions
MTN Nigeria
Call Attempts Successful RRC Connection Setups Successful Call Setups Failed Call Setups CS Call Re-establishment fail RRC Connection Setup Success rate CS Call Setup Success rate
1 1 1 0 0 100% 100%
4 2
1 0 100% 66.7%
Cellcite Solutions
MTN Nigeria
CSSR
100% 80% 60% 40% 20% 0% MTN
Figure 2 : CSSR (Voice)
100% 66.70%
CSSR
AIRTEL
As seen in the chart, the accessibility statistics show that MTN is better than Airtel in the tested area.
Table 3: MTN Retainability Stats Retainability Results - CS Number of Drop Call Drop Call Rate UE Tx Power (Max) UE Tx Power (Mean) UE Tx Power (Min) DL BLER (Average) DL BLER, 95 Percentile
th
Table 4: Airtel Retainability stats Retainability Results - CS Number of Drop Call Drop Call Rate UE Tx Power (Max) UE Tx Power (Mean) UE Tx Power (Min) DL BLER (Average) DL BLER, 95 Percentile
th
Cellcite Solutions
MTN Nigeria
CDR
50% 40% 30% 20% 10% 0% 0% MTN
Figure 3: Voice Call Drop Rate
50%
CDR
AIRTEL
MTN drop call rate is better than that of Airtel in the driven area as can be seen in the chart above.
82.93
75.8
BLER<2%
84.00% 82.00% 80.00% 78.00% 76.00% 74.00% 72.00% MTN AITEL
Figure 4: BLER<2% (Voice)
82.93%
BLER<2%
75.80%
Cellcite Solutions
MTN Nigeria
Table 5 : MTN SHO stats SHO Results - CS # e1a # e1b # e1c # e1d # Unknown Total HO Events # Measurement Reports # Active Set Updates # Active Set Update Completes # Measurement Control SHO Success Rate Active Set Update Completion Rate
Table 6: Airtel SHO Stats SHO Results -CS # e1a # e1b # e1c # e1d # Unknown Total HO Events # Measurement Reports # Active Set Updates # Active Set Update Completes # Measurement Control SHO Success Rate ActiveSet Update Completion Rate
Cellcite Solutions
MTN Nigeria
SHO SR
100% 100% 99% 99% 98% 98% 97% 97% 96%
100%
SHO SR
97.42%
MTN
AIRTEL
Figure 6: Voice SHO Success Rate
MTN network has 100% while Airtel has 97.42% in the test area. MTN performs better than Airtel in term of SHO success rate as seen in the chart above.
3 SECTION 3: VIDEO
3.1 Call Setup Success Rate Video
13 2
9 0 100%
10
Cellcite Solutions
MTN Nigeria
75 7
56 0 100%
CSSR
100% 80% 60% 40% 20% 0% MTN AITEL
Figure 7 : CSSR (Video)
100%
100.00%
CSSR
From the chart above, it shows that both MTN and Airtel perform excellently well in term of Call Setup Success Rate. 3.2 Call Drop Rate
Table 9: MTN Video Retainability Stats Retainability Results - CS Number of Drop Call Drop Call Rate UE Tx Power (Max) UE Tx Power (Mean) UE Tx Power (Min) 0 0% 20.2 9.5 -45.4
11
Cellcite Solutions
MTN Nigeria
479 30.3
Retainability Results - CS Number of Drop Call Drop Call Rate UE Tx Power (Max) UE Tx Power (Mean) UE Tx Power (Min) DL BLER (Average) DL BLER, 95th Percentile 4 6.35% 14.2 -17.17 -35 263 21.3
CDR
7% 6% 5% 4% 3% 2% 1% 0% 0% MTN AITEL
Figure 8: Call Drop Rate (Video)
6.35%
CDR
CS Video call drop rate of MTN network is better in comparison with Airtel as seen in the Call Drop Rate above.
86 79 20 185 229
12
Cellcite Solutions
MTN Nigeria
# Active Set Updates # Active Set Update Completes # Measurement Control SHO Success Rate Active Set Update Completion Rate
Table 12: Airtel Video SHO stats SHO Results - CS # e1a # e1b # e1c # e1d # Unknown Total HO Events # Measurement Reports # Active Set Updates # Active Set Update Completes # Measurement Control SHO Success Rate Active Set Update Completion Rate
SHO SR
99.50% 99.00% 98.50% 98.00% 97.50% 97.00% 96.50% 96.00% 95.50%
99.46%
SHO SR
97.07%
MTN
AIRTEL
MTN network is having 99.46% while Airtel has 97.04% in the tested area which shows that MTN performs better.
MTN 12 12
Airtel 63 7
13
Cellcite Solutions
MTN Nigeria
Metrics
Call Setup Success Rate Call Drop Rate # SHO Events Average BLER Call Completion Success Rate
BLER<2%
90.00% 89.00% 88.00% 87.00% 86.00% 85.00% 84.00% MTN AIRTEL 86.01% 89.73% BLER<2%
Airtel is performing better in term of Block Error Rate <2% in comparison with MTN as seen in the chart above.
14
Cellcite Solutions
MTN Nigeria
Percentage of RSCP>-95dBm
100.00% 99.00% 98.00% 97.00% 96.00% 95.00% 94.00% 93.00% 92.00% MTN AIRTEL 95.25% 99.90% Percentage of RSCP>95dBm
Cellcite Solutions
MTN Nigeria
As seen in the plots Airtel network has better coverage in the tested area, 99.9% of coverage route is covered by Airtel WCDMA signal with RSCP above -95dBm in comparison to 95.25% coverage of MTN WCDMA signal.
16
Cellcite Solutions
MTN Nigeria
17
Cellcite Solutions
MTN Nigeria
The signal quality (Ec/No) of Airtel is also better than MTN in the tested area. At driven routes Airtel network has 97.29% samples with Ec/No above -12 dB, while MTN has 84.35% respectively.
18
Cellcite Solutions
MTN Nigeria
UE Transmission Power
UE Tx Power <0dBm
94.50% 94.00% 93.50% 93.00% 92.50% 92.00% 91.50% 91.00% MTN AIRTEL 92.37% 94.46% UE Tx Power <0dBm
19
Cellcite Solutions
MTN Nigeria
As seen from UE Tx Power data, both Airtel and MTN are performing well in term of UE Tx Power. The UE uses a bit less power while connected to both Airtel WCDMA network and MTN WCDMA network. Though, Airtel is approximately 2% better than MTN (i.e Airtel is having 94.46% in comparison with MTN that is having 92.37%.
20
Cellcite Solutions
MTN Nigeria
4 SECTION 4: SMS
4.1 SMS Success Rate
Table 14: SMS success rate SMS SMS Success Rate MTN Airtel 100.0%
100.00%
4.3 Some Findings and Recommendations MTN needs to lower down the level of pollution by adding more sites if possible, to improve the network performance in the area. This will also improve the Block Error rate and coverage which is not as good as Airtel network in the area.
21
Cellcite Solutions
MTN Nigeria
5 SECTION 5: Appendices
5.1 Key Performance Indicator General Descriptions Call Setup Success Rate (CSSR) = number of successful call setups / number of call setup attempts
The Call Setup Success Rate Speech (CSR Speech) is defined as the ratio of successful call setups, divided by the total number of call setup attempts for speech calls. It is the probability of successfully initiating a speech call from an end user perspective. CSSR Speech measured by Drive tests, presents the proportion of speech calls which are successfully setup by the initiating party. Calculated with Counter Statistics, CSR Speech is a product of the RRC Setup Success Rate and the RAB Setup Success Rate for Speech within a cell or RNC.
This formula indicates the success rate of RAB establishments for Speech calls. Note that the total number of attempts of RAB establishments is decreased by the number of attempts outgoing via interRAT handover to GSM due to capacity reasons. The pmNoRab EstablishAttemptSpeech counter is increased just after successful RAB Speech Mapping, when a RANAP RAB Assignment Request message is received from the CN with Speech RABs to be setup or modified, while pmNoRabEstablishSuccessSpeech is increased after successful RAB Speech Establishment, after sending the RANAP RAB Assignment Response message to the CN. Both counters will only be incremented in the SRNC for the Best Cell. The pmNoDirRetryAttcounter is triggered when sending Relocation required message (after Directed Retry to GSM was initiated). The counter is stepped for the cell where the RRC connection was established and will only be incremented in the SRNC. This KPI can be computed on a per RNC basis as well as a per cell basis. When computing the RNC result, individual cell counters should be summed on a RNC basis before applying KPI calculation. This is in contrast to applying the KPI equation to each cell and then taking an average across the RNC. The latter can give poor performances. This formula can give some strange fluctuation about percentage values if calculated on cell level.
22
Cellcite Solutions
MTN Nigeria
This behaviour has not been observed on RNC level. The KPI is useful to identify cells which exhibit poor RAB Speech establishment.
NOTE:
This formula represents the percentage of successful RRC Connection Requests over the total number of RRC Connection Requests decreased by the number of diversions due to the Load Sharing feature during the establishments of RRC Connections, so that it is not counted as access failure on WCDMA RAN. As soon as an RRC Connection Request message is received by RNC from UE for any Establishment Cause, pmTotNoRrcConnectReq counter is triggered and if UE has selected anothercell (inter-frequency), due to Load Sharing mechanism, pmNoLoadSharingRrcConn counter is stepped when the RRC message RRC Connection Reject is sent to the UE. Then RNC asks permission both from RNC Main Processor (MP) load control and admission control functions. Havingreceived permission to continue, allocates a DL channelization code and then starts to set up a connection towards the RBS. Also the UE is requested to setup an RRC connection with RRCConnection Setup message. Once NBAP Radio Link Restore Indication message and RRCConnection Setup Complete message have been received by RNC, then the RRC connection is considered to be successfully established. The counter pmTotNoRrcConnectReq Success is now increased.
Call Drop Rate (CDR) = number of drops / number successful call setups The Drop Call Rate Speech (DCR Speech) is defined as the ratio of abnormal call disconnections, divided by the total number of successful call setups for speech calls. It is the probability of successfully holding and terminating a call once it has been successfully initiated. DCR Speech measured by Drive tests, presents the proportion of speech calls which are successfully released after a specified holding time from when the call was successfully setup. Calculated with Counter Statistics, DCR Speech is the ratio of abnormally released calls divided by the sum of the abnormally and normal released Speech RABs within a cell or RNC.
23
Cellcite Solutions
MTN Nigeria
The KPI defines the drop rate for RAB Speech. It can be seen as the ratio between all the abnormal RAB Speech releases over the total number of all the RAB Speech releases The pmNoNormalRabReleaseSpeech and pmNoSystemRabReleaseSpeech counters are only increased due to a RANAP Iu Release Command or RAB Assignment Request message for RABSpeech respectively with release cause = Normal Release, Successful Relocation, Resource Optimisation Relocation, User Inactivity or release-due-to-UE-generated-signallingconnection release for the first one or anything except the previous causes for the second one. For UtranCell class these counters are incremented for the best cell in the Active Set in the SRNC. All the counters involved in the formula are available in two different MOs: UtranCell and IurLink. If an analysis of RAB Drop Rate at Iur level or RNC level is required (instead of Cell level), Its possible to collect data related to these counters with MO IurLink or UtranCell respectively, and in the latter case aggregate them on all the cells belonging to the RNC. Note also that, in case of activation of AMR, in this formula are present all the releases of AMR code RABs. When computing the RNC result, individual cell counters should be summed on a RNC basis before applying KPI calculation. This is in contrast to applying the KPI equation to each cell and then taking an average across the RNC. The latter can give incorrect results. Call Completion Success Rate (CSR) = CSSR * (1 - drop call rate)
The Call Completion Success Rate Speech (CSR Speech) is defined as the ratio of successful normal call disconnections, divided by the total number of call setup attempts for speech calls. It is the probability of successfully initiating, holding and then terminating a speech call from an end user perspective.
CSR Speech measured by Drive tests, presents proportion of speech calls which are successfully set up, held and released by the initiating party. Calculated with Counter Statistics, CSR Speech is a product of Accessibility [Call Setup Success Rate (CSSR) Speech] and Retainability [1 - Drop Call Rate (DCR) Speech] within a cell or RNC.
24
Cellcite Solutions
MTN Nigeria
Soft Handover Success Rate (SHO SR) = Number of successful SHOs/Number of SHO attempts
Inter System Handover Success Rate (IRAT HO SR) = Number of successful IRAT HOs / Number of IRAT HO attempts
The Inter Radio Access Technology Handover Success Rate for Speech (IRAT Speech) is defined as the ratio of successful handovers to GSM over the number of attempted handovers to GSM. It is the probability of successfully performing a handover from WCDMA to GSM and continuing the call without end user interruption.
25
Cellcite Solutions
MTN Nigeria
IRAT Speech Handovers can be measured either by Drive tests or Statistics data although due to difficulties in drive test collection, Statistics is recommended. In the case of a drive test, a normal drive within the coverage area may not have sufficient number of samples where IRAT handover is performed and it is recommended that a separate drive route along the borders of the coverage be covered. Calculated with Statistics, IRAT Speech is a ratio of the number of successful Handovers over the number of attempted handovers. The counters are only incremented if a GSM relation exists between the Target and the Source Cell where the Source cell is the Best Cell in the Active Set. This can be aggregated to Cell and RNC level
This KPI defines the percentage of successful non blind Inter Frequency Handovers for CS Speech, over the total number of non blind Inter Frequency Handover attempts for CS speech. The pmSuccNonBlindInterFreqHoCsSpeech12 Counter provides the number of successful nonblind outgoing inter-frequency handovers for RAB = Conversational speech. After Handover Evaluation has decided to initiate interfrequency handover for a CS speech RAB, the UE is ordered to move to a new frequency by sending an RRC Physical Channel Reconfiguration message. When a successful response, RRC Physical Channel Reconfiguration Complete is received from the UE, this counter is stepped. The counter is stepped for the best cell in the active set but only if that cell has a cell relation towards the target cell. If the best cell in the active set has no cell relation towards the target cell, the counter is not stepped. Note: In case of a multi-RAB combination, the counters corresponding to each type of RAB involved shall be incremented.
The pmAttNonBlindInterFreqHoCsSpeech12 provides the number of attempted non-blind outgoinginter-frequency handovers for RAB = Conversational speech After Handover Evaluation
26
Cellcite Solutions
MTN Nigeria
has decided to initiate inter frequency handover for a CS speech RAB, the UE is ordered to move to a new frequency by sending an RRC Physical Channel Reconfiguration message. This counter is stepped after that message is sent. The counter is stepped for the best cell in the active set but only if that cell has a cell relation towards the target cell. If the best cell in the active set has no cell relation towards the target cell, the counter is not stepped. Note1: The handover evaluation decision is based on measurements performed by the UE on the target frequency. Note2: In case of a multi-RAB combination, the counters corresponding to each type of RAB involved shall be incremented. This KPI can be computed on a per RNC basis as well as a per cell basis. When computing the RNC result, individual cell counters should be summed on a RNC basis before applying KPI calculation. This is in contrast to applying the KPI equation to each cell and then taking an average across the RNC. The latter can give incorrect results.
Compressed Mode Time = Time spent in compressed mode / Full calls duration time
VIDEO Call Setup Success Rate (CSSR) The Call Setup Success Rate CS64 (CSR CS64) is defined as the ratio of successful call setups, divided by the total number of call setup attempts for video calls. It is the probability of successfully initiating a video call from an end user perspective. CSSR CS64 measured by Drive tests, presents the proportion of video calls which are successfully setup by the initiating party. Calculated with Counter Statistics, CSSR CS64 is a product of the RRC Setup Success Rate and the RAB Setup Success Rate for Video within a cell or RNC.
Call Drop Rate (CDR) The Drop Call Rate CS64 (DCR CS64) is defined as the ratio of abnormal call disconnections, divided by the total number of successful call setups for CS64 (video) calls. It is the probability of successfully holding and terminating a video call once it has been successfully initiated. DCR CS64 measured by Drive tests, presents the proportion of video calls which are successfully released after a specified holding time from when the call was successfully setup. Calculated with Counter Statistics, DCR CS64 is the ratio of abnormally released calls divided by the sum of the abnormally and normal released calls for Video RABs within a cell or RNC.
27
Cellcite Solutions
MTN Nigeria
Call Completion Success Rate (CSR) The Call Completion Success Rate CS64 (CSR Video) is defined as the ratio of successful normal call disconnections, divided by the total number of call setup attempts for video calls. It is the probability of successfully initiating, holding and then terminating a video call from an end user perspective. CSR Video measured by Drive tests, presents proportion of speech calls which are successfully setup, held and released by the initiating party. Calculated with Counter Statistics, CSR Video is a product of Accessibility [Call Setup Success Rate (CSSR) Video] and Retainability [1 - Drop Call Rate (DCR) Video] within a cell or RNC.
The KPI defines the success rate for RL addition, defined for the source best cell in the active set. It is calculated as the rate between the sum of RL addition success for CS64 conversational RABs and the sum of RL addition attempts for CS64 conversational RABs. The pmRlAddSuccessBestCellCsConvers counter is increased when a new RL is attempted to be added to an active set for a conversational CS64 RAB. The counter is increased after a handover proposal has been received from the handover evaluation function or an RNSAP Radio Link Addition Request has been received, admission control has been granted, DL channelization code has been allocated for the new cell, RL Setup or RL Addition procedure is successfully completed with the RBS, the Active Set Update procedure is successfully completed with the UE, the
28
Cellcite Solutions
MTN Nigeria
necessary ATM resources have been set up between RBS and RNC, and the appropriate parameters are available. The pmRlAddAttemptsBestCellCsConvers counter is increased when a new RL is attempted to be added to an active set for conversational CS 64 RAB. The counter is increased after a handover proposal has been received from the handover evaluation function or an RNSAP Radio Link Addition Request has been received. This counter only monitors RLs for cells in the SRNC. If an RL is replaced in an active set, this counter is also stepped. This KPI can be computed on a per RNC basis as well as a per cell basis. When computing the RNC result, individual cell counters should be summed on a RNC basis before applying KPI calculation. This is in contrast to applying the KPI equation to each cell and then taking an average across the RNC. The latter can give incorrect results.
Key Performance Indicator Call Setup Success Rate Block Error Rate Soft Handover Received Signal Code Power Carrier- to- Noise Ratio User Equipment Transmitter
29