SQM EOT V200R007 VoLTE Voice Experience Assurance Solution Project Acceptance Guide

SQM EOT V200R007 VoLTE Voice Experience Assurance Solution Project Acceptance
Guide INTERNAL
Product
SmartCare SQM EOT Product Version V200R007
Name
Security Intended
Internal -
Level Audience
Compiling Document
- -
Department Version
SQM EOT V200R007 VoLTE Voice Experience

Assurance Solution Project Acceptance Guide
Tian Lizhu (employee ID: Date

Prepared By 2016/03/10
00319747)
Yao Yuehai (employee ID: Date
Reviewed By 2016/03/11
00300049)
Approved By Date
Huawei Technologies CO., LTD.

All Rights Reserved
2017-07-15 Huawei confidential. No spreading without permission. Page 1 of 39

Guide INTERNAL
Contents
1 Overview.........................................................................................................................................6
1.1 Purpose...............................................................................................................................................................6
1.2 Intended Audience.............................................................................................................................................6
1.3 Acceptance Principle and Guide........................................................................................................................6
2 Acceptance Process........................................................................................................................7
2.1 Acceptance Process............................................................................................................................................7
2.1.2 Acceptance Pre-test or Pre-evaluation......................................................................................................7
2.1.3 Acceptance Application and Approval.....................................................................................................7
2.1.4 Acceptance Preparation............................................................................................................................7
2.1.5 Acceptance Data Collection & Acceptance Test......................................................................................8
2.1.6 Acceptance Report Output........................................................................................................................8
2.2 Acceptance Responsibility Matrix and Role......................................................................................................8
2.3 Acceptance Precautions.....................................................................................................................................9
3 Acceptance Contents and Methods............................................................................................9

3.1 VoLTE KQI/KPI Accuracy..............................................................................................................................10
3.2 KQI Monitoring...............................................................................................................................................11
3.3 KQI Demarcation.............................................................................................................................................15
3.3.1 VoLTE Accessibility KQI Demarcation.................................................................................................15
3.3.2 VoLTE Retainability KQI Demarcation.................................................................................................17
3.3.3 VoLTE Integrity KQI Demarcation........................................................................................................19
3.3.4 VoLTE Mobility KQI Demarcation........................................................................................................21
3.4 VVIP/VIP User Assurance...............................................................................................................................23
3.4.1 VVIP/VIP User Group Insight................................................................................................................23
3.4.2 VVIP/VIP User Group Analysis.............................................................................................................25
3.5 Service Quality Demarcation for Complaining Users.....................................................................................26
3.5.1 VoLTE Correlated xDR Query...............................................................................................................26
3.5.2 VoLTE Real-Time Session Trace............................................................................................................27
3.6 VoLTE Thematic Analysis...............................................................................................................................28
3.6.1 VoLTE Registration Analysis..................................................................................................................28
3.6.2 VoLTE Handover Analysis.....................................................................................................................29
3.6.3 VoLTE Device Analysis..........................................................................................................................30
3.7 Service Value Acceptance................................................................................................................................31
3.7.1 VoLTE KQI/KPI Monitoring and Demarcation......................................................................................31
3.7.2 VVIP/VIP User Assurance.....................................................................................................................33
3.7.3 Service Quality Demarcation for Complaining Users............................................................................34
3.7.4 Value Acceptance for VoLTE Thematic Analysis...................................................................................35

Guide INTERNAL
4 Acceptance Handover.................................................................................................................36
4.1 Service Document Handover...........................................................................................................................36
4.2 Acceptance Signature Form.............................................................................................................................36
5 Reference.......................................................................................................................................37
5.1 Reference Documents......................................................................................................................................37
5.2 Acronyms and Abbreviations...........................................................................................................................37

Guide INTERNAL
Cyber Security Redline Requirements

Huawei service quality management (SQM) services strictly comply with Huawei Product Cyber Security
Redline. This part describes requirements on data use and deletion during SQM services in compliance with
the Cyber Security Redline.
1. Requirements for customer data collection, storage, and use
Even for the purpose of network operation and service assurance, it is prohibited to collect the original
communication contents of end users, such as data of the voice service, short message service (SMS),
multimedia messaging service (MMS), fax, and data services.
Obtain customers' confirmation of the data content and authorization for data collection and
transferring before collecting data.
Obtain customers' written authorization before performing any maintenance operation. Do not
perform any operation that is not approved by customers.
Formal customer authorization documents must be properly filed. Prevent document loss or
damage caused by duty changes or improper management of the file safekeeping personnel.
Archive customer authorization documents sent by email.
Do not transfer data out of cyber security-sensitive countries.
When collecting a large amount of personal data (such as with SmartCare), use a non-Huawei HSM-
based encryption solution and transfer the encryption keys to the customer and have the customer sign
the transfer document. When collecting a small amount of personal data, anonymize the data.
2. Requirements for anonymization of customer network data
Anonymization is required when the processing of customer network data involves personal data
(privacy) during service delivery.
3. Requirements for remote access
Computers that have access to customers' networks must meet cyber security requirements of
customers' live networks, such as having antivirus software installed.
4. Requirements for data use and deletion
All data from cyber security-sensitive countries must not be transferred back to China, or stored on
servers located in China.
Use data only within the validity period of the authorization document, and permanently delete the
data as soon as the validity period expires.
Perform integrity check on all software and patches installed on customer networks and add this
requirement in the WBS.
Install non-Huawei security auditing software on the ingress and egress servers of the service delivery
platform in all areas.

Guide INTERNAL
Sensitive Words Using Guide

The following words might be very sensitive and conflict with laws & regulations in your regions. Please
be cautious to use them:
Very Annoyed Person (VAP), Very Important Person (VIP)
Signaling Trace
Signaling Back
User-level Index Monitoring
IMSI/IMEI/MSISDN/IP
DPI
User Behavior
GPS
User Signaling Monitoring
Tracking Area Code (TAC)
Call Detail Record (CHR)

Guide INTERNAL
1 Overview
1.1 Purpose
This document describes the acceptance contents, acceptance methods, delivery contents, and primary
deliverables of the VoLTE voice experience assurance solution for SQM EOT V200R007 service products,
helping standardize each delivery action. Additionally, this document clarifies acceptance objects and
criteria in each scenario and provides guidance for the frontline project acceptance team to better complete
service acceptance and facilitate payment collection.
1.2 Intended Audience

This document is intended for and provides guidance and reference for:
Service product delivery engineers
Service product sales personnel
Service product development engineers
1.3 Acceptance Principle and Guide

This section describes the acceptance principles of the VoLTE voice experience assurance solution. The
following are some common cases. They can be added or deleted according to the specific product.
5. Write acceptance criteria in the contracts.
This ensures contract-based final result acceptance by both parties and prevents losses caused by
misunderstanding during acceptance.
6. Relationship between the delivery quality and acceptance test contents
Ensure delivery quality in the whole acceptance process. Acceptance must be comprehensive because
simple acceptance may decrease delivery quality. Comprehensive acceptance also avoids customers'
mistrust of Huawei.
Reduce acceptance test contents while user quality requirements are met. Complicated acceptance may
increase costs.
Clarify delivery quality with users even though acceptance is simple, and provide specific delivery
results for users, including data and documents.
7. Users can provide a template.
The template provided by Huawei is for reference only. Use the acceptance template provided by users
if they have one. The template content must be reviewed by Huawei.
8. Acceptance contents
Acceptance is conducted based on contract contents, industry standards, product requirements
(including promotion), and customer satisfaction.
9. Acceptance test contents are classified into the basic package and extended package.
The basic package is used by default. Costs are increased if the extended package is used. In this case,
mark new test contents in different colors in the acceptance criterion template.
10. Conduct acceptance by phase/project.
Conduct acceptance on integrated services or long-period services by phase/project to facilitate
acceptance and payment collection.
11. Determine acceptance failure handling methods.

Guide INTERNAL
Provide specific handling suggestions (that need to be customized), for example, not handled, not
accepted after rectification, providing only a report, accepted after rectification, and penalized, on
acceptance failures.
2 Acceptance Process
2.1 Acceptance Process
The VoLTE voice experience assurance solution project is accepted in accordance with the contract and
acceptance plan. The acceptance plan and the project planning report list the test cases for acceptance,
acceptance plan, and other related descriptions. The specific acceptance is performed based on the
acceptance plan.
Figure 11.1 Standard service acceptance process
2.1.1 Acceptance Pre-test or Pre-evaluation

Before the formal acceptance, perform acceptance tests based on the acceptance plan without the
participation of customer's engineers, familiarize yourself with the acceptance methods and tools, and
identify and resolve problems that may occur during the formal acceptance.
If tests are not required, evaluate and review the deliverables based on the acceptance plan.
2.1.2 Acceptance Application and Approval

After the pre-test or pre-evaluation, the project delivery personnel apply to the customer for formal
acceptance. The customer needs to examine and approve Huawei's acceptance application within the
specified time.
2.1.3 Acceptance Preparation

After the customer agrees to accept the project, convene a meeting and ask the personnel responsible for
delivery to clarify the following issues to the customer and associated departments:

Guide INTERNAL
Acceptance test plan

Test tools (UEs for dialing tests), methods, and cases
Test resources, time, and responsibility division
Qualification standard (customized based on the contract)
Any operation on the network and network failures during the acceptance affect the acceptance results.
Therefore, during the acceptance preparation process, do not perform operations in the acceptance area.
Related customer departments are requested to implement network monitoring to ensure that the network is
running properly during the acceptance.
Acceptance tests are performed by Huawei, the customer, or a third party based on the contract
requirements. Designate the contact person in advance to facilitate the communication during the
acceptance.
2.1.4 Acceptance Data Collection & Acceptance Test

If acceptance tests are required, delivery engineers perform acceptance tests item by item with
customer's engineers based on acceptance cases, save test files, and record test results. The test results
need to be confirmed and signed by Huawei and customer's engineers.
If a problem occurs during the acceptance but it does not affect the network operation and main
indexes, and the customer determines that the acceptance is not affected, the problem is regarded as a
known issue and will be handled after the acceptance. Sign an acceptance memo and obtain the
acceptance certificate or report.
If a major issue occurs and the acceptance fails, clarify the time and perform acceptance tests after the
responsible party resolves the problem.
2.1.5 Acceptance Report Output

The acceptance director needs to:
Summarize the test records and other deliverables and output the acceptance test report.
Submit them to the customer for review upon review by the project manager and account manager.
Submit the acceptance report or acceptance signature form to the customer for signing and sealing
based on the acceptance plan.
If the acceptance does not require tests, submit the service deliverables to the customer, organize
review, and report the progress to the customer. In addition, submit the acceptance report or
acceptance signature form to the customer for signing and sealing based on the acceptance plan.
2.2 Acceptance Responsibility Matrix and Role

To ensure validity and reasonability of the acceptance tests and to obtain users' approval, the responsible
person should implement acceptance on the service result and assume the acceptance responsibility. The
responsible person includes users and Huawei or third parties. The responsible person must clarify
responsibilities in the contract signing phase and specific acceptance personnel before delivery, and provide
guidance for role and acceptance responsibility division.
Acceptance Acceptance Acceptance Acceptance

Preparation Implementation Support Review
Huawei: XXX Huawei: XXX China Mobile: China Mobile:

XX XX
China Mobile: XX Huawei: XXX Huawei: XXX China Mobile:
XX

Guide INTERNAL
2.3 Acceptance Precautions

If the pre-test and pre-evaluation do not cover all test items, select high-risk test cases and conduct
them. Reach an agreement with the customer before acceptance.
Communicate with related departments before acceptance to ensure that the network is running
properly and no risk exists during the acceptance.
For the report submitted to the customer, specify the reply time.
For the test item that fails, apply for a test again. For the test item that succeeds, apply for test
exemption during the next test.
3 Acceptance Contents and Methods

Acceptance is conducted based on contract contents, industry standards, product requirements (including
promotion), and customer satisfaction.
This document provides only how to accept platform functions. To accept deliverables, see the deliverable
output requirements in the service proposal. Use the deliverable template approved by both field engineers
and the customer as the deliverable standard for accepting deliverables.
The menu paths on WebUI pages vary depending on sites. Change menu paths to correct ones as required
when accepting WebUI functions.
No. Service Module Acceptance Method Description
1 VoLTE KQI/KPI Delivery acceptance VoLTE KQI/KPI accuracy check

accuracy report
2 KQI monitoring Platform function and VoLTE service quality monitoring
deliverable acceptance report
3 KQI demarcation Platform function and Call failure and drop demarcation
deliverable acceptance SLA: 80% within 2 hours/Ticket
4 VVIP/VIP user Platform function and MOS and one-way audio
assurance deliverable acceptance demarcation SLA: 70% within 2
hours/Ticket
5 Complaint user Platform function and
quality deliverable acceptance
demarcation
6 Thematic analysis Platform function and Thematic analysis reports
deliverable acceptance
- - - -

Guide INTERNAL
3.1 VoLTE KQI/KPI Accuracy

Acceptance Whether VoLTE KQIs/KPIs are correct
Item
Acceptance To enable that VoLTE functions are properly running, check the accuracy of basic data before
using such functions. The data accuracy check items contain registered services, call services,
Content
SMS, miscellaneous services, HSS transactions, Rx, S11, S5/S8, S1MME, Gx, Sv, voice
quality, and other service and interfaces. The check dimensions contain configuration data,
collection integrity, field integrity, field integrity, number backfilling success rate, correlation
accuracy, and KQI/KPI accuracy.
Prerequisites The SEQ Analyst system is running properly.
The software versions of the SEQ Analyst, PS probe, IMS probe, and CS probe meet the
requirements in the VoLTE KQI/KPI accuracy check guide.
The data connection network of the SEQ Analyst meets the requirements in the VoLTE
KQI/KPI accuracy check guide.
You have logged in to the SEQ Analyst WebUI and been authorized to enter the xDR
database and obtain the xDR tables.
Acceptance Procedure and Methods
See the acceptance content parts in the VoLTE KQI/KPI accuracy check guide.
Execution Result
See the acceptance content parts in the VoLTE KQI/KPI accuracy check guide.
Deliverable acceptance
Module Input Output Description
VoLTE VoLTE VoLTE If the KQI/KPI accuracy does not meet the
KQI/KPI KQI/KPI KQI/KPI requirement, provide the problem cause (data
accuracy accuracy check accuracy check collection fault, platform fault, and other
guide report causes) and solution.
Result Pass
Failed
Not Verified

Guide INTERNAL
3.2 KQI Monitoring

Guide INTERNAL
Acceptance Whether VoLTE KQI/KPI monitoring is available.

Item
Acceptance 1. VoLTE service quality KQI monitoring

Content
VoLTE service quality monitoring is to periodically monitor the VoLTE service quality using
the signaling- and user-plane KQIs based on the standard-interface signaling files on the SEQ
Analyst platform in a near-real-time manner. With this function, the SEQ Analyst displays the
total voice traffic volume and trend of each KQI in the specified areas (NE or administrative
regions), and service alarms generated based on configured customized alarm rules.
2. VoLTE network performance KPI monitoring
This function is to periodically monitor VoLTE network performance KPIs based on
IMS&CS and EPC single-interface signaling data from accessibility, retainability, mobility,
integrity, and other dimensions. In this way, network performance problems can be identified
in a timely manner, trace and push problem resolving
Huawei VoLTE network performance monitoring involves:
VoLTE network performance monitoring KPI customization, monitoring rule
customization, and monitoring report template customization
According to customer requirements, Huawei provides the recommended KPIs, definitions,
and calculation formulas related to network performance. In addition, Huawei also
customizes the thresholds, period, and rules for reporting KPI-related alarms. All the final
results must be approved by the operator.
VoLTE network performance monitoring and preliminary problem demarcation
Huawei provides periodic network performance monitoring and monitoring reports in the
specified period (day, week, and month). In addition, the SEQ Analyst analyzes the abnormal
KQIs/KPOIs, demarcates problems, and provides the demarcation results for the customer in
a timely manner. This facilitates further problem analysis and resolving.
VoLTE KQI list
Type No. KQI Name Description
Accessibility 1 Perceived Call Measured from the S1-U interface on

Completion the calling party side (Invite to 180
Rate Ringing).
2 E2E Measured from the S1-U interface on
Connection the calling party side (Invite to 180
Delay Ringing).
Retainability 3 Perceived Call Measured from the S1-U and Rx
Drop Rate interfaces (200 OK response ASR)
Integrity 4 Voice MOS Measured from the S1-U, Gm, and
Mw interfaces based on RTCP and
Emodel algorithm.
5 Voice one-way Measured from the S1-U, Gm, and Mw
audio interfaces based on RTCP and RTP.
VoLTE KPI list

Type No. KPI Description

Guide INTERNAL
Initial 1 Registration Registration success rate = Number of successful

phase Success Rate registrations/Number of registration requests x 100%
2 Registration Registration average delay
Delay
3 Third-party Third-party registration success rate = Number of
Registration successful third-party registrations/Number of
Success Rate successful third-party registration requests x 100%
4 PDN IMS network PDN connection successes/IMS network
Connection PDN connection requests x 100%
Establishment
Success Rate
Accessib 1 MO Call Number of VoLTE MO call answers/Number of MO
ility Completion call requests x 100%
Rate
2 MO Call Number of VoLTE MO call answers/Number of MO
Answered Rate call requests x 100%
3 MT Call Number of VoLTE MT call answers/Number of MT
Completion call requests x 100%
Rate
4 MT Call Number of VoLTE MT call answers/Number of MT
Answered Rate call requests x 100%
5 Dedicated VoLTE dedicated bearer setup successes/VoLTE
Bearer Success dedicated bearer setup requests x 100%
Rate
6 Dedicated VoLTE dedicated bearer update successes/VoLTE
Bearer dedicated bearer update requests x 100%
Modification
Success Rate
7 AF Session Number of successful AF session authorization
Authorization modifications/Number of modification requests for AF
Success Rate session authorizations
Authorization modifications/Number of modification requests for AF
Modification session authorizations
Success Rate
Authorization terminations/Number of modification requests for AF
Termination session authorizations
Success Rate
10 Success Rate of Number of successful AF session authorization
Abnormal AF abnormal terminations/Number of abnormal
Session termination requests for AF session authorizations
Termination

Guide INTERNAL
Mobility 1 SRVCC Number of successful SRVCC successes/Number of

Handover SRVCC handover requests x 100%
Success Rate
2 SRVCC SRVCC handover average delay
Handover
Delay
Integrity 1 One-Way Measured from the uplink, downlink, RTP, and RTCP
Audio dimensions.
2 Packet Loss
3 Jitter
4 Delay

The carrier to which the system network belongs has been configured under Settings >
Configuration Management > Operation Configuration > Home Network
Information Management > Local Carrier.
The NEs on the network to be monitored have been configured under Settings >
Information Management > NE.
The provinces, cities, eNodeBs, and ECGIs to be monitored have been configured under
Settings > Configuration Management > Operation Configuration > Home Network
Information Management > Location.
The dynamic KQI configuration package has been imported to the SEQ Analyst using the
metadata tool.
The fault tree package has been imported to the SEQ Analyst.
The VoLTE customized KQIs and customized alarms have been configured on the SEQ
Analyst.
You have logged in to the SEQ Analyst WebUI and been permitted to use VoLTE thematic
analysis and multi-dimension query.
1. Use the multi-dimension query module to query VoLTE KQIs/KPIs.

2. Obtain the alarms generated for abnormal VoLTE KQIs/KPIs by area and NE alarm type on the Service
Alarm Browsing page of the SEQ Analyst.
Execution Result
1. The KQIs, KPIs, and voice traffic volume of the VoLTE service can be queried from the time and space
dimensions on the customized Dashboard module.
2. The failure VoLTE KQI/KPI xDR drill and raw signaling query can be performed on the customized
module.
3. The alarm is generated for a VoLTE KQI/KPI less than its predefined threshold on the Service Alarm
Browsing page of the SEQ Analyst.

Guide INTERNAL
4. The alarms generated from the time and region dimensions are correctly displayed on the Service Alarm
Browsing page of the SEQ Analyst.
5. The alarm trigger delay meets the alarm delay requirements in the capability specification documents on
the Service Alarm Browsing page of the SEQ Analyst.
6. After SOC function module is enabled, the triggered city-dimension alarms can be automatically
demarcated so that problems can be preliminarily demarcated.
7. Deliverable acceptance
VoLTE service Report Customization Before delivering the VoLTE service quality
quality customization rules for VoLTE monitoring service, make an agreement on the
monitoring rules service quality number of the monitored KQIs/KPIs, KQI/KPI
monitoring reports formulas, measurement period, dimensions, and
thresholds.
Raw counters VoLTE service Provide the report as required by the customer.
quality monitoring The report contains daily, weekly, and monthly
report reports.
Result Pass
Failed
Not Verified

Guide INTERNAL
3.3 KQI Demarcation

3.3.1 VoLTE Accessibility KQI Demarcation
Acceptance Whether VoLTE accessibility KQI demarcation is available
Item
Acceptance The VoLTE perceived call success rate is demarcated from the following dimensions:
Content IMS: SBC/P-CSCF, S-CSCF, AS, HSS
EPC: MME, SGW/PGW
CS: MGCF, MSC
eRAN: ECI, eNB
Device: IMEI
User: IMSI, MSISDN

metadata tool.
The VoLTE accessibility KQIs have been configured on the SEQ Analyst.
1. Use the multi-dimension query module to query VoLTE accessibility KQIs/KPIs.

2. Go to the VoLTE thematic analysis module on the SEQ Analyst WebUI.
Execution Result
1. The KQIs related to the VoLTE perceived call success rate can be queried from the time and region
dimensions. The KQIs must contain the following accessibility correlation KQIs: VoLTE MO Call
Completion Rate, VoLTE MO Call Answered Rate, VoLTE MT Call Completion Rate, VoLTE MT Call
Answered Rate, VoLTE Dedicated Bearer Setup Success Rate, VoLTE Dedicated Bearer Modification
Success Rate, AF Session Authorization Success Rate, AF Session Authorization Modification Success
Rate, AF Session Authorization Termination Success Rate, Success Rate of Abnormal AF Session
Termination. Multi-dimension query supports the drilldown and raw signaling query of success rate KQIs,
and the comparison and change trend of delay KQIs/KPIs. The multi-dimension KQI/KPI query module can

Guide INTERNAL
provide the reports of VoLTE accessibility KQIs/KPIs based on dimension and storage requirements. In
addition, the module must ensure the accuracy and availability of reports.
2. The VoLTE thematic analysis module can display the change trend of the perceived call success rate from
the time and region dimensions and provide the failure cause category, failure cause analysis, xDR
drilldown, and raw signaling query functions.
3. By correlating and analyzing the VoLTE perceived call success rate, the VoLTE thematic analysis module
can demarcate the problems of the VoLTE perceived call success rate to the following sides: wireless (cells
to be optimized must be provided), core network (NEs to be optimized must be provided), data (the
problem causes must be analyzed on both data and NE sides and configuration data modification
suggestions must be provided, device (device vendors, modules, types, and symptoms must be provided.
The optimization direction and optimization suggestions must be provided for various failure scenarios in
order to support the analysis and optimization of VoLTE accessibility KQIs.
VoLTE service VoLTE accessibility Provide the report as required by the

quality demarcation KQI demarcation customer. The report contains daily,
VoLTE guide report weekly, and monthly reports.
accessibility
demarcation VoLTE accessibility Determine the content and format of the
Raw counters KQI demarcation demarcation report based on customer
report requirements and project conditions.
Result Pass
Failed
Not Verified

Guide INTERNAL
3.3.2 VoLTE Retainability KQI Demarcation

Acceptance Whether VoLTE retainability KQI demarcation is available
Item
Acceptance The VoLTE perceived call connection rate is demarcated from the following dimensions:
Content eRAN: ECI
Device: IMEI

The provinces, cities, eNodeBs, and ECGIs to be monitored have been configured
under Settings > Configuration Management > Operation Configuration > Home
Network Information Management > Location.
The dynamic KQI configuration package has been imported to the SEQ Analyst using
the metadata tool.
The VoLTE retainability KQIs have been configured on the SEQ Analyst.
You have logged in to the SEQ Analyst WebUI and been permitted to use VoLTE
thematic analysis and multi-dimension query.
1. Use the multi-dimension query module to query VoLTE retainability KQIs/KPIs.


Guide INTERNAL
Execution Result
3. The KQIs related to the VoLTE call drop success rate can be queried from the time and region
dimensions. The KQIs must contain the following retainability correlation KQIs: VoLTE Call Drop Rate,
SRVCC Handover Success Rate, Intra-LTE X2 Handover Success Rate, Intra-LTE S1 Handover Success
Rate, Intra-LTE S1 Outgoing Handover Success Rate, and Intra-LTE S1 Incoming Handover Success
Rate. Multi-dimension query supports the drilldown and raw signaling query of success rate KQIs.
6. The multi-dimension KQI/KPI query module can provide the reports of VoLTE retainability KQIs/KPIs
based on dimension and storage requirements. In addition, the module must ensure the accuracy and
availability of reports.
7. The VoLTE thematic analysis module can display the change trend of the perceived call drop rate from
the time and region dimensions and provide the failure cause category, failure cause analysis, xDR
drilldown, and raw signaling query functions.
8. By correlating and analyzing the VoLTE perceived call drop rate, the VoLTE thematic analysis module
can demarcate the problems of the VoLTE perceived call drop rate to the following sides: wireless (cells
order to support the analysis and optimization of VoLTE retainability KQIs.
VoLTE service VoLTE retainability Provide the report as required by the

VoLTE guide report weekly, and monthly reports.
retainability
demarcation VoLTE retainability Determine the content and format of the
Result Pass
Failed
Not Verified

Guide INTERNAL
3.3.3 VoLTE Integrity KQI Demarcation

Acceptance Whether VoLTE integrity KQI demarcation is available
Item
Acceptance The VoLTE voice MOS and one-way audio are demarcated from the following dimensions:
Content eRAN: ECI (the S1-U must be collected)
EPC (the Gm must be collected)
IMS (the Mw must be collected)

metadata tool.
The VoLTE integrity KQIs have been configured on the SEQ Analyst.
1. Use the multi-dimension query module to query VoLTE integrity KQIs/KPIs.


Guide INTERNAL
Execution Result
1. The KQIs related to the VoLTE low MOS and one-way audio can be queried from the time and region
dimensions. The KQIs must contain the following retainability correlation KQIs: Packet Loss Rate, Delay,
Jitter, VoLTE Uplink and Downlink Low MOS Rate, VoLTE Uplink and Downlink Low IP MOS Rate,
VoLTE Uplink and Downlink One-Way Audio Rate, VoLTE Uplink and Downlink RTP One-Way Audio
Rate, VoLTE Uplink and Downlink RTCP One-Way Audio Rate.
2. The multi-dimension KQI/KPI query module can provide the reports of VoLTE integrity KQIs/KPIs based
on dimension and storage requirements. In addition, the module must ensure the accuracy and availability
of reports.
3. The VoLTE thematic analysis module can display the change trends of the low MOS and one-way audio
from the time and region dimensions and provide the demarcation result based on the demarcation rules of
the low MOS and one-way audio.
4. By correlating and analyzing the low MOS and one-way audio, the VoLTE thematic analysis module can
demarcate the problems of the VoLTE plow MOS and one-way audio to the following sides: wireless (cells
order to support the analysis and optimization of VoLTE integrity KQIs.
VoLTE service VoLTE integrity Provide the report as required by the

VoLTE integrity guide report weekly, and monthly reports.
demarcation VoLTE integrity Determine the content and format of the
Result Pass
Failed
Not Verified

Guide INTERNAL
3.3.4 VoLTE Mobility KQI Demarcation

Acceptance Whether VoLTE mobility KQI demarcation is available.
Item
Acceptance The VoLTE voice SRVCC/eSRVCC handover is demarcated from the following dimensions:
Content IMS: SBC/P-CSCF, S-CSCF, AS, HSS
EPC: MME, SGW/PGW
CS: MGCF, MSC
eRAN: ECI, eNB
Device: IMEI
User: IMSI, MSISDN

The dynamic KQI configuration package has been imported to the SEQ Analyst using
the metadata tool.
The VoLTE mobility KQIs have been configured on the SEQ Analyst.
thematic analysis and multi-dimension query.
1. Use the multi-dimension query module to query VoLTE mobility KQIs/KPIs.

Execution Result
1. The KQIs related to the SRVCC/eSRVCC handover success rate and SRVCC/eSRVCC handover delay
can be queried from the time and region dimensions. The KQIs must contain the following retainability
correlation KQIs: SRVCC handover success rate, Intra-LTE X2 Handover Success Rate, Intra-LTE S1
Handover Success Rate, Intra-LTE S1 Outgoing Success Rate, and Intra-LTE S1 Incoming Handover
Success Rate.
2. The multi-dimension KQI/KPI query module can provide the reports of VoLTE mobility KQIs/KPIs based
on dimension and storage requirements. In addition, the module must ensure the accuracy and availability
of reports.
3. The VoLTE thematic analysis module can display the change trends of the SRVCC/eSRVCC handover

Guide INTERNAL
success rate and SRVCC/eSRVCC handover delay from the time and region dimensions and provide the
demarcation result based on the demarcation rules of the SRVCC/eSRVCC handover success rate and
SRVCC/eSRVCC handover delay.
4. By correlating and analyzing the SRVCC/eSRVCC handover success rate and SRVCC/eSRVCC handover
delay, the VoLTE thematic analysis module can demarcate the problems of the SRVCC/eSRVCC handover
success rate and SRVCC/eSRVCC handover delay to the following sides: wireless (cells to be optimized
must be provided), core network (NEs to be optimized must be provided), data (the problem causes must
be analyzed on both data and NE sides and configuration data modification suggestions must be provided,
device (device vendors, modules, types, and symptoms must be provided. The optimization direction and
optimization suggestions must be provided for various failure scenarios in order to support the analysis
and optimization of VoLTE mobility KQIs.
VoLTE service VoLTE mobility Provide the report as required by the

VoLTE mobility guide report weekly, and monthly reports.
demarcation VoLTE mobility Determine the content and format of the
Result Pass
Failed
Not Verified

Guide INTERNAL
3.4 VVIP/VIP User Assurance

3.4.1 VVIP/VIP User Group Insight
Acceptance Whether VVIP/VIP user group assurance is available
Item
Acceptance VVIP/VIP users are high-value users and main revenue sources for carriers. During routine
Content VoLTE O&M, ensure the services of VVIP/VIP users to provide the quality service
experience for VVIP/VIP users.
The VVIP/VIP assurance service of the Huawei VoLTE voice service includes:
VVIP/VIP real-time assurance
Collects and correlates multi-interface data, monitors VVIP/VIP users at an interval of 1
minute, and displays the total traffic volume of the VoLTE voice service, numbers of
exceptions, event alarms, and geographical information.
VIP monitoring exception list
No. Voice Exception Description
1 MO Call Failure Includes the VoLTE MO calls of VVIP/VIP users.
2 MT Call Failure Includes the VoLTE MT calls of VVIP/VIP users.
Includes the VoLTE MO and MT calls of VVIP/VIP

3 Call Drop users.
Long E2E
4 Connection Delay Includes the VoLTE MO calls of VVIP/VIP users.
Includes uplink and downlink low MOS of VVIP/VIP

5 Low MOS users.
Includes uplink and downlink one-way audio of

6 One-Way Audio VVIP/VIP users.

VVIP users have been configured under Settings > Configuration Management >
Operation Configuration > Home Network Information Management > User
Group.
The NEs on the network to which VVIP users belong have been configured under
Settings > Configuration Management > Operation Configuration > Home
Network Information Management > NE.
The provinces, cities, eNodeBs, and ECGIs to which VVIP users belong have been
configured under Settings > Configuration Management > Operation Configuration
> Home Network Information Management > Location.
You have logged in to the SEQ Analyst WebUI and been permitted to use VVIP/VIP
user group assurance.
Go to the VVIP/VIP user group assurance module.

Guide INTERNAL
Execution Result
1. The VVIP/VIP user assurance module is to monitor the exceptions of the VoLTE voice service and make
an insight into the poor services of VVIP/VIP users.
2. The VVIP/VIP user group assurance module can correctly display the predefined MO and MT call failure,
long call connection delay, call drop, low MOS, one-way audio, exception alarm, and geographical
information for the VoLTE voice service. In addition, the module enables you to drill down to xDRs and
the signaling flowchart.
3. By analyzing the xDRs and signaling flowchart of exceptions, the VVIP/VIP user group assurance
function can determine the problem scenarios and corresponding demarcation results based on the earliest
failure phase, failure message, failure cause value, and provide faulty NEs, wireless cells, or device
IMEIs.
VoLTE voice's VIP real-time exception data, VIP user group Provide the report based on
VIP user group xDRs, and raw signaling insight report for the the period required by the
insight provided by the SEQ Analyst VoLTE voice service customer.
Result Pass
Failed
Not Verified

Guide INTERNAL
3.4.2 VVIP/VIP User Group Analysis

Acceptance
Whether VVIP/VIP user group analysis is available
Item
Acceptance VIP exception analysis and demarcation:

Content Based on the VIP real-time assurance statistics or alarms, the module identifies the
exceptions of the VVIP/VIP users' VoLTE voice service, and queries the xDRs and raw
signaling of each exception. In addition, the module provides the demarcation result based
on rich scenario database and expert experience and sends the result to the
IMS/CS/EPC/wireless NEs for further location.
VVIP users have been configured under Settings > Configuration Management >
Operation Configuration > Home Network Information Management > User
Group.
The NEs on the network to which VVIP users belong have been configured under
Network Information Management > NE.
The provinces, cities, eNodeBs, and ECGIs to which VVIP users belong have been
configured under Settings > Configuration Management > Operation
Configuration > Home Network Information Management > Location.
You have logged in to the SEQ Analyst WebUI and been permitted to use VVIP/VIP
user group analysis.
Go to the VVIP/VIP user group analysis module.

Execution Result
1. The VVIP/VIP user group assurance module can correctly display the MO/MT call attempts, call
connections, MO/MT call failures, call drops, and long delays for the predefined VoLTE voice service.
2. In the VVIP/VIP user group assurance module, VoLTE exception analysis and demarcation includes
exception analysis, location analysis, device analysis, and failure trend analysis. Ensure the availability
of the preceding WebUI functions.
VoLTE voice's VIP real-time exception data, VoLTE voice's VIP Provide the report based on
VIP user group xDRs, and raw signaling user group the period required by the
analysis provided by the SEQ Analyst analysis report customer.
Result Pass
Failed
Not Verified

Guide INTERNAL
3.5 Service Quality Demarcation for Complaining Users

3.5.1 VoLTE Correlated xDR Query
Acceptance Whether VoLTE correlated xDR query is available
Item
Acceptance The assistant handling service for VoLTE user complaints helps the VoLTE network
Content O&M engineers quickly respond to user complaints and restore the service usage
information in the phase of the user complaints. In addition, the service makes an in-
depth analysis on the complaint causes and submits the complaints to the functional
departments, improving the user satisfaction and service experience.
Network with the signaling probe and SEQ Analyst deployed:
After receiving the user complaint orders, the Huawei assistant handling engineers
for user complaints perform the following steps:
Collect monitoring data for analysis.
Initially analyze the problem and determine whether to conduct further analyze
the problem.
Extract the correlated xDRs obtained using the multi-interface correlation result,
analyze the raw signaling flowchart, and trace users in a real-time and E2E
manner, and quickly locate the problem cause and network node of problems.
Submit the problem solution to the carrier for review and approval. After the
solution is approved, take measures to resolve the problem. Then, close the
problem.
Summarize the complaint handling cases and provide the handling report.

The carrier to which the system network belongs has been configured under
Network Information Management > Local Carrier.
The VoLTE application installation package has been imported to the SEQ
Analyst.
correlated xDR query and voice quality xDR query.
Go to the correlated xDR query module on the SEQ Analyst WebUI.

Execution Result
1. The VoLTE correlated xDR query function supports the query of signaling-plane xDRs, user-plane
voice quality xDRs, and raw signaling. The service type includes MOC/MTC, registration,
supplementary service.
2. The VoLTE correlated xDR query function supports the filtering of user xDRs by user type, network,
and high level for accurate user xDR query.
3. The VoLTE correlated xDR query function supports multi-interface correlation on the CS/ECP/IMS
network. This function also supports the display of the first release point is displayed based the

Guide INTERNAL
analysis result of the raw signaling flowchart and quickly locates the cause of the release exception for
complaining users to identify the problem cause and network node of problems.
Result Pass
Failed
Not Verified
3.5.2 VoLTE Real-Time Session Trace

Acceptance Whether VoLTE real-time session trace is available
Item
Acceptance The assistant handling service for VoLTE user complaints helps the VoLTE network
Content O&M engineers quickly respond to user complaints and restore the service usage
information in the phase of the user complaints. In addition, the service makes an in-
depth analysis on the complaint causes and submits the complaints to the functional
departments, improving the user satisfaction and service experience.
Network with the signaling probe and SEQ Analyst deployed:
After receiving the user complaint orders, the Huawei assistant handling engineers for
user complaints perform the following steps:
Collect monitoring data for analysis.
Initially analyze the problem and determine whether to conduct further analyze the
problem.
Extract the correlated xDRs obtained using the multi-interface correlation result,
analyze the raw signaling flowchart, and trace users in a real-time and E2E
manner, and quickly locate the problem cause and network node of problems.
Submit the problem solution to the carrier for review and approval. After the
solution is approved, take measures to resolve the problem. Then, close the
problem.
Summarize the complaint handling cases and provide the handling report.
Network Information Management > Local Carrier.
The VoLTE application installation package has been imported to the SEQ Analyst.
real-time session trace.
Go to the VoLTE real-time session trace module on the SEQ Analyst WebUI.
Execution Result
1. The VoLTE real-time session trace function supports the following service types: VoLTE > VoLTE,
VoLTE > CS, VoLTE > ECP, CS > VoLTE, and EPC > VoLTE. The function traces the required E2E

Guide INTERNAL
service messages to help the carrier location problems and hand user complaints.
2. The VoLTE real-time session trace function supports the correlation of multiple interfaces on the
CS/EPC/IMS network and generates one correlated xDR for each service.
3. The VoLTE real-time session trace function enables you to enter the wildcard character (* or ?) to
filter user numbers and IP addresses.
Result Pass
Failed
Not Verified
3.6 VoLTE Thematic Analysis

3.6.1 VoLTE Registration Analysis
Acceptance Item Whether VoLTE registration analysis is available
Acceptance Content VoLTE registration analysis includes:

VoLTE initial registration analysis
VoLTE reregistration analysis
VoLTE third-party registration analysis

Settings > Configuration Management > Operation Configuration >
Home Network Information Management > Local Carrier.
The VoLTE application installation package has been imported to the SEQ
Analyst.
The app installation package for VoLTE registration analysis has been
imported to the SEQ Analyst and the function is available.
You have logged in to the SEQ Analyst WebUI and been permitted to use
VoLTE registration analysis.
Go to the VoLTE registration analysis module on the SEQ Analyst WebUI.

Execution Result
1. With VoLTE registration analysis, the initial registration success rate and third-party registration success
rate can be compared and analyzed from the time, region, and NE dimensions.
2. VoLTE registration analysis supports the measurement of the initial registration failure, third-party
registration failure, top registration failure users or NEs.
3. VoLTE registration analysis supports the measurement of the initial registration failure, third-party
registration failure, top registration failure users or NEs.

Guide INTERNAL
VoLTE Guide to demarcating service Determine the key

VoLTE registration
registration quality problems for voice analysis points based on
analysis report
analysis experience assurance customer requirements.
Result Pass
Failed
Not Verified
3.6.2 VoLTE Handover Analysis

Acceptance Item Whether VoLTE handover analysis is available
Acceptance Content VoLTE handover analysis includes:

SRVCC handover analysis
eSRVCC handover analysis

The carrier to which the system network belongs has been configured
under Settings > Configuration Management > Operation
Configuration > Home Network Information Management > Local
Carrier.
The VoLTE application installation package has been imported to the
SEQ Analyst.
The app installation package for VoLTE handover analysis has been
imported to the SEQ Analyst and the function is available.
You have logged in to the SEQ Analyst WebUI and been permitted to
use VoLTE registration analysis.
Go to the VoLTE handover analysis module on the SEQ Analyst WebUI.

Guide INTERNAL
Execution Result
1. The SRVCC handover success rate can be compared and analyzed from the time, region, and NE dimensions.
2. The SRVCC handover failure cause and top handover failure cells can be measured.
3. bSRVCC (before ringing), aSRVCC (after ringing), and eSRVCC (after answering calls) can be measured,
respectively.
Guide to demarcating service Determine the key

VoLTE handover VoLTE handover
quality problems for voice analysis points based on
analysis analysis report
experience assurance customer requirements.
Result Pass
Failed
Not Verified
3.6.3 VoLTE Device Analysis

Acceptance Whether VoLTE device analysis is available
Item
Acceptance VoLTE device analysis enables you to:

Content Query the number of VoLTE users, and the number of VoLTE devices.
Query the VoLTE device penetration rate from the device brand and model dimensions.
Query VoLTE KQIs/KPIs from the device brand and model dimensions.

The VoLTE application installation package has been imported to the SEQ Analyst.
The app installation package for VoLTE device analysis has been imported to the SEQ
Analyst and the function is available.
registration analysis.
Go to the VoLTE device analysis module on the SEQ Analyst WebUI.

Guide INTERNAL
Execution Result
1. The number of VoLTE registration users can be measured. The number of users that successfully register the
VoLTE service can be measured at an interval of one day from the city and province dimensions.
2. The following KQIs can be measured from the VoLTE device dimension: registration success rate, call
connection rate, SRVCC handover success rate, and MOS.
3. The VoLTE device penetration rate can be measured. The number of users and user ratios can be measured
at an interval of one day from the device model dimension.
Guide to demarcating service Determine the key

VoLTE device VoLTE device
quality problems for voice analysis points based on
analysis analysis report
experience assurance customer requirements.
Result Pass
Failed
Not Verified
3.7 Service Value Acceptance

3.7.1 VoLTE KQI/KPI Monitoring and Demarcation
Acceptance Whether KQI/KPI monitoring and demarcation meet the service value requirements
Item
Acceptance By monitoring and demarcating the model of VoLTE KQIs, the function can quickly
Content identify and demarcate the VoLTE service quality problems. The demarcation result
supports the automatic root cause location and optimization by the O&M department and
ensures the VoLTE service experience, improving user satisfaction.
Execution Result
1. KQI/KPI integrity
The multi-dimension module can query the deliverable KQIs/KPIs for the VoLTE service from the time
and space dimensions and supports the query of failure xDRs and raw signaling.
2. Alarm integrity
KQIs/KPIs monitoring can comprehensively cover all phases of the VoLTE assurance service process,
ensuring that the alarm monitoring function monitors different service dimensions, such as accessibility,
retainability, integrity, and mobility.

Guide INTERNAL
3. Alarm delay
Alarm delay formula:
Alarm delay = Alarm generation time - Fault occurrence time
Observe the following rules to accept the alarm delay KPIs with different time intervals:
Signaling plane: 15 minutes (measured delay 30 minutes), 1 hour (measured delay 1 hour), one day
(measured delay 5 hours)
User plane: 15 minutes (measured delay 30 minutes), 1 hour (measured delay 1 hour), one day
(measured delay 5 hours)
4. Alarm validity
If VoLTE KQI/KPI alarm monitoring must be delivered according to the delivery contract, the alarm validity
must be accepted in the acceptance contract terms. The alarm validity is calculated using the following
formula:
Alarm validity = Number of alarms for effectively dispatching trouble tickets/Total number of alarms >
xx% (recommended value > 80%)
Valid orders are not submitted for the alarm in the following scenarios: Alarms can be queried in on the
multi-dimension or VoLTE analysis page of the SEQ Analyst. The false alarms are generated due to
platform fault exception even though KQIs/KPIs are within the specified range and do not greatly
fluctuate.
5. Demarcation success rate
If VoLTE KQI/KPI alarm monitoring, VoLTE fault tree, and automatic VoLTE KQI/KPI monitoring
alarm demarcation are delivered for the SEQ Analyst according to the contract, the monitoring alarm
demarcation success rate must be accepted in the acceptance contract terms. The monitoring alarm
demarcation success rate is calculated using the following formula:
Demarcation success rate = Number of successfully demarcated problems/Total number of problems >
xx% (recommended value > 60%)
The number of successfully demarcated problems defines the number of alarms based on the
demarcation result obtained using the VoLTE fault tree.
6. Demarcation accuracy rate
demarcation accuracy rate must be accepted in the acceptance contract terms. The monitoring alarm
demarcation accuracy rate is calculated using the following formula:
Demarcation accuracy = Number of correctly demarcated problems/Number of successfully demarcated
problems > xx% (recommended value > 50%)
The number of accurately demarcated problems indicates the number of times the lower-layer trouble
ticket handling team (trouble ticket takeover departments, such as the core network and network
optimization departments) accurately locates network problem alarms based on the rough demarcation
result of the SEQ Analyst platform on condition that the SEQ Analyst platform successfully demarcates
the monitoring alarms.
7. Demarcation duration
demarcation duration must be accepted in the acceptance contract terms. The monitoring alarm
demarcation duration is calculated using the following formula:
Demarcation duration = Demarcation end time Alarm generation time (recommended value < 30
minutes)

Guide INTERNAL
The alarm demarcation end time is defined as the time when the VoLTE KQI/KPI exception alarm is
demarcated on the SEQ Analyst.
Result Pass
Failed
Not Verified
3.7.2 VVIP/VIP User Assurance

Acceptance Whether VVIP/VIP user assurance meets the service value requirements
Item
Acceptance Service value acceptance helps carriers to proactively perform VoLTE service assurance
Content for VVIP users. That is, carriers proactively analyze VoLTE service problem causes when
or before users find the service quality problem. In this way, carriers' traditional network
O&M department now can analyze single-user problems. According to the demarcation
result, the network O&M department can locate the root cause and perform optimization.
This helps the carrier adjust the network establishment priority based on VVIP user
experience and proactively conduct VVIP user concern, reducing the VVIP user
complaint rate.
Execution Result
1. Validity for demarcating the poor services of VVIP/VIP users

If the contract specifies VVIP/VIP user assurance for SEQ Analyst platform delivery, the validity for
demarcating the poor services of VVIP/VIP users must be accepted in the acceptance contract terms.
The validity for demarcating the poor services of VVIP/VIP users is calculated using the following
formula:
Validity for demarcating the poor services of VVIP/VIP users = Number of valid VVIP/VIP user service
problems demarcated/Number of VVIP/VIP user service problems for which alarms are triggered. xx%
(recommended value 90%)
Number of invalid VVIP/VIP user service problems demarcated includes but not limited to the
following scenarios:
VVIP/VIP users use the CSFB voice service while the SEQ Analyst demarcates the service as the
VoLTE voice service or other services.
VVIP/VIP users correctly release calls while the SEQ Analyst demarcates the release as call drop or
other poor service types.
VVIP/VIP user complaints have been filed while alarms are not generated for these complaints on the
SEQ Analyst.
2. Duration for demarcating the poor services of VVIP/VIP users
If the contract specifies VVIP/VIP user assurance for SEQ Analyst platform delivery, the duration for
The duration for demarcating the poor services of VVIP/VIP users is calculated using the following
formula: Duration for demarcating the poor services of VVIP/VIP users = VVIP/VIP user alarm trigger

Guide INTERNAL
time Time when the poor services of VVIP/VIP users are demarcated (recommended value < 30
minutes)
3. Success rate for demarcating the poor services of VVIP/VIP users
If the contract specifies VVIP/VIP user assurance for SEQ Analyst platform delivery, the success rate
for demarcating the poor services of VVIP/VIP users must be accepted in the acceptance contract terms.
The success rate for demarcating the poor services of VVIP/VIP users is calculated using the following
formula:
Success rate for demarcating the poor services of VVIP/VIP users = Number of VVIP/VIP user service
problems successfully demarcated/Number of VVIP/VIP user service problems for which alarms are
triggered > xx% (recommended value 80%)
Number of VVIP/VIP user service problems successfully demarcated indicates the number of VVIP/VIP
user service problems for which the SEQ Analyst can provides the demarcation result.
4. Accuracy for demarcating the poor services of VVIP/VIP users
If the contract specifies VVIP/VIP user assurance for SEQ Analyst platform delivery, the accuracy for
The accuracy for demarcating the poor services of VVIP/VIP users is calculated using the following
formula:
Accuracy for demarcating the poor services of VVIP/VIP users = Number of VVIP/VIP user service
problems accurately demarcated/Number of VVIP/VIP service problems successfully demarcated > xx
% (recommended value 60%)
The number of accurately demarcated problems indicates the number of times the lower-layer trouble
ticket handling team (trouble ticket takeover departments, such as the core network and network
optimization departments) accurately locates the complaints for network problems based on the rough
demarcation result of the SEQ platform on condition that the SEQ platform successfully demarcates the
monitoring alarms.
Result Pass
Failed
Not Verified
3.7.3 Service Quality Demarcation for Complaining Users

Acceptance Whether service quality demarcation for complaining users meets the service value
Item requirements
Acceptance With service quality demarcation for complaining users, the carrier can handle the
Content VoLTE quality problems that cannot be processed by the customer care, improving the
complaining problem handling efficiency for the carrier's O&M department.
Execution Result
1. User complaint demarcation duration

If the contract specifies complaint user quality demarcation for SEQ platform delivery, the user
complaint demarcation duration counter must be accepted in the acceptance contract terms. The user
complaint demarcation duration is calculated using the following formula:

Guide INTERNAL
User complaint demarcation duration = Time when user complaint demarcation starts Time when
user complaint demarcation ends (recommended value < 30 minutes)
2. User complaint demarcation success rate
complaint demarcation success rate counter must be accepted in the acceptance contract terms. The
user complaint demarcation success rate is calculated using the following formula:
User complaint demarcation success rate = Number of successfully demarcated user
complaints/Total number of user complaints received by the SEQ Analyst > xx% (recommended
value 80%)
The number of successfully demarcated user complaints indicates the number of complaints with
specific demarcation results.
3. User complaint demarcation success rate
complaint demarcation success rate counter must be accepted in the acceptance contract terms. The
user complaint demarcation success rate is calculated using the following formula:
User complaint demarcation success rate = Number of successfully demarcated user complaints/Total
number of user complaints received by the SEQ Analyst > xx% (recommended value 80%)
The number of successfully demarcated user complaints indicates the number of complaints with
specific demarcation results.
User complaint demarcation accuracy
complaint demarcation accuracy counter must be accepted in the acceptance contract terms. The user
complaint demarcation accuracy is calculated using the following formula:
User complaint demarcation accuracy = Number of accurately demarcated user complaints/Number of
successfully demarcated user complaints > xx% (recommended value 60%)
The number of accurately demarcated user complaints indicates the number of times the lower-layer
complaint handling team (trouble ticket takeover departments, such as the core network and network
optimization departments) accurately locates the complaints for network problems based on the rough
demarcation result of the SEQ platform on condition that the SEQ platform successfully demarcates
user complaints.
Result Pass
Failed
Not Verified

Guide INTERNAL
3.7.4 Value Acceptance for VoLTE Thematic Analysis

Acceptance Whether the service values for VoLTE thematic analysis meet the requirements
Item
Acceptance With VoLTE thematic analysis, specific services, specific failure scenarios, and
Content specified requirements are displayed to meet the VoLTE service analysis requirements
for the carrier. This helps the carrier identify hidden network problems and display the
various values for VoLTE thematic analysis.
Execution Result
KQI/KPI integrity for VoLTE thematic analysis

Coverage integrity in specific scenarios
Result Pass
Failed
Not Verified
4 Acceptance Handover
4.1 Service Document Handover
Document handover: After the service acceptance is complete, the project delivery owner checks
whether all deliverables are handed over to the customer based on the requirements of the contract and
service proposal.
Data handover: Delete all live network data after the project delivery based on Huawei's requirements.
IT account handover: After the project delivery is complete, return to the customer all IT accounts
applied for network monitoring and operation during the project delivery and remind the customer to
unregister the IT accounts.
4.2 Acceptance Signature Form

No. Acceptance Item Result Remarks
1 VoLTE KQI/KPI accuracy Pass Not Pass Not Involved

2 Availability of VoLTE KQI/KPI Pass Not Pass Not Involved
monitoring
3 Availability of VoLTE KQI/KPI Pass Not Pass Not Involved
demarcation
4 Availability of VoLTE Pass Not Pass Not Involved
VVIP/VIP user group assurance

Guide INTERNAL
5 Availability of service quality Pass Not Pass Not Involved

demarcation for complaining
users (correlated xDR
query/real-time session trace)
6 VoLTE service acceptance Pass Not Pass Not Involved
7 Service value acceptance Pass Not Pass Not Involved
(integrity/alarm integrity/alarm
validity/alarm accuracy/alarm
success rate/demarcation
duration)
Based on contract requirements, both parties accept the listed items, agree with the result, and sign
below.
Huawei representative: User representative:
Date: Date:
5 Reference
5.1 Reference Documents
No. Document Link
1 Product Features VoLTE Experience Assurance Capability Specifications 01-en

and
Specifications
2 Sales Guide VoLTE Experience Assurance Customer Promotional Slides
3 Cases for Hong Kong Hutchison SEQ Analyst VoLTE POC Project Delivery Summary
Customer http://3ms.huawei.com/hi/group/1004057/blog_2052041.html?
Reference uid=566199&mapId=3215649
4 Service Contract VoLTE Experience Assurance Service Proposal
5 Configuration SEQ Analyst 3.0 VoLTE Delivery White Paper (Platform Deployment) V1.8
Manual
6 Project Delivery SEQ Analyst 3.0 VoLTE Delivery White Paper (Platform Deployment) V1.8
Plan
7 Acceptance VoLTE KQI/KPI Accuracy Acceptance Guide
Guide VoLTE Voice Experience Assurance Solution Project Acceptance Guide V1.0

Guide INTERNAL
8 Acceptance
Criteria and
Template
5.2 Acronyms and Abbreviations

Acronyms and Abbreviations Full Spelling
VoLTE Voice over long term evolution

KQI Key quality information
KPI Key performance indication
IMS IP multimedia subsystem
CS Circuit switched
EPC Evolved packet core
RAN Radio access network
DT Drive test
MOS Mean Opinion Score

SQM EOT V200R007 VoLTE Voice Experience Assurance Solution Project Acceptance Guide

Uploaded by

Document Information

Original Description:

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

SQM EOT V200R007 VoLTE Voice Experience Assurance Solution Project Acceptance Guide

Uploaded by

Copyright:

Available Formats

SQM EOT V200R007 VoLTE Voice Experience Assurance Solution Project Acceptance

SQM EOT V200R007 VoLTE Voice Experience

Tian Lizhu (employee ID: Date

Huawei Technologies CO., LTD.

2017-07-15 Huawei confidential. No spreading without permission. Page 1 of 39

3 Acceptance Contents and Methods............................................................................................9

2017-07-15 Huawei confidential. No spreading without permission. Page 2 of 39

2017-07-15 Huawei confidential. No spreading without permission. Page 3 of 39

Cyber Security Redline Requirements

2017-07-15 Huawei confidential. No spreading without permission. Page 4 of 39

Sensitive Words Using Guide

2017-07-15 Huawei confidential. No spreading without permission. Page 5 of 39

1.2 Intended Audience

1.3 Acceptance Principle and Guide

2017-07-15 Huawei confidential. No spreading without permission. Page 6 of 39

Figure 11.1 Standard service acceptance process

2.1.1 Acceptance Pre-test or Pre-evaluation

2.1.2 Acceptance Application and Approval

2.1.3 Acceptance Preparation

2017-07-15 Huawei confidential. No spreading without permission. Page 7 of 39

Acceptance test plan

2.1.4 Acceptance Data Collection & Acceptance Test

2.1.5 Acceptance Report Output

2.2 Acceptance Responsibility Matrix and Role

Acceptance Acceptance Acceptance Acceptance

Huawei: XXX Huawei: XXX China Mobile: China Mobile:

2017-07-15 Huawei confidential. No spreading without permission. Page 8 of 39

2.3 Acceptance Precautions

3 Acceptance Contents and Methods

No. Service Module Acceptance Method Description

1 VoLTE KQI/KPI Delivery acceptance VoLTE KQI/KPI accuracy check

2017-07-15 Huawei confidential. No spreading without permission. Page 9 of 39

3.1 VoLTE KQI/KPI Accuracy

2017-07-15 Huawei confidential. No spreading without permission. Page 10 of 39

3.2 KQI Monitoring

2017-07-15 Huawei confidential. No spreading without permission. Page 11 of 39

Acceptance Whether VoLTE KQI/KPI monitoring is available.

Acceptance 1. VoLTE service quality KQI monitoring

Accessibility 1 Perceived Call Measured from the S1-U interface on

VoLTE KPI list

2017-07-15 Huawei confidential. No spreading without permission. Page 12 of 39

Initial 1 Registration Registration success rate = Number of successful

2017-07-15 Huawei confidential. No spreading without permission. Page 13 of 39

Mobility 1 SRVCC Number of successful SRVCC successes/Number of

Prerequisites The SEQ Analyst system is running properly.

1. Use the multi-dimension query module to query VoLTE KQIs/KPIs.

2017-07-15 Huawei confidential. No spreading without permission. Page 14 of 39

Module Input Output Description

2017-07-15 Huawei confidential. No spreading without permission. Page 15 of 39

3.3 KQI Demarcation

Prerequisites The SEQ Analyst system is running properly.

1. Use the multi-dimension query module to query VoLTE accessibility KQIs/KPIs.

2017-07-15 Huawei confidential. No spreading without permission. Page 16 of 39

Module Input Output Description

VoLTE service VoLTE accessibility Provide the report as required by the

2017-07-15 Huawei confidential. No spreading without permission. Page 17 of 39

3.3.2 VoLTE Retainability KQI Demarcation

Prerequisites The SEQ Analyst system is running properly.

1. Use the multi-dimension query module to query VoLTE retainability KQIs/KPIs.

2017-07-15 Huawei confidential. No spreading without permission. Page 18 of 39

Module Input Output Description

VoLTE service VoLTE retainability Provide the report as required by the