Professional Documents
Culture Documents
IP
etw PN
o rk
GG
Gn/Gp
SN
SG
SN tcke it Sw
d che
Co
Pa
S1/S11 luPS Gb
Gs
Gr
LTE
Uu
e-Node B
m Ter g Lon
l Evo
on uti RN
lub Node B
luCS
UMT S
lur
UT
tw Ne s s cce A AN
o rk
Uu
GSM
BS
Abis BTS
C o rk
GS
Um
tw Ne s es Ac c
CDR IP
Bi l lin g d an tin g
Ra
Gi
e dS an t ten on
r vi
ces
MM7
GG
Gn/Gp
SN tw Ne o rk
Gc
MM
SMPP UCP CIMD
SC
ke
wit t-S
d che
o re
P WA P
Ma SC
il t Pl a for m
Gs
Gr
Gd
S
C HLR D
C MS
Op
Se or t a er
r vi
ce
GM
E
SC rk
ISUP S2m
it Sw ch PB X
Mc MGW
Ci r
it Sw t i cu
d che
o etw N re Co
SC o rk
CDMA
PS
tw Ne N D / IS TN
o rk
tw Ne s ces
a/b So
All trademarks and registered trademarks are the property of their respective owners.
Contents
Keynote SIGOS
Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6 Company . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8 Portfolio . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
TEST SYSTEMS
36
GlobalRoamer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
World-Wide Coverage . . . . . . . . . . . . . . . . . . . . . . . . 39 Use Cases . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41
USE CASES
Service Quality Monitoring
12
SITE . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
The Unique Test Platform . . . . . . . . . . . . . . . . . . . . . 42 Hardware Components & Interfaces . . . . . . . . . . . 46
Periodic QoS Testing . . . . . . . . . . . . . . . . . . . . . . . . . . 14 On-Demand Testing . . . . . . . . . . . . . . . . . . . . . . . . . . 15 Network Diagnosis . . . . . . . . . . . . . . . . . . . . . . . . . . . 16 Drive Service Testing . . . . . . . . . . . . . . . . . . . . . . . . . . 17 Content Testing / Handset Simulation . . . . . . . . . 18 Benchmarking . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19
Roaming Testing
Inbound Roaming Testing . . . . . . . . . . . . . . . . . . . . 20 Outbound Roaming Testing . . . . . . . . . . . . . . . . . . . 21 SLA Testing according to GSMA (GRQ) . . . . . . . . . 22 Roaming Hubbing Testing . . . . . . . . . . . . . . . . . . . . 23 Roaming Steering Testing . . . . . . . . . . . . . . . . . . . . 24
PROFESSIONAL SERVICES
72
Revenue Assurance
Test Call / Event Generation . . . . . . . . . . . . . . . . . . . 28 CDR Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29 Tariff Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30 Prepaid SIM Recharging . . . . . . . . . . . . . . . . . . . . . . 31
INDEX REFERENCES
79 80
With a customer base of more than 240 operators around the world in over 100 countries... With over 50 representations around the world, covering sales and post sales services... With more than 20 languages spoken by our expert staff...
Introduction
Company
Testing is our Competence
Portfolio
SITE Active end-to-end test system GlobalRoamer Managed world-wide system Professional Services Consulting and more
Testing and integration support for the first German GSM network
Keynote SIGOS
1985
Industry
First ISDN communication system is established
1987
1989
1990
1991
Keynote SIGOS
The Company
What we do
Keynote SIGOS provides scalable and fully integratable telecommunications testing solutions to service network operators (mobile and fixed line as well as MVNOs), content providers, carriers and regulators. Our solutions and services are designed to give our customers the full picture on Quality of Service from an end-user perspective. But we do not stop there: our customers enjoy the most comprehensive range of scalable active end-to-end testing solutions available on the market. Service Quality testing and monitoring Roaming testing International Carrier Quality testing Revenue Assurance and Billing verification Revenue Leakage and Fraud Detection solutions Drive Service testing Fixed and IP network testing Test creation, diagnosis and reporting tools Core Network testing solutions Handset simulation
SIGOS provides test and integration support to all German GSM networks
Keynote SIGOS
1997
Industry
2000
3G starts: First CDMA2000 commercial system is launched in South Korea
2001
First commercial UMTS network is launched in Norway
2002
1 Billion of mobile phone subscribers world-wide
2005
HSDPA is introduced
www.keynote-sigos.com
1992
1993
1994
1995
1996
GPRS / EDGE (2.5G) ADSL allows high-speed communication over phone lines
Who we are
Founded in 1989 under the name of SIGOS Systemintegration GmbH, Keynote SIGOS brings in more than two decades of broad experience to the telecommunications industry, helping our customers to be even more successful in todays highly competitive environment. Keynote SIGOS is a truly international company: bringing people from multiple cultural backgrounds together to outstandingly serve our global customer base with what Keynote SIGOS employees all have in common: true passion for telecommunications!
Keynote SIGOS is headquartered in Germany where our solutions are being developed under highest standards. Representations on multiple continents and our strong partner network distributed all over the world rounds up our world-wide presence.
Introduction of Keynote SIGOS GlobalResource Pool celebrates GlobalRoamer to cover its 20 Years of the world countries Anniversary LTE Test System
te SIGOS
20
YEA
RS
9
2006
VoIP is now established as communications platform
2007
HSUPA is introduced
2008
HSPA+ is introduced Mobile Connections hit 4 Billions world-wide
19 00 89 - 2
2009
2010
Beginning of LTE era (4G)
2011
IPv4 addresses to run out by the end of the year
HSPA+ rollouts
www.keynote-sigos.com
The Portfolio
Steering of Roaming Testing Fraud Detection for National & International Tra c International Carrier Testing
GlobalRoamer
Billing Testing for International Tra c World-wide Handset Speci c QoS Testing QoS Tools for Diagnosis & Reporting
Roaming Testing
LU
CLU
LU
Fixed
IP Networks
Mobile
GO
P GR h wit AL B GLO
Managed Services
Professional Services
Training
Consulting Services
10
www.keynote-sigos.com
The Managed Global Infrastructure and Test System For The World-Wide Telecommunications Industry
With GlobalRoamer, Keynote SIGOS offers the most extensive infrastructure for automated telecommunication testing world-wide. We provide our customers with an extensive network of testing facilities around the globe, hosted by Keynote SIGOS. GlobalRoamer customers can use this sophisticated testing infrastructure through a web based user interface. All that is required is a web browser and access to the internet. Simply log on with your password and set up your test schedules without worrying about a thing. However, Keynote SIGOS can also provide fully managed test services so that all that you really need to do is: look at the results. The on-demand world-wide test platform hosted by Keynote SIGOS
www.keynote-sigos.com
11
Versatility is key!
12
Roaming Testing
> > > > >
Inbound Roaming Testing Outbound Roaming Testing SLA Testing according to GSMA (GRQ) Roaming Hubbing Testing Roaming Steering Testing
Revenue Assurance
> Test Call/Event Generation > CDR Comparison Testing > Tariff Testing > Prepaid SIM Recharging
13
In a highly competitive market, such as the telecommunications industry, providing and maintaining highest quality to end customers is the key to a sustainable competitive advantage. With customers having multiple options at hand, poor quality even the occasional drop in quality can have immediate consequences. Switching between operators never has been easier through mobile number portability. First class service quality has many influencing factors not all being under the immediate control of the operator. Identification of weak points can be difficult and some may remain undiscovered even while their effects are still evident in the market.
Keynote SIGOS offers accurate measurements of end-to-end quality for voice and data services by measuring KPIs like call setup success rates, HSDPA, HTTP average throughput or service degradation of BlackBerry services. Taking round the clock automated measurements at the end users interface (rather than in network nodes) operators obtain in-depth insight into end-users perception of the network. Generation of active test calls 24/7 without the cost of 24/7 staff - covering all aspects of the network and the upload of KPIs to a centralized alarming system provides excellent real-time feedback on the service levels of the network.
14
www.keynote-sigos.com
On-Demand Testing
Perform reproducible ad-hoc testing!
The customer service desk keeps getting complaints about certain service scenarios like BlackBerry e-mail service not reliable, basic voice calls not possible in certain locations, in the home country as well as abroad. Quick action needs to be taken!
World-wide Testing
Keynote SIGOS hosts the largest and most comprehensive world-wide test infrastructure, currently covering 4/5 of the worlds countries. GlobalRoamer users benefit from the availability and flexibility of the GlobalRoamer test network without the effort of running their own system. GlobalRoamer account holders log on and schedule their tests whenever the demand occurs. Being able to perform tests independently and without the usual hassles connected with doing business globally like time-zones is an invaluable asset!
If a real time test is needed, and its too late to contact a roaming partner, I can re-produce the test scenario identically.
The test call can be replicated repetitively in order to check whether service has been re-established. GlobalRoamer is deployed to survey specific services over roaming partners networks managing both post-paid and prepaid SIMs across the different technologies. The SIMs are co-located in Keynote SIGOS premises in Nuremberg, Germany.
There is no time lost as we do not have to get in touch with the roaming partner. We can execute tests via GlobalRoamer in a matter of a few minutes anywhere in the world where SIGOS has coverage. Before we started to use GlobalRoamer sometimes we had to wait more than 3 months for execution of a roaming test because partners were occupied with other roaming partners tests. The SIGOS test system helps us to manage our test SIMs efficiently as we do not have to send the SIMs to multiple countries for roaming testing. It provides us with a fully controlled test platform. We can perform multiple test cases easily and simultaneously.
www.keynote-sigos.com
15
Network Diagnosis
Model your network & find the root cause of service outages!
Once periodic heartbeat testing for the services has been set up, very often Service Operations is the first team to detect service outages through the results of this active testing. But what network entity has caused the fault? SITE proves not only to be a good reflection of real customer experience but also shows up bottlenecks in the network infrastructure via its solution Service Alarm Map (SAM). By supervision of all relevant end-customer services and correlation of network events it becomes possible to both anticipate and analyze service affecting network problems. A clear and comprehensive mapping of service problems to the performance of individual network elements and systems can then significantly drive down time to repair. Service Alarm Map helps to reduce the time for root cause identification and supports the technical service teams with additional information like error-id, trace details & measurement values. This important drill-down functionality from service chain visualization to raw measurement values and trace information improves reaction times in the event of traffic congestion and network element failures.
The number of customer complaints have been reduced significantly due to network issues being identified faster by the Keynote SIGOS test system. Real-time alerts and reports of incidents lead to faster resolution of the network issues identified. Subscribers are not fast enough to call our Customer Care to lodge a complaint.
LocationUpdate2G
GPRS_Attach2G
Opera server
DL_Duration HttpAv
INTERNET VPN Tunnel
GGSN
PDP_ContextActivation
Router
Internet
DL_Duration HttpAv
16
www.keynote-sigos.com
Unattended System SITE Drive Service Test is a completely autonomous system after installation. No engineer needs to be present in the vehicle for test setup, modification or analysis. Easy Installation and Removal MLU is shipped fully pre-configured and only needs to be connected to the electronic on-board system. No further human interaction, not even switch-on is required. Geographic View SITE system delivers graphical views on your network quality. A comprehensive set of KPIs enriched with further information like speed of moving vehicle, altitude and position can be displayed on a map. WMS maps, e.g. operators own coverage map, display KPIs customizable by operator.
Investment Protection Drive Service Tests are fully SITE compatible and can be performed as an extension to existing SITE systems securing current investment into Keynote SIGOS service assurance products.
www.keynote-sigos.com
17
18
www.keynote-sigos.com
Benchmarking
Who is the best performer?
KPIs for own network are regularly reported to senior management. But how does your network perform compared to the competitors? Who has the best performance? Who offers the highest quality of service (QoS)? What is the quality situation for your international traffic? In the competitive mobile environment, consistently high QoS is the deciding key. Benchmarking is an important dimension in making sure your services are competitive. National Approach Most measurement projects start off with a national performance investigation and comparison after national network rollout has been completed. Operators have to find innovative ways to outperform their competition on network and service quality.
With the SITE test system, network services can be benchmarked against the competition, measuring internationally approved and recognized Key Performance Indicators (KPIs) in a fast and easy way.
Static Test Approach Network benchmark assessment is executed using an active end-to-end test scenario to observe the performance of your network from a subscriber point of view. Typical static benchmarking tests are performed at airports, city centres, mega sports or social event venues and hotspots where masses of people congregate. On-the-Move Test Approach Drive Service tests have the ability to cover different geographical areas of locally competing networks rather than being focused on static locations. This simulates subscriber behavior moving from one cell to another and provides a comprehensive performance overview of the complete network. See your network through the eyes of your customer
International Approach In order to get a comprehensive overview of multinational or group-wide benchmarks, GlobalRoamers extensive global footprint can perform international benchmark tests and ensure improved cost efficiencies. Benchmarking of international carriers is an important step in ensuring high quality of service for the international traffic impacting your revenue.
Service performance is benchmarked with national competitors as well as international operators: Static testing Drive service testing Outbound roaming testing (e.g. GRQ)
www.keynote-sigos.com
19
Inbound Roaming
Provide best service to visitors in your network!
Today, subscribers expect all frequently used mobile services to work reliably everywhere in the world. Thus, the quality and availability of services inside and outside the home network becomes increasingly important in the battle for customers! Inbound roaming has a big impact on your revenue and a long list of international roaming agreements may be desireable. It comes at a cost: each and every roaming agreement with a new roaming partner requires intense testing according to GSMA standards. In addition, periodic roaming tests with the most important roaming partners need to be performed. How can efforts be reduced? Testing according to GSMA IREG standards is required whenever a new roaming partner is added. It can be a very time-consuming and exhaustive task. It may absorb your most expert staff and repetitive testing can be just as expensive as the initial test setup if performed manually! Therefore, test automation is key for cost effectiveness and operational efficiency. With the SITE system your staff will perform IREG specific tests in much shorter times with less effort and the results will be easily reproducible! Implementation of testing for new roaming partners could not be easier: the SIM card is implemented into SITEs SIM Multiplexer which can be expanded to a capacity of more than 2,000 SIM cards. As soon as the SIM card has been implemented, staff can run the necessary tests. Ready-to-use test cases are available for the execution of tests, according to IR 24, 26, 27, 29,32, 35, 50, 60. These tests can be repeated at any given time! The test results are automatically processed into GSMA conformant reports ready for evaluation.
20
www.keynote-sigos.com
The possiblility to travel the world quite easily is perceived as a matter of course nowadays. Traveling subscribers take availability and proper operation of all mobile services for granted. Outbound roaming contributes considerable revenue and therefore requires QoS assurance.
Operators require information on service quality beyond their own network. To subscribers, perceived mobile quality when traveling abroad is vital, especially for corporate customers. Mobile operators need to ensure subscribers are able to log onto preferred roaming partners networks when traveling, whilst preserving consistently high levels of QoS to maintain long term business sustainability. When your subscribers arrive at a foreign destination, they expect their mobile service to work at all times. All relevant services need to be tested with at least each top roaming partner. If you depend on these partners to execute these required tests, it will be a huge task, considering availability of staff, time zone differences and the like. The solution is the worlds largest automated on-demand test network: GlobalRoamer. Tests can be executed in more than 500 networks in three quarters of the worlds countries. GlobalRoamer is hosted by Keynote SIGOS and can be accessed from anywhere in the world by logging on through a web interface. Why risk losing subscribers and roaming revenue, when the ability to test the performance of all your roaming partners is at your fingertips? Standard services as well as complex technologies and services like Video Telephony, MMS and UMTS/HSDPA networks can be tested without the need for cooperation with your roaming partners and independently of time zone.
Use GlobalRoamer, the most extensive global infrastructure for automated active End-to-End testing hosted by Keynote SIGOS. With GlobalRoamer you can access an ever increasing number of world-wide networks through a web interface. Thanks to GlobalRoamer we were able to increase our outbound roaming capability dramatically in very short time. Get the full picture of your roaming services
LUP-avail.
GPRS-avail.
Speech
SMS
www.keynote-sigos.com
21
27 Active QoS parameters on voice, data and SMS traffic KPIs for five different categories:
Network access Service Accessibility Connection Establishment Connection Substainability Connection Quality
Why GRQ?
Common understanding about the criteria for measuring Quality of Service in outbound situations Developed and defined by GSMA Focus on periodic testing of service quality Applied for monitoring of top roaming partners
Key Benefits:
roaming partners by adherence to a shared set of QoS KPIs Improve operational cost effectiveness, by automated testing and realtime reporting Increased Roaming revenue through fast resolution of home and visited networks SLA violations
...
10 11 12 13 14 15
...
24 25 26 27
22
www.keynote-sigos.com
PMN B
PMN A
PMN C
One agreement
One relation
Clearing
Reduced complexity
Increased availability
PMN
PMN
PMN
PMN
PMN
PMN
www.keynote-sigos.com
23
VPMN A
Outbound Roaming
ed! Preferr
VPMN B
Outbound Roaming
HPMN
VPMN C
Outbound Roaming
HPMN MSC/VLR Non-Preferred VPMN 1 SoR node MAP messages Update Location UpdateLocation.error 4x UpdateLocation.error 5th attempt is on next VPMN; in this case the preferred PMN Update Location InsertSubscriberData InsertSubscriberData.ack Location Updating Accept UpdateLocation.ack HLR/ AuC
1 2 3 4
Preferred VPMN 1
KPIs (examples): Location Update Duration also delive- ring indication of deterioration of end user experience Number of PMNs rejected number of quad attempts or roaming not allowed rejects List of rejected PMNs non-preferred PMNs tried PMN after successful steering also indicating successful SoR at all LUP mode (automatic/manual) testing correct behavior of SoR Server for manual selection Reject Causes (i.e. Network Failure, PLMN)
24
www.keynote-sigos.com
Testing with prefixed called numbers requires knowledge about the current setup at the international gateway exchange. The deployment of an SS7 LU directly at the international gateway Exchange ensures dedicated interconnection carrier testing. Poor CLI and voice quality would inevitably decrease revenue and market share.
For example, if no CLI is received, there would be no possibility to call back and poor voice quality would result in short and frustrating conversations. Maximising revenue is essential in an environment of falling wholesale prices. This objective can only be achieved if you have consistently high quality on your network and on your international interconnection.
International Gateway
Interconnection Carriers
25
www.keynote-sigos.com
Originating Network
SIM Box Operators Local SIMs are used to terminate international incoming tra c
Terminating Network
Local Retail rate
(A) 0,14
(B) 0,10
GMSC
Air interface
BTS
(C) 0,15 Originating Networks: > PSTN > Mobile > VoIP > Carrier Select (CS) > Calling Cards > Carrier Pre Select (CPS)
Regular Transit
(D) 0,13
Terminating network operator loses 0,03 per minute, i.e. (B) - (D)
26
www.keynote-sigos.com
A common phenomenon is the scenario of Early or False Answer during voice call setup procedures. How do you detect and fight these cases? Calls are being charged as though connected without ever reaching the called party, or additional connection time charged. The lack of Active End-to-End monitoring has led to millions of minutes being inaccurately billed to the originating calling parties world-wide. These fraudulent billings sometimes go unnoticed because the incremental billed call duration per user may be in the fraction of seconds. Prepaid SIMs used in GSM Gateways (SIM Boxes) could lead to false answers when the fraudulent SIM Box SIM credit has been consumed resulting in an announcement being played. In this instance the caller has to pay for the call connection leading to customer complaints and dissatisfaction with the service rendered. Fight fraudulent charges to your customers accounts with GlobalRoamer, the world-wide distributed test infrastructure for end-to-end testing.
Benefits: Reduce revenue leakage caused by early charging / false answers Ensure billing accuracy and fight interconnect fraud Improve quality of calls leading to a reduction in customer complaints and dissatisfaction Active end-to-end monitoring ensures consistency in billing
International carrier(s) releases answer message even though call(s) are not setup Originating Network Terminating Network (CUSTOMER)
Setup Answer Fraudulent early return of Answer message resulting in charging record for non-delivered service Setup is not even sent to B-Party Call is not established International carrier(s) Setup
Unexpected answer on A-side detected and NO incoming setup on B-side International carrier(s) releases answer message even though call(s) are not setup Terminating Network CUSTOMERs SIMs (CUSTOMER) on Roaming
Setup International carrier(s) Setup Answer Setup is not even sent to B-Party Call is not establised Fraudulent early return of Answer message resulting in charging recod for non-delivered service
www.keynote-sigos.com
27
Revenue Assurance
Money makes the world go round what happens if your network rating and billing is not correct?
For all network operators validation of billing is of major importance. Operators must provide fair and accurate billing to the customer and also avoid revenue leakage or overcharges caused by services being incorrectly rated and invoiced. In most countries accuracy of metering and billing is mandatory to comply with legal regulations. As markets have become increasingly competitive, operators have used innovative tariffs, product and service bundles and discounts to differentiate themselves. Complex and fast changing tariffs inevitably create challenges in ensuring correct billing. Testing that is both end-to-end and independent can provide the assurance that the customers are being correctly billed as well as satisfying compliance requirements. Today, manual tests not only provide inaccurate, untrustworthy but in most cases cost inefficient testing. To ensure correct billing, a precise and reliable Revenue Assurance system is essential. With a SITE test system, continuous testing of all services provides maximum assurance that all calls are being correctly billed as each network element can be tested and verified.
28
www.keynote-sigos.com
CDR Testing
Timely detection of revenue leakages
You want a solution which compares CDRs generated by network nodes like the MSC or SGSN in a highly automated way and sends alarms mismatches. SITE acts as a Test Call/Event Generator, it is capable of importing live CDRs from the network and comparing them with the reference CDRs generated by SITE. The live CDRs of the generated test calls are extracted at a chosen point in postprocessing for automated comparison by the test system. CDRs can be verified and erroneous CDR fields such as faulty time stamps and call duration can be detected.
CDR Structure Record Type: e.g. TimeBased, VolumeBased, EventBased Service Type: e.g. SPEECH, FAX, GPRS Begin of event: timestamp in milli- seconds A Number B Number Call Duration (Time based calls) Data Volume (Volume based calls) Event Count (Event based calls)
Live Network
CDRs
Mediation System
CDR Postprocessing
SITE System Virtual SIM Transfer Automated E2E Call Processing (unrated) SITE CDRs (rated or unrated)
Filter*
Operator CDRs
CDR Import
Reference CDRs derived from SITE test results
CDR Import*
Live CDRs imported via e.g. csv- les
Reference CDRs
Live CDRs
Are Core Network nodes like MSC or SGSN generating the right CDR data? Deploy a test event generator which generates CDRs that you can compare with your network CDRs.
www.keynote-sigos.com
29
Tariff Testing
Proactively monitor tariff plans against variety of test cases
You want a solution which not only compares CDRs but also detects billing errors before they turn into customer complaints or revenue losses.
Rating
At the heart of the billing system is the rating engine. This takes the CDRs (call detail records) or IPDRs (internet protocol detail records) from the network, and then applies the appropriate rating plans to turn this information into rated CDRs ready to be associated with the customer.
Billing
Once a CDR has been rated it is applied to the customers account, where discounts can be applied and from which a bill is created. Operators usually produce bills in cycles, spreading the load over a month or quarter and also evening out cash flow. Within SITE your tariff model can be replicated. Thus, not only the raw data of CDRs can be compared but in addition also the correct billing of a service can be verified. Thanks to SITE, fast regression testing of new pricing plans against a variety of test cases can be performed, detecting potential flaws in the billing process at a very early stage.
Live Network
CDRs
Mediation System
SITE System
Billing
Operator CDRs
CDR Import
Billing Veri cation Rating
CDR Import*
Tari Model*
Reference CDRs
Live CDRs
Invoice comparison Resource allocation for different users or groups Detailed test reports Revenue stream audit Covering billing aspects of outbound roaming
30
www.keynote-sigos.com
Sample Features
Detection of revenue leaks due to SIM card recharging errors Increase of customer satisfaction and spen- ding due to error free SIM card recharging Simplified prepaid SIM card handling in the central SIM Multiplexer
Sample KPIs
Initial account balance Account balance after recharge Used Voucher for recharge Received USSD response string USSD process duration
www.keynote-sigos.com
31
32
www.keynote-sigos.com
IP Network Testing
Optimize your data network performance
Slow access, error pages and unsuccessful orders? Just started VoIP services? Are you relying on your customers to find out about incidents, availability, speed and load issues? Mobile has made its impact on connecting the last mile, particularly for voice communications, but has yet to make its impact on higher speed links and at least one mobile company has admitted that it cannot deliver the speeds contained in the 3G specifications. So where do fixed networks and IP connections coming with them win over radio-mobile? When capacities and speeds are high, where Internet access is required or where there are large files to be downloaded, then the optical fibre link remains supreme, whether it is a link to a corporate client, a national backbone network or an international submarine cable system.
SITE measures the user perception of your services SITE checks the quality of your calls in real time Use SITE for proactive supervision! Secure your IT with SITE End-to-End monitoring! SITE measures and alerts you in real time!
KPIs (examples): Duration between the rst and last http data packet HTTP Data Size Duration of web browsing session HTTP Valid Page Content
Ping (ICMP)
KPIs (examples): Round-trip time (min, mean, max) Packet loss Size of Ping packet
FTP SOAP
KPIs (examples): Response Time of SOAP server in seconds
KPIs (examples): Network Non-Accessibility File Size Download Duration Upload Duration IP Service Failure Ratio
TCP/IP Command
DNS
KPIs (examples): DNS Query Duration (min, average, max) DNS Host Name Resolution Time DNS Host Name Resolution Failure Ratio
www.keynote-sigos.com
33
Regression Testing
Another instance where connection direct to core network components is required is where tests need to be executed in a very short time. This is typically the case when network components like the MSC or SGSN have been updated or where the influence of a high number of concurrently connected subscribers has to be checked immediately and automatically. Such kinds of regression testing can usually be executed in less than 20 minutes whilst still covering all services and subscriber profiles.
Typical use cases for regression testing without radio access part:
Automated regression testing after upgrade/updates on: MSC (via GSM A) MSC and fixed network switches (via ISUP) SGSN (2.5G) via Gb MSC-Server via IuCS SGSN via IuPS SMSC, MMSC WAP-, Web-, Mail-Server SCP testing including IN services and prepaid services etc.
see page 2
34
www.keynote-sigos.com
Sports and Social Events: Testing campaign of short time frame and short notice. The Nomadic local unit is also ideally suited for short-term campaigns like sport events. A lot of sports fans gather at top level events like Formula 1 or soccer championships and expect high levels of service quality. Due to its fast installation the nomadic units can be quickly rolled out even at short notice. After easy deployment at temporary locations this autonomous system sends network information back via its air interfaces. Rural Areas: Where there are people there should be communication. Especially in remote areas it is often impossible to install local units, as no fixed IP connection is available. In this case the nomadic local unit is capable of establishing a permanent IP connection via GPRS/EDGE/HSPA modem. The connection is upheld via IPSec tunneling. By this means, test probes can be quickly installed in rural areas where you cannot rely on wired IP connections. The Nomadic local unit is the ideal solution for flexible deployment in the field.
www.keynote-sigos.com
35
36
GlobalRoamer
The Reference System for world-wide testing Largest footprint of world-wide test probes Managed and serviced by Keynote SIGOS Extensive set of test case applications
Roaming Testing
LU
CLU
LU
Fixed
IP Networks
Mobile
GO
P GR h wit AL B GLO
SITE
The Unique Test Platform for various technologies Mobile / Fixed / IP testing Core Network testing Globalize with GRP
37
GlobalRoamer
The On-Demand world-wide test platform!
Challenge
End users demand and expect a high quality, reliable service from their chosen network operator and a similar experience regardless of where in the world they are. Therefore, permanent surveillance of the roaming network is indispensable but extremely difficult due to a lack of operational visibility of the roaming partners networks.
Solution
GlobalRoamer allows you to verify that all services are available to your customers who are traveling world-wide. With test probes in 150+ countries you have your world wide testing platform without investing in infrastructure. Just buy your testing package and run your tests worldwide.
Managed Services are on offer to all Operators looking for an operationally efficient solution!
where they are virtually transmitted to any of GlobalRoamers remote test stations where the actual test is performed
network of test stations allows access to three quarters of the worlds countries and is continuously being expanded
38
www.keynote-sigos.com
NETWORKS
COUNTRIES
LOCATIONS
588
589
587
176
177
175
225
226
224
Enter the most extensive global network test system from your desk and gain access to:
GlobalRoamer is growing continuously. Please contact us for the current footprint and more details. Q4 2011
www.keynote-sigos.com
39
2003 2004 2005 2006 2007 2008 2009 2010 Networks Countries
40
www.keynote-sigos.com
Use Cases
Service Quality in outbound roaming (on-demand testing / periodic testing) Full range of QoS applications (Voice / SMS / Data) (page 14) Outbound Roaming Testing GRQ GSMA compliant testing (page 22) Steering of Roaming (SoR) Testing Evaluation of proper application of Steering of Roaming and detection of Anti-Steering activities (page 24) Fraud Detection for International Traffic SIM Box Detection, False Answer Detection (page 26) International Carrier Quality Testing Full range of QoS applications (Voice / SMS / Data) (page 25) Revenue Assurance in an international context CDR Comparison, Roaming Tariff Model Testing (page 28) International Interconnect Management CLI Verification, Voice Quality (MOS), Call Setup Time, Call Attempt Success rateetc. (page 25) Benchmark Testing in operator groups See how your network performs within one operator group (page 19) Service Level Agreement (SLA) Verification Verify the fulfilment of Service Level Agreements (page 22) Handset specific Testing in outbound roaming Automated content testing with a broad selection of simulated handsets (page 18)
Fraud Detection for National & International Tra c International Carrier Testing Outbound Roaming Testing Billing Testing for International Tra c World-wide Handset Speci c QoS Testing QoS Tools for Diagnosis & Reporting
Departments (Examples):
Service Quality Management Operation and Maintenance Roaming Billing Fraud Management Marketing Interconnect International Business Revenue Assurance
www.keynote-sigos.com
41
SITE
One platform for all your End-to-End test requirements
Challenge
Today, network operators are confronted with an extremely dynamic market and the challenges of keeping up with new technology, permanent surveillance of Service Level Agreements (SLA) and reducing cost whilst also maintaining customer satisfaction. Since these tests can be both, labor-intensive and costly they are too often neglected. To meet these challenges preventive and permanent Service Quality Assurance by means of End-to-End testing is essential.
Solution
Keynote SIGOS has developed the most advanced automated test system available on the market. SITE is the proven and flexible test platform for cost- and time-saving automated Active End-to-End testing. With SITE, telecommunication operators all around the world benefit from its unique versatility. SITEs modular structure and scalability ensure it can always be matched exactly to your requirements. In addition, your local SITE system can go global by connecting to the world-wide GlobalRoamer probes with our Global Resource Pool feature all in one go!
Why SITE?
experience (QoE) and act, instead of reacting to customer complaints Continuously monitor service availability, test and measure quality (KQI) and performance (KPI) Upfront testing ensures a smooth roll-out for new services and new technologies Initiate reproducible test cases which cannot be done with passive monitoring solutions Comprehensive network diagnosis, reporting and alarming Services can be tested before commercial release
Identification and localization of service and network can be achieved before actual service degradation and threat of revenue losses Reduced time and risks to install or modify network infrastructure by providing extensive recursive testing capability Reduced operating costs by automating monitoring, testing, and reporting; increased personnel efficiency; costs not correlated with network size and growth Number of test cycles is flexible
Network Services
Network Interfaces
SPEECH
Voice Voice Quality Suppl. Services IVR Push-to-Talk VoIP Echo
DATA
DATA IP (CS/PS) Web/Wap Browsing E-mail Streaming Video Telephony Video Quality Digital Rights Mgmt.
MESSAGING
SMS MMS Mobile IM iPhone BlackBerry
FIXED
ISDN S0 ISDN PRI S2m PSTN a/b
RADIO
HSPA UMTS Uu GSM Um EDGE CDMA 2000 GSM-R LTE Uu
IP
WLAN DSL Ethernet MM7 SMPP, UCP, CIMP SMPT / IMAP
CORE
IuCS / IuPS GSM Gb GSM A ISUP SS7 IN / CAMEL MAP (HLR/VLR)
42
www.keynote-sigos.com
What is SITE?
Existing equipment can be directly linked to SITE and controlled and monitored through the SITE system Software updates, configuration modifications and problem resolution are quickly and reliably performed by Keynote SIGOS SITEs modular structure software and hardware guarantees maximum flexibility in service and protocol testing From portable and Stand-Alone Systems in test laboratories to distributed systems covering the geography of an entire live network, everything is possible
SITE enables both, single technology testing as well as cross technology testing Mobile / Fixed / IP-based - all kind of combinations can be tested 2G, 2.5G, 3G and beyond all mobile network technologies can be tested SITE enables thorough testing of all relevant mobile and BlackBerry services, even taking handset specific characteristics into account if desired Voice Messaging Data Video Value Added Services
SITE provides test solutions for billing verification and other revenue assurance related applications
Roaming Testing
LU
CLU
LU
Fixed
IP Networks
Mobile
www.keynote-sigos.com
43
Central SIM Multiplexing Technology an Unparalleled Teleporter for SIM Cards SIM cards are centrally hosted and virtually transmitted to any of the systems remote test stations where the actual test is performed. SITE can handle thousands of SIM, USIM or Micro-SIM cards in cascade-style boards. Subscriber information from a SIM card is read out by the system and transmitted via a LAN/WAN network to any test location required. The SIM authentication procedure is handled virtually between the wireless interface in any location and the real SIM stored in the central SIM Multiplexer unit. Intuitive Workbench Tailored to Users Specific Demands Comprehensive set of tools are available for Test Creation, Diagnosis as well as Alarming and Reporting to adapt SITE exactly to user demands. (see page 50) Configurable user access rights User-friendly and intuitive Graphical User Interface which can be accessed from Windows and Linux platforms alike through the Inter- or Intranet. Role-based GUI views provide the right level of information and tools depending on the users role (Test / Report / GIS / Admin).
Test/Report
Network Expert Test Manager Test Case Designer
GIS
Admin
System Administrator
User role-based GUI always gives the right level of information to the user
Test Analysis
Test Admin
Test Design
GIS
The SITE Architecture Ensuring High-Performance, Security and Stability SITE runs on a stable, Linux based server solution offering highest standards of redundancy. SITE client workstations can be either Windows or Linux based. To ensure maximum performance, the SITE System uses an open SQL database. All configuration information, test results, measurements and KPIs are stored logically, to provide clear measurement and reporting capabilities. Using powerful filter functionality any database listing can be easily modified and a multi-format export function allows the sharing of data with other network support tools. Behind the Scenes SITEs Unique Test Management SITE can execute tests at any time desired. Via the scheduler window a single or group of tests can be defined once or periodically, based on very flexible selection criteria of date, day, time, frequency and number of repetitions. To avoid any resource conflict, an intelligent resource management system controls access to interfaces and SIM cards, assuring smooth operation and maximum test parallelism. The self-management checks system components regularly and generates an alarm (SNMP-Trap) in the event of any failure.
44
www.keynote-sigos.com
h wit L A LOB OG
P GR
Connect your local SITE system to the world-wide GlobalRoamer probes with the unique Global Resource Pool feature!
www.keynote-sigos.com
45
SIM Multiplexer
The SIM Multiplexer has an unlimited capacity to handle thousands of SIM cards at various locations all over the world. Any SIM authentication procedure is handled virtually between the wireless interface in any location and the real SIM stored in the central Multiplexer unit.
SIM Card Board
SIM Server 100-240 V 1A, 50/60 Hz Low power consumption Compact design, only 3HU Compatible for SIM, Micro SIM, USIM, R-UIM Automated voltage negotiation for each SIM card position
Remote Components
The remote units, also called local units, are installed wherever they are needed for 2G, 2.5G and 3G or core network tests. Local Units for fixed and stationary usage: Local Unit (LU) Compact Local Unit (CLU) SS7 Local Unit (SS7 LU) Gb Local Unit (Gb LU) IU Local Unit (IU LU) ISDN PRI Local Unit (ISDN PRI LU) Wireless Local Unit (WLU) Local Units for mobile usage: Mobile Local Units (MLU); 12V DC, 5A, typ. 40W incl. internal SIM Multiplexer incl. GPS module Nomadic Probe: 12V DC, 2A, typ. 20W incl. internal SIM Multiplexer incl. GPS module available in fixed, wireless and mobile mode
46
www.keynote-sigos.com
Test Interfaces
Keynote SIGOS SITE Test System supports the whole range of todays telecommunication networks. Testing them needs multiple interfaces which are integrated in the SITE systems. Sample interfaces: 3G UMTS/HSPA+ and 2G GSM/GPRS/ EDGE Voice & Data & Fax Supported frequency bands: 850/900/1900/2100 MHz Downlink up to 42 Mbps Uplink up to 5.76 Mbps
SS7 / GSM A, ISUP: 4 E1 (2048 MBit/s) trunks (RJ45 connectors), Impedance of 120/ 75 Ohm balanced/unbalanced Iu over IP: based on Ethernet IP, 4 x Ethernet Interface 10/100 Gb over IP: based on Ethernet IP, 4 x Ethernet Interface 10/100 Gb over E1/T1: 4 E1 (2048 MBit/s) trunks (RJ45 connectors), Impedance of 120/ 75 Ohm balanced/unbalanced CDMA2000 1X / EV-DO Supported frequency bands: 800/1900 MHz ISDN S0: B-Channel Protocols: like HDLC X.75, X.25, T.30, V.90,V.120 D-Channel Protocols: like ETSI-DSS1, NI-1, CT1, VN3, 1TR6, INS-64, 5ESS, Q-Sig
Sample Interfaces
ISDN S2m: B-Channel Protocols: like HDLC X.75, X.25, T.30, V.90,V.120 D-Channel Protocols: like ETSI-DSS1, NI-1, 1TR6, NET3, VN3/4/6, INS-64,INS- 1500 PSTN a/b: ITU-T Modem Compatibility, Fax Compatibility All Components: Developed by Keynote SIGOS, made in Germany.
www.keynote-sigos.com
47
48
Diagnosis Tools
> Service Alarm Map > 3G Layer 3 Tracing
49
Online Reporting
Reporting Alarming
Test Executions
KPI Database
Report De nition
All solutions of SITE and GlobalRoamer Reporting allow the users to observe KPI performance in an optimal way: analysis of trends / analysis of incidents based on locations or based on service problems.
50
www.keynote-sigos.com
Dashboard
This Graphical User Interface (GUI) system tool provides a simplified intelligent interface to SITE and GlobalRoamer reporting. It is of special interest to the people responsible for the service, who want to work intuitively without any training effort. KPIs can easily be filtered and individually stored in a few clicks. Individual configurations allow additional, more customer-oriented, data analysis. Fast and easy drill down to individual traces is possible directly from the Dashboard.
Matrix Report
The Matrix Report environment allows the user to view Key Performance Indicator (KPI) data as a numerical value, which can be easily color coded to provide a quick, easy to understand overview of network performance. Service KPIs can therefore be displayed in a format which is especially useful for Network Management and Operations personnel.
GIS
For service testing on the move, a map based Geographical Information System (GIS) is integrated into SITE. Each drive test case collects position data from a GPS receiver during visibility of GPS satellites. These are displayed in a GIS. This means that after service testing a rich set of KPIs according to GPS data can be locally analysed displayed on geographic maps.
www.keynote-sigos.com
51
Control Structure
The Control Structure enables test users to easily create tests at various locations and with different SIM cards. It uses the logical operators: list based FOR EACH condition based REPEAT time based WAIT
SITE Recorder
This Tool allows intuitive automated recording of browsing actions taking handset characteristics into account. Mobile and provider specific web and WAP pages are retrieved from the network via the test probes during recording sessions to get a feel for real download behavior and latency. Traces are shown live while the developer is browsing. The test case can be evaluated before saving the entire browsing session for replay. Full feature support by the Test Case Editor makes later adaptation of recorded browsing sessions easy. It is like having full and instant remote control access to a specific handset or browser in a remote location with no need to travel anywhere to use it.
Test Sequence
The goal of the test sequence concept is to save execution time by avoiding the resource consuming location update process being repeated for each subsequent test case. Usually a test case starts with a switched off mobile terminal. The side-effect of this approach is that each test case has the following procedure: location update make a call (service test 1) switch off Each of these steps often require more than one minute each to complete. For saving test execution time, an arbitrary number of service tests can be combined in one test sequence, which requires only a single location update. This effectively simulates typical mobile user behavior e.g.: switch on a mobile (location update) make a call (service test 1) send an SMS (service test 2) web browsing (service test 3) make a call (service test 4) switch off
52
www.keynote-sigos.com
Diagnosis Tools
Keep the overview or go into details!
Service Alarm Map
The Service Alarm Map is used to visualize mobile network services that target a specific service area. Alarms that are generated by the failure or degraded performance of services can be linked to a specific network element within the operators infrastructure. This function is implemented by careful correlation between the specific elements used within a test case execution and the overall network topology which has supported the test scenario that generated the alarms.
KPIs Alarms
An example could be a WAP test initiated from a wireless interface located at latitude (x), longitude (y). The topology for this scenario would use specific BTS/node B, BSC/ RNC infrastructure, assigned to an MSC/ SGSN finally reaching a specific content portal. Each piece of network information and trace is processed to provide significant data on the actual network performance and functionality, finally the data is combined to give a total service area view.
Report Traces
Drill Down
SERVICE View With Service view you get an easy high level overview about the status of the whole network. DETAILS View The Details view is accessed via single network elements of the Service view. It shows exactly which test case leads when to which failures.
3G Layer 3 Tracing
Deeper insight into message flow with 3G Layer 3 tracing
Keynote SIGOS offers 3G Layer 3 tracing which is very important for telecommunication network testing. The primary goal is to get a deeper insight into the message flow and the protocol data exchanged between mobile station and network. On Qualcomm-based 3G mobile probes Keynote SIGOS records traces of the Layer 3 Non-Access Stratum (NAS) signalling messages sent and received by the mobile. The information contained in these traces is vital for monitoring and troubleshooting the communication between mobile station and core network. Optionally, the NAS traces are supplemented with traces of Radio Resource Control (RRC) signalling messages exchanged between the mobile and the 3G radio access network. These RRC traces provide valuable additional information, facilitating monitoring and troubleshooting of the Access Stratum (AS) as well.
www.keynote-sigos.com
53
54
Messaging
> SMS > MMS > Mobile IM
Data
Video
55
Network Registration
Fundamental for all mobile services!
Each mobile subscriber wants to be able to communicate in the cellular telecommunications network without having to consider whether the network technology is 2G, 2.5G or 3G. This requires a successful mobile device registration on the base station subsystem (BSS). This is always the first step for further communication. Even if a call is not set up, the network needs to be able to communicate with the mobile handset to pinpoint where it is. Hence, a mobile network is divided into multiple cells (Base Transceiver Stations BTS). And a group of cells is considered a location area. A mobile device in motion keeps the network informed about changes in different location areas. If the handset moves from a cell in one location area to a cell in another location area, the mobile device should perform a location area update to inform the network about the new location of the mobile device. Each Keynote SIGOS test case requires this successful network registration.
Location Update procedure is performed: when the mobile device has been switched off and wants to become active, or when it is active but not involved in a call, and it moves from one location area to another, or after a regular time interval because of signal fade
Some aspects of the registration procedure:
make contact with the base station the mobile device registers to the network for access
Sample KPIs
Location Update Duration Received Signal Code Power RX Level Service Type GPRS Attach Duration PDP Context Activation Duration
Network location registration is not only necessary for each call, but also for location based services like friends-finder!
56
www.keynote-sigos.com
Identification
Authentication
Ciphering Mode-Activation
Identification
Authentication
Ciphering Mode-Activation
57
Voice Services
The basic elements for telecommunication!
Voice
Do not ignore your core services!
Voice services are fundamental to telecommunications companies. It is vital that the user experience of these services is measured continuously by active testing. Only this can assure the quality of this core service. Verification of various KPIs are performed on basic voice parameters, such as checking B-channel availability, measuring call establish duration and call success rate alerts, to name a few.
Sample Features
CLI Check Call establishment to external party Call establishment between two parties Call establishment without answer on external side (no connective costs) B-Channel check Check of all available PLMNs
Sample KPIs
Call Duration Received CLI Establish Duration Alert Duration
Push-to-Talk
Back to the Future with Push-to-Talk!
The push-to-talk services turn mobile phones into walkie-talkies with unlimited range. The benefit of radio-style communication, especially broadcasting to multiple users, makes it much more convenient than making many phone calls or even call conferencing.
Sample Features
Test 1-to-1 or 1-to-many communication
Sample KPIs
Stop-Talking Timer Failure Ratio Stop-Talking Time Session Cut-off Ratio Session Setup Time Voice Delay (in session) Voice Delay (first)
Play and record speech data Emulating PTT mobiles Real End-to-End Testing of real-time-always-on voice service Check SIP (Session Initiated Protocol) Control Plane
Photo T-Mobile AG
58
www.keynote-sigos.com
Sample Features
Testing IVR trees Voice mailbox tests Resource allocation for different users or groups Announcement comparison based on new voice prompts Easy integration of new voice prompts DTMF and voice stimulation Customer specific extension Several languages available
Sample KPIs
Call Duration Duration of played audio file Length of recognized reference prompt Duration of recognition process Recognition confidence of best recognized Reference prompt Recorded audio file location Real duration of recording
Supplementary Services
Compliments on your supplementary services?
Supplementary services like call forwarding, call waiting, call barring, call hold, CLIP/CLIR are multi-switched services which require complex interaction within the network and its elements. Other supplementary services, like prepaid customers checking their current account balance, involves the GSM protocol USSD (Unstructured Supplementary Service Data). At the same time, seamless and instant operation of all supplementary services, including notifications and coding of all relevant information are vital for a satisfying end-user experience. Keynote SIGOS Test Systems provide you with a comprehensive range of test cases for all relevant KPIs and the ability to test USSD protocol commands as well as operator specific extensions, so that your customers will pay you compliments on your supplementary services!
Sample Features
Supplementary Service tests e.g. Call Forwarding Call Hold Call Barring CLIP / CLIR Call Waiting Multi Party Call DTMF and voice stimulation testing USSD testing
Sample KPIs
Forward Erase Duration Forward Register Duration Received CLI Barring Activation Duration Call Hold Duration USSD Received Response
www.keynote-sigos.com
59
Voice Advanced
Do you offer excellent Voice Quality?
Voice Quality
Do you offer excellent Voice Quality?
Voice Quality is, and will remain, the major key performance indicator for each operators network quality. This is recognized by subscribers and operators alike. Bad voice quality represents noise, echo, degraded tele-conversations and immediately sets a poor level of user satisfaction. International Carrier Voice Quality tests can reveal crucial quality information of different network carriers and if it has been impacted by the usage of IP routing or SIM boxes. Therefore, verification of voice quality is essential. Automated test methods with the intention to mimic subjective tests, allow for a cost effective and consistent alternative to subjective testing, either on a referenced or an unreferenced algorithm. Voice Quality Referenced VQ (PESQ/POLQA) Unreferenced VQ (3 SQM) Echo Testing Voice over IP Quality Testing
Echo Testing
In the course of the migration of 2G/3G Core Network (CN) and Radio Access Network (RAN) towards IP based transport solutions the importance of Echo measurements raises considerably. In SITE, the echo itself is generated artificially and its characteristics can be configured by the user. This allows for the simulation of well defined (acoustic) echoes that enables users to check whether the echo cancellers are configured correctly. Sample KPIs
Echo Return Loss (ERL) in dB Echo Delay in ms Echo Classification (acceptable, unacceptable, side tone)
Sample Features
Reference speech quality assessment model Accurate full-reference model Customer specific audio reference files are easy to integrate Objective Mean Option Score / Perceptual Evaluation of Speech Quality (MOS-LQO / PESQ) MOS Voice Quality result values from 1-5 Support of super-wide-band signals up to 14kHz
60
www.keynote-sigos.com
Sample Features
Perceptual analysis of degradations in voice signals Non-intrusive, single ended analysis method Output score correlates well with subjective MOS Available as DLL/Library or Source
Sample KPIs
3SQM MOS value Noise level Background noise Beeps Signal to noise ratio
Voice Quality Referenced VQ (PESQ/POLQA) Unreferenced VQ (3 SQM) Echo Testing Voice over IP Quality Testing
Additional KPIs
RTP Jitter RTP Packet Loss
www.keynote-sigos.com
61
Messaging
Are your Messaging Services delivered reliably and on time?
Short Message Service (SMS)
Still the favored message service!
SMS is the world-wide killer application for network operators. This simple network application results in large percentages of revenue for every mobile network operator. Therefore, this critical revenue stream would require constant active monitoring so as to achieve consistently high quality of service. SMS often suffers from long delivery durations, modification of content or missing text with multiple SMS messages. Due to roaming complexities, SMS messages may be lost resulting in non-delivery of the service paid for by the subscribers.
Sample KPIs
SMS send duration SMS deliver duration SMS end-to-end duration SMS Success ratio
62
www.keynote-sigos.com
Sample KPIs
MMS send duration MMS fetch duration MMS push arrival to receive MMS Duration MMS connection to send duration MMS send to push arrival duration MMS end-to-end duration MMS Success ratio
Mobile IM
Can your customers chat via Mobile Instant Messaging?
The real time text based communication between two or more participants is popular on PC devices, e.g. Skype, ICQ, MSN, Yahoo, Google etc. This instant messaging platform has made the leap from the PC to the mobile device, connecting friends, peers and colleagues while they are on the go. To get connected to either fixed or mobile IM users, Java applets are installed on mobile devices delivering branded IM user interfaces. A single device client may provide access to multiple IM systems which transmit and receive presence information. The device clients have to be compliant to the Open Mobile Alliance (OMA) Instant Messaging and Presence Service (IMPS).
Sample Features
Registration at the IM server Successful login Get presence-information of other users and whether two parties can see each other Text message receipt from IM server Successful logout from the IM server
Sample KPIs
Time of OMA IM Login Request Session ID given from IM server Time when a party sends the message Time of OMA IM Logout Request
www.keynote-sigos.com
63
Data
Boost your trusted data communication!
Data IP
Do you meet your subscribers demands with GPRS, EDGE, UMTS and HSPA Data Services?
Over the Air (OTA) IP data services offer subscribers a highly effective way to connect to a dynamically rich world filled with internet based services such as Email, Instant Messaging, websites, VoIP and much more. GPRS represents the first step towards faster access provided via EDGE, UMTS, HSPA (HSDPA / HSUPA). To maintain this flexibility in speed, network operators have to deal with the operation and maintenance of multiple technologies. This complexity drives up costs. To increase revenue and service quality, SITE and GlobalRoamer offer data tests to access all available technologies via dedicated interfaces to discover service performance and functionality problems.
Sample KPIs
PS: GPRS Attach Duration GPRS access point PDP context activation Duration PDP setup Connect Duration PDP IP UP Duration
Sample Features
DNS request Download URL HTTP browsing FTP upload / download Ping a host TCP/IP command Transfer rates measuring
CS: CSD Dialin Duration CSD connect assign IP Duration Download: Downloading Duration Download Rate FTP: Downloading Duration Uploading Duration Mean Download Rate
64
www.keynote-sigos.com
E-Mail
Modern life is unthinkable without E-Mail!
Subscribers not only need voice communication, they also want be in contact with friends and colleagues via mobile E-mail. In order to gain acceptance as a reliable service frequently used by the subscribers, network errors must be avoided and uncovered by performing active continuous tests. The question is, whether mobile E-mails are delivered on time to the receivers designated email addresses. Keynote SIGOS Test Systems provide E-mail testing via multiple interfaces, like GSM Um, GSM Gb, 3G UMTS Uu or Iu PS. It can be checked whether a mobile E-Mail can be sent and received via a POP3 / IMAP / SMTP server. The mobile E-Mail would be sent via Simple Mail Transfer Protocol (SMTP) to an E-Mail server and fetched via Post Office Protocol version 3 (POP3) or Internet Message Access Protocol (IMAP). Sample Features
Mobile E-mail upload and download from an E-mail server Interfaces: GSM Um, GSM Gb, 3G UMTS Uu or Iu PS SMTP server POP3/IMAP server
Sample KPIs
Mobile E-mail address Mobile E-mail size Mobile E-mail fetch duration Mobile E-mail send duration Mobile E-Mail End-to-End Transaction Time with Notification Mobile E-mail success ratio
Sample KPIs
HTTP data packet duration HTTP data size Web Browsing duration GPRS access point PDP context activation duration PDP setup connect duration PDP IP UP duration
www.keynote-sigos.com
65
Video Services
Provide your customers more than moving color pixels!
Video Telephony
Do you provide reliable video telephony in 3G UMTS?
High quality for Video Telephony using 3G UMTS is an absolute must, without which it is used perhaps once, and then never again by your subscribers! The premium cost paid for the use of UMTS service will most often increase customers expectations regarding quality of service rendered. Due to competitive pressure, it is mandatory for wireless service providers to increase their subscribers average revenue quickly by successfully launching new services such as video telephony. At the same time, they must maintain the consistent high quality their customers have come to expect. The implementation of this technology often involves complex interaction between network nodes supplied by different manufacturers and therefore constant automated testing should be applied to check initial configurations, and then provide active continuous monitoring of the service.
Sample KPIs
Video send duration Video call duration Video file size Audio send duration CS Bearer establish duration
Sample Features
Real End-to-End (mobile-to-mobile) Video Telephony Usage of standard 3G UMTS interfaces no special hardware required Usage of standardized or customer specific video/audio sequences Usage of a market leading protocol stack
66
www.keynote-sigos.com
Video Quality
Is your network Video Quality excellent?
3G UMTS opened a world of possibilities with multimedia applications. Customized infotainment like streaming video, video messaging, mobile TV and video telephony offer a unique opportunity to create a market for highly personalized and truly inimitable mobility services. For mobile customers the quality of services is decisive for acceptance; especially for motion picture based services, quality is the key factor of success. Keynote SIGOS Test Systems deliver perceptual quality measurements to reproduce subscribers quality impression mapped to the mean opinion score (MOS), similarly to other quality tests. Be sure that your networks new multimedia applications are more than just moving color pixels. Sample Features
Testing IVR trees Real End-to-End Testing of real-time video services (video telephony, video streaming, video messaging) Objective MOS Video Quality result values from 1 - 5 (1-bad, 2-poor, 3-fair, 4-good, 5-excellent) PEVQ analysis is based on human model of visual perception
Sample KPIs
MOS value Delays Brightness Contrast Distortion indicators
Streaming
What about your Streaming service?
Today, almost every major event, e.g. sport, news or society events can be accessed via real-time multimedia streams on a mobile phone. These multimedia applications become more and more important in the wireless and mobile community. To make sure that customers can enjoy these exciting premium services, it is most important to guarantee an impeccable streaming service. Using the industry standard protocols RTP and RTSP, the Keynote SIGOS Test Systems are up-to-date with the latest technology. Scheduled and continuous active testing ensure that multimedia streams deliver the desired contents and the required quality even to the largest possible groups. Sample Features
Parallel subsessions per stream, e.g. video and audio Send streamed multimedia over IP TCP or UDP transport protocols Measurement interval in multiple of 100 milliseconds Used industry standard RTP/RTSP
Sample KPIs
RTSP packets loss percent video RTSP packets loss percent audio RTSP packets received video RTSP packets received audio
www.keynote-sigos.com
67
68
www.keynote-sigos.com
Sample KPIs
Media Download Purchase Time Download Session Time Download Media Object Access Time
www.keynote-sigos.com
69
Sample Features
Real End-to-End testing of BlackBerry push service Testing carried out using a commercial BlackBerry device Check sending and receiving e-mails Check the BlackBerry device integrated email features Using BlackBerry devices with a java application for reflector code for sending emails Management notification and reporting
iPhone
Up with the hype on iPhone tests
For many users, the iPhone and the 3G iPhone represents a new era of mobile phone interaction and services. The unique combination of multimedia content, intuitive multi-touch display controls, accelerometer and much more created strong demand for new operator services dedicated only for a unique group of users. Operators around the world specify this group of iPhone users as high-tech high potential customers with distinctive technology and quality demands. The unique services offered for this iPhone customer base like the Visual Voice Mailbox create additional quality process demands at each network operator.
70
www.keynote-sigos.com
Photo T-Mobile AG
Keynote SIGOS Test Systems offer dedicated iPhone tests to fit simply into all QoS test procedures performed via SITE or GlobalRoamer without any additional effort. At the same time, measurements and KPIs provide clear evidence of the service availability and performance focussed on this group of high-tech high potential customers. Sample KPIs
Duration Failure Rates
SMS noti cation: new message Call the Mailbox Download message from Mailbox
Visual voice
Mailbox
Handset Simulation
Do handsets work perfectly in your mobile network?
The opportunity for mobile operators to sell exciting new mobile content and handsets is enormous, but the variety of available services like MMS, Video Streaming and Web Browsing may cause problems when using different handsets. How can these new devices and services be properly tested in a cost-effective way that ultimately leads to increased revenue and customer satisfaction? We can help you with a powerful tool to test all your services, simulating the large variety of handsets in your network. No labor intensive and high-cost manual testing! SITE tests specific handset characteristics against network services and device specific monitoring of pages with fixed content/ URLs. The following important content questions are validated: Color Support: Check if device is capable of displaying colored images Image Size: Comparison of all downloaded images with maximum height and width of the device Content Support: Check (based on HTTP/ WTP accept header) if device can decode downloaded content Data Format: Check if the downloaded content is valid
Sample Features
Intuitive Recording of browsing actions No drag n drop anymore Support of HTML forms Easy creation and adaptation of browsing sessions Received page content at a glance KPIs for each browsing action User defined measurements / KPIs can be added with Test Case Editor Whole session can be Replayed during development to evaluate the test case
www.keynote-sigos.com
71
72
Managed Services
Training
Consulting Services
73
Managed Services
We take the load off your shoulders! Flexible and Customizable
Test Infrastructure Management
Reduce your effort in system administration with TIM
Administration & Management of your SITE test system Providing & hosting of GlobalRoamer, Keynote SIGOS world-wide test environment
Performance Tests
QoS Monitoring
GlobalRoamer
World-wide test infrastructure
SITE
System Hosting Administration Maintenance
GlobalRoamer Keynote SIGOS hosts, maintains and constantly expands the worlds extensive test infrastructure, GlobalRoamer. Customers simply log on to the system via web interface and get access to an ever-increasing number of networks and locations for their outbound roaming testing. SITE If you are looking for the benefits of the most comprehensive active end-to-end test system but dont want to look after the infrastructure, let us do the job for you. Keynote SIGOS experts take care of the administration of your SITE testing infrastructure while you can fully concentrate on your business. We offer a fully hosted service at the Keynote SIGOS premises (e.g. hosting and maintaining your SITE Central Unit and other core components).
Performance Tests Ensure end-to-end Quality of Service through delivery of Key Performance Indicators (KPIs) prepared for you by Keynote SIGOS. To reach a snapshot like view, a large number of tests in a short period of time (a few days or weeks) is executed and analyzed by Keynote SIGOS. The results are presented as combination of reports, graphs and text documents and can be the foundations for your benchmarks. QoS Monitoring With Keynote SIGOS you can easily prepare a long-term testing environment to ensure and monitor your Quality of Service. As an example, many customers constantly monitor the 50 to 100 most important roaming partners. Automatic tests and reports on Key Quality Indicators (KQIs) are prepared according to the customers wishes. Trained Keynote SIGOS experts manage reports for troubleshooting and provide test results in an easy to read format. SITE Tools like Dashboard and Service Alarm Map give significant data on the actual network performance and functionality. Quality of Service monitoring with Keynote SIGOS is an indispensable way for all departments of an operator to ensure high-class quality at all times.
www.keynote-sigos.com
74
Roaming Steering Tests Test the functionality of steering programs. A number of location update tests in steered countries/networks are performed. The tests are examined by Keynote SIGOS to discover whether the steering works as expected. From the distribution of tests over different networks it is determined whether the planned steering ratios between different networks are fulfilled.
(page 24)
Carrier Quality Tests It is of primary importance that Operators and Carriers offer high quality transmission services. Operators can use Keynote SIGOS to help ensure that their end customers enjoy the best possible quality services. By constantly monitoring the transmission quality of all connected carriers, traffic can be routed intelligently to the best available. Carriers are interested to manage their SLAs with the Operators and to maximise the volume of traffic coming from each operator. Since Operators may well route traffic away from any carrier delivering poor quality transmission then the carriers have a vested interest in measuring their transmission quality. Keynote SIGOS can support carriers in understanding and monitoring the transmission quality of traffic to more than 500 operator networks world-wide.
(page 25)
GRQ Tests Based on general experience of the outbound roaming market 80% of outbound roaming revenue comes from the top 20 roaming partners. For this reason the GSM Association recommends regular monitoring of service quality during outbound roaming with these top roaming partners. Keynote SIGOS has implemented a world-wide test system capable of measuring, reporting and alarming all aspects of roaming service quality using standard prepared test scenarios which can be used to regularly test, monitor and report on service quality in these top roaming partner networks using the SIM cards of the interested operators. Keynote SIGOS supported several operators during the GRQ trial phase and has successfully proven to be fully compliant to the GRQ framework.
(page 22)
Fraud Bypass Detection The internationally installed Keynote SIGOS Test Systems can be used for Interconnect Fraud Bypass detection services. Access to alerts and detailed trace information is possible in real time allowing blocking of SIM Box numbers rapidly. All tests are provided as a fully managed service. Powerful reporting techniques allow benchmarking of SIM Box issues against historical values.
(page 26)
www.keynote-sigos.com
75
Consulting Services
Customized for all your specific needs!
Strategic Consulting
With two decades of experience in the field of telecommunications testing we can provide you with the unique service of high-level strategic consulting. Our Senior Telecommunications Experts are available for strategic assessments and solutions development workshops to provide thorough and comprehensive answers to the question like: How does end-to-end testing fit into our service quality assurance procedures? Book this service as an approximately 2-day workshop.
Engineering Consulting
If you have the concept and the right tools, you need an efficient implementation for your business. Therefore Keynote SIGOS offers: Support of customers for the OPERATION of SITE or GlobalRoamer scheduling of periodic & ad hoc tests according to customer regulations scheduling of periodic & ad hoc reports analyses of failures analyses of trends preparation of specific reports (e.g. test campaigns, management reports, department specific reports) Support of customers for the ADMINISTRATION of SITE *) administration of the SITE system data base management alarm management hard- and software maintenance backup and software-updates *) For GlobalRoamer, engineering consulting in administration is not required since GlobalRoamer is fully hosted and administered by Keynote SIGOS.
Senior Consulting
Get the most out of your Keynote SIGOS test system right from the start. With our Engineering Consulting services, our system experts assist your team during the introduction phase of your Keynote SIGOS solution. Our system experts share their knowledge with your team on the job especially for a question like: How to implement service testing or fraud testing into our business processes? Book Senior Consulting service for the duration of weeks or months, depending on the suitable concept.
Support
SITE Warranty E-mail Support - A fast and reliable way to get clear answers and step-by-step instructions should you experience problems Support Hotline direct communication with Keynote SIGOS professionals (Monday Friday during business hours (CET); 24/7 for premium service subscribers) Fax to Keynote SIGOS Support Keynote SIGOS Trouble Ticket System (OTRS) Web based access for monitoring customer ticket status online
76
www.keynote-sigos.com
Kic
kO
e ff M
n Pla
ple
ste Sy
ce Pu
O to n i t
www.keynote-sigos.com
77
Training
Wherever you want, with specially trained experts!
Training
On-site at your locations or at our training center!
Keynote SIGOS offers a comprehensive range of training to users of SITE and GlobalRoamer. Training can be scheduled on demand on your own site or at the Keynote SIGOS training center in Nuremberg, Germany. Keynote SIGOS training is designed for maximum efficiency. Thats why we limit the seats for each session.
Public Training
The new cost-effective alternative to on-site training!
The Keynote SIGOS Public Training Program is the cost-effective alternative to private on-site training. Benefit from our trainers hands-on expertise being brought to various word-wide locations in a modular concept. Book your public training seat today!
Reporting & Diagnosis - Advanced User Training - Advanced Reporting & Diagnosis - Base
Administrator Training Test Case Editor Training
78
www.keynote-sigos.com
Index
Index
Keyword Page Keyword Page
3 G Layer 3 Tracing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53 3SQM . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61 Administration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76 Alarming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50 Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55 Benchmarking . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19 Billing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28 BlackBerry . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70 Carrier Quality Tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25 Carriers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 75 CDR Comparison Testing . . . . . . . . . . . . . . . . . . . . . . . . . 29 Central Unit . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 Compact Local Unit (CLU) . . . . . . . . . . . . . . . . . . . . . . . . 46 Consulting Services . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76 Content Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18 Control Structure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52 Core Network Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34 Dashboard . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51 Data IP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64 Diagnosis Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53 Digital Rights Management . . . . . . . . . . . . . . . . . . . . . . 69 Drive Service Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17 Early Charging Detection . . . . . . . . . . . . . . . . . . . . . . . . . 27 Echo . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60 Email Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65 Engineering Consulting . . . . . . . . . . . . . . . . . . . . . . . . . . 76 Fixed Network Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32 Fraud Detection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26 Gb Local Unit (Gb LU) . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 GIS (Geographical Information System) . . . . . . . . . . . 51 Global Ressource Pool (GRP) . . . . . . . . . . . . . . . . . . . . . . 45 GlobalRoamer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38 GPRS Attached . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57 GPS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51 GRQ Tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22 GSMA . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22 GUI (Graphical User Interface) . . . . . . . . . . . . . . . . . . . . 51 Handset Oriented Testing . . . . . . . . . . . . . . . . . . . . . . . . 70 Handset Simulation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18 Hardware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 Hotline . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76 Inbound Roaming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20 Indoor Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35 Interactive Voice Response (IVR) . . . . . . . . . . . . . . . . . . 59 Interconnection Carriers . . . . . . . . . . . . . . . . . . . . . . . . . 39 Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42 International Carrier Quality Testing . . . . . . . . . . . . . . 25 International Gateway . . . . . . . . . . . . . . . . . . . . . . . . . . . 25 IP Network Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33 iPhone . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70 IREG 24, 26, 27, 29, 32, 35, 50, 60 . . . . . . . . . . . . . . . . . . 20 ISDN PRI Local Unit (ISDN PRI LU) . . . . . . . . . . . . . . . . . 46 Local Unit (LU) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 Location Update . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57 lu Local Unit (lu LU) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 Maintenance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76 Managed Services . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74 Matrix Reporting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51 Messaging . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62 MMS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63 Mobile Instant Messaging (Mobile IM) . . . . . . . . . . . . 63 Mobile Local Unit (MLU) . . . . . . . . . . . . . . . . . . . . . . . . . . 46 Mobile Network Operators . . . . . . . . . . . . . . . . . . . . . . . 39 Mobile Virtual Network Operators (MVNO) . . . . . . . . 39 Network Diagnosis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16 Network Registration . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56 Network Structure (of SITE) . . . . . . . . . . . . . . . . . . . . . . . 2 Nomadic Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35 On-Demand Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15 Open Connectivity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23 Outbound Roaming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21 Performance Tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74 Periodic QoS Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14 PESQ/POLQA . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60 PEVQ . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67 Portfolio . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10 Prepaid SIM Recharging . . . . . . . . . . . . . . . . . . . . . . . . . . 31 Project Engineering . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77 Project Implementation . . . . . . . . . . . . . . . . . . . . . . . . . . 77 Project Management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77 Push-to-Talk . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58 QoS Monitoring . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74 Regression Test . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34 Regulators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39 Reporting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50 Revenue Assurance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28 Revenue Leakage & Fraud Detection . . . . . . . . . . . . . 26 Ring back tone . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 68 Ring tone download . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 68 Roaming Hubbing Testing . . . . . . . . . . . . . . . . . . . . . . . . 23 Roaming Steering Testing . . . . . . . . . . . . . . . . . . . . . . . . 24 Roaming Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20 Senior Consulting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76 Service Alarm Map . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53 Service Quality Monitoring . . . . . . . . . . . . . . . . . . . . . . . 14 SIM Box Detection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26 SIM Multiplexer (Hardware) . . . . . . . . . . . . . . . . . . . . . . 46 SIM Multiplexing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44 SITE . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42 SITE Recorder . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52 SLA Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22 SMS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62 Speech . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58 SS7 Local Unit (SS7 LU) . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 Strategic Consulting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76 Streaming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67 Supplementary Services . . . . . . . . . . . . . . . . . . . . . . . . . 76 Support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 59 System Hosting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74 Tariff Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30 Test Call / Event Generation . . . . . . . . . . . . . . . . . . . . . . 28 Test Case Editor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52 Test Creation Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52 Test Infrastucture Management (TIM) . . . . . . . . . . . . . 74 Test Operations Management (TOM). . . . . . . . . . . . . . 74 Test Sequence . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52 Test Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49 Training . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 78 Value Added Services (VAS) . . . . . . . . . . . . . . . . . . . . . . 68 Video . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66 Video Quality . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67 Video Telephony . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66 Voice . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58 Voice over IP Quality Testing . . . . . . . . . . . . . . . . . . . . . . 61 Voice Quality . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60 WAP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65 Warranty. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76 Web Browsing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65 Wireless Local Unit (WLU) . . . . . . . . . . . . . . . . . . . . . . . . 46
www.keynote-sigos.com
79
Some of o ur w or ld -
d wi
Fon +49 (0)911 9 51 68-0 Fax +49 (0)911 9 51 68-355 info@keynote-sigos.com www.keynote-sigos.com
anoris. 10.2011