You are on page 1of 82

PRODUCT GUIDE

Various Technologies ONE Test System: SITE


Abbreviations
BSC BTS CDR CIMD GGSN GMSC GPRS GSM HLR IP ISDN ISUP LTE MGW MMSC MSC PBX PoC PSTN RNC SGSN SITE SMPP SMSC UCP UMTS UTRAN VLR Base Station Controller Base Transceiver Station Call Detail Record Computer Interface to Message Distribution Gateway GPRS Support Node Gateway MSC General Packed Radio Service (2.5G) Global System for Mobile Communications (2G) Home Location Register Internet Protocol Integrated Service Digital Network ISDN User Part Long Term Evolution (4G) Media Gateway MMS Center Mobile Switching Centre Private Branch Exchange Push-to-talk over Cellular Public Switched Telephone Network Radio Network Controller Serving GPRS Node SIGOS Integrated Test Environment Short Message Peer to Peer Short Message Service Center Universal Computer Protocol Universal Mobile Telecommunications System (3G) UMTS Terrestrial Access Network Visitor Location Register

DSL WLAN Ethernet

IP

etw PN

o rk

GG
Gn/Gp

SN

SG

SN tcke it Sw

d che

Co

Pa
S1/S11 luPS Gb

Gs

Gr

LTE
Uu

e-Node B

m Ter g Lon

l Evo

on uti RN
lub Node B

luCS

UMT S

lur

UT

tw Ne s s cce A AN

o rk

Uu

GSM

BS
Abis BTS

C o rk

GS
Um

tw Ne s es Ac c

CDR IP
Bi l lin g d an tin g

Ra

Gi

e dS an t ten on

r vi

ces
MM7

GG
Gn/Gp

SN tw Ne o rk
Gc

MM
SMPP UCP CIMD

SC

ke

wit t-S

d che

o re

P WA P

Ma SC

il t Pl a for m

Gs

Gr

Gd

S
C HLR D

C MS
Op

Se or t a er

r vi

ce

GM
E

SC rk
ISUP S2m
it Sw ch PB X

MS C-S erv er/ VL R

Mc MGW

Ci r

it Sw t i cu

d che

o etw N re Co

SC o rk
CDMA

PS

tw Ne N D / IS TN

o rk

tw Ne s ces

a/b So

All trademarks and registered trademarks are the property of their respective owners.

Contents

Keynote SIGOS
Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6 Company . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8 Portfolio . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10

TEST SYSTEMS

36

GlobalRoamer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
World-Wide Coverage . . . . . . . . . . . . . . . . . . . . . . . . 39 Use Cases . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41

USE CASES
Service Quality Monitoring

12

SITE . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
The Unique Test Platform . . . . . . . . . . . . . . . . . . . . . 42 Hardware Components & Interfaces . . . . . . . . . . . 46

Periodic QoS Testing . . . . . . . . . . . . . . . . . . . . . . . . . . 14 On-Demand Testing . . . . . . . . . . . . . . . . . . . . . . . . . . 15 Network Diagnosis . . . . . . . . . . . . . . . . . . . . . . . . . . . 16 Drive Service Testing . . . . . . . . . . . . . . . . . . . . . . . . . . 17 Content Testing / Handset Simulation . . . . . . . . . 18 Benchmarking . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19

Test Tools for SITE and GlobalRoamer . . . . . . 48


Reporting & Alarming . . . . . . . . . . . . . . . . . . . . . . . . 50 Test Creation Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52 Diagnosis Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53

Test Applications for SITE and GlobalRoamer. . 54


Network Registration . . . . . . . . . . . . . . . . . . . . . . . . . 56 Voice . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58 Voice Advanced . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60 Messaging . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62 Data . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64 Video . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66 Value Added Services . . . . . . . . . . . . . . . . . . . . . . . . . 68 Handset Oriented Testing . . . . . . . . . . . . . . . . . . . . . 70

Roaming Testing
Inbound Roaming Testing . . . . . . . . . . . . . . . . . . . . 20 Outbound Roaming Testing . . . . . . . . . . . . . . . . . . . 21 SLA Testing according to GSMA (GRQ) . . . . . . . . . 22 Roaming Hubbing Testing . . . . . . . . . . . . . . . . . . . . 23 Roaming Steering Testing . . . . . . . . . . . . . . . . . . . . 24

International Carrier Quality Testing


Dedicated carrier route selection . . . . . . . . . . . . . 25

Revenue Leakage & Fraud Detection


SIM Box Detection . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26 Early Charging Detection . . . . . . . . . . . . . . . . . . . . . 27

PROFESSIONAL SERVICES

72

Managed Services . . . . . . . . . . . . . . . . . . . . . . . . . . . 74 Consulting Services . . . . . . . . . . . . . . . . . . . . . . . . . 76 Project Management & Implementation . . . 77 Training . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 78

Revenue Assurance
Test Call / Event Generation . . . . . . . . . . . . . . . . . . . 28 CDR Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29 Tariff Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30 Prepaid SIM Recharging . . . . . . . . . . . . . . . . . . . . . . 31

INDEX REFERENCES

79 80

Fixed & IP Network Testing


Fixed Network Testing . . . . . . . . . . . . . . . . . . . . . . . . 32 IP Network Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33

Core Network Testing


Testing without Radio Access . . . . . . . . . . . . . . . . . 34 Regression Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . 34

Nomadic & Indoor Testing . . . . . . . . . . . . . . . . . . 35 5

With a customer base of more than 240 operators around the world in over 100 countries... With over 50 representations around the world, covering sales and post sales services... With more than 20 languages spoken by our expert staff...

...your world-wide partner in telecommunications testing: Keynote SIGOS

Introduction
Company
Testing is our Competence

Portfolio
SITE Active end-to-end test system GlobalRoamer Managed world-wide system Professional Services Consulting and more

Introduction > Company

Foundation of SIGOS Systemintegration GmbH

Testing and integration support for the first German GSM network

Active participation in standardization process as full member of ETSI

Keynote SIGOS

1985
Industry
First ISDN communication system is established

1987

1989

1990

1991

The idea for GSM is born (Memorandum of Understanding)

First GSM network is launched in Finland (2G)

Keynote SIGOS
The Company
What we do
Keynote SIGOS provides scalable and fully integratable telecommunications testing solutions to service network operators (mobile and fixed line as well as MVNOs), content providers, carriers and regulators. Our solutions and services are designed to give our customers the full picture on Quality of Service from an end-user perspective. But we do not stop there: our customers enjoy the most comprehensive range of scalable active end-to-end testing solutions available on the market. Service Quality testing and monitoring Roaming testing International Carrier Quality testing Revenue Assurance and Billing verification Revenue Leakage and Fraud Detection solutions Drive Service testing Fixed and IP network testing Test creation, diagnosis and reporting tools Core Network testing solutions Handset simulation

SITE Testing Environment now includes mobile network End-to-End testing

SIGOS provides test and integration support to all German GSM networks

GlobalRoamer goes online

Launch of BlackBerry, PoC, Video Testing

Keynote SIGOS

1997
Industry

2000
3G starts: First CDMA2000 commercial system is launched in South Korea

2001
First commercial UMTS network is launched in Norway

2002
1 Billion of mobile phone subscribers world-wide

2005
HSDPA is introduced

www.keynote-sigos.com

Introduction > Company

SITE End-to-End testing environment for fixed line networks is born

SIGOS plans a GSM core network

SITE DECT for type approval tests introduced

SITE ISUP for conformance test for C7 networks

1992

1993

1994

1995

1996

SMS is introduced World Wide Web (www) is born

First commercial website

VoIP in its infancy is used for the first time

GPRS / EDGE (2.5G) ADSL allows high-speed communication over phone lines

Who we are
Founded in 1989 under the name of SIGOS Systemintegration GmbH, Keynote SIGOS brings in more than two decades of broad experience to the telecommunications industry, helping our customers to be even more successful in todays highly competitive environment. Keynote SIGOS is a truly international company: bringing people from multiple cultural backgrounds together to outstandingly serve our global customer base with what Keynote SIGOS employees all have in common: true passion for telecommunications!

Keynote SIGOS is headquartered in Germany where our solutions are being developed under highest standards. Representations on multiple continents and our strong partner network distributed all over the world rounds up our world-wide presence.

Keynote acquires SIGOS GmbH

SITE provides test environment for VoIP, ADSL, DSL, HSUPA

Launch of Billing Verification and Drive Service Test


Ke y
no

Introduction of Keynote SIGOS GlobalResource Pool celebrates GlobalRoamer to cover its 20 Years of the world countries Anniversary LTE Test System
te SIGOS

Keynote SIGOS introduces IPv6 test cases and test interfaces

20
YEA

RS
9

2006
VoIP is now established as communications platform

2007
HSUPA is introduced

2008
HSPA+ is introduced Mobile Connections hit 4 Billions world-wide

19 00 89 - 2

2009

2010
Beginning of LTE era (4G)

2011
IPv4 addresses to run out by the end of the year

HSPA+ rollouts

www.keynote-sigos.com

Introduction > Portfolio

The Portfolio
Steering of Roaming Testing Fraud Detection for National & International Tra c International Carrier Testing

GlobalRoamer

Outbound Roaming Testing

Billing Testing for International Tra c World-wide Handset Speci c QoS Testing QoS Tools for Diagnosis & Reporting

Fraud Detection Revenue Assurance Tool


SIM Multiplexer Clients
LAN / WAN

SITE TEST SYSTEM

Roaming Testing

SITE Central Unit

Drive Service Testing


CLU LU CLU WLU MLU

LU

CLU

LU

Core Network Testing

Fixed

IP Networks

Mobile

Handset Speci c QoS Testing

QoS Tools for Diagnosis & Reporting

GO

P GR h wit AL B GLO

Managed Services

Professional Services

Training

Consulting Services

Project Management & Project Implementation

10

www.keynote-sigos.com

The Managed Global Infrastructure and Test System For The World-Wide Telecommunications Industry
With GlobalRoamer, Keynote SIGOS offers the most extensive infrastructure for automated telecommunication testing world-wide. We provide our customers with an extensive network of testing facilities around the globe, hosted by Keynote SIGOS. GlobalRoamer customers can use this sophisticated testing infrastructure through a web based user interface. All that is required is a web browser and access to the internet. Simply log on with your password and set up your test schedules without worrying about a thing. However, Keynote SIGOS can also provide fully managed test services so that all that you really need to do is: look at the results. The on-demand world-wide test platform hosted by Keynote SIGOS

Your Own Scalable and Highly Flexible Testing Infrastructure


With the Keynote SIGOS SITE Test System comprising sophisticated hardware and software solutions network operators are enabled to host and work with their own testing facilities. The key is the ability to easily integrate into the existing network infrastructure realities. Interfaces to complementary solutions, e.g. monitoring systems, are provided so that SITE can be exactly matched to your specific requirements. The SITE Test Systems architecture is completely modular. Only the modules that are needed for the given tasks needs to be purchased. Your local SITE system can go global by connecting to the world-wide GlobalRoamer probes with our GlobalResource Pool feature - all in one go! One platform for all your end-to-end test requirements

Solution Consulting, Managed Services and More Flexible and Customizable


We at Keynote SIGOS are always here for our customers: in each phase of your testing requirements we provide you with well experienced and specifically trained personnel, whether it be for project implementation, maintenance, managed services, training or solution consulting. All our Professional Services can be customized to your specific needs. For instance, with different levels of Managed Services, we can help our customers with the management, operation and administration of tests. Our services are completely customizable and scalable: we are handling complete SITE systems for customers as well as we manage small occasional testing projects. Just as you please. Expert staff gives assistance at all project phases

www.keynote-sigos.com

11

Versatility is key!

Keynote SIGOS solutions in action.

12

The Use Cases


Service Quality Monitoring
> > > > > Periodic / On-Demand Testing Network Diagnosis Drive Service Testing Content Testing / Handset Simulation Benchmarking

Roaming Testing
> > > > >

Inbound Roaming Testing Outbound Roaming Testing SLA Testing according to GSMA (GRQ) Roaming Hubbing Testing Roaming Steering Testing

International Carrier Quality Testing


> Dedicated Carrier Route Selection

Revenue Leakage & Fraud Detection


> SIM Box Detection > Early Charging Detection

Revenue Assurance
> Test Call/Event Generation > CDR Comparison Testing > Tariff Testing > Prepaid SIM Recharging

Fixed & IP Network Testing


> Fixed Network Testing > IP Network Testing

Core Network Testing


> Testing without Radio Access > Regression Testing

Nomadic & Indoor Testing


> Nomadic Testing > Indoor Testing

13

Use Cases > Service Quality Monitoring

Service Quality Monitoring


Periodic QoS testing
Slow setup time, service outages or unsuccessful data downloads are experienced in every network. In order to manage daily operations standardized matrices should be deployed by several divisions, e.g. Service Operations, Service Quality Assurance, Network Operations, International Roaming and Revenue Assurance.

In a highly competitive market, such as the telecommunications industry, providing and maintaining highest quality to end customers is the key to a sustainable competitive advantage. With customers having multiple options at hand, poor quality even the occasional drop in quality can have immediate consequences. Switching between operators never has been easier through mobile number portability. First class service quality has many influencing factors not all being under the immediate control of the operator. Identification of weak points can be difficult and some may remain undiscovered even while their effects are still evident in the market.

Keynote SIGOS offers accurate measurements of end-to-end quality for voice and data services by measuring KPIs like call setup success rates, HSDPA, HTTP average throughput or service degradation of BlackBerry services. Taking round the clock automated measurements at the end users interface (rather than in network nodes) operators obtain in-depth insight into end-users perception of the network. Generation of active test calls 24/7 without the cost of 24/7 staff - covering all aspects of the network and the upload of KPIs to a centralized alarming system provides excellent real-time feedback on the service levels of the network.

See your network through the eyes of your customer

Active testing benefits


Testing time Continuous heartbeat tests End user experience Best reflection of end user experience: E2E service quality tests Time to detect issues Identification and localization of service and network issues can be achieved before actual service degradation and threat of revenue loss Operating costs Reduced operating costs by automating monitoring, testing, and reporting; increased personnel efficiency; costs not correlated with network size and growth Testing scope Pro-active test approach can be realized; in control of testing scope

14

www.keynote-sigos.com

Use Cases > Service Quality Monitoring

On-Demand Testing
Perform reproducible ad-hoc testing!
The customer service desk keeps getting complaints about certain service scenarios like BlackBerry e-mail service not reliable, basic voice calls not possible in certain locations, in the home country as well as abroad. Quick action needs to be taken!

World-wide Testing
Keynote SIGOS hosts the largest and most comprehensive world-wide test infrastructure, currently covering 4/5 of the worlds countries. GlobalRoamer users benefit from the availability and flexibility of the GlobalRoamer test network without the effort of running their own system. GlobalRoamer account holders log on and schedule their tests whenever the demand occurs. Being able to perform tests independently and without the usual hassles connected with doing business globally like time-zones is an invaluable asset!

Home Network Testing


SITE enables network operators to test all relevant services in their network with a private test system. All locations covered by the private SITE system can be used for flexible end-to-end testing. Due to their modular structure, SITE test systems can range from a small local system to geographically widely distrubuted areas as well. The unique feature Global Resource Pool however, enables operators to expand the capability of their SITE system no matter how small or big it may be to reach out to world-wide test locations covering 4/5 of the worlds countries! In fact, they are enabled to utilize the huge network of GlobalRoamer test probes all in one go! See your network through the eyes of your customer Root causes can be localised easily when used in tandem with Keynote SIGOSs integrated analysis tools. Time zone and business hours differences often make it difficult to run tests with the co-operation of roaming partners. GlobalRoamer offers an easy and instant solution to this problem.

If a real time test is needed, and its too late to contact a roaming partner, I can re-produce the test scenario identically.

The test call can be replicated repetitively in order to check whether service has been re-established. GlobalRoamer is deployed to survey specific services over roaming partners networks managing both post-paid and prepaid SIMs across the different technologies. The SIMs are co-located in Keynote SIGOS premises in Nuremberg, Germany.

There is no time lost as we do not have to get in touch with the roaming partner. We can execute tests via GlobalRoamer in a matter of a few minutes anywhere in the world where SIGOS has coverage. Before we started to use GlobalRoamer sometimes we had to wait more than 3 months for execution of a roaming test because partners were occupied with other roaming partners tests. The SIGOS test system helps us to manage our test SIMs efficiently as we do not have to send the SIMs to multiple countries for roaming testing. It provides us with a fully controlled test platform. We can perform multiple test cases easily and simultaneously.

www.keynote-sigos.com

15

Use Cases > Service Quality Monitoring

Network Diagnosis
Model your network & find the root cause of service outages!
Once periodic heartbeat testing for the services has been set up, very often Service Operations is the first team to detect service outages through the results of this active testing. But what network entity has caused the fault? SITE proves not only to be a good reflection of real customer experience but also shows up bottlenecks in the network infrastructure via its solution Service Alarm Map (SAM). By supervision of all relevant end-customer services and correlation of network events it becomes possible to both anticipate and analyze service affecting network problems. A clear and comprehensive mapping of service problems to the performance of individual network elements and systems can then significantly drive down time to repair. Service Alarm Map helps to reduce the time for root cause identification and supports the technical service teams with additional information like error-id, trace details & measurement values. This important drill-down functionality from service chain visualization to raw measurement values and trace information improves reaction times in the event of traffic congestion and network element failures.

See your network through the eyes of your customer

The number of customer complaints have been reduced significantly due to network issues being identified faster by the Keynote SIGOS test system. Real-time alerts and reports of incidents lead to faster resolution of the network issues identified. Subscribers are not fast enough to call our Customer Care to lodge a complaint.

MSC 4 BSC 12 SGSN 2 GPRS backbone

LocationUpdate2G

GPRS_Attach2G

Opera server
DL_Duration HttpAv
INTERNET VPN Tunnel

GGSN

PDP_ContextActivation

Router

Internet

DL_Duration HttpAv

Example: The Service Alarm Map (SAM) indicates a problem on BSC12

16

www.keynote-sigos.com

Use Cases > Service Quality Monitoring

Drive Service Testing


Test mobile subscriber experience on the move!
SITE has already been widely deployed for periodic QoS testing and KPI generation. Quality of subscriber experience however is not only driven by static service use but also by service deployment on the move. Testing during moving is an important complementary approach in addition to stationary testing. SITE is a powerful tool for the delivery of Service Assurance and generation of leading Key Performance Indicators (KPIs) for operator networks, not only for static testing but also for mobility, simulating end user experience. Equivalent to the behavior of static Local Units, the SITE System collects a variety of network measurements from moving subscriber probes, known simply as Mobile Local Units (MLUs). These mobility tests are geared for vehicles like taxis, trucks or trains. Consequently they are called SITE Drive Service Tests. The raw information is processed into KPIs and displayed on a color coded geographic map. Drive Service Testing provides you with Service QoS KPIs (Voice Quality etc.) as well as many specific measurments (RxLevel, Handover, Call ID, MAIO...)

Unattended System SITE Drive Service Test is a completely autonomous system after installation. No engineer needs to be present in the vehicle for test setup, modification or analysis. Easy Installation and Removal MLU is shipped fully pre-configured and only needs to be connected to the electronic on-board system. No further human interaction, not even switch-on is required. Geographic View SITE system delivers graphical views on your network quality. A comprehensive set of KPIs enriched with further information like speed of moving vehicle, altitude and position can be displayed on a map. WMS maps, e.g. operators own coverage map, display KPIs customizable by operator.

See your network through the eyes of your customer

Investment Protection Drive Service Tests are fully SITE compatible and can be performed as an extension to existing SITE systems securing current investment into Keynote SIGOS service assurance products.

www.keynote-sigos.com

17

Use Cases > Service Quality Monitoring

Content Testing / Handset Simulation


Do all handsets work perfectly in your mobile network?
The opportunity for mobile operators and advertisers to sell exciting new mobile content is enormous. However, the variety of available services like MMS, Video Streaming and Web Browsing may cause problems when using different handsets, since the service platforms of the network react individually to each mobile phone type! Data Services like Web and WAP browsing, streaming, MMS or video telephony are ARPU driving services. Premium content download is another huge revenue driver. Subscribers expectations on quality of service are legitimately high. At the same time, handset specific behavior plays an important role in the delivery of this content and services. Delivered content not displayed in the expected format causes a definite negative impact on customers Quality of Experience (QoE). How can new devices and services be properly tested in a cost-effective way that ultimately leads to customer satisfaction and increased revenue? The answer is automated testing while taking handset specifics into account handset simulation. Keynote SIGOS provides a powerful handset simulation tool, integrated into the SITE and GlobalRoamer test systems. More than 1,000 virtual handsets are available from a ready-to-use and expandable library. Simulate the large variety of handsets without the effort of labor intensive manual testing.

See your network through the eyes of your customer

Picture and Text in wrong position

Handset Simulation Test Concept Features:


Simulation of real subscriber behavior, taking handset specifics into account Automated testing of services like Web and WAP browsing, MMS, streaming, video tele- phony, content download Interfaces: GSM/GPRS Um, GSM Gb, UMTS Uu, HSDPA, HSUPA, EDGE, Iu PS Real End-to-End mobile content testing of various handsets Validation of received content with mobile profiles Database with more than 1,000 mobile device profiles and their relevant parameters New customer or country specific handsets can easily be integrated

18

www.keynote-sigos.com

Use Cases > Service Quality Monitoring

Benchmarking
Who is the best performer?
KPIs for own network are regularly reported to senior management. But how does your network perform compared to the competitors? Who has the best performance? Who offers the highest quality of service (QoS)? What is the quality situation for your international traffic? In the competitive mobile environment, consistently high QoS is the deciding key. Benchmarking is an important dimension in making sure your services are competitive. National Approach Most measurement projects start off with a national performance investigation and comparison after national network rollout has been completed. Operators have to find innovative ways to outperform their competition on network and service quality.
With the SITE test system, network services can be benchmarked against the competition, measuring internationally approved and recognized Key Performance Indicators (KPIs) in a fast and easy way.

Static Test Approach Network benchmark assessment is executed using an active end-to-end test scenario to observe the performance of your network from a subscriber point of view. Typical static benchmarking tests are performed at airports, city centres, mega sports or social event venues and hotspots where masses of people congregate. On-the-Move Test Approach Drive Service tests have the ability to cover different geographical areas of locally competing networks rather than being focused on static locations. This simulates subscriber behavior moving from one cell to another and provides a comprehensive performance overview of the complete network. See your network through the eyes of your customer

International Approach In order to get a comprehensive overview of multinational or group-wide benchmarks, GlobalRoamers extensive global footprint can perform international benchmark tests and ensure improved cost efficiencies. Benchmarking of international carriers is an important step in ensuring high quality of service for the international traffic impacting your revenue.

Service performance is benchmarked with national competitors as well as international operators: Static testing Drive service testing Outbound roaming testing (e.g. GRQ)

www.keynote-sigos.com

19

Use Cases > Roaming Testing

Inbound Roaming
Provide best service to visitors in your network!
Today, subscribers expect all frequently used mobile services to work reliably everywhere in the world. Thus, the quality and availability of services inside and outside the home network becomes increasingly important in the battle for customers! Inbound roaming has a big impact on your revenue and a long list of international roaming agreements may be desireable. It comes at a cost: each and every roaming agreement with a new roaming partner requires intense testing according to GSMA standards. In addition, periodic roaming tests with the most important roaming partners need to be performed. How can efforts be reduced? Testing according to GSMA IREG standards is required whenever a new roaming partner is added. It can be a very time-consuming and exhaustive task. It may absorb your most expert staff and repetitive testing can be just as expensive as the initial test setup if performed manually! Therefore, test automation is key for cost effectiveness and operational efficiency. With the SITE system your staff will perform IREG specific tests in much shorter times with less effort and the results will be easily reproducible! Implementation of testing for new roaming partners could not be easier: the SIM card is implemented into SITEs SIM Multiplexer which can be expanded to a capacity of more than 2,000 SIM cards. As soon as the SIM card has been implemented, staff can run the necessary tests. Ready-to-use test cases are available for the execution of tests, according to IR 24, 26, 27, 29,32, 35, 50, 60. These tests can be repeated at any given time! The test results are automatically processed into GSMA conformant reports ready for evaluation.

Get the full picture of your roaming services

Features for inbound roaming testing:


SITE offers the right concept for inbound roaming testing: Core network test interfaces (A, Gb, IUCS, IUPS) for testing roaming, independently of radio specific problems Air interface testing for measuring real end-to-end behavior and experience SIM Multiplexer: SIM cards can be managed centrally and securely for all roaming partners (as many as 2,000 SIM cards) Detailed KPI test reports according to GSMA standards Test sets according to IREG 24, 26, 27, 29, 32, 35, 50, 60 from GSM MoU

20

www.keynote-sigos.com

Use Cases > Roaming Testing

Outbound Roaming Testing


Assure QoS abroad to optimize and develop outbound roaming revenue

The possiblility to travel the world quite easily is perceived as a matter of course nowadays. Traveling subscribers take availability and proper operation of all mobile services for granted. Outbound roaming contributes considerable revenue and therefore requires QoS assurance.

Operators require information on service quality beyond their own network. To subscribers, perceived mobile quality when traveling abroad is vital, especially for corporate customers. Mobile operators need to ensure subscribers are able to log onto preferred roaming partners networks when traveling, whilst preserving consistently high levels of QoS to maintain long term business sustainability. When your subscribers arrive at a foreign destination, they expect their mobile service to work at all times. All relevant services need to be tested with at least each top roaming partner. If you depend on these partners to execute these required tests, it will be a huge task, considering availability of staff, time zone differences and the like. The solution is the worlds largest automated on-demand test network: GlobalRoamer. Tests can be executed in more than 500 networks in three quarters of the worlds countries. GlobalRoamer is hosted by Keynote SIGOS and can be accessed from anywhere in the world by logging on through a web interface. Why risk losing subscribers and roaming revenue, when the ability to test the performance of all your roaming partners is at your fingertips? Standard services as well as complex technologies and services like Video Telephony, MMS and UMTS/HSDPA networks can be tested without the need for cooperation with your roaming partners and independently of time zone.

Use GlobalRoamer, the most extensive global infrastructure for automated active End-to-End testing hosted by Keynote SIGOS. With GlobalRoamer you can access an ever increasing number of world-wide networks through a web interface. Thanks to GlobalRoamer we were able to increase our outbound roaming capability dramatically in very short time. Get the full picture of your roaming services

LUP-avail.

GPRS-avail.

Speech

SMS

www.keynote-sigos.com

21

Use Cases > Roaming Testing

SLA Testing according to GSMA GRQ


Consistency & comparability of roaming QoS testing
Since the traffic in outbound roaming has a big value for operator revenue, it is important to monitor the most frequently visited roaming operators. The GSM Association has designed the right concept: GRQ. Roaming traffic may be a low percentage of the entire network traffic, but remains a significant profit contributor. How to gain a global perspective on roaming quality with consistent measurements and thus comparability between home network and visited networks? And how to achieve this goal in a cost efficient manner? The Global Roaming Quality (IR.81) standards developed by the GSMA in cooperation with selected partners like Keynote SIGOS provide an answer to this question regardless of the monitoring and testing methods used. GRQ is a comprehensive framework for pro-active testing and assurance of end-to-end roaming services quality. With SITE and GlobalRoamer you have a unique tool to monitor your SLA agreements with numerous roaming partners. Keynote SIGOS is a self-certified vendor of the GSMA GRQ compliant test systems.

27 Active QoS parameters on voice, data and SMS traffic KPIs for five different categories:
Network access Service Accessibility Connection Establishment Connection Substainability Connection Quality

Why GRQ?
Common understanding about the criteria for measuring Quality of Service in outbound situations Developed and defined by GSMA Focus on periodic testing of service quality Applied for monitoring of top roaming partners

Get the full picture of your roaming services

Key Benefits:
roaming partners by adherence to a shared set of QoS KPIs Improve operational cost effectiveness, by automated testing and realtime reporting Increased Roaming revenue through fast resolution of home and visited networks SLA violations

Cost-efficient co-operation with

GRQ Parameters, defined by GSMA


# 1 GRQ Parameter name CS LU SR CS LU Delay CLI SpQ SA-MO SA-MT AD-MO AD-MT Throughput Goodput Roundtrip Time Packet Loss Category Voice Voice Voice Voice SMS SMS SMS SMS Data Data Data Data Description Circuit Switched Location Update Success Rate Network Accessibility Circuit Switched Circuit Switched Location Update Delay CLI Transparency Speech Quality Service Accessibility SMS MO Service Accessibility SMS MT Access Delay SMS MO Access Delay SMS MT Throughput (kbit/s) Goodput (kbit/s) Roundtrip Time Packet Loss 2% 1% Major target 95% 50s 95% 2.5 95% 95% 10s 10s Minor target 98% 10s 98% 3 98% 98% 4s 4s X X yes yes x x X X KPI alarm yes Trend report X

...
10 11 12 13 14 15

...
24 25 26 27

22

www.keynote-sigos.com

Use Cases > Roaming Testing

Roaming Hubbing Testing


Connecting the world with a single roaming relationship
Roaming hubs safeguard multi-lateral roaming and interworking relationships. How can a roaming hub concentrate on managing the key roaming priorities? Open Connectivity (OC) is replacing multiple bilateral roaming relationships between operators with a more efficient hub-based approach. Open Connectivity enables multi-lateral roaming and interworking relationships via SMS hubbing and roaming hubbing. Keynote SIGOS world-wide, on-demand test platform caters for roaming hubs. It enables them to perform tests of Outbound Roaming services, IREG testing for Inbound Roaming, and QoS Monitoring, as well as GRQ testing. It improves operational and cost efficiencies because of the automated test approach and real time reporting feature. Roaming hubbing providers are often tasked to actively monitor service availability and service quality on all their multilateral relations. GlobalRoamer allows the activation and testing of Roaming Hubbing customers SIMs. It helps them to work more efficiently to improve the quality of voice, data and SMS services for their customers. Keynote SIGOS GlobalRoamer can add value to many aspects of the Roaming Hub business model. GlobalRoamer is an ideal enhancement to hubs.

Get the full picture of your roaming services

PMN B

PMN A

PMN C

One agreement

One relation

Clearing

Data Services SMS-IW & MMS-IW CAMEL

Reduced complexity

Roaming Coordination Signalling

Increased availability

PMN

PMN

PMN

PMN

PMN

PMN

www.keynote-sigos.com

23

Use Cases > Roaming Testing

Roaming Steering Testing


Are subscribers roaming with preferred roaming partners abroad?
Steering of Roaming (SoR) has been rolled out by Operators in order to direct their outbound roamers to preferred VPMNs in the roaming destinations. Does it work? Steering of Roaming (SoR) solutions have been implemented by mobile operators in order to direct their outbound roamers to preferred VPMNs in each country. In some cases just one preferred VPMN in a country is chosen, in other cases SoR is about managing the proportion of revenue and traffic shares between two or more VPMNs. SoR is the logical result of roaming/IOT agreements which are linked to volumes and percentages for one or more preferred VPMNs. On one hand it is a significant commercial matter to detect short- or long-term deviations from these target distributions, on the other hand it is worthwhile to test potential deterioration of customer experience caused by SoR. Get the full picture of your roaming services Detection of Anti-Steering of Roaming is essential as operators may lose subscribers to non-preferred networks resulting in margin losses. Anti-steering is not only a breach to roaming agreements but may also lead to a bad roaming experience as the subscribers could be left without any coverage. Subscribers will not blame the VPMN but their subscribed home network. Subscribers will also not be able to benefit from the special roaming retail tariffs that have been offered to them. By detecting anti-steering activities, higher roaming costs can be avoided. Operators primary business goal is to streamline roaming steering mechanisms such that outbound roaming revenues are optimized while maintaining high levels of end user satisfaction.

VPMN A
Outbound Roaming
ed! Preferr

VPMN B
Outbound Roaming

HPMN

VPMN C
Outbound Roaming

HPMN MSC/VLR Non-Preferred VPMN 1 SoR node MAP messages Update Location UpdateLocation.error 4x UpdateLocation.error 5th attempt is on next VPMN; in this case the preferred PMN Update Location InsertSubscriberData InsertSubscriberData.ack Location Updating Accept UpdateLocation.ack HLR/ AuC

1 2 3 4

Location Updating Request Location Updating Reject 4x Location Updating Reject

Preferred VPMN 1

Location Updating Request

KPIs (examples): Location Update Duration also delive- ring indication of deterioration of end user experience Number of PMNs rejected number of quad attempts or roaming not allowed rejects List of rejected PMNs non-preferred PMNs tried PMN after successful steering also indicating successful SoR at all LUP mode (automatic/manual) testing correct behavior of SoR Server for manual selection Reject Causes (i.e. Network Failure, PLMN)

24

www.keynote-sigos.com

Use Cases > International Carrier Quality Testing

International Carrier Quality Testing


Who is the best international carrier of choice?
Setting up a call to a subscriber in a foreign country involves the choice of the relevant international interconnection carrier. How much impact has the interconnection carrier on QoS? Who is the best interconnection carrier partner? There is a need for both mobile and fixed operators to get a global perspective on interconnection service quality in order to maintain high levels of QoS to subscribers. The international interconnection quality experience is heavily influenced by the choice of the international carrier at the national boundary. By testing international carriers with an active monitoring system, you can not only monitor if the right calling number is displayed abroad but also the voice quality and call setup time, which can be effectively measured and reported. In addition, international carrier quality testing can be coupled with False Answer and SIM Box Detection. KPIs (examples): Received CLI on destination side CLI Indicator distinguishing the follo- wing cases: CLI from CgPN (OK) No CLI (N) Wrong CLI (W) Mean Opinion Score (PESQ MOS) for Voice Quality (ITU-T P.862.1) Call Setup Time
Example of international CLI quality testing

Stay in control of communication beyond your network

Testing with prefixed called numbers requires knowledge about the current setup at the international gateway exchange. The deployment of an SS7 LU directly at the international gateway Exchange ensures dedicated interconnection carrier testing. Poor CLI and voice quality would inevitably decrease revenue and market share.

For example, if no CLI is received, there would be no possibility to call back and poor voice quality would result in short and frustrating conversations. Maximising revenue is essential in an environment of falling wholesale prices. This objective can only be achieved if you have consistently high quality on your network and on your international interconnection.

Private SITE System


Dedicated carrier route selection

KPI / SLA monitoring

Global Resource Pool

International Gateway

Interconnection Carriers
25

www.keynote-sigos.com

Use Cases > Revenue Leakage & Fraud Detection

Revenue Leakage & Fraud Detection


Make sure your roaming revenues are not being detoured
Fraud - the word sounds quite exciting when it appears on a cinema billboard or a TV programme schedule but when it hits you personally, professionally, or in a corporate environment, it is much less enticing. Fraud will never be completely eliminated but, unless fraud management countermeasures are undertaken, it is unlikely that it will be reduced to a manageable level.

SIM Box Detection


The business goal is to gradually clean incoming traffic terminating through SIM boxes by disconnecting all SIM Box numbers detected and to protect the network from any potential fraudulent upsurge in their use. SIM boxes have multiple negative effects on operators, roaming hub providers and customers alike, e.g.: revenue loss due to call redirection roaming calls are intercepted, redirected and terminated via fraudulent SIM Box equipment. unnecessary investment due to service inaccessibility as a result of SIM Boxes creating false network congestion issues revenue loss through CLI Quality Prob- lems; immediate impact is the inability to call back. image loss through bad QoS as SIM Boxes often redirect calls over inade- quate, highly compressed IP connec- tions, resulting in poor voice quality. Call setup time is extended which leads to the impression of bad call quality from the home network operator.
SIM

Fraud Bypass Detection Features:


Reliable detection of SIM boxes Safeguard your revenues Cost-effective concept for fraud bypass detection Ensure first-class end user experience through quick elimination of SIM boxes High test density possible while avoiding network congestion

Identify leaks in your revenue stream

Originating Network

SIM Box Operators Local SIMs are used to terminate international incoming tra c

Terminating Network
Local Retail rate

(A) 0,14

(B) 0,10

GMSC

Air interface

BTS

(C) 0,15 Originating Networks: > PSTN > Mobile > VoIP > Carrier Select (CS) > Calling Cards > Carrier Pre Select (CPS)

Regular Transit

International Interconnect Termination rate

(D) 0,13

Terminating network operator loses 0,03 per minute, i.e. (B) - (D)

26

www.keynote-sigos.com

Use Cases > Revenue Leakage & Fraud Detection

Early Charging Detection


Get it right for your customers

A common phenomenon is the scenario of Early or False Answer during voice call setup procedures. How do you detect and fight these cases? Calls are being charged as though connected without ever reaching the called party, or additional connection time charged. The lack of Active End-to-End monitoring has led to millions of minutes being inaccurately billed to the originating calling parties world-wide. These fraudulent billings sometimes go unnoticed because the incremental billed call duration per user may be in the fraction of seconds. Prepaid SIMs used in GSM Gateways (SIM Boxes) could lead to false answers when the fraudulent SIM Box SIM credit has been consumed resulting in an announcement being played. In this instance the caller has to pay for the call connection leading to customer complaints and dissatisfaction with the service rendered. Fight fraudulent charges to your customers accounts with GlobalRoamer, the world-wide distributed test infrastructure for end-to-end testing.

Benefits: Reduce revenue leakage caused by early charging / false answers Ensure billing accuracy and fight interconnect fraud Improve quality of calls leading to a reduction in customer complaints and dissatisfaction Active end-to-end monitoring ensures consistency in billing

International carrier(s) releases answer message even though call(s) are not setup Originating Network Terminating Network (CUSTOMER)
Setup Answer Fraudulent early return of Answer message resulting in charging record for non-delivered service Setup is not even sent to B-Party Call is not established International carrier(s) Setup

Identify leaks in your revenue stream

Unexpected answer on A-side detected and NO incoming setup on B-side International carrier(s) releases answer message even though call(s) are not setup Terminating Network CUSTOMERs SIMs (CUSTOMER) on Roaming
Setup International carrier(s) Setup Answer Setup is not even sent to B-Party Call is not establised Fraudulent early return of Answer message resulting in charging recod for non-delivered service

Unexpected answer on A-side detected and NO incoming setup on B-side

www.keynote-sigos.com

27

Use Cases > Revenue Assurance

Revenue Assurance
Money makes the world go round what happens if your network rating and billing is not correct?
For all network operators validation of billing is of major importance. Operators must provide fair and accurate billing to the customer and also avoid revenue leakage or overcharges caused by services being incorrectly rated and invoiced. In most countries accuracy of metering and billing is mandatory to comply with legal regulations. As markets have become increasingly competitive, operators have used innovative tariffs, product and service bundles and discounts to differentiate themselves. Complex and fast changing tariffs inevitably create challenges in ensuring correct billing. Testing that is both end-to-end and independent can provide the assurance that the customers are being correctly billed as well as satisfying compliance requirements. Today, manual tests not only provide inaccurate, untrustworthy but in most cases cost inefficient testing. To ensure correct billing, a precise and reliable Revenue Assurance system is essential. With a SITE test system, continuous testing of all services provides maximum assurance that all calls are being correctly billed as each network element can be tested and verified.

How to guarantee correct billing?


Three Revenue Assurance concepts are highlighted: Test Call/Event Generation CDR Testing Tariff Testing

Ensure correct billing, for you and your customers

Test Call/Event Generation


Test call and event generation can be as basic as creating network events by generating calls to test the correct function of a network or its subsystems. SITE is ideally suited as a Test Call/Event Generator for Revenue Assurance projects generating its CDRs to be referenced with the networks live CDRs. Operators need to recognize the value of more than just test call generation; you need to be able to store CDRs to perform verification and detection for errors AUTOMATICALLY. New product pre-launch testing can we bill accurately and reliably for the product? Testing of correct function after product updates does the mediation system still summarize all CDRs correctly? Testing of software patching on switches and other infrastructure are we still producing correct CDRs for all call classes? Testing new infrastructure during and after roll out, e.g. new base stations. Testing of roaming tariff updates are roamers, still being billed?

28

www.keynote-sigos.com

Use Cases > Revenue Assurance

CDR Testing
Timely detection of revenue leakages
You want a solution which compares CDRs generated by network nodes like the MSC or SGSN in a highly automated way and sends alarms mismatches. SITE acts as a Test Call/Event Generator, it is capable of importing live CDRs from the network and comparing them with the reference CDRs generated by SITE. The live CDRs of the generated test calls are extracted at a chosen point in postprocessing for automated comparison by the test system. CDRs can be verified and erroneous CDR fields such as faulty time stamps and call duration can be detected.

CDR Structure Record Type: e.g. TimeBased, VolumeBased, EventBased Service Type: e.g. SPEECH, FAX, GPRS Begin of event: timestamp in milli- seconds A Number B Number Call Duration (Time based calls) Data Volume (Volume based calls) Event Count (Event based calls)

Test Call Generation

Live Network

CDRs

Mediation System

CDR Postprocessing
SITE System Virtual SIM Transfer Automated E2E Call Processing (unrated) SITE CDRs (rated or unrated)

Ensure correct billing, for you and your customers


Billing

Filter*
Operator CDRs

CDR Import
Reference CDRs derived from SITE test results

CDR Import*
Live CDRs imported via e.g. csv- les

Reference CDRs

unrated CDR Comparison

Live CDRs

Rated CDRs Unrated CDRs * Customization required

Are Core Network nodes like MSC or SGSN generating the right CDR data? Deploy a test event generator which generates CDRs that you can compare with your network CDRs.

www.keynote-sigos.com

29

Use Cases > Revenue Assurance

Tariff Testing
Proactively monitor tariff plans against variety of test cases
You want a solution which not only compares CDRs but also detects billing errors before they turn into customer complaints or revenue losses.

Rating
At the heart of the billing system is the rating engine. This takes the CDRs (call detail records) or IPDRs (internet protocol detail records) from the network, and then applies the appropriate rating plans to turn this information into rated CDRs ready to be associated with the customer.

Billing
Once a CDR has been rated it is applied to the customers account, where discounts can be applied and from which a bill is created. Operators usually produce bills in cycles, spreading the load over a month or quarter and also evening out cash flow. Within SITE your tariff model can be replicated. Thus, not only the raw data of CDRs can be compared but in addition also the correct billing of a service can be verified. Thanks to SITE, fast regression testing of new pricing plans against a variety of test cases can be performed, detecting potential flaws in the billing process at a very early stage.

Ensure correct billing, for you and your customers

Test Call Generation

Live Network

CDRs

Mediation System

SITE System

Virtual SIM Transfer

Tari CDR Model Postprocessing Filter*


(rated)

Billing

Automated E2E Call Processing (unrated) SITE CDRs

Operator CDRs

CDR Import
Billing Veri cation Rating

CDR Import*

Tari Model*
Reference CDRs

unrated CDR Comparison

Live CDRs

Invoice comparison Resource allocation for different users or groups Detailed test reports Revenue stream audit Covering billing aspects of outbound roaming

Rated CDRs Unrated CDRs * Customization required

30

www.keynote-sigos.com

Use Cases > Revenue Assurance

Prepaid SIM Recharging


With prepaid subscribers you make substantial profits
Prepaid subscribers expect correct voucher recharging. Keynote SIGOS provides a tool to verify Prepaid SIM Card Recharging. SITE or GlobalRoamer have the ability to check if recharging procedures of prepaid cards has been performed successfully. Test Cases collect information about the current account balance and establish a call in the same way a subscriber does. That means entering vouchers using DTMF tones for navigating IVR menus or using USSD commands where supported. After a SIM card recharging attempt the account balance of a dedicated prepaid SIM card is re-checked and compared to balance before recharging attempt. Besides using single vouchers (e.g. from scratch cards) for a single test, Keynote SIGOS Test Systems support comprehensive voucher repository functionality managing numerous numbers. Further customer specific account verification methods (e.g. via SMS) are also supported on request.

Sample Features
Detection of revenue leaks due to SIM card recharging errors Increase of customer satisfaction and spen- ding due to error free SIM card recharging Simplified prepaid SIM card handling in the central SIM Multiplexer

Sample KPIs
Initial account balance Account balance after recharge Used Voucher for recharge Received USSD response string USSD process duration

Ensure correct billing, for you and your customers

www.keynote-sigos.com

31

Use Cases > Fixed & IP Network Testing

Fixed Network Testing


NGN evolution calls for multi-technology testing
With the explosive growth in the mobility arena, one could almost believe that the future of fixed networks was doomed. However, fixed networks continue to maintain their relevance, with technological evolution requiring new test approaches. Technological advances and the complex changeover from established technologies to new ones triggers the need for ensuring consistency of service quality over all underlying technologies. Poor service quality inevitably leads to loss of profit if, for example, the line is bad the conversation will be short. With the SITE test system, Keynote SIGOS provides ONE platform for testing all technologies fixed, mobile and IP-based, either within one technology or across technologies. Fixed network operators benefit from SITE through: Periodic service quality testing Ad-hoc service quality testing SITE supports all interfaces required for fixed network testing: PSTN ISDN DSL IP (VoIP) KPIs for fixed network testing (examples): Delay Echo Delay MOS Value

Beyond mobile the other kind of telecommunications

Testing in all network technologies, mobile, fixed and IP

32

www.keynote-sigos.com

Use Cases > Fixed & IP Network Testing

IP Network Testing
Optimize your data network performance
Slow access, error pages and unsuccessful orders? Just started VoIP services? Are you relying on your customers to find out about incidents, availability, speed and load issues? Mobile has made its impact on connecting the last mile, particularly for voice communications, but has yet to make its impact on higher speed links and at least one mobile company has admitted that it cannot deliver the speeds contained in the 3G specifications. So where do fixed networks and IP connections coming with them win over radio-mobile? When capacities and speeds are high, where Internet access is required or where there are large files to be downloaded, then the optical fibre link remains supreme, whether it is a link to a corporate client, a national backbone network or an international submarine cable system.

SITE measures the user perception of your services SITE checks the quality of your calls in real time Use SITE for proactive supervision! Secure your IT with SITE End-to-End monitoring! SITE measures and alerts you in real time!

Beyond mobile the other kind of telecommunications

Web Browsing (HTTP)

KPIs (examples): Duration between the rst and last http data packet HTTP Data Size Duration of web browsing session HTTP Valid Page Content

Ping (ICMP)

KPIs (examples): Round-trip time (min, mean, max) Packet loss Size of Ping packet

FTP SOAP
KPIs (examples): Response Time of SOAP server in seconds

KPIs (examples): Network Non-Accessibility File Size Download Duration Upload Duration IP Service Failure Ratio

TCP/IP Command

KPIs (examples): TCP/IP command Duration of TCPIP command

DNS

KPIs (examples): DNS Query Duration (min, average, max) DNS Host Name Resolution Time DNS Host Name Resolution Failure Ratio

www.keynote-sigos.com

33

Use Cases > Core Network Testing

Core Network Testing


Service Testing independent from Radio Problems
Testing without Radio Access
In some cases the active test approach of using test mobiles on an air interface can be counterproductive because radio specific problems can disturb results without adding any value. A typical example is roaming testing, where the problems come from the core network. For such cases there is benefit in testing the services by means of simulating the radio access part, connecting directly to the core components such as the MSC, SGSN etc. without involving the radio access components.

Regression Testing
Another instance where connection direct to core network components is required is where tests need to be executed in a very short time. This is typically the case when network components like the MSC or SGSN have been updated or where the influence of a high number of concurrently connected subscribers has to be checked immediately and automatically. Such kinds of regression testing can usually be executed in less than 20 minutes whilst still covering all services and subscriber profiles.

Typical use cases for testing without radio access part:


Interactive Voice Response incl. interactive announcement tests Testing of Supplementary Services Testing of IN Services Inbound Roaming tests Load Tests on Core Network components Billing Testing via CDR tests Data Content Testing Handset Simulation etc.
ork ore Netw Mobile C

Typical use cases for regression testing without radio access part:
Automated regression testing after upgrade/updates on: MSC (via GSM A) MSC and fixed network switches (via ISUP) SGSN (2.5G) via Gb MSC-Server via IuCS SGSN via IuPS SMSC, MMSC WAP-, Web-, Mail-Server SCP testing including IN services and prepaid services etc.

Inside out core network testing can save money

ore Mobile C s Interface rk o Netw

Typical advantages of core network testing:


Not influenced by radio specific problems Fast execution of mass tests (e.g. thousands of tests in an hour) Quick results Detailed trace analyses with protocol stack information

see page 2

34

www.keynote-sigos.com

Use Cases > Nomadic & Indoor Testing

Nomadic & Indoor Testing


Portable local unit for flexible deployment and mass testing
Indoor: Shopping and Exibition Centers or Airports places of communication. But do mobile services work properly everywhere? There are a lot of interesting and revenue generating use cases for indoor testing. Especially in international airports where testing of inbound roaming characteristics is crucial to secure lucrative business. Also exhibition centers and shopping centers are typical buildings where subcribers very often experience lack of service. Furthermore it is worthwhile to mass-deploy the cost-efficient nomadic units in office towers with a lot of business customers. For indoor testing either the air interfaces or direct LAN connection can be recommended.

Sports and Social Events: Testing campaign of short time frame and short notice. The Nomadic local unit is also ideally suited for short-term campaigns like sport events. A lot of sports fans gather at top level events like Formula 1 or soccer championships and expect high levels of service quality. Due to its fast installation the nomadic units can be quickly rolled out even at short notice. After easy deployment at temporary locations this autonomous system sends network information back via its air interfaces. Rural Areas: Where there are people there should be communication. Especially in remote areas it is often impossible to install local units, as no fixed IP connection is available. In this case the nomadic local unit is capable of establishing a permanent IP connection via GPRS/EDGE/HSPA modem. The connection is upheld via IPSec tunneling. By this means, test probes can be quickly installed in rural areas where you cannot rely on wired IP connections. The Nomadic local unit is the ideal solution for flexible deployment in the field.

Reach out to remote and temporary locations

www.keynote-sigos.com

35

Invest in the future!

Keynote SIGOS test systems adapt to your demands.

36

The Test Systems


Steering of Roaming Testing Fraud Detection for National & International Tra c International Carrier Testing Outbound Roaming Testing Billing Testing for International Tra c World-wide Handset Speci c QoS Testing QoS Tools for Diagnosis & Reporting

GlobalRoamer
The Reference System for world-wide testing Largest footprint of world-wide test probes Managed and serviced by Keynote SIGOS Extensive set of test case applications

Fraud Detection Revenue Assurance Tool


SIM Multiplexer Clients
LAN / WAN

Roaming Testing

SITE Central Unit

Drive Service Testing


CLU LU CLU WLU MLU

LU

CLU

LU

Core Network Testing

Fixed

IP Networks

Mobile

Handset Speci c QoS Testing

QoS Tools for Diagnosis & Reporting

GO

P GR h wit AL B GLO

SITE
The Unique Test Platform for various technologies Mobile / Fixed / IP testing Core Network testing Globalize with GRP

37

Test Systems > GlobalRoamer

GlobalRoamer
The On-Demand world-wide test platform!
Challenge
End users demand and expect a high quality, reliable service from their chosen network operator and a similar experience regardless of where in the world they are. Therefore, permanent surveillance of the roaming network is indispensable but extremely difficult due to a lack of operational visibility of the roaming partners networks.

Solution
GlobalRoamer allows you to verify that all services are available to your customers who are traveling world-wide. With test probes in 150+ countries you have your world wide testing platform without investing in infrastructure. Just buy your testing package and run your tests worldwide.

Managed Services are on offer to all Operators looking for an operationally efficient solution!

How does it work?


For testing in mobile networks, by means of Keynote SIGOS SIM Multiplexing technology, your SIMs are capable of being virtually transmitted to any of GlobalRoamers extensive network of remote test stations in more than 190 locations, where tests simulating end customer experience are performed. Complete, real time visibility of the resulting network messaging allows rapid fault resolution. GlobalRoamer also allows you to perform tests across technologies, e.g. Fixed and IP networks as Fixed Mobile Convergence (FMC) becomes more prevalent!

Automated active End-to-End Testing and Monitoring


Get the full picture on what your customers experience world-wide Initiate reproducible test cases which cannot be done with passive monitoring solutions

Unique SIM Multiplexing Technology



SIM cards are hosted centrally from

where they are virtually transmitted to any of GlobalRoamers remote test stations where the actual test is performed

Global Testing Network



GlobalRoamers extensive global

network of test stations allows access to three quarters of the worlds countries and is continuously being expanded

38

www.keynote-sigos.com

Test Systems > GlobalRoamer

All you need to do


Order your account at Keynote SIGOS For testing in mobile networks: send your test SIM cards to Keynote SIGOS! Access the world-wide test network via the internet! Define and set your tests running! Collect the results!
GlobalRoamer Login

How to access GlobalRoamer?

NETWORKS

COUNTRIES

LOCATIONS

The World at Your Fingertips

588
589

587

176
177

175

225
226

224

Enter the most extensive global network test system from your desk and gain access to:

GlobalRoamer Location GlobalRoamer Country Location comming soon

GlobalRoamer is growing continuously. Please contact us for the current footprint and more details. Q4 2011

www.keynote-sigos.com

39

Test Systems > GlobalRoamer

The High Performance Global Test Infrastructure


On-Demand End-to-End Test System for Roaming Situations and More
What is GlobalRoamer? Get access to test 500+ networks in more than 75% of the worlds countries 2G, 2.5G and 3G network probes Fixed network probes available Fully hosted and continuously expanded by Keynote SIGOS Continuous growth of telco networks accessible through GlobalRoamer
505 450 400 350 300 250 200 150 100 50 0

2003 2004 2005 2006 2007 2008 2009 2010 Networks Countries

The Cost-effective Testing Solution


Take Advantage of Deploying GlobalRoamer Without Having to Think About Labor Intensive Operations
Simply start using GlobalRoamer no maintenance, no CAPEX No setup or exit fees for GlobalRoamer use Flexible packages available (prepaid for ad-hoc testing / flat-rate for periodic testing) Pay-as-you-use concept

The Independent Round-theClock Event Generator


Benefit from Availability and Accessibility to the Whole World Anytime, Anywhere
Easy web access allows 24/7 availability, irrespective of time-zones Independence and convenience through pre-scheduled automated test execution Massive world-wide test capacity, your SIMs can be used almost anywhere at any time

The Time-Saving and Customizable Tool-Box


Enjoy the Convenience of Predefined Tests and Reports Whilst Keeping the Option to Customize
Comprehensive libraries of test cases and report templates save valuable time Customer-specific test cases and reports allow for full flexibility User-friendly web-based graphical user interface

The Reliable Sentinel Always on Duty


Keep Track of Your Network On-time and Relevant Information Delivery at your Fingertips
Extensive alarming, performance notification and reporting functionality Customizable alarms to alert you to any network issues Adjustable information-depth (from high-level overview to deepest-deep details) Continuous network surveillance with reports (several styles, from graphical to plain text)

40

www.keynote-sigos.com

Test Systems > GlobalRoamer

Use Cases
Service Quality in outbound roaming (on-demand testing / periodic testing) Full range of QoS applications (Voice / SMS / Data) (page 14) Outbound Roaming Testing GRQ GSMA compliant testing (page 22) Steering of Roaming (SoR) Testing Evaluation of proper application of Steering of Roaming and detection of Anti-Steering activities (page 24) Fraud Detection for International Traffic SIM Box Detection, False Answer Detection (page 26) International Carrier Quality Testing Full range of QoS applications (Voice / SMS / Data) (page 25) Revenue Assurance in an international context CDR Comparison, Roaming Tariff Model Testing (page 28) International Interconnect Management CLI Verification, Voice Quality (MOS), Call Setup Time, Call Attempt Success rateetc. (page 25) Benchmark Testing in operator groups See how your network performs within one operator group (page 19) Service Level Agreement (SLA) Verification Verify the fulfilment of Service Level Agreements (page 22) Handset specific Testing in outbound roaming Automated content testing with a broad selection of simulated handsets (page 18)
Fraud Detection for National & International Tra c International Carrier Testing Outbound Roaming Testing Billing Testing for International Tra c World-wide Handset Speci c QoS Testing QoS Tools for Diagnosis & Reporting

Use Cases for GlobalRoamer

Steering of Roaming Testing

Clients from all over the world rely on GlobalRoamer


Mobile Network Operators Fixed Network Operators Mobile Virtual Network Operators (MVNO) Carriers Content Providers Regulators

Who benefits from GlobalRoamer?

Departments (Examples):
Service Quality Management Operation and Maintenance Roaming Billing Fraud Management Marketing Interconnect International Business Revenue Assurance

www.keynote-sigos.com

41

Test Systems > SITE

SITE
One platform for all your End-to-End test requirements
Challenge
Today, network operators are confronted with an extremely dynamic market and the challenges of keeping up with new technology, permanent surveillance of Service Level Agreements (SLA) and reducing cost whilst also maintaining customer satisfaction. Since these tests can be both, labor-intensive and costly they are too often neglected. To meet these challenges preventive and permanent Service Quality Assurance by means of End-to-End testing is essential.

Solution
Keynote SIGOS has developed the most advanced automated test system available on the market. SITE is the proven and flexible test platform for cost- and time-saving automated Active End-to-End testing. With SITE, telecommunication operators all around the world benefit from its unique versatility. SITEs modular structure and scalability ensure it can always be matched exactly to your requirements. In addition, your local SITE system can go global by connecting to the world-wide GlobalRoamer probes with our Global Resource Pool feature all in one go!

Why SITE?

Why Automated Active Testing and Monitoring with SITE?


Get the full picture of your end users

experience (QoE) and act, instead of reacting to customer complaints Continuously monitor service availability, test and measure quality (KQI) and performance (KPI) Upfront testing ensures a smooth roll-out for new services and new technologies Initiate reproducible test cases which cannot be done with passive monitoring solutions Comprehensive network diagnosis, reporting and alarming Services can be tested before commercial release

Identification and localization of service and network can be achieved before actual service degradation and threat of revenue losses Reduced time and risks to install or modify network infrastructure by providing extensive recursive testing capability Reduced operating costs by automating monitoring, testing, and reporting; increased personnel efficiency; costs not correlated with network size and growth Number of test cycles is flexible

Network Services

SITE Solution Tests ALL

Network Interfaces

SPEECH
Voice Voice Quality Suppl. Services IVR Push-to-Talk VoIP Echo

DATA
DATA IP (CS/PS) Web/Wap Browsing E-mail Streaming Video Telephony Video Quality Digital Rights Mgmt.

MESSAGING
SMS MMS Mobile IM iPhone BlackBerry

FIXED
ISDN S0 ISDN PRI S2m PSTN a/b

RADIO
HSPA UMTS Uu GSM Um EDGE CDMA 2000 GSM-R LTE Uu

IP
WLAN DSL Ethernet MM7 SMPP, UCP, CIMP SMPT / IMAP

CORE
IuCS / IuPS GSM Gb GSM A ISUP SS7 IN / CAMEL MAP (HLR/VLR)

42

www.keynote-sigos.com

Test Systems > SITE

Open, Modular and Customizable Just the Right System, Always


SITE is an open system and can be easily integrated into existing test environments

What is SITE?

Existing equipment can be directly linked to SITE and controlled and monitored through the SITE system Software updates, configuration modifications and problem resolution are quickly and reliably performed by Keynote SIGOS SITEs modular structure software and hardware guarantees maximum flexibility in service and protocol testing From portable and Stand-Alone Systems in test laboratories to distributed systems covering the geography of an entire live network, everything is possible

ONE Test System, ENDLESS Testing Options


SITE uniquely combines Quality of Service (QoS) testing with the ability to deliver Core Network Testing all in ONE test system Mobile, Fixed, VoIP testing Protocol test interfaces

SITE enables both, single technology testing as well as cross technology testing Mobile / Fixed / IP-based - all kind of combinations can be tested 2G, 2.5G, 3G and beyond all mobile network technologies can be tested SITE enables thorough testing of all relevant mobile and BlackBerry services, even taking handset specific characteristics into account if desired Voice Messaging Data Video Value Added Services

SITE provides test solutions for billing verification and other revenue assurance related applications

Fraud Detection Revenue Assurance Tool


SIM Multiplexer Clients
LAN / WAN

Roaming Testing

SITE Central Unit

Drive Service Testing


CLU LU CLU WLU MLU

LU

CLU

LU

Core Network Testing

Fixed

IP Networks

Mobile

Handset Speci c QoS Testing

QoS Tools for Diagnosis & Reporting

www.keynote-sigos.com

43

Test Systems > SITE

How does it work?

Central SIM Multiplexing Technology an Unparalleled Teleporter for SIM Cards SIM cards are centrally hosted and virtually transmitted to any of the systems remote test stations where the actual test is performed. SITE can handle thousands of SIM, USIM or Micro-SIM cards in cascade-style boards. Subscriber information from a SIM card is read out by the system and transmitted via a LAN/WAN network to any test location required. The SIM authentication procedure is handled virtually between the wireless interface in any location and the real SIM stored in the central SIM Multiplexer unit. Intuitive Workbench Tailored to Users Specific Demands Comprehensive set of tools are available for Test Creation, Diagnosis as well as Alarming and Reporting to adapt SITE exactly to user demands. (see page 50) Configurable user access rights User-friendly and intuitive Graphical User Interface which can be accessed from Windows and Linux platforms alike through the Inter- or Intranet. Role-based GUI views provide the right level of information and tools depending on the users role (Test / Report / GIS / Admin).
Test/Report
Network Expert Test Manager Test Case Designer

GIS

Admin
System Administrator

User role-based GUI always gives the right level of information to the user

Test Analysis

Test Admin

Test Design

GIS

System Data Health Bases

The SITE Architecture Ensuring High-Performance, Security and Stability SITE runs on a stable, Linux based server solution offering highest standards of redundancy. SITE client workstations can be either Windows or Linux based. To ensure maximum performance, the SITE System uses an open SQL database. All configuration information, test results, measurements and KPIs are stored logically, to provide clear measurement and reporting capabilities. Using powerful filter functionality any database listing can be easily modified and a multi-format export function allows the sharing of data with other network support tools. Behind the Scenes SITEs Unique Test Management SITE can execute tests at any time desired. Via the scheduler window a single or group of tests can be defined once or periodically, based on very flexible selection criteria of date, day, time, frequency and number of repetitions. To avoid any resource conflict, an intelligent resource management system controls access to interfaces and SIM cards, assuring smooth operation and maximum test parallelism. The self-management checks system components regularly and generates an alarm (SNMP-Trap) in the event of any failure.

44

www.keynote-sigos.com

Test Systems > SITE

Globalize your SITE system and take off with GRP!


With Global Resource Pool your SITE system gets access to test probes all over the world
Most SITE solutions are deployed for testing networks within national boundaries. Some existing SITE installations cover international testing by deploying SITE Local Units in neighboring countries for purposes of outbound roaming testing and fraud detection. The unique Global Resource Pool (GRP) feature now allows users to connect private SITE systems with the world-wide network of GlobalRoamer test probes. By this, it means your local SITE system can get access to Keynote SIGOS hosted probes in more than 580 networks world-wide! As GRP connects to GlobalRoamer, which comes as a scalable pre-deployed infrastructure owned and managed by Keynote SIGOS, Operators are liberated from cumbersome manual implementation, operations and maintenance of these Remote Test Interfaces. GRP currently contains GSM Um and UMTS Uu interfaces which are all available for testing.

h wit L A LOB OG

P GR

Connect your local SITE system to the world-wide GlobalRoamer probes with the unique Global Resource Pool feature!

www.keynote-sigos.com

45

Test Systems > SITE > Hardware Components & Interfaces

Hardware Components & Interfaces


Scalable and highly flexible infrastructure!
Central Unit
This is the base of the whole Keynote SIGOS Test System SITE. Everything important is integrated: O&M Manager, Scheduler, Resource Manager and Test Execution Manager. Central Unit Extensions (CUX) are important to give the possibility to increase the number of parallel running test cases.

19 (rack mount) 100 V - 240 V, max 8A 4A, approx. 450 W

Main Hardware Components

SIM Multiplexer
The SIM Multiplexer has an unlimited capacity to handle thousands of SIM cards at various locations all over the world. Any SIM authentication procedure is handled virtually between the wireless interface in any location and the real SIM stored in the central Multiplexer unit.
SIM Card Board

SIM Server 100-240 V 1A, 50/60 Hz Low power consumption Compact design, only 3HU Compatible for SIM, Micro SIM, USIM, R-UIM Automated voltage negotiation for each SIM card position

Remote Components
The remote units, also called local units, are installed wherever they are needed for 2G, 2.5G and 3G or core network tests. Local Units for fixed and stationary usage: Local Unit (LU) Compact Local Unit (CLU) SS7 Local Unit (SS7 LU) Gb Local Unit (Gb LU) IU Local Unit (IU LU) ISDN PRI Local Unit (ISDN PRI LU) Wireless Local Unit (WLU) Local Units for mobile usage: Mobile Local Units (MLU); 12V DC, 5A, typ. 40W incl. internal SIM Multiplexer incl. GPS module Nomadic Probe: 12V DC, 2A, typ. 20W incl. internal SIM Multiplexer incl. GPS module available in fixed, wireless and mobile mode

Remote Components / Local Units

46

www.keynote-sigos.com

Test Systems > SITE > Hardware Components & Interfaces

Test Interfaces
Keynote SIGOS SITE Test System supports the whole range of todays telecommunication networks. Testing them needs multiple interfaces which are integrated in the SITE systems. Sample interfaces: 3G UMTS/HSPA+ and 2G GSM/GPRS/ EDGE Voice & Data & Fax Supported frequency bands: 850/900/1900/2100 MHz Downlink up to 42 Mbps Uplink up to 5.76 Mbps

SS7 / GSM A, ISUP: 4 E1 (2048 MBit/s) trunks (RJ45 connectors), Impedance of 120/ 75 Ohm balanced/unbalanced Iu over IP: based on Ethernet IP, 4 x Ethernet Interface 10/100 Gb over IP: based on Ethernet IP, 4 x Ethernet Interface 10/100 Gb over E1/T1: 4 E1 (2048 MBit/s) trunks (RJ45 connectors), Impedance of 120/ 75 Ohm balanced/unbalanced CDMA2000 1X / EV-DO Supported frequency bands: 800/1900 MHz ISDN S0: B-Channel Protocols: like HDLC X.75, X.25, T.30, V.90,V.120 D-Channel Protocols: like ETSI-DSS1, NI-1, CT1, VN3, 1TR6, INS-64, 5ESS, Q-Sig

Sample Interfaces

ISDN S2m: B-Channel Protocols: like HDLC X.75, X.25, T.30, V.90,V.120 D-Channel Protocols: like ETSI-DSS1, NI-1, 1TR6, NET3, VN3/4/6, INS-64,INS- 1500 PSTN a/b: ITU-T Modem Compatibility, Fax Compatibility All Components: Developed by Keynote SIGOS, made in Germany.
www.keynote-sigos.com

47

Deliver high performance!

Keynote SIGOS puts the optimum instruments in your hands.

48

The Test Tools


On SITE and GlobalRoamer
Reporting & Alarming
> Dashboard > Matrix Report > GIS

Test Creation Tools


> Test Case Editor > SITE Recorder > Test Sequence > Control Structure

Diagnosis Tools
> Service Alarm Map > 3G Layer 3 Tracing

49

Test Systems > Test Tools > Reporting & Alarming

Reporting & Alarming


Fully integrated in GlobalRoamer and SITE
SITE and GlobalRoamer Reporting enables users to create, view and forward multiple reports. These reports are generated from measurements collected in the report database. These reports can either be based on Keynote SIGOS standard Key Performance Indicators (KPIs), on KPIs according to ETSI standards or on individual customized KPIs. Report creation is done by means of an easy drag-and-drop arrangement. SITE and GlobalRoamer Reporting offers the possibility to visualize test results using various graphical tools, serving even very specific presentation and monitoring needs. Flexible standard charts and diagrams as well as enhanced functionalities like histograms, percentile, ad hoc reporting and derive to can be immediately generated from recorded KPI data. Real time alarming is also embedded: resulting alarm notifications are automatically distributed via SMS, e-mail, SNMP, etc. to defined recipients. Users can define threshold-settings, counters, severity triggering points, etc. which control when alarms should be generated or cleared. Reports can be illustrated in different ways, either charts in various formats; markers, bars, lines etc, or by matrix tables to provide a fast color coded overview of vital services or specific KPIs.

Test Execution on di erent locations

Online Reporting

Reporting Alarming
Test Executions

real time reporting alarming


Post Reporting

Raw-Measurements (Input and Output)

Measurements Strategy / KPI design

KPI Database

Report De nition

Measurement processing: from test execution to test reports

All solutions of SITE and GlobalRoamer Reporting allow the users to observe KPI performance in an optimal way: analysis of trends / analysis of incidents based on locations or based on service problems.

Who benefits from reporting functionality?


Telco Service Manager, who read service performance reports Network Experts, who analyze test results and trace information Report Designer, who set up reports

50

www.keynote-sigos.com

Test Systems > Test Tools > Reporting & Alarming

Dashboard
This Graphical User Interface (GUI) system tool provides a simplified intelligent interface to SITE and GlobalRoamer reporting. It is of special interest to the people responsible for the service, who want to work intuitively without any training effort. KPIs can easily be filtered and individually stored in a few clicks. Individual configurations allow additional, more customer-oriented, data analysis. Fast and easy drill down to individual traces is possible directly from the Dashboard.

Matrix Report
The Matrix Report environment allows the user to view Key Performance Indicator (KPI) data as a numerical value, which can be easily color coded to provide a quick, easy to understand overview of network performance. Service KPIs can therefore be displayed in a format which is especially useful for Network Management and Operations personnel.

Dashboard Matrix GIS

GIS
For service testing on the move, a map based Geographical Information System (GIS) is integrated into SITE. Each drive test case collects position data from a GPS receiver during visibility of GPS satellites. These are displayed in a GIS. This means that after service testing a rich set of KPIs according to GPS data can be locally analysed displayed on geographic maps.

www.keynote-sigos.com

51

Test Systems > Test Tools > Test Creation Tools

Test Creation Tools


Easy and time saving configuration!
Test Case Editor
SITE provides large libraries of Test Cases for main network services in various formats with detailed parameter options. It is also possible to create customized test cases by means of the assembly of various test steps via a user-friendly drag-and-drop mechanism that SITE provides in its Test Case Editor environment. Complex scenarios can be quickly built to enable the testing of new network services.

Control Structure
The Control Structure enables test users to easily create tests at various locations and with different SIM cards. It uses the logical operators: list based FOR EACH condition based REPEAT time based WAIT

SITE Recorder
This Tool allows intuitive automated recording of browsing actions taking handset characteristics into account. Mobile and provider specific web and WAP pages are retrieved from the network via the test probes during recording sessions to get a feel for real download behavior and latency. Traces are shown live while the developer is browsing. The test case can be evaluated before saving the entire browsing session for replay. Full feature support by the Test Case Editor makes later adaptation of recorded browsing sessions easy. It is like having full and instant remote control access to a specific handset or browser in a remote location with no need to travel anywhere to use it.

Test Sequence
The goal of the test sequence concept is to save execution time by avoiding the resource consuming location update process being repeated for each subsequent test case. Usually a test case starts with a switched off mobile terminal. The side-effect of this approach is that each test case has the following procedure: location update make a call (service test 1) switch off Each of these steps often require more than one minute each to complete. For saving test execution time, an arbitrary number of service tests can be combined in one test sequence, which requires only a single location update. This effectively simulates typical mobile user behavior e.g.: switch on a mobile (location update) make a call (service test 1) send an SMS (service test 2) web browsing (service test 3) make a call (service test 4) switch off

Test Case Editor SITE Recorder Test Sequence Control Structure

52

www.keynote-sigos.com

Test Systems > Test Tools > Diagnosis Tools

Diagnosis Tools
Keep the overview or go into details!
Service Alarm Map
The Service Alarm Map is used to visualize mobile network services that target a specific service area. Alarms that are generated by the failure or degraded performance of services can be linked to a specific network element within the operators infrastructure. This function is implemented by careful correlation between the specific elements used within a test case execution and the overall network topology which has supported the test scenario that generated the alarms.
KPIs Alarms

An example could be a WAP test initiated from a wireless interface located at latitude (x), longitude (y). The topology for this scenario would use specific BTS/node B, BSC/ RNC infrastructure, assigned to an MSC/ SGSN finally reaching a specific content portal. Each piece of network information and trace is processed to provide significant data on the actual network performance and functionality, finally the data is combined to give a total service area view.

Report Traces

Drill Down

SERVICE View With Service view you get an easy high level overview about the status of the whole network. DETAILS View The Details view is accessed via single network elements of the Service view. It shows exactly which test case leads when to which failures.

Service Alarm Map 3G Layer 3 Tracing

DETAILS View SERVICE View

3G Layer 3 Tracing
Deeper insight into message flow with 3G Layer 3 tracing
Keynote SIGOS offers 3G Layer 3 tracing which is very important for telecommunication network testing. The primary goal is to get a deeper insight into the message flow and the protocol data exchanged between mobile station and network. On Qualcomm-based 3G mobile probes Keynote SIGOS records traces of the Layer 3 Non-Access Stratum (NAS) signalling messages sent and received by the mobile. The information contained in these traces is vital for monitoring and troubleshooting the communication between mobile station and core network. Optionally, the NAS traces are supplemented with traces of Radio Resource Control (RRC) signalling messages exchanged between the mobile and the 3G radio access network. These RRC traces provide valuable additional information, facilitating monitoring and troubleshooting of the Access Stratum (AS) as well.

www.keynote-sigos.com

53

Always at your service!

Keynote SIGOS allows you to test the full range of services.

54

The Test Applications


Network Registration
> Location Update > GPRS Attach

Voice / Voice Advanced


> Voice > Interactive Voice Response > Push-to-Talk > Supplementary Services > Voice Quality

Messaging
> SMS > MMS > Mobile IM

Data

> Data IP > E-mail > WAP / Web Browsing

Video

> Video Telephony > Video Quality > Streaming

Value Added Services


> Ring Back Tone > Digital Rights Management

Handset oriented testing


> BlackBerry > iPhone > Handset Simulation

55

Test Systems > Applications > Network Registration

Network Registration
Fundamental for all mobile services!
Each mobile subscriber wants to be able to communicate in the cellular telecommunications network without having to consider whether the network technology is 2G, 2.5G or 3G. This requires a successful mobile device registration on the base station subsystem (BSS). This is always the first step for further communication. Even if a call is not set up, the network needs to be able to communicate with the mobile handset to pinpoint where it is. Hence, a mobile network is divided into multiple cells (Base Transceiver Stations BTS). And a group of cells is considered a location area. A mobile device in motion keeps the network informed about changes in different location areas. If the handset moves from a cell in one location area to a cell in another location area, the mobile device should perform a location area update to inform the network about the new location of the mobile device. Each Keynote SIGOS test case requires this successful network registration.

Location Update procedure is performed: when the mobile device has been switched off and wants to become active, or when it is active but not involved in a call, and it moves from one location area to another, or after a regular time interval because of signal fade
Some aspects of the registration procedure:

Network Registration Location Update GPRS Attach

make contact with the base station the mobile device registers to the network for access

Sample KPIs
Location Update Duration Received Signal Code Power RX Level Service Type GPRS Attach Duration PDP Context Activation Duration

to start a voice and/or data session

Network location registration is not only necessary for each call, but also for location based services like friends-finder!

56

www.keynote-sigos.com

Test Systems > Applications > Network Registration

Location Update for CS / PS Domain Registration


Mobile switch on Whenever a mobile device wants to obtain service from a cell, it must make sure beforehand that its subscribers SIM can be registered for that cell. By switching on the mobile device, it directly requests to update its current location information in the network. If this is performed successfully, the network acknowledges this with a message Location Update Accept. During this process, the network can ask for the mobile devices identity and check it against reference data (Identification and Authentication). When the service confidential subscriber identity has been activated, a new Temporary Mobile Subscriber Identity (TMSI) assignment becomes a component of the location update. In this case enciphering of user data is activated and the new TMSI is transmitted together with the message Location Update Accept. The TMSI is used for security purposes, so that the International Mobile Subscriber Identity (IMSI) does not have to be transmitted over the air interface. The TMSI is a randomly assigned identity, which is updated each time the mobile device is in motion. Network Registration Location Update GPRS Attach

Location Update Request

Identification

Authentication

Ciphering Mode-Activation

Location Update Request

Ready for circuit switched services (Voice...)


GPRS Attach Request

Identification

Authentication

GPRS Attach for mobile data connection


GPRS Attach is the process during which the mobile device informs the packet core network about its presence in the network. The device usually initiates the GPRS attach after power on. The message sent to the new Serving GPRS Support Node (SGSN) contains the last assigned TMSI, location area information, etc. After the GPRS Attach, procedure when the mobile device is attached to SGSN and has been authorized, the mobile device is prepared for data communication. So when the mobile starts communication, it initiates establishing of Packet Data Protocol Context (PDP context activation).

Ciphering Mode-Activation

GPRS Attach Request

PDP Context Activation

Ready for packed switched services (Data...)


www.keynote-sigos.com

57

Test Systems > Applications > Voice

Voice Services
The basic elements for telecommunication!
Voice
Do not ignore your core services!
Voice services are fundamental to telecommunications companies. It is vital that the user experience of these services is measured continuously by active testing. Only this can assure the quality of this core service. Verification of various KPIs are performed on basic voice parameters, such as checking B-channel availability, measuring call establish duration and call success rate alerts, to name a few.

Sample Features
CLI Check Call establishment to external party Call establishment between two parties Call establishment without answer on external side (no connective costs) B-Channel check Check of all available PLMNs

Sample KPIs
Call Duration Received CLI Establish Duration Alert Duration

Voice Push-to-Talk Interactive Voice Response Suppl. Services

Push-to-Talk
Back to the Future with Push-to-Talk!
The push-to-talk services turn mobile phones into walkie-talkies with unlimited range. The benefit of radio-style communication, especially broadcasting to multiple users, makes it much more convenient than making many phone calls or even call conferencing.

Sample Features
Test 1-to-1 or 1-to-many communication

Sample KPIs
Stop-Talking Timer Failure Ratio Stop-Talking Time Session Cut-off Ratio Session Setup Time Voice Delay (in session) Voice Delay (first)

Play and record speech data Emulating PTT mobiles Real End-to-End Testing of real-time-always-on voice service Check SIP (Session Initiated Protocol) Control Plane
Photo T-Mobile AG

Check RTP (Real-time Transfer Protocol) User Plane

58

www.keynote-sigos.com

Test Systems > Applications > Voice

Interactive Voice Response (IVR)


Do your voice response services work correctly?
IVR services are deployed during Voicemail access and are a common feature of everyday life such as phone banking, ticketing and customer hotline services. Testing these systems is essential for network operators (and their customers) to assure the quality of their services. IVR systems are sophisticated and extremely difficult to test on an active and reliable basis. Keynote SIGOS innovation has created a tool that can wholly automate this task. The IVR tester is designed so that even the most sophisticated speech menus may be recorded and recognized based on a library of voice prompts.

Sample Features
Testing IVR trees Voice mailbox tests Resource allocation for different users or groups Announcement comparison based on new voice prompts Easy integration of new voice prompts DTMF and voice stimulation Customer specific extension Several languages available

Sample KPIs
Call Duration Duration of played audio file Length of recognized reference prompt Duration of recognition process Recognition confidence of best recognized Reference prompt Recorded audio file location Real duration of recording

Voice Push-to-Talk Interactive Voice Response Suppl. Services

Supplementary Services
Compliments on your supplementary services?
Supplementary services like call forwarding, call waiting, call barring, call hold, CLIP/CLIR are multi-switched services which require complex interaction within the network and its elements. Other supplementary services, like prepaid customers checking their current account balance, involves the GSM protocol USSD (Unstructured Supplementary Service Data). At the same time, seamless and instant operation of all supplementary services, including notifications and coding of all relevant information are vital for a satisfying end-user experience. Keynote SIGOS Test Systems provide you with a comprehensive range of test cases for all relevant KPIs and the ability to test USSD protocol commands as well as operator specific extensions, so that your customers will pay you compliments on your supplementary services!

Sample Features
Supplementary Service tests e.g. Call Forwarding Call Hold Call Barring CLIP / CLIR Call Waiting Multi Party Call DTMF and voice stimulation testing USSD testing

Sample KPIs
Forward Erase Duration Forward Register Duration Received CLI Barring Activation Duration Call Hold Duration USSD Received Response

www.keynote-sigos.com

59

Test Systems > Applications > Voice Advanced

Voice Advanced
Do you offer excellent Voice Quality?
Voice Quality
Do you offer excellent Voice Quality?
Voice Quality is, and will remain, the major key performance indicator for each operators network quality. This is recognized by subscribers and operators alike. Bad voice quality represents noise, echo, degraded tele-conversations and immediately sets a poor level of user satisfaction. International Carrier Voice Quality tests can reveal crucial quality information of different network carriers and if it has been impacted by the usage of IP routing or SIM boxes. Therefore, verification of voice quality is essential. Automated test methods with the intention to mimic subjective tests, allow for a cost effective and consistent alternative to subjective testing, either on a referenced or an unreferenced algorithm. Voice Quality Referenced VQ (PESQ/POLQA) Unreferenced VQ (3 SQM) Echo Testing Voice over IP Quality Testing

Referenced Voice Quality Testing (PESQ and POLQA)


Referenced Voice Quality testing is based on the ITU-T P.862 standard via the PESQ algorithm (Perceptual Evaluation of Speech Quality) and the ITU-T P.863 standard via the POLQA algorithm (Perceptual Objective Listening Quality Analysis). Both form the state-of-the-art techniques and international standards for automated advanced perceptual voice quality analysis, comparing actual test results with audio references. Referenced voice Quality Testing provides a very high level of accuracy. Sample KPIs
POLQA MOS value (P.863) PESQ MOS-LQO value (P.862.1) Background noise Average delay Attenuation Signal to noise ratio

Echo Testing
In the course of the migration of 2G/3G Core Network (CN) and Radio Access Network (RAN) towards IP based transport solutions the importance of Echo measurements raises considerably. In SITE, the echo itself is generated artificially and its characteristics can be configured by the user. This allows for the simulation of well defined (acoustic) echoes that enables users to check whether the echo cancellers are configured correctly. Sample KPIs
Echo Return Loss (ERL) in dB Echo Delay in ms Echo Classification (acceptable, unacceptable, side tone)

Sample Features
Reference speech quality assessment model Accurate full-reference model Customer specific audio reference files are easy to integrate Objective Mean Option Score / Perceptual Evaluation of Speech Quality (MOS-LQO / PESQ) MOS Voice Quality result values from 1-5 Support of super-wide-band signals up to 14kHz

60

www.keynote-sigos.com

Test Systems > Applications > Voice Advanced

Unreferenced Voice Quality Testing (3SQM)


Keynote SIGOS Test Systems also support the Single Sided Speech Quality Measure 3SQM (ITU-T P.563) for advanced nonintrusive voice quality testing. The technology behind 3SQM is based on a generic perceptual approach and so is independent from any original reference signal. In comparison to intrusive measurement techniques, such as PESQ, 3SQM is based on single ended measurements. In consequence, accuracy may not be as high but measurements can be worked on an analysis of the digital bit stream on an IP packet level. The measurement is limited to the transport stream analysis.

Sample Features
Perceptual analysis of degradations in voice signals Non-intrusive, single ended analysis method Output score correlates well with subjective MOS Available as DLL/Library or Source

Sample KPIs
3SQM MOS value Noise level Background noise Beeps Signal to noise ratio

Voice over IP Quality Testing


Voice Quality is vitally important for any type of network that routes voice traffic. With the shift from dedicated circuits to the efficiency of IP based traffic, it brings its inherent issues with regard to the end customers satisfaction with quality performance. Additional PESQ KPIs such as Real-time Transport Protocol (RTP), Jitter and Packet Loss are actively monitored. Performing checks on a comprehensive set of voice quality metrics ensures that IP networks run smoothly and problems are detected before they cause major disturbances leading to customer dissatisfaction.

Voice Quality Referenced VQ (PESQ/POLQA) Unreferenced VQ (3 SQM) Echo Testing Voice over IP Quality Testing

Additional KPIs
RTP Jitter RTP Packet Loss

www.keynote-sigos.com

61

Test Systems > Applications > Messaging

Messaging
Are your Messaging Services delivered reliably and on time?
Short Message Service (SMS)
Still the favored message service!
SMS is the world-wide killer application for network operators. This simple network application results in large percentages of revenue for every mobile network operator. Therefore, this critical revenue stream would require constant active monitoring so as to achieve consistently high quality of service. SMS often suffers from long delivery durations, modification of content or missing text with multiple SMS messages. Due to roaming complexities, SMS messages may be lost resulting in non-delivery of the service paid for by the subscribers.

Sample Features SMS MMS Mobile IM


Check functionality of SMSC Check SM Service functionality at peak times Check SMS transmission time

Sample KPIs
SMS send duration SMS deliver duration SMS end-to-end duration SMS Success ratio

62

www.keynote-sigos.com

Test Systems > Applications > Messaging

Multimedia Messaging Service (MMS)


When words are not enough!
MMS are vital to the network operators younger and higher ARPU (Average Revenue Per User) customers. With its complex functional combination of SMS and GPRS, it is easy for the service to become unavailable in a complex mobile network that is often being upgraded or optimized. In order to gain acceptance as a reliable service frequently used by the subscribers, network errors must be avoided and uncovered by performing active continuous tests. This will safeguard the reputational health of the operators and ensure high quality standards. Sample Features
No MM storage limitations MM to legacy handset tests User definable test messages MO/MT transmission of multipart MMs Segmentation and reassembly supported Expandable library of MMS test messages Logging

Sample KPIs
MMS send duration MMS fetch duration MMS push arrival to receive MMS Duration MMS connection to send duration MMS send to push arrival duration MMS end-to-end duration MMS Success ratio

Mobile IM
Can your customers chat via Mobile Instant Messaging?
The real time text based communication between two or more participants is popular on PC devices, e.g. Skype, ICQ, MSN, Yahoo, Google etc. This instant messaging platform has made the leap from the PC to the mobile device, connecting friends, peers and colleagues while they are on the go. To get connected to either fixed or mobile IM users, Java applets are installed on mobile devices delivering branded IM user interfaces. A single device client may provide access to multiple IM systems which transmit and receive presence information. The device clients have to be compliant to the Open Mobile Alliance (OMA) Instant Messaging and Presence Service (IMPS).

SMS MMS Mobile IM

Sample Features
Registration at the IM server Successful login Get presence-information of other users and whether two parties can see each other Text message receipt from IM server Successful logout from the IM server

Sample KPIs
Time of OMA IM Login Request Session ID given from IM server Time when a party sends the message Time of OMA IM Logout Request

www.keynote-sigos.com

63

Test Systems > Applications > Data

Data
Boost your trusted data communication!
Data IP
Do you meet your subscribers demands with GPRS, EDGE, UMTS and HSPA Data Services?
Over the Air (OTA) IP data services offer subscribers a highly effective way to connect to a dynamically rich world filled with internet based services such as Email, Instant Messaging, websites, VoIP and much more. GPRS represents the first step towards faster access provided via EDGE, UMTS, HSPA (HSDPA / HSUPA). To maintain this flexibility in speed, network operators have to deal with the operation and maintenance of multiple technologies. This complexity drives up costs. To increase revenue and service quality, SITE and GlobalRoamer offer data tests to access all available technologies via dedicated interfaces to discover service performance and functionality problems.

Sample KPIs
PS: GPRS Attach Duration GPRS access point PDP context activation Duration PDP setup Connect Duration PDP IP UP Duration

Sample Features
DNS request Download URL HTTP browsing FTP upload / download Ping a host TCP/IP command Transfer rates measuring

Data IP E-Mail Web / WAP Browsing

CS: CSD Dialin Duration CSD connect assign IP Duration Download: Downloading Duration Download Rate FTP: Downloading Duration Uploading Duration Mean Download Rate

64

www.keynote-sigos.com

Test Systems > Applications > Data

E-Mail
Modern life is unthinkable without E-Mail!
Subscribers not only need voice communication, they also want be in contact with friends and colleagues via mobile E-mail. In order to gain acceptance as a reliable service frequently used by the subscribers, network errors must be avoided and uncovered by performing active continuous tests. The question is, whether mobile E-mails are delivered on time to the receivers designated email addresses. Keynote SIGOS Test Systems provide E-mail testing via multiple interfaces, like GSM Um, GSM Gb, 3G UMTS Uu or Iu PS. It can be checked whether a mobile E-Mail can be sent and received via a POP3 / IMAP / SMTP server. The mobile E-Mail would be sent via Simple Mail Transfer Protocol (SMTP) to an E-Mail server and fetched via Post Office Protocol version 3 (POP3) or Internet Message Access Protocol (IMAP). Sample Features
Mobile E-mail upload and download from an E-mail server Interfaces: GSM Um, GSM Gb, 3G UMTS Uu or Iu PS SMTP server POP3/IMAP server

Sample KPIs
Mobile E-mail address Mobile E-mail size Mobile E-mail fetch duration Mobile E-mail send duration Mobile E-Mail End-to-End Transaction Time with Notification Mobile E-mail success ratio

Data IP E-Mail Web / WAP Browsing

WAP / Web Browsing


What about mobile Internet browsing?
The combination of high throughput protocols such as WLAN, EDGE and HSPA along with the variety of todays multifunctional, big screen handsets have greatly enhanced the mobile internet browsing experience. The network operators need to ensure access to the internet directly via HTTP, HTTPS and FTP via a mobile device. Response, accessibility and data throughput are the major performance indicators for monitoring the quality of service. In addition, Web Browsing tests can access websites, fill in forms, receive cookies, initiate secure transactions, download contents and much more! Sample Features
Chains of user interaction on a web application, e.g. a full ecommerce session HTTP post/get request methods HTTPS (SSL) for secure transactions Cookie handling Follow links both by name or URL

Sample KPIs
HTTP data packet duration HTTP data size Web Browsing duration GPRS access point PDP context activation duration PDP setup connect duration PDP IP UP duration

www.keynote-sigos.com

65

Test Systems > Applications > Video

Video Services
Provide your customers more than moving color pixels!
Video Telephony
Do you provide reliable video telephony in 3G UMTS?
High quality for Video Telephony using 3G UMTS is an absolute must, without which it is used perhaps once, and then never again by your subscribers! The premium cost paid for the use of UMTS service will most often increase customers expectations regarding quality of service rendered. Due to competitive pressure, it is mandatory for wireless service providers to increase their subscribers average revenue quickly by successfully launching new services such as video telephony. At the same time, they must maintain the consistent high quality their customers have come to expect. The implementation of this technology often involves complex interaction between network nodes supplied by different manufacturers and therefore constant automated testing should be applied to check initial configurations, and then provide active continuous monitoring of the service.

Video Telephony Video Quality Streaming

Sample KPIs
Video send duration Video call duration Video file size Audio send duration CS Bearer establish duration

Sample Features
Real End-to-End (mobile-to-mobile) Video Telephony Usage of standard 3G UMTS interfaces no special hardware required Usage of standardized or customer specific video/audio sequences Usage of a market leading protocol stack

66

www.keynote-sigos.com

Test Systems > Applications > Video

Video Quality
Is your network Video Quality excellent?
3G UMTS opened a world of possibilities with multimedia applications. Customized infotainment like streaming video, video messaging, mobile TV and video telephony offer a unique opportunity to create a market for highly personalized and truly inimitable mobility services. For mobile customers the quality of services is decisive for acceptance; especially for motion picture based services, quality is the key factor of success. Keynote SIGOS Test Systems deliver perceptual quality measurements to reproduce subscribers quality impression mapped to the mean opinion score (MOS), similarly to other quality tests. Be sure that your networks new multimedia applications are more than just moving color pixels. Sample Features
Testing IVR trees Real End-to-End Testing of real-time video services (video telephony, video streaming, video messaging) Objective MOS Video Quality result values from 1 - 5 (1-bad, 2-poor, 3-fair, 4-good, 5-excellent) PEVQ analysis is based on human model of visual perception

Sample KPIs
MOS value Delays Brightness Contrast Distortion indicators

Streaming
What about your Streaming service?
Today, almost every major event, e.g. sport, news or society events can be accessed via real-time multimedia streams on a mobile phone. These multimedia applications become more and more important in the wireless and mobile community. To make sure that customers can enjoy these exciting premium services, it is most important to guarantee an impeccable streaming service. Using the industry standard protocols RTP and RTSP, the Keynote SIGOS Test Systems are up-to-date with the latest technology. Scheduled and continuous active testing ensure that multimedia streams deliver the desired contents and the required quality even to the largest possible groups. Sample Features
Parallel subsessions per stream, e.g. video and audio Send streamed multimedia over IP TCP or UDP transport protocols Measurement interval in multiple of 100 milliseconds Used industry standard RTP/RTSP

Video Telephony Video Quality Streaming

Sample KPIs
RTSP packets loss percent video RTSP packets loss percent audio RTSP packets received video RTSP packets received audio

www.keynote-sigos.com

67

Test Systems > Applications > Value Added Services

Value Added Services


Todays driver of ARPU!
Value Added Services (VAS)
Is your ARPU driver up and running?
Value Added Services (VAS) are considered todays driver of ARPU. Operators or third-party value-added service providers (VASP), also known as content providers, add value to standard service offerings, encouraging subscribers to optimise their mobile phone usage. With subscribers spending money on VAS, they naturally expect highest quality. Therefore, successful new VAS launch is mandatory while maintaining the consistently high quality customers have come to expect. The implementation of new VAS often involves complex interaction between network elements supplied by different application content providers and, therefore, constant automated testing should be applied to check initial configurations, and then provide active continous monitoring of service quality. Value Added Services Digital Rights Management VAS Examples and Features
Ring tone or logo download by sending request SMS to external number Ring back tone, which enables users to select a melody or to record a short greeting that the caller will hear Ring back tone activations are done per SMS, per IVR or per Web Browsing Customized new value added services

68

www.keynote-sigos.com

Test Systems > Applications > Value Added Services

Digital Rights Management


Make Premium Content download a premium customer experience and test your DRM!
Digital Rights Management (DRM) is an important enabler for billing of premium priced content, e.g. ring tones. To cater for fast and flexible service creation the Open Mobile Alliance (OMA) defined application-level protocols and behaviors needed to provide powerful as well as reliable content download functionality. The scheme is implemented on most multi-media phones and is intended to be used by mobile content providers to control access to their products. The whole Digital Rights Management process is relatively complex and could introduce multiple risks of malfunction. At the same time, the effect of a possible error can be disastrous: unhappy customers if a fault occurs during the download and billing process of the premium priced content. Sample Features
The purpose of DRM is to enable controlled purchase and usage of digital media objects The Open Mobile Alliance (OMA) has defined Digital Rights Management specifications for the mobile world: Forward Lock (prevents the user from unlawful forwarding of protected content) Combined Delivery (combined rights object / media object) Separate Delivery (separated rights object + encrypted media object)

Sample KPIs
Media Download Purchase Time Download Session Time Download Media Object Access Time

Value Added Services Digital Rights Management

www.keynote-sigos.com

69

Test Systems > Applications > Handset Oriented Testing

Handset oriented testing


So many features for each new device!
BlackBerry
Your network`s sweetest fruit
BlackBerry is one of todays leading wireless connectivity solutions for a large number of mobile business professionals found in enterprise and governmental organizations world-wide. It allows users to stay connected with secured wireless access to e-mail, corporate data, calendar and web, to easily manage all their communication and information from a single BlackBerry device whenever and wherever required. BlackBerry eliminates the hassles of dialup by moving mobile data to a push architecture. Especially for mobile professionals, it is vital that the network operator provides the highest levels of quality and reliability. Sample KPIs BlackBerry iPhone Handset Simulation
Send time Receive time Round trip time Battery level of the device Battery temperature of the device

Sample Features
Real End-to-End testing of BlackBerry push service Testing carried out using a commercial BlackBerry device Check sending and receiving e-mails Check the BlackBerry device integrated email features Using BlackBerry devices with a java application for reflector code for sending emails Management notification and reporting

iPhone
Up with the hype on iPhone tests
For many users, the iPhone and the 3G iPhone represents a new era of mobile phone interaction and services. The unique combination of multimedia content, intuitive multi-touch display controls, accelerometer and much more created strong demand for new operator services dedicated only for a unique group of users. Operators around the world specify this group of iPhone users as high-tech high potential customers with distinctive technology and quality demands. The unique services offered for this iPhone customer base like the Visual Voice Mailbox create additional quality process demands at each network operator.

70

www.keynote-sigos.com

Photo T-Mobile AG

Test Systems > Applications > Handset Oriented Testing

Keynote SIGOS Test Systems offer dedicated iPhone tests to fit simply into all QoS test procedures performed via SITE or GlobalRoamer without any additional effort. At the same time, measurements and KPIs provide clear evidence of the service availability and performance focussed on this group of high-tech high potential customers. Sample KPIs
Duration Failure Rates

SMS noti cation: new message Call the Mailbox Download message from Mailbox

Visual voice

Mailbox

Handset Simulation
Do handsets work perfectly in your mobile network?
The opportunity for mobile operators to sell exciting new mobile content and handsets is enormous, but the variety of available services like MMS, Video Streaming and Web Browsing may cause problems when using different handsets. How can these new devices and services be properly tested in a cost-effective way that ultimately leads to increased revenue and customer satisfaction? We can help you with a powerful tool to test all your services, simulating the large variety of handsets in your network. No labor intensive and high-cost manual testing! SITE tests specific handset characteristics against network services and device specific monitoring of pages with fixed content/ URLs. The following important content questions are validated: Color Support: Check if device is capable of displaying colored images Image Size: Comparison of all downloaded images with maximum height and width of the device Content Support: Check (based on HTTP/ WTP accept header) if device can decode downloaded content Data Format: Check if the downloaded content is valid

BlackBerry iPhone Handset Simulation

Sample Features
Intuitive Recording of browsing actions No drag n drop anymore Support of HTML forms Easy creation and adaptation of browsing sessions Received page content at a glance KPIs for each browsing action User defined measurements / KPIs can be added with Test Case Editor Whole session can be Replayed during development to evaluate the test case

www.keynote-sigos.com

71

We take load off your shoulders!

Keynote SIGOS provides flexible and customizable services.

72

The Professional Services

Managed Services

Training

Consulting Services

Project Management & Project Implementation

73

Professional Services > Managed Services

Managed Services
We take the load off your shoulders! Flexible and Customizable
Test Infrastructure Management
Reduce your effort in system administration with TIM
Administration & Management of your SITE test system Providing & hosting of GlobalRoamer, Keynote SIGOS world-wide test environment

Test Operations Management


Reduce your effort in test execution with TOM
Periodic managed services Campaign-based managed services

Test Operations Management


(Full Managed Service)

Roaming Steering Tests GRQ Tests

Carrier Quality Tests Fraud Bypass Detection

Performance Tests

QoS Monitoring

Test Infrastructure Management


(System Hosting)

GlobalRoamer
World-wide test infrastructure

SITE
System Hosting Administration Maintenance

Test Operations Management Test Infrastructure Management

GlobalRoamer Keynote SIGOS hosts, maintains and constantly expands the worlds extensive test infrastructure, GlobalRoamer. Customers simply log on to the system via web interface and get access to an ever-increasing number of networks and locations for their outbound roaming testing. SITE If you are looking for the benefits of the most comprehensive active end-to-end test system but dont want to look after the infrastructure, let us do the job for you. Keynote SIGOS experts take care of the administration of your SITE testing infrastructure while you can fully concentrate on your business. We offer a fully hosted service at the Keynote SIGOS premises (e.g. hosting and maintaining your SITE Central Unit and other core components).

Performance Tests Ensure end-to-end Quality of Service through delivery of Key Performance Indicators (KPIs) prepared for you by Keynote SIGOS. To reach a snapshot like view, a large number of tests in a short period of time (a few days or weeks) is executed and analyzed by Keynote SIGOS. The results are presented as combination of reports, graphs and text documents and can be the foundations for your benchmarks. QoS Monitoring With Keynote SIGOS you can easily prepare a long-term testing environment to ensure and monitor your Quality of Service. As an example, many customers constantly monitor the 50 to 100 most important roaming partners. Automatic tests and reports on Key Quality Indicators (KQIs) are prepared according to the customers wishes. Trained Keynote SIGOS experts manage reports for troubleshooting and provide test results in an easy to read format. SITE Tools like Dashboard and Service Alarm Map give significant data on the actual network performance and functionality. Quality of Service monitoring with Keynote SIGOS is an indispensable way for all departments of an operator to ensure high-class quality at all times.
www.keynote-sigos.com

74

Professional Services > Managed Services

Roaming Steering Tests Test the functionality of steering programs. A number of location update tests in steered countries/networks are performed. The tests are examined by Keynote SIGOS to discover whether the steering works as expected. From the distribution of tests over different networks it is determined whether the planned steering ratios between different networks are fulfilled.
(page 24)

Carrier Quality Tests It is of primary importance that Operators and Carriers offer high quality transmission services. Operators can use Keynote SIGOS to help ensure that their end customers enjoy the best possible quality services. By constantly monitoring the transmission quality of all connected carriers, traffic can be routed intelligently to the best available. Carriers are interested to manage their SLAs with the Operators and to maximise the volume of traffic coming from each operator. Since Operators may well route traffic away from any carrier delivering poor quality transmission then the carriers have a vested interest in measuring their transmission quality. Keynote SIGOS can support carriers in understanding and monitoring the transmission quality of traffic to more than 500 operator networks world-wide.
(page 25)

GRQ Tests Based on general experience of the outbound roaming market 80% of outbound roaming revenue comes from the top 20 roaming partners. For this reason the GSM Association recommends regular monitoring of service quality during outbound roaming with these top roaming partners. Keynote SIGOS has implemented a world-wide test system capable of measuring, reporting and alarming all aspects of roaming service quality using standard prepared test scenarios which can be used to regularly test, monitor and report on service quality in these top roaming partner networks using the SIM cards of the interested operators. Keynote SIGOS supported several operators during the GRQ trial phase and has successfully proven to be fully compliant to the GRQ framework.
(page 22)

Fraud Bypass Detection The internationally installed Keynote SIGOS Test Systems can be used for Interconnect Fraud Bypass detection services. Access to alerts and detailed trace information is possible in real time allowing blocking of SIM Box numbers rapidly. All tests are provided as a fully managed service. Powerful reporting techniques allow benchmarking of SIM Box issues against historical values.
(page 26)

Test Operations Management Test Infrastructure Management

Benefits of Managed Services


Get the benefit of the know-how of our experienced engineers in the testing area. Low or no resources from customer side required. Our customers can focus energy on using the results to perform network troubleshooting and other meaningful tasks. The biggest attraction for operators is Cost Savings. A Managed Services contract can take upfront CAPEX out of the budget as well as cut OPEX in the long run. Increase your time to market and benefit from the intangibles and the innovation that Keynote SIGOS Managed Services is performed for multiple Operators and Carriers. We have the in-house skills, experience and staff to tackle dedicated projects.

www.keynote-sigos.com

75

Professional Services > Consulting Services

Consulting Services
Customized for all your specific needs!
Strategic Consulting
With two decades of experience in the field of telecommunications testing we can provide you with the unique service of high-level strategic consulting. Our Senior Telecommunications Experts are available for strategic assessments and solutions development workshops to provide thorough and comprehensive answers to the question like: How does end-to-end testing fit into our service quality assurance procedures? Book this service as an approximately 2-day workshop.

Engineering Consulting
If you have the concept and the right tools, you need an efficient implementation for your business. Therefore Keynote SIGOS offers: Support of customers for the OPERATION of SITE or GlobalRoamer scheduling of periodic & ad hoc tests according to customer regulations scheduling of periodic & ad hoc reports analyses of failures analyses of trends preparation of specific reports (e.g. test campaigns, management reports, department specific reports) Support of customers for the ADMINISTRATION of SITE *) administration of the SITE system data base management alarm management hard- and software maintenance backup and software-updates *) For GlobalRoamer, engineering consulting in administration is not required since GlobalRoamer is fully hosted and administered by Keynote SIGOS.

Senior Consulting
Get the most out of your Keynote SIGOS test system right from the start. With our Engineering Consulting services, our system experts assist your team during the introduction phase of your Keynote SIGOS solution. Our system experts share their knowledge with your team on the job especially for a question like: How to implement service testing or fraud testing into our business processes? Book Senior Consulting service for the duration of weeks or months, depending on the suitable concept.

Test Operations Management Test Infrastructure Management

Support
SITE Warranty E-mail Support - A fast and reliable way to get clear answers and step-by-step instructions should you experience problems Support Hotline direct communication with Keynote SIGOS professionals (Monday Friday during business hours (CET); 24/7 for premium service subscribers) Fax to Keynote SIGOS Support Keynote SIGOS Trouble Ticket System (OTRS) Web based access for monitoring customer ticket status online

76

www.keynote-sigos.com

Professional Services > Project Management & Implementation

Project Management & Implementation


Always flexible and customizable!
Once the right solution for your situation has been identified during the counseling phase, the actual project begins. To minimize our customers efforts, our experienced Project Management team takes on responsibility of the organization, execution, control and reporting of the project, from the beginning to the end. With our expertise gained over two decades in the implementation of large-scale as well as niche projects we will help you find the optimal solution for efficient and successful project realization. Regular tests are therefore required to maintain a high standard of quality and to improve customer satisfaction. Included Services: Project management Project engineering Commissioning and installation of soft- and hardware components System implementation and network integration Coordination and roll-out of system components Project controlling Project reporting

Typical Keynote SIGOS Project Management Process


n eti g n ing On ns ei sit io lat tal Im n me tio nta n m Ro ll-O ut ce Ac n pta tio era n
Test Operations Management Test Infrastructure Management

Kic

kO

e ff M

n Pla

ple

ste Sy

ce Pu

O to n i t

www.keynote-sigos.com

77

Professional Services > Training

Training
Wherever you want, with specially trained experts!
Training
On-site at your locations or at our training center!
Keynote SIGOS offers a comprehensive range of training to users of SITE and GlobalRoamer. Training can be scheduled on demand on your own site or at the Keynote SIGOS training center in Nuremberg, Germany. Keynote SIGOS training is designed for maximum efficiency. Thats why we limit the seats for each session.

Public Training
The new cost-effective alternative to on-site training!
The Keynote SIGOS Public Training Program is the cost-effective alternative to private on-site training. Benefit from our trainers hands-on expertise being brought to various word-wide locations in a modular concept. Book your public training seat today!

Reporting & Diagnosis - Advanced User Training - Advanced Reporting & Diagnosis - Base
Administrator Training Test Case Editor Training

User Training - Base

Training Public Training

Users Scheduling tests (ad hoc)

Strategic Users Scheduling tests Scheduling reports Defining alarms

Administrator Administrator of infrastructure, access rights management

Test Case Developer Developer of test cases

78

www.keynote-sigos.com

Index

Index
Keyword Page Keyword Page
3 G Layer 3 Tracing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53 3SQM . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61 Administration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76 Alarming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50 Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55 Benchmarking . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19 Billing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28 BlackBerry . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70 Carrier Quality Tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25 Carriers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 75 CDR Comparison Testing . . . . . . . . . . . . . . . . . . . . . . . . . 29 Central Unit . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 Compact Local Unit (CLU) . . . . . . . . . . . . . . . . . . . . . . . . 46 Consulting Services . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76 Content Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18 Control Structure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52 Core Network Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34 Dashboard . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51 Data IP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64 Diagnosis Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53 Digital Rights Management . . . . . . . . . . . . . . . . . . . . . . 69 Drive Service Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17 Early Charging Detection . . . . . . . . . . . . . . . . . . . . . . . . . 27 Echo . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60 Email Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65 Engineering Consulting . . . . . . . . . . . . . . . . . . . . . . . . . . 76 Fixed Network Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32 Fraud Detection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26 Gb Local Unit (Gb LU) . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 GIS (Geographical Information System) . . . . . . . . . . . 51 Global Ressource Pool (GRP) . . . . . . . . . . . . . . . . . . . . . . 45 GlobalRoamer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38 GPRS Attached . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57 GPS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51 GRQ Tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22 GSMA . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22 GUI (Graphical User Interface) . . . . . . . . . . . . . . . . . . . . 51 Handset Oriented Testing . . . . . . . . . . . . . . . . . . . . . . . . 70 Handset Simulation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18 Hardware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 Hotline . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76 Inbound Roaming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20 Indoor Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35 Interactive Voice Response (IVR) . . . . . . . . . . . . . . . . . . 59 Interconnection Carriers . . . . . . . . . . . . . . . . . . . . . . . . . 39 Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42 International Carrier Quality Testing . . . . . . . . . . . . . . 25 International Gateway . . . . . . . . . . . . . . . . . . . . . . . . . . . 25 IP Network Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33 iPhone . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70 IREG 24, 26, 27, 29, 32, 35, 50, 60 . . . . . . . . . . . . . . . . . . 20 ISDN PRI Local Unit (ISDN PRI LU) . . . . . . . . . . . . . . . . . 46 Local Unit (LU) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 Location Update . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57 lu Local Unit (lu LU) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 Maintenance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76 Managed Services . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74 Matrix Reporting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51 Messaging . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62 MMS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63 Mobile Instant Messaging (Mobile IM) . . . . . . . . . . . . 63 Mobile Local Unit (MLU) . . . . . . . . . . . . . . . . . . . . . . . . . . 46 Mobile Network Operators . . . . . . . . . . . . . . . . . . . . . . . 39 Mobile Virtual Network Operators (MVNO) . . . . . . . . 39 Network Diagnosis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16 Network Registration . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56 Network Structure (of SITE) . . . . . . . . . . . . . . . . . . . . . . . 2 Nomadic Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35 On-Demand Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15 Open Connectivity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23 Outbound Roaming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21 Performance Tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74 Periodic QoS Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14 PESQ/POLQA . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60 PEVQ . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67 Portfolio . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10 Prepaid SIM Recharging . . . . . . . . . . . . . . . . . . . . . . . . . . 31 Project Engineering . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77 Project Implementation . . . . . . . . . . . . . . . . . . . . . . . . . . 77 Project Management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77 Push-to-Talk . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58 QoS Monitoring . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74 Regression Test . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34 Regulators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39 Reporting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50 Revenue Assurance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28 Revenue Leakage & Fraud Detection . . . . . . . . . . . . . 26 Ring back tone . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 68 Ring tone download . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 68 Roaming Hubbing Testing . . . . . . . . . . . . . . . . . . . . . . . . 23 Roaming Steering Testing . . . . . . . . . . . . . . . . . . . . . . . . 24 Roaming Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20 Senior Consulting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76 Service Alarm Map . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53 Service Quality Monitoring . . . . . . . . . . . . . . . . . . . . . . . 14 SIM Box Detection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26 SIM Multiplexer (Hardware) . . . . . . . . . . . . . . . . . . . . . . 46 SIM Multiplexing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44 SITE . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42 SITE Recorder . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52 SLA Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22 SMS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62 Speech . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58 SS7 Local Unit (SS7 LU) . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 Strategic Consulting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76 Streaming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67 Supplementary Services . . . . . . . . . . . . . . . . . . . . . . . . . 76 Support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 59 System Hosting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74 Tariff Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30 Test Call / Event Generation . . . . . . . . . . . . . . . . . . . . . . 28 Test Case Editor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52 Test Creation Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52 Test Infrastucture Management (TIM) . . . . . . . . . . . . . 74 Test Operations Management (TOM). . . . . . . . . . . . . . 74 Test Sequence . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52 Test Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49 Training . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 78 Value Added Services (VAS) . . . . . . . . . . . . . . . . . . . . . . 68 Video . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66 Video Quality . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67 Video Telephony . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66 Voice . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58 Voice over IP Quality Testing . . . . . . . . . . . . . . . . . . . . . . 61 Voice Quality . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60 WAP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65 Warranty. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76 Web Browsing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65 Wireless Local Unit (WLU) . . . . . . . . . . . . . . . . . . . . . . . . 46

www.keynote-sigos.com

79

More than 240 operators rely on Keynote SIGOS solutions.


mers usto c e

Some of o ur w or ld -

d wi

Keynote SIGOS GmbH Klingenhofstrasse 50d 90411 Nuremberg Germany

Fon +49 (0)911 9 51 68-0 Fax +49 (0)911 9 51 68-355 info@keynote-sigos.com www.keynote-sigos.com

anoris. 10.2011

You might also like