Keynote SIGOS Product Portfolio

e SIGO
ot S
n
y
Ke
20
YEA
RS
9
19 0
0
89 - 2
P RO D U C T G U I D E
SITE / GlobalRoamer / Professional Ser vices
www.keynote-sigos.com
Keynote SIGOS
Testing is our Competence

Keynote SIGOS was nications itself: we started with testing of
founded under the fixed line services, expanded our intelligent
name of SIGOS back in testing solutions towards mobile telecommu-
1989. For two decades nications in 2G and 3G. Of course we won't
we have been sup- stop there: we will continuously strengthen
porting the mobile our customers’ position through providing
networks, including most more than just basic mobile operator testing
of the World's Top Twenty operators, ensur- services. Next generation network including
ing and improving their Quality of Service VoIP quality testing, revenue assurance and
and helping them to both discover new Drive Service Testing are good examples of
opportunities and launch new services. In solutions that go beyond the verification
other words, we have helped our network of standard services.
customers to continuously improve the
experience of their own customers, driving Today, Keynote SIGOS offers the most tho-
up customer satisfaction and retention. rough active End-to-End Testing solutions
in the market.
We are doing this through providing flagship
solutions for active End-to-End Testing to We have a clear business focus, close co-
the telecommunications industry. Since we operation with our customer base and an
have dedicated ourselves totally to this established and experienced team. Telecom-
speciality we always have to be top notch munications is a relatively young business
in what we do. but we can proudly look back on two
decades of success.
The development of our product portfolio

note SI
also reflects the development of telecommu- ey G
K
O
S
YEA
20
RS
9
1
89
- 2 0 09
3
Index
SITE Test Applications

Keynote SIGOS
End-to-End Testing
Introduction . . . . . . . . . . . . . . . . . . . . . . . . . 6 Basic Call . . . . . . . . . . . . . . . . . . . . . . . . 16
Supplementary Services . . . . . . . . . . . . . . 16
Messaging
SITE TEST SYSTEM
SMS . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
SITE Overview (Tools & Features) MMS . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18
Open System . . . . . . . . . . . . . . . . . . . . . . . 8 Mobile Instant Messaging . . . . . . . . . . . . . 20
Central Open Databases . . . . . . . . . . . . . . . 8 Digital Rights Management . . . . . . . . . . . . 21
SIM Multiplexing . . . . . . . . . . . . . . . . . . . . . 8 Speech
Test Interfaces . . . . . . . . . . . . . . . . . . . . . . . 8 Interactive Voice Response . . . . . . . . . . . . 22
Graphical User Interface . . . . . . . . . . . . . . . . 9 Push-to-Talk . . . . . . . . . . . . . . . . . . . . . . 24
Modularity & Scalability . . . . . . . . . . . . . . . . 9 Voice Quality . . . . . . . . . . . . . . . . . . . . . . 26
Dynamic Resource Management . . . . . . . . . . 9 Voice over IP . . . . . . . . . . . . . . . . . . . . . 28
Test Case Editor . . . . . . . . . . . . . . . . . . . . . . 10 Data
Test Case Recorder . . . . . . . . . . . . . . . . . . . . 10 GPRS IP (CS / PS) . . . . . . . . . . . . . . . . . . 29
Test Sequences & Control Structures . . . . . . . 10 BlackBerry . . . . . . . . . . . . . . . . . . . . . . . . 30
Data Safety . . . . . . . . . . . . . . . . . . . . . . . . . 10 iPhone . . . . . . . . . . . . . . . . . . . . . . . . . . 32
UTF-8 Character Support . . . . . . . . . . . . . . . . 10 WAP . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
Reporting & Alarming . . . . . . . . . . . . . . . . . . 11 Web Browsing, IP . . . . . . . . . . . . . . . . . . . 34
- Service Area Monitoring . . . . . . . . . . . . . . . 12 WLAN . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
- Dashboard . . . . . . . . . . . . . . . . . . . . . . . . 13 Streaming . . . . . . . . . . . . . . . . . . . . . . . . 38
- Matrix Report . . . . . . . . . . . . . . . . . . . . . . 13 Video Telephony . . . . . . . . . . . . . . . . . . . 40
SITE Network Graphic . . . . . . . . . . . . . . . . . . 14 Video Quality . . . . . . . . . . . . . . . . . . . . . . 42
SITE Network Graphic > 14 Drive Service Testing > 44

4
> Index
SITE Test Concepts

GlobalRoamer
Drive Service Testing . . . . . . . . . . . . . . . . . . 44
Handset Simulation . . . . . . . . . . . . . . . . . . . 46 Outbound Roaming . . . . . . . . . . . . . . . . . . . 58
SIM Box Detection . . . . . . . . . . . . . . . . . . . . 48
Revenue Assurance . . . . . . . . . . . . . . . . . . . 50
- CDR Comparison . . . . . . . . . . . . . . . . . . . . 51
- Billing and Rating Verification . . . . . . . . . . . 52
Professional Services
Roaming . . . . . . . . . . . . . . . . . . . . . . . . . . . 53 Professional Services . . . . . . . . . . . . . . . . . . 63
- Inbound Roaming (IREG) . . . . . . . . . . . . . . . 53
- Global Roaming Quality (GRQ) . . . . . . . . . . . 54
Customers
SITE Protocol Test
Protocol Test . . . . . . . . . . . . . . . . . . . . . . . . 55 Customers . . . . . . . . . . . . . . . . . . . . . . . . . . 66
Core Network Testing . . . . . . . . . . . . . . . . . . 55

Layer 3 Trace . . . . . . . . . . . . . . . . . . . . . . . . 55
IN / CAMEL . . . . . . . . . . . . . . . . . . . . . . . . . 56
Customer Map > 66
SIM Box Detection > 48

Photo © T-Mobile AG
5
Keynote SIGOS
> Introduction
SITE TEST SYSTEM
Your Own Scalable and Highly Flexible Testing Infrastructure

Whether you require a stand-alone test solution the existing network infrastructure realities.
or you wish to span your testing facilities around Interfaces to complementary solutions, e.g.
the globe at multiple locations: from Keynote monitoring systems, are provided so that SITE
SIGOS solutions you can always expect scalability, can be exactly matched to your specific
integrity and great expertise reflected in our requirements.
solutions and professional services.
The SITE Test System’s architecture is completely
With the Keynote SIGOS SITE Test System – modular. Only the modules that are needed for
comprising sophisticated hardware and software the given tasks needs to be purchased. Our
solutions – network operators are enabled to Senior Telco Experts will be happy to discuss
host and work with their own testing facilities. your requirements.
Key here is the ability to easily integrate into
GlobalRoamer
Keynote SIGOS Managed Global Infrastructure and Test System

For Outbound Roaming
With GlobalRoamer, Keynote SIGOS offers the All that is required is a web browser and access
most extensive infrastructure for automated to the internet. Simply log on with your password
outbound roaming testing world-wide. We provide and set up your test schedules without worrying
our customers with an extensive network of about a thing. However, Keynote SIGOS can
testing facilities around the globe, hosted by also provide a fully managed roaming test
Keynote SIGOS. GlobalRoamer customers can service so that all that you really need to do
use this sophisticated testing infrastructure is look at the results.
through a web based user interface.
Solution Consulting, Managed Services and More – Flexible

and Customizable
We at Keynote SIGOS are always there for our For instance, with different levels of Managed
customers: in each phase of your testing Services, we can help our customers with the
requirements we provide you with well management, operation and administration of
experienced and specifically trained personnel, tests. Our services are completely customizable
whether it be for project implementation, and scalable: we are handling complete SITE
maintenance, managed services, training or systems for customers as well as we manage
solution consulting. All our Professional Services small occasional testing projects. Just as you
can be customized to your specific needs. please.
6
Keynote SIGOS
> Introduction
The Keynote SIGOS platform for

first-class Quality of Service
Today, network operators are confronted with an extremely dynamic market
and the challenges of keeping up with new technology, permanent surveillance
of Service Level Agreements (SLA) and reducing costs whilst maintaining
customer satisfaction. To fulfil these challenges preventive and permanent
testing is required. These tests can be both labour-intensive and extremely
costly and for those reasons are frequently neglected.
The solution is fully automated testing with SITE:

Keynote SIGOS has developed the most advanced
automated test system available on the market,
providing precise and easy to use automated testing
throughout the entire network.
Cost-Saving Automated Testing

Avoid imprecise, time consuming and labour intensive manual tests
Surveillance
Continuous and precise monitoring of service availability, quality (KQI)
and performance (KPI)
Service Quality Management

Precise measurement of service availability, performance and quality
Reporting
Highly flexible, dynamic and automated reporting and alarming environment
Scalability
From small stand-alone to network-wide distributed systems
Central SIM Multiplexing

To use infinite numbers of SIM Cards at various locations
Graphical User Interface

User-friendly, drag-and-drop graphical interface with rollover help text
Flexible User Access

Permission based access via Internet, LAN and XML
Open Interfaces
For seamless integration and combination of existing and new tools
Customising Environment
Test case editor to create and adapt tests to specific customer needs
7
SITE Overview
Open System Central Open Databases

SITE is an open system and can be easily integrated To ensure maximum performance, the SITE System
into existing test environments. Existing equipment uses an open SQL-based database. All configuration
SITE TEST SYSTEM
may be directly linked to SITE and controlled and information, test results, measurements and KPIs
monitored via the XML system interface. are stored logically, to provide a clear measurement
In addition, current software updates, configuration and reporting capability. Using powerful filter
modifications or problem resolution are quickly functionality any database listing can be easily
and reliably performed by Keynote SIGOS. modified and a multi-format export function allows
the sharing of data with other network support
tools.
Central
Unit Clients
SIM
Multiplexer
Local Units
ISDN GSMA Compact Local

Units
UMTS Uu LAN / WAN
Gb GSM GSM /
ISUP
GPRS Um GSM/GPRS UMTS
Interfaces Interface
lu CS lu PS
supporting thousands of SIM cards serving
Um, Uu and SS7-Interfaces (A, …)
SIM Multiplexing
SITE can handle thousands of SIM and USIM
cards in cascade-style SIM card boards. The Test Interfaces
subscriber information of a SIM card is read out
SITE supports GSM/GPRS Um , UMTS Uu , HSDPA,
by the system and transmitted via a LAN/ WAN
HSUPA, EDGE, CDMA2000, PSTN a/b, ISDN S0, S2m,
network to any test location required. The SIM
GSM A, GSM Gb, ISUP, GSM-R, WLAN, IuCS , IuPS ,
authentication procedure is handled virtually between
Ethernet, DSL, SMPP/UCP/CIMD, MM7.
the wireless interface in any location and the real
SIM stored in the central Multiplexer unit.
SITE Test System
PBX
GSM A SMTP/IMAP
GSM/GPRS Um ISUP SMPP
UMTS Uu* CDMA2000 INAP SCCP WLAN UCP S0 S 2m a/b
MAP CAP TCAP WAP via IP Ethernet CIMD
GSM-R EDGE
Gb GSM IuPS IuCS MM7 DSL MMS via IP
HSPA* BlackBerry PSTN
Mobile Network Core Network Internet Specific Interfaces
* with possibility of Layer 3 protocol trace feature/monitoring
8
SITE Overview
Graphical User Interface

The SITE User Interface enables easy system
operation and administration via either the intranet
SITE TEST SYSTEM

or internet. The Web GUI client is used for
configuration of tests and reports as well as for
administrative system configuration. The system
can be accessed simultaneously by various parties,
each with configurable user rights. The SITE User
Interface provides a user friendly, drag-and-drop
environment to arrange, copy and edit test and
report elements, within a directory tree and folder
system. The Web enabled User Interface enables
a flexible access to the system, for example, by
technicians from remote locations.
The XML interface is used as an integration interface
to exchange input and output data with other
network test or management infrastructure.
Modularity & Scalability

The modularity and scalability of SITE permits independent of permanent IP is just as possible.
optimum system adaptation to customer There are Wireless Local Units (WLU) and Mobile
requirements. Portable and Stand-Alone Systems Local Units (MLU) to increase deployment flexibility.
for implementation in test laboratories are just as
possible as the provision of a distributed system The IP connection is vital to the system and is
to cover the geography of an entire live network. therefore constantly monitored by SITE. The test
The modules of the SITE system are the Central system may be upgraded as required by new
Unit, SIM Multiplexer and Local Units. Local Units applications, functions and test interfaces.
may be connected by permanent IP – but fast,
problem oriented, deployment of local units
Dynamic Resource Management

SITE can execute tests at any time desired. Via the
scheduler window a single or group of tests can
be defined once or periodically, based on very
flexible selection criteria of date, day, time, frequency
and number of repetitions. To avoid any resource
conflict, an intelligent resource management system
controls access to interfaces and SIM cards, assuring
a smooth operation and maximum test parallelism.
The selfmanagement checks system components
regularly and generates an alarm (SNMP-Trap) in
the event of failure.
9
SITE Overview
Test Case Editor DATA Safety

SITE provides large libraries of Test Cases for main SITE redundant is a solution for reliable high
network services in various formats with detailed availability. The main concept is the mirroring of
SITE TEST SYSTEM
parameter options. To create customized own Test the hard disk partition over TCP, based on the
Cases with the assembly of various test steps via standard Linux High-Availability option. It observes
a user-friendly drag-and-drop mechanism SITE the operating system, databases and processes.
provides it’s Test Case Editor environment. Complex If a component crashes a power failure happens
scenarios can be quickly built to enable the testing or anything is stopped manually, then a switchover
of new network services. to the second system will be initiated.
SITE Backup Solution is very important in the case

of a damaged or corrupt database, SITE installation
Test Case Recorder or hard disk. It is based on Arkeia’s “Enterprise
This SITE tool allows intuitive recording of browsing Backup Solutions”. Keynote SIGOS provides this
actions taking handset characteristics into account. backup software with a pre-configured backup
Mobile and provider specific web and WAP pages strategy for the SITE Central Unit. Special features
are retrieved from the network via the test probes are scheduled backups, incremental and
during recording sessions to get a feel for real differentiating backup, as well as tape
download behaviour and latency. Traces are shown administration.
live while the developer is browsing. The test case
can be evaluated before saving the entire browsing
session by replay during creation. Full feature UTF-8 Character Support
support by the Test Case Editor makes later
The UTF-8 feature enables the full encoding for
adaptation of recorded browsing sessions easy. It
e-mail, web pages, & other places where characters
is like having full and instant remote control access
are stored or streamed. SITE test cases support
to a specific handset in a remote location – with
full encoding for SMS, WAP and MMS parameters.
no need to travel anywhere to use it.
All parameters in the Test Case Editor can be filled
with UTF-8 characters unless no specific presets
are given. So an SMS text or html link can be
searched and checked with UTF-8. SITE Reporting
Test Sequences & Control Structures shows all possible values: conventional as well as
UTF-8 entries.
To mimic the typical usage, of say a mobile network
Benefit: Wealth of language specific characters can
customer, a test sequence feature can be used for
be supported, e.g. Latin, Greek & Coptic, Cyrillic,
a series of different service tests after a single
Armenian, Hebrew, Arabic, Syrian, Bengali, Thai,
Location Update. Control Structures provide logical
Myanmar, Georgian …
operators like: List based ‘FOR EACH’, condition
based ‘WHILE and REPEAT’, and time based ‘WAIT’
functions. These features save valuable resource
time and significantly increase the testing throughput
and efficiency of the system.
10
SITE Overview
> Reporting and Alarming
Reporting and Alarming
SITE TEST SYSTEM

SITE Reporting enables users to create, view
and forward multiple reports. These reports are
Test Execution on different locations generated from measurements collected in the
Online report database. These reports can either be
Reporting
real time based on SIGOS standard Key Performance
reporting
Test Executions
alarming
Indicators (KPIs), on KPIs according to ETSI
standards or on individual customized KPIs.
Post
Reporting This report creation is by means of an easy
Raw-Measurements Measurements Report drag-and-drop configuration functionality. SITE
KPI Databases Definition
(Input and Output) Strategy / KPI design
Reporting offers the possibility to visualize test
results in various illustration tools, serving
even specific presentation and monitoring
needs. Flexible standard charts and diagrams
as well as enhanced functionalities like
“percentile”, “ad hoc reporting” and “derive to”
can be immediately generated from recorded
Reporting is fully integrated in SITE
KPI data. Real time alarming is also embedded:
resulting alarm notifications are automatically
distributed e.g. via SMS, e-mail, SNMP, etc. to
defined recipients. Users can define flexible
Service Area Monitoring threshold-settings, counters, severity triggering
points, etc. when alarms should be generated
Dashboard
or cleared.
Matrix Report
Reports can be illustrated in different ways,
either charts in various formats; markers, bars,
lines etc, or by matrix tables to provide a fast
color coded overview of vital services or
specific KPIs.
Your benefits
Automated testing: avoid expensive and time consuming manual tests

Increase reliability of the mobile network, thereby increasing ARPU
Increase customer satisfaction
Monitoring and measuring of service availability and quality Ensuring SLAs with precise KPIs
Scalable architecture: from stand-alone to geographically distributed systems
Central SIM Multiplexing No “SIM card traveling”
Quick detection of problems by rapid parallel testing of all network services
In addition to standard SITE reporting, many powerful reporting features are available
11
SITE Overview
> Reporting Additions
Service Area Monitoring

The SITE Service Area Monitoring application is measurement. An example could be a WAP test
used to visualize mobile network services that initiated from a wireless interface located at
SITE TEST SYSTEM
target a specific Service Area. Alarms that are Latitude (x), Longitude (y). The topology for this
generated by the failure or degraded performance scenario would use specific BTS/node B, BSC/RNC
of services can now be linked to a specific infrastructure, assigned to an MSC/SGSN reaching
network element within the operator’s finally a specific content portal.
infrastructure. This function is implemented by
careful correlation between the specific elements Each network information and trace is processed
used within a Test Case execution, and the overall to provide significant data of the actual network
network topology which has supported the Test performance and functionality, finally combined
Case scenario that generated the alarm or to a total service area view.
Alarm Correlation
Test Definitions Report Definitions Network/Service
Schedules Alarm Thresholds Topology
Test Execution System SITE KPI Database Reporting/Alarming Service Monitoring Engine
Alarms
Test Execution Results (Traces) Report/Alarm View Service View
Drill Down #2 Drill Down #1
Service Area Monitoring is divided in two panels:
SERVICE View DETAILS View

The Service View is the GUI for Service Area The Details View offers further information for
Monitoring application. Users are able to see each unit in the Service View, such as:
the status of network elements in the Name, Alarm Aggregation Method, Comments
Network / Service model graphically. and Assigned Alarms.
12
SITE Overview
> Reporting Additions
Dashboard
This GUI system tool provides a simplified intelligent
interface to SITE reporting. It is interesting especially
SITE TEST SYSTEM

for the people responsible for the service who
want to work intuitively without any training effort.
KPIs can easily be filtered and individually stored
in a few clicks. Individual configurations allow
additional, more customer-oriented, data analysis.
Fast and easy drill down to individual traces is
possible directly from the Dashboard.
Matrix Report
Matrix Report environment allows the user to
view Key Performance Indicator (KPI) data as a
numerical value, which can be easily color coded
to provide a quick, easy to understand overview
of network performance. Service KPIs can
therefore be displayed in a format which is
especially useful for Network Management and
Operations personnel.
Matrix_Single mode allows for the tracking of

one Key Performance Indicator (KPI) , in relation
to two other KPIs in a matrix. Alarm thresholds
can easily be set to provide a distinctive color
output to ensure that possible error conditions
can be quickly seen and understood. In the left
example, the Rx (Receive) Value is the single KPI
represented, against day of the week and different
interface types and their current locations.
Matrix_Multi mode, allows for a table of different

KPIs as the “Y-Axis” to be configured, in relation
to another KPI as the “X-Axis”.
The right example displays the average results
of a tested service, where three different
measurement KPIs, (Success, Failure and
Incomplete) have been tracked against different
PLMNs. By placing the cursor above a selected
cell within the Matrix, additional information can
be gained regarding the displayed statistic. As
with all report charts available in SITE, a “drill
down” process is also available to gain access
to detailed individual test data when required.
13
SITE TEST SYSTEM
Various Technologies –
ONE Test System: SI TE
SITE TEST SYSTEM
14
15
SITE TEST SYSTEM
> End-to-End testing
Why End-to-End Service Testing?

SITE TEST SYSTEM
In a highly competitive market, such as the tele- are multi-switched calls which need complex
communications industry, providing and interaction with the subscriber profile.
maintaining highest quality to end customers Infrastructure growth or changes require that
is key to sustainable competitive advantage. core network configuration data between mobile
to mobile and between mobile and fixed line
With customers having multiple options at hand, is correctly maintained.
poor quality – even the occasional drop of
quality – can have immediate consequences.
Switching between operators never has been Given all these challenges how can you
easier and through mobile number portability
ensure top quality end user experience
a classical barrier to switching long has fallen.
avoid revenue leakage
First class service quality has many influencing safeguard SLA compliance
factors not all being under immediate control
of the operator. Identification of weak points The answer is “Active End-to-End Service
can be difficult and remain undiscovered while Quality Testing and Revenue Assurance” with
the effects still are being carried into the market.
Keynote SIGOS.
Often goes along hidden revenue leakage as
for example through the fraudulent and
undiscovered usage of SIM boxes. Safeguarding Active End-to-End service quality testing and
compliance of service level agreements is another revenue assurance with Keynote SIGOS enables
example that requires active testing. operators to identify weak points and to get in
control over aspects normally out of direct reach.
Even the basic call in fact is not exactly basic: From slipping into the role of end customers
prepaid subscribers, which make the majority and experiencing service quality from different
of most mobile network's customer base, typically angles to preventive testing, as it is required
involve complex intelligent network support when new services are introduced. With Keynote
and interaction with a ‘hot billing’ credit database. SIGOS’ SITE Test System and its comprehensive
Also supplementary services like Call Forwarding, test applications and concepts, operators always
Call Waiting, Call Barring, Call Hold, CLIP/CLIR have the right tool available.
Advantages of active End-to-End Testing

Customers’ View Defined Conditions Preventive Testing
Quality of Service Defined time /duration New Components
Quality of Service on the move Defined data volume Service Introduction
Service reaction time Defined period Regression tests
Exact KPI control Roaming Tests
Revenue Assurance
CDR Compare Immediate Reaction IREG tests
Prepaid account check Immediate fail detection Outbound roaming
Voucher booking Clear alarm situation
16
> SMS
What about your Text Message Service?
SITE TEST SYSTEM

SMS is the worldwide killer application
for network operators.
This simple network application results

in a large percentage of turnover for each
network operator. However, this important
revenue stream also requires constant
monitoring and possible improvement in
quality of service. SMS, as simple as it
may look, when monitored continuously,
often suffers from long delivery durations,
modification of content or missing text
with multiple SMS messages.
Regular tests are therefore required to

maintain a high standard of quality and
to improve customer satisfaction.
Available SMS KPIs:
SMS send duration
SMS deliver duration
SMS end-to-end duration
BSC SMSC BSC
IP IP IP
SMPP UCP CIMD
SITE Test System
Features
Simulation of real subscriber behaviour Protocol test GSM 03.40, MO / MT

Interfaces: GSM/GPRS Um, UMTS Uu, Iu CS, Resource allocation for different users or groups
CDMA2000, GSM A, Check functionality of SMSC
SMPP / UCP / CIMD via LAN (TCP/ IP) Check SM Service functionality
Central SIM Multiplexer: infinite number at peak times
of SIM cards can be managed Transmission time KPI
17
> MMS
Success with MMS!

SITE TEST SYSTEM
Multimedia Messaging Services are vital

to the network operators younger and
higher ARPU (Average Revenue Per User)
customers. With its complex functional
combination of SMS and GPRS it is easy
for the service to become unavailable in
a complex mobile network that is always
being upgraded or optimized.
In order to gain acceptance as a useful

service and drive frequent use by the
subscribers errors should be avoided
from the beginning, as once a service
does not work subscribers turn away
from it. Therefore, to aquire a high
reputation for Quality of Services (QoS),
regular tests are essential.
Test your services proactively via the

automatated SITE MMS Test capability,
and guarantee your subscribers a high
standard of quality!
Features
Simulation of real subscriber behaviour No MM storage limitations

Interfaces: GSM / GPRS Um, GSM A, GSM Gb, MM to legacy handset tests
UMTS Uu, HSDPA, HSUPA, EDGE, Iu CS, Iu PS User definable test messages
CDMA2000, MM7 MO/MT transmission of multipart MMs
Detailed test reports incl. WAP WTP/WSP Segmentation and reassembly supported
decoding Expandable library of MMS test messages
Central SIM Multiplexer: infinite number Logging of all relevant timestamps
of SIM cards can be managed
Resource allocation for different
users or groups
18
> MMS
MMS Test Cases

MMS_MO MMS_MO_ToEmail_Retrieval Via Mobile
SITE TEST SYSTEM

Sending of an MMS message to any external Sending of an MMS message to an e-mail
numbers or e-mail address address and fetching the corresponding
e-mail message via POP3/IMAP
MMS_MT
Receiving MMS via corresponding WAP Page MMS_MO_ToLegacy
after SMS notification Sending of an MMS to a subscriber which has
no MMS capabilities configured by the
network operator
MMS_MO_MT
Sending and receiving of an MMS (notification
and download via WTP or WHTTP protocol stack) Others on Request
Example Test Case MMS_MO_MT
Orig. Orig. MMS Target MMS Target

MMS Client Proxy-Relay Proxy-Relay MMS Client
M-Send
.req
Interactions occuring
beyond MMSM are not M-Notifi
.conf cation.i
M-Send in this document’s scope nd
Re sp.ind
M-Notify
Time passes
.req
TP GET
WSP/HT
M-Retrie
ve.conf
e .ind
Interactions occuring owledg
beyond MMSM are not M-Ackn
ery.ind
M-Deliv in this document’s scope
Available MMS KPIs:

GPRS attach duration MMS fetch duration MMS send to push arrival duration
PDP context activation duration MMS push arrival to receive MMS MMS end-to-end duration
PDP IP UP duration duration
MMS send duration MMS connection to send duration
19
> Mobile Instant Messaging
Can your customers chat via

Mobile Instant Messaging?
SITE TEST SYSTEM
Instant Messaging – the real time text

based communication between two or
more participants – is well known on the
desktop, like Skype, ICQ, MSN etc. This
instant messaging (IM) has made the
leap from the PC to the mobile phone
connecting friends, peers, colleagues
while they are on the go.
To get connected to either fixed IM users

or mobile IM users, Java applets installed
on mobiles deliver branded user interfaces
that reflect the operator-owned mobile
IM community or the most popular
Internet IM services. A single client gives
access to multiple IM systems and can
transmit and receive presence information.
The clients are compliant to the Open
Mobile Alliance (OMA) Instant Messaging
and Presence Service (IMPS). Which also
means the needed IM protocol for mobile
devices is defined by the OMA.
Keynote SIGOS offers Mobile IM test cases based

on OMA, optimized to customer requirements.
Operators who test with SITE can get KPIs about:
registration at the IM server

successful login
“get presence”-information of other users
and whether two parties can “see” each other
text message receipt from IM server
successful logout from the IM server
20
> Digital Rights Management
Make Premium Content download a

premium customer experience and
SITE TEST SYSTEM

test your Digital Rights Management
Digital Rights Management (DRM) is an
important enabler for billing of premium
priced content, e.g. ring tones. To cater
for fast and flexible service creation the
Open Mobile Alliance (OMA) defined
application-level protocols and behaviors
needed to provide powerful as well as
reliable content download functionality.
The scheme is implemented on most

multi-media phones and is intended to
be used by mobile content providers to
control access to their products.
The whole Digital Rights Management

process is relatively complex and could
Digital Rights Management is a complex introduce multiple risks of malfunction.
process. Users expect seamless proce- At the same time, the effect of a possible
dures when downloading premium content. error can be disastrous: unhappy
customers if a fault occurs during the
Ensure your customers will call their
download and billing process of the
download experience a premium one. premium priced content.
The purpose of DRM is to enable controlled

With special SITE Test Cases for the
purchase and usage of digital media objects.
verification of your Digital Rights
Management you can avoid undesirable
The Open Mobile Alliance (OMA) has defined
surprises for your customers and test the
Digital Rights Management specifications for
entire procedure according to OMA
the mobile world:
specifications. So that your customers
will call their download experience a
Forward Lock (prevents the user from
premium one.
unlawful forwarding of protected content)
Combined Delivery
(combined rights object / media object)
Separate Delivery (separated rights object
+ encrypted media object)
21
> IVR
Do your voice response services

work correctly?
SITE TEST SYSTEM
Interactive Voice Response services (IVR)

used, for example, during Voicemail
access, are a common feature of everyday
life. The situations in which people
communicate with services such as
customer care systems via IVR servers
will increase continuously.
Testing these systems is essential for

network operators to assure the quality
of their services and thus keep their
customers. IVR systems are sophisticated
and extremely difficult to test on a
continuous and reliable basis. At present,
complicated test runs in which employees
must manually test IVR systems are to
a large extent standard practice.
Keynote SIGOS innovation has created a

tool that can wholly automate this task.
The IVR tester is designed so that even
the most sophisticated speech menus
may be recorded and recognized based
on a library of voice prompts.
Features
Simulation of real subscriber behaviour Voice mailbox tests

Interfaces: GSM /GPRS Um, UMTS Uu, Iu CS, Resource allocation for different
CDMA2000, PSTN, ISDN So, S2m, GSM A users or groups
and ISUP Announcement comparison based on
Scalable architecture: from stand-alone voice prompts
system to widely distributed system Easy integration of new voice prompts
Detailed IVR test reports DTMF and voice stimulation
Central SIM Multiplexer: infinite number Customer specific extension
of SIM cards can be managed Several languages available
Testing IVR trees Language independent
22
> IVR
IVR systems need to be checked in respect to:
SITE TEST SYSTEM

Availability of voice services
Correctness of announcement
The structure of the entire IVR system
Available IVR KPIs
Recognized prompt
Recognized prompt parts examples
Keynote SIGOS IVR Test System Procedure
calling service number

SITE IVR Tester IVR System
Announcement
comparison recording announcement 1
with Prompt SITE IVR Tester
library
sending DTMF/WAV
IVR System
Announcement
comparison recording announcement 2
with Prompt SITE IVR Tester
library
sending DTMF/ WAV

IVR System
recording announcement n
...
Available IVR KPIs:

Call Duration
Duration of played audio file
Length of recognized reference prompt
Duration of recognition process
Recognition confidence of best recognized
reference prompt
Recorded audio file location
Real duration of recording
23
> Push-to-Talk
Back to the Future with Push-to-Talk

SITE TEST SYSTEM
The “push-to-talk” services turn mobile

phones into walkie-talkies with unlimited
range.
Mobile users like businessmen, delivery

companies and taxi drivers can connect
in a “walkie-talkie-style” at the touch of
a button.
Push-to-Talk over Cellular (PoC) a real-

time, direct, 1-to-1 and 1-to-many voice
communication service is mandatory for
today’s cellular networks. Companies,
especially those needing to be in constant
touch with several teams and locations,
will soon discover PoC to be the most
efficient solution. The benefit of radio-
style communication, especially
broadcasting to many users, makes it
much more convenient than many phone
calls or even call conferencing.
Be sure your Push-to-Talk service meets

the high quality and reliability required.
Features
Simulation of real subscriber behaviour Emulating mobiles like Nokia 5140

Interfaces: GSM/GPRS Um, GSM Gb, and similar
UMTS Uu, HSDPA, HSUPA, EDGE, Iu PS, Real End-to-End Testing of
CDMA2000 real-time-always-on voice service
Central SIM Multiplexer: infinite number Check SIP (Session Initiated Protocol) Control
of SIM cards can be managed Plane of the PoC Application Server
Test 1-to-1 or 1-to-many communication Check RTP (Real-time Transfer Protocol) User
Play and record speech data Plane of the PoC Application Server
24
> Push-to-Talk
QoS testing solution for PoC:
Test PoC availability Check user plane
SITE TEST SYSTEM

Check Communication between Speech data transmission
UE and PoC server Send and receive speech data
Check control plane in AMR format to/from
other group members
Handling SIP sessions which are
Handling of RTCP messages
used to establish and maintain
the connection between PoC-enabled handsets
(Interface: UE and PoC server via UDP)
Registration, authentication and
authorization at PoC server
Group attachment
IP Network
PoC Application Server
RTP SIP
User Plane Control Plane
via Um, Uu
SIP + RTP messages via
Um, Uu
LAN/WAN
Central Unit
SIM Multiplexer
SITE Test System
Available PoC KPIs*:

Registration Failure Ratio Floor Request Time [s] Voice Delay (in session) [s]
Registration Time Stop-Talking Timer Failure Ratio [%] Voice Delay (first) [s]
Session Initialization Failure Ratio [%] Stop-Talking Time [s] Audio Quality
Session Initialization Time [s] Session Cut-off Ratio [%]
Floor Request Failure Ratio [%] Session Setup Time [s] * Reference: ETSI/STQ_Mobile(05)06TD06
25
> Voice Quality
Do you offer excellent Voice Quality?

SITE TEST SYSTEM
Voice Quality is, and will remain the major

key performance indicator for each
operator’s network quality. This is
recognized by subscribers and operators
alike.
Bad voice quality generates short holding

times and repeated attempts, and
immediately sets a poor level of
satisfaction with the user. Furthermore,
international Voice Quality tests can reveal
crucial quality information of different
network carriers, the usage of IP routing
or SIM boxes. Therefore, verification of
voice quality is essential. Subjective tests,
where human beings would have to score
the quality of sound samples in a listening
laboratory environment are expensive.
Automated test methods with the

intention to mimic subjective tests, allow
for a cost effective and consistent
alternative to subjective testing, either
on a referenced or an unreferenced basis.
Referenced Voice Quality (PESQ)
Unreferenced Voice Quality (3SQM)
Features
Simulation of real subscriber behaviour Customer specific audio reference files

Interfaces: GSM /GPRS Um, UMTS Uu, Iu CS, are easy to ingrate
CDMA2000, VoIP, PSTN, ISDN S0, S2m, Objective MOS Voice Quality result values
GSM A, ISUP, LAN/WLAN from 1 -5 (bad, poor, fair, good, excellent)
Central SIM Multiplexer: infinite number Many further measurements
26
> Voice Quality
Referenced Voice Quality Testing (PESQ)

Referenced SITE Voice Quality testing is based automated advanced perceptual voice quality
on the ITU-T P.862 standard via the PESQ analysis, comparing actual test results with an
SITE TEST SYSTEM

algorithm (PESQ = Perceptual Evaluation of audio reference. Referenced Voice Quality Testing
Speech Quality). PESQ forms the state-of-the- provides a very high level of accuracy.
art technique and international standard for
A-Side B-Side
play Audio File record
Reference Audio File = Recorded Audio File
Reference Audio File
optionally: PESQ
Algorithm
A B
A B
Measurements e.g.: Impairment Grade

Call from A-Side to B-Side and perform speech MOS value Excellent 5
quality check, by playing an audio reference file background noise Good 4
from A-Side to B-Side and check the received delays Fair 3
attenuation Poor 2
audio signal with its reference using the
… Bad 1
standardized PESQ algorithm. One crucial result
measurement is called ‘mean opinion score’
(MOS) and the result values can be interpreted
from ‘bad’ to ‘excellent’.
Unreferenced Voice Quality Testing

( 3 SQM™)
SITE also supports the Single Sided Speech Quality
Measure 3SQM™ (ITU-T P.563) for advanced non-
intrusive voice quality testing. The technology behind
3SQM™ is also based on a generic perceptual approach
and so is independent from the network technology
being assessed.
Available Voice Quality KPIs:
MOS_Lq In comparison to intrusive measurement techniques,
MOS_Noise
such as P.862/PESQ, 3SQM™ is based on single ended
MOS_P8001
MOS_Speech measurements. In consequence, accuracy may not be
Background Noise as high but measurements can be made at almost
Average delay any point in the network with any real-world speech
signal.
27
> VoIP
Voice over IP
SITE TEST SYSTEM
With the Voice over IP testing capabilities

of the SITE Test System, it is possible to
perform real time end-to-end active
VoIP-testing to determine the customer’s
experience of the service.
Testing Voice Quality

Although Voice Quality is vitally important
for any type of network that routes voice
traffic, the shift from dedicated circuits
to the efficiency of IP based traffic, brings
its own problems with regard to the end
customer’s perception of performance.
The possibilities for Delay, Jitter and
Packet Loss over an IP based infrastructure,
means the network operator must con-
Available VoIP KPIs:
stantly check the Voice Quality metrics
The Mean Opinion Score /
Perceptual Evaluation of to ensure that problems are detected
Speech Quality (MOS / PESQ) before they cause major disturbances
Delay
and dissatisfac-tion to the customers. As
RTP Jitter
RTP Packet Loss
well as ensuring that end-to-end connec-
tions can be established, maintained in
a speech state for the required test period
and success-fully cleared down, the quality
of real sound samples needs to be
SITE Central Unit checked throughout the “speech” phase
of the connection.
LAN This is why SITE supports voice quality

testing according to the PESQ algorithm
Location 1 recommended in the ITU-T P.862 standard.
CLU Location n
CLU
IP IP Ethernet
PSTN / ISDN PSTN / ISDN

DSL-Router DSL-Router
DSL-Modem DSL-Modem
Fixed Network IP Fixed Network IP

ISDN S0, S2m ISDN S0, S2m
Operator Network
28
> GPRS IP (CS / PS)
Do you meet your subscribers’ demands with

GPRS, EDGE, UMTS and HSPA Data Services?
SITE TEST SYSTEM

Over the air IP data services offer
subscribers a highly flexible way to
connect to a rich world of internet based
services like Email, Instant Messaging,
websites, VoIP and much more.
GPRS represents the first step towards
a faster access provided via EDGE, UMTS,
HSPA (HSDPA / HSUPA). Whilst there are
gains in flexibility the technologies need
to be supervised and maintained leading
to added costs and higher labor content.
To increase revenue and service quality
SITE offers data tests to access all
available technologies via dedicated
interfaces to reveal service performance
and functionality problems.
Service precedence
Availability and reliability
Access speed and delay
Available data KPIs:
Throughput, RTD and idiosyncrasies
GPRS attach duration
And much more ... PDP context activation duration
PDP setup connect duration
PDP IP UP duration
CSD dial in duration
CSD connect assign IP duration
Download: download duration, download rate,
throughput, session time
Features
Simulation of real subscriber behaviour Pro-active testing

Interfaces: GPRS Um, GSM Gb, EDGE, HSDPA throughput: theoretical download
UMTS Uu, HSDPA, HSUPA, Iu PS, CDMA2000, maximum 7.2 Mbps; Cat. 6, 8 and 12
Ethernet IP, DSL HSUPA throughput: theoretical upload
Central SIM Multiplexer: infinite number maximum 2.0 Mbps; Cat. 3 and 5
of SIM cards can be managed HTTP, FTP, SMTP, WAP
Scalable architecture: from stand-alone Measuring transfer rates
system to widely distributed system Roaming aspects covered
Detailed test reports
29
> BlackBerry
BlackBerry, your network’s sweetest fruit?

SITE TEST SYSTEM
BlackBerry is today’s leading wireless

connectivity solution for a large number
of mobile professionals like enterprise
and governmental organizations
worldwide.
It allows users to stay connected with

secure and wireless access to e-mail,
corporate data, calendar and web, to
easily manage all their communication
and information from a single BlackBerry
device whenever and wherever required.
BlackBerry eliminates the hassles of dial-

up by moving mobile data to a “push”
architecture.
Especially for mobile professionals, it is

vital that the network operator provides
the highest levels of quality and reliability.
Features
Simulation of real subscriber behaviour Check sending and receiving e-mails

Interfaces: GSM/GPRS Um, UMTS Uu, HSDPA, Check the BlackBerry device integrated
HSUPA, TCP/ IP email features
Real End-to-End testing of BlackBerry Using BlackBerry devices with a java application
‘push’ service for reflector code – for sending emails
Testing carried out using a commercial Management notification and reporting
BlackBerry device
30
> BlackBerry
QoS testing solution for BlackBerry:

Sending a message from SITE test system to a BlackBerry
SITE TEST SYSTEM

device via mobile operator’s network
Important: time synchronisation for time KPIs
BlackBerry device receives e-mails from the SITE test
system per “push” from the RIM Server and it immediately
responds to the sender with a receive timestamp
SITE extracts timestamp details from the e-mail and
processes them to measurements which can give delivery
delay or success rates in both directions
Mobile Operator’s Network
PLMN
RIM Mail Server

IP Network
with POP3, IMAP
or SMTP Servers
BlackBerry RIM SITE e-mail

device Server Test Case
Push 1. part of e-mail e-mail x @ y.com

(optional) (more parts of e-mail)
e-mail a @ b.com
e-mail with timestamps
SITE Test System
BlackBerry device
with java application
for reflector code
Available BlackBerry KPIs:

Send time
Receive time
Round trip time
Battery level of the device
Battery temperature of the device
31
> iPhone
Up to the hype with iPhone tests

SITE TEST SYSTEM
For many users the iPhone and the 3G

iPhone opened a new era of mobile
phone interaction and services. The unique
combination of multimedia contents,
intuitive multi-touch display controls,
accelerometer and much more created
also a demand for new operator services
dedicated only for a single group of
subscribers.
Operators around the world specify this

group of iPhone users as high-tech –
high potential customers with a distinctive
technology and quality demand. The
unique services offered for this iPhone
customer base like the Visual Voice Mail
Box create additional quality process
demands at each network operator.
The Keynote SIGOS SITE System offers

dedicated iPhone tests to simply fit into
all QoS test procedures performed via
Available iPhone Visual Voicemail KPIs: SITE without any additional effort. At the
same time measurements and KPIs
duration
Failure Rates provide clear evidence of the service
availability and performance focussed on
this group of high-tech – high potential
customers.
Leav
ear
efere
nce m
essa
ge o
n the
Visua
l Voi
ce M
ailbo
x Ser
ver
Receive an SMS notification for a new message
Read the target address from the SMS and open

connectivity via APN to the Visual Voice Mailbox Server
Download the new message from the Visual

Voice Mailbox Server to the device
executed every e.g. 15 minutes
32
> WAP
What about the reliability

of your WAP services?
SITE TEST SYSTEM

Test before your
credibility breaks down!
Wireless Application Protocol technology,

and its correct functionality are vital to
today’s mobile networks and the need
to increase the amount of data usage by
customers. To attract and maintain
customers as data users requires that
content must be interesting and up to
date, which creates risk with the constant
change of Portal structure and individual
page format.
Keynote SIGOS has designed the WAP

1.x /2.0 Test Cases to prevent the drama
of a protracted breakdown in operation
becoming reality and to indentify
unavailable pages or incorrect links,
thereby reinforcing the subscriber’s
existing trust and acceptance of WAP
services.
Available WAP KPIs:
PDP context activation duration
PDP IP UP duration
WAP get duration
Features
Simulation of real subscriber behaviour Testing availability of WAP portals

Interfaces: GSM / GPRS Um, GSM Gb, Resource allocation for different users
UMTS Uu, HSDPA, HSUPA, EDGE, Iu PS, or groups
CDMA2000 Request pages over WAP 1.x or WAP 2.0
Central SIM Multiplexer: infinite number WML/XHTML/CSS decoding
of SIM cards can be managed Content check
Scalable architecture: from stand-alone Location based services
system to widely distributed system Throughput measurements
Detailed test reports WTP/WSP/W-HTTP traces
33
> Web Browsing, IP
What about mobile Internet browsing?

SITE TEST SYSTEM
The combination of high throughput

protocols such as WLAN, EDGE and HSDPA
along with the variety of today’s multi-
functional, big screen handsets open
many new possibilities. The network
operators need to ensure that accessing
the internet directly via http, https and
ftp via a mobile device, provides a similar
experience to the customer as their home
or office fixed network internet connection.
Response, accessibility, Throughput and

so on are major performance indicators
for monitoring the quality of service. In
addition, the SITE Web Browsing test can
access websites, fill in forms, receive
cookies, initiate secure transactions,
download contents etc.
Be sure your service is at its peak in

coping with today’s demands!
Features
Simulation of real subscriber behaviour Chains of user interaction on a web

Interfaces: GSM /GPRS Um, GSM Gb, UMTS Uu, application, e.g. a full e-commerce session
HSDPA, HSUPA, EDGE, Iu PS, CDMA2000, HTTP post/get request methods
WLAN, Ethernet HTTPS (SSL) for secure transactions
Simulation of different browsers, Cookie handling
e.g. Netscape, MSIE, Mozilla Firefox Follow links both by name or URL
Central SIM Multiplexer: infinite number
34
> Web Browsing, IP
Testing Services
such as:
SITE TEST SYSTEM

Send and Check e-mail
Send MMS and SMS over a Web Portal
Check Cookies
Limited check of HTML page content (keywords, images)
HTML parsing
Example: Send MMS to a non MMS compatible mobile

1. Client (A) sends MMS to Mobile (B).
2. (B) receives an SMS notification with a Web Link possibly with password.
3. (B) starts a Web session by sending this Web Link (URL) to an operator Web Portal.
4. Web Portal responses and asks (B) for his authentication.
5. (B) sends authentication (e.g. mobile no., possibly with password).
6. Web Portal responses with MMS.
Operators
MMS Client (A) Mobile Client (B) Web Browser Web Portal
1.
Send MMS
2.
Receive legacy
notification per SMS
Extract Web Link
Start Browser
Session
3.
URL request
4.
URL response )
(with html form
GSM Um 5.
UMTS Uu Authentication
6.
(with MMS)
URL response
SITE
Available Web Browsing KPIs:

PDP context activation duration
PDP IP UP duration
Web Browsing duration
35
> WLAN
Wireless LAN for mobile operators –

Test the availability and services!
SITE TEST SYSTEM
Business at every location, direct e-mail

and internet is today’s life. Due to this,
the number of worldwide Wireless LAN
(WLAN) access points and users is
continuously growing. Many mobile
network operators offer this type of
convenient internet access to their
customers. The existing customer SIM
card is the preferred most secure solution
for identification and authentication to
this service.
If customers discover that the service is

unreliable or inconvenient to use, they
will soon retreat. In a competitive market
it is essential to maximize quality,
reliability and usability along with the
fastest possible time to market. With
SITE WLAN it’s easy to test the availability,
the access and the performance of hot
spots in a flexible, continuous and
accurate way.
36
> WLAN
Testing Services
such as:
SITE TEST SYSTEM

Search for available WLAN networks in
the hot spot area
Entering SSID of WLAN network
Entering WEP network key
Receiving IP address via DHCP DHCP: Dynamic host configuration protocol
DNS: Domain name system
Receiving DNS servers and default IP SSID: Service Set Id
(Identifies the WLAN network to attach)
gateway from the backbone IP network WEP: Wired Equivalent Privacy
(Encryption/ Security mechanism for WLAN)
Payment /Billing procedures
SITE Test System Architecture for WLAN

with CU, CLU, GSM-Probe, SIM Multiplexer and the components of public networks
like hot-spots with Internet access and public terrestrial mobile network with backbone.
SITE
Central Unit
SIM Multiplexer
LAN
Um, Uu
PLMN
Um, Uu Probe
Compact
Local Unit
WLAN Probe
HotSpot
WLAN
Internet
Access Point Server
Available WLAN KPIs:

Number of packets sent
Number of packets received
round trip delay
Features
Simulation of real subscriber behaviour SSID – Network search

Central SIM Multiplexer: infinite number WLAN authentication
of SIM cards can be managed Payment /Billing
Interfaces: WLAN Detailed test reports
WLAN 802.11
37
> Streaming
What about your streaming applications?

SITE TEST SYSTEM
Today, almost every major event, e.g.

sport, news or society events can be
accessed via real-time multimedia streams
on a mobile phone. These multimedia
applications become more and more
important in the wireless and mobile
community.
To make sure that customers can enjoy

these new and exciting premium services,
it is most important to guarantee an
impeccable streaming service. Using the
industry standard protocols RTP and RTSP
the SITE system is up-to-date with the
latest technology. Scheduled and contin-
uous tests make sure that multimedia
streams deliver the desired contents and
the required quality even to the largest
possible groups.
Features
Simulation of real subscriber behaviour Parallel subsessions per stream,

Interfaces: GSM/GPRS Um, GSM Gb, UMTS Uu, e.g. video and audio
HSDPA, HSUPA, WLAN, EDGE, Iu PS, CDMA2000 Send streamed multimedia over IP
Simulation of different browsers, TCP or UDP transport protocols
e.g. Mozilla Firefox, Netscape, MSIE Measurement interval in multiple
Central SIM Multiplexer: infinite of 100 milliseconds
number of SIM cards can be managed Used industry standard RTP/RTSP
38
> Streaming
SITE Architecture for Streaming

Because higher bandwidth rates have become available to
mobile users the use of real time multimedia applications
SITE TEST SYSTEM

has grown dramatically. To ensure the mobile customer enjoys
a positive experience, the streaming data transfer has to be
tested with SITE Streaming. For the solution an RTP/RTSP
client is used to download the data (e.g. audio and video).
SIM Multiplexer
SITE
Central Unit
Test Case
LAN
RTSP
RTP
Compact Socket Interface
Local Unit UDP
WLAN
GSM IP
Probe LAN/DSL/
WLAN Probe GPRS
WLAN
WLAN
PLMN Access Point
Internet
RTSP Server
RTSP / RTP
RTSP (Real Time Streaming Protocol) is a client-server
multimedia presentation control protocol, designed to address
the needs for efficient delivery of streamed multimedia over
IP networks. The actual transmission is done by the Real-
time Transport Protocol (RTP).
Available Streaming KPIs:

GPRS attach duration RTSP packets loss percent video
PDP context activation duration RTSP packets loss percent audio
PDP setup connect duration RTSP packets received video
PDP IP UP duration RTSP packets received audio
39
> Video Telephony
Do you provide reliable video telephony

in 3G UMTS?
SITE TEST SYSTEM
High quality for Video Telephony using

3G UMTS is an absolute must, without
which it is used perhaps once, and then
never again by your customers!
A high expectation regarding quality of

service is set by the mobile UMTS
subscriber, as the premium cost invoked
by use of the service will always
increase customer sensitivity. Due to
competitive pressure, It is mandatory for
wireless service providers to increase
their subscriber’s average revenue
quickly by successfully launching new
services such as video telephony. At the
same time, they must also maintain the
same stable, consistent quality their
customers have come to expect.
The implementation of this technology
often involves complex interaction
between network nodes supplied by
different manufacturers, and therefore
SITE provides the solution to constant automated testing should be
easily ensure the availability of applied to check initial configurations,
and then provide long term monitoring
your video telephony service,
of the service.
and to maintain its efficiency
and quality.
Features
Simulation of real subscriber behaviour Usage of SITE’s standard 3G interfaces – no

Interfaces: UMTS Uu, HSDPA, HSUPA special hardware required
Central SIM Multiplexer: infinite number Usage of standardized or customer
of SIM cards can be managed specific video /audio sequences
Real End-to-End (mobile-to-mobile) Usage of a market leading protocol stack
Video Telephony
40
> Video Telephony
Video telephony with SITE

Video Telephony is a key service for 3G. Mobile
VT is based on 3G-324M / H.324M protocol
SITE TEST SYSTEM

stack which is the “mobile” extension of the
H.324 stack. Currently the only reliable way for
VT calls is to use a 64 kbps circuit-switched
connection to avoid delays as much as
possible. So VT is a real high performance
service for mobile networks and it is currently
only possible via 3G networks.
SITE Test System
Test case Video-coding Test case

H.263
MPEG-4
Multimedia
H.324M Voice Coding Multiplexing H.324M
Call Control AMR H.223 Call Control
stack stack
Control Protocol
H.245
3G UMTS Probe 3G UMTS Probe

PLMN
Specific test case results: Available Video telephony KPIs:

Detailed Error Codes from the VT stacks Video send duration
Video call duration
VT setup time
Video file size
Measurements for data quality (delays, drops) H245 setup duration A
Trace information for advanced analysis H245 setup duration B
Audio send duration
H223 setup duration A
H223 setup duration B
CS Bearer establish duration
41
> Video Quality
Is your network Video Quality excellent?

SITE TEST SYSTEM
UMTS opens a new world of possibilities

with multimedia applications. Customized
infotainment like streaming video, video
messaging, mobile TV and video
telephony offer a unique opportunity to
create a market for highly personalized
and truly inimitable mobility services.
For mobile customers the quality of

services is decisive for acceptance;
especially for motion picture based
services, quality is the key factor to
success.
SITE delivers perceptual quality measure-

ments to reproduce the subscriber’s
quality impression mapped to the mean
opinion score (MOS), similar to other
quality tests.
Be sure that your network’s new multi-

media applications are more then just
moving colour pixels.
Features
Simulation of real subscriber behaviour Objective MOS Video Quality result values
Interfaces: UMTS Uu, HSDPA, HSUPA from 1 -5 (bad, poor, fair, good, excellent)
Central SIM Multiplexer: infinite number Many further measurements
of SIM cards can be managed PEVQ analysis is based on human model of
Customer specific video reference files visual perception
are easy to integrate
Real End-to-End Testing of real-time video
services (video telephony, video streaming,
video messaging)
42
> Video Quality
QoS testing solution for Video Quality:
SITE TEST SYSTEM

Send a video file from A-Side to B-Side. Perform One crucial result KPI is the objective ‘mean
Video Quality check by playing a video reference opinion score’ (MOS). The scale values can be
file from A-Side to B-Side and check the received interpreted from bad to excellent.
video signals against the reference video signals
using the standardized PEVQ algorithm.
A-Side B-Side
play Video File record
Reference Video File = Recorded Video File
Reference Video File
PEVQ
Algorithm
Available KPIs e.g.: Impairment Grade

MOS value Excellent 5
delays Good 4
Fair 3
brightness Poor 2
contrast Bad 1
distortion indicators
…
43
SITE Test Concepts
> Drive Service Testing
Drive Service Testing

What ’s your customers ’ experience on the move?
SITE TEST SYSTEM
SITE solution is a powerful tool to

guarantee Service Assurance and generate
leading KPIs for operator networks. Quality
of subscriber’s experience is not only
driven by static service usage but also
by service deployment on the move.
Mobility truly represents subscribers’
experience in the network.
To cover the mobility aspect SITE offers

the capability to calculate KPIs for moving
subscribers performing end-to-end services
in addition to static subscriber probes.
These mobility tests are geared for
vehicles like taxis, trucks or trains.
Consequently they are called SITE ‘Drive
Enhanced Service Assurance:
Service Tests’. Equivalent to the static
Independent view of end-to-end Local Units SITE collects a variety of
quality for static & moving customers network measurements from moving
subscriber probes, so-called Mobile Local
Customer Experience:
Units (MLU). The information is processed
Reproduce customer’s experience to KPIs and displayed on a brightly
on the move coloured geographic map.
Geographic View:
of your network quality – KPIs
displayed on map
Features
Autonomous System Benchmarking

No engineer needs to be present in the vehicle Comparison with quality of competitors’ networks
Easy Installation and Removal Interfaces
Once the MLU has been installed, no All SITE air interface probes supported
further human interaction required Investment Protection
Network Optimization Compatible extension to existing SITE solution
Troubleshooting & optimization for new securing current investment into Keynote
technology networks SIGOS products
44
> Drive Service Testing
Functionality of Drive Service Testing

The Mobile Local Unit (MLU) is connected to
the electronic board system of a vehicle. In case
SITE TEST SYSTEM

of cars the MLU is automatically started once
the engine is started.
Fully automated test cases, even beyond the

automation grade of previous SITE System
ensure that absolutely no human interaction is
required after first installation in a vehicle and
test case set up of an MLU.
Geographic View (GIS)
GPS Position
Clients
Customer’s
Map Server
Mobile LU
in car
LAN/WAN
Central Unit
Mobile LU
SIM Multiplexer in train
Static LU
Permanent IP Connection
As no permanent IP connection between MLU
Non-Permanent IP Connection
and Central Unit can be guaranteed all the time,
since there will be gaps in coverage, the
communication is realized via an e-mail server.
The MLU sends its results and receives additional
administrative commands via e-mails.
45
SITE Test Concepts
> Handset Simulation
Do handsets work perfectly

in your mobile network?
SITE TEST SYSTEM
The opportunity for mobile operators to

sell exciting new mobile content and
handsets is enormous, but the variety of
available services like MMS, Video
Streaming and Web Browsing may cause
problems when using different handsets.
How can these new devices and services

be properly tested in a cost-effective way
that ultimately leads to increased
revenue and customer satisfaction?
We can help you with a powerful

tool to test all your services, simulating
the large variety of handsets in your
network. – No labour intensive and high
cost manual testing!
Features
Simulation of real subscriber behaviour Database with a large collection of mobile

Central SIM Multiplexer: infinite number devices and their relevant parameters
of SIM cards can be managed New customer or country specific handsets
Interfaces: GSM/GPRS Um, GSM Gb, UMTS Uu, can easily be integrated
HSDPA, HSUPA, EDGE, Iu PS Support of many services: e.g. WAP1.x /WML,
Real End-to-End content test of available WAP2.0 /XHTML, MMS, Video Streaming
handsets on the market (e.g. Mobile TV)
Validation of received contents with
mobile profiles
46
> Handset Simulation
Handsets need to be tested

SITE tests specific handset characteristics against Image Size
network services and device specific monitoring Comparison of all downloaded images with
SITE TEST SYSTEM

of pages with fixed content/ URLs. The following maximum height and width of the device
important content questions are validated: Content Support
Check (based on HTTP/WTP accept header)
Color Support if device can decode downloaded content
Check if device is capable of displaying Data Format
colored images
Check if the downloaded content is valid
SIM Multiplexer MMSC

Central Unit
via UMTS Uu WAP

LAN/WAN GSM/GPRS Um Proxy/Gateway
GSM Gb, HSDPA,
HSUPA, EDGE
Local Unit Content

Server
SITE Test System
SITE Test Case Recorder

This recorder is an easy tool for intuitive creation
of test cases e.g. WAP, Web Browsing or whatever
you need. It is particularly for use in handset
simulation tests. Each click on a hyperlink
creates a URL download test step and a trace
of all browser actions, like HTTP-GET-Requests,
which are shown live whilst the developer is
browsing. (See also chapter “Overview”)
The trace of the recorded session
is shown live during development
Your benefits
Intuitive Recording of browsing actions KPIs for each browsing action

=> No drag ‘n’ drop anymore User defined measurements / KPIs can be
Support of HTML forms added with SITE Test Case Editor
Easy creation & adaptation of browsing sessions Whole session can be ‘Replayed’ during
SITE integrated development to evaluate the test case
Received page content at a glance
47
SITE Test Concepts
> SIM Box Detection
SIM Box Detection –

Make sure your roaming revenues are not being detoured
SITE TEST SYSTEM
SIM boxes have multiple negative effects

on operators, roaming hub providers and
customers alike, e.g.:
revenue loss due to call redirection
roaming calls are intercepted, redirected
and terminated whilst being re-conducted
via the fraudulent SIM box, creating a
cost / revenue shifting along the way
revenue loss due to service inaccessibility

SIM boxes have the negative effect that
multiple popular services, e.g. voice
mailbox, may not be available. Revenue
loss and unhappy customers is the
consequence
revenue loss through missing callbacks

due to the redirection of calls none or
wrong CLIs will be displayed at the
recipient’s side; immediate impact is the
The fraudulent usage of SIM boxes inability to “call back” resulting in a
significant loss of roaming revenue
remains a big issue to various
image loss through bad QoS
network operators around the world.
SIM boxes redirect calls over inadequate,
The revenue leakage caused often highly compressed IP connections,
stays unnoticed, hence no or only resulting in poor voice quality. Call setup
time is extended which also leads to the
little action is taken. impression of an overall bad roaming
QoS of the home network operator.
Features
Reliable detection of SIM boxes Hight test density possible while avoiding
Preserve the revenues you are entitled to network congestions
Cost-effective concept for SIM box detection
Ensure first-class end user experience through

quick elimination of SIM boxes
www.keynote-sigos.com
> SIM Box Detection
SIM Box Detection in two steps

SIM Box Detection is a fully implemented probability of SIM boxes being in operation
feature. The concept follows a very cost- on certain routes by identifying suspicious
SITE TEST SYSTEM

effective strategy: at the first step, SIM Box MSISDNs. Once SIM boxes have been
Detection tests generate results without the identified, the operator can then block these
necessity to establish a speech channel. This suspicious SIMs. Trace files and additional
allows a high test density without possible tools provide the option to identify the actual
network congestion. These results lay the SIM box location, allowing operators to fight
foundation for step two: narrowing down the back on revenue.
Situation:
The A-Party at the visited country (VPMN)
calls the B-party at the home country (HPMN)
Normal situation:
The call is being forwarded through an international roaming network and terminated at your home network (HPMN).
OK Visited Country (VPMN) Home Country (HPMN)
Network International Network

call transfer
A B
Subscriber Subscriber
Detour situation:
The international call is intercepted and terminated by a SIM box located in your home country (HPMN). The
call is transferred to the B-party by a SIM box, e.g. transforming the original international call into a domestic
call whilst bypassing your network.
Visited Country (VPMN) Home Country (HPMN)

not
OK
Network
International
Network call transfer
A B
Subscriber Detour SIM box Subscriber
49
SITE Test Concepts
> Revenue Assurance
Money makes the world go round –

what happens if the networks metering, rating and
SITE TEST SYSTEM
billing is not correct?
For all network operators Revenue

Assurance is of major importance. The
operator must provide fair and accurate
billing to the customer and also avoid
revenue leakage from services being
incorrectly rated and invoiced. In most
countries accuracy of metering and
billing is mandatory to comply with legal
regulations.
How to guarantee
correct billing?
Call Generation Today manual tests only provide
inaccurate, untrustworthy and in most
CDR Comparison cases very expensive results. To ensure
correct billing a precise and reliable
Billing and Rating Verification
Revenue Assurance system is essential.
With SITE scheduled, continuous testing
of all services provides maximum
assurance that all calls are being
correctly billed.
Features
Simulation of real subscriber behaviour CDR generation

Interfaces: GMS/GPRS Um, GSM Gb, UMTS Uu, CDR comparison
HSDPA, HSUPA, CDMA2000, ISDN S0, GSM A, Billing and Rating
ISUP, INAP Invoice comparison
Scalable architecture: from stand-alone Resource allocation for different users or groups
system to widely distributed system Detailed test reports
Central SIM Multiplexer: infinite number Revenue stream audit
of SIM cards can be managed Covering billing aspects of outbound roaming
50
> Revenue Assurance – CDR Comparison
Actual Customer Usage

SITE
CDRs Live Network
Mediation Systems Test Call Generation
SITE TEST SYSTEM

CDR
Tariff Postprocessing SITE Test System
Model
Billing
Filter*
Operator CDRs (rated/unrated) SITE CDRs (unrated)
CDR Import* Billing Verification CDR Import

Rating
Tariff
Model*
Reference CDRs
Live CDRs CDR Comparison
Comparison Results
Unrated CDRs
Rated CDRs
* Customization required Reports
CDR Comparison
The SITE Call Detail Record (CDR) Comparison Leakage and ensuring the end customer is
provides a mechanism to match MSC call subject to a fair and legally compliant charging
records against SITE generated CDRs. Thus, the process. Scenarios such as basic call, SMS etc.
correctness can be verified. Discrepancies are used to generate CDRs from the network
between the MSC CDR and the corresponding elements. These standard network CDRs are
SITE KPIs are calculated. And tolerances of CDR- handled by the operators Mediation, Rating and
pair differences can be passed or failed. Thus Billing Systems.
an independent means of minimizing Revenue
SITE generates and compares output data like:

Time based Calls (e.g. speech) Volume based Calls (e.g. GPRS-data) Event based Calls (e.g. SMS)
A Number A Number A Number
B Number B Number B Number
Call Type Call Type Call Type
Begin of call for both files Begin of call for both files Time stamp from both files
Difference of begin of call Difference of begin of call
Call duration for both files Data Volume for both files
Difference of call duration Difference of data volume
51
SITE Test Concepts
> Revenue Assurance – Billing and Rating
Billing and Rating Verification

With the SITE Billing and Rating concept the the correctness or discrepancies of invoices.
actual price of a test case scenario dependent SITE CDR Comparison, including the price
SITE TEST SYSTEM
upon the defined customer price plan can be comparison, can be used to identify the CDRs
generated. This allows a simple comparison to that cause billing discrepancies.
be made with the actual bill generated by the
network’s billing system.
With this concept there are test cases for the

services like basic call, SMS, MMS, WAP and
HTTP which write their own independently
measured CDRs into a data table. The billing
job then takes these CDRs during a specified
time period, and rates them according to the
pricing plan of the specific subscriber (Tariff The screenshot shows an example of a trace
Model). The calculated price for each Test Case

is then written to the rated reference CDR table. The trace of the billing job can be viewed with
the SITE User Interface. This trace contains on
Furthermore, the reference of the invoice total each line the rating (price) information
for a given period, is calculated and returned generated for each of the CDRs within the
as a result of the billing job. Then the live billing job. Other details include the Service
invoice total is calculated and compared with Type and the event related time stamps. The
the reference invoice. Thus SITE Invoice trace also contains the invoice total for the
comparison creates measurements indicating whole billing job.
A central part of SITE Billing and Rating concept

is the implementation of the price plans. A table
driven Tariff Model is built to replicate the price
plans and billing rules of the network operator.
The tables can be easily modified later, in the
case of changes to the price plan or associated
rules.
The billing job is defined and scheduled in the The SITE Billing and Rating concept again
same way as normal test cases. For the enhances the Return on Investment (ROI) for
parameterization of the billing job the user has the SITE system. Now another vitally important
to provide a subscriber number, a tariff name department, Revenue Assurance (RA), can also
and a time period for which the bill shall be become a user of the SITE system to perform
created. essential checks on the billing process.
52
SITE Test Concepts
> Roaming – Inbound Roaming (IREG)
What about your inbound roaming services?
SITE TEST SYSTEM

Today, subscribers expect all frequently
used mobile services to work reliably
everywhere in the world. Thus, the quality
and availability of services inside and
outside the home network becomes
increasingly important in the battle for
customers.
A large list of international roaming
agreements seems to be the key to
success.
However, most operators simply suffer

from a lack of manpower to perform all
IREG specified test sets like IR 24, 26,
27, 29, 32, 35, 50 and 60 for often well
over 200 Roaming partners.
Keynote SIGOS has facilitated IREG testing to run periodically and automatically,
using all your roaming partner SIM cards. All sets of IREG tests will generate
an ITU-T standardized report for all your roaming partners.
The Keynote SIGOS distributed test Available Roaming KPIs:

Roaming – IREG
system covers the complete network Barring: barring activation duration
barring deactivation duration
and locations, even abroad with Forwarding:forwarding activation duration
forwarding deactivation duration
remote test probes and virtual SIM SMS MO MT: SMS send duration
SMS deliver duration
card transfer. SMS end-to-end duration
Basic call: call setup alert duration
call establish duration
For Outbound Roaming see chapter “Global Roamer”
Features
Simulation of real subscriber behaviour Detailed IREG reports

Interfaces: GSM / GPRS Um, GSM Gb, GSM A, Resource allocation for different
UMTS Uu, HSDPA, HSUPA, EDGE, users or groups
lu CS, lu PS, PSTN, ISDN So Tests according: IREG 24, 26, 27, 29, 32,
Scalable architecture: from stand-alone 35, 50, 60 from GSM MoU
system to widely distributed system
Central SIM Multiplexer: infinite number
53
SITE Test Concepts
> Global Roaming Quality (GRQ)
Consistency and comparability of QoS

tests for Inbound and Outbound Roaming
SITE TEST SYSTEM
Mobile Network Operator A

The newly defined GRQ (Global Roaming
Roaming
QoS
Standard monitoring
methods e.g. daily, monthly
Quality) / IR.81 standards – developed
Parameters 1 2 3 4 by the GSMA in co-operation with selected
KPIa partners like Keynote SIGOS – provides
KPIb
a comprehensive framework for pro-active
Roaming SLA
KPIc
testing, reactive monitoring and assurance
A B
of end-to-end roaming services quality.
Reconciliation
Key to a global perspective on roaming
Compare results
Problem Reporting Mobile Network Operator B quality is consistency of measurements
Troubleshooting Roaming Standard monitoring
QoS methods e.g. daily, monthly and thus comparability between home
Escalation
Parameters 1 2 3 4 network and visited networks, regardless
KPIa
of monitoring and testing methods used.
Both mobile network operators KPIb
can monitor and test on base KPIc
of standard parameters that
followed a comparison of SLAs
and KPIs for QoS.
With SITE and GlobalRoamer,
Keynote SIGOS covers all
specified parameters / KPIs of
IREG – IR.81 for active roaming
end-to-end testing.
What are the GRQ Quality of Service Parameters?
About 40 parameters / KPIs have been identified by defining
5 stages of service usage for Voice, Data and SMS:
Network access
Service accessibility
Connection establishment
Connection sustainability
Connection quality
As an additional service Keynote SIGOS

offers special managed service packages
on GlobalRoamer. With these you can
introduce the standardized GSMA SLA
monitoring approach without administra-
tive or engineering effort on your part.
54
SITE Protocol Test
SITE Protocol Test
SITE TEST SYSTEM

SITE is a flexible solution, which offers an ISUP INTERCONNECTION, CONFORMANCE
extensive library of available test cases, that ITU-T Q.784 & Q.788
fit with the majority of services defined in the ETSI ETS 300 356-31/32/33 Basic Calls
ETSI ETS 300 356-34/35/36 Suppl. Services
mobile network standards and popular
implementations of other additional network
features. These tests enable operators to test
GSM – A (BSSAP)
the End-to-End functionality of their network.
for testing of MSCs
However, it may be necessary for a network
operator to examine the detailed signalling
protocols that support their services, or
implement a non-standard interconnection GSM – Gb
between internal network nodes or external for testing core network components of GPRS
packet domain (e.g. SGSN)
network operators.
Core Network Testing Iu CS / Iu PS over IP

for testing circuit and packet switched
Keynote SIGOS offers core network protocol core network components (e.g. MSC and SGSN)
tests on various core network interfaces in GSM,
GPRS, UMTS and IN environments which are
available with the SITE test system.
Protocol tests are needed to analyse the
network’s behaviour in detail and to reach a
high degree of interoperability between networks
and network components. Keynote SIGOS
engineers have developed test applications on
SITE and have supported various network
operators and vendors with its integration tests.
Layer 3 Trace
Keynote SIGOS offers 3G Layer 3 tracing which
is very important for core network testing. The SS7
primary goal is to get a deeper insight into the for SCCP, TCAP and ISUP
message flow and the protocol data exchanged
between mobile station and network. On most
Qualcomm-based 3G probes traces of the Layer
3 (NAS) signalling messages exchanged are IN/CAMEL TESTS
for SSP and SCP on CAP or INAP
recorded.
Keynote SIGOS supplements the 3G Layer 3
NAS tracing with selectively recorded information
from Radio Resource Control (RRC) signalling MAP
messages, employing appropriate protocol HLR and VLR Test Suite, specified by
Keynote SIGOS
filtering techniques.
55
SITE Protocol Testing
> IN / CAMEL
Improve your IN / CAMEL test strategy!

SITE TEST SYSTEM
CAMEL is the keyword for

intelligent service roaming
within GSM, GPRS and
UMTS networks.
For the differentiation of mobile market

competitors the IN services play a major
role. Above all, the customers demand a
roaming capability that functions exactly
as it would in the home environment.
With most networks having a majority of
Prepaid customers, and the special billing
requirements and checks that must be
made by the home network, the testing
of CAMEL is an essential requirement for
the mobile operator.
Keynote SIGOS offers you a fully

automated IN / CAMEL test system for
preparing your own network

for Camel roaming requirements
End-to-End testing with real

roaming partners
preparing your IN platform (SSP, SCP)
Your benefits
Reduction of testing effort for IN/CAMEL tests Full test system control for simulation
Preparation of the own network components of end-user behaviour at Um
for inbound and outbound roaming No real roaming partner’s network required
(SCP and SSP with high quality) Excluding protocol problems before
Simulation of the complete foreign End-to-End tests
PLMN at CAP, INAP, MAP, ISUP for inbound Automated re-execution for regression tests
and outbound roaming Fully automated IR.32 tests
56
> IN / CAMEL
Testing of IN/CAMEL in the UMTS-GSM-ISDN network environment
SITE TEST SYSTEM

The introduction of IN or CAMEL based services According to the network architecture Keynote
affects various interfaces of the network. In SIGOS has developed test scenarios for tests
order to reduce the implementation risks of on all relevant interfaces adjacent to the
services, all involved components have to be GSM/GPRS/ISDN core networks. These kind of
tested on the related internal interfaces of the tests allow the vendor or network provider to
network. For this kind of core network protocol test either single network components or their
tests, the simulation of several components is own network without any real connection to
necessary. other networks.
The figure below points out which interfaces The SITE Test System offers simulation and tests
and network components should be tested for of IN/CAMEL on the interfaces UMTS Uu,
introducing IN or CAMEL services. GSM/GPRS Um, ISDN S0, ISDN ISUP, GSM MAP
(3), GSM A, GSM Gb, CAP and INAP.
CSE / SCP
Core network protocol
tests with SITE
INAP
MAP
Test interfaces
HLR CAP
CAP
Fixed Network
MAP MAP
MSC/SSP MSC/SSP SGSN/SSP
SGSN/ SSP
A or ISUP A or Gb
ISUP ISUP
Gb
GSM A ISUP MAP CAP INAP GSM Gb
Um ISDN S0
a/b
Test System SITE IN/CAMEL

57
GlobalRoamer
> Outbound Roaming
GlobalRoamer – the easiest way to solve

your Roaming Test needs
The Challenge
Customers demand and expect a high
quality and reliable service from their
chosen network operator and a similar
seamless experience regardless of where
they are currently in the world.
GlobalRoamer
By introducing new technologies and

services like Streaming, Video
Telephony, UMTS and HSDPA, networks
become more and more complex,
interference-prone and increasingly
complicated to administer.
Permanent surveillance of roaming

networks is indispensable but inevitably
extremely complicated due to the lack
of operational visibility of the roaming
partners networks.
Test the service availability and performance for

your customers when they roam to other networks
Features
Centralized SIM Multiplexing technology Daily /weekly/ monthly reporting –

makes your SIMs travel the world! graphical display
All services can be tested (speech, data, Automated alarming based on your
messaging...) threshold settings
Web-based, secure and convenient CDRs, KPIs and traces for billing and
user interface troubleshooting
Daily e-mail reports
Flexible scheduling of test campaigns
(once only, periodically)
58
> Outbound Roaming
The Solution
GlobalRoamer allows you to verify that all
services are available to your roaming customers
worldwide. By means of the Keynote SIGOS SIM
Multiplexing technology your SIMs are capable
of being virtually transmitted to any of our
GlobalRoamer
extensive global network of remote test stations
where the actual testing is performed.
Tests can be generated on an individual SIM Multiplexer

immediate ad-hoc basis, or as a fully automated
group of tests via the flexible test case scheduler.
Sophisticated reporting facilities enable the
visualization of the results, which can be
generated at any required time or sent
periodically via email reporting.
All you have to do is:

Send your test SIM cards to Keynote SIGOS!
Access the worldwide test network via the internet!
Define and start tests and collect the results!
Benefits
Increased roaming revenue due to better Test of new roaming services before
service availability and performance commercial launch
Increased Roaming Customer Satisfaction Complete overview of outbound Roaming
No CAPEX performance at any time
Reduce your mean-time-to-repair in Reduced costs for manual testing
identifying / resolving problems
24 hour testing possible
Full worldwide control of Roaming tests so
Roaming partners’ support is not needed
59
GlobalRoamer
> Outbound Roaming
Ad-Hoc testing and pro-active monitoring

in one combined solution!
GlobalRoamer provides a very powerful test
environment for network or service engineers:
Secure web-based, ad-hoc and periodic

testing environment
Ultimate flexibility in terms of parameter

setting and SIM card selection
GlobalRoamer
Extensive library of predefined test cases,

easily adaptable
Targeted troubleshooting and detailed analysis

based on call traces and CDRs
SMS, MMS, WAP, GPRS, UMTS, HSPA, Voice & Video Quality, CLI
GlobalRoamer provides automated,

pro-active testing of roaming services:
Pro-active monitoring assures optimal

service for your outbound roamers
Continuous network surveillance with
graphical reports
Predefined management reports based on
the most important KPIs
Ultimate flexibility in report generation and
threshold setting
Tailored service view sorted by geography,
operator and service
Automated e-mail alarms directly to the
technical engineer
Automated e-mail reports
60
> Outbound Roaming
Over 250 networks can be tested today
Who benefits from GlobalRoamer?

There are several departments which will benefit from GlobalRoamer.
Keynote SIGOS helps to solve questions!
Management: Service quality:

How to increase and protect highly profitable How to measure the actual experience of
roaming revenue whilst improving quality for highest value roaming customers?
premium customers? Customer Care:
Network operations: How to troubleshoot roaming problems
GlobalRoamer
How to keep expected roaming services in real-time?
working to expectation whilst CAPEX budget Revenue assurance:
is being squeezed? How to verify that the TAP files from roaming
Core network and service engineering: partners are correct?
How to ensure new roaming services work at
launch?
delivery, CF to mailbox, Prepaid CAMEL, USSD call back, PLMN selection
Worldwide testing
Today you can already test over 250 mobile networks worldwide in more than 90 countries.
Currently covered are the following countries:
Afghanistan Cape Verde Iceland Morocco Sri Lanka

Algeria Chile India Netherlands Sweden
Angola China Indonesia New Zealand Switzerland
Argentina Colombia Ireland Nigeria Taiwan
Australia Cook Islands Israel Norway Tajikistan
Austria Costa Rica Italy Pakistan Thailand
Bahamas Croatia Jamaica Panama Tunisia
Bahrain Cyprus Japan Peru Turkey
Bangladesh Czech Republic Jordan Philippines Turkmenistan
Barbados Denmark Korea Poland Turks and
Belarus Dom. Republic La Reunion Portugal Caicos Islands
Belgium Egypt Lebanon Romania UK
Bermuda Estonia Lichtenstein Russia Ukraine
Bosnia and Fiji Islands Lithuania Saudi Arabia United Arab
Herzegovina Finland Luxembourg Serbia Emirates
Brazil France Macedonia Singapore USA
Brunei Germany Madagascar Slovakia Uzbekistan
Bulgaria Greece Malaysia Slovenia Venezuela
Cambodia Hong Kong Mauritania South Africa Vietnam
Canada Hungary Mexico Spain
The GlobalRoamer deployment is ongoing with new locations added continuously.

Please contact us for the current installation base!
61
GlobalRoamer
> Outbound Roaming
What our customers say

Ilse De Kee (Base Belgium) Gerrit Raymakers
“Using GlobalRoamer, we realized that the
(Vodafone NL)
success rate of our CAMEL calls was only “…The biggest profit we yield by using
around 50%! Additional to that, we then GlobalRoamer is the improvement of our GPRS
realized that another 50% of the successful roaming service. By testing this service on a
tests weren’t billed! Thanks to GlobalRoamer, daily basis we were able to notice disturbances
we could detect this and immediately take the prior to customer complaints being reported.
respective actions.” Before we had GlobalRoamer, these tests had
GlobalRoamer
to be done manually; in other words we had

to contact other operators and ask them to
Kjartan Briem perform these tests. This proved to be very
(OG Vodafone Iceland) time-consuming and the frequency of these
tests were at a much lower rate than with
“The chart demonstrates how we could
GlobalRoamer.
decrease the amount of Roaming errors.
[…] Our experience has taught us that network
This improvement was a combination of three
changes can lead to serious roaming problems
actions: the automatic roaming testing with
and, of course, you want to detect these as
the GlobalRoamer service, a new international
soon as possible in order that the customers
carrier connection and the ASR measurements
are less inconvenienced.
on international links.”
To summarize, we can say that we are
enthusiastic about GlobalRoamer. It has helped
Registered roaming problems us in several cases to detect network errors
and because we were able to identify those
Number of problems
errors at an early stage we were able to

decrease the resolve time.”
Aug
Sep
Feb
Apr
Sep
Jan
Jun
Aug
Jul
Oct
Nov
Dec
Mar
May
Jul
Oct
Nov
62
> Your Needs – Our Services
In the liberalized and highly innovative and fast paced

telecommunications market, new products and services
are introduced at very short notice. This means that
complex processes have to be constantly adjusted,
thus generating a need for testing and quality
measurement with independent, reliable and trustworthy
solutions.
The introduction of new services, especially in respect

of being on time and budget, depends on the efficiency
of testing and the availability of appropriate service
quality management tools.
Professional Services –
for an error-free network!
We at Keynote SIGOS are striving to support our
customers in each and every phase of their testing
requirements. Under the umbrella of “Keynote SIGOS
Professional Services” we provide a focussed collection
of support and consulting services.
project implementation
training
maintenance
system hosting
managed services
solution consulting
63
During Project Implementation we assist Training on our solutions can be provided

you in determining the best possible either on site or at our headquarters in
solution for your requirements. With our Germany, and can be supplemented by
expertise gained over two decades in the web-aided meetings. We offer training
implementation of large-scale as well as tailored to users or administrators or we
niche projects we will help you find the develop specific training schedules
optimal solution for efficient and successful according to your requirements.
project realization.
With different levels of Managed Services

packages we take further load off our
Maintenance contracts offer support through customers’ shoulders: let Keynote SIGOS
multiple channels: hotline support, on-site manage the operation and / or administra-
or remote support. Of course, maintenance tion of your tests. This can be either on a
of hard- and software components is project basis on special occasions, e. g.
included as well. Olympic Games, or as part of your supply
chain on a long-term basis.
System Hosting refers to our world-wide Our experts are available for Solution
roaming test infrastructure GlobalRoamer. Consulting at any stage of your project.
Customers gain access to this extensive From systems integration to project
and comprehensive network for roaming management to development of test
testing and do not need to worry about a concepts and coaching during and after
thing. project implementation. You can always
rely on our expertise.
Project Maintenance
Hosted System Managed Solution
Implementation Contract Training
(GlobalRoamer) Services Consulting
(SITE) (SITE)
64
Test Specification and Development

Network Component Tests (Protocol Tests)
SIM Tests and Tests for SIM Toolkit Applications
Service Tests (End-to-End Service)
Mobile Phone Type Approval Tests (2G, 3G)
TTCN Specification & Validation
Engineering Services
SW Development Outsourced Test Services for:
Service Development • Acceptance Tests for Networks
(specifications and reviews) • Type Approval Tests for Mobiles
System and Network Integration (GSM, GPRS, UMTS)
• UMTS – Network Integration and • Network Launch Tests
Interoperability GSM-UMTS • Service Tests (GSM, GPRS, UMTS, IN, IP)
• Interconnection (fixed, wireless) • International Roaming Tests
• Billing Tests (fixed, wireless network)
Senior Consulting Services

Standardisation (ETSI, ITU-T)
Test Strategies
Process Optimisation
Network Management & Network Optimising
Project Management
65
Customers
Albania Finland
Operator
Austria France
Belgium Operator
Germany Operator
Europe Bosnia
Bulgaria
Operator Operator
Greece
Croatia
Hungary
Czech Rep.
Iceland
Denmark
Estonia Operator
Africa / Middle East

Azerbaijan
Angola Operator
Bahrain
Burkina Faso
Congo Brazzaville
Democratic Rep. of Congo
Egypt
Gabon
Ghana
Kenya
Kuwait Operator
North and South America Malawi
Mauritania
Argentina Operator
Morocco
Canada
Niger
Chile Operator
Paraguay Nigeria
Uruguay Palestine Operator
USA Saudi Arabia
Sierra Leone
South Africa
Tanzania
Tchad
Customer Country
Tunisia
66
Ireland Portugal Switzerland Operator
Italy Operator Operator Romania Turkey
Kazakhstan Operator Russia UK
Luxemburg Serbia Ukraine
Macedonia
Slovakia
Malta
Slovenia
Netherlands
Spain Operator Operator
Asia Pacific
Afghanistan
Bangladesh
Cambodia
China
Hongkong
India
Indonesia
Malaysia
Pakistan
Singapore
Madagascar
Sri Lanka
Taiwan Operator
New Zealand
UAE
Thailand Australia
Uganda Operator
Vietnam
Zambia
67
Keynote SIGOS GmbH Fon +49 (o)911 9 51 68-0
Klingenhofstrasse 50d Fax +49 (0)911 9 51 68-355
90411 Nuremberg info@keynote-sigos.com
anoris. 01.2009
Germany www.keynote-sigos.com

Keynote SIGOS Product Portfolio

Uploaded by

Document Information

Original Description:

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Keynote SIGOS Product Portfolio

Uploaded by

Copyright:

Available Formats

e SIGO

Testing is our Competence

founded under the fixed line services, expanded our intelligent

name of SIGOS back in testing solutions towards mobile telecommu-

1989. For two decades nications in 2G and 3G. Of course we won't

we have been sup- stop there: we will continuously strengthen

porting the mobile our customers’ position through providing

other words, we have helped our network of standard services.

customers to continuously improve the

up customer satisfaction and retention. rough active End-to-End Testing solutions

We are doing this through providing flagship

speciality we always have to be top notch munications is a relatively young business

in what we do. but we can proudly look back on two

The development of our product portfolio

SITE Test Applications

SITE Overview (Tools & Features) MMS . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18

Open System . . . . . . . . . . . . . . . . . . . . . . . 8 Mobile Instant Messaging . . . . . . . . . . . . . 20

Central Open Databases . . . . . . . . . . . . . . . 8 Digital Rights Management . . . . . . . . . . . . 21

SIM Multiplexing . . . . . . . . . . . . . . . . . . . . . 8 Speech

Test Interfaces . . . . . . . . . . . . . . . . . . . . . . . 8 Interactive Voice Response . . . . . . . . . . . . 22

Graphical User Interface . . . . . . . . . . . . . . . . 9 Push-to-Talk . . . . . . . . . . . . . . . . . . . . . . 24

Modularity & Scalability . . . . . . . . . . . . . . . . 9 Voice Quality . . . . . . . . . . . . . . . . . . . . . . 26

Dynamic Resource Management . . . . . . . . . . 9 Voice over IP . . . . . . . . . . . . . . . . . . . . . 28

Test Case Editor . . . . . . . . . . . . . . . . . . . . . . 10 Data

Test Case Recorder . . . . . . . . . . . . . . . . . . . . 10 GPRS IP (CS / PS) . . . . . . . . . . . . . . . . . . 29

Test Sequences & Control Structures . . . . . . . 10 BlackBerry . . . . . . . . . . . . . . . . . . . . . . . . 30

Data Safety . . . . . . . . . . . . . . . . . . . . . . . . . 10 iPhone . . . . . . . . . . . . . . . . . . . . . . . . . . 32

UTF-8 Character Support . . . . . . . . . . . . . . . . 10 WAP . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33

Reporting & Alarming . . . . . . . . . . . . . . . . . . 11 Web Browsing, IP . . . . . . . . . . . . . . . . . . . 34

- Service Area Monitoring . . . . . . . . . . . . . . . 12 WLAN . . . . . . . . . . . . . . . . . . . . . . . . . . . 36

- Matrix Report . . . . . . . . . . . . . . . . . . . . . . 13 Video Telephony . . . . . . . . . . . . . . . . . . . 40

SITE Network Graphic . . . . . . . . . . . . . . . . . . 14 Video Quality . . . . . . . . . . . . . . . . . . . . . . 42

SITE Network Graphic > 14 Drive Service Testing > 44

SITE Test Concepts

Core Network Testing . . . . . . . . . . . . . . . . . . 55

Customer Map > 66

SIM Box Detection > 48

SITE TEST SYSTEM

Your Own Scalable and Highly Flexible Testing Infrastructure

Keynote SIGOS Managed Global Infrastructure and Test System

Solution Consulting, Managed Services and More – Flexible

The Keynote SIGOS platform for

The solution is fully automated testing with SITE:

Cost-Saving Automated Testing

Service Quality Management

Central SIM Multiplexing

Graphical User Interface

Flexible User Access

Open System Central Open Databases

ISDN GSMA Compact Local

SITE Test System

Mobile Network Core Network Internet Specific Interfaces

* with possibility of Layer 3 protocol trace feature/monitoring

Graphical User Interface

SITE TEST SYSTEM

Modularity & Scalability

Dynamic Resource Management

Test Case Editor DATA Safety

SITE Backup Solution is very important in the case

Reporting and Alarming

SITE TEST SYSTEM

Automated testing: avoid expensive and time consuming manual tests

Service Area Monitoring