Keynote SIGOS Product Portfolio

PRODUCT GUIDE

Various Technologies ONE Test System: SITEAbbreviationsBSC BTS CDR CIMD GGSN GMSC GPRS GSM HLR IP ISDN ISUP LTE MGW MMSC MSC PBX PoC PSTN RNC SGSN SITE SMPP SMSC UCP UMTS UTRAN VLR Base Station Controller Base Transceiver Station Call Detail Record Computer Interface to Message Distribution Gateway GPRS Support Node Gateway MSC General Packed Radio Service (2.5G) Global System for Mobile Communications (2G) Home Location Register Internet Protocol Integrated Service Digital Network ISDN User Part Long Term Evolution (4G) Media Gateway MMS Center Mobile Switching Centre Private Branch Exchange Push-to-talk over Cellular Public Switched Telephone Network Radio Network Controller Serving GPRS Node SIGOS Integrated Test Environment Short Message Peer to Peer Short Message Service Center Universal Computer Protocol Universal Mobile Telecommunications System (3G) UMTS Terrestrial Access Network Visitor Location Register

DSL WLAN Ethernet

IP

I

etw PN

o rk

GGGn/Gp

SN

SG

SN tcke it Sw

d che

Co

r

PaS1/S11 luPS Gb

Gs

Gr

LTEUu

e-Node B

m Ter g Lon

l Evo

on uti RNlub Node B

luCS

UMT S

C

lur

UT

R

tw Ne s s cce A AN

o rk

Uu

GSM

BSAbis BTS

C o rk

GSUm

M

tw Ne s es Ac c

CDR IPBi l lin g d an tin g

Ra

Gi

C

e dS an t ten on

r vi

cesMM7

GGGn/Gp

SN tw Ne o rkGc

MMSMPP UCP CIMD

SC

ke

wit t-S

d che

C

o re

P WA P

Ma SC

il t Pl a for m

Gs

Gr

Gd

SC HLR D

C MSOp

Se or t a er

r vi

ce

GME

SC rkISUP S2mit Sw ch PB X

MS C-S erv er/ VL R

Mc MGW

Ci r

it Sw t i cu

d che

o etw N re Co

A

B

SC o rkCDMA

PS

tw Ne N D / IS TN

o rk

tw Ne s ces

a/b So

All trademarks and registered trademarks are the property of their respective owners.

Contents

Keynote SIGOSIntroduction. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6 Company. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8 Portfolio. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10

TEST SYSTEMS

36

GlobalRoamer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38 World-Wide Coverage . . . . . . . . . . . . . . . . . . . . . . . . 39 Use Cases . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41

USE CASESService Quality Monitoring

12

SITE . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42 The Unique Test Platform . . . . . . . . . . . . . . . . . . . . . 42 Hardware Components & Interfaces . . . . . . . . . . . 46

Periodic QoS Testing . . . . . . . . . . . . . . . . . . . . . . . . . . 14 On-Demand Testing . . . . . . . . . . . . . . . . . . . . . . . . . . 15 Network Diagnosis . . . . . . . . . . . . . . . . . . . . . . . . . . . 16 Drive Service Testing. . . . . . . . . . . . . . . . . . . . . . . . . . 17 Content Testing / Handset Simulation . . . . . . . . . 18 Benchmarking. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19

Test Tools for SITE and GlobalRoamer . . . . . . 48 Reporting & Alarming . . . . . . . . . . . . . . . . . . . . . . . . 50 Test Creation Tools. . . . . . . . . . . . . . . . . . . . . . . . . . . . 52 Diagnosis Tools. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53

Test Applications for SITE and GlobalRoamer. .54 Network Registration . . . . . . . . . . . . . . . . . . . . . . . . . 56 Voice. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58 Voice Advanced . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60 Messaging . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62 Data . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64 Video . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66 Value Added Services. . . . . . . . . . . . . . . . . . . . . . . . . 68 Handset Oriented Testing. . . . . . . . . . . . . . . . . . . . . 70

Roaming Testing Inbound Roaming Testing . . . . . . . . . . . . . . . . . . . . 20 Outbound Roaming Testing. . . . . . . . . . . . . . . . . . . 21 SLA Testing according to GSMA (GRQ) . . . . . . . . . 22 Roaming Hubbing Testing . . . . . . . . . . . . . . . . . . . . 23 Roaming Steering Testing . . . . . . . . . . . . . . . . . . . . 24

International Carrier Quality Testing Dedicated carrier route selection . . . . . . . . . . . . . 25

Revenue Leakage & Fraud Detection SIM Box Detection. . . . . . . . . . . . . . . . . . . . . . . . . . . . 26 Early Charging Detection . . . . . . . . . . . . . . . . . . . . . 27

PROFESSIONAL SERVICES

72

Managed Services . . . . . . . . . . . . . . . . . . . . . . . . . . . 74 Consulting Services . . . . . . . . . . . . . . . . . . . . . . . . . 76 Project Management & Implementation . . . 77 Training . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 78

Revenue Assurance Test Call / Event Generation. . . . . . . . . . . . . . . . . . . 28 CDR Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29 Tariff Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30 Prepaid SIM Recharging . . . . . . . . . . . . . . . . . . . . . . 31

INDEX REFERENCES

79 80

Fixed & IP Network Testing Fixed Network Testing . . . . . . . . . . . . . . . . . . . . . . . . 32 IP Network Testing. . . . . . . . . . . . . . . . . . . . . . . . . . . . 33

Core Network Testing Testing without Radio Access . . . . . . . . . . . . . . . . . 34 Regression Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . 34

Nomadic & Indoor Testing . . . . . . . . . . . . . . . . . . 35 5

With a customer base of more than 240 operators around the world in over 100 countries... With over 50 representations around the world, covering sales and post sales services... With more than 20 languages spoken by our expert staff...

...your world-wide partner in telecommunications testing: Keynote SIGOS

6

IntroductionCompanyTesting is our Competence

PortfolioSITE Active end-to-end test system GlobalRoamer Managed world-wide system Professional Services Consulting and more

7

Introduction > Company

Foundation of SIGOS Systemintegration GmbH

Testing and integration support for the first German GSM network

Active participation in standardization process as full member of ETSI

Keynote SIGOS

1985IndustryFirst ISDN communication system is established

1987

1989

1990

1991

The idea for GSM is born (Memorandum of Understanding)

First GSM network is launched in Finland (2G)

Keynote SIGOSThe CompanyWhat we doKeynote SIGOS provides scalable and fully integratable telecommunications testing solutions to service network operators (mobile and fixed line as well as MVNOs), content providers, carriers and regulators. Our solutions and services are designed to give our customers the full picture on Quality of Service from an end-user perspective. But we do not stop there: our customers enjoy the most comprehensive range of scalable active end-to-end testing solutions available on the market. Service Quality testing and monitoring Roaming testing International Carrier Quality testing Revenue Assurance and Billing verification Revenue Leakage and Fraud Detection solutions Drive Service testing Fixed and IP network testing Test creation, diagnosis and reporting tools Core Network testing solutions Handset simulation

SITE Testing Environment now includes mobile network End-to-End testing

SIGOS provides test and integration support to all German GSM networks

GlobalRoamer goes online

Launch of BlackBerry, PoC, Video Testing

Keynote SIGOS

1997Industry

20003G starts: First CDMA2000 commercial system is launched in South Korea

2001First commercial UMTS network is launched in Norway

20021 Billion of mobile phone subscribers world-wide

2005HSDPA is introduced

8

www.keynote-sigos.com

Introduction > Company

SITE End-to-End testing environment for fixed line networks is born

SIGOS plans a GSM core network

SITE DECT for type approval tests introduced

SITE ISUP for conformance test for C7 networks

1992

1993

1994

1995

1996

SMS is introduced World Wide Web (www) is born

First commercial website

VoIP in its infancy is used for the first time

GPRS / EDGE (2.5G) ADSL allows high-speed communication over phone lines

Who we areFounded in 1989 under the name of SIGOS Systemintegration GmbH, Keynote SIGOS brings in more than two decades of broad experience to the telecommunications industry, helping our customers to be even more successful in todays highly competitive environment. Keynote SIGOS is a truly international company: bringing people from multiple cultural backgrounds together to outstandingly serve our global customer base with what Keynote SIGOS employees all have in common: true passion for telecommunications!

Keynote SIGOS is headquartered in Germany where our solutions are being developed under highest standards. Representations on multiple continents and our strong partner network distributed all over the world rounds up our world-wide presence.

Keynote acquires SIGOS GmbH

SITE provides test environment for VoIP, ADSL, DSL, HSUPA

Launch of Billing Verification and Drive Service TestKe yno

Introduction of Keynote SIGOS GlobalResource Pool celebrates GlobalRoamer to cover its 20 Years of the world countries Anniversary LTE Test Systemte SIGOS

Keynote SIGOS introduces IPv6 test cases and test interfaces

20YEA

RS9

2006VoIP is now established as communications platform

2007HSUPA is introduced

2008HSPA+ is introduced Mobile Connections hit 4 Billions world-wide

19 00 89 - 2

2009

2010Beginning of LTE era (4G)

2011IPv4 addresses to run out by the end of the year

HSPA+ rollouts


9

Introduction > Portfolio

The PortfolioSteering of Roaming Testing Fraud Detection for National & International Tra c International Carrier Testing

GlobalRoamer

Outbound Roaming Testing

Billing Testing for International Tra c World-wide Handset Speci c QoS Testing QoS Tools for Diagnosis & Reporting

Fraud Detection Revenue Assurance ToolSIM Multiplexer ClientsLAN / WAN

SITE TEST SYSTEM

Roaming Testing

SITE Central Unit

Drive Service TestingCLU LU CLU WLU MLU

LU

CLU

LU

Core Network Testing

Fixed

IP Networks

Mobile

Handset Speci c QoS Testing

QoS Tools for Diagnosis & Reporting

GO

P GR h wit AL B GLO

Managed Services

Professional Services

Training

Consulting Services

Project Management & Project Implementation

10


The Managed Global Infrastructure and Test System For The World-Wide Telecommunications IndustryWith GlobalRoamer, Keynote SIGOS offers the most extensive infrastructure for automated telecommunication testing world-wide. We provide our customers with an extensive network of testing facilities around the globe, hosted by Keynote SIGOS. GlobalRoamer customers can use this sophisticated testing infrastructure through a web based user interface. All that is required is a web browser and access to the internet. Simply log on with your password and set up your test schedules without worrying about a thing. However, Keynote SIGOS can also provide fully managed test services so that all that you really need to do is: look at the results. The on-demand world-wide test platform hosted by Keynote SIGOS

Your Own Scalable and Highly Flexible Testing InfrastructureWith the Keynote SIGOS SITE Test System comprising sophisticated hardware and software solutions network operators are enabled to host and work with their own testing facilities. The key is the ability to easily integrate into the existing network infrastructure realities. Interfaces to complementary solutions, e.g. monitoring systems, are provided so that SITE can be exactly matched to your specific requirements. The SITE Test Systems architecture is completely modular. Only the modules that are needed for the given tasks needs to be purchased. Your local SITE system can go global by connecting to the world-wide GlobalRoamer probes with our GlobalResource Pool feature - all in one go! One platform for all your end-to-end test requirements

Solution Consulting, Managed Services and More Flexible and CustomizableWe at Keynote SIGOS are always here for our customers: in each phase of your testing requirements we provide you with well experienced and specifically trained personnel, whether it be for project implementation, maintenance, managed services, training or solution consulting. All our Professional Services can be customized to your specific needs. For instance, with different levels of Managed Services, we can help our customers with the management, operation and administration of tests. Our services are completely customizable and scalable: we are handling complete SITE systems for customers as well as we manage small occasional testing projects. Just as you please. Expert staff gives assistance at all project phases


11

Versatility is key!

Keynote SIGOS solutions in action.

12

The Use CasesService Quality Monitoring> > > > > Periodic / On-Demand Testing Network Diagnosis Drive Service Testing Content Testing / Handset Simulation Benchmarking

Roaming Testing> > > > >

Inbound Roaming Testing Outbound Roaming Testing SLA Testing according to GSMA (GRQ) Roaming Hubbing Testing Roaming Steering Testing

International Carrier Quality Testing> Dedicated Carrier Route Selection

Revenue Leakage & Fraud Detection> SIM Box Detection > Early Charging Detection

Revenue Assurance> Test Call/Event Generation > CDR Comparison Testing > Tariff Testing > Prepaid SIM Recharging

Fixed & IP Network Testing> Fixed Network Testing > IP Network Testing

Core Network Testing> Testing without Radio Access > Regression Testing

Nomadic & Indoor Testing> Nomadic Testing > Indoor Testing

13

Use Cases > Service Quality Monitoring

Service Quality MonitoringPeriodic QoS testingSlow setup time, service outages or unsuccessful data downloads are experienced in every network. In order to manage daily operations standardized matrices should be deployed by several divisions, e.g. Service Operations, Service Quality Assurance, Network Operations, International Roaming and Revenue Assurance.

In a highly competitive market, such as the telecommunications industry, providing and maintaining highest quality to end customers is the key to a sustainable competitive advantage. With customers having multiple options at hand, poor quality even the occasional drop in quality can have immediate consequences. Switching between operators never has been easier through mobile number portability. First class service quality has many influencing factors not all being under the immediate control of the operator. Identification of weak points can be difficult and some may remain undiscovered even while their effects are still evident in the market.

Keynote SIGOS offers accurate measurements of end-to-end quality for voice and data services by measuring KPIs like call setup success rates, HSDPA, HTTP average throughput or service degradation of BlackBerry services. Taking round the clock automated measurements at the end users interface (rather than in network nodes) operators obtain in-depth insight into end-users perception of the network. Generation of active test calls 24/7 without the cost of 24/7 staff - covering all aspects of the network and the upload of KPIs to a centralized alarming system provides excellent real-time feedback on the service levels of the network.

See your network through the eyes of your customer

Active testing benefits Testing time Continuous heartbeat tests End user experience Best reflection of end user experience: E2E service quality tests Time to detect issues Identification and localization of service and network issues can be achieved before actual service degradation and threat of revenue loss Operating costs Reduced operating costs by automating monitoring, testing, and reporting; increased personnel efficiency; costs not correlated with network size and growth Testing scope Pro-active test approach can be realized; in control of testing scope

14



On-Demand TestingPerform reproducible ad-hoc testing!The customer service desk keeps getting complaints about certain service scenarios like BlackBerry e-mail service not reliable, basic voice calls not possible in certain locations, in the home country as well as abroad. Quick action needs to be taken!

World-wide TestingKeynote SIGOS hosts the largest and most comprehensive world-wide test infrastructure, currently covering 4/5 of the worlds countries. GlobalRoamer users benefit from the availability and flexibility of the GlobalRoamer test network without the effort of running their own system. GlobalRoamer account holders log on and schedule their tests whenever the demand occurs. Being able to perform tests independently and without the usual hassles connected with doing business globally like time-zones is an invaluable asset!

Home Network TestingSITE enables network operators to test all relevant services in their network with a private test system. All locations covered by the private SITE system can be used for flexible end-to-end testing. Due to their modular structure, SITE test systems can range from a small local system to geographically widely distrubuted areas as well. The unique feature Global Resource Pool however, enables operators to expand the capability of their SITE system no matter how small or big it may be to reach out to world-wide test locations covering 4/5 of the worlds countries! In fact, they are enabled to utilize the huge network of GlobalRoamer test probes all in one go! See your network through the eyes of your customer Root causes can be localised easily when used in tandem with Keynote SIGOSs integrated analysis tools. Time zone and business hours differences often make it difficult to run tests with the co-operation of roaming partners. GlobalRoamer offers an easy and instant solution to this problem.

If a real time test is needed, and its too late to contact a roaming partner, I can re-produce the test scenario identically.

The test call can be replicated repetitively in order to check whether service has been re-established. GlobalRoamer is deployed to survey specific services over roaming partners networks managing both post-paid and prepaid SIMs across the different technologies. The SIMs are co-located in Keynote SIGOS premises in Nuremberg, Germany.

There is no time lost as we do not have to get in touch with the roaming partner. We can execute tests via GlobalRoamer in a matter of a few minutes anywhere in the world where SIGOS has coverage. Before we started to use GlobalRoamer sometimes we had to wait more than 3 months for execution of a roaming test because partners were occupied with other roaming partners tests. The SIGOS test system helps us to manage our test SIMs efficiently as we do not have to send the SIMs to multiple countries for roaming testing. It provides us with a fully controlled test platform. We can perform multiple test cases easily and simultaneously.


15


Network DiagnosisModel your network & find the root cause of service outages!Once periodic heartbeat testing for the services has been set up, very often Service Operations is the first team to detect service outages through the results of this active testing. But what network entity has caused the fault? SITE proves not only to be a good reflection of real customer experience but also shows up bottlenecks in the network infrastructure via its solution Service Alarm Map (SAM). By supervision of all relevant end-customer services and correlation of network events it becomes possible to both anticipate and analyze service affecting network problems. A clear and comprehensive mapping of service problems to the performance of individual network elements and systems can then significantly drive down time to repair. Service Alarm Map helps to reduce the time for root cause identification and supports the technical service teams with additional information like error-id, trace details & measurement values. This important drill-down functionality from service chain visualization to raw measurement values and trace information improves reaction times in the event of traffic congestion and network element failures.


The number of customer complaints have been reduced significantly due to network issues being identified faster by the Keynote SIGOS test system. Real-time alerts and reports of incidents lead to faster resolution of the network issues identified. Subscribers are not fast enough to call our Customer Care to lodge a complaint.

MSC 4 BSC 12 SGSN 2 GPRS backbone

LocationUpdate2G

GPRS_Attach2G

Opera serverDL_Duration HttpAvINTERNET VPN Tunnel

GGSN

PDP_ContextActivation

Router

Internet

DL_Duration HttpAv

Example: The Service Alarm Map (SAM) indicates a problem on BSC12

16



Drive Service TestingTest mobile subscriber experience on the move!SITE has already been widely deployed for periodic QoS testing and KPI generation. Quality of subscriber experience however is not only driven by static service use but also by service deployment on the move. Testing during moving is an important complementary approach in addition to stationary testing. SITE is a powerful tool for the delivery of Service Assurance and generation of leading Key Performance Indicators (KPIs) for operator networks, not only for static testing but also for mobility, simulating end user experience. Equivalent to the behavior of static Local Units, the SITE System collects a variety of network measurements from moving subscriber probes, known simply as Mobile Local Units (MLUs). These mobility tests are geared for vehicles like taxis, trucks or trains. Consequently they are called SITE Drive Service Tests. The raw information is processed into KPIs and displayed on a color coded geographic map. Drive Service Testing provides you with Service QoS KPIs (Voice Quality etc.) as well as many specific measurments (RxLevel, Handover, Call ID, MAIO...)

Unattended System SITE Drive Service Test is a completely autonomous system after installation. No engineer needs to be present in the vehicle for test setup, modification or analysis. Easy Installation and Removal MLU is shipped fully pre-configured and only needs to be connected to the electronic on-board system. No further human interaction, not even switch-on is required. Geographic View SITE system delivers graphical views on your network quality. A comprehensive set of KPIs enriched with further information like speed of moving vehicle, altitude and position can be displayed on a map. WMS maps, e.g. operators own coverage map, display KPIs customizable by operator.


Investment Protection Drive Service Tests are fully SITE compatible and can be performed as an extension to existing SITE systems securing current investment into Keynote SIGOS service assurance products.


17


Content Testing / Handset SimulationDo all handsets work perfectly in your mobile network?The opportunity for mobile operators and advertisers to sell exciting new mobile content is enormous. However, the variety of available services like MMS, Video Streaming and Web Browsing may cause problems when using different handsets, since the service platforms of the network react individually to each mobile phone type! Data Services like Web and WAP browsing, streaming, MMS or video telephony are ARPU driving services. Premium content download is another huge revenue driver. Subscribers expectations on quality of service are legitimately high. At the same time, handset specific behavior plays an important role in the delivery of this content and services. Delivered content not displayed in the expected format causes a definite negative impact on customers Quality of Experience (QoE). How can new devices and services be properly tested in a cost-effective way that ultimately leads to customer satisfaction and increased revenue? The answer is automated testing while taking handset specifics into account handset simulation. Keynote SIGOS provides a powerful handset simulation tool, integrated into the SITE and GlobalRoamer test systems. More than 1,000 virtual handsets are available from a ready-to-use and expandable library. Simulate the large variety of handsets without the effort of labor intensive manual testing.


Picture and Text in wrong position

Handset Simulation Test Concept Features:Simulation of real subscriber behavior, taking handset specifics into account Automated testing of services like Web and WAP browsing, MMS, streaming, video telephony, content download Interfaces: GSM/GPRS Um, GSM Gb, UMTS Uu, HSDPA, HSUPA, EDGE, Iu PS Real End-to-End mobile content testing of various handsets Validation of received content with mobile profiles Database with more than 1,000 mobile device profiles and their relevant parameters New customer or country specific handsets can easily be integrated

18



BenchmarkingWho is the best performer?KPIs for own network are regularly reported to senior management. But how does your network perform compared to the competitors? Who has the best performance? Who offers the highest quality of service (QoS)? What is the quality situation for your international traffic? In the competitive mobile environment, consistently high QoS is the deciding key. Benchmarking is an important dimension in making sure your services are competitive. National Approach Most measurement projects start off with a national performance investigation and comparison after national network rollout has been completed. Operators have to find innovative ways to outperform their competition on network and service quality.With the SITE test system, network services can be benchmarked against the competition, measuring internationally approved and recognized Key Performance Indicators (KPIs) in a fast and easy way.

Static Test Approach Network benchmark assessment is executed using an active end-to-end test scenario to observe the performance of your network from a subscriber point of view. Typical static benchmarking tests are performed at airports, city centres, mega sports or social event venues and hotspots where masses of people congregate. On-the-Move Test Approach Drive Service tests have the ability to cover different geographical areas of locally competing networks rather than being focused on static locations. This simulates subscriber behavior moving from one cell to another and provides a comprehensive performance overview of the complete network. See your network through the eyes of your customer

International Approach In order to get a comprehensive overview of multinational or group-wide benchmarks, GlobalRoamers extensive global footprint can perform international benchmark tests and ensure improved cost efficiencies. Benchmarking of international carriers is an important step in ensuring high quality of service for the international traffic impacting your revenue.

Service performance is benchmarked with national competitors as well as international operators: Static testing Drive service testing Outbound roaming testing (e.g. GRQ)


19

Use Cases > Roaming Testing

Inbound RoamingProvide best service to visitors in your network!Today, subscribers expect all frequently used mobile services to work reliably everywhere in the world. Thus, the quality and availability of services inside and outside the home network becomes increasingly important in the battle for customers! Inbound roaming has a big impact on your revenue and a long list of international roaming agreements may be desireable. It comes at a cost: each and every roaming agreement with a new roaming partner requires intense testing according to GSMA standards. In addition, periodic roaming tests with the most important roaming partners need to be performed. How can efforts be reduced? Testing according to GSMA IREG standards is required whenever a new roaming partner is added. It can be a very time-consuming and exhaustive task. It may absorb your most expert staff and repetitive testing can be just as expensive as the initial test setup if performed manually! Therefore, test automation is key for cost effectiveness and operational efficiency. With the SITE system your staff will perform IREG specific tests in much shorter times with less effort and the results will be easily reproducible! Implementation of testing for new roaming partners could not be easier: the SIM card is implemented into SITEs SIM Multiplexer which can be expanded to a capacity of more than 2,000 SIM cards. As soon as the SIM card has been implemented, staff can run the necessary tests. Ready-to-use test cases are available for the execution of tests, according to IR 24, 26, 27, 29,32, 35, 50, 60. These tests can be repeated at any given time! The test results are automatically processed into GSMA conformant reports ready for evaluation.

Get the full picture of your roaming services

Features for inbound roaming testing: SITE offers the right concept for inbound roaming testing: Core network test interfaces (A, Gb, IUCS, IUPS) for testing roaming, independently of radio specific problems Air interface testing for measuring real end-to-end behavior and experience SIM Multiplexer: SIM cards can be managed centrally and securely for all roaming partners (as many as 2,000 SIM cards) Detailed KPI test reports according to GSMA standards Test sets according to IREG 24, 26, 27, 29, 32, 35, 50, 60 from GSM MoU

20



Outbound Roaming TestingAssure QoS abroad to optimize and develop outbound roaming revenue

The possiblility to travel the world quite easily is perceived as a matter of course nowadays. Traveling subscribers take availability and proper operation of all mobile services for granted. Outbound roaming contributes considerable revenue and therefore requires QoS assurance.

Operators require information on service quality beyond their own network. To subscribers, perceived mobile quality when traveling abroad is vital, especially for corporate customers. Mobile operators need to ensure subscribers are able to log onto preferred roaming partners networks when traveling, whilst preserving consistently high levels of QoS to maintain long term business sustainability. When your subscribers arrive at a foreign destination, they expect their mobile service to work at all times. All relevant services need to be tested with at least each top roaming partner. If you depend on these partners to execute these required tests, it will be a huge task, considering availability of staff, time zone differences and the like. The solution is the worlds largest automated on-demand test network: GlobalRoamer. Tests can be executed in more than 500 networks in three quarters of the worlds countries. GlobalRoamer is hosted by Keynote SIGOS and can be accessed from anywhere in the world by logging on through a web interface. Why risk losing subscribers and roaming revenue, when the ability to test the performance of all your roaming partners is at your fingertips? Standard services as well as complex technologies and services like Video Telephony, MMS and UMTS/HSDPA networks can be tested without the need for cooperation with your roaming partners and independently of time zone.

Use GlobalRoamer, the most extensive global infrastructure for automated active End-to-End testing hosted by Keynote SIGOS. With GlobalRoamer you can access an ever increasing number of world-wide networks through a web interface. Thanks to GlobalRoamer we were able to increase our outbound roaming capability dramatically in very short time. Get the full picture of your roaming services

LUP-avail.

GPRS-avail.

Speech

SMS


21


SLA Testing according to GSMA GRQConsistency & comparability of roaming QoS testingSince the traffic in outbound roaming has a big value for operator revenue, it is important to monitor the most frequently visited roaming operators. The GSM Association has designed the right concept: GRQ. Roaming traffic may be a low percentage of the entire network traffic, but remains a significant profit contributor. How to gain a global perspective on roaming quality with consistent measurements and thus comparability between home network and visited networks? And how to achieve this goal in a cost efficient manner? The Global Roaming Quality (IR.81) standards developed by the GSMA in cooperation with selected partners like Keynote SIGOS provide an answer to this question regardless of the monitoring and testing methods used. GRQ is a comprehensive framework for pro-active testing and assurance of end-to-end roaming services quality. With SITE and GlobalRoamer you have a unique tool to monitor your SLA agreements with numerous roaming partners. Keynote SIGOS is a self-certified vendor of the GSMA GRQ compliant test systems.

27 Active QoS parameters on voice, data and SMS traffic KPIs for five different categories: Network access Service Accessibility Connection Establishment Connection Substainability Connection Quality

Why GRQ? Common understanding about the criteria for measuring Quality of Service in outbound situations Developed and defined by GSMA Focus on periodic testing of service quality Applied for monitoring of top roaming partners


Key Benefits:roaming partners by adherence to a shared set of QoS KPIs Improve operational cost effectiveness, by automated testing and realtime reporting Increased Roaming revenue through fast resolution of home and visited networks SLA violations

Cost-efficient co-operation with

GRQ Parameters, defined by GSMA# 1 GRQ Parameter name CS LU SR CS LU Delay CLI SpQ SA-MO SA-MT AD-MO AD-MT Throughput Goodput Roundtrip Time Packet Loss Category Voice Voice Voice Voice SMS SMS SMS SMS Data Data Data Data Description Circuit Switched Location Update Success Rate Network Accessibility Circuit Switched Circuit Switched Location Update Delay CLI Transparency Speech Quality Service Accessibility SMS MO Service Accessibility SMS MT Access Delay SMS MO Access Delay SMS MT Throughput (kbit/s) Goodput (kbit/s) Roundtrip Time Packet Loss 2% 1% Major target 95% 50s 95% 2.5 95% 95% 10s 10s Minor target 98% 10s 98% 3 98% 98% 4s 4s X X yes yes x x X X KPI alarm yes Trend report X

...10 11 12 13 14 15

2

...24 25 26 27

22



Roaming Hubbing TestingConnecting the world with a single roaming relationshipRoaming hubs safeguard multi-lateral roaming and interworking relationships. How can a roaming hub concentrate on managing the key roaming priorities? Open Connectivity (OC) is replacing multiple bilateral roaming relationships between operators with a more efficient hub-based approach. Open Connectivity enables multi-lateral roaming and interworking relationships via SMS hubbing and roaming hubbing. Keynote SIGOS world-wide, on-demand test platform caters for roaming hubs. It enables them to perform tests of Outbound Roaming services, IREG testing for Inbound Roaming, and QoS Monitoring, as well as GRQ testing. It improves operational and cost efficiencies because of the automated test approach and real time reporting feature. Roaming hubbing providers are often tasked to actively monitor service availability and service quality on all their multilateral relations. GlobalRoamer allows the activation and testing of Roaming Hubbing customers SIMs. It helps them to work more efficiently to improve the quality of voice, data and SMS services for their customers. Keynote SIGOS GlobalRoamer can add value to many aspects of the Roaming Hub business model. GlobalRoamer is an ideal enhancement to hubs.


PMN B

PMN A

PMN C

One agreement

One relation

Clearing

Data Services SMS-IW & MMS-IW CAMEL

Reduced complexity

Roaming Coordination Signalling

Increased availability

PMN

PMN

PMN

PMN

PMN

PMN


23


Roaming Steering TestingAre subscribers roaming with preferred roaming partners abroad?Steering of Roaming (SoR) has been rolled out by Operators in order to direct their outbound roamers to preferred VPMNs in the roaming destinations. Does it work? Steering of Roaming (SoR) solutions have been implemented by mobile operators in order to direct their outbound roamers to preferred VPMNs in each country. In some cases just one preferred VPMN in a country is chosen, in other cases SoR is about managing the proportion of revenue and traffic shares between two or more VPMNs. SoR is the logical result of roaming/IOT agreements which are linked to volumes and percentages for one or more preferred VPMNs. On one hand it is a significant commercial matter to detect short- or long-term deviations from these target distributions, on the other hand it is worthwhile to test potential deterioration of customer experience caused by SoR. Get the full picture of your roaming services Detection of Anti-Steering of Roaming is essential as operators may lose subscribers to non-preferred networks resulting in margin losses. Anti-steering is not only a breach to roaming agreements but may also lead to a bad roaming experience as the subscribers could be left without any coverage. Subscribers will not blame the VPMN but their subscribed home network. Subscribers will also not be able to benefit from the special roaming retail tariffs that have been offered to them. By detecting anti-steering activities, higher roaming costs can be avoided. Operators primary business goal is to streamline roaming steering mechanisms such that outbound roaming revenues are optimized while maintaining high levels of end user satisfaction.

VPMN AOutbound Roaminged! Preferr

VPMN BOutbound Roaming

HPMN

VPMN COutbound Roaming

HPMN MSC/VLR Non-Preferred VPMN 1 SoR node MAP messages Update Location UpdateLocation.error 4x UpdateLocation.error 5th attempt is on next VPMN; in this case the preferred PMN Update Location InsertSubscriberData InsertSubscriberData.ack Location Updating Accept UpdateLocation.ack HLR/ AuC

1 2 3 4

Location Updating Request Location Updating Reject 4x Location Updating Reject

Preferred VPMN 1

9

Location Updating Request

KPIs (examples): Location Update Duration also delive- ring indication of deterioration of end user experience Number of PMNs rejected number of quad attempts or roaming not allowed rejects List of rejected PMNs non-preferred PMNs tried PMN after successful steering also indicating successful SoR at all LUP mode (automatic/manual) testing correct behavior of SoR Server for manual selection Reject Causes (i.e. Network Failure, PLMN)

24


Use Cases > International Carrier Quality Testing

International Carrier Quality TestingWho is the best international carrier of choice?Setting up a call to a subscriber in a foreign country involves the choice of the relevant international interconnection carrier. How much impact has the interconnection carrier on QoS? Who is the best interconnection carrier partner? There is a need for both mobile and fixed operators to get a global perspective on interconnection service quality in order to maintain high levels of QoS to subscribers. The international interconnection quality experience is heavily influenced by the choice of the international carrier at the national boundary. By testing international carriers with an active monitoring system, you can not only monitor if the right calling number is displayed abroad but also the voice quality and call setup time, which can be effectively measured and reported. In addition, international carrier quality testing can be coupled with False Answer and SIM Box Detection. KPIs (examples): Received CLI on destination side CLI Indicator distinguishing the following cases: CLI from CgPN (OK) No CLI (N) Wrong CLI (W) Mean Opinion Score (PESQ MOS) for Voice Quality (ITU-T P.862.1) Call Setup TimeExample of international CLI quality testing

Stay in control of communication beyond your network

Testing with prefixed called numbers requires knowledge about the current setup at the international gateway exchange. The deployment of an SS7 LU directly at the international gateway Exchange ensures dedicated interconnection carrier testing. Poor CLI and voice quality would inevitably decrease revenue and market share.

For example, if no CLI is received, there would be no possibility to call back and poor voice quality would result in short and frustrating conversations. Maximising revenue is essential in an environment of falling wholesale prices. This objective can only be achieved if you have consistently high quality on your network and on your international interconnection.

Private SITE SystemDedicated carrier route selection

KPI / SLA monitoring

Global Resource Pool

International Gateway

Interconnection Carriers25


Use Cases > Revenue Leakage & Fraud Detection

Revenue Leakage & Fraud DetectionMake sure your roaming revenues are not being detouredFraud - the word sounds quite exciting when it appears on a cinema billboard or a TV programme schedule but when it hits you personally, professionally, or in a corporate environment, it is much less enticing. Fraud will never be completely eliminated but, unless fraud management countermeasures are undertaken, it is unlikely that it will be reduced to a manageable level.

SIM Box DetectionThe business goal is to gradually clean incoming traffic terminating through SIM boxes by disconnecting all SIM Box numbers detected and to protect the network from any potential fraudulent upsurge in their use. SIM boxes have multiple negative effects on operators, roaming hub providers and customers alike, e.g.: revenue loss due to call redirection roaming calls are intercepted, redirected and terminated via fraudulent SIM Box equipment. unnecessary investment due to service inaccessibility as a result of SIM Boxes creating false network congestion issues revenue loss through CLI Quality Prob- lems; immediate impact is the inability to call back. image loss through bad QoS as SIM Boxes often redirect calls over inade- quate, highly compressed IP connections, resulting in poor voice quality. Call setup time is extended which leads to the impression of bad call quality from the home network operator.SIM

Fraud Bypass Detection Features:Reliable detection of SIM boxes Safeguard your revenues Cost-effective concept for fraud bypass detection Ensure first-class end user experience through quick elimination of SIM boxes High test density possible while avoiding network congestion

Identify leaks in your revenue stream

Originating Network

SIM Box Operators Local SIMs are used to terminate international incoming tra c

Terminating NetworkLocal Retail rate

(A) 0,14

(B) 0,10

GMSC

Air interface

BTS

(C) 0,15 Originating Networks: > PSTN > Mobile > VoIP > Carrier Select (CS) > Calling Cards > Carrier Pre Select (CPS)

Regular Transit

International Interconnect Termination rate

(D) 0,13

Terminating network operator loses 0,03 per minute, i.e. (B) - (D)

26


Use Cases > Revenue Leakage & Fraud Detection

Early Charging DetectionGet it right for your customers

A common phenomenon is the scenario of Early or False Answer during voice call setup procedures. How do you detect and fight these cases? Calls are being charged as though connected without ever reaching the called party, or additional connection time charged. The lack of Active End-to-End monitoring has led to millions of minutes being inaccurately billed to the originating calling parties world-wide. These fraudulent billings sometimes go unnoticed because the incremental billed call duration per user may be in the fraction of seconds. Prepaid SIMs used in GSM Gateways (SIM Boxes) could lead to false answers when the fraudulent SIM Box SIM credit has been consumed resulting in an announcement being played. In this instance the caller has to pay for the call connection leading to customer complaints and dissatisfaction with the service rendered. Fight fraudulent charges to your customers accounts with GlobalRoamer, the world-wide distributed test infrastructure for end-to-end testing.

Benefits: Reduce revenue leakage caused by early charging / false answers Ensure billing accuracy and fight interconnect fraud Improve quality of calls leading to a reduction in customer complaints and dissatisfaction Active end-to-end monitoring ensures consistency in billing

International carrier(s) releases answer message even though call(s) are not setup Originating Network Terminating Network (CUSTOMER)Setup Answer Fraudulent early return of Answer message resulting in charging record for non-delivered service Setup is not even sent to B-Party Call is not established International carrier(s) Setup

Identify leaks in your revenue stream

Unexpected answer on A-side detected and NO incoming setup on B-side International carrier(s) releases answer message even though call(s) are not setup Terminating Network CUSTOMERs SIMs (CUSTOMER) on RoamingSetup International carrier(s) Setup Answer Setup is not even sent to B-Party Call is not establised Fraudulent early return of Answer message resulting in charging recod for non-delivered service

Unexpected answer on A-side detected and NO incoming setup on B-side


27

Use Cases > Revenue Assurance

Revenue AssuranceMoney makes the world go round what happens if your network rating and billing is not correct?For all network operators validation of billing is of major importance. Operators must provide fair and accurate billing to the customer and also avoid revenue leakage or overcharges caused by services being incorrectly rated and invoiced. In most countries accuracy of metering and billing is mandatory to comply with legal regulations. As markets have become increasingly competitive, operators have used innovative tariffs, product and service bundles and discounts to differentiate themselves. Complex and fast changing tariffs inevitably create challenges in ensuring correct billing. Testing that is both end-to-end and independent can provide the assurance that the customers are being correctly billed as well as satisfying compliance requirements. Today, manual tests not only provide inaccurate, untrustworthy but in most cases cost inefficient testing. To ensure correct billing, a precise and reliable Revenue Assurance system is essential. With a SITE test system, continuous testing of all services provides maximum assurance that all calls are being correctly billed as each network element can be tested and verified.

How to guarantee correct billing?Three Revenue Assurance concepts are highlighted: Test Call/Event Generation CDR Testing Tariff Testing

Ensure correct billing, for you and your customers

Test Call/Event GenerationTest call and event generation can be as basic as creating network events by generating calls to test the correct function of a network or its subsystems. SITE is ideally suited as a Test Call/Event Generator for Revenue Assurance projects generating its CDRs to be referenced with the networks live CDRs. Operators need to recognize the value of more than just test call generation; you need to be able to store CDRs to perform verification and detection for errors AUTOMATICALLY. New product pre-launch testing can we bill accurately and reliably for the product? Testing of correct function after product updates does the mediation system still summarize all CDRs correctly? Testing of software patching on switches and other infrastructure are we still producing correct CDRs for all call classes? Testing new infrastructure during and after roll out, e.g. new base stations. Testing of roaming tariff updates are roamers, still being billed?

28



CDR TestingTimely detection of revenue leakagesYou want a solution which compares CDRs generated by network nodes like the MSC or SGSN in a highly automated way and sends alarms mismatches. SITE acts as a Test Call/Event Generator, it is capable of importing live CDRs from the network and comparing them with the reference CDRs generated by SITE. The live CDRs of the generated test calls are extracted at a chosen point in postprocessing for automated comparison by the test system. CDRs can be verified and erroneous CDR fields such as faulty time stamps and call duration can be detected.

CDR Structure Record Type: e.g. TimeBased, VolumeBased, EventBased Service Type: e.g. SPEECH, FAX, GPRS Begin of event: timestamp in milli- seconds A Number B Number Call Duration (Time based calls) Data Volume (Volume based calls) Event Count (Event based calls)

Test Call Generation

Live Network

CDRs

Mediation System

CDR PostprocessingSITE System Virtual SIM Transfer Automated E2E Call Processing (unrated) SITE CDRs (rated or unrated)

Ensure correct billing, for you and your customersBilling

Filter*Operator CDRs

CDR ImportReference CDRs derived from SITE test results

CDR Import*Live CDRs imported via e.g. csv- les

Reference CDRs

unrated CDR Comparison

Live CDRs

Rated CDRs Unrated CDRs * Customization required

Are Core Network nodes like MSC or SGSN generating the right CDR data? Deploy a test event generator which generates CDRs that you can compare with your network CDRs.


29


Tariff TestingProactively monitor tariff plans against variety of test casesYou want a solution which not only compares CDRs but also detects billing errors before they turn into customer complaints or revenue losses.

RatingAt the heart of the billing system is the rating engine. This takes the CDRs (call detail records) or IPDRs (internet protocol detail records) from the network, and then applies the appropriate rating plans to turn this information into rated CDRs ready to be associated with the customer.

BillingOnce a CDR has been rated it is applied to the customers account, where discounts can be applied and from which a bill is created. Operators usually produce bills in cycles, spreading the load over a month or quarter and also evening out cash flow. Within SITE your tariff model can be replicated. Thus, not only the raw data of CDRs can be compared but in addition also the correct billing of a service can be verified. Thanks to SITE, fast regression testing of new pricing plans against a variety of test cases can be performed, detecting potential flaws in the billing process at a very early stage.


Test Call Generation

Live Network

CDRs

Mediation System

SITE System

Virtual SIM Transfer

Tari CDR Model Postprocessing Filter*(rated)

Billing

Automated E2E Call Processing (unrated) SITE CDRs

Operator CDRs

CDR ImportBilling Veri cation Rating

CDR Import*

Tari Model*Reference CDRs

unrated CDR Comparison

Live CDRs

Invoice comparison Resource allocation for different users or groups Detailed test reports Revenue stream audit Covering billing aspects of outbound roaming

Rated CDRs Unrated CDRs * Customization required

30



Prepaid SIM RechargingWith prepaid subscribers you make substantial profitsPrepaid subscribers expect correct voucher recharging. Keynote SIGOS provides a tool to verify Prepaid SIM Card Recharging. SITE or GlobalRoamer have the ability to check if recharging procedures of prepaid cards has been performed successfully. Test Cases collect information about the current account balance and establish a call in the same way a subscriber does. That means entering vouchers using DTMF tones for navigating IVR menus or using USSD commands where supported. After a SIM card recharging attempt the account balance of a dedicated prepaid SIM card is re-checked and compared to balance before recharging attempt. Besides using single vouchers (e.g. from scratch cards) for a single test, Keynote SIGOS Test Systems support comprehensive voucher repository functionality managing numerous numbers. Further customer specific account verification methods (e.g. via SMS) are also supported on request.

Sample Features Detection of revenue leaks due to SIM card recharging errors Increase of customer satisfaction and spen- ding due to error free SIM card recharging Simplified prepaid SIM card handling in the central SIM Multiplexer

Sample KPIs Initial account balance Account balance after recharge Used Voucher for recharge Received USSD response string USSD process duration



31

Use Cases > Fixed & IP Network Testing

Fixed Network TestingNGN evolution calls for multi-technology testingWith the explosive growth in the mobility arena, one could almost believe that the future of fixed networks was doomed. However, fixed networks continue to maintain their relevance, with technological evolution requiring new test approaches. Technological advances and the complex changeover from established technologies to new ones triggers the need for ensuring consistency of service quality over all underlying technologies. Poor service quality inevitably leads to loss of profit if, for example, the line is bad the conversation will be short. With the SITE test system, Keynote SIGOS provides ONE platform for testing all technologies fixed, mobile and IP-based, either within one technology or across technologies. Fixed network operators benefit from SITE through: Periodic service quality testing Ad-hoc service quality testing SITE supports all interfaces required for fixed network testing: PSTN ISDN DSL IP (VoIP) KPIs for fixed network testing (examples): Delay Echo Delay MOS Value

Beyond mobile the other kind of telecommunications

Testing in all network technologies, mobile, fixed and IP

32


Use Cases > Fixed & IP Network Testing

IP Network TestingOptimize your data network performanceSlow access, error pages and unsuccessful orders? Just started VoIP services? Are you relying on your customers to find out about incidents, availability, speed and load issues? Mobile has made its impact on connecting the last mile, particularly for voice communications, but has yet to make its impact on higher speed links and at least one mobile company has admitted that it cannot deliver the speeds contained in the 3G specifications. So where do fixed networks and IP connections coming with them win over radio-mobile? When capacities and speeds are high, where Internet access is required or where there are large files to be downloaded, then the optical fibre link remains supreme, whether it is a link to a corporate client, a national backbone network or an international submarine cable system.

SITE measures the user perception of your services SITE checks the quality of your calls in real time Use SITE for proactive supervision! Secure your IT with SITE End-to-End monitoring! SITE measures and alerts you in real time!

Beyond mobile the other kind of telecommunications

Web Browsing (HTTP)

KPIs (examples): Duration between the rst and last http data packet HTTP Data Size Duration of web browsing session HTTP Valid Page Content

Ping (ICMP)

KPIs (examples): Round-trip time (min, mean, max) Packet loss Size of Ping packet

FTP SOAPKPIs (examples): Response Time of SOAP server in seconds

KPIs (examples): Network Non-Accessibility File Size Download Duration Upload Duration IP Service Failure Ratio

TCP/IP Command

KPIs (examples): TCP/IP command Duration of TCPIP command

DNS

KPIs (examples): DNS Query Duration (min, average, max) DNS Host Name Resolution Time DNS Host Name Resolution Failure Ratio


33

Use Cases > Core Network Testing

Core Network TestingService Testing independent from Radio ProblemsTesting without Radio AccessIn some cases the active test approach of using test mobiles on an air interface can be counterproductive because radio specific problems can disturb results without adding any value. A typical example is roaming testing, where the problems come from the core network. For such cases there is benefit in testing the services by means of simulating the radio access part, connecting directly to the core components such as the MSC, SGSN etc. without involving the radio access components.

Regression TestingAnother instance where connection direct to core network components is required is where tests need to be executed in a very short time. This is typically the case when network components like the MSC or SGSN have been updated or where the influence of a high number of concurrently connected subscribers has to be checked immediately and automatically. Such kinds of regression testing can usually be executed in less than 20 minutes whilst still covering all services and subscriber profiles.

Typical use cases for testing without radio access part: Interactive Voice Response incl. interactive announcement tests Testing of Supplementary Services Testing of IN Services Inbound Roaming tests Load Tests on Core Network components Billing Testing via CDR tests Data Content Testing Handset Simulation etc.ork ore Netw Mobile C

Typical use cases for regression testing without radio access part:Automated regression testing after upgrade/updates on: MSC (via GSM A) MSC and fixed network switches (via ISUP) SGSN (2.5G) via Gb MSC-Server via IuCS SGSN via IuPS SMSC, MMSC WAP-, Web-, Mail-Server SCP testing including IN services and prepaid services etc.

Inside out core network testing can save money

ore Mobile C s Interface rk o Netw

Typical advantages of core network testing: Not influenced by radio specific problems Fast execution of mass tests (e.g. thousands of tests in an hour) Quick results Detailed trace analyses with protocol stack information

see page 2

34


Use Cases > Nomadic & Indoor Testing

Nomadic & Indoor TestingPortable local unit for flexible deployment and mass testingIndoor: Shopping and Exibition Centers or Airports places of communication. But do mobile services work properly everywhere? There are a lot of interesting and revenue generating use cases for indoor testing. Especially in international airports where testing of inbound roaming characteristics is crucial to secure lucrative business. Also exhibition centers and shopping centers are typical buildings where subcribers very often experience lack of service. Furthermore it is worthwhile to mass-deploy the cost-efficient nomadic units in office towers with a lot of business customers. For indoor testing either the air interfaces or direct LAN connection can be recommended.

Sports and Social Events: Testing campaign of short time frame and short notice. The Nomadic local unit is also ideally suited for short-term campaigns like sport events. A lot of sports fans gather at top level events like Formula 1 or soccer championships and expect high levels of service quality. Due to its fast installation the nomadic units can be quickly rolled out even at short notice. After easy deployment at temporary locations this autonomous system sends network information back via its air interfaces. Rural Areas: Where there are people there should be communication. Especially in remote areas it is often impossible to install local units, as no fixed IP connection is available. In this case the nomadic local unit is capable of establishing a permanent IP connection via GPRS/EDGE/HSPA modem. The connection is upheld via IPSec tunneling. By this means, test probes can be quickly installed in rural areas where you cannot rely on wired IP connections. The Nomadic local unit is the ideal solution for flexible deployment in the field.

Reach out to remote and temporary locations


35

Invest in the future!

Keynote SIGOS test systems adapt to your demands.

36

The Test SystemsSteering of Roaming Testing Fraud Detection for National & International Tra c International Carrier Testing Outbound Roaming Testing Billing Testing for International Tra c World-wide Handset Speci c QoS Testing QoS Tools for Diagnosis & Reporting

GlobalRoamerThe Reference System for world-wide testing Largest footprint of world-wide test probes Managed and serviced by Keynote SIGOS Extensive set of test case applications


Roaming Testing

SITE Central Unit


LU

CLU

LU


Fixed

IP Networks

Mobile



GO

P GR h wit AL B GLO

SITEThe Unique Test Platform for various technologies Mobile / Fixed / IP testing Core Network testing Globalize with GRP

37

Test Systems > GlobalRoamer

GlobalRoamerThe On-Demand world-wide test platform!ChallengeEnd users demand and expect a high quality, reliable service from their chosen network operator and a similar experience regardless of where in the world they are. Therefore, permanent surveillance of the roaming network is indispensable but extremely difficult due to a lack of operational visibility of the roaming partners networks.

SolutionGlobalRoamer allows you to verify that all services are available to your customers who are traveling world-wide. With test probes in 150+ countries you have your world wide testing platform without investing in infrastructure. Just buy your testing package and run your tests worldwide.

Managed Services are on offer to all Operators looking for an operationally efficient solution!

How does it work?For testing in mobile networks, by means of Keynote SIGOS SIM Multiplexing technology, your SIMs are capable of being virtually transmitted to any of GlobalRoamers extensive network of remote test stations in more than 190 locations, where tests simulating end customer experience are performed. Complete, real time visibility of the resulting network messaging allows rapid fault resolution. GlobalRoamer also allows you to perform tests across technologies, e.g. Fixed and IP networks as Fixed Mobile Convergence (FMC) becomes more prevalent!

Automated active End-to-End Testing and Monitoring Get the full picture on what your customers experience world-wide Initiate reproducible test cases which cannot be done with passive monitoring solutions

Unique SIM Multiplexing Technology SIM cards are hosted centrally from

where they are virtually transmitted to any of GlobalRoamers remote test stations where the actual test is performed

Global Testing Network GlobalRoamers extensive global

network of test stations allows access to three quarters of the worlds countries and is continuously being expanded

38



All you need to doOrder your account at Keynote SIGOS For testing in mobile networks: send your test SIM cards to Keynote SIGOS! Access the world-wide test network via the internet! Define and set your tests running! Collect the results!GlobalRoamer Login

How to access GlobalRoamer?

NETWORKS

COUNTRIES

LOCATIONS

The World at Your Fingertips

588589

587

176177

175

225226

224

Enter the most extensive global network test system from your desk and gain access to:

GlobalRoamer Location GlobalRoamer Country Location comming soon

GlobalRoamer is growing continuously. Please contact us for the current footprint and more details. Q4 2011


39


The High Performance Global Test InfrastructureOn-Demand End-to-End Test System for Roaming Situations and MoreWhat is GlobalRoamer? Get access to test 500+ networks in more than 75% of the worlds countries 2G, 2.5G and 3G network probes Fixed network probes available Fully hosted and continuously expanded by Keynote SIGOS Continuous growth of telco networks accessible through GlobalRoamer505 450 400 350 300 250 200 150 100 50 0

2003 2004 2005 2006 2007 2008 2009 2010 Networks Countries

The Cost-effective Testing SolutionTake Advantage of Deploying GlobalRoamer Without Having to Think About Labor Intensive OperationsSimply start using GlobalRoamer no maintenance, no CAPEX No setup or exit fees for GlobalRoamer use Flexible packages available (prepaid for ad-hoc testing / flat-rate for periodic testing) Pay-as-you-use concept

The Independent Round-theClock Event GeneratorBenefit from Availability and Accessibility to the Whole World Anytime, AnywhereEasy web access allows 24/7 availability, irrespective of time-zones Independence and convenience through pre-scheduled automated test execution Massive world-wide test capacity, your SIMs can be used almost anywhere at any time

The Time-Saving and Customizable Tool-BoxEnjoy the Convenience of Predefined Tests and Reports Whilst Keeping the Option to CustomizeComprehensive libraries of test cases and report templates save valuable time Customer-specific test cases and reports allow for full flexibility User-friendly web-based graphical user interface

The Reliable Sentinel Always on DutyKeep Track of Your Network On-time and Relevant Information Delivery at your Fingertips Extensive alarming, performance notification and reporting functionality Customizable alarms to alert you to any network issues Adjustable information-depth (from high-level overview to deepest-deep details) Continuous network surveillance with reports (several styles, from graphical to plain text)

40



Use CasesService Quality in outbound roaming (on-demand testing / periodic testing) Full range of QoS applications (Voice / SMS / Data) (page 14) Outbound Roaming Testing GRQ GSMA compliant testing (page 22) Steering of Roaming (SoR) Testing Evaluation of proper application of Steering of Roaming and detection of Anti-Steering activities (page 24) Fraud Detection for International Traffic SIM Box Detection, False Answer Detection (page 26) International Carrier Quality Testing Full range of QoS applications (Voice / SMS / Data) (page 25) Revenue Assurance in an international context CDR Comparison, Roaming Tariff Model Testing (page 28) International Interconnect Management CLI Verification, Voice Quality (MOS), Call Setup Time, Call Attempt Success rateetc. (page 25) Benchmark Testing in operator groups See how your network performs within one operator group (page 19) Service Level Agreement (SLA) Verification Verify the fulfilment of Service Level Agreements (page 22) Handset specific Testing in outbound roaming Automated content testing with a broad selection of simulated handsets (page 18)Fraud Detection for National & International Tra c International Carrier Testing Outbound Roaming Testing Billing Testing for International Tra c World-wide Handset Speci c QoS Testing QoS Tools for Diagnosis & Reporting

Use Cases for GlobalRoamer

Steering of Roaming Testing

Clients from all over the world rely on GlobalRoamer Mobile Network Operators Fixed Network Operators Mobile Virtual Network Operators (MVNO) Carriers Content Providers Regulators

Who benefits from GlobalRoamer?

Departments (Examples):Service Quality Management Operation and Maintenance Roaming Billing Fraud Management Marketing Interconnect International Business Revenue Assurance


41

Test Systems > SITE

SITEOne platform for all your End-to-End test requirementsChallengeToday, network operators are confronted with an extremely dynamic market and the challenges of keeping up with new technology, permanent surveillance of Service Level Agreements (SLA) and reducing cost whilst also maintaining customer satisfaction. Since these tests can be both, labor-intensive and costly they are too often neglected. To meet these challenges preventive and permanent Service Quality Assurance by means of End-to-End testing is essential.

SolutionKeynote SIGOS has developed the most advanced automated test system available on the market. SITE is the proven and flexible test platform for cost- and time-saving automated Active End-to-End testing. With SITE, telecommunication operators all around the world benefit from its unique versatility. SITEs modular structure and scalability ensure it can always be matched exactly to your requirements. In addition, your local SITE system can go global by connecting to the world-wide GlobalRoamer probes with our Global Resource Pool feature all in one go!

Why SITE?

Why Automated Active Testing and Monitoring with SITE? Get the full picture of your end users

experience (QoE) and act, instead of reacting to customer complaints Continuously monitor service availability, test and measure quality (KQI) and performance (KPI) Upfront testing ensures a smooth roll-out for new services and new technologies Initiate reproducible test cases which cannot be done with passive monitoring solutions Comprehensive network diagnosis, reporting and alarming Services can be tested before commercial release

Identification and localization of service and network can be achieved before actualservice degradation and threat of revenue losses Reduced time and risks to install or modify network infrastructure by providing extensive recursive testing capability Reduced operating costs by automating monitoring, testing, and reporting; increased personnel efficiency; costs not correlated with network size and growth Number of test cycles is flexible

Network Services

SITE Solution Tests ALL

Network Interfaces

SPEECHVoice Voice Quality Suppl. Services IVR Push-to-Talk VoIP Echo

DATADATA IP (CS/PS) Web/Wap Browsing E-mail Streaming Video Telephony Video Quality Digital Rights Mgmt.

MESSAGINGSMS MMS Mobile IM iPhone BlackBerry

FIXEDISDN S0 ISDN PRI S2m PSTN a/b

RADIOHSPA UMTS Uu GSM Um EDGE CDMA 2000 GSM-R LTE Uu

IPWLAN DSL Ethernet MM7 SMPP, UCP, CIMP SMPT / IMAP

COREIuCS / IuPS GSM Gb GSM A ISUP SS7 IN / CAMEL MAP (HLR/VLR)

42


Test Systems > SITE

Open, Modular and Customizable Just the Right System, Always SITE is an open system and can be easily integrated into existing test environments

What is SITE?

Existing equipment can be directly linked to SITE and controlled and monitored through the SITE system Software updates, configuration modifications and problem resolution are quickly and reliably performed by Keynote SIGOS SITEs modular structure software and hardware guarantees maximum flexibility in service and protocol testing From portable and Stand-Alone Systems in test laboratories to distributed systems covering the geography of an entire live network, everything is possible

ONE Test System, ENDLESS Testing Options SITE uniquely combines Quality of Service (QoS) testing with the ability to deliver Core Network Testing all in ONE test system Mobile, Fixed, VoIP testing Protocol test interfaces

SITE enables both, single technology testing as well as cross technology testing Mobile / Fixed / IP-based - all kind of combinations can be tested 2G, 2.5G, 3G and beyond all mobile network technologies can be tested SITE enables thorough testing of all relevant mobile and BlackBerry services, even taking handset specific characteristics into account if desired Voice Messaging Data Video Value Added Services

SITE provides test solutions for billing verification and other revenue assurance related applications


Roaming Testing

SITE Central Unit


LU

CLU

LU


Fixed

IP Networks

Mobile




43

Test Systems > SITE

How does it work?

Central SIM Multiplexing Technology an Unparalleled Teleporter for SIM Cards SIM cards are centrally hosted and virtually transmitted to any of the systems remote test stations where the actual test is performed. SITE can handle thousands of SIM, USIM or Micro-SIM cards in cascade-style boards. Subscriber information from a SIM card is read out by the system and transmitted via a LAN/WAN network to any test location required. The SIM authentication procedure is handled virtually between the wireless interface in any location and the real SIM stored in the central SIM Multiplexer unit. Intuitive Workbench Tailored to Users Specific Demands Comprehensive set of tools are available for Test Creation, Diagnosis as well as Alarming and Reporting to adapt SITE exactly to user demands. (see page 50) Configurable user access rights User-friendly and intuitive Graphical User Interface which can be accessed from Windows and Linux platforms alike through the Inter- or Intranet. Role-based GUI views provide the right level of information and tools depending on the users role (Test / Report / GIS / Admin).Test/ReportNetwork Expert Test Manager Test Case Designer

GIS

AdminSystem Administrator

User role-based GUI always gives the right level of information to the user

Test Analysis

Test Admin

Test Design

GIS

System Data Health Bases

The SITE Architecture Ensuring High-Performance, Security and Stability SITE runs on a stable, Linux based server solution offering highest standards of redundancy. SITE client workstations can be either Windows or Linux based. To ensure maximum performance, the SITE System uses an open SQL database. All configuration information, test results, measurements and KPIs are stored logically, to provide clear measurement and reporting capabilities. Using powerful filter functionality any database listing can be easily modified and a multi-format export function allows the sharing of data with other network support tools. Behind the Scenes SITEs Unique Test Management SITE can execute tests at any time desired. Via the scheduler window a single or group of tests can be defined once or periodically, based on very flexible selection criteria of date, day, time, frequency and number of repetitions. To avoid any resource conflict, an intelligent resource management system controls access to interfaces and SIM cards, assuring smooth operation and maximum test parallelism. The self-management checks system components regularly and generates an alarm (SNMP-Trap) in the event of any failure.

44


Test Systems > SITE

Globalize your SITE system and take off with GRP!With Global Resource Pool your SITE system gets access to test probes all over the worldMost SITE solutions are deployed for testing networks within national boundaries. Some existing SITE installations cover international testing by deploying SITE Local Units in neighboring countries for purposes of outbound roaming testing and fraud detection. The unique Global Resource Pool (GRP) feature now allows users to connect private SITE systems with the world-wide network of GlobalRoamer test probes. By this, it means your local SITE system can get access to Keynote SIGOS hosted probes in more than 580 networks world-wide! As GRP connects to GlobalRoamer, which comes as a scalable pre-deployed infrastructure owned and managed by Keynote SIGOS, Operators are liberated from cumbersome manual implementation, operations and maintenance of these Remote Test Interfaces. GRP currently contains GSM Um and UMTS Uu interfaces which are all available for testing.

G

h wit L A LOB OG

P GR

Connect your local SITE system to the world-wide GlobalRoamer probes with the unique Global Resource Pool feature!


45

Test Systems > SITE > Hardware Components & Interfaces

Hardware Components & InterfacesScalable and highly flexible infrastructure!Central UnitThis is the base of the whole Keynote SIGOS Test System SITE. Everything important is integrated: O&M Manager, Scheduler, Resource Manager and Test Execution Manager. Central Unit Extensions (CUX) are important to give the possibility to increase the number of parallel running test cases.

19 (rack mount) 100 V - 240 V, max 8A 4A, approx. 450 W

Main Hardware Components

SIM MultiplexerThe SIM Multiplexer has an unlimited capacity to handle thousands of SIM cards at various locations all over the world. Any SIM authentication procedure is handled virtually between the wireless interface in any location and the real SIM stored in the central Multiplexer unit.SIM Card Board

SIM Server 100-240 V 1A, 50/60 Hz Low power consumption Compact design, only 3HU Compatible for SIM, Micro SIM, USIM, R-UIM Automated voltage negotiation for each SIM card position

Remote ComponentsThe remote units, also called local units, are installed wherever they are needed for 2G, 2.5G and 3G or core network tests. Local Units for fixed and stationary usage: Local Unit (LU) Compact Local Unit (CLU) SS7 Local Unit (SS7 LU) Gb Local Unit (Gb LU) IU Local Unit (IU LU) ISDN PRI Local Unit (ISDN PRI LU) Wireless Local Unit (WLU) Local Units for mobile usage: Mobile Local Units (MLU); 12V DC, 5A, typ. 40W incl. internal SIM Multiplexer incl. GPS module Nomadic Probe: 12V DC, 2A, typ. 20W incl. internal SIM Multiplexer incl. GPS module available in fixed, wireless and mobile mode

Remote Components / Local Units

46


Test Systems > SITE > Hardware Components & Interfaces

Test InterfacesKeynote SIGOS SITE Test System supports the whole range of todays telecommunication networks. Testing them needs multiple interfaces which are integrated in the SITE systems. Sample interfaces: 3G UMTS/HSPA+ and 2G GSM/GPRS/EDGE Voice & Data & Fax Supported frequency bands: 850/900/1900/2100 MHz Downlink up to 42 Mbps Uplink up to 5.76 Mbps

SS7 / GSM A, ISUP: 4 E1 (2048 MBit/s) trunks (RJ45 connectors), Impedance of 120/ 75 Ohm balanced/unbalanced Iu over IP: based on Ethernet IP, 4 x Ethernet Interface 10/100 Gb over IP: based on Ethernet IP, 4 x Ethernet Interface 10/100 Gb over E1/T1: 4 E1 (2048 MBit/s) trunks (RJ45 connectors), Impedance of 120/ 75 Ohm balanced/unbalanced CDMA2000 1X / EV-DO Supported frequency bands: 800/1900 MHz ISDN S0: B-Channel Protocols: like HDLC X.75, X.25, T.30, V.90,V.120 D-Channel Protocols: like ETSI-DSS1, NI-1, CT1, VN3, 1TR6, INS-64, 5ESS, Q-Sig

Sample Interfaces

ISDN S2m: B-Channel Protocols: like HDLC X.75, X.25, T.30, V.90,V.120 D-Channel Protocols: like ETSI-DSS1, NI-1, 1TR6, NET3, VN3/4/6, INS-64,INS- 1500 PSTN a/b: ITU-T Modem Compatibility, Fax Compatibility All Components: Developed by Keynote SIGOS, made in Germany.www.keynote-sigos.com

47

Deliver high performance!

Keynote SIGOS puts the optimum instruments in your hands.

48

The Test ToolsOn SITE and GlobalRoamerReporting & Alarming> Dashboard > Matrix Report > GIS

Test Creation Tools> Test Case Editor > SITE Recorder > Test Sequence > Control Structure

Diagnosis Tools> Service Alarm Map > 3G Layer 3 Tracing

49

Test Systems > Test Tools > Reporting & Alarming

Reporting & AlarmingFully integrated in GlobalRoamer and SITESITE and GlobalRoamer Reporting enables users to create, view and forward multiple reports. These reports are generated from measurements collected in the report database. These reports can either be based on Keynote SIGOS standard Key Performance Indicators (KPIs), on KPIs according to ETSI standards or on individual customized KPIs. Report creation is done by means of an easy drag-and-drop arrangement. SITE and GlobalRoamer Reporting offers the possibility to visualize test results using various graphical tools, serving even very specific presentation and monitoring needs. Flexible standard charts and diagrams as well as enhanced functionalities like histograms, percentile, ad hoc reporting and derive to can be immediately generated from recorded KPI data. Real time alarming is also embedded: resulting alarm notifications are automatically distributed via SMS, e-mail, SNMP, etc. to defined recipients. Users can define threshold-settings, counters, severity triggering points, etc. which control when alarms should be generated or cleared. Reports can be illustrated in different ways, either charts in various formats; markers, bars, lines etc, or by matrix tables to provide a fast color coded overview of vital services or specific KPIs.

Test Execution on di erent locations

Online Reporting

Reporting AlarmingTest Executions

real time reporting alarmingPost Reporting

Raw-Measurements (Input and Output)

Measurements Strategy / KPI design

KPI Database

Report De nition

Measurement processing: from test execution to test reports

All solutions of SITE and GlobalRoamer Reporting allow the users to observe KPI performance in an optimal way: analysis of trends / analysis of incidents based on locations or based on service problems.

Who benefits from reporting functionality?Telco Service Manager, who read service performance reports Network Experts, who analyze test results and trace information Report Designer, who set up reports

50


Test Systems > Test Tools > Reporting & Alarming

DashboardThis Graphical User Interface (GUI) system tool provides a simplified intelligent interface to SITE and GlobalRoamer reporting. It is of special interest to the people responsible for the service, who want to work intuitively without any training effort. KPIs can easily be filtered and individually stored in a few clicks. Individual configurations allow additional, more customer-oriented, data analysis. Fast and easy drill down to individual traces is possible directly from the Dashboard.

Matrix ReportThe Matrix Report environment allows the user to view Key Performance Indicator (KPI) data as a numerical value, which can be easily color coded to provide a quick, easy to understand overview of network performance. Service KPIs can therefore be displayed in a format which is especially useful for Network Management and Operations personnel.

Dashboard Matrix GIS

GISFor service testing on the move, a map based Geographical Information System (GIS) is integrated into SITE. Each drive test case collects position data from a GPS receiver during visibility of GPS satellites. These are displayed in a GIS. This means that after service testing a rich set of KPIs according to GPS data can be locally analysed displayed on geographic maps.


51

Test Systems > Test Tools > Test Creation Tools

Test Creation ToolsEasy and time saving configuration!Test Case EditorSITE provides large libraries of Test Cases for main network services in various formats with detailed parameter options. It is also possible to create customized test cases by means of the assembly of various test steps via a user-friendly drag-and-drop mechanism that SITE provides in its Test Case Editor environment. Complex scenarios can be quickly built to enable the testing of new network services.

Control StructureThe Control Structure enables test users to easily create tests at various locations and with different SIM cards. It uses the logical operators: list based FOR EACH condition based REPEAT time based WAIT

SITE RecorderThis Tool allows intuitive automated recording of browsing actions taking handset characteristics into account. Mobile and provider specific web and WAP pages are retrieved from the network via the test probes during recording sessions to get a feel for real download behavior and latency. Traces are shown live while the developer is browsing. The test case can be evaluated before saving the entire browsing session for replay. Full feature support by the Test Case Editor makes later adaptation of recorded browsing sessions easy. It is like having full and instant remote control access to a specific handset or browser in a remote location with no need to travel anywhere to use it.

Test SequenceThe goal of the test sequence concept is to save execution time by avoiding the resource consuming location update process being repeated for each subsequent test case. Usually a test case starts with a switched off mobile terminal. The side-effect of this approach is that each test case has the following procedure: location update make a call (service test 1) switch off Each of these steps often require more than one minute each to complete. For saving test execution time, an arbitrary number of service tests can be combined in one test sequence, which requires only a single location update. This effectively simulates typical mobile user behavior e.g.: switch on a mobile (location update) make a call (service test 1) send an SMS (service test 2) web browsing (service test 3) make a call (service test 4) switch off

Test Case Editor SITE Recorder Test Sequence Control Structure

52


Test Systems > Test Tools > Diagnosis Tools

Diagnosis ToolsKeep the overview or go into details!Service Alarm MapThe Service Alarm Map is used to visualize mobile network services that target a specific service area. Alarms that are generated by the failure or degraded performance of services can be linked to a specific network element within the operators infrastructure. This function is implemented by careful correlation between the specific elements used with

Keynote SIGOS Product Portfolio

Documents

Transcript of Keynote SIGOS Product Portfolio