HOW IS P3 COMMUNICATIONS TESTING NETWORKS – INCLUDING INDOOR

Ralf Pabst

P3 communications

Amsterdam, 22.09.2016

22/09/2016

Agenda

1 Company Presentation

2 How to rate Network Quality?Introducing the P3 Score

2

3 What is important to customers?Understanding more through Crowd Sourced Data

Public

Our Commitment With the most demanding clients all over the world: Your Business Is Our Priority

22/09/2016 3

P3 GROUP FACTS & FIGURES

Public

Aerospace

Automotive

Telecoms

Energy & other Industries

P3 communications serves all major players in the telecommunications industry

Mobile network operators

Fixed network operators

Cable operators

MVNOs

Professional mobileradio operators

Network Operators

OUR CUSTOMERS

Device vendors

Terminal suppliers

Chipset manufacturers and suppliers

Terminal and Chipset Suppliers

Network suppliers

Platform vendors

Network service suppliers

Managed service suppliers

Equipment Suppliers

Regulators / Authorities

Aerospace – inflight entertainmentsystem suppliers

Automotive – telematics serviceproviders

Other Players

4Public22/09/2016

22/09/2016

Agenda

1 Company Presentation

2 How to rate Network Quality?Introducing the P3 Score

5

3 What is important to customers?Understanding more through Crowd Sourced Data

Public

Public

Operators leverage network quality as a competitive advantage – the public has a demand for transparency and neutrality.

Assess and analyze your quality

Strategize for your unique quality profile

Optimize your network

Benchmark your quality

Talk about it

Operator Quality Cycle

WHY MEASURING AND MANAGING?

Communication

Very Good

622/09/2016

Shooting star of the year!

22/09/2016 Public 7

Type A: IB with Certification of P3-Score*

PUBLIC COMMUNICATION OF RESULTS

Type B: IB with Public Communication

In general P3 is working with two types of public communication.

Can be ordered by one or more operators per country

Test methodologies & routes

Independently chosen by P3

Continuous open cooperation and feedback channel with operators to further develop the measurement set-ups

Results

P3-Score

“best in test”-seal if applicable

Detailed reports

Communication

Achieved P3-Score and result overview will be available on P3 web page for all tested operators

Operator is entitled to use the certificate and the “best in test”-seal for own communication

Cannot be ordered

Test methodology & Routes

Independently chosen by P3 and potential media partner

Information and feedback loops with operators

Periodic independent pre-benchmarks offered

Results

Detailed reports for potential pre-benchmarks

Publication of benchmark results by P3 media campaign or via selected media partner

Communication:

Publication of benchmarkresults in magazines, newspapers, apps, TV, social and online media, etc.

Background stories, interviews, technical explanations

* only available in markets where Type B is not in place or planned

22/09/2016

Acceptance/Relevance in the operator community through transparency and cooperation is one of the key ingredients of P3’s methodology.

P3-SCORE PRINCIPLES – POSITIONING BUILDING BLOCKS

Transparency & Cooperation

IndependenceHigh-End

Positioning

- continuous com-munication with operators and media

- align on new metho-dologies and test cases

- discuss new techno-logies (e.g. VoLTE)

- understand latest customer requirements

- high end test devices- Most powerful tariffs- advanced test patterns

from customers perspective

- New test cases with focus on latest technologies

- cutting edge positioning

Public 8

- independent campaign planning and execution

- test methodology- scope of measurements- scoring and

certification- international

comparable results

Acceptance and Relevance

22/09/2016 Public 9

Measuring Network Performance

RATIONALE

The P3 Score as a management Tool

‚Measuring performance‘ means collecting many different performance indicators – how to stay focused and easily communicate results?

Historically, benchmarking results look at a vast multitude of indicators, easily missing the important aspects

The P3 score aggregates the complete set of KPIs into a single score figure, preserving the drilldown capability.

It features implicit weighting of environment, services and KPIs and comparability on national and international level

Distracting details

Tons of (K)PIs

What isimportant?

unique performance

profile

Benchmark

History

Learning from best-in-

class

Manageable targets

Priorities

0 1000

22/09/2016

The P3-Score delivers a robust scale to assess network quality and performance. It is coupled with a unified measurement methodology for true international comparability.

P3-SCORE PRINCIPLES – TECHNICAL BUILDING BLOCKS

P3-Score: 1000 Pts

DataScore: 600

VoiceScore: 400

QualifierKPIs

Differentiator KPIs

OverallScore

ServiceModules

AreaLevel

KPI Level

Unified Measurement Methodology

Modular Score Approach

ConsistentReporting

- Measurement Systems- Test cases and Settings- Device capabilities- Geographical Mix- KPIs, post processing- Mapping functions

- C-level Views- Mgmt. Level

Breakdowns- Drilldown to KPI-Level- Cross-Project Reports

Public 10

City Drive 525

City Indoor

150Towns

150Roads

175

22/09/2016

Agenda

1 Company Presentation

2 How to rate Network Quality?Introducing the P3 Score

11

3 What is important to customers?Understanding more through Crowd Sourced Data

Public

Public 12

P3 enables smart decisions by introducing innovative on-device data collection methods and by applying advanced analytics expertise and capabilities to deliver insights

On-device measurements and passive data collection

Crowdsourcing and dedicated panels

Customer experience measurements

Competitor benchmarking

Data cleansing, enrichment, analytics and correlation

Market intelligence reports

Data Collection, Analysis and Insights

PORTFOLIO AND CAPABILITIES

Enabling all P3 industry branches with technology solutions (in-house and cloud) and respective expertise

Advanced data analytics as a service, using big data technologies

Design and implementation of data analytics and reporting solutions

Developing and using machine learning approaches

Advanced Analytics

22/09/2016

22/09/2016 Public 13

P3 Crowdsourced Solution

EXAMPLE: BENCHMARKING VIEW

Country Benchmark

P3’s Network Weather provides detailed view on your end-customers experience where and when it matters to them

Network-wide benchmarking provides view on representative route and is limited in time

Performance is personal and local and differs regionally

Virtual drive testing in your pocket

Crowdsourced measurements allow seeing much more detailed trends and changes over time and space, allowing to peek into your home

Our passive solution creates magnitudes more data than traditional crowdsourced solution

Traditional crowdsourced solutions result in~2 samples per 100 users per month

P3’s passive solution triggers2,000 samples per 100 users per month

Public 14

P3 has a proven track record with several running projects using its data collection framework collecting data via managed panels and public crowdsourcing

P3 has successfully deployed its insight Core Libraryin various public and private applications

Public references

WEKA Media Publishing GmbH

connect / PC Magazin

Deutsche Bahn (German Railways)

DB Netzradar

P3

U get, P3 Feedback, Who’s Calling?

Sunrise

“Mobilnetz” Customer Feedback App

QuEST Forum / Metrinomics / P3

QuEST WCX Research App

Private references:

EU National Regulatory Authority / Research App

Int‘l Market Research Partner / Research App

CEM Solution Provider / Research App

Demonstrated Project Experience and Support

PORTFOLIO AND CAPABILITIES

22/09/2016

22/09/2016 Public 15

QUEST WCX – WIRELESS CUSTOMER EXPERIENCE

QuEST WCX is a partnership between QuEST Forum, Metrinomics and P3. The solution collects pure customer perceptions, and then connects them to technical network aspects

https://youtu.be/sJjZXAPQJbI

Public 16

Key voice, data and network metrics available in ‘U get‘.And more features to be added soon

‘U GET‘ – WIRELESS PERFORMANCE, PERSONALIZED.

22/09/2016

22/09/2016 Public 17

WRAP-UP

Combine detailed knowledge of your network’s quality with that about customer behaviour and experience – all services matter but you cannot test everything

Which services really matter to the customer and does the network impact their perception?

Dedicated networkquality testing

Connectivity, responsivity, reliability,throughput of the network

Getting the common basicsof most services right

Network elements in E2E chain that impact popular services (e.g. QoS

enforcing mechanisms, web proxy, PEP)

Customerexperience

The customer’s mix of services and environments

Understand popular app requirements -Throughput, data volume, typical traffic

patterns, Timeout mechanisms

Customer‘s quality expectations, which are highly target-group and situation-

dependent.

Germany - Aachen

P3 communications GmbHAm Kraftversorgungsturm 3D-52070 AachenGermany

Web

www.p3-group.com

Disclaimer

This document and all information contained herein is the sole property of P3. No intellectual property rights are granted by the delivery of this document or the disclosure of its content. This document shall not be reproduced or disclosed to a third party without the express written consent of P3. This document and its content shall not be used for any purpose other than that for which it is supplied.

22/09/2016 Public 18

Your Contact

+49 (0) 151 571 33 343

ralf.pabst@p3-group.com

Ralf Pabst