Telecoms Evangelist no.2

Good EveningWelcome to Telecoms Evangelist evening

sponsored by Arrows Group

Monday, 24 September 12


Video


I would like to play you a video,reminding us all why our mobiles are so

important to our lives..Monday, 24 September 12

I would like to play you a video,reminding us all why our mobiles are so

important to our lives..Monday, 24 September 12

The Challenge...


The Challenge...• We need to provide Customer

Experience testing at key venues across UK.




• The Solution had to provide a comparison of all the operators, near realtime





• Old methods would normally mean up to a weeks delay from the test taking place to getting the report.






• Crowd sourcing is great, but is too random, and relies on a large number people testing randomly.






• Crowd sourcing is great, but is too random, and relies on a large number people testing randomly.

• What we needed was a new approach...


The origin’s of an idea...


The origin’s of an idea... • The idea for realtime CET was

based on our internal crowd sourced system,




• A system that we have pioneered for a number years...





• But with Crowd sourcing... It is difficult to achieve a consistent relevant testing regime.






• What we needed was a dedicated crowd... A crowd which would be happy to work 24/7 and stand around all day.






• What we needed was a dedicated crowd... A crowd which would be happy to work 24/7 and stand around all day.

• So that was it ‘Dedicated Crowd Sourcing’ was the answer...


The basic requirements


The basic requirements • We needed a real product, so that we

could use to deliver an end2end solution...




• Realtime App-based measurement system...





• We needed an app that could provide both voice & data testing in one unit...






• A flexible deployment strategy...







• Simple API driven reporting system for a web-portal, Spreadsheets & an App..








• See the results in realtime...








• See the results in realtime...

• An interface that would allow full diagnostics when required...


A Cloud based solution...

Smartphone testing app

Backend server in Cloud

JSON api to enable reporting on mobile devices

Root cause analysis tool

JSON api to enable realtime excel reporting


Comparison Of Existing systems

Data Voice JSON Realtime Cost

Metrico

iTestNet

TEMS

Epitiro

Yes Yes Yes Yes >200K

Yes No Yes Yes Free

Yes Yes No No >100K

Yes Yes Yes Yes <100K




Metrico

iTestNet

TEMS

Epitiro


Yes No Yes Yes Free

Yes Yes No No >100K





Metrico

iTestNet

TEMS

Epitiro


Yes No Yes Yes Free

Yes Yes No No >100K


The only solution to meet all our requirements was Epitiro








Dashboard & JSON api Specification provided

JSON%api%Dashboard%Coverage% layer% should% provide%a% clear% view% of% all% signal%strength% data% collected% over%the%measurement%period.% %And%provide% a% clear% uninterrupted%a n d% a n ima t e d% z o om i n g%experience%

Very%Simple%network%dashboard%based%on%the%displayed%areas…%%Providing%a%simple%view%of%Signal%level,%Download%&%Upload%Speed,%Ping%&%IP%success%rate.%

The% legend,% clean% simple%legend.% % This% should% a%simple% and% show% poor% to%good%coverage% in%a%simple%linear%flow…%

Combined%Network%Coverage%S i m p l e%G o o g l e%s t y l e%navigaLon%controls%%

CCSR%

98.2%%

97.5%%

95.3%%

97.6%%

97.6%%

97.6%%

The% Map% must% have% a% clear% and%unambiguous%Ltle%

Logo% Title%area%

Operator%logo%

Operator%ranking%table%Including%Signal,%download%speed,%

upload%speed,%Ping,%webpage%download%speed,%Voice%&%Data%CompleLon%Success%

rate%&%Sample%size%



• We provided a detailed specification for both the API and the web Portal...





CCSR%

98.2%%

97.5%%

95.3%%

97.6%%

97.6%%

97.6%%


Logo% Title%area%

Operator%logo%



rate%&%Sample%size%




• Writing a test API interface to ensure that the product would interface with our internal tools when it was delivered...





CCSR%

98.2%%

97.5%%

95.3%%

97.6%%

97.6%%

97.6%%


Logo% Title%area%

Operator%logo%



rate%&%Sample%size%




• Writing a test API interface to ensure that the product would interface with our internal tools when it was delivered...

• We wanted to support web-portal, excel spreadsheet, and apps which would all run off the same JSON API...





CCSR%

98.2%%

97.5%%

95.3%%

97.6%%

97.6%%

97.6%%


Logo% Title%area%

Operator%logo%



rate%&%Sample%size%


JSON RESTFull Functions



• @class iPQ_Epitiro;




• @interface iPQ_Epitiro : NSObject





• getiPQDashboard:coordinates:Radius:from:to:bearer






• getAgentIDForPeriod:hours/days/weeks







• getAgentID:from:to








• urlForMapWithX: andY: andZ:andOperator:andBearer:








• urlForMapWithX: andY: andZ:andOperator:andBearer:

• @end



72 Thousand


72 Thousand

Miles driven during the last 16 weeks



152 test units


152 test units

Deployed across UK venue’s, cities and motorways



16.3 Million


16.3 Million

Network Test made during in the last 16 weeks


16.3 Million


16.3 Million

That’s 107 Thousand test per handset



Demo


ats-group.co.uk

Tom Bryer

Managing Director

Est. 1992


London 2012 GamesBenchmarking the Mobile

OperatorsWorking With:

Est. 1992


During the Summer of 2012 – ATS&RO pioneered the CET bike! Giving unprecedented access to London during busy times of the day..


From the initial concept… To Reality…

Production Engineering from ATS…Monday, 24 September 12

Creating the static units for the London 2012 Games…


Intelligent Communication Solutions

• Took delivery of 20 static benchmark units on Friday morning

• Work very hard to get to the key locations in the Olympic park

• Deadline for installation within the Olympic park was Sunday evening

• All boxes were installed, activated & commissioned on time

Rigging and Installation Services

Deploying the static units for the London 2012 Games…


152 test units deployed across the UK…


Our Benchmark Test Kit Range…

Walk, able to provide access to key areas

Sta'c, 24 by 7 at key locaDons

Car, great for all round balance of TesDng and Mileage

Cycle, provide great access to urban areas

Bike, great for central London or other urban areas


Motorbike test unit…


Static Test unit…


Backpack test unit


Car Test Unit…


Currently Working With:

We are so Impressed with realTime CET… We have set-‐up a new company to drive this forward:


On the way to completing a UK coverage mapEncouraging Mobile choice


Gavin Johns

Chief Operating Officer

Est. 2000


ww

w.epitiro.com

Gavin JohnsCEO, Epitiro

iPQTM

Real-Time Insight

Epitiro Group Limited10-11 Raleigh Walk, Waterfront 2000, Brigantine Place, Cardiff, CF10 4LNRegistered in England and Wales no: [email protected] | www.epitiro.com


ww

w.epitiro.com

§ Epitiro provides leading Mobile Operators with network monitoring systems to ensure they can measure and manage Quality of Experience

§ Real-time insight of QoE helps address service-affecting issues in their infancy

§ We help operators achieve;§ Efficient Network Expansion§ Reduced Support Calls§ Higher Customer Satisfaction / Reduced Churn

§ Established 2000, Cardiff

‘Quality of Experience’ Monitoring Solutions for Mobile Operators

About Epitiro

ipQTM



ww

w.epitiro.com

Our Clients


ww

w.epitiro.com

“Does it work when I want it?”

Challenges for Mobile Operators

Coverage

Performance

ReliabilityCapacity

Capability “Does it perform as I expect?”• Voice, text and Data

“Is there service where I need it?”

Availability of Voice and Data Services 24/7

Does the Network support the latest

technology

How does the network cope at times of peak demand

Coverage - Capacity – Capability - Performance - ReliabilityThe Five Pillars of Customer Experience…

“Can I make a call when I want to, for as longa as I want to?”


ww

w.epitiro.com

34

Product Overview

ipQTM Block Diagram


ww

w.epitiro.com

• Overview– Targeted measurement of mobile network – based on

cell, bearer etc.– Test Scheduling event based, time based, push-to-

test– Active & Passive testing

• Device Support– Android 2.1+ and iOS 4.0+– Consolidated approach for future device support with

RIM and Windows

• Network and Bearer support– 2G, 3G UMTS and CDMA, 4G WiMAX and LTE– Wi-Fi

AT50M Software Probe Test App

AT50MSoftware

Client

OTA Android Smartphones


ww

w.epitiro.com

ipQ Analytics

Filter just the data you want to see

CeX Dashboard’s in Real Time

Drill-down to investigate network performance

See network performance by location


ww

w.epitiro.com

ipQ Analytics






ww

w.epitiro.com

ipQ Analytics






ww

w.epitiro.com

One Click shows top KPIs

One-Click Dashboards

Click on any legend to add/remove from

view

Click on any point to see detailed

information

Line Chart View…


ww

w.epitiro.com




view


information

Line Chart View…


ww

w.epitiro.com




view


information

Line Chart View…


ww

w.epitiro.com




view


information

Line Chart View…


ww

w.epitiro.com

Map Views

Click on a Pin to see the test details of any

smartphone within the tile

See Any KPI by heat map

Click on a tile to zoom in and see Pin

locations of smartphone tests

See Coverage and KPIs on a Map


ww

w.epitiro.com

Map Views








ww

w.epitiro.com

Map Views








ww

w.epitiro.com

Map Views








ww

w.epitiro.com

IP Data Measurements• TCP Throughput• TCP Echo• TCP 3-way Handshake Latency• UDP Network Quality

– Packet Loss– Jitter– Two-way latency

One-way latency (OWAMP)– Echo

• ICMP Latency• DNS Lookup

• Application Measurements• ITU-T G.107 E-model• Call Success Rate (Dropped Calls)• UDP Gaming• P2P Bandwidth • HTTP Web Browsing

Passive Measurements • Data Connection State• Cellular Service State• Application Throughput• Application Bandwidth Consumption• Web Browser Throughput• TCP / UDP Network Traffic

Geolocation • GPS• Triangulation• IP Geolocation

Test Scheduling• Fixed • Periodic• Window based• Event based• On idle

A Full Range of Measurement Capability

Summary of KPIs and Ancillary Data

Network Interfaces• IEEE 802.3 Ethernet • IEEE 802.11 Wireless

Internet Protocols• IPv4• IPv6

IP QoS Control• DiffServ DSCP• IPv6 Flow Label


ww

w.epitiro.com

Test Management

Create unlimited versions of KPI Tests

Extensive control over the configuration of each Test

Easily make the Test available for any

probe

A Full Configurable Client from the Server


ww

w.epitiro.com

Test Management




probe



ww

w.epitiro.com

Test Management




probe



ww

w.epitiro.com

Test Management




probe



ww

w.epitiro.com

§ Programmable warning and critical thresholds means is instantly alerted when baseline thresholds are breached

§ Full access to testing allows to control the frequency and the number of KPIs

§ Benchmarking competitor MNOs highlights opportunities to improve service..

§ Instantly see the impact of any changes on the network…

In Summary

Benefits of iPQ…


ww

w.epitiro.com

§ Real-Time Reporting Interface Mobile Operators

§ Full ‘On-Demand’ Management of data collection probe testing

§ Support Services to ensure installation, configuration, maintenance and further data analysis

ipQTM Performance Monitoring Solution

ipQTM


Product and Services


Telecoms Evangelist no.2

Documents