2021 umlaut Manawatu AuditReport

New Zealand, Manawatu 08/2021

Audit Report.

Foreword

For the inhabitants of New Zealand, it is particularly interesting to see how the operators perform in metropolitan areas as well in areas of low popula-tion density.

Therefore, we have performed indi-vidual analyses for Manawatu. More than 250,000 New Zealanders live in this region.

umlaut report

2

umlaut report umlaut report

32

Testing area

530 kmmeasuring distance

Intro

The leader in mobile benchmarking, umlaut, has analyzed

the mobile networks in New Zealand with regards to

mobile network performance.

We measure smartphone voice and data performance

based on extensive drivetests.

This report has been commissioned by Vodafone.

As the de-facto industry standard, our benchmarking

methodology focuses on customer-perceived network

quality and covers a wide range of mobile services.

Today, more than 200 mobile networks in more than 120

countries are being evaluated by our unique methodology.

It allows a technical analysis that is unprecedented in its

level of detail and enables comparisons between the net-

work performance and capability of each mobile network.

Our benchmarks help network operators to demonstrate

how well they are delivering wireless connections to

consumers, business users and enterprises and reveals the

areas of improvement.

Manawatu

Drivetest Voice Data

Device Samsung Galaxy S20+5G (Exynos) SM-G986B Samsung Galaxy S20+5G (Exynos) SM-G986B

Test Cases Mobile-to-MobileSide1 (5G pref) to Side2 (5G pref) 115 sec call window70 sec call duration15 sec call setup timeoutMulti-RAB traffic injection on both sides

Data 5G preferredHTTP DL datastream 7sHTTP UL datastream 7sHTTP 10MB DL fixed file transferHTTP 5MB UL fixed file transferWeb Browsing - Kepler ETSI Ref. Page10 Live web pages 3YouTube ( videos ~ 45s)

Mobility andRoute Types

100% DrivetestSmall Country Approach

Samples ~ 1380 ~ 6240

Dates 3 measurement days11.08.2021 – 13.08.2021

The map shows the total driving area for Manawatu.

The routes were independently selected by umlaut based

on the official coverage maps provided by the network

operators.

5G Coverage Maps Vodafone:https://www.vodafone.co.nz/network/coverage/

5G Coverage Maps 2degrees:https://www.2degrees.nz/coverage/

5G Coverage Maps Spark:https://www.spark.co.nz/shop/mobile/network/

4


5

Total Score Overall results

Score achieved by the networks under test.

Total Score1000 Dots

2degrees

411

243

Spark

343

157

- S

how

n to

tal s

core

s ar

e ro

und

ed.

Vodafone

416

297

Voicemax. 400

Datamax. 600

Operator

713654

500

6

umlaut report

7

umlaut report

5G availabilityMeasured from UE

The table shows the 5G availability measured in Manawatu. All data sequences from the umlaut use case are taken into

account.

5G availability is defined as the share of time a user is actually using the 5G network (represented by the percentage of

test cases during which the UE was using 5G).The graph shows the 5G availability measured in Manawatu. All data sequences from the umlaut use case are taken into

account.

Manawatu[%]

2degrees Spark

- S

how

n va

lues

are

rou

nded

.

Vodafone

49.4

04.9

Operator

5Gavailability

Technology List Unit Vodafone 2degrees Spark

Manawatu

5G [%] 33.46 0 1.32

5G-LTE Mixed Session [%] 15.94 0 3.58

LTE [%] 47.23 95.99 87.24

LTE-3G Mixed Session [%] 0.63 1.08 1.03

3G [%] 2.74 2.92 6.82

8


9

Datastream DownloadAvg. & Max. Throughputs HD video class and UHD video class

The graph shows the average throughput (darker shade) and the maximum throughput (lighter shade) for all technologies.

All data sequences from the umlaut use case are taken into account.

The graph shows the number of samples at least achieving 5Mbit/s (HD video class - lighter shade) and 20Mbit/s (UHD

video class - darker shade) for all technologies. All data sequences from the umlaut use case are taken into account.

Manawatu[Mbps]

2degrees Spark

-Sh

own

valu

es a

re r

ound

ed.

Vodafone

196

440

41

89

52

119DatastreamDownload

Operator

Manawatu[%]

2degrees Spark

-Sh

own

valu

es a

re r

ound

ed.

Vodafone

89

98

66

93

65

92

HD video class andUHD video class

Operator

10


11

Achieved values of all networks under test in each of the relevant Voice Key Performance Indicators (KPIs) for Manawatu.

Voice Service Group Unit Vodafone 2degrees Spark

Manawatu

Qualifier [%] 97,2 97,8 93,0

Call Setup Time (P90) [s] 3,0 6,6 4,6

Speech Quality (P10) [MOS-LQO] 3,4 3,1 3,1

Multirab connectivity [%] 99,6 99,6 99,3

KPI overview — Voice

2degrees

6.6

Spark

4.6

- S

how

n va

lues

are

rou

nded

.

Vodafone

Manawatu[s]

3.0

Operator

Call Setup Time

2degrees

3.1

Spark

3.1

- S

how

n va

lues

are

rou

nded

.

Vodafone

Manawatu[MOS-LQO]

3.4

Operator

P10 Speech Quality

Achieved values of all networks under test in Call Setup Tme for Manawatu. Achieved values of all networks under test in Speech Quality for Manawatu.

12


13

Achieved values of all networks under test in each of the relevant Data Key Performance Indicators (KPIs) in Manawatu

from all collected test samples.

KPI overview — DataData Manawatu KPI Name Unit Vodafone 2degrees Spark

HTTP Web Page DL Smartphone

Qualifier [%] 97,6 97,6 96,9

Overall Session Time [s] 1,9 2,2 2,5

HTTP 10MB DL Smartphone

Qualifier [%] 98,4 99,5 97,8

Overall Session Time [s] 2,4 6,0 6,0

90% faster than [Mbit/s] 18,2 6,2 6,4


HTTP 5MB UL Smartphone

Qualifier [%] 95,0 98,9 98,3

Average Session Time [s] 5,8 5,7 9,1


10% faster than [kbit/s] 34,5 37,9 27,8

HTTP DL FDTT

Qualifier [%] 97,8 98,9 97,8


faster than 5 Mbit/s [%] 98,3 93,0 92,1


HTTP UL FDTT

Qualifier [%] 96,7 96,8 93,8




YouTube

Qualifier [%] 95,6 96,8 95,5

Start Time [s] 1,7 1,5 1,6

AVG Resolution [p] 1064,6 1059,8 1029,8

YouTube Live Smartphone

Qualifier [%] 93,1 92,3 86,5

Start Time [s] 3,5 4,1 4,3

AVG Resolution [p] 1080,0 1080,0 1080,0

YouTube 4K Smartphone

Qualifier [%] 97,8 95,7 92,9

Start Time [s] 2,0 1,5 1,6

AVG Resolution [p] 1740,6 1446,1 1427,6

14

umlaut report

15

umlaut report

17

Key takeaways

In the voice category, Vodafone achieves the highest score, showing the shortest call set up times and the best speech quality.

Vodafone is leading with the highest overall umlaut score in Manawatu.

Vodafone shows the widest 5G availability in Manawatu.

In the data category, Vodafone is leading with the highest overall score and has the fastest down-load throughputs.

16

umlaut report

17

umlaut report

umlaut SE

Am Kraftversorgungsturm 3 · 52070 Aachen · Germany

Hakan Ekmen · Chief Executive Officer Telecommunication

cell +49 151 571 33 235 · [email protected]

www.umlaut.com

2021 umlaut Manawatu AuditReport

Documents