3G KPI Guidelines,UMTS,WCDMA

5/20/2018 3G KPI Guidelines,UMTS,WCDMA

1/40

Appendix U12

UMTS Network KPI

NOTES:

This document can be used as an example of defining KPs in a cont!act" t is inE!icsson#s inte!est that KPs a!e $ell defined% including:

a KP ta!get &alues '(eep as fe$ $ith ta!gets as possible)

b *o!mula and measu!ement definitions 'fo! d!i&es and stats)

c +he!e and ho$ KP $ill be measu!ed 'locations% setup% tools% d!i&e% statistics)

d ,onditions - p!e!e.uisites% exclusions

e Statistical conside!ations

As much of this as p!actical should be defined in the cont!act% pa!ticula!l/ an/thingthat $ill limit E!icsson#s !is(s and costs"

Some of the mate!ial in this document ma/ best be included in othe! pa!ts of thecont!act% including the Acceptance P!ocedu!e and associated documents"

KP ta!get &alues ha&e &e!/ little meaning until the conditions of measu!ement a!edefined as abo&e" ,ommitting to a ta!get $ithout defining ho$% $hen and $he!e it $illbe measu!ed lea&es E!icsson at g!eat !is("

N"0" The KPs and thei! ta!gets included in this document ma/ not be the ones

!ecommended b/ E!icsson" efe! to the KP Technical uidelines and KP data basefo! cu!!ent !ecommendations"


2/40

Table of Contents

UMTS NETWORK KPI..........................................................................................................................................................1

1 INTRODUCTION..........................................................................................................................................................3

1.1 SUMMARYOFLEVEL-1 KPI ANDTARGETS.............................................................................................................3

2 PERFORMANCE COMMITMENTS AND REQUIREMENTS...............................................................................6

2.1 MILESTONEDEFINITION..........................................................................................................................................62.2 SCOPE......................................................................................................................................................................6

2.3 GENERALREQUIREMENTS.......................................................................................................................................62.4 CONTRACTUALKPI COMMITMENTS.......................................................................................................................7

3 UTRAN LEVEL-1 KEY PERFORMANCE INDICATORS......................................................................................7

3.1 CIRCUITSWITCHEDLEVEL-1 KEYPERFORMANCEINDICATORS.............................................................................7

3.1.1 Circuit Switched Call Setup...............................................................................................................................7

3.1.2 RRC Establishment Causes............................................................................................................................ ....93.1.3 CSV Access Failure............................................................................................................................................9

3.1.4 CSV Drop..........................................................................................................................................................11

3.1.5 CSV Qualit......................................................................................................................................................1!

3.1.6 CSV Cell Capacit............................................................................................................................................1"

3.1.7 CSV So#t$So#ter %ando&er '&erhead...............................................................................................................1(3.1.8 CSV )nter*Radio Access +echnolo, %ando&er Failure..................................................................................1-

3.1.9 CSV Call Setup +ime........................................................................................................................................1

3.1.10 CSD Access Failure.....................................................................................................................................193.1.11 CSD Drop....................................................................................................................................................!/

3.1.12 CSD Qualit................................................................................................................................................!1

3.1.13 CSD Call Setup time....................................................................................................................................!!

3.2 PACKETSWITCHEDLEVEL-1 KEYPERFORMANCEINDICATORS............................................................................233.2.1 0acet Switched Call Setup..............................................................................................................................!2

3.2.2 0SD Access Failure..........................................................................................................................................!"

3.2.3 0SD Drop.........................................................................................................................................................!(

3.2.4 0SD 3atenc.....................................................................................................................................................!-3.2.5 0SD +hrou,hput...............................................................................................................................................!-

3.2.6 0SD Call Setup +ime........................................................................................................................................!3.2.7 0SD )nter*Radio Access +echnolo, %ando&er Failure..................................................................................!9

3.2.8 0SD )RA+ )nterruption time.............................................................................................................................2/3.2.9 %SD0A Access Failure.....................................................................................................................................21

3.2.10 %SD0A Drop................................................................................................................................ ............ ...2!

3.2.11 %SD0A 3atenc............................................................................................................................... ............2"

3.2.12 %SD0A +hrou,hput.....................................................................................................................................2"3.2.13 %S40A +hrou,hput.....................................................................................................................................2-

3.2.14 %SD0A Data Session Setup +ime.................................................................................................... ............27

3.3 SYSTEMAVAILAILITY..........................................................................................................................................37

3.3.1 A&era,e Cell A&ailabilit..................................................................................................................................23.3.2 A&era,e Cell 5on*6aintenance A&ailabilit....................................................................................................2

3.4 COMPARISONOFUMTS ANDGSM NETWORKPERFORMANCE............................................................................3!

3." IMPACTOFUMTS ONGSM NETWORKPERFORMANCE........................................................................................3!4 UTRAN LEVEL-2 KEY PERFORMANCE INDICATORS....................................................................................40

2 of 34


3/40

1 Introduction

The pu!pose of this Appendix U12 is to define Net$o!( Ke/ Pe!fo!mance ndicato!s 'KP) fo! the U5TS

d!i&e test% UTAN counte! based measu!ements and pe!fo!mance ta!gets and fo!mulas fo! each of the

KP" All capitali6ed te!ms% ac!on/ms% and definitions used in this Appendix U12 a!e listed in eithe! the

U5TS Ac!on/ms and 7efinitions 'Appendix U18)% o! in the O!iginal Ag!eement"

The UTAN KP definition and de&elopment effo!t is pe!fo!med at the t$o le&els as defined belo$:

9e&el1 KP: a!e the highle&el met!ics used fo! o&e!all se!&ice .ualit/ measu!ement and monito!ing

the health of Pu!chase!#s UTAN Net$o!(" These met!ic definitions shall be ag!eed to b/ Selle!%

and Selle!;s implementation of the 9e&el1 met!ics shall be in compliance $ith Pu!chase!;s

definitions defined in this Appendix U12"

9e&el2 KP: a!e the detailed enginee!ing le&el met!ics that shall be used fo! enginee!ing%

dimensioning the Net$o!(% the in&estigation and t!oubleshooting of p!oblem a!eas in the U5TS

Net$o!("

Summary of Level1 KPI and Tar!ets

N"T#$ T%e selection of KPI and t%e tar!et values s%ould use t%eKPI Tec%nical &uidelines and KPI 'atabase( T%e followin! is ane)am*le from a real contract and s%ould N"T be seen as#ricsson recommendation and must not be used in any contractin t%is form(

KPI Parameter Table

+eference

PreLaunc%

,Milestone 1-

Launc%

,Milestone .-

Post Launc%

,Milestone /-

,S< Access *ailu!e ate Table = > 2"4 ? > 2"4 ? > 2"4 ?

,S< 7!op ate Table @ > 2"4 ? > 2"4 ? > 2"4 ?

,S< ualit/ '79) Table 8 B@thpe!centile

of samples >

2"4 ? 09E

B@thpe!centile of

samples > 2"4 ?

09E

B@thpe!centile

of samples >

2"4 ? 09E

,S< ualit/ 'U9) Table 8 B@thpe!centile

of samples >

2"4 ? 09E

B@thpe!centile of

samples > 2"4 ?

09E

B@thpe!centile

of samples >

2"4 ? 09E

,ell ,apacit/ Table 14 C 34 U# 0M+1.(.k

'p!o&ided it is

achie&ed in *

design)

C 34 U# 0M+1.(.k 'p!o&ided it

is achie&ed in *

design)

5easu!e and!epo!t

SoftDSofte! ando&e!

O&e!head

Table 12 > 1"F > 1"F > 1"G

,S< AT *ailu!e ate Table 13 NDA > @"4 ? > @"4 ?

= of 34


4/40

H B seconds

B@thpe!centile >

B seconds

B@thpe!centile

> B seconds

,S7 Access *ailu!e ate Table 1G > ="4 ? > 2"4 ? > 2"4 ?

,S7 7!op ate Table 1B > 2"@ ? > 2"@ ? > ="4 ?

',ounte!)

> 2"@ ? '7!i&e

Test)

,S7 ualit/ '79) Table 21 B@thpe!centile

of samples >

1"4 ? 09E

B@thpe!centile of

samples > 1"4 ?

09E

B@thpe!centile

of samples >

1"4 ? 09E

,S7 ualit/ 'U9) Table 21 B@thpe!centileof samples >

1"4 ? 09E

B@thpe!centile ofsamples > 1"4 ?

09E

B@thpe!centileof samples >

1"4 ?09E

H,S7 ,all Setup time Table 22 N"A B@thpe!centile > B

seconds

N"A

PS7 Access *ailu!e ate Table 23 > 2"4 ? > 2"4 ? > 2"4 ?

PS7 7!op ate Table 2F > 2"@ ? > 2"4 ? > 2"4 ?

HPS7 9atenc/ 'an/ BBA0)

Table 28 N"A B@thpe!centile

> 244ms

N"A

PS7 BB A&e!age 79

th!oughput '(bps)

'Unloaded)

Table =1 C 234 C 234 C 1@4 ',ounte!)

C 234 '7!i&e

Test)

PS7 BB A&e!age 79

th!oughput '(bps)

'9oaded)

Table =1 C 214 C 214 C 1@4 ',ounte!)

C 214 '7!i&e

Test)

PS7 BB A&e!age U9

th!oughput '(bps)

'Unloaded)

Table =2 C 244 C 244 C 1@4 ',ounte!)

C 244 '7!i&e

Test)

PS7 BB A&e!age U9

th!oughput '(bps)

'9oaded)

Table =2 C 184 C 184 C 1@4 ',ounte!)

C 184 '7!i&e

Test)

3 of 34


5/40

HPS7 ,all Setup time Table =3 N"A B@thpe!centile

sessions > @

seconds

N"A

PS7 AT *ailu!e ate Table =F NDA > @"4 ? > @"4 ?

PS7 AT nte!!uption time Table =B N"A B@th pe!centile> 12 seconds

N"A

PS7 AT Use! 7ata

nte!!uption time

Table =B N"A 5easu!e andepo!t

N"A

S7PA Access *ailu!e

ate

Table 31 > 2"4 ? > 2"4 ? > 2"4 ?

S7PA 7!op ate Table 3= > ="4 ? > 2"4 ? > 2"4 ?

HS7PA 9atenc/ Table 3@ N"A B@th

pe!centilesessions > 144

ms

N"A

Stationa!/ 5aximum 79

S7PA 0it ate '(bps)

unde! no load 'UE

,atego!/ 12)

Table 3G C 1=44 C 1=44 C1=44

'at 9, 9a/e!

using counte!)

Stationa!/ 5aximum 79

S7PA 0it ate '(bps) $ith

@4? 79 loading 'UE

,atego!/ 12)

Table 3G C 1144 C 1144 N"A

S7PA A&e!age 79

Th!oughput '(bps) fo! UE

catego!/ 12 unde! no load

Table 38 C G44 C G44 C G44

'at off pea()

S7PA A&e!age 79

Th!oughput '(bps) fo! UE

catego!/ 12 unde! @4? 79

loading

Table 38 C F44 C F44 N"A

SUPA Stationa!/ Pea(

th!oughput '(bps) fo! UE

,atego!/ = '1"3@ 5bps)

Table @4 C 1144 C 1144 5easu!e and

epo!t

SUPA Stationa!/ A&e!age

th!oughput '(bps) fo! UE

,atego!/ = '1"3@ 5bps)

Table @4 C @44 C @44 5easu!e and

epo!t

HS7PA Session Acti&ation

time

Table @1 N"A B@thpe!centile

sessions > @

seconds

N"A

@ of 34


6/40

HA&e!age ,ell A&ailabilit/

KP

Table @= N"A N"A N"AHH

HA&e!age ,ell Non

5aintenance A&ailabilit/

KP

Table @@ N"A N"A N"AHH

S5 Pe!fo!mance

7eg!adation due to

nt!oduction of U5TS

Page No:

34

,ell > 14 ?

,luste! > G"@?

5a!(et > @?

,ell> 14 ?

,luste! > G"@?

5a!(et > @?

,ell> 14 ?

,luste! > G"@?

5a!(et > @?

H Selle! shall commit to these KP du!ing the life of the Net$o!( as desc!ibed in Section of this document

HH KP Applicable one '1) /ea! afte! U5TS Net$o!( comme!cial 9aunch"

2 Performance Commitments and +euirements

Milestone 'efinition

5ilestone desc!iption is p!o&ided in the U5TS S/stem Acceptance 'Appendix U1F)"

Th!ee milestones a!e defined in this Appendix U12 as follo$s:

1" 5ilestone1 '5S1): Prelaunc%" P!elaunch is defined as the completion of ,luste! Acceptancetesting" The KP ta!get le&els $ill be based on d!i&e tests and not OSS statistics"

2" 5ilestone2 '5S2): Launc%" 9aunch is defined as the completion of 5a!(et Acceptance testing of the

initial Net$o!( configu!ation" The KP ta!get le&els shall be based on d!i&e tests and not OSS

statistics"

=" 5ilestone= '5S=): PostLaunc%" Post9aunch is defined as six 'F) months afte! 9aunch" The KP

ta!get le&els shall be based on OSS statistics at 5a!(et 9e&el o! 7!i&e Test data if the!e is not

sufficient t!affic% as defined in U5TS S/stem Acceptance 'Appendix U1F) in the U5TS Net$o!("

Sco*e

The scope in this Appendix U12 is to define applicable U5TS Net$o!( KPs fo! S/stems and E.uipmentsupplied b/ Selle!"

&eneral +euirements

Pe!fo!mance 5anagement 5easu!ement Entit/ shall be a&ailable at ,ell% Node0% ,luste!% N,% 5a!(et%

egion and Net$o!( le&el fo! e&e!/ KP unless othe!$ise stated in this Appendix U12" N, 5easu!ement

!anula!it/ shall be a minimum pe!iod of fifteen '1@) minutes unless othe!$ise stated in this Appendix U12"

All tests fo! KP pu!poses shall be pe!fo!med in 5obile '&ehicle d!i&e) en&i!onment unless othe!$ise specified"

AT a!d ando&e! *eatu!e shall be s$itched off du!ing KP &e!ification $ithin the U5TS Se!&ice A!ea at

P!e9aunch" At 9aunch milestone AT O failu!e !ate in =2 * Se!&ice bounda!/ shall be &e!ified $ith

one dedicated d!i&e pe! 5a!(et unit"

The tests shall be pe!fo!med unde! a multisupplie! en&i!onment% in $hich nodes f!om diffe!ent supplie!sma/ be used 'e"g" SSN% SN% 5S,% 5+ etc)" n the e&ent that a pa!ticula! test is not passed andSelle! claims the p!oblem is $ith the othe! supplie!% Selle! shall clea!l/ demonst!ate that the element in.uestion is the sou!ce of the p!oblem" f the p!oblem is confi!med to be in a thi!dpa!t/ supplie!#sE.uipment then Selle! shall !eschedule the indi&idual test cases onl/ afte! the p!oblem has been!esol&ed b/ the thi!dpa!t/ supplie!"

The initial UTAN pa!amete! set shall be mutuall/ ag!eed" No UTAN pa!amete! shall be changeddu!ing ,luste!D5a!(et Acceptance tests $ithout p!io! app!o&al of Pu!chase! as defined in the U5TSS/stem Acceptance 'Appendix U1F)" As te!minal pe!fo!mance ma/ also ha&e an impact on the

F of 34


7/40

pe!fo!mance% the b!and and model of te!minal to be used fo! the tests shall be mutuall/ ag!eed to b/Selle! and Pu!chase!"

,ounte! based statistics fo! 9e&el1 KP shall co&e! all t!affic classes and include all causes of

failu!esDsuccesses to indicate end to end pe!fo!mance as &ie$ed b/ UTAN"

Contractual KPI Commitments

The follo$ing KPs and ta!gets shall be &alid fo! the lifetime of the Net$o!(% p!o&ided that the!e is a Suppo!tAg!eement in place fo! the Selle! p!o&ided S/stems"

Table .$ KPI Parameter Commitment for t%e lifetime of t%e UMTS Network

SN KPI Parameter Tar!et

1 ,S< ,all Setup Time '5obile to PSTN) > F seconds

2 ,S< ,all Setup Time '5obile to 5obile) > B seconds

= ,S7 ,all Setup time '5obile to 5obile) > B seconds

3 PS7 9atenc/ an/ BB A0 > 244 ms

@ PS7 ,all Setup Time > @ seconds

F S7PA 9atenc/ > 144ms

G S7PA 7ata Session Setup Time > @ seconds

8 ,ell A&ailabilit/ As pe! Table @=

B ,ell A&ailabilit/ 'Non5aintenance) As pe! Table @@

The U5TS Net$o!( is expected to meet o! exceed the KP ta!gets specified in this Appendix U12 $ithin the

U5TS Se!&ice A!ea $ith o! $ithout loading the U5TS Net$o!("

Selle! commitment applies to 9e&el1 KP fo! achie&ing ta!get &alues at the milestone applicable to KP"

KP counte! met!ics shall be based on UTAN &ie$ of Net$o!( Pe!fo!mance" Selle! shall p!o&ide all9e&el1 KP counte!s used in the fo!mulas defined in this Appendix U12 at 5ilestone2 $ith theexception of S0 counte!s fo! Access *ailu!e" Selle! shall p!o&ide all 9e&el1 KP !epo!ts fo! KP

Acceptance"

Pu!chase! shall define KP 9e&el2 !e.ui!ements as outlined in Section 3"

3 UT+0N Level1 Key Performance IndicatorsThis Section desc!ibes the UTAN 9e&el1 KP% o! high le&el se!&ice met!ics" 9e&el1 KP is subdi&ided into t$o basic se!&ice domains: the ,i!cuit S$itched ',S) domain that includes


8/40

/(1(1 ,i!cuit S$itched ,all Setup

The setup of a ,S se!&ice is comp!ised of th!ee basic steps 'see *igu!e 1)" *i!st% UE must accessthe UTAN and establish an , connection" Once this connection is completed the Non AccessSt!atum 'NAS) messages a!e exchanged bet$een the UE and the ,o!e Net$o!( ',N) e"g" ,5Se!&ice e.uest% Authentication% Secu!it/% etc" The last step of the call setup is the establishment ofa adio Access 0ea!e! 'A0) bet$een the ,N and the UE"

2i!ure 1$ Call Setu* 3lock 'ia!ram

*igu!e 2 illust!ates a call setup flo$ diag!am fo! a ,S mobile o!iginated call" f a p!oblem occu!sbet$een , ,onnection e.uest 'step 1)% and ANAP: A0 Assignment esponse 'step 2G)%

Ale!tingD,onnect 'step 2B) in case of d!i&e test% it is conside!ed an Access *ailu!e" An/ A0abno!mal !elease afte! A0 Assignment esponse 'in case of ,ounte! *o!mula)% Ale!tingD,onnect

message 'in case of 7!i&e Test *o!mula) is conside!ed a d!opped call"

8 of 34

Establish,

,onnection

Non AccessSt!atum

5essaging

adioAccess0ea!e!'A0)Setup


9/40

2i!ure .$ Circuit Switc%ed Call Setu* 2low 'ia!ram

/(1(. , Establishment ,auses

Table 1 p!o&ides a list of , establishment causes" +hen the UE attempts to setup a ,,onnection $ith the UTAN% the UE sends a , ,onnection e.uest message" Embedded $ithin

this message is an info!mation element that communicates the establishment cause fo! theconnection !e.uest" This establishment cause shall be utili6ed to diffe!entiate ,S and PS call KP!elated to Access *ailu!e" Sepa!ate counte!s fo! each t!affic classes fo! e&e!/ , ,onnectione.uest and , ,onnection ,omplete 'as pe! =PP) shall be made a&ailable in Soft$a!e !eleaseat the time of comme!cial launch '5ilestone 2)"

Table 1$ ++C #stablis%ment Causes

++C #stablis%mentCause

'escri*tion

4 O!iginating ,on&e!sational ,all

1 O!iginating St!eaming ,all

2 O!iginating nte!acti&e ,all

= O!iginating 0ac(g!ound ,all

3 O!iginating Subsc!ibed t!affic ,all

@ Te!minating ,on&e!sational ,all

F Te!minating St!eaming ,all

G Te!minating nte!acti&e ,all

8 Te!minating 0ac(g!ound ,all

B Eme!genc/ ,all

14 nte!AT ,ell !eselection

11 nte!AT ,ell change o!de!

12 egist!ation

1= 7etach

13 O!iginating igh P!io!it/ Signaling

1@ O!iginating 9o$ P!io!it/ Signaling

1F ,all !eestablishment

1G Te!minating igh P!io!it/ Signaling

18 Te!minating 9o$ P!io!it/ Signaling

1B Te!minating - cause un(no$n

/(1(/ ,S< Access *ailu!e

Access failu!e is the p!oduct of the , ,onnection *ailu!e% NAS Setup *ailu!e and the A0Establishment *ailu!e" , ,onnection Success is counted $hen the N, !ecei&es a , Setup,omplete f!om the UE" NAS Setup is conside!ed successful $hen the signaling messages in thecall flo$ du!ing call setup flo$ is successfull/ completed b/ !ele&ant Net$o!( Elements" A A0 isconside!ed successfull/ established $hen the A0 Assignment esponse is sent b/ N, to the,N"

B of 34


10/40

#uation 1$ CS4 0ccess 2ailure +ate ,Counter 2ormula-

144H

#$R%&

#$R%&'

&

&'

&

&1

CSV7uestAssi,nmentRA8

CSVsponseAssi,nmentRA8

SR8Attempt

SR8Success

AttemptConnectionRRC

SuccessConnectionRRC

The abo&e fo!mula definition shall be met $ith the follo$ing Selle!#s counte!s"

144H

-(S*,0A((%-N4R*E(

%S*,0S5//-N4R*E('!!!3.'

,,#C$U()*+C%C4++%/(R%7-T4(N4R)/

*+C%,,#CS5//$U()C4++%/(R%7-T4(N4R)/1

Selle! shall de&elop S0 counte!s b/ AN elease P8" Selle! and Pu!chase! ag!eed to use BB"B=?S0 success !ate until S0 counte!s pe! ,S and PS domain a!e made a&ailable at P8"

As an inte!im solution% it shall be defined as a d!op !ate of 2? o&e! an a&e!age call length of B4seconds% the p!obabilit/ of d!opping the S0 du!ing the di!ect t!ansfe! phase is =sDB4sH2?I 4"4G?"

f du!ing the deplo/ment% fault !ates highe! than 4"1? a!e obse!&ed% selle! shall de&elop counte!s inPG"

Measurement Condition$

n case of multiple , connection !e.uests onl/ the fi!st , connection !e.uest shall be ta(eninto conside!ation fo! KP calculation"

Table .$ CS4 0ccess Term 'efinition

Key Performance Indicator Term 'efinition

#RRC Connection Success (CSV) The numbe! of successful , ,onnection ,omplete$ith an/ establishment cause that lead to ,S< A0"

#RRC Connection Attempt (CSV) The numbe! , ,onnection e.uest 5essages!ecei&ed $ith an/ establishment cause that leads to a,S< A0"

#RAB Assignment Response (CSV) The numbe! of ANAP: A0 Assignment esponsemessages sent f!om the N, to the 5S, fo! a &oicecall"

#RAB Assignment Request (CSV) The numbe! of ANAP: A0 Assignment e.uestmessages sent f!om the 5S, to the N, to establish a&oice call"

# SRB Attempt The numbe! of , ,onnection ,ompletes that $ill

lead to an nitial 7i!ect T!ansfe! to the ,S domain and$ill also lead to a ,S< A0 Assignment e.uest"

# SRB Success The numbe! of ,S< A0 Assignment e.uests

#uation .$ CS4 0ccess 2ailure +ate ,'rive Test 2ormula-

=

CallsCSV

CallsCSV

7uestConnectionRRC

ConnectAlertin,CC

ailureRateCSVAccessF

8

8

R%8

98

1'166

14 of 34


11/40


n the e&ent that the!e a!e se&e!al consecuti&e , ,onnection e.uest onl/ the fi!st , connection

!e.uest shall be ta(en into account fo! the KP calculation"

,alls a!e conside!ed as failed du!ing access $hen a connection is attempted and the UE does not !ecei&e

Ale!tingD,onnect message in case of d!i&e test measu!ement" *o! OSS ANAP: A0 Assignment

esponse message f!om the N, to co!e Net$o!( is conside!ed as a call successful setup"

Table /$ CS4 0ccess 2ailure +ate KPI

PreLaunc% Launc% PostLaunc%

5 .(6 7 5 .(6 7 5 .(6 7

/(1(8 ,S< 7!op

,i!cuit S$itched


12/40


An/ ,S< call successfull/ handed o&e! f!om = to 2 net$o!( $ithin the ,S< Se!&ice A!ea shall beconside!ed as d!op call fo! 5ilestone 2"

Table 9$ CS4 'ro* +ate KPI


5 .(6 7 5 .(6 7 5 .(67

/(1(9 ,S< ualit/


13/40

144H#$&

#$&

Speechnin,A#terCombiDownlin1)n8loc1sport+otal+rans

Speechnin,A#terCombiDownlin1)n8loc1s+ransportFault

,P fo! ES is found unde! AN Pe!fo!mance 5anagement !adio En&i!onment Statistics:USE 7ES,PTON 14FD1@@=S7 141 42D@ Uen 0

Measurement Condition$79 .ualit/ shall be measu!ed in all th!ee '=) 5ilestones 'P!e9aunch% 9aunch and Post 9aunch)

This KP shall be measu!ed at 1? 09E ope!ating point set in UTAN fo! &oice call"

09E shall be a&ailable using counte!s $ith ,ell 9e&el g!anula!it/" KP fo! 5S= shall be calculatedat 5a!(et 9e&el" *o! 5S=% 79 09E shall be measu!ed using ES counte!s o! d!i&e test as!e.ui!ed"

79 09E is !epo!ted b/ the mobile acco!ding to =PP specification" 5easu!ement !epo!ts a!ecollected and p!esented in the 5+ featu!e in OSS," epo!ting pe!iod can be set to bet$een2 to F3 seconds acco!ding to standa!d" ,ounte!s a!e p!esented in a P7* fo!mat in 5+" n 2seconds the!e a!e 144 bloc(s"

esolution fo! the P7* is 4"@?" Note that using &e!/ sho!t sampling inte!&als fo! 09E

measu!ements $ill !esult in lo$ accu!ac/ fo! each sample"

Table 9t%*ercentile ofsam*les 5 .(6 7

3L#+

>9t%*ercentile ofsam*les 5 .(6 7

3L#+


3L#+

1= of 34


14/40

KPI PreLaunc% Launc% Post Launc%

CS4 :uality ,UL- >9t%*ercentile ofsam*les 5 .(6 7

3L#+


3L#+


3L#+

3.1.6 ,S< ,ell ,apacit/

#uation =$ CS4 Cell Ca*acity ,Counter 2ormula-

llA&,R30erCarR3A&,0ower0e

c0owerCell+ra##iacitCSVCellCap

'=

nel0owerCommonChanabilitDl0owerCapc0owerCell+ra##i =*?ch0owerprimarCpinel0owerCommonChan '".2

=

=

+=

74

74

;$ Cell Ca*acity 'efinition


CSV CellCapacity A&e!age numbe! of


15/40

PreLaunc% Launc% PostLaunc% Units

? 86 ,*rovided it isac%ieved in +2

desi!n-

? 86 ,*rovided it isac%ieved in +2

desi!n-

? Measure andre*ort

@ of 0M+1.(. U#As


,S< ,ell ,apacit/ shall be calculated based on a&e!age 79 po$e! allocated to A5 12"2 0 fo! this KP"The $hole of ,luste!D5a!(et d!i&e data shall be used to calculate this KP"

3.1.7 ,S< SoftDSofte! ando&e! O&e!head

SoftDSofte! ando&e! O&e!head KP p!o&ides an indication of ho$ man/ ,ells o! Secto!s $e!e in the

acti&e set du!ing the call on an a&e!age basis"

#uation 16$ SoftBSofter andover "ver%ead ,Counter 2ormula-

=

== 6

AS

6

AS

ASDuration

ASDurationAS

erhead%ando&er'&So#tSo#ter

1

1

#$

#$'

.-S5-U%+A/(S%((03R,4R,I.-S5-U%W+A/(S%((03R,3R,I.-S5-U%W

.-S5-U%+A/(S%((02R,3R,I.-S5-U%W+A/(S%((02R,2R,I.-S5-U%W

.-S5-U%W+A/(S%((01R,2R,I.-S5-U%WI+A/(S%((01R,1R,$.-S5-U%W

.-S5-U+A/(S%((03R,4R,I.-S5-U%WI+A/(S%((02R,4R,$.-S5-U%W'4

.-S5-U%+A/(S%((02R,3R,I.-S5-U%WI+A/(S%((01R,3R,$.-S5-U%W'3

.-S5-U%I+A/(S%((01R,2R,$.-S5-U%W'2I+A/(S%((01R,1R,$.-S5-U%W

+++

+++

++

+++

+++

++

=erhead%ando&er'&So#tSo#ter

The counte!s fo! this KP measu!es not onl/ ,S< SoftDSofte! ando&e! O&e!head fo! all ,Sconnections but also fo! PS connections"


The counte!s ha&e a sampling !ate of 1 minute and the counte!s should be agg!egated o&e! a sufficientl/

long pe!iod fo! statistical &alidit/"

Table 11$ SoftBSofter andover "ver%ead definition


5aximum Acti&e Set si6e as defined in N,

AS Acti&e Set si6e

uration(AS) 7u!ation of the call in Acti&e Set si6e of AS 'ASI1 to 5)

#uation 11$ SoftBSofter andover "ver%ead ,'rive Test 2ormula-

1@ of 34


16/40

=

==6

AS

6

AS

ASDuration

ASDurationAS

%ando&erSo#tSo#ter

1

1

#$

#$'

Table 1.$ SoftBSofter andover "ver%ead KPI


5 1(; 5 1(; 5 1($ CS' 'ro* +ate KPI


5 .(9 7 5 .(9 7 5 /(6 7 ,Usin! Counter met%od-

5 .(9 7 ,Usin! 'rive Test met%od-

/(1(1. ,S7 ualit/

This e.uation is simila! to that of ,S


22/40

79 09E is !epo!ted b/ the mobile acco!ding to =PP specification" 5easu!ement !epo!ts a!ecollected and p!esented in the 5+ featu!e in OSS," epo!ting pe!iod can be set to bet$een2 to F3 seconds acco!ding to standa!d" ,ounte!s a!e p!esented in a P7* fo!mat in 5+" n 2seconds the!e a!e 144 bloc(s"

esolution fo! the P7* is 4"@?" Note that using &e!/ sho!t sampling inte!&als fo! 09Emeasu!ements $ill !esult in lo$ accu!ac/ fo! each sample"

,P fo! ES is found unde! AN Pe!fo!mance 5anagement !adio En&i!onment Statistics


79 .ualit/ shall be measu!ed in all th!ee '=) 5ilestones 'P!e9aunch% 9aunch and Post 9aunch $ithoptional featu!e fo! UE to !epo!t 79 09E measu!ement)

09E shall be a&ailable using counte!s $ith ,ell 9e&el g!anula!it/" KPs at 5S= shall be calculated

at 5a!(et 9e&el"

Table .6$ CS' :uality Terms 'efinition


#FaultyTransportBlocks2nplinkA!terSelectionCombining(CS)

Numbe! of fault/ Uplin( 7, t!anspo!t bloc(s fo! ,S7afte! selection and combining" Sampling pe!iod shall bee&e!/ ten '14) seconds

#TotalTransportBlocks2nplinkA!terSelectionCombining(CS)

Total numbe! of Uplin( 7, t!anspo!t bloc(s fo! ,S7afte! selection and combining" Sampling pe!iod shall bee&e!/ ten '14) seconds "

#FaultyTransportBlocks2no$nlinkA!terCombining(CS)

Numbe! of fault/ 7o$nlin( 7, t!anspo!t bloc(s fo!,S7 afte! combining" Sampling pe!iod shall be e&e!/ten '14) seconds

#TotalTransportBlocks2no$nlinkA!terCombining(CS)

Total numbe! of 7o$nlin( 7, t!anspo!t bloc(s fo!,S7 afte! combining" Sampling pe!iod shall be e&e!/ten '14) seconds

#uation .1$ CS' :uality 'L ,'rive Test 2ormula-

=

CallsCSD

CallsCSD

plesAll83ERSam

etow83ER+Samples8el

D3CSDQualit

8

8

*)>

'1


79 .ualit/ shall be measu!ed in all th!ee '=) 5ilestones 'P!e9aunch% 9aunch and Post 9aunch)

Table .1$ CS' :uality KPI


CS' :uality,'L-

>9t%*ercentile ofsam*les 5 17 3L#+

>9t%*ercentile ofsam*les 517 3L#+


CS' :uality,UL-




This KP $ill be measu!ed at 4"= ? 09E ope!ating point set in UTAN fo! ,S


23/40

n case of multiple , connection !e.uests the fi!st , connection !e.uest $ill be ta(en intoaccount fo! KP calculation"

#uation ..$ Mobile to Mobile 4ideo call ,'rive Test 2ormula-

Vi-eo Call setup time . CC/Alerting (0C) 1 RRC Connection Request (0C)

Table ..$ CS' Call Setu* time KPI

Parameter PreLaunc% Launc%

4ideo Call Setu* time N(0 >9t%*ercentile 5 > seconds

Selle! ag!ees to the B@thpe!centile and B seconds p!o&ided the impact of non UTAN E.uipment is $ithin

the indust!/ t/pical &alue !ange"

Packet Switc%ed Level1 Key Performance Indicators

BB 79 A0 allo$ed: =83 (bps%128 (bps% and F3 (bps% onl/BB U9 A0 allo$ed: =83 (bps% F3 (bps onl/

S7PA 79 S7S, allo$ed: UE ,at 12 '1844 (bps)SUPA U9 allo$ed: UE ,at = '1"3@4 5bps)

/(1(18 Pac(et S$itched ,all Setup

*igu!e 3 is a flo$ diag!am fo! a PS call" f a p!oblem occu!s bet$een , ,onnection e.uest'step 1) and the A0 Assignment esponse 'step 2G)% the !esult is conside!ed Access *ailu!e" An/A0 abno!mal !elease afte! the A0 Assignment esponse is conside!ed a call 7!op"

2= of 34


24/40

2i!ure 8$ Packet Switc%ed Setu* 2low 'ia!ram

/(1(19 PS7 Access *ailu!e

The aim is to measu!e Pac(et S$itch 7ata access failu!e f!om a use! pe!specti&e"

#uation ./$ PS' 0ccess 2ailure +ate ,Counter 2ormula-

144H

#$R%&

#$R%&'

&

&'

R%&

&1

0SD7uestentRA8Assi,nm

0SDsponseentRA8Assi,nm

SR8Attempt

SR8Success

7uestConnectionRRC

CompleteConnectionRRC

The follo$ing fo!mula includes Pac(et nte!acti&e and Pac(et 0ac(g!ound" Please !efe! to Section Fof the ,P document Use! 7esc!iption ,onnection andling 3D1@@=S7 141 42D@ Uen"

23 of 34


25/40

144H

ishSueRA8Establ)nteracti&R!!'!!!3.'

,,#P$U()*+C%C4++%/(R%7-T4(N4R)/

*+C%,,#PS5//$U()C4++%/(R%7-T4(N4R)/1

R!!I+(%)*/(B%RAE(*,0S5//%R*(% %5*,

+C%,,#8F,4$U()*HS28H*)HO-

.(P*/=%*,30A((%.N4R*E3(-#$U()*+C%,,+(%)*/(B%.(P*/=%(I*,30A((%.N4R*E3(

%33P*/=%*,30S5//.N4R*E3(-#$U()*+C%,,+(%)*/(B%%33P*/=%(I*,30S5//.N4R*E3(

*+

HS28H*)HO8F,$U()*+C%,,# O5(>+>HH*)HA((%($U()*+C%,,#

NHH*)HR%(5)+O,C0S5)/%$U()*+C%,,# I+/+HH*)HA((%($U()*+C%,,#


*o! an inte!im solution% it shall be defined as a d!op !ate of 2? o&e! an a&e!age call length of B4

seconds% the p!obabilit/ of d!opping the S0 du!ing the di!ect t!ansfe! phase is =sDB4sH2?I 4"4G?"f du!ing the deplo/ment fault !ates highe! than 4"1? a!e obse!&ed% selle! shall de&elop counte!s inPG"


0oth nte!acti&e and 0ac(g!ound t!affic a!e included in the counte! based fo!mula abo&e"

Table ./$ PS' 0ccess 2ailure Term 'efinition


#RRCConnectionComplete The numbe! of successful , ,onnectionSetups $ith PS7 Establishment ,auses 'botho!iginating and te!minating)"

#RRCConnectionRequest The numbe! , ,onnection e.uest5essages !ecei&ed $ith PS7 Establishment,auses 'both o!iginating and te!minating)"

#RABAssignmentResponse (%S) The numbe! of ANAP: A0 Assignmentesponse messages sent f!om the N, tothe SSN PS se!&ice"

#RABAssignmentRequest(%S) The numbe! of ANAP: A0 Assignmente.uest messages sent f!om the SSN tothe N, to establish PS Se!&ice"

#SRBAttempt The numbe! of , ,onnection ,ompletesthat $ill lead to an nitial 7i!ect T!ansfe! to

the PS domain and $ill also lead to a PS'BB) A0 Assignment e.uest"

#SRBSuccess The numbe! of PS BB A0 Assignmente.uests"

#uation .8$ PS' 0ccess 2ailure +ate ,'rive Test 2ormula-

2@ of 34


26/40

=

Calls0SD

Calls0SD

7uestConnectionRRC

0D0

ateFailure R0SD Access

8

8

R%

A//%.(C+(%?(A/(B*(%

1'1


Access *ailu!e ate shall be measu!ed b/ data session acti&ation 'PS) follo$ed b/ do$nload" n case ofmultiple , connection !e.uests the fi!st , connection !e.uest $ill be conside!ed fo! KP calculation"

Table .8$ PS' 0ccess 2ailure +ate KPI


5 .(6 7 5 .(6 7 5 .(6 7

3.1.16 PS7 7!op

Pac(et session is conside!ed as d!opped $hen associated A0 has been !eleased abno!mall/ b/eithe! UTAN o! ,N" An/ d!op afte! ANAP: A0 Assignment esponse is conside!ed as PS d!opcall"

#uation .9$ PS' 'ro* +ate ,Counter 2ormula-

144H#$&

#$&

0SDmpleteRA8SetupCo

0SDRA8Drop

144H

+(%)*/(B%%P*/=%(I*,0S5//N4R*E(

P*/=%(R*R%,%*%N4S:(%

The fo!mula abo&e calculates d!op !ate fo! Pac(et nte!acti&e and Pac(et 0ac(g!ound 'including S7PA)"


T!affic classes 0ac(g!ound% and nte!acti&e 'both o!iginating and te!minating) shall be conside!ed in

counte!based met!ics" Table .9$ PS' 'ro* Term 'efinition


#RABSetupComplete The numbe! of completed A0 setup phasefo! PS 7ata% $hen the N, sends ANAP:A0 Assignment esponses to ,o!e Net$o!(afte! a successful A0 establishment

#RABrop The numbe! of A0 7!op fo! PS data calls

#uation .;$ PS' 'ro* +ate ,'rive Test 2ormula-

=

#tpSession

#tpSession

uccessCallSetupS

dSuccess#tpDownloa

pRate0SDCallDro 1'1


PS7 d!op ate shall be measu!ed afte! sta!t of ftp do$nload " PS7 call is conside!ed as d!opped$hen ftp session is manuall/Dabno!mall/ disconnected $ithout completing file t!ansfe! due to an/!eason"

2F of 34


27/40

Table .;$ $ PS' 'ro* +ate KPI


5 .(9 7 5 .(67 5 .(6 7

/(1(1< PS7 9atenc/

The follo$ing is ext!acted f!om =PP Specification 2="14G% Section F"3"="1 fo! !efe!ence:

Transfer delay ,ms-

'efinition: ndicates maximum dela/ fo! B@thpe!centile of the dist!ibution of dela/ fo! all deli&e!edS7Us du!ing the lifetime of a bea!e! se!&ice% $he!e dela/ fo! an S7U is defined as the time f!om a!e.uest to t!ansfe! an S7U at one SAP to its deli&e!/ at the othe! SAP"

N"T# /$ T!ansfe! dela/ of an a!bit!a!/ S7U is not meaningful fo! a bu!st/ sou!ce% since the lastS7Us of a bu!st ma/ ha&e long dela/ due to .ueuing% $he!eas the meaningful !esponse dela/pe!cei&ed b/ the use! is the dela/ of the fi!st S7U of the bu!st"

Table .9t%*ercentile 5 .66 ms +>> +03 ,;8 Kb*s or 1.= Kb*s or /=8 Kb*s-

Selle! ag!ees to the B@thpe!centile and the 244ms p!o&ided the impact of non UTAN E.uipment is $ithin


/(1(1= PS7 Th!oughput

Total numbe! of 9, bloc(s sent o&e! the obse!&ation $indo$ including !et!ansmission pe!t!anspo!t t/pe"

#uation .


28/40


This met!ic shall be measu!ed onl/ fo! Pac(et S$itch T!affic ,lass 'nte!acti&e and 0ac(g!ound)"

KP 5easu!ement shall be based on 9, 'S7U) la/e! th!oughput $ith fi&e pe!cent '@?) ta!get fo!

79DU9 09E fo! BB A0"

Table .>$ PS' 0vera!e T%rou!%*ut Term 'efinition


A/R'C/S/ata(kb) Total A5 9, S7Us '(b) t!ansfe!!ed excluding !et!ansmission in the do$nlin( o! uplin(

lserT"roug"put 7o$nlin( A&e!age Pac(et data th!oughput '(bps)

A/R'C/S/uration The total 9, S7U t!ansmission du!ation in seconds" *o!79DU9% this excludes the pe!iod $hen the 79DU9t!ansmission buffe! fo! the 9, entit/ is empt/

#uation .=$ PS' 0vera!e T%rou!%*ut ,'rive Test 2ormula-

=

Call0SD

Call0SD

ationSessionDur

1bans#erred4serData+r

1bpsu,hput0SDA&,+hro

8

8

$%/#

#$

#$

*o!mula is &alid fo! uplin( and do$nlin("


KP 5easu!ement shall be fo! application la/e! th!oughput $ith fi&epe!cent '@?) ta!get 79DU9

09E ope!ating point fo! BB A0" Th!oughput shall be calculated using data f!om the enti!e

,luste!D 5a!(et d!i&e test fo! 5ilestone 1 and 5ilestone 2"

The do$nloadDupload file shall be comp!essed t/pe"

Table /6$ PS' 0vera!e T%rou!%*ut 'efinition


serataTrans!erre-(kb) *TP do$nload in (ilobit du!ing one session"

Sessionuration(sec) Time du!ation 'seconds) to do$nloadDupload a file"

%S/T"roug"put(kbps) Pac(et data th!oughput in (bps using BB A0measu!ed at application la/e!"

Table /1$ PS' 0vera!e 'L T%rou!%*ut KPI


0vera!e 'L t%rou!%*ut

,Unloaded- kb*s

? .86 ? .86 ? 196 ,Counter-

? .86 ,'rive Test-

0vera!e 'L T%rou!%*ut

,Loaded- kb*s

? .16 ? .16 ? 196 ,Counter-

? .16 ,'rive Test-

Table /.$ PS' 0vera!e UL T%rou!%*ut KPI

28 of 34


29/40


0vera!e UL t%rou!%*ut

,Unloaded- kb*s

? .66 ? .66 ? 196 ,Counter-

? .66 ,'rive Test-

0vera!e UL T%rou!%*ut

,Loaded- kb*s

? 1=6 ? 1=6 ? 196 ,Counter-

? 1=6 ,'rive Test-


KP 5easu!ement shall be fo! application la/e! th!oughput $ith fi&epe!cent '@?) 09E ope!ating

point fo! both U9 and 79" Th!oughput shall be calculated using data f!om the enti!e ,luste!D 5a!(et

d!i&e test fo! 5ilestone 1 and 5ilestone 2 using all a&ailable BB adio 0ea!e!"

Table //$ PS' 0vera!e T%rou!%*ut 'efinition


serataTrans!erre-(kb) Total ftp si6e do$nload in (ilobit in one session

Sessionuration(sec) Total time 'seconds) du!ation to do$nload singlefileSession7u!ation'sec) I 'time stamp of Session End o!

Session E!!o! - time stamp of Session Sta!t)%SA&gT"roug"put Pac(et S$itched 7ata a&e!age th!oughput using BB A0

measu!ed at application la/e!

/(1(1> PS7 ,all Setup Time

PS7 call setup time indicates Net$o!( !esponse time to a use! !e.uest fo! a pac(et data se!&ice" ncase of multiple , connection !e.uests the fi!st , connection !e.uest $ill be conside!ed fo!KP calculation"

#uation .>$ PS' Call Setu* Time ,'rive Test 2ormula-

%S Call setup time . %% Conte3t Acti&ation accept (0C) 4 RRC Connection Request (0C)

Measurement Condition$The UE is al!ead/ attached to the UTAN net$o!("

Table /8$ PS' Call Setu* time KPI

KPI PreLaunc% 0t Launc% Post Launc%

PS' Session0ctivation time

N(0 >9t%*ercentilesessions 5 9

seconds

N(0

Selle! ag!ees to the B@thpe!centile and the @ seconds p!o&ided the impact of nonUTAN E.uipment is

$ithin the indust!/ t/pical &alue !ange"

3.1.20 PS7 nte!adio Access Technolog/ ando&e! *ailu!ente!adio Access Technolog/ 'AT) is a ha!d hando&e! bet$een U5TS and S5"

*o! Pac(et S$itched hando&e!% the N, sends a ,ell ,hange O!de! f!om UTAN command to theUE" A successful hando&e! can be monito!ed b/ the N, u elease message f!om the ,N"

#uation /6$ PS' I+0T 2ailure +ate ,counter formula-

d+RA5Comman'rderFrom4CellChan,e

e+RA5Failur'rderFrom4CellChan,eterFailureRa90S%ando&e9

&

&'16623 =

2B of 34


30/40

pmNoOut!at,cetu!nOld,h is inc!eased $hen the ,E99 ,ANE O7E *O5 UTAN*A9UE ',) message is !ecei&ed f!om the UE"pmNoOut!at,cAtt is inc!eased $hen the ,E99 ,ANE O7E *O5 UTAN ',) messagehas been sent to the UE"

R%,*(4+#(C/A(($GN4O5(I)*

,*(4+#,C0$GR%(C/R%(5)+ON4O5(I)*'16623 =terFailureRa90S%ando&e9


PS7 AT O failu!e KP does not include O P!epa!ation failu!e"

n o!de! to &e!if/ PS7 AT O pe!fo!mance% some p!e!e.uisites ha&e to be fulfilled such as: definition of

AT st!ateg/% setting up se!&ices p!io!ities" 0oth = and 2 Net$o!(s shall ha&e AT neighbo!s defined"

The S5 Net$o!( shall ha&e a&ailable !esou!ces $ithout sho$ing congestion" 5utuall/ ag!eed test UE

'$ith the latest a&ailable Soft$a!e% *i!m$a!e and E.uipment) shall be used fo! the AT KP &e!ification"

The 2 and = Net$o!(s shall be p!ope!l/ configu!ed in acco!dance $ith Pu!chase!#s Net$o!( design

including the definition of the !outing tables th!ough the ,o!e Net$o!(" PU,ASE shall info!m Selle!

about maJo! changes in the configu!ation of the S5 Net$o!( 'f!e.uenc/ !eplan% ,ell pa!amete!

changes% etc) that $ill deg!ade the = AT pe!fo!mance . Selle! ma/ !e&ie$ Pu!chase!#s S5 Net$o!(

changesDplanned acti&ities befo!e% du!ing o! afte! AT KP &e!ification d!i&e"

Table /9$ PS' I+0T 2ailure Term 'efinition


*+*%S,an-o&erFailureRate a!d ando&e! failu!e !ate $hen a PS 7ata call'BB) fail to hando&e! f!om U5TS net$o!( toS5 net$o!(

#CellC"ange0r-erFromTRAN Failure(%S) ,: The numbe! of ,ell ,hange O!de! f!omUTAN *ailu!e messages f!om UE to N,

#CellC"ange0r-erFromTRAN Comman-(%S) ,: The numbe! of ,ell ,hange O!de!5essages f!om N, to UE

#uation /1$ PS' I+0T 2ailure +ate ,'rive Test 2ormula-

=

Call0SD

Call0SD

R5Cd+RA5Comman'rderFrom4CellChan,e

4Ee+RA5Failur'rderFrom4CellChan,e

90S%%'9

8

8

8

8

'1%F*,5)%R*(23

,,ell,hangeO!de!*!omUTAN*ailu!eLUE message is sent b/ UE",,ell,hangeO!de!*!omUTAN,ommandLN, message is sent b/ N,"


PS7 AT O failu!e KP does not include O P!epa!ation failu!e" Specific d!i&e !oute shall beidentified at the U5TS * Se!&ice A!ea bounda!/ to &e!if/ this KP"

Table /;$ PS' I+0T 2ailure +ate KPI


NB0 5 9(6 7 5 9(6 7

3.1.21 PS7 AT nte!!uption time

=4 of 34


31/40

This KP is an indicato! of inte!!uption time fo! the pac(et s$itch data du!ing nte!adio Access

Technolog/ ha!d hando&e!"

#uation /.$ PS' I+0T Interru*tion time ,'rive Test 2ormula-

%S/2RAT2nterruptionTime . (TimeRAp-ateComplete/5 1 TimeCellC"ange0r-er/RNC)

#uation //$ PS' I+0T User 'ata Interru*tion time ,'rive Test 2ormula-

%S/2RATserata2nterruptionTime . (TimeFirst%acketataRecei&e-2n+* 1Time'ast%acketataRecei&e-2n*)


This KP is applicable fo! dedicated d!i&e test !oute on =2 * se!&ice bo!de! a!ea du!ing 5a!(etAcceptance"

The inte!!uption time shall be measu!ed du!ing = to 2 PS7 O"

Table /


32/40

This test shall be done $ith a single UE doing S7PA call in the ,ell unde! test $ith =83DF3 Kbpsassociated 7, on the uplin("

#uation /8$ S'P0 0ccess 2ailure +ate ,Counter 2ormula-

144H

$R%&

$&'

&

&'

R%&

&1

DSC%%S7uestentRA8Assi,nm

DSC%%SSuccessentRA8Assi,nm

SR8Attempt

SR8Success

7uestConnectionRRC

CompleteConnectionRRC

144H

,,#H$U()*+C%+(%)*/(2B%-(P*/=%(I*,20A((%-N4R*E(

,,#H$U()*+C%+(%)*/(2B%%P*/=%(I*,20S5//-N4R*E(

'!!!3.6',,#P$U()*+C%C4++%/(R%7-T4(N4R)/

*+C%,,#PS5//$U()C4++%/(R%7-T4(N4R)/

1


As an inte!im solution% it shall be defined as a d!op !ate of 2? o&e! an a&e!age call length of B4seconds% the p!obabilit/ of d!opping the S0 du!ing the di!ect t!ansfe! phase is =sDB4sH2?I 4"4G?"f du!ing the deplo/ment% fault !ates highe! than 4"1? a!e obse!&ed% selle! shall de&elop counte!s inPG"

Table 86$ S'P0 0ccess 2ailure Term 'efinition


#RRCConnectionComplete The numbe! of successful , ,onnectionSetups $ith Pac(et Establishment ,auses'both o!iginating and te!minating)"

#RRCConnectionRequest The numbe! , ,onnection e.uest5essages !ecei&ed $ith Pac(etEstablishment ,auses 'both o!iginating andte!minating)"

#RABAssignmentResponse (,S4SC,)

The numbe! of ANAP: A0 Assignmentesponse messages sent f!om the N, tothe SSN PS se!&ice"

#RABAssignmentRequest(,S4SC,) The numbe! of ANAP: A0 Assignment

e.uest messages sent f!om the SSN tothe N, to establish S7PA Se!&ice"

#SRBAttempt The numbe! of , ,onnection ,ompletesthat $ill lead to an nitial 7i!ect T!ansfe! tothe PS domain and $ill also lead to a S7PAA0 Assignment e.uest"

#SRBSuccess The numbe! of S7PA A0 Assignmente.uests

#uation /9$ S'P0 0ccess 2ailure +ate ,'rive Test 2ormula-

=2 of 34


33/40

=

Session%SD0A

Session%SD0A

7uestConnectionRRC

0D0

atessFailureR%SD0A Acce

8

8

R%

A//%(C4+(%?(A/(B*(%

1'1


n case of multiple , connection !e.uests the fi!st , connection !e.uest $ill be conside!ed fo!KP calculation"

Access *ailu!e ate shall be measu!ed b/ data session acti&ation 'S7PA) follo$ed b/ do$nload"

Table 81$ S'P0 0ccess 2ailure +ate KPI


5 .(6 7 5 .(6 7 5 .(6 7

/(1(./ S7PA 7!op

S7PA session is conside!ed as d!opped $hen associated S7S, has been !eleasedabno!mall/ b/ eithe! UTAN o! ,N" This test $ill be done $ith a single UE pe!fo!ming S7PA callin the ,ell unde! test $ith =83DF3 Kbps associated 7, on the uplin( and S7S, in the 79 $ithdo$ng!adeDupg!ade toDf!om BB A0"

#uation /;$ S'P0 'ro* +ate ,Counter 2ormula-

144H *(4+S5//%DSCH8A,,4/-HS&

,5)%%D5%T4F*DSCH8R%,%*-HS&

144H

++

+

#

%HI+(%)*/(B/%P*/=%((*,0S5/$.-NR*E

RR%,%*%H.-NS:(%-

ulchSuccessEpm4l4pswitEulnteracti&eess0ac1et)ablishSuccpm5oRabEst

schSuccess%pmDl4pswit

pmNoSstemR!Release"s: Numbe! of successful s/stem !eleases of pac(et A0s mapped onS7S, in the Se!&ing S7S, cell" The counte! is stepped fo! the Se!&ing S7S, cell atA0D0 combination t!ansition f!om PS nte!acti&e F3DS S7S, to S07, o! to dle modedue to the same !easons as fo! stepping the existing counte! pmNoS/stemabeleasePac(et"pmNoS/stemabeleasePac(et is onl/ inc!eased due to a ANAPu elease ,ommand o! A0

Assignment e.uest message $ith M!elease causeM I an/thing except No!mal elease%Successful elocation% esou!ce Optimisation elocation% Use! nacti&it/ o! !eleaseduetoUEgene!ated signallingconnection!elease" This counte! is inc!emented fo! the best cell in the Acti&e

Set in the SN, and $hen !eleasing a S A0% this counte! is stepped fo! the Se!&ing S7,cell"

pmNoRa!#sta!lis$S%ccessPacketInteractive"s: The numbe! of successful A0 establishmentsfo! PS nte!acti&e A0 mapped on S7S," The counte! is stepped fo! the selected Se!&ing S7S, cell at A0 establishment afte! the successfull/ t!ansition S07, to PS nte!acti&e F3DS S7S,"

pmDl&ps'itc$S%ccess"s( Numbe! of successful 79 ups$itches to an/ S state" The counte! isstepped fo! successful 79 ups$itch to a 0 combination containing S" The counte! is inc!ementedin all cells of the acti&e set"

== of 34


34/40

pmNoRa!#sta!lis$S%ccessPacketInteractive#%l( The numbe! of successful A0establishments fo! PS nte!acti&e A0 mapped on E7,DS7PA" ,ounte! is stepped fo! theSe!&ing E7, cell at successful A0D0 combination t!ansition to PS nte!acti&e E7,DS S7S, due to A0 establishment" The counte! is t!igge!ed afte! sending of A0 Assignmentesponse 'successful)"

pm&l&ps'itc$S%ccess#%l(Numbe! of successful ups$itches% t!igge!ed b/ U9 use! acti&it/% to a ta!get0 combination E7,DS7PA" Stepped fo! the ta!get cell" ,ounte! in ta!get cell is stepped at a

successful ups$itch t!igge!ed b/ U9 use! acti&it/"


The Selle! counte! based met!ics fo!mula shall be updated as ne$ functionalit/ is int!oduced in the

S/stem

Table 8.$ S'P0 'ro* Term 'efinition


,S4SC,/ReleaseueToFailure Numbe! of S7S, allocation !eleases due to !adiolin( and othe! failu!es

,S4SC,/AllocationSuccess Numbe! of allocations $hen the N, has !ecei&ed,: adio 0ea!e! e,onfigu!ation ,ompletemessage f!om the UE afte! successful S7S, 5A,d flo$ setup

#uation /;$ S'P0 'ro* +ate ,'rive Test 2ormula-

=

Call%SD0A

Call%SD0A

SuccessAllocationDSC%%SDropRate%SD0A

8

8

8

DSCH8D)4.-HS

'1668


S7PA 7!op ate shall be measu!ed b/ data session acti&ation 'S7PA) follo$ed b/ ftp do$nload

Table 8/$ S'P0 'ro* +ate KPI


5 /(6 7 5 .(6 7 5 .(6 7

/(1(.8 S7PA 9atenc/

Table 88$ S'P0 Latency Term 'efinition


,S%A 'atencyound t!ip time fo! a =2 0/tes ping fo! S7PANT A0


9atenc/ shall be measu!ed $ith the destination se!&e! fo! ping connected di!ectl/ to the SN 'i"e

the se!&e! on the same nt!anet domain as SN)" TT shall be measu!ed in a stationa!/ test" This

test shall be done $ith a single UE doing S7PA call in the ,ell unde! test"

Table 89$ S'P0 Latency KPI

=3 of 34


35/40

KPI Latency at Launc%

S'P0 Latency >9t%*ercentile sessions 5 166 ms

Selle! ag!ees to the B@thpe!centile and the 144ms p!o&ided the impact of non UTAN E.uipment is $ithin


3.1.2 S7PA Th!oughput

Total numbe! of 9, bloc(s sent o&e! the obse!&ation $indo$ including !et!ansmission"

#uation />$ S'P0 T%rou!%*ut ,Counter 2ormula-

=

Call%SD0A

Call%SD0A

Duration0D4R3CA6

1bData0D4R3CA6

+hrou,hput%SD0A

8

8

888

#$888

8

#R%$'2 rames7uiredSubF&epm5o)nactiSubFramespm5oActi&e

8itspmSumAc1edhrou,hput%SD0ACell+

+=

Key Performance IndicatorTerm

'efinition

A/R'C/%/ata(kb) Total A5 9, P7Us '(ilobit) t!ansfe!!ed excluding !et!ansmission in the uplin(

A/R'C/%/uration The total 9, P7U t!ansmission du!ation 'in seconds)

Table 8;$ S'P0 T%rou!%*ut Term 'efinition


'efinition

A/R'C/%/ata(kb) Total A5 9, P7Us '(ilobit) t!ansfe!!ed excluding !et!ansmission in the do$nlin( o! uplin(

A/R'C/%/uration The total 9, P7U t!ansmission du!ation 'in seconds)"*o! do$nlin( this du!ation excludes the pe!iod $hen thedo$nlin( t!ansmission buffe! fo! the 9, entit/ is empt/

#uation 86$ S'P0 T%rou!%*ut ,'rive Test 2ormula-

=

Call%SD0A

Call%SD0A

ationSessionDur


+hrou,hput%SD0A

8

8

$%/#

#$

8


5easu!ement shall be fo! Application 9a/e! bit !ate" The S7PA th!oughput is onl/ applicable $hen

the UE is on S7S,"

Table 8


36/40

PreLaunc% Launc% PostLaunc% 1=66 kb*s

,usin! U# cate!ory 1.-

? 1/66 ? 1/66 ? 1/66

,at +LC Layerusin! counter-

Under no load condition

? 1166 ? 1166 N(0 967 of 0vailable Power atSystem +eference Pointallocated to S'P0


UE shall be in Stationa!/ location unde! excellent * condition ',P, S,P C 84 d0m and

,P, EcDNo C 8 d0)"

The do$nload file shall be comp!essed t/pe"

5easu!ement shall be based on *TP file do$nload of minimum ten '14) 50 file to !educe the

impact of T,P slo$ sta!t"

5easu!ement shall be at application la/e! th!oughout the S7PA Se!&ice A!ea"

Table 8=$ 0vera!e 'L T%rou!%*ut ,kb*s- KPI

PreLaunc% Launc% PostLaunc% Usin! U# cate!ory 1.

1(= Mb*s

?


37/40

=

Session%S40A

Session%S40A

Duration0D4R3CA6

1bData0D4R3CA6

+hrou,hput%S40A

8

8

888

#$888

8

#16'16$ lmsFramesEupm5oActi&e

l8itsCellEupmSumAc1edhrou,hput%S40ACell+ =

pmSumAc(ed0its,ellEul: The numbe! of 5edia Access ,ont!ol Enhanced Uplin( 'Eul) bits!ecei&ed and ac(no$ledged b/ the 0S"

pmNoActi&e14ms*!amesEul: The numbe! of 14ms f!ames containing enhanced uplin( datat!ansmitted b/ the UE

Table 8>$ SUP0 T%rou!%*ut Term 'efinition


'efinition

A/R'C/%/ata(kb) Total A5 9, P7Us '(ilobit) t!ansfe!!ed excluding !et!ansmission in the uplin(

A/R'C/%/uration The total 9, P7U t!ansmission du!ation 'in seconds)"

#uation 86$ SUP0 T%rou!%*ut ,'rive Test 2ormula-

=

Session%S40A

Session%S40A

ationSessionDur


+hrou,hput%S40A

8

8

$%/#

#$

8


5easu!ement shall be at Application 9a/e! bit !ate" The upload file shall be comp!essed t/pe"

SUPA Se!&ice A!ea shall be same as PS7 F3( Se!&ice A!ea"

UE shall be in Stationa!/ location unde! excellent * condition ',P, S,P C 84 d0m and

,P, EcDNo C 8 d0)

Table 96$ SUP0 Stationary UL 3it +ate ,kb*s- KPI

PreLaunc% Launc% PostLaunc% U# Cate!ory / ,1(89 Mb*s-

? 1166 ? 1166 Measure and+e*ort

Stationary Peak T%rou!%*ut,kb*s- under no load

? 966 ? 966 Measure and

+e*ort

0vera!e T%rou!%*ut ,kb*s-

under no load

3.1.27 S7PA 7ata Session Setup Time

S7PA 7ata Session setup time indicates Net$o!( !esponse time to a use! !e.uest fo! an S7PAdata se!&ice"

#uation 81$ S'P0 session definition ,'rive Test 2ormula-

,S%A ata Session setup time . %% Conte3t Acti&ation accept (0C) 4 RRC ConnectionRequest (0C)


=G of 34


38/40

This test shall be done $ith a single UE pe!fo!ming S7PA call in the cell unde! test" The UE isal!ead/ attached to the UTAN Net$o!("

Table 91$ S'P0 'ata Session Setu* time KPI

KPI PreLaunc% Launc%

S'P0 Session 0ctivation time N(0 >9t%*ercentile sessions 59 seconds

Selle! ag!ees to the B@thpe!centile and the @ seconds p!o&ided the impact of non UTAN E.uipment is

$ithin the indust!/ t/pical &alue !ange"

System 0vailability

S/stem A&ailabilit/ is defined as the pe!centage of time the Net$o!( can handle one hund!ed pe!cent'144?) of the t!affic it is designed fo! as measu!ed at ,ell 9e&el"

The pu!pose of this met!ic is to calculate the total amount of time 'in pe!centage) out of the totalope!ating time the N, and Node0 a!e a&ailable to ca!!/ comme!cial t!affic" 5inimum g!anula!it/ fo!KP pu!poses is total loss of t!affic at ,ell le&el"

Selle! is !esponsible onl/ fo! the SubS/stem supplied to Pu!chase!: N, and Node0" This excludesAntenna S/stems% T!anspo!t S/stems% Po$e!D0atte!/ 0ac(up% nonSelle! ,o!e Net$o!("

The loss of t!affic at ,ell 9e&el can be due to one o! mo!e !easons:

1" E.uipment failu!es

2" Soft$a!e failu!es

=" Selle! o!iginated 'accidental% misuse% !eset etc")

3" Planned e&ents autho!i6ed b/ Selle! 'Soft$a!e upg!ade% E.uipment upg!ade% Pa!amete! changeetc)

*o! A&e!age ,ell A&ailabilit/% Selle! shall be !esponsible fo! se!&ice deg!adation due to 1% 2% = 'causedb/ Selle!#s pe!sonnel o! subcont!acto!s of Selle!) and 3"

*o! A&e!age ,ell Non5aintenance A&ailabilit/% Selle! shall be !esponsible fo! se!&ice deg!adation dueto 1% 2 and = 'caused b/ Selle!#s pe!sonnel o! subcont!acto!s of Selle!)"

The le&el of agg!egation fo! this met!ic is Pu!chase!#s enti!e U5TS Net$o!( fo! $hich Selle! hassupplied the E.uipment and Soft$a!e 'N, and Node0)" The ala!m agg!egation fo! this met!ics shallbe pe!fo!med on dail/ basis" S/stem A&ailabilit/ KP fo! Selle! shall be calculated on a /ea!l/ basis fo!the pu!pose of achie&ing KP ta!get sta!ting f!om the Net$o!( comme!cial 9aunch fo! N, and Node0E.uipment" Selle! shall p!o&ide all the necessa!/ ala!m details to assist Pu!chase! in !eali6ing S/stem

A&ailabilit/ KP mat!ices fo! the subS/stems supplied b/ Selle! 'N, and Node0)" Selle! shall!ecommend to Pu!chase! $hich ala!ms to use to measu!e these KPs"

7ail/ S/stem A&ailabilit/ shall be measu!ed as follo$s:

3.1.28 A&e!age ,ell A&ailabilit/

#uation /


39/40


TotalSectorCo%nt Total numbe! of acti&e Node0 ,ells $ithin N,

AvgCellAvaila!ilit A&e!age Node0 ,ells a&ailabilit/ to ca!!/ use! t!afficcalculated as a pe!centage of total time

Table 9/$ 0vera!e Cell 0vailability KPI

0vera!e Cell 0vailability KPI SubSystem +0N +elease

? >>(>9 ,>>(>(>9 ,>>(=- 7 +NC E Node3 P;

? >>(>9 ,>>(>- 7 +NCE Node3 P>(>9 ,F>>(>-7 +NCE Node3 ?P=

3.1.2! A&e!age ,ell Non5aintenance A&ailabilit/

#uation /=$ 0vera!e Cell NonMaintenance 0vailability 2ormula

R5C

R5C

rCount+otalSecto6in%rs

timeenanceDownon6a+otalCell5

'$%/#6'#$6'#$1@

$%/#+(

1'1

Table 98$ 0vera!e Cell NonMaintenance 0vailability Term 'efinition


TotalCellNon)aintenanceDo'ntime*sec+ Total du!ation 'in seconds) of Node0 ,ells $ithina N, not able to ca!!/ an/ t!affic du!ing no!malope!ation 'excluding planned e&ents) due to N,

and Node0 E.uipment !eason" The du!ation shallbe calculated $hen Ala!mDS/stem notificationclea!s minus $hen Ala!mDS/stem notificationt!igge!s"

TotalSectorCo%nt Total numbe! of acti&e Node0 ,ells $ithin N,

AvgCellNon)aintenanceAvaila!ilit A&e!age Node0 ,ells a&ailable calculated as ape!centage of a&ailable time at ,ell le&el

Table 99$ 0vera!e Cell NonMaintenance 0vailability KPI

0vera!e Cell NonMaintenance 0vailability KPI SubSystem +0N +elease

? >>(>>9 ,>>(>(>>9 ,>>(=- 7 +NC E Node3 P;

? >>(>>9 ,>>(>- 7 +NCE Node3 P>(>>9 ,F>>(>- 7 +NCE Node3 ?P=

Com*arison of UMTS and &SM Network Performance

Selle! shall collect some 2 measu!ements defined belo$ at the same time as = measu!ementsfo! all ,luste! Acceptance and all 5a!(et Acceptance d!i&es"

=B of 34


40/40

The 2 measu!ements collected b/ Selle! f!om a 2 te!minal in the &ehicle executing a p!edefinedcall se.uence a!e defined belo$:

a"

3G KPI Guidelines,UMTS,WCDMA

Documents

ed leaes e

ill limit e

alues hae e

ecommended b e

g kpi guidelines

icsson efe

illbe measu

conditions of measu