Testing Plan v1

8/10/2019 Testing Plan v1

http://slidepdf.com/reader/full/testing-plan-v1 1/41

Functionality / Feature Testing Scenario

2G layer does not employs priority based

reselection (legacy functionality)

Current strategy

(Prio: U900,F1,F2=4 ; F3=3 ; GSM=1)

CSFB from 4G to 2G

[UE is in IDLE]

CSFB from 4G to 3G

[UE is in IDLE]

Reselection from 2G/3G to 4G

2G layer employs priority based

reselection

CSFB from 4G to 3G

[UE is in Connected]

CSFB

CSFB from 4G to a "no coverage" layer

CSFB from 4G to 2G




Simplified strategy

(Prio: U900,F1=4 ; F3=3 ; GSM=1)

Intra endoB

Inter enodeB - over X2

Inter enodeB - over S1

Interoperability with NSN 2G and 3G underlay

CSFB from 4G to 3G

[UE is in IDLE]

CSFB from 4G to 2G

[UE is in IDLE]

CSFB from 4G to 3G


CSFB from 4G to 2G


Blind redirection

(current strategy)

Session Continuity with measurement

HO from 4G

HO in 4G



Reselection from 3G to 4G

Reselection from LTE to 2G/3G

define elements that need to be

extracted

extract the values from EE existingLondon logs

produce the comparing document

Ericsson possible bug

Abnormal UE behaviourEMM cause codes when rejecting or

accepting an attach request

UE Behaviour

ANR for LTE

ANR for LTE

SIB 2 Quarter & High number of UMFIs defined in 2G

Vodafone vs EE

Mobility Strategy

Reselection from 2G to 4G

OFF

ON

Efficient DRX/DTX for Connected UE

Automated Neighbor Relations

CSFB from 4G to 3G

[UE is in IDLE]

DMCR (3G)

Not in the initial configuration



PM-Initiated UE Measurements

RRC Connection Re-establishment

Interference Rejection Combining


Uplink Frequency-Selective Scheduling

Not in the initial configurationDownlink Frequency-Selective Scheduling


HO VF-TEF Inter-Vendor

Fast Return to LTE after Call Release (2G)


Release with Redirect to LTE (3G)




Test Case / Action What we measure

Success Rate

CSFB Time as perceived by the user

Success Rate


Success Rate


Success Rate


Success Rate


Success Rate


Success Rate


Success Rate


Success Rate

CSFB Time as perceived by the userSuccess Rate


Success Rate


Success Rate


Success Rate


Success Rate


Success Rate


2 step reselection: 2G to 4GTime to reselect 4G

Ration of 1 step

3 step reselection: 2G to 3G to 4G

Time to reselect 3G

Time to reselect 4G

Ratio of 2 stepts

3 step reselection: 2G to 3G to 4GTime to reselect 3G

Time to reselect 4G

IDLE while in mobilityUnderstand the functionality

Time to reselect 3G/2G

MO toward another UE in 4G

MO toward a land line (1700)




MT


MT



MT

MT



MT



IDLE while in mobility Time to reselect 3G/2G

Throughput

Packet lost

HO Success Rate

FTP and HTTP Download 100 MB file DL Throughput at low RSRP

FTP and HTTP Upload 50MB file UL Throughput at low RSRP

Ping Testing RTT at low RSRP

DL Throughput at low RSRP when

measuring 3G

DL Throughput in 3G after HO

HO Success Rate

UL Throughput at low RSRP when

measuring 3G

UL Throughput in 3G after HO

HO Success Rate

RTT at low RSRP when measuring 3G

RTT in 3G after HO

Success Rate


Success Rate


Success RateCSFB Time as perceived by the user

Success Rate


Success Rate


Success Rate


Success Rate


Success Rate


Success Rate


Success Rate


Success Rate


Success Rate




MT


MT


MT



MT


FTP and HTTP Download 50 MB file

FTP and HTTP Upload 30 MB file

Ping Testing



FTP and HTTP Upload 30 MB file

Ping Testing



2G cell has the correct TAC defined

2G cell has a fake TAC defined

Time to reselect 4G

Time to reselect 3G/2G

For big UMFI list verify that all UMFIs are transmitted inthe SIB2Qs

Audit MME configuration regarding EMM codes

Map each code to the expected UE behaviour according

to 3GPP

Test the possible scenarios

Mitigate possible negative effects

Investigate available logs for any other negative UE

behaviour.

Web Browsing Loading Time

PING Testing RTT

Web Browsing Loading Time

PING Testing RTT


FTP and HTTP Upload 50MB file

Ping Testing

IDLE while in mobility


FTP and HTTP Upload 50MB file

Ping Testing

IDLE while in mobility

Success Rate


Success Rate


Success Rate


How the UE reacts. Does it wait to read al

or it will reselect 3G faster.

What is the behaviour of the UE with opti

around 21 UMFIs: 6 x 10687 (closed acce

10712 (co-site) + 3 x 2938 (co-site) + 3 x 1

neighbours)

Increase gradually the number of UMFIs

I noticed that some UMFIs a

HO Success Rate

Time to reselect 4G



MT



Time to reselect 4G

Success Rate

Time to reselect 4G

Success Rate



Details Testing protocol Date of DT

17.07.2013

18.07.2013Time to reselect 3G/2G will be measured:

- '

Time to reselect 4G will be measured between

the first 2G MIB and the first 4G MIB. Also we

will filter only the samples when the UE was in

dense repetitive measurement state and the

opposite.

Time to reselect 3G will be measured between

the first 2G MIB and the first 3G MIB

Protocol 1'!A1

11.07.2013

Success Rate will be measured as the number

of answered calls / number of attempted calls

(Drop call rate is out of the scope of this

testing since the call will proceed in the legacy

network)

CSFB time as perceived by the UE will be

measured between the following L3 messages:

- Extended Service Request in 4G

- CC-ALERTING

Protocol 2'!A1

11.07.2013

12.07.2013

11.07.2013

12.07.2013

Protocol 1'!A1 12.07.2013We will define the CSFB towards a fake

UARFCN to mimic a no coverage target.





network)




- CC-ALERTING

Protocol 1'!A1



TBD





network)




- CC-ALERTING

Protocol 2'!A1




testing since the call will proceed in the legacynetwork)




- CC-ALERTING

Protocol 1'!A1

19.07.2013

22.07.2013

- first MIB from 3G/2G

10.07.2013

Low RSRP: -115 … -120

Protocol 3'!A1

Protocol 3'!A1

Data Forwarding at Intra-LTE Handover &

Packet Forwarding at S1 Handover should

assure no packet loss at HO and good

throughput.

Will need to trace L3 and PCAP

Protocol 3'!A1 18.07.2013



ll SIBs and the last one (containing the EARFCN)

imat UMFI list. The optimal list should contain

ss femto) + 3 x 10687 (open access femto) + 3 x

0712 (first-neighbours) + 3 x 2938 (first-

re missing. To raise CSR to Ericsson

HO Success Rate

Protocol 1'!A1 and

Brett will help will reconfiguring in NSN

23.07.2013

24.07.2013





network)

25.07.2013



30.07.2013

31.07.2013

02.08.2013

06.08.2013

08.08.2013

26.07.2013

Protocol 1'!A1 29.07.2013

Protocol 1'!A1



Date of delivering results 10-Jul 11-Jul 12-Jul 13-Jul 14-Jul

19.07.2013

22.07.2013

15.07.2013

15.07.2013

16.07.2013

15.07.2013

16.07.2013

16.07.2013



TBD

23.07.2013

24.07.2013

12.07.2013

22.07.2013



12.07.2013

17.07.2013

19.07.2013

19.07.2013

19.07.2013

19.07.2013

25.07.2013

26.07.2013

29.07.2013



01.08.2013

02.08.2013

05.08.2013

08.08.2013

12.08.2013

30.07.2013

31.07.2013



15-Jul 16-Jul 17-Jul 18-Jul 19-Jul 20-Jul 21-Jul 22-Jul 23-Jul



24-Jul 25-Jul 26-Jul 27-Jul 28-Jul 29-Jul 30-Jul 31-Jul 1-Aug



2-Aug 3-Aug 4-Aug 5-Aug 6-Aug 7-Aug 8-Aug 9-Aug 10-Aug



11-Aug



Protocol

Device 1

Repeating sequence below Time Comment

IDLE Always waiting to be called

VOICE MT from Device 2 DEV state: most probable IDLE <<<<<<<<

TOTAL 80 seconds for each call

Mobility scenarios:

A) while moving (driving)

B) 10 minutes in each hot spot



Device 2

Repeating sequence below Time

IDLE 75 s

VOICE MO to Device 1 5 s


Device 3


IDLE 75 s

VOICE MO to land line (1700) 5 s


Device 4


IDLE



Comment

We start with 75 seconds to make sure that the UE has sufficient

time to reselect from 2G/3G to 4G. To be modified in future

DEV state: most probable IDLE

Comment



DEV state: most probable IDLE

Comment

Always in IDLE reselecting between layers 4G/3G/2G



Protocol

Device 1

Repeating sequence below Time Comment

IDLE Always waiting to be called

VOICE MT from Device 2To make the UE switch from IDLE to

Connected<<<<<<<<

IDLE

VOICE MT from Device 2 DEV state: Connected <<<<<<<<


Mobility scenarios:

A) while moving (driving)

B) 10 minutes in each hot spot



Device 2


IDLE 75 s

SMS MO to Device 1 10 s

IDLE 1 s

VOICE MO to Device 1 5 s


Device 3


IDLE 75 s

FTP download 1MB 5 s

IDLE 1 s

VOICE MO to land line (1700) 5 s


Device 4

Repeating sequence below TimeIDLE



Comment



To make the UE switch from IDLE to Connected

DEV state: Connected

Comment



To make the UE switch from IDLE to Connected

DEV state: Connected

CommentAlways in IDLE reselecting between layers 4G/3G/2G



Device 1 VDF


IDLE 50 s

HTTP DL 50MB (speedtest server) timeout at 200 sIDLE 5 s

HTTP UL 30MB (speedtest server) timeout at 120 s

IDLE 5 s

30 x PING 32 bytes timeout at 30 s

TOTAL 6.83 minutes for each (in the worst case scenario)

A) while moving (driving) to hot spots

B) 10 minutes in each hot spot (low signal strength hot spots)



Device 2

Comment Repeating sequence below

To allow the UE to reselect the

4G IDLE

timeout assumes a minimum

throughput of a minimum 2Mbps FTP DL 50MB (rackspace server)IDLE


throughput of a minimum 2Mbps FTP UL 30MB (rackspace server)

IDLE

pings sent to bbc.co.uk 30 x PING 32 bytes

TOTAL



VDF

Time Comment

50 s

To allow the UE to reselect the

4G

timeout at 200 s


throughput of a minimum 2Mbps5 s

timeout at 120 s


throughput of a minimum 2Mbps

5 s

timeout at 30 s pings sent to bbc.co.uk

6.83 minutes for each (in the worst case scenario)

Testing Plan v1

Documents

Transcript of Testing Plan v1