Post on 02-Jun-2018
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 1/41
Functionality / Feature Testing Scenario
2G layer does not employs priority based
reselection (legacy functionality)
Current strategy
(Prio: U900,F1,F2=4 ; F3=3 ; GSM=1)
CSFB from 4G to 2G
[UE is in IDLE]
CSFB from 4G to 3G
[UE is in IDLE]
Reselection from 2G/3G to 4G
2G layer employs priority based
reselection
CSFB from 4G to 3G
[UE is in Connected]
CSFB
CSFB from 4G to a "no coverage" layer
CSFB from 4G to 2G
[UE is in Connected]
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 2/41
Simplified strategy
(Prio: U900,F1=4 ; F3=3 ; GSM=1)
Intra endoB
Inter enodeB - over X2
Inter enodeB - over S1
Interoperability with NSN 2G and 3G underlay
CSFB from 4G to 3G
[UE is in IDLE]
CSFB from 4G to 2G
[UE is in IDLE]
CSFB from 4G to 3G
[UE is in Connected]
CSFB from 4G to 2G
[UE is in Connected]
Blind redirection
(current strategy)
Session Continuity with measurement
HO from 4G
HO in 4G
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 3/41
Reselection from 3G to 4G
Reselection from LTE to 2G/3G
define elements that need to be
extracted
extract the values from EE existingLondon logs
produce the comparing document
Ericsson possible bug
Abnormal UE behaviourEMM cause codes when rejecting or
accepting an attach request
UE Behaviour
ANR for LTE
ANR for LTE
SIB 2 Quarter & High number of UMFIs defined in 2G
Vodafone vs EE
Mobility Strategy
Reselection from 2G to 4G
OFF
ON
Efficient DRX/DTX for Connected UE
Automated Neighbor Relations
CSFB from 4G to 3G
[UE is in IDLE]
DMCR (3G)
Not in the initial configuration
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 4/41
PM-Initiated UE Measurements
RRC Connection Re-establishment
Interference Rejection Combining
Not in the initial configuration
Uplink Frequency-Selective Scheduling
Not in the initial configurationDownlink Frequency-Selective Scheduling
Not in the initial configuration
HO VF-TEF Inter-Vendor
Fast Return to LTE after Call Release (2G)
Not in the initial configuration
Release with Redirect to LTE (3G)
Not in the initial configuration
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 5/41
Test Case / Action What we measure
Success Rate
CSFB Time as perceived by the user
Success Rate
CSFB Time as perceived by the user
Success Rate
CSFB Time as perceived by the user
Success Rate
CSFB Time as perceived by the user
Success Rate
CSFB Time as perceived by the user
Success Rate
CSFB Time as perceived by the user
Success Rate
CSFB Time as perceived by the user
Success Rate
CSFB Time as perceived by the user
Success Rate
CSFB Time as perceived by the userSuccess Rate
CSFB Time as perceived by the user
Success Rate
CSFB Time as perceived by the user
Success Rate
CSFB Time as perceived by the user
Success Rate
CSFB Time as perceived by the user
Success Rate
CSFB Time as perceived by the user
Success Rate
CSFB Time as perceived by the user
2 step reselection: 2G to 4GTime to reselect 4G
Ration of 1 step
3 step reselection: 2G to 3G to 4G
Time to reselect 3G
Time to reselect 4G
Ratio of 2 stepts
3 step reselection: 2G to 3G to 4GTime to reselect 3G
Time to reselect 4G
IDLE while in mobilityUnderstand the functionality
Time to reselect 3G/2G
MO toward another UE in 4G
MO toward a land line (1700)
MO toward another UE in 4G
MO toward another UE in 4G
MO toward a land line (1700)
MT
MO toward a land line (1700)
MT
MO toward another UE in 4G
MO toward a land line (1700)
MT
MT
MO toward another UE in 4G
MO toward a land line (1700)
MT
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 6/41
IDLE while in mobility Time to reselect 3G/2G
Throughput
Packet lost
HO Success Rate
FTP and HTTP Download 100 MB file DL Throughput at low RSRP
FTP and HTTP Upload 50MB file UL Throughput at low RSRP
Ping Testing RTT at low RSRP
DL Throughput at low RSRP when
measuring 3G
DL Throughput in 3G after HO
HO Success Rate
UL Throughput at low RSRP when
measuring 3G
UL Throughput in 3G after HO
HO Success Rate
RTT at low RSRP when measuring 3G
RTT in 3G after HO
Success Rate
CSFB Time as perceived by the user
Success Rate
CSFB Time as perceived by the user
Success RateCSFB Time as perceived by the user
Success Rate
CSFB Time as perceived by the user
Success Rate
CSFB Time as perceived by the user
Success Rate
CSFB Time as perceived by the user
Success Rate
CSFB Time as perceived by the user
Success Rate
CSFB Time as perceived by the user
Success Rate
CSFB Time as perceived by the user
Success Rate
CSFB Time as perceived by the user
Success Rate
CSFB Time as perceived by the user
Success Rate
CSFB Time as perceived by the user
MO toward another UE in 4G
MO toward a land line (1700)
MT
MO toward a land line (1700)
MT
MO toward a land line (1700)
MT
MO toward another UE in 4G
MO toward a land line (1700)
MT
MO toward another UE in 4G
FTP and HTTP Download 50 MB file
FTP and HTTP Upload 30 MB file
Ping Testing
MO toward another UE in 4G
FTP and HTTP Download 50 MB file
FTP and HTTP Upload 30 MB file
Ping Testing
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 7/41
2G cell has the correct TAC defined
2G cell has a fake TAC defined
Time to reselect 4G
Time to reselect 3G/2G
For big UMFI list verify that all UMFIs are transmitted inthe SIB2Qs
Audit MME configuration regarding EMM codes
Map each code to the expected UE behaviour according
to 3GPP
Test the possible scenarios
Mitigate possible negative effects
Investigate available logs for any other negative UE
behaviour.
Web Browsing Loading Time
PING Testing RTT
Web Browsing Loading Time
PING Testing RTT
FTP and HTTP Download 100 MB file
FTP and HTTP Upload 50MB file
Ping Testing
IDLE while in mobility
FTP and HTTP Download 100 MB file
FTP and HTTP Upload 50MB file
Ping Testing
IDLE while in mobility
Success Rate
CSFB Time as perceived by the user
Success Rate
CSFB Time as perceived by the user
Success Rate
CSFB Time as perceived by the user
How the UE reacts. Does it wait to read al
or it will reselect 3G faster.
What is the behaviour of the UE with opti
around 21 UMFIs: 6 x 10687 (closed acce
10712 (co-site) + 3 x 2938 (co-site) + 3 x 1
neighbours)
Increase gradually the number of UMFIs
I noticed that some UMFIs a
HO Success Rate
Time to reselect 4G
MO toward another UE in 4G
MO toward a land line (1700)
MT
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 8/41
Time to reselect 4G
Success Rate
Time to reselect 4G
Success Rate
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 9/41
Details Testing protocol Date of DT
17.07.2013
18.07.2013Time to reselect 3G/2G will be measured:
- '
Time to reselect 4G will be measured between
the first 2G MIB and the first 4G MIB. Also we
will filter only the samples when the UE was in
dense repetitive measurement state and the
opposite.
Time to reselect 3G will be measured between
the first 2G MIB and the first 3G MIB
Protocol 1'!A1
11.07.2013
Success Rate will be measured as the number
of answered calls / number of attempted calls
(Drop call rate is out of the scope of this
testing since the call will proceed in the legacy
network)
CSFB time as perceived by the UE will be
measured between the following L3 messages:
- Extended Service Request in 4G
- CC-ALERTING
Protocol 2'!A1
11.07.2013
12.07.2013
11.07.2013
12.07.2013
Protocol 1'!A1 12.07.2013We will define the CSFB towards a fake
UARFCN to mimic a no coverage target.
Success Rate will be measured as the number
of answered calls / number of attempted calls
(Drop call rate is out of the scope of this
testing since the call will proceed in the legacy
network)
CSFB time as perceived by the UE will be
measured between the following L3 messages:
- Extended Service Request in 4G
- CC-ALERTING
Protocol 1'!A1
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 10/41
TBD
Success Rate will be measured as the number
of answered calls / number of attempted calls
(Drop call rate is out of the scope of this
testing since the call will proceed in the legacy
network)
CSFB time as perceived by the UE will be
measured between the following L3 messages:
- Extended Service Request in 4G
- CC-ALERTING
Protocol 2'!A1
Success Rate will be measured as the number
of answered calls / number of attempted calls
(Drop call rate is out of the scope of this
testing since the call will proceed in the legacynetwork)
CSFB time as perceived by the UE will be
measured between the following L3 messages:
- Extended Service Request in 4G
- CC-ALERTING
Protocol 1'!A1
19.07.2013
22.07.2013
- first MIB from 3G/2G
10.07.2013
Low RSRP: -115 … -120
Protocol 3'!A1
Protocol 3'!A1
Data Forwarding at Intra-LTE Handover &
Packet Forwarding at S1 Handover should
assure no packet loss at HO and good
throughput.
Will need to trace L3 and PCAP
Protocol 3'!A1 18.07.2013
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 11/41
ll SIBs and the last one (containing the EARFCN)
imat UMFI list. The optimal list should contain
ss femto) + 3 x 10687 (open access femto) + 3 x
0712 (first-neighbours) + 3 x 2938 (first-
re missing. To raise CSR to Ericsson
HO Success Rate
Protocol 1'!A1 and
Brett will help will reconfiguring in NSN
23.07.2013
24.07.2013
Success Rate will be measured as the number
of answered calls / number of attempted calls
(Drop call rate is out of the scope of this
testing since the call will proceed in the legacy
network)
25.07.2013
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 12/41
30.07.2013
31.07.2013
02.08.2013
06.08.2013
08.08.2013
26.07.2013
Protocol 1'!A1 29.07.2013
Protocol 1'!A1
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 13/41
Date of delivering results 10-Jul 11-Jul 12-Jul 13-Jul 14-Jul
19.07.2013
22.07.2013
15.07.2013
15.07.2013
16.07.2013
15.07.2013
16.07.2013
16.07.2013
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 14/41
TBD
23.07.2013
24.07.2013
12.07.2013
22.07.2013
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 15/41
12.07.2013
17.07.2013
19.07.2013
19.07.2013
19.07.2013
19.07.2013
25.07.2013
26.07.2013
29.07.2013
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 16/41
01.08.2013
02.08.2013
05.08.2013
08.08.2013
12.08.2013
30.07.2013
31.07.2013
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 17/41
15-Jul 16-Jul 17-Jul 18-Jul 19-Jul 20-Jul 21-Jul 22-Jul 23-Jul
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 18/41
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 19/41
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 20/41
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 21/41
24-Jul 25-Jul 26-Jul 27-Jul 28-Jul 29-Jul 30-Jul 31-Jul 1-Aug
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 22/41
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 23/41
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 24/41
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 25/41
2-Aug 3-Aug 4-Aug 5-Aug 6-Aug 7-Aug 8-Aug 9-Aug 10-Aug
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 26/41
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 27/41
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 28/41
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 29/41
11-Aug
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 30/41
Protocol
Device 1
Repeating sequence below Time Comment
IDLE Always waiting to be called
VOICE MT from Device 2 DEV state: most probable IDLE <<<<<<<<
TOTAL 80 seconds for each call
Mobility scenarios:
A) while moving (driving)
B) 10 minutes in each hot spot
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 31/41
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 32/41
Device 2
Repeating sequence below Time
IDLE 75 s
VOICE MO to Device 1 5 s
TOTAL 80 seconds for each call
Device 3
Repeating sequence below Time
IDLE 75 s
VOICE MO to land line (1700) 5 s
TOTAL 80 seconds for each call
Device 4
Repeating sequence below Time
IDLE
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 33/41
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 34/41
Comment
We start with 75 seconds to make sure that the UE has sufficient
time to reselect from 2G/3G to 4G. To be modified in future
DEV state: most probable IDLE
Comment
We start with 75 seconds to make sure that the UE has sufficient
time to reselect from 2G/3G to 4G. To be modified in future
DEV state: most probable IDLE
Comment
Always in IDLE reselecting between layers 4G/3G/2G
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 35/41
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 36/41
Protocol
Device 1
Repeating sequence below Time Comment
IDLE Always waiting to be called
VOICE MT from Device 2To make the UE switch from IDLE to
Connected<<<<<<<<
IDLE
VOICE MT from Device 2 DEV state: Connected <<<<<<<<
TOTAL 86 seconds for each call
Mobility scenarios:
A) while moving (driving)
B) 10 minutes in each hot spot
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 37/41
Device 2
Repeating sequence below Time
IDLE 75 s
SMS MO to Device 1 10 s
IDLE 1 s
VOICE MO to Device 1 5 s
TOTAL 86 seconds for each call
Device 3
Repeating sequence below Time
IDLE 75 s
FTP download 1MB 5 s
IDLE 1 s
VOICE MO to land line (1700) 5 s
TOTAL 86 seconds for each call
Device 4
Repeating sequence below TimeIDLE
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 38/41
Comment
We start with 75 seconds to make sure that the UE has sufficient
time to reselect from 2G/3G to 4G. To be modified in future
To make the UE switch from IDLE to Connected
DEV state: Connected
Comment
We start with 75 seconds to make sure that the UE has sufficient
time to reselect from 2G/3G to 4G. To be modified in future
To make the UE switch from IDLE to Connected
DEV state: Connected
CommentAlways in IDLE reselecting between layers 4G/3G/2G
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 39/41
Device 1 VDF
Repeating sequence below Time
IDLE 50 s
HTTP DL 50MB (speedtest server) timeout at 200 sIDLE 5 s
HTTP UL 30MB (speedtest server) timeout at 120 s
IDLE 5 s
30 x PING 32 bytes timeout at 30 s
TOTAL 6.83 minutes for each (in the worst case scenario)
A) while moving (driving) to hot spots
B) 10 minutes in each hot spot (low signal strength hot spots)
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 40/41
Device 2
Comment Repeating sequence below
To allow the UE to reselect the
4G IDLE
timeout assumes a minimum
throughput of a minimum 2Mbps FTP DL 50MB (rackspace server)IDLE
timeout assumes a minimum
throughput of a minimum 2Mbps FTP UL 30MB (rackspace server)
IDLE
pings sent to bbc.co.uk 30 x PING 32 bytes
TOTAL
8/10/2019 Testing Plan v1
http://slidepdf.com/reader/full/testing-plan-v1 41/41
VDF
Time Comment
50 s
To allow the UE to reselect the
4G
timeout at 200 s
timeout assumes a minimum
throughput of a minimum 2Mbps5 s
timeout at 120 s
timeout assumes a minimum
throughput of a minimum 2Mbps
5 s
timeout at 30 s pings sent to bbc.co.uk
6.83 minutes for each (in the worst case scenario)