2019 January NORTH ZONE

INDEPENDENT DRIVE TEST REPORT

For

Agra2019

January

NORTH ZONE

Key Performance Indicators: All TSPs have met the Drop Call Rate (DCR)

benchmark of 2%. All TSPs have met the Call Setup Success Rate (CSSR) of

95%.

The Independent Drive Test has been carried out by M/s PhiMetrics Technologies Pvt. Ltd. on behalf of TRAI

in Agra City & adjoining areas from 9:00 AM to 9:00 PM; 8th January to 11th January 2019 . The drive test covered an

drive route of 447 KMs & 6 hotspot over a period of 4 days. Approximately 788 calls were made for each of the 12

networks: five 2G networks, five 3G networks and Two LTE network covering 6 unique TSPs

Data SummaryVoice SummaryOverview

Service Specifications

Download 2G (Locked) - 500KB, 3G (Dual) - 20 MB, 4G (Free) - 40 MB

Upload 2G (Locked) - 100KB, 3G (Dual) - 5 MB, 4G (Free) - 10 MB

Web Browsing 3 links of e/m commerce website www.amazon.in, www.flipkart.com and PayTm

Video Streaming 130 sec clip

Latency 32 Bytes on www.google.com

Overview:Telecom Regulatory Authority of India has been entrusted with the task of laying down the standards of quality of service to be provided by

the service providers and ensuring its enforcement; and also TRAI is responsible for conducting the periodical audit of such services

provided by the service providers so as to protect the interest of the consumers of telecommunications service

TRAI is regularly monitoring the performance of Telecom Service Providers (TSP) against the benchmarks for the various Quality of Service

(QoS) parameters laid down by the Authority. TSPs submit Performance Monitoring Reports to TRAI every quarter. TRAI also undertakes

audit and assessment of Quality of Service through independent agencies to verify the Quality of Service claimed. The Audit agencies

conduct sample ‘Drive tests’ across various cities in the country as part of audit and assessment of the TSPs’ performance.

In view of complaints on call drops and other network quality issues, on behalf of TRAI, an Independent Drive Test (IDT) was conducted by

PhiMetrics Technologies Pvt. Ltd. From 8th January to 11th January 2019 covering various locations in Agra City & surrounding region.

The performance of Airtel, BSNL, Idea, Tata, Vodafone and Jio were monitored across various technologies (2G, 3G, and 4G). The drive test

route was defined on the basis of several factors that include - areas from where call drop complaints are commonly received; areas of

heavy usage; residential areas away from arterial roads; office areas; areas where previous Drive tests showed network issues; etc.

The test results obtained from these drive tests were utilized to assess the network quality for Voice and Data services in terms of

Voice: Coverage, Quality, Handover Success Rate, Call Setup Success Rate, Drop Call Rate and Block Call Rate.

Data: Download and Upload Throughputs, Web Browsing Delay, Video Streaming Delay and Latency

Drive Test Details For Agra:

Independent Drive test was conducted for a period of 4 days from 8th January to 11th January 2019 in Agra city & surrounding areas from

9:00 AM to 9:00 PM. Calls were made for 90 sec duration with wait time of 10 sec between calls in all technologies.

Voice Tests: The drive test covered a drive route of approximately 447 KMs over a period of 3 days from 8th January to 10th January 2019 .

Approximately 788 calls were made for each of the 12 networks: five 2G (Lock Mode) networks, five 3G (Free mode) networks and two

VoLTE network covering 6 unique TSPs.* In case of multiple call failure in similar geo location in given period of 60secs has been counted as one call failure

Data Tests: Data Tests were performed at 6 static locations for 1 days on 11th January 2019 ; five 2G (Lock mode) networks, five 3G (Dual

mode) networks and Four 4G (Free mode) networks covering 6 unique TSPs were tested.* For Voice and Data KPI’s, 2G measurement is done with UE locked on 2G, 3G measurement is done with UE in Dual mode (2G & 3G) and 4G measurement is done with

UE in Free Mode.

* 3G KPI’s which are calculated from UE in Dual Mode (2G & 3G) includes samples and events of 2G.

* 4G KPI’s which are calculated from the UE in Free Mode included samples and events of 2G & 3G.

Overview Details

Overview

of 30

Voice Test Drive Route - Agra Data Service testing across 6 Static Locations

Blo

ck C

all

Ra

te (%

)

3G

Ne

two

rkV

oLT

E

2G

Ne

two

rk

QoS compliance of the TSPs in Agra for Voice across technologies 2G/3G/4G-VoLTE is given below:

Not meeting Benchmark

Voice CallsKey Observations

Voice Summary Page 3 of 30

Dro

p C

all

Ra

te (%

)

3G

Ne

two

rkV

oLT

E

2G

Ne

two

rk

a) All TSPs have met the 2% QOS benchmark of Drop Call Rate (DCR%).

b) Call Block Rate (CBR%) benchmark of 3% was achieved by all TSP’s except.

c) NA (Not Applicable ) in CSFB failure for those TSP ,doesn't have 4G technology.

KPI2G Networks

Airtel BSNL Idea Tata VodafoneSDCCH Congestion% 0.38% 0.13% 0.13% 0.52% 0.39%

TCH Congestion % 0.38% 0.00% 0.12% 0.00% 0.27%

KPI3G Networks

Airtel BSNL Idea Tata Vodafone

CSFB Failure % 0.00% NA 0.00% NA 0.14%

SDCCH Congestion% 0.00% 0.13% 0.00% 0.00% 0.00%

RRC Congestion% 0.41% 0.13% 1.06% 1.88% 0.14%

SDCCH & RRC Congestion% 0.41% 0.26% 1.06% 1.88% 0.14%

TCH Congestion % 0.00% 0.00% 0.00% 0.00% 0.00%

RAB Congestion % 0.27% 0.26% 0.13% 0.13% 0.54%

TCH & RAB Congestion % 0.27% 0.26% 0.13% 0.13% 0.54%

0.41

0.53

0.00

0.55

0.55

Airtel

BSNL

Idea

Tata

Vodafone

0.39

1.01

0.13

0.39

0.13

Airtel

BSNL

Idea

Tata

Vodafone

0.76

0.13

0.25

0.52

0.66

Airtel

BSNL

Idea

Tata

Vodafone

0.68

0.52

1.19

2.02

0.81

Airtel

BSNL

Idea

Tata

Vodafone

1.41

0.40

Airtel

Jio

0.13

0.00

Airtel

Jio

Benchmark

3%

Benchmark

2%

3%

Benchmark

2%

Benchmark

Voice Calls

a) Percentage of coverage samples for 2G ≥ -85 dBm.

b) Percentage of coverage samples for 2G ≥ -85 dBm, 3G ≥ -90 dBm & LTE ≥ -110 dBm.

c) Percentage of time spent on 3G network:

d) Percentage of RLT >=48:

e) Average CST Second

Coverage

TSPs2G


Coverage% 93.52% 93.14% 98.13% 88.09% 94.62%

Key Observations

Voice Summary Page 4 of 30

TSPs3G VoLTE

Airtel BSNL Idea Tata Vodafone Airtel Jio

Coverage % 94.87% 88.97% 96.56% 91.89% 89.89% 97.56% 97.22%

TSPs2G


%RLT >=48 0.00% 4.79% 0.00% 0.00% 0.00%

TSPs3G


Time Spent on 3G% 87.50% 62.47% 49.23% 69.73% 77.48%

TSPs2G


CST(sec) 2.71 2.65 2.59 2.74 2.37

TSPs

3G V0LTE


CST(sec) 5.84 2.64 2.85 3.57 2.99 1.55 0.49

Data

Services Static

Data Summary

Data Download and Upload Performance (Mbps)

Data was tested at 6 locations .Following services were tested: Data Download/Upload, Latency (www.google.com), Video

Streaming (YouTube) and Web browsing (Flipkart, Amazon, PayTm)

Key Observations

of 30

4G Network:

3G Network:

Download Throughput Upload Throughput

4.80

3.45

3.59

3.86

0.21

Airtel

BSNL

Idea

Tata

Vodafone

0.90

2.00

2.08

0.79

0.55

Latency (msec)

344

123

129

252

140

Airtel

BSNL

Idea

Tata

Vodafone

3G Network

Airtel

Idea

Jio

Vodafone


9.11

6.82

5.19

3.23

Airtel

Idea

Jio

Vodafone

4.20

8.33

4.68

3.93

93

97

239

88

4G Network

Streaming (sec)

Streaming Delay further broken into 2 parameters which form the end-user perception to assess consistency on Video

streaming.

• Initial Start time

• Interruption time while playing the video.

Web browsing experience is the average time taken to fully load the websites tested.

Video Streaming Performance (130 sec YouTube video sample sizes)

Video Streaming

Avg. Initial Start Time (sec)

Avg. Interruption Time (sec)

Web Page Download Time (sec)

Data

Services Static Key Observations

Data Summary of 30

3G 4G

Airtel BSNL Idea Tata Vodafone Airtel Idea Jio Vodafone

3.57 1.36 2.27 1.21 2.04 2.37 1.50 0.83 3.66

3.57

1.36

2.27

1.21

2.04

Airtel

BSNL

Idea

Tata

Vodafone

3G Network

15.76

9.59

9.12

13.92

17.49

Airtel

BSNL

Idea

Tata

Vodafone

3G Network

2.37

1.50

0.83

3.66

4G Network

Airtel

Idea

Jio

Vodafone

Airtel

Idea

Jio

Vodafone

7.38

7.79

5.84

10.77

4G Network

Data

Services Dynamic

Data Summary

Data Download and Upload Performance (Mbps)

Data was tested between one location to another location .Following services were tested: Data Download/Upload, Latency

(www.google.com), Video Streaming (YouTube) and Web browsing (Flipkart, Amazon, PayTm)

Key Observations

of 30

4G Network:

3G Network:


3.75

3.17

2.49

3.10

0.25

Airtel

BSNL

Idea

Tata

Vodafone

0.54

1.74

1.92

0.61

0.18

Latency (msec)

352

114

125

273

Airtel

BSNL

Idea

Tata

Vodafone

3G Network

Airtel

Idea

Jio

Vodafone


8.22

5.64

2.45

1.86

Airtel

Idea

Jio

Vodafone

6.10

8.02

3.34

3.15

108

99

287

93

4G Network

Streaming (sec)

Streaming Delay further broken into 2 parameters which form the end-user perception to assess consistency on Video

streaming.

• Initial Start time

• Interruption time while playing the video.

Web browsing experience is the average time taken to fully load the websites tested.

Video Streaming Performance (130 sec YouTube video sample sizes)

Video Streaming

Avg. Initial Start Time (sec)

Avg. Interruption Time (sec)

Web Page Download Time (sec)

Data

Services Dynamic Key Observations

Data Summary of 30

3G 4G


3.17 1.96 2.02 2.61 8.13 5.09 1.80 2.16 2.99

3.17

1.96

2.02

2.61

8.13

Airtel

BSNL

Idea

Tata

Vodafone

3G Network

14.87

11.39

10.68

16.42

17.50

Airtel

BSNL

Idea

Tata

Vodafone

3G Network

5.09

1.80

2.16

2.99

4G Network

Airtel

Idea

Jio

Vodafone

Airtel

Idea

Jio

Vodafone

9.66

8.54

8.38

12.40

4G Network

SummaryCity Level Summary

Summary Page 9 of 30

Voice Call2G


Call Attempt 785 790 790 770 762

Blocked Call Rate (%) 0.76% 0.13% 0.25% 0.52% 0.66%

CSSR% (Accessibility) 99.24% 99.87% 99.75% 99.48% 99.34%

Drop Call Rate (%) 0.39% 1.01% 0.13% 0.39% 0.13%

Mobility HOSR (%) 98.20% 92.13% 98.20% 98.52% 97.57%

Rx Quality (%) 97.13% 97.45% 97.00% 97.56% 98.10%

Voice Call3G VoLTE


Call Attempt 735 762 754 743 738 781 759

Blocked Call Rate (%) 0.68% 0.52% 1.19% 2.02% 0.81% 1.41% 0.40%

CSSR% (Accessibility) 99.32% 99.48% 98.81% 97.98% 99.19% 98.59% 99.60%

Drop Call Rate (%) 0.41% 0.53% 0.00% 0.55% 0.55% 0.13% 0.00%

Mobility HOSR (%) 99.94% 98.28% 99.71% 99.72% 99.81% 99.91% 99.29%

Rx Quality (%) 95.06% 97.10% 91.93% 95.73% 93.12% 84.34% 83.66%

Summary of 30

SummaryCity Level Summary(contd.)

Data Services2G


Download Throughput

(Kbps)134.85 138.17 121.93 102.46 112.32

Upload Throughput

(kbps)150.25 119.53 96.92 124.29 105.20

Web Browsing Delay

(sec)30.45 39.91 27.81 29.05 27.51

Latency

(msec)257 247 238 248 274

Data Services3G 4G


Download Throughput

(Mbps)4.80 3.45 3.59 3.86 0.21 9.11 6.82 5.19 3.23

Upload Throughput

(Mbps) 0.90 2.00 2.08 0.79 0.55 4.20 8.33 4.68 3.93

Web Browsing Delay

(sec)15.76 9.59 9.12 13.92 17.49 7.38 7.79 5.84 10.77

Video Streaming Delay

(sec)3.57 1.36 2.27 1.21 2.04 2.37 1.50 0.83 3.66

Latency

(msec)344 123 129 252 140 93 97 239 88

Data Services3G 4G


Download Throughput

(Mbps)3.75 3.17 2.49 3.10 0.25 8.22 5.64 2.45 1.86

Upload Throughput

(Mbps) 0.54 1.74 1.92 0.61 0.18 6.10 8.02 3.34 3.15

Web Browsing Delay

(sec)14.87 11.39 10.68 16.42 17.50 9.66 8.54 8.38 12.40

Video Streaming Delay

(sec)3.17 1.96 2.02 2.61 8.13 5.09 1.80 2.16 2.99

Latency

(msec)352 114 125 273 TO 108 99 287 93

Data Test - Stationary

Data Test - Mobility

a) TO (Timeout) for Failed data test .

Summary of 30


Agra Cant Station2G


Download Throughput

(Kbps)85.26 69.74 57.99 115.57 85.96

Upload Throughput (kbps) 123.62 99.52 76.22 125.44 106.81

Web Browsing Delay (sec) 28.91 40.57 34.64 36.81 23.45

Latency (msec) 250 262 286 196 226

Agra Cant Station3G 4G


Download Throughput

(Mbps)3.91 2.01 0.74 4.51 0.08 6.33 2.77 5.48 0.63

Upload Throughput (Mbps) 0.66 1.61 1.14 0.66 0.35 4.42 6.07 5.44 0.50

Web Browsing Delay (sec) 16.17 9.69 11.08 12.76 20.43 7.00 10.27 5.21 12.56

Video Streaming Delay (sec) 5.69 1.32 4.49 1.61 1.39 1.24 1.61 0.59 4.58

Latency (msec) 339 87 172 296 165 88 88 313 75

ISBT2G


Download Throughput

(Kbps)74.45 135.34 138.36 110.97 160.75



Latency (msec) 420 269 223 472 212

ISBT3G 4G


Download Throughput

(Mbps)TO 4.24 5.71 0.13 0.36 6.49 7.59 4.74 0.46

Upload Throughput (Mbps) TO 2.39 3.37 0.00 1.34 2.45 10.51 3.52 2.96

Web Browsing Delay (sec) TO 7.94 7.12 TO 16.39 7.67 6.20 6.53 10.39

Video Streaming Delay (sec) TO 1.26 1.31 TO 0.77 1.62 1.28 0.56 4.49

Latency (msec) TO 97 82 TO 208 101 109 165 88

Summary of 30


Sanjay Place2G


Download Throughput

(Kbps)150.19 132.61 68.50 70.85 38.90



Latency (msec) 228 196 229 314 408

Sanjay Place3G 4G


Download Throughput

(Mbps)8.67 5.70 4.29 5.95 0.75 18.26 7.51 6.46 9.19



Video Streaming Delay (sec) 3.32 1.23 1.05 1.00 2.36 1.84 1.07 TO 0.53

Latency (msec) 413 100 200 243 131 107 96 58 83

Shilp Gram2G


Download Throughput

(Kbps)191.81 156.36 157.06 98.80 150.68



Latency (msec) 234 202 192 170 242

Shilp Gram3G 4G


Download Throughput

(Mbps)4.32 4.19 6.34 3.74 0.16 8.18 5.57 6.55 6.25




Latency (msec) 401 95 105 303 91 87 111 319 123

Summary of 30


SN Medical College2G


Download Throughput

(Kbps)142.63 162.91 179.16 106.99 TO



Latency (msec) 232 229 306 228 234

SN Medical College3G 4G


Download Throughput

(Mbps)5.11 3.62 1.67 4.28 0.09 9.59 10.95 2.12 0.44




Latency (msec) 338 108 100 92 98 102 97 296 92

TDI Mall2G


Download Throughput

(Kbps)164.79 149.27 130.50 111.55 92.92



Latency (msec) 179 328 206 192 317

TDI Mall3G 4G


Download Throughput

(Mbps)2.00 1.69 2.76 1.68 0.14 5.77 6.57 5.77 1.38




Latency (msec) 230 249 114 237 134 73 84 291 66

RF Coverage relates to the geographical footprint within the system that has sufficient RF signal strength to provide for a call/data session. The

Coverage rate of an TSP is calculated on the basis of % of samples in which the Rx level ≥ -85 dBm, RSCP is ≥ -90 dBm & RSRP ≥ -110dBm.

The details are as follows.

Airtel 2G

I. Coverage Details

Coverage Details of 30

TSPCoverage

Rate

Airtel 2G 93.52%

BSNL 2G 93.14%

Idea 2G 98.13%

Tata 2G 88.09%

Vodafone 2G 94.62%

Airtel Dual(2G/3G) 94.87%

BSNL Dual(2G/3G) 88.97%

Idea Dual(2G/3G) 96.56%

Tata Dual(2G/3G) 91.89%

Vodafone Dual(2G/3G) 89.89%

Airtel VoLTE 97.56%

Jio VoLTE 97.22%

0%

25%

50%

75%

100%

Air

tel 2

G

BS

NL

2G

Idea

2G

Tata

2G

Vo

da

fon

e 2

G

Air

tel D

ua

l(2

G/

3G

)

BS

NL

Du

al(

2G

/3

G)

Idea

Du

al(

2G

/3

G)

Tata

Du

al(

2G

/3

G)

Vo

da

fon

e D

ua

l(2

G/

3G

)

Air

tel V

oLT

E

Jio

Vo

LTE

Coverage Distribution

2G : -85 to Min/ Dual (2G/3G) : -90 to Min/ VoLTE : -110 to -130 dBm 2G : -75 to -85dBm/ Dual (2G/3G) : -80 to -90 dBm/ VoLTE : -95 to -110 dBm

2G : -65 to -75dBm/ Dual (2G/3G) : -70 to -80 dBm/ VoLTE : -80 to -95 dBm 2G : 0 to 65dBm/ Dual (2G/3G) : 0 to -70 dBm/ VoLTE : 0 to -80 dBm

BSNL 2G

Idea 2G


I. Coverage Details (contd.)



Tata 2G

Vodafone 2G

Airtel Free mode



BSNL Free mode

Idea Free mode



Tata Free mode



Vodafone Free mode

Airtel VoLTE



Jio VoLTE

TSP Rx Quality

Airtel 2G 97.13%

BSNL 2G 97.45%

Idea 2G 97.00%

Tata 2G 97.56%

Vodafone 2G 98.10%

Airtel Dual(2G/3G) 95.06%

BSNL Dual(2G/3G) 97.10%

Idea Dual(2G/3G) 91.93%

Tata Dual(2G/3G) 95.73%

Vodafone Dual(2G/3G) 93.12%

Airtel VoLTE 84.34%

Jio VoLTE 83.66%

0.00%

25.00%

50.00%

75.00%

100.00%

Air

tel 2

G

BS

NL

2G

Idea

2G

Tata

2G

Vo

da

fon

e 2

G

Air

tel D

ua

l(2

G/

3G

)

BS

NL

Du

al(

2G

/3

G)

Idea

Du

al(

2G

/3

G)

Tata

Du

al(

2G

/3

G)

Vo

da

fon

e D

ua

l(2

G/

3G

)

Air

tel V

olt

e

Jio

Vo

LTE

Rx Quality Distribution

RxQual ≤5, EcNo ≥-14 dBm, FER≤ 4%, SINR >0 RxQual >5, EcNo <-14 dBm, FER > 4%, SINR ≤0

For measuring voice quality, as per the QoS norms, RxQual <=5 for GSM TSPs, EcNo >= -14 dBm for 3G TSP sand SINR >0 in case of VoLTE is

considered to be good, where as quality beyond this benchmark is considered to be bad. The benchmark should usually be ≥ 95%.

TSPs not meeting the Benchmark

Airtel 2G

II. Quality Details

Quality Details of 30

II. Quality Details (contd.)


BSNL 2G

Idea 2G



Tata 2G

Vodafone 2G



Airtel Free mode

BSNL Free mode



Tata Free mode

Idea Free mode



Vodafone Free mode

Airtel VoLTE


Coverage Detail of 30

s

Jio VoLTE

TSP % Time on 3G

Airtel 3G 87.50%

BSNL3G 62.47%

Idea 3G 49.23%

Tata 3G 69.73%

Vodafone 3G 77.48%

0.00%

25.00%

50.00%

75.00%

100.00%

Air

tel 3

G

BS

NL

3G

Idea

3G

Tata

3G

Vo

da

fon

e 3

G

Technology Distribution

% Time on 3G % Time on 2G % Time on 4G

III. Technology Details

Technology Details of 30

Airtel 3G

III. Technology Details(contd.)


BSNL 3G

Idea 3G

III. Technology Details(contd.)


Tata 3G

Vodafone 3G

2019 January NORTH ZONE

Documents

Transcript of 2019 January NORTH ZONE