2g Meerut Report

download 2g Meerut Report

of 65

Transcript of 2g Meerut Report

  • 8/2/2019 2g Meerut Report

    1/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Meerut 2G Benchmark Report

    February 2012

  • 8/2/2019 2g Meerut Report

    2/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Executive Summary Meerut

    Demographics of MeerutMeerut is a metropolitan city in the Indian state of Uttar Pradesh. It is an ancient city located 70 km (43 mi) northeast of the national capital New Delhi,and 453 km (281 mi) northwest of the state capital, Lucknow. It is the second largest city in the National Capital Region of India (the largest being Delhi),the 16th largest metropolitan area and 17th largest city in India. It ranked 292 in 2006 and 242 in 2010 in the list of largest cities and urban areas in theworld and is the second fastest developing city in Uttar Pradesh (after Noida).It has the 2nd largest army cantonment in the country. The city is one of the largest producers of sports goods, and the largest producer of musicalinstruments in India.

    Meerut Details

    Population 3,447,405

    Area 272 km

    Population Density 1342 /km

    MeerutOperators

    TechBand of

    Operation(MHz)

    No. of 2GCells*

    Subscribers (UPWest Circle)

    Airtel GSM 1800 471 6620368

    Vodafone GSM 900 306 9413864

    Docomo GSM 1800 361 8528526

    Idea GSM 900 339 9829965

    RCOM CDMA EVDO 850 - 467950

    TATA CDMA EVDO 850 - 8528526

    *No of Cells is an indicative no the cells encountered during the drive

    Subscriber figures are for UP West Circle taken from the latest COAI report.

    *TATA & Reliance Subs includes GSM + CDMA.

  • 8/2/2019 2g Meerut Report

    3/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Section 1

    Benchmarking Equipment and setup

    Data Collection Details

    Voice Testing Algorithm

    Data Testing Algorithm

    Strategic Location Testing

    Benchmarking KPIs: Score Evolution

    Voice & Data KPI weightages

    Benchmarking Methodology

  • 8/2/2019 2g Meerut Report

    4/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Benchmarking Equipment and Setup

    The XCAL MO is a drive test data collection and analysis system for mobile networks. XCAL tool is a systemthat collects radio performance and QoS Key Performance Indicators (KPIs) of wireless networks.

    It is built upon a modular platform for Quality of Service (QoS) wireless network drive testing, RFOptimization and Competitive network benchmarking.The systems uses specially configured commercial phones attached to controlling device in isolationchambers to perform various test such as voice call, data calls, video calls etc. The equipment is flexible inconfiguration supporting a maximum of 20 handset devices on the same testing platform.

  • 8/2/2019 2g Meerut Report

    5/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Data Collection Details

    A benchmarking activity, was carried out in Meerut for

    across the city. The details of the activity are:

    Measurement Period : 15th Jan 2012 to 11th Feb2012

    Measurement time during the day : 8 AM to 9 PM

    Measurement days during the week : Monday to Saturday

    The drive route was created to cover the dense population

    area , key commercial area, key residential area. The

    city was divided into 5 clusters/areas.

    CL -1 Ishwar Nagar, Kanjar Mohalla,

    CL-2 Prem Puri , sharda Puri Ph1

    CL-3 Beripura, Muftiyan , Islamabad

    CL-4 Garh Raod, Tejgarhi, Prabhat Nagar

    CL- 5 Sharma Nagar, Jawahar Nagar.

    1

    2

    3

    4

    5

  • 8/2/2019 2g Meerut Report

    6/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Voice Testing Algorithm

    Test Details Specifications

    No of Operators tested2G Network (Airtel, Docomo, Idea,

    Vodafone, Reliance CDMA, Tata CDMA)

    Voice Test Algorithm

    Call Duration 3 mins (180 Secs)

    Idle time in between calls 10 Secs

    Continuous call for 3 minute duration with 10 seconds of

    Idle time. Speech samples (DL and UL) are sent and

    received which provide the MOS score for voice quality.

    This was repeated for the entire duration of collection

  • 8/2/2019 2g Meerut Report

    7/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Data Testing Algorithm

    Test Details Specifications

    No of Operators testedGSM Network (Airtel, Docomo, Idea, Vodafone)

    EVDO Network (Reliance, Tata)

    Data Test Algorithm

    Attach and PDP Activation Before every test

    Ping 3 times - 32 bytes on www.google.co.in

    FTP Download 10 MB (for EvDo), 500KB (for GSM) from server

    FTP Upload 1 MB ( for EvDo), 100KB (for GSM) to Server

    HTTP 8 different websites.

    Email send 100 KB Email to SMTP server

    Email Receive 100 KB Email from POP3 server

    After every application test, we have 5 sec Idle time before the next Application is tested.

    No HTTP Websites1 google.com

    2 facebook.com

    3 nimbuzz.com

    4 airtel.in

    5 vuclip.com

    6 youtube.com

    7 admob.com

    8 nokia.com

  • 8/2/2019 2g Meerut Report

    8/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Strategic Location Testing

    Strategic Locations Specifications

    No of Operators testedGSM Network (Airtel, Docomo, Idea, Vodafone)

    EVDO Network (Reliance, Tata)

    Data Test Algorithm

    WAP Test 8 different WAP sites

    FTP Download 10 MB (for EvDo), 1MB (for GSM) from Server

    Email send 100 KB Email to SMTP server

    Email Receive 100 KB Email from POP3 server

    SMS SMS send to same number (160 char)

    MMS MMS send to same number 15 Kb

    WAP sites

    wap.google.comm.facebook.com

    m.samsungmobile.com

    wapin.com

    m.vuclip.com

    m.youtube.com

    m.admob.com

    m.sonyericsson.com

    Apart from the above tests during the drive, at 5 strategic locations across the city, additional stationary tests were

    carried out. These locations are important locations of the city.

    1. Abu Lane

    2. Begam Pul

    3. Roadways Bus Stand

    4. Sadar Bazar

    5. Shastri Nagar

  • 8/2/2019 2g Meerut Report

    9/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Each KPI is then measured on a scale of0 to 200 on the basis of performance.

    Value of the Particular KPI is not reported default score is 100.

    The Score is then weighted with the respective weightages to arrive at an overall Voiceor a Data Score.

    Benchmarking KPIs: Score Evolution

    9

    T

    op

    Top 20% percentile draws the borderline to the global to 20% performers

    50% operators are above medianvalue and 50% of operator are belowthis value

    Here you find individual operators

    Maximum value shows the best result in thiscase best performing operator call setup

    time(2.62 S)

    Low 20% percentile shows that 20%of all operators are on this level orlower.

    Minimum Values shows poor

    performing network in this category .

    Here the lowest performing operator

    having call setup time(5.00 s)

    1

    2

    3

    2.62s

    5.00s

    3.8s

  • 8/2/2019 2g Meerut Report

    10/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Voice & Data KPI weightages

    5 KPIs are used to arrive at the Voice Quality Score and 19 KPIs are used to arrive at the Data Quality Score.

    Following are the details of weightings assigned to different KPIs. These are used for arriving at the final ranking of the

    operator.

    *Coverage Calculation:Coverage = A%*10+B%*8+C%*6+D%*1

    10

  • 8/2/2019 2g Meerut Report

    11/65

  • 8/2/2019 2g Meerut Report

    12/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Voice Quality Score

    12CST= Call Setup Time CSSR= Call Setup Success Rate CCR= Call Completion Rate MOS= Mean Opinion Score 12

    Best Operator Airtel

    Retainability,AccessibilityVoice quality andcoverage

    94

    128

    53

    1

    2

    3

    4

    5

    172

    6

    VCQI

    \

    3.8

    4.7

    3.2

    1

    2 3

    5

    4

    10.0

    6

    CST

    97%

    99%

    92%

    1

    2

    3

    4

    5

    100%

    6

    CSSR

    97%

    99%

    92%

    1

    2

    3

    4 5

    100%

    6

    CCSR

    3.6

    3.8

    3.4

    1

    2

    3

    4

    5

    4.01

    6

    MOS

    74%

    92%

    61%

    1 2 3 4

    5

    100%

    6

    Coverage

    Operator VCQI CST CSSR CCSR MOS Coverage

    1 Airtel 140.29 4.58 98.25% 98.21% 3.89 90.81%

    2 Docomo 34.32 5.00 93.51% 94.26% 3.21 90.62%

    3 Vodafone 84.62 4.97 96.73% 96.24% 3.59 90.56%

    4 Idea 107.79 4.74 96.06% 97.80% 3.71 90.09%

    5 RCOM 94.69 2.62 97.60% 97.86% 3.28 84.44%

    6 Tata 56.85 2.68 93.91% 95.76% 3.27 74.89%

  • 8/2/2019 2g Meerut Report

    13/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Data Quality Score

    Best Operator Overall Vodafone among GSM Operators

    96

    117

    66

    1

    2

    3

    4

    183

    65

    DCQI

    100

    146

    55

    1 2 3 4

    200

    5 6

    GPRS

    100

    153

    57

    1 2

    3

    4

    5

    197

    6

    PDP

    94

    129

    41

    1

    2

    3

    4

    5

    200

    6

    FTP DL

    91

    130

    40

    1

    2

    34

    5

    196

    6

    FTP UL

    99

    133

    41

    1

    2

    3

    4

    5

    200

    6

    HTTP

    95

    136

    52

    12

    3

    4

    5

    199

    6

    Email

    100

    124

    44

    1

    2

    3

    4

    5

    200

    6

    Ping

    Operator DCQI HTTP FTP DL FTP UP SMS MMS Email PRS ATT PDP PING

    1 Airtel 94 89 55 67 199 188 63 120 0 117

    2 Docomo 57 32 0 41 200 149 59 120 0 64

    3 Vodafone 125 104 98 135 199 184 157 120 76 124

    4 Idea 102 84 134 138 200 89 77 120 51 28

    5 RCOM 111 119 47 176 100 100 142 100 100 179

    6 Tata 114 135 56 94 100 100 143 100 100 182

  • 8/2/2019 2g Meerut Report

    14/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Section 3

    Voice Performance Analysis

    Coverage Distribution

    Call Setup Time

    Call Setup Success Rate Call Setup Failure Analysis

    Call Completion Success Rate Call Completion Failure Analysis

    Accessibility V/s Retainability: Market Comparison

    Voice Quality: MOS Airtel MOS Performance

    Airtel RxQual

    Voice Codec Distribution

    Handover Analysis

    Detailed Voice Analysis

  • 8/2/2019 2g Meerut Report

    15/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Call Setup Time:

    Airtel Is no. 3 with Call Setup time of 4.58s

    Call Setup Success Rate:

    Airtel No. 1 call setup success Rate 98.25%

    Call Completion Success Rate:

    Airtel is no. 1 for CCSR 98.21%

    Voice Quality:Airtel Ranked No. 1 for speech quality for with MOS 3.89

    Ranking for Voice KPIs

    Voice Performance Analysis

    Parameter Best Value Operator

    Call Setup Time 2.62 RCOM

    Accessibility 98.25% Airtel

    Retainability 98.21% Airtel

    MOS 3.89 Airtel

    Coverage 90.81% Airtel

    Best Operator Airtel

    15

    Operator CST Accessibility Retainability Voice Quality Coverage

    1 Airtel 3 1 1 1 1

    2 Docomo 6 6 6 6 2

    3 Vodafone 5 3 4 3 3

    4 Idea 4 4 3 2 45 RCOM 1 2 2 4 5

    6 Tata 2 5 5 5 6

  • 8/2/2019 2g Meerut Report

    16/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Coverage DistributionCoverage was measured with the help of a digital scanner for all the networks.

    All the GSM operators have

    an almost equal coverage.

    Out of these Airtel is best

    Airtel Distribution

    Coverage RSSI

    0

    50000

    100000

    150000

    200000

    250000

    300000

    350000

    400000

    0 TO 6565 TO 7575 TO 8585 TO 95 95 TO105

    Tata CDMA

    Reliance CDMA

    IdeaVodafone

    Docomo

    Airtel

    Operator

    % of

    samples

    > -

    85dBm

    Coverag

    e Rate

    using

    formula

    Rank

    Airtel 2G 89.53% 90.81% 1

    Tata

    Docomo

    2G

    89.67% 90.62% 2

    Vodafone

    2G89.69% 90.56% 3

    Idea 2G 85% 90.09% 4

    RCOM

    CDMA86.61% 84.44% 5

    TATA

    CDMA83.38% 74.89% 6

    Range Samples Percentage

    =-65 29749 69.35%

    =-75 8961 20.89%

    =-85 2812 6.56%

    =-95 1314 3.06%

    =-105 62 0.14%

  • 8/2/2019 2g Meerut Report

    17/65

  • 8/2/2019 2g Meerut Report

    18/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    -10

    0

    10

    20

    30

    40

    5060

    70

    80

    0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16

    Airtel Docomo VodafoneIdea Reliance CDMA Tata CDMA

    Airtel have least call setup timeamongst all GSM operators.

    Call Setup Time (CST)

    Call Set up Time (PDF)

    3.9 4.7 4.1 4.08 1.54 1.1

    14.73

    17.53

    13.55

    22.93

    27.57

    16.13

    4.58 5.00 4.97 4.742.62 2.68

    0

    5

    10

    15

    20

    25

    30

    Airtel Docomo Vodafone Idea RelianceCDMA

    Tata CDMA

    MIN

    MAX

    Avg.

    CST Avg.

  • 8/2/2019 2g Meerut Report

    19/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Call Setup Success Rate is a measure of subscriber experience associated with the access to network

    resource. It consists of congestion of network or unavailability of network resources.

    Call Setup Success Rate

    Airtel has the best accessibility amongst all

    Operators with value of 98.25%Operator Call Attempts

    Blocked

    CallsCSSR

    Blocked

    Rate

    Airtel 2G 479 9 98.25% 1.75%

    Docomo 2G 487 37 93.51% 6.49%

    Vodafone 2G 496 17 96.73% 3.27%

    Idea 2G 418 20 96.06% 3.94%

    Reliance CDMA 442 11 97.60% 2.40%

    Tata CDMA 447 26 93.91% 6.09%

    Call Setup Success Rate Airtel 2G Docomo 2G Vodafone 2G Idea 2G

    Reliance

    CDMA Tata CDMA

    Total Calls Attempts 479 487 496 418 442 447

    Blocked Call Reasons (Radio Cause) 9 37 17 20 11 26

    SDCCH Drop

    SDCCH blocking

    CM Setup Phase Failure 6 28 14 17 9 22

    SDCCH Drop, High RxQual

    Temporary failure

    High RxQual 2 2 3 1 2

    Poor Coverage 1 1 1 2

    Failed after TCH Assignment/progress

    Total 9 37 17 20 11 26

    CSSR 98.25% 93.51% 96.73% 96.06% 97.60% 93.91%

  • 8/2/2019 2g Meerut Report

    20/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Call Completion Success Rate is a measure of subscriber experience associated with the continued use of network

    resources that have been granted. It consists of radio link drops or abnormal network-initiated releases.

    Call Completion Success Rate

    Airtel has best retainability.

    Call Completion Success Rate Airtel 2G Docomo 2G Vodafone 2G Idea 2G Reliance CDMA Tata CDMA

    Total Calls Established 470 450 479 398 431 421

    Dropped Call Reasons 9 23 18 9 10 16

    High RxQual

    5 18 17 5 7 12

    Missing Handover, High RxQual 1 2 2 2 2

    Resource Unavailable

    High RxQual, FER 3 3 1 2 1 2

    Total 9 23 18 9 10 16

    CCSR 98.21% 94.26% 96.24% 97.80% 97.86% 95.76%

    Operator EstablishedDropped

    CallsCCSR

    Dropped

    Rate

    Airtel 2G 470 9 98.21% 1.79%

    Docomo 2G 450 23 94.26% 5.74%

    Vodafone 2G 479 18 96.24% 3.76%

    Idea 2G 398 9 97.80% 2.20%

    Reliance CDMA 431 10 97.86% 2.14%

    Tata CDMA 421 16 95.76% 4.24%

  • 8/2/2019 2g Meerut Report

    21/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Call Failed & Drop Plot

    DROPPED CALLSFAILEDCALLS

  • 8/2/2019 2g Meerut Report

    22/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Accessibility V/s Retainability: Market Comparison

    98.

    25%

    93.

    51%

    96.

    73%

    96.

    06%

    97.

    60%

    93.

    91%

    9

    37

    17

    20

    11

    26

    0

    5

    10

    1520

    25

    30

    35

    40

    91%

    92%

    93%

    94%95%

    96%

    97%

    98%

    99%

    Airtel Docomo Vodafone Idea Reliance Tata

    CCSR NO OF CALL BLOCKS

    98.

    21%

    94.

    26%

    96.

    24%

    97.

    80%

    97.

    86%

    95.

    76%

    9

    23

    18

    910

    16

    0

    5

    10

    15

    20

    25

    92%

    93%

    94%

    95%

    96%

    97%

    98%

    99%

    Airtel Docomo Vodafone Idea Reliance Tata

    CCR NO OF CALL DROPSCSSR

    CSSR CCR

  • 8/2/2019 2g Meerut Report

    23/65

  • 8/2/2019 2g Meerut Report

    24/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Plot DL MOS

    MOS Legend Samples Percentage

    3.8 < x < 5 29655 24.85%

    2.8 < x < 3.8 79418 66.56%

    2.2 < x < 2.8 0 0.00%

    0 < x < 2.2 10244 8.59%

  • 8/2/2019 2g Meerut Report

    25/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Plot RxQualSub

    Rx Qual Legend Samples Percentage

    7

  • 8/2/2019 2g Meerut Report

    26/65

  • 8/2/2019 2g Meerut Report

    27/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Handover Performance

    AIRTEL DOCOMO VODAFONE IDEA RELIANCE CDMA TATA CDMA

    HO ATTEMPTS 1396 1375 1257 1168 675 467

    HO SUCCESS 1375 726 1146 1076 645 449HO FAILURE 22 649 111 92 30 18

    HO SUCCESS RATE 98.50% 52.80% 91.17% 92.12% 95.56% 96.15%

    Avg. HO TIME 0.18 0.17 0.17 0.18 0.16 0.17

    2G HANDOVERS

  • 8/2/2019 2g Meerut Report

    28/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Section 3

    Data Performance Analysis

    FTP Performance FTP Application Throughput Analysis

    HTTP Browsing Analysis HTTP Performance (Airtel)

    FTP DL/UL and HTTP Failures

    Email Performance

    GPRS Attach and PDP performance

    Data Access Technology Distribution EDGE - GPRS Codecs

    GPRS Timeslot Allocation

    Ping Response: Latency Performance

    KPI Overview Table

    Detailed Data Analysis

  • 8/2/2019 2g Meerut Report

    29/65

    All Rights Reserved Alcatel-Lucent 2006, #####Ranking for Data KPIs

    Airtel FTP UL performance ranked 4, FTP DL

    Performance rank 3

    Airtel Ranked 4th for FTP UL throughput, no 5 for

    FTP DL throughput

    Airtel is at 4th for email sent and 5th retrieve

    performance

    Ranked 4th for HTTP performance

    PDP context performance Airtel ranked 5th

    Airtel, Docomo, Vodafone and Idea has comparableGPRS Attach performance

    Airtel, Docomo, Vodafone and Idea have same rank

    for SMS performance while Vodafone has best MMS

    delivery time while Docomo is best for SMS delivery

    time

    Data Performance Analysis

    29

    Test Ping (10%)

    Operator FTP UP

    Success(

    60%)

    FTP UP

    Through

    put(40%)

    FTP DL

    Success(

    60%)

    FTP DL

    through

    Put (40%)

    HTTP

    Success(

    60%)

    HTTP

    downloa

    d

    time(40%)

    Email

    sent

    Success(

    60%)

    Email

    sent

    time(40%)

    Email

    retrive

    Success(

    60%)

    Email

    Retrive

    time(40%)

    Ping RTT

    1 Airtel 4 4 3 5 4 5 4 5 5 6 4

    2 Docomo 6 6 4 6 6 6 4 4 6 5 5

    3 Vodafone 3 3 2 3 3 3 1 3 1 3 3

    4 Idea 1 5 1 4 5 4 4 6 4 4 6

    5 RCOM 2 1 4 2 2 2 3 1 2 2 2

    6 Tata 5 2 4 1 1 1 2 2 3 1 1

    Email Retrive(5%)FTP UP (5%) FTP DL (20%) HTTP (30%) Email Se nt (5%)

    Test

    Operator GPRS

    AttachSuccess

    Rate

    GPRS

    attachdelay(40

    %

    PDP

    contextsuccess(6

    0%)

    PDP

    contextdelay(40

    %)

    1 Airtel 1 3 5 4

    2 Docomo 1 3 5 4

    3 Vodafone 1 3 1 3

    4 Idea 1 3 4 4

    5 RCOM 5 1 2 1

    6 Tata 5 1 2 1

    GPRS Attached(5%) PDP Attached(5%)

    Test

    Operator SMSsuccess

    (60%)

    SMSdelivery

    time(40%)

    MMSsuccess

    (60%)

    MMSdelivery

    time

    (40%)

    1 Airtel 1 4 1 2

    2 Docomo 1 1 3 3

    3 Vodafone 1 3 2 1

    4 Idea 1 2 6 4

    5 RCOM 5 5 4 5

    6 Tata 5 5 4 5

    SMS(5%) MMS(5%)

  • 8/2/2019 2g Meerut Report

    30/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    FTP Statistics

    File transfer is becoming increasingly and

    legitimately popular as a method of transferring

    media files (movies and music).

    The FTP test is used to test the FTP service

    availability and to measure the application

    throughput for file download or file upload. The

    test is successful when the desired operation

    (uploading or downloading) has succeeded.

    Airtel has an average throughput as compared to

    other GSM providers.

    FTP SUCCESS RATE

    FTP THROUGHPUT

    FTP UL Throughput

    73.26%

    49.70%

    87.32%

    94.93%

    0.00%

    32.69%

    78.68%

    72.82%

    93.31%

    94.64%

    94.48%

    76.36%

    0%

    10%

    20%

    30%

    40%

    50%

    60%

    70%

    80%

    90%

    100%

    Airtel Docomo Vodafone Idea Reliance

    CDMA

    Tata CDMA

    FTP DL SUCCESS RATE FTP UL SUCCESS RATE

    457.6

    232.0

    97.8

    113.4

    35.8

    69.1

    553.6

    566.3

    70.0

    99.8

    64.3

    72.4

    0.00 100.00 200.00 300.00 400.00 500.00 600.00

    Tata CDMA

    Reliance

    CDMA

    Idea

    Vodafone

    Docomo

    Airtel

    FTP UL SUCCESS RATE FTP DL SUCCESS RATE

    FTP DL Throughput

  • 8/2/2019 2g Meerut Report

    31/65

  • 8/2/2019 2g Meerut Report

    32/65

  • 8/2/2019 2g Meerut Report

    33/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    FTP DL/UL and HTTP Failures

    The Plots show the Failure events

    encountered during FTP

    Download, FTP upload and HTTP

    Browsing for Airtel .

  • 8/2/2019 2g Meerut Report

    34/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    10.2

    6.3

    28.7

    20.4

    23.3

    28.3

    6.7

    8.7

    29.3

    18.2

    31.7

    36.4

    0.00 10.00 20.00 30.00 40.00

    Tata CDMA

    Reliance CDMA

    Idea 2G

    Vodafone 2G

    Docomo 2G

    Airtel 2G

    Email Retrieve time Email Send time

    83.2%

    68.3%

    98.1%

    85.7%

    92.0%

    92.8%

    83.2%

    68.3%

    98.1%

    85.7%

    92.8%

    92.8%

    0%

    20%

    40%

    60%

    80%

    100%

    120%

    Airtel Docomo Vodafone Idea Reliance

    CDMA

    Tata CDMA

    Email Send success rate Email Receive success rate

    Email Send / Retrieve

    A 100KB email was sent and downloaded viathe POP and SMTP protocols. This is a close

    simulation of Users accessing pull mail from

    their work IDs using their handphones.

    Airtel has average email send success rate.

    Airtel has highest email send delay ascompared to other operators.

    EMAIL SEND / RECEIVE RATE

    EMAIL SEND/RECEIVE TIME

  • 8/2/2019 2g Meerut Report

    35/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    GPRS Attach and PDP Context

    35

    Airtel has poor average GPRS attach Delay amongst all operators.

    PDP performance is also poor for Airtel.

    92%

    89%

    99%

    98%

    8.15

    3.713.25

    5.16

    0

    1

    2

    3

    4

    5

    67

    8

    9

    84%

    86%

    88%

    90%

    92%

    94%

    96%

    98%

    100%

    Airtel Docomo Vodafone Idea

    PDP Context Activation rate PDP Time

    1

    00%

    1

    00%

    1

    00%

    1

    00%

    18.78

    22.55

    19.82

    9.55

    0

    5

    10

    15

    20

    25

    0%

    20%

    40%

    60%

    80%

    100%

    120%

    Airtel Docomo Vodafone Idea

    GPRS Attach Success rate Attach Time

    GPRS STATISTICS PDP STATISTICS

  • 8/2/2019 2g Meerut Report

    36/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    0.00

    5.00

    10.00

    15.00

    20.00

    25.00

    30.00

    35.00

    40.00

    Airtel Docomo Vodafone Idea

    CS4

    CS3

    CS2

    CS1

    EDGE GPRS Codecs

    GPRS Downlink

    0.00

    5.00

    10.00

    15.00

    20.00

    25.00

    30.00

    35.00

    40.00

    Airtel Docomo Vodafone Idea

    CS4

    CS3

    CS2

    CS1

    GPRS Uplink

    0.00

    10.00

    20.00

    30.00

    40.0050.00

    60.00

    70.00

    80.00

    90.00

    100.00

    Airtel Docomo Vodafone Idea

    MCS9

    MCS8

    MCS7

    MCS6

    MCS5

    MCS4

    MCS3

    MCS2

    MCS1

    EDGE Downlink

    0.00

    10.00

    20.00

    30.00

    40.0050.00

    60.00

    70.00

    80.00

    90.00

    100.00

    Airtel Docomo Vodafone Idea

    MCS9

    MCS8

    MCS7

    MCS6

    MCS5

    MCS4

    MCS3

    MCS2

    MCS1

    EDGE Uplink

  • 8/2/2019 2g Meerut Report

    37/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Timeslot Allocation

    TS Downlink TS Uplink

    Airtel has got average TS allocation.

  • 8/2/2019 2g Meerut Report

    38/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    A Latency Test was Conducted with www.google.co.in with 32bytes of data to figure out the round trip time. A

    Ping Response signifies the average delay it takes to access a particular service.

    Airtel has an average ping delay in all GSM Service Providers.

    The ping delay response is however not a comprehensive representation of the service access time since it is

    dependent on factors beyond the GGSN such as the number of hops to the destination and the pipe available

    The delay in the RTT can point to:

    UL/DL TBF allocation algorithm

    Different Implementation of QoS on the Gn/Gi and giving priority to other traffic than the tunnelled ICMP

    Ping Response: Latency Performance

    0

    100

    200

    300

    400

    500

    600

    Airtel 2G Docomo 2G Vodafone

    2G

    Idea 2G Reliance

    CDMA

    Tata CDMA

    >1000 800-1000 600-800

    400-600 200-400 0-200

    Ping RTT (msec)

    370

    573

    348

    714

    164

    153

    0

    100

    200

    300

    400

    500

    600

    700

    800

    Airtel Docomo Vodafone Idea RelianceCDMA Tata CDMA

    Ping RTT

    Airtel Docomo Vodafone Idea Reliance CDMA Tata CDMA

  • 8/2/2019 2g Meerut Report

    39/65

  • 8/2/2019 2g Meerut Report

    40/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    KPI Overview Table

    The attached KPI table gives an overview about the most important performance figures collected

    during this Benchmarking campaign.

  • 8/2/2019 2g Meerut Report

    41/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Section 4

    City Vs Cluster Standings

    Cluster wise Summary Voice

    Cluster wise Snapshot Voice

    Cluster wise Summary Data

    Cluster wise Snapshot Data

    Cluster Analysis Cluster 1

    Cluster 2

    Cluster 3

    Cluster 4

    Cluster 5

    Clusterwise Analysis

  • 8/2/2019 2g Meerut Report

    42/65

    Cit Cl t V i Q lit S

  • 8/2/2019 2g Meerut Report

    43/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    City vs Cluster Voice Quality Score

    43CST= Call Setup Time CSSR= Call Setup Success Rate CCR= Call Completion Rate MOS= Mean Opinion Score 43

    3.8

    4.7

    3.2

    0 1 2 43

    10.0

    5

    CST

    97%

    99%

    92%

    0

    1

    2

    3

    4

    100%

    5

    CSSR

    97%

    99%

    92%

    0

    1

    2

    3

    4

    100%

    5

    CCSR

    74%

    92%

    61%

    0

    1 2

    3

    4

    100%

    5

    Coverage

    Meerut 2G VCQI CST CSSR CCR MOS

    (Avg ofDL/UL)

    Coverage

    0 Overall 140 4.58 98.25% 98.21% 3.89 90.81%

    1 Cl1 122 4.64 97.14% 97.06% 3.87 93.22%

    2 Cl2 178 4.66 100.00% 100.00% 4.20 92.96%

    3 Cl3 118 4.53 97.10% 97.01% 3.80 99.27%

    4 Cl4 138 4.56 98.36% 98.33% 3.84 95.23%

    5 Cl5 130 4.52 98.67% 98.65% 3.755 73.35%

    94

    128

    53

    0

    2

    3

    4

    179

    5

    1

    VCQI

    3.6

    3.8

    3.4

    0 1

    2

    3 4

    4.20

    5

    MOS

  • 8/2/2019 2g Meerut Report

    44/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    City vs Cluster Data Quality Score

    44

    96

    117

    66

    0

    1

    2

    3 4

    183

    5

    DCQI

    100

    146

    55

    0 1 2 3

    200

    4 5

    GPRS

    100

    153

    57

    0

    1

    2

    3

    4

    197

    5

    PDP

    94

    129

    41

    0

    1 23

    4

    200

    5

    FTP DL

    91

    130

    40

    0

    1

    2

    34

    196

    5

    FTP UL

    99

    133

    41

    0

    1

    2

    3

    4

    200

    5

    HTTP

    95

    136

    52

    0

    1

    2

    3

    4

    199

    5

    Email

    100

    124

    44

    0

    1

    2

    3

    4

    200

    5

    PING

    Meerut 2G DCQI GPRS PDP

    Context

    FTP DL FTP UL HTTP Email Ping

    RTT

    0 Overall 94 120 0 55 67 89 63 117

    1 Cl1 111 120 120 71 75 110 35 152

    2 Cl2 89 120 0 73 98 48 55 140

    3 Cl3 96 120 14 75 57 92 84 65

    4 Cl4 98 120 0 43 51 101 111 102

    5 Cl5 100 120 0 66 49 85 100 134

  • 8/2/2019 2g Meerut Report

    45/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Clusterwise Summary Voice

    1

    2

    3

    4

    5

    VoiceIndex

    C1 C2 C3 C4 C5

    Airtel 1 1 1 1 1

    Docomo 2 6 6 6 4

    Vodafone 3 4 3 3 5

    Idea 6 3 2 2 3

    RCOM 4 2 4 4 2

    TATA 5 5 5 5 6

  • 8/2/2019 2g Meerut Report

    46/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    0

    1

    2

    3

    4

    5

    6

    7

    8

    Cluster1 Cluster2 Cluster3 Cluster4 Cluster5

    Airtel Docomo VodafoneIdea Reliance CDMA Tata CDMA

    0

    0.5

    1

    1.5

    2

    2.5

    3

    3.5

    4

    4.5

    Cluster1 Cluster2 Cluster3 Cluster4 Cluster5

    Airtel Docomo Vodafone Idea Reliance CDMA Tata CDMA

    0%

    20%

    40%

    60%

    80%

    100%

    120%

    Cluster 1 Cluster 2 Cluster 3 Cluster 4 Cluster 5

    Airtel Docomo Vodafone Idea Reliance Tata CDMA

    0%

    10%

    20%

    30%

    40%

    50%

    60%70%

    80%

    90%

    100%

    Cluster 1 Cluster 2 Cluster 3 Cluster 4 Cluster 5

    Airtel Docomo Vodafone Idea Reliance Tata CDMA

    Clusterwise Snapshot Voice

    CALL SETUP SUCCESS RATECALL COMPLETION RATE

    VOICE QUALITY (MOS) CALL SETUP TIME

  • 8/2/2019 2g Meerut Report

    47/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Clusterwise Summary Data

    1

    2

    3

    4

    5

    Data Index C1 C2 C3 C4 C5

    Airtel 4 5 5 5 3

    Docomo 6 6 6 6 6

    Vodafone 1 1 1 1 1

    Idea 3 4 4 3 5

    RCOM 5 3 3 4 2

    TATA 2 2 2 2 4

  • 8/2/2019 2g Meerut Report

    48/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    0%

    20%

    40%

    60%

    80%

    100%

    120%

    Cluster 1 Cluster 2 Cluster 3 Cluster 4 Cluster 5

    Airtel Docomo Vodafone Idea Reliance Tata CDMA

    0

    10

    20

    30

    40

    50

    60

    70

    Cluster 1 Cluster 2 Cluster 3 Cluster 4 Cluster 5

    Airtel Docomo Vodafone Idea Reliance Tata CDMA

    0%

    20%

    40%

    60%

    80%

    100%

    120%

    Cluster 1 Cluster 2 Cluster 3 Cluster 4 Cluster 5

    Airtel Docomo Vodafone Idea Reliance Tata CDMA

    0

    100

    200

    300

    400

    500

    600

    700

    800

    900

    Cluster 1 Cluster 2 Cluster 3 Cluster 4 Cluster 5

    Airtel Docomo Vodafone Idea Reliance Tata CDMA

    Clusterwise Snapshot: Data

    48

    HTTP DOWNLOAD TIME HTP SUCCESS RATE

    FTP DL ACCESSIBILITY FTP DL THROUGHPUT

  • 8/2/2019 2g Meerut Report

    49/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Average

    Cluster 1

    Best Operator (GSM)Voice: Airtel

    Data: VodafoneGood Excellent

    MOS

    Poor

    CSSR

    CCRCST

    Coverage

    Focus Area: Coverage and FTP Success

    Rate

    1

    FTP DL and UL both are poor incomparison with other operators.

    79.03%

    82%

    97%

    96.30%

    0% 3

    8%

    81%

    100%

    88.89%

    100%

    92.31%

    81.82%

    0%

    10%

    20%

    30%

    40%

    50%

    60%

    70%

    80%

    90%

    100%

    Airtel Docomo Vodafone Idea Reliance

    CDMA

    Tata CDMA

    FTP DL

    Success

    Rate

    FTP UL

    Success

    Rate

    FTP SUCCESS RATE

  • 8/2/2019 2g Meerut Report

    50/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Cluster 2

    Good Excellent

    Average Poor

    CSSR

    CCR

    CST

    Focus Area: FTP DL Success Rate

    Average HTTP browsing success rate

    FTP DL Success Rate is Poor.

    Coverage

    MOS

    2

    Best Operator (GSM)Voice: Airtel

    Data: Vodafone

    79%

    54%

    90%

    94%

    0%

    33%

    72.04

    36.84

    137.96

    105.16

    214.5

    374.73

    0

    50

    100

    150

    200

    250

    300

    350

    400

    0%

    10%

    20%

    30%40%

    50%

    60%

    70%

    80%

    90%

    100%

    Airtel Docomo Vodafone Idea Reliance

    CDMA

    Tata CDMA

    FTP DL Success Rate FTP DL Throughput

    FTP DL SUCCESS RATE

  • 8/2/2019 2g Meerut Report

    51/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Average

    Best Operator (GSM)Voice: Airtel

    Data: Vodafone

    Cluster 3

    Good Excellent

    MOS

    Poor

    CSSR

    CCRCST

    Coverage

    Focus Area: FTP UL Success Rate

    Low FTP Upload success rate

    3

    77%

    8

    8%

    94%

    100%

    95%

    100%

    73.98 84.83110.11

    70.11

    511.33

    873.1

    0

    100

    200

    300400

    500

    600

    700

    800

    900

    1000

    0%

    10%

    20%

    30%40%

    50%

    60%

    70%

    80%

    90%

    100%

    Airtel Docomo Vodafone Idea Reliance

    CDMA

    Tata CDMA

    FTP UL Success Rate FTP UL Throughput

    FTP UL SUCCESS RATE & THROUGHPUT

  • 8/2/2019 2g Meerut Report

    52/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Best Operator (GSM)Voice: Airtel

    Data: Vodafone

    Cluster 4

    Good Excellent

    Average Poor

    CSSR

    CCR

    CST

    Coverage

    4

    Focus Area: FTP Success Rate (DL/UL)

    Poor FTP UL and DL Success rate.

    MOS

    4

    74%

    0%

    84.62%

    100.00%

    0%

    25%

    75.00%

    0%

    96.15%

    100.00%

    96.77%

    100.00%

    0%

    10%

    20%

    30%

    40%

    50%

    60%

    70%

    80%

    90%

    100%

    Airtel Docomo Vodafone Idea Reliance

    CDMA

    Tata CDMA

    FTP

    DL

    Succe

    ss

    Rate

    FTPUL

    Succe

    ss

    Rate

    FTP SUCCESS RATE

  • 8/2/2019 2g Meerut Report

    53/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Low FTP DL success rate Weak Coverage

    Cluster 5

    Good Excellent

    MOS

    Average Poor

    CSSR

    CCR

    CST

    Focus Area: Coverage and FTP Success

    Rate

    Coverage

    5

    Best Operator (GSM)Voice: Airtel

    Data: Vodafone

    79%

    70%

    75%

    89

    %

    0%

    0.00%

    75%

    86%

    92%

    86%

    93%

    0.00%

    0%

    10%

    20%

    30%

    40%

    50%

    60%

    70%

    80%

    90%

    100%

    Airtel Docomo Vodafone Idea Reliance

    CDMA

    Tata CDMA

    FTP DL

    Succes

    s Rate

    FTP UL

    Succes

    s Rate

    FTP DL SUCCESS RATE

  • 8/2/2019 2g Meerut Report

    54/65

  • 8/2/2019 2g Meerut Report

    55/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Strategic Location: Overview

    Locations Latitude LongitudeAbu Lane 28.996955 77.700448

    Roadways Bus Stand 28.988847 77.701049

    Begampul 28.998006 77.706027

    Shastri Nagar 28.953555 77.732892

    Sadar Bazar 28.990762 77.696893

  • 8/2/2019 2g Meerut Report

    56/65

  • 8/2/2019 2g Meerut Report

    57/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Location 1: Abu lane

    Test Airtel 2G DOCOMO 2G VODAFONE 2G IDEA 2G Reliance EvDo TATA EVDO

    FTP DL Access 5 5 5 5 0 5

    FTP DL Success 5 0 2 5 0 1

    FTP DL Access ibi l i ty 100.00% 0.00% 40.00% 100.00% 0.00% 20.00%

    FTP DL Mean Data rate(Kbps) 46.9 13.21 144.21 98.3 0 1030.48

    Emai l Send Access 5 5 5 5 5 5

    Emai l Send Success % 100.00% 80.00% 100.00% 100.00% 80.00% 70.00%

    Emai l Send Delay 41.44 21.17 14.03 92.92 38.38 3.32

    Emai l Retrieve Access 5 5 5 5 5 5

    Emai l Retrieve Success % 100.00% 80.00% 100.00% 100.00% 80.00% 70.00%

    Emai l Retrieve Delay 28.85 35.21 11.75 10.6 21.37 1.86

    SMS send Access 10 10 10 10 - -

    SMS e2e Success % 100.00% 100.00% 100.00% 100.00% - -

    SMS send Delay (sec) 6.7 8.4 7.3 6.2 - -

    Delivery Time (sec) 7.2 10.22 10.21 9.3 - -

    MMS send Access 5 5 5 5 - -

    MMS e2e Success % 80.00% 10.00% 10.00% 30.00% - -

    MMS send Delay 15.78 23.89 18.23 11.23 - -

    ABU LANE

  • 8/2/2019 2g Meerut Report

    58/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Location 2: Roadways Bus Stand

    Test Airtel 2G DOCOMO 2G VODAFONE 2G IDEA 2G Reliance EvDo TATA EVDO

    FTP DL Access 5 5 5 5 0 5

    FTP DL Success 5 1 5 5 0 2

    FTP DL Accessibility 100.00% 20.00% 100.00% 100.00% 0 40

    FTP DL Mean Data rate(Kbps) 92.84 18.12 133.34 91.74 0 149.28

    Email Send Access 5 5 5 5 5 5

    Email Send Success % 100.00% 80.00% 100.00% 100.00% 100.00% 40

    Email Send Delay 14.82 16.35 34.44 42.65 82.37 11.13

    Email Retrieve Access 5 5 5 5 5 5

    Email Retrieve Success % 100.00% 100.00% 100.00% 100.00% 100.00% 40

    Email Retrieve Delay 9.23 80.37 13.47 43.1 72.47 4.41

    SMS send Access 10 10 10 10 - -

    SMS e2e Success % 100.00% 100.00% 100.00% 100.00% - -

    SMS send Delay (sec) 7.92 5.5 6.8 9.28 - -

    Delivery Time (sec) 9.98 10.1 11 9.34 - -

    MMS send Access 5 5 5 5 - -

    MMS e2e Success % 80.00% 0.00% 20.00% 100.00% - -

    MMS send Delay 15.24 0 19.21 12.78 - -

    ROADWAYS BUS STAND

  • 8/2/2019 2g Meerut Report

    59/65

  • 8/2/2019 2g Meerut Report

    60/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Location 4: Shastri Nagar

    Test Airtel 2G DOCOMO 2G VODAFONE 2G IDEA 2G Reliance EvDo TATA EVDO

    FTP DL Access 5 5 5 5 5 5

    FTP DL Success 5 0 5 5 5 4

    FTP DL Accessibility 100.00% 20.00% 100.00% 100.00% 100% 80%

    FTP DL Mean Data rate(Kbps) 107.28 0 125.67 76.34 198.54 156.77

    Email Send Access 5 5 5 5 5 5

    Email Send Success % 100.00% 100.00% 100.00% 100.00% 100.00% 100%

    Email Send Delay 16.72 16.56 13.89 19.31 18.23 11.49Email Retrieve Access 5 5 5 5 5 5

    Email Retrieve Success % 100.00% 100.00% 100.00% 100.00% 100.00% 100%

    Email Retrieve Delay 9.76 15.67 17.98 12.76 18.3 18.88

    SMS send Access 10 10 10 10 - -

    SMS e2e Success % 100.00% 100.00% 100.00% 100.00% - -

    SMS send Delay (sec) 7.4 8.67 4.7 8.66 - -

    Delivery Time (sec) 3.67 18.88 11.22 7.23 - -

    MMS send Access 5 5 5 5 - -

    MMS e2e Success % 100.00% 0.00% 20.00% 0.00% - -

    MMS send Delay 18.97 0 16.23 0 - -

    SHASTRI NAGAR

  • 8/2/2019 2g Meerut Report

    61/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Location 5: Sadar Bazar

    Test Airtel 2G DOCOMO 2G VODAFONE 2G IDEA 2G Reliance EvDo TATA EVDO

    FTP DL Access 5 5 5 5 5 5

    FTP DL Success 5 3 5 5 5 5

    FTP DL Accessibility 100.00% 60.00% 100.00% 100.00% 100% 100%

    FTP DL Mean Data rate(Kbps) 99.03 92.76 78.61 89.09 166.23 196.56

    Email Send Access 5 5 5 5 5 5

    Email Send Success % 100.00% 100.00% 100.00% 100.00% 100.00% 100%

    Email Send Delay 12.74 19.85 17.45 11.12 16.8 12.53

    Email Retrieve Access 5 5 5 5 5 5

    Email Retrieve Success % 100.00% 100.00% 100.00% 100.00% 100.00% 100%

    Email Retrieve Delay 8.28 9.1 14.25 10.21 9.61 6.1

    SMS send Access 10 10 10 10 - -

    SMS e2e Success % 100.00% 100.00% 100.00% 100.00% - -

    SMS send Delay (sec) 6.3 6.22 8.59 9.2 - -Delivery Time (sec) 5.43 9.69 10.41 5.19 - -

    MMS send Access 5 5 5 5 - -

    MMS e2e Success % 60.00% 0.00% 0.00% 40.00% - -

    MMS send Delay 16.99 0 0 21.48 - -

    SADAR BAZAR

  • 8/2/2019 2g Meerut Report

    62/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Section 6

    Summary

    SWOT Analysis for Airtel

    Key findings

  • 8/2/2019 2g Meerut Report

    63/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    SWOT Analysis for Airtel

    Lowest ping latency as compared to competitorindicating lowest delay to access data network

    Poor Email success rate as compared to otheroperators

    HTTP browsing success rate is poor as www.zedge.net, www.nokia.com and www.cricinfo.com site was themost failed sites.

    Low FTP DL success rate Ping delay Lowest call drop rate

    STRENGHTS

    Voice Quality Accessibility Retainability

    By improving HTTP statistics for few of the sitesoverall data score can be improved

    THREATS

    Both Vodafone & Idea can take the lead byimproving little coverage & quality and enjoy thefacilities of MNP

    OPPORTUNITIES

    Coverage improvement Download Throughput

    WEAKNESS

    Coverage FTP DL Throughput

  • 8/2/2019 2g Meerut Report

    64/65

    All Rights Reserved Alcatel-Lucent 2006, #####

    Key Findings

    Voice:

    Speech Quality: Airtel is leading as per SpeechQuality amongst all other operators.

    Data:

    GPRS utilization is high on Airtel compared to

    EDGE with other operators leading to lower

    FTP download throughput.

    Key Suggestions:

    Resource allocation (TS) need to be verified for

    optimum DATA usage.

    Coverage & Quality need to be looked upon in

    main city center (Cluster 5).

  • 8/2/2019 2g Meerut Report

    65/65