3g benchmarking report jan 2012

Udaipur 3G Benchmark Report February 2012

PhiMetrics Technologies Pvt. Ltd.

Section 1

PhiMetrics Benchmarking Methodology • • • • • • •

Benchmarking Equipment and setup Data Collection Details Voice Testing Algorithm Data Testing Algorithm Strategic Location Testing Benchmarking KPIs: Score Evolution Voice & Data KPI weightages

Executive Summary – Udaipur Udaipur

Details 0.6 Million 37 km² 16,457 per km²

Population Area

Population Density Udaipur Operators

Tech

Band of Operation (MHz)

No. of 3G Cells*

No. of 2G Cells*

Subscribers

Airtel

3G+2G

2100/900

142

20

12.9 Million

Reliance

3G+2G

2100/1800

32

187

5.25 Million

BSNL

3G+2G

2100/900

119

99

5.28 Million

Reliance HSD

EVDO

850

15

2.3 Million

*No of Cells is an indicative no the cells encountered during the Voice drive Subscriber figures are for Rajasthan Circle taken from the latest TRAI report.

Demographics of Udaipur Udaipur , also known as the City of Lakes, is a city, a Municipal Council and the administrative headquarters of the Udaipur district in the state of Rajasthan in western India.

The city lies on the Golden Quadrilateral National Highway (NH) 8, midway between Delhi and Mumbai, located around 700 km from either city.

3 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Benchmarking Equipment and Setup • •

•

Nemo Invex is an evolutionary chassis-based benchmarking solution which combines powerful intuitive software and scalable military grade hardware design to create superior drive-test systems for wireless networks.

It is built upon a modular platform for Quality of Service (QoS) wireless network drive testing, RF optimization and competitive network benchmarking.

The system uses specially configured commercial phones attached to controlling devices in isolation chambers to perform various tests such as voice calls, data calls, video calls etc.

4 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Data Collection Details A benchmarking activity, was carried out in Udaipur for over 250Kms across the city. The details of the activity are: – Total route covered in KMs : approx 250 Kms – Measurement Period : 30th Jan 2012 to 2nd Feb 2012 – Measurement time during the day : 8 AM to 9 PM

Cluster 3: Area Covered: Panchwati, Pulan, Sobhagpura, Ahinsapuri

* Except congested area

– –

Measurement days during the week : Monday to Saturday The drive route was created to cover the dense population area , key commercial area, key residential area. The city was divided into 4 clusters/areas. The route consisted of Highways, Main Roads, Other roads and Streets in the composition mentioned below.

• Highway - 20% • Main Road - 40% • Other Road - 20% • Streets - 20%

Cluster 1: Area Covered: Pichola, Kalaji Goraji

4 Cluster 4: Area Covered: NH - 76

Cluster 2: Area Covered: Hiran Magari, Vardhman Nagar, Jawahar Nagar, Railway Colony

This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Voice Testing Algorithm Test Details

Specifications

No of Operators tested

Dual Mode (Airtel, Reliance, BSNL)

Voice Test Algorithm Call Duration

3 mins (180 Secs)

Idle time in between calls

10 Secs

Continuous call for 3 minute duration with 10 seconds of Idle time. Speech samples (DL and UL) are sent and received which provide the MOS score for voice quality.

This was repeated for the entire duration of collection

6 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Data Testing Algorithm Test Details No of Operators tested

Specifications Dual Mode (Airtel, Reliance,BSNL) EvDo Network (Reliance)

Data Test Algorithm Attach and PDP Activation Ping FTP Download FTP Upload HTTP Email send Email Receive

Before every test 3 times - 32 bytes on www.google.co.in 10 MB (for EvDo) and 15 MB (for Dual Mode) from server 1 MB (for EvDo) and 1 MB ( for Dual Mode ) to Server 10 different websites.

100 KB Email to SMTP server 100 KB Email from POP3 server

No

HTTP Websites

1 2 3 4 5 6 7 8

www.google.com www.facebook.com www.nimbuzz.com www.airtel.in www.cricinfo.com www.vuclip.com www.youtube.com www.admob.com www.zedge.net www.nokia.com

9 10

• After every application test, we have 2 sec Idle time before the next Application is tested.

7 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Strategic Location Testing Strategic Locations No of Operators tested

Specifications Dual Mode (Airtel, Reliance, BSNL) EvDo Network (Reliance)

Data Test Algorithm WAP Test FTP Download

10 different WAP sites 10 MB (for EvDo) and 15MB (for Dual Mode) from Server

Email send

100 KB Email to SMTP server

Email Receive

100 KB Email from POP3 server

SMS

SMS send to same number (160 char)

MMS

MMS send to same number 15 Kb

WAP sites wap.google.co.in m.facebook.com m.orkut.com wapin.com m.cricinfo.com m.vuclip.com m.youtube.com m.admob.com m.zedge.net m.sonyericsson.com

Apart from the above tests during the drive, at 5 strategic locations across the city, additional stationary tests were carried out. These locations are important locations of the city.

1. Airport

4. Suraj Pol

2. Bus Stand

5. Trident Hotel

3. Chetak Circle

8 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Benchmarking KPIs: Score Evolution

  

Each KPI is then measured on a scale of 0 to 200 on the basis of performance.

Value of the Particular KPI is not reported default score is 100.

The Score is then weighted with the respective weightages to arrive at an overall Voice or a Data Score.

9

This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Voice & Data Quality Score 5 KPI’s are used to arrive at the Voice Quality Score and 15 KPI’s are used to arrive at the Data Quality Score Following are the details of weightings assigned to different KPIs. These are used for arriving at the final ranking of the operator.

*Coverage Calculation: Coverage = A%*10+B%*8+C%*6+D%*1 10

GRADE A B C D

RSCP IN dBm 0 to -74 -74 to -82 -82 to -90 -90 to -98

10

Section 2

Management Summary • • • • •

Overall Voice Quality Score Overall Data Quality Score SWOT Analysis for Airtel Voice Quality Score Data Quality Score

Voice Quality Score VQI

CSSR

CST 192

2.1

1

2.54

1

CCR 100% 99.64% 99.05%

4.06

100%

1

1

99.35%

3 2

3G Coverage

MOS 100% 3

98.78% 96.16% 2

1

95.85%

115

3.77

3

97.00%

3.71 3.66

2

1

3.86 88 3

85.00% 3

62 3

4.68

2

1

Airtel 3G

2

Reliance 3G

3

BSNL 3G

2

0

9.82

77.26%

VQI Scoring

VCQI

CST

CSSR

CCSR

MOS

Coverage

Airtel 3G Reliance 3G BSNL 3G

142.05 23.81 72.33

162.00 121.20 115.50

90.1 7 32.2

148.7 34.3 0

167.1 0 155.7

130.9 0 76.3

CST= Call Setup Time

65.00%

2

CSSR= Call Setup Success Rate

68.00%

0:00%

3.06

Call setup time, Accessibility, Retainability,MOS, Coverage

CCR= Call Completion Rate MOS= Mean Opinion Score

12

Data Quality Score DCQI

HTTP

FTP UL

FTP DL

163

200

Email 200

200

200

170

PING

PDP Context

Data Attach

200

200

2

1

1

4

147 159 107

140 123

4

108

133

118 81

1

100

1

4

87

100

1 80

2

2

100

4

100

100

3

1

2 4

58

4 61

4 2

56

60

1

53

62

62

41

3

3 1

3

13

2 3 4

3

0

0

3

DQI Scoring

DCQI

HTTP

FTP DL

FTP UL

Email

Airtel 3G Reliance 3G BSNL 3G Reliance EvDo

78.28 48.54 7.25 62.29

8.2 0 0 0

92.64 79.62 0 65.28

178.88 74.82 0 103.6

89.97 83.61 22.35 58.47

9

Data Attach 65.12 0 77.08 100

2

0

PDP Context 163.32 181.08 23.24 100

Ping RTT

54.1 0 0 145.8

0

0

2

3

1

Airtel 3G

2

Reliance 3G

3 4

BSNL 3G Reliance EvDo

13

0

Section 3

Detailed Voice Analysis • • • •

Voice Performance Analysis Coverage Distribution Call Setup Time Call Setup Success Rate –

•

Call Completion Success Rate –

• •

Call Completion Failure Analysis

Accessibility V/s Retainability: Market Comparison Voice Quality: MOS – – –

•

Call Setup Failure Analysis

Airtel MOS Performance Airtel EcIo, BLER Pilot Pollution Analysis

Handover Analysis

Voice Performance Analysis Call Setup Time: Airtel has the least call setup time of 2.77 sec.

Call Setup Success Rate: Airtel has 98.77% Accessibility with just 2 block calls in the entire drive test.

Call Completion Success Rate: Airtel has 1 drop call and has 99.38% Retainability in the city.

Voice Quality: Airtel has best speech quality as compared to other operators.

Parameter Call Setup Time Accessibility Retainability MOS Coverage Best Operator

Best Value 2.77 sec 98.77% 99.38% 3.95 89.64%

Operator Airtel Airtel Airtel Airtel Airtel

Airtel 3G

Operator

Coverage

Accessibility

Retainability

Call Setup Time

Voice Quality

Airtel 3G

1

1

1

1

1

Reliance 3G

3

3

2

2

3

BSNL 3G

2

2

3

3

2

Ranking for Voice KPIs

15 This report is generated in Phimetrics Proprietary format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Coverage Distribution Coverage was measured with the help of a digital scanner/phone for all the networks.

Operator

% of Samples > -82

Coverage Rate using formula

Rank

Airtel 3G

88.32%

89.64%

1

Reliance 3G

49.70%

60.95%

3

BSNL 3G

73.50%

80.27%

2

•

Airtel has good 3G coverage footprint in the city as compared other operators.

•

Reliance coverage was found to be noncontiguous which might be due to temporary failure.

16 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Coverage Plot

•

There were some poor coverage patches(highlighted areas) in the city. Cluster 3 has lower coverage which includes industrial areas and Udaipur bypass.

17 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Radio Technology Distribution

•

Airtel has almost all its voice traffic on 3G, which has resulted in better voice quality compared to other operators.

18 This report is generated in Phimetrics Proprietary format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Call Setup Time (CST) •

Airtel has the best call setup time compared to other 3G operators.

19 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Call Setup Success Rate Call Setup Success Rate is a measure of subscriber experience associated with the access to network resource. It consists of congestion of network or unavailability of network resources.

Operator

Call Attempts

Blocked Calls

CSSR

Block Rate

Airtel 3G

162

2

98.77%

1.23%

Reliance 3G

165

6

96.36%

3.64%

BSNL 3G

172

5

97.09%

2.91%

•

Airtel has 98.77% Accessibility with 2 fail calls.

Call Setup Success Rate

Airtel 3G

Reliance 3G

BSNL 3G

Total Calls Attempts

162

165

172

1

1

1

Technology

Blocked Call Reasons (Radio Cause)

2G

SDCCH Drop

2G

High RxQual

1

2G

Bad Downlink Coverage

2

2G

TCH Assignment failure

1

3G

RRC Connection failed

3G

Bad Downlink Coverage

3G

Missing Neighbour

3G

High BLER

1

3G

Poor EcIo

1

2 1 1

Total

2

6

5

CSSR

98.77%

96.36%

97.09%

20

This report is generated in Phimetrics Proprietary format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves he right to use this format for its other customers if required.

Call Completion Success Rate Call Completion Success Rate is a measure of subscriber experience associated with the continued use of network resources that have been granted. It consists of radio link drops or abnormal network-initiated releases.

Operator

Total Call Established

Dropped Calls

CCSR

Drop Rate

Airtel 3G

162

1

99.38%

0.63%

Reliance 3G

165

5

96.86%

3.14%

BSNL 3G

172

22

86.83%

13.17%

•

Airtel has 99.38% call completion rate with 1 drop call.

Call Completion Success Rate

Airtel 3G

Reliance 3G

BSNL 3G

Total Calls Established

162

165

172

Technology

Dropped Call Reasons

2G

DL Interference

2

2G

Bad Downlink Coverage

3

3G

Missing Neighbour

3G

Missing Handover

3G

Low EcIo

1

3G

RRC Release received

20

1 1

Total

1

5

22

CCSR

99.38%

96.86%

86.83%

21 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Call Setup Failure & Drop Plot

Fail Call

Drop Call

22 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Accessibility V/s Retainability: Market Comparison

23 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Voice Quality: UL & DL MOS •

Airtel has better DL and UL speech quality amongst all operators.

24 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Plot DL MOS

DL MOS

25 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Plot EcNo/ BLER

Ec/No

BLER

26 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Pilot Pollution Airtel

•

A scan was performed to detect all PSCs that were within 10dB Max CPICH EcNo

•

It was found that there were a lot of instances where up to 7 PSCs were found in certain locations.

These could cause substantial Interference. Due to Fast Fading, the instantaneous EcIo could go below the threshold and cause a call to be dropped

•

Some of the areas in cluster 1 and 2 have more number of polluting cells.

27

This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Handover Performance Inter cell Handovers HO Attempts HO Success HO failure Success Rate Avg HO Duration (s)

2G handovers Airtel 3G Reliance 3G 25 362 358 24 1 4 96.00% 98.90% 0.116 0.126

BSNL 3G 118 109 9 92.37% 0.161

Intracell Handovers HO Attempts HO Success HO failure Success Rate Avg HO Duration (s)

Airtel 3G 9 9 0 100.00% 0.042

Reliance 3G 1 1 0 100.00% 0.088

BSNL 3G 19 19 0 0.00% 0.071

Soft Handovers HO Attempts HO Success HO failure Success Rate

3G-3G Handovers Airtel 3G Reliance 3G 5246 270 270 5246 0 0 100.0% 100.0%

BSNL 3G 2651 2651 0 100.0%

UTRAN Handovers HO Attempts HO Success HO failure Success Rate

IRAT Handovers Airtel 3G Reliance 3G 4 5 4 5 0 0 100.0% 100.0%

BSNL 3G 71 70 1 98.6%

This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Section 3

Detailed Data Benchmarking • •

Data Performance Analysis FTP Performance –

•

HTTP Browsing Analysis –

• • • • • • • •

FTP Application Throughput Analysis HTTP Performance (Airtel)

FTP DL/UL and HTTP Failures Email Performance GPRS Attach and PDP performance Data Access Technology Distribution Ping Response: Latency Performance SMS Analysis MMS Analysis KPI Overview Table

Data Performance Analysis Test Operator Airtel 3G Reliance 3G BSNL 3G Reliance EvDo

Test

FTP Upload (15%) FTP UL Success (40%)

1 3 4 2

FTP Download (25%)

HTTP (30%)

Email Send (5%)

FTP UL HTTP FTP DL Success FTP DL Throughput HTTP Success Throughput Download (40%) (60%) (40%) (60%) time (60%)

1 2 4 3

2 4 3 1

GPRS Attach (5%)

1 2 4 3

1 3 4 2

PDP context activation (5%)

Operator

GPRS attach success rate (60%)

GPRS attach Delay (40%)

PDP context success (60%)

PDP context Delay (40%)

Airtel 3G

2

1

1

2

Reliance 3G

3

3

1

1

BSNL 3G

1

2

3

3

4 1 3 2

Email Send Success (30%)

1 1 4 3

Email Retrieve (5%)

Email Send Email Retrieve time (20%) Success (30%)

2 3 4 1

1 3 4 2

Ping (10%)

Email Retrieve time (20%)

Ping RTT

1 3 4 2

2 4 3 1

•

Airtel have good FTP performance with best downlink and uplink throughput.

•

HTTP browsing performance in terms of browsing success rate.

•

Least GPRS attach delay.

•

Airtel has best Email send success rate.

•

Higher browsing delay.

Ranking for Data KPIs

30 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

FTP Statistics • File transfer is becoming increasingly and legitimately popular as a method of transferring media files (movies and music). • The FTP test is used to test the FTP service availability and to measure the application throughput for file download or file upload. The test is successful when the desired operation (uploading or downloading) has succeeded. • Airtel has best downlink and uplink throughput as compared to other operators. * BSNL has low FTP throughputs due to lack of access to data plans beyond a certain limit.

31 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

HTTP Browsing Analysis

• The web browsing quality of experience is generally associated with the time it takes to locate and download a web page within a web browser application.

• The HTTP Download test was conducted with 10 different websites. The Downloaded Page size was approx 350Kb. • Airtel has higher HTTP browsing time for all web sites.

32 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

HTTP Performance

33 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Airtel FTP DL/UL and HTTP Failures

FTP DL Failure HTTP Browsing Failure FTP UL Failure

34 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Email Send / Retrieve •

A 100KB email was sent and downloaded via the POP and SMTP protocols. This is a close simulation of Users accessing pull mail from their work IDs using their hand phone.

•

Airtel has good overall email performance with least email retrieve delay.

35 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Ping Response: Latency Performance

•

A Latency Test was Conducted with www.google.co.in with 32bytes of data to figure out the round trip time. A Ping Response signifies the average delay it takes to access a particular service.

•

Airtel has high ping latency, as it takes higher number of hops to reach destination server.

36 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Data Access Technology Distribution

• Airtel has spent maximum amount of time on 3G compared to other operators.

37 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Attach and PDP Context Statistics

• Airtel has good GPRS attach and PDP context activation success rate.

• Airtel has higher PDP context delay compared to Reliance.

38 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

CQI & Modulation Scheme

Operator

CQI > 25

HS-DSCH Codes > 8

Airtel 3G

51.89%

43.29%

Reliance 3G

45.59%

21.95%

BSNL 3G

42.33%

39.19%

• Airtel has better channel quality and has been assigned higher number of codes.

39 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

SMS & MMS Analysis

40 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

KPI Overview Table The attached KPI table gives an overview about the most important performance figures collected during this Dual mode Benchmarking campaign.

41 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Section 4

Clusterwise Analysis • • • • •

Clusterwise Summary – Voice Clusterwise Snapshot – Voice Clusterwise Summary – Data Clusterwise Snapshot – Data Cluster Analysis – – – –

Cluster 1 Cluster 2 Cluster 3 Cluster 4

Clusterwise Summary – Voice

Cluster 3

Voice Index Cluster 4

Cluster 1 Cluster 2 Cluster 3 Cluster 4

Airtel

1

1

1

1

Reliance

3

2

3

3

BSNL

2

3

2

2

Cluster 1

Cluster 2

43 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel3G for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Clusterwise Snapshot – Voice

44 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel3G for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Clusterwise Summary – Data

Cluster 3

Cluster 4 Cluster 1

Data Index

Cluster 1

Cluster 2

Cluster 3

Cluster 4

Airtel 3G

1

1

1

1

Reliance 3G

4

3

3

3

BSNL 3G

3

4

4

4

Reliance EvDo

2

2

2

2

Cluster 2

45 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel3G for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Clusterwise Snapshot: Data

46 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel3G for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Cluster 1 (Pichola, Kalaji Goraji) CST

Good

CSSR

MOS

Excellent Coverage

Average

Focus Area: HTTP Browsing Success Rate

Poor

CCR

Best Operator Voice: Airtel 3G Data: Airtel 3G

• Airtel has low HTTP success rate.

1

47 This report is generated in Phimetrics Proprietary format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Cluster 2 (Hiran Magari, Vardhman Nagar, Jawahar Nagar, Railway Colony) CST

Good

Focus Area: Block call and Drop Call MOS

Excellent

Coverage

Best Operator Voice: Airtel 3G Data: Airtel 3G

• Airtel has 2 failed calls and 1 drop call in the entire drive and all of them were in this cluster.

2

CCR

Average

Poor

CSSR

48 This report is generated in Phimetrics Proprietary format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Cluster 3 (Panchwati, Pulan, Sobhagpura, Ahinsapuri) CSSR

Good

MOS

Focus Area: Ping RTT and Downlink throughput

ExcellentCCR

Best Operator Voice: Airtel 3G Data: Airtel 3G

• Airtel has poor downlink throughput in this cluster compared to other clusters

CST

• High ping RTT

Coverage

Average

3

Poor

49 This report is generated in Phimetrics Proprietary format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Cluster 4 (NH-76) CST

Good

Focus Area: FTP DL Statistics CSSR MOS ExcellentCCR

Coverage

Average

Poor

Best Operator Voice: Airtel 3G Data: Airtel 3G

• Airtel has poor FTP DL success rate

4

50 This report is generated in Phimetrics Proprietary format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Section 5

Strategic Locations Analysis • • •

Strategic Location: Overview Strategic Location: Voice Analysis Strategic Location: Data Analysis – – – – – –

Overall Location 1: Airport Location 2: Bus Stand Location 3: Chetak Circle Location 4: Suraj Pol Location 5: Trident Hotel

Strategic Location: Overview

Locations

Latitude

Longitude

Airport

24.62473

73.88862

Bus Stand

24.57684

73.70061

Chetak Circle

24.59066

73.69103

Suraj Pol

24.57998

73.69714

Trident Hotel

24.58082

73.67027

5 Strategic Locations were tested for Voice (Accessibility testing) and Data Tests

52

This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Strategic Location: Voice Analysis Operators

Calls Attempted

Calls Failed

Calls Dropped

Call Setup Time

Airtel 3G

75

0

0

2.65

Reliance 3G

74

0

0

2.99

BSNL 3G

75

0

0

3.18

Failed

•

• •

Locations

Airtel 3G

Reliance 3G

BSNL 3G

Airport

0

0

0

Bus Stand

0

0

0

Chetak Circle

0

0

0

Suraj Pol

0

0

0

Trident Hotel

0

0

0

Voice Testing was done at each location with many short calls of 30s duration were made from a stationary position.

Voice Accessibility was measured.

MOS could not be measured as the duration of the call was too short for voice clips to be relayed

53 This report is generated in Phimetrics Proprietary format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Strategic Location : Data Analysis Test FTP DL Access FTP DL Success FTP DL Accessibility FTP DL Mean Data rate(Kbps) Email Send Access Email Send Success % Email Send Delay Email Receive Access Email Receive Success % Email Receive Delay SMS send Access SMS send Success % SMS send Delay (sec) e2e Delivery Time (sec) MMS send Access MMS send Success % MMS send Delay e2e MMS Delivery Time(sec) WAP Browsing Attempt WAP Browsing Success WAP Browsing Success Rate WAP Browsing Delay

Airtel 3G

Reliance 3G

BSNL 3G

Reliance EvDo

10 10 100.00% 1637.83 15 100.00% 12.4 15 100.00% 9.6 50 100.00% 2.4 6.4 15 80.00% 8.54 37.4

12 0 75.00% 1735.15 15 100.00% 24.5 15 100.00% 11.7 50 90.00% 3.7 6.1 9 20.00% 9.13 20.0

9 0 0% 67.79 15 86.67% 45.3 15 93.33% 27.9 50 94.00% 2.1 3.9 6 0.00% 0.00 0.0

10 0 70.00% 367.88 11 73.33% 9.9 11 73.33% 15.4 -

50

30

40

10

44 88.00% 49.1

18 60.00% 11.9

32 80.00% 39.7

6 60.00% 30.8

-

54 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Location 1: Airport Test

FTP DL Access FTP DL Success FTP DL Accessibility FTP DL Mean Data rate(Kbps) Email Send Access Email Send Success % Email Send Delay Email Receive Access Email Receive Success % Email Receive Delay SMS send Access SMS send Success % SMS send Delay (sec) e2e Delivery Time (sec) MMS send Access MMS send Success % MMS send Delay e2e MMS Delivery Time(sec) WAP Browsing Attempt WAP Browsing Success WAP Browsing Success Rate WAP Browsing Delay

Airtel 3G

Reliance 3G

BSNL 3G

Reliance EvDo

2 2 100.00%

2 2 100.00%

1 0 0.00%

2 0 0.00%

987.97

93.0

32.35

26.27

3 100.00% 13.6 3 100.00% 22.6 10 100.00% 2.4 4.8 3 100.00% 7.99 24.8

3 100.00% 90.4 3 100.00% 34.1 10 70.00% 5.3 10.3 0 0.00% 0.00 0.0

3 100.00% 90.3 3 100.00% 61.9 10 100.00% 2.3 4.5 0 0.00% 0.00 0.0

3 100.00% 17.1 3 100.00% 52.6 -

10

10

10

10

8 80.00% 92.6

4 40.00% 36.4

6 60.00% 65.2

6 60.00% 61.5

55 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Location 2: Bus Stand Test

FTP DL Access FTP DL Success FTP DL Accessibility FTP DL Mean Data rate(Kbps) Email Send Access Email Send Success % Email Send Delay Email Receive Access Email Receive Success % Email Receive Delay SMS send Access SMS send Success % SMS send Delay (sec) e2e Delivery Time (sec) MMS send Access MMS send Success % MMS send Delay e2e MMS Delivery Time(sec) WAP Browsing Attempt

WAP Browsing Success WAP Browsing Success Rate WAP Browsing Delay

Airtel 3G

Reliance 3G

BSNL 3G

Reliance EvDo

2 2 100.00% 2970.318 3 100.00% 15.3 3 100.00% 6.6 10 100.00% 2.3 4.6 3 66.67% 7.41 47.1

3 3 100.00% 2020.502 3 100.00% 7.3 3 100.00% 5.4 10 80.00% 3.5 0.0 3 0.00% 0.00 0.0

2 0 0.00% 124.94 3 100.00% 32.1 3 100.00% 11.4 10 100.00% 2.5 4.6 3 0.00% 0.00 0.0

2 1 100.00% 530.78 3 100.00% 8.9 3 100.00% 5.9 -

10

0

10

-

8 80.00% 37.3

0 0% 0.0

10 100.00% 43.1

-

56 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Location 3 : Chetak Circle Test

FTP DL Access FTP DL Success FTP DL Accessibility FTP DL Mean Data rate(Kbps) Email Send Access Email Send Success % Email Send Delay Email Receive Access Email Receive Success % Email Receive Delay SMS send Access SMS send Success % SMS send Delay (sec) e2e Delivery Time (sec) MMS send Access MMS send Success % MMS send Delay e2e MMS Delivery Time(sec) WAP Browsing Attempt

WAP Browsing Success WAP Browsing Success Rate WAP Browsing Delay

Airtel 3G

Reliance 3G

BSNL 3G

Reliance EvDo

2 1 50.00% 2535.94 3 100.00% 8.4 3 100.00% 4.9 10 100.00% 2.7 17.8 3 100.00% 12.79 20.0

3 3 100.00% 2415.13 3 100.00% 8.7 3 100.00% 7.5 10 100.00% 3.1 5.4 3 100.00% 9.13 20.0

3 0 0.00% 106.75 3 100.00% 9.3 3 100.00% 5.2 10 70.00% 3.0 5.3 0 0.00% 0.00 0.0

2 2 100.00% 331.56 0 0.00% 0.0 0 0.00% 0.0 -

10

10

0

0

10 100.00% 4.4

4 50.00% 3.7

0 0.00% 0.0

0 0.00% 0.0

57 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Location 4 : Suraj Pol Test FTP DL Access FTP DL Success FTP DL Accessibility FTP DL Mean Data rate(Kbps) Email Send Access Email Send Success % Email Send Delay Email Receive Access Email Receive Success % Email Receive Delay SMS send Access SMS send Success % SMS send Delay (sec) e2e Delivery Time (sec) MMS send Access MMS send Success % MMS send Delay e2e MMS Delivery Time(sec) WAP Browsing Attempt WAP Browsing Success WAP Browsing Success Rate WAP Browsing Delay

Airtel 3G

Reliance 3G

BSNL 3G

Reliance EvDo

2 2 100.00% 1228.58 3 100.00% 9.2 3 100.00% 7.2 10 100.00% 2.4 0.0 3 66.67% 7.10 47.8

1 1 100.00% 2123.471 3 100.00% 8.8 3 100.00% 6.1 10 100.00% 3.3 0.0 0 0.00% 0.00 0.0

1 0 0.00% 0.00 3 33.33% 62.7 3 66.67% 49.6 10 100.00% 2.6 4.8 0 0.00% 0.00 0.0

2 2 100.00% 272.81 2 100.00% 14.6 2 100.00% 12.8 -

10

10

10

-

10 100.00% 74.1

10 100.00% 19.2

6 60.00% 47.0

-

58 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Location 5 : Trident Hotel Test

FTP DL Access FTP DL Success FTP DL Accessibility FTP DL Mean Data rate(Kbps) Email Send Access Email Send Success % Email Send Delay Email Receive Access Email Receive Success % Email Receive Delay SMS send Access SMS send Success % SMS send Delay (sec) e2e Delivery Time (sec) MMS send Access MMS send Success % MMS send Delay e2e MMS Delivery Time(sec) WAP Browsing Attempt WAP Browsing Success WAP Browsing Success Rate WAP Browsing Delay

Airtel 3G

Reliance 3G

BSNL 3G

Reliance EvDo

2 2 100.00% 1361.36 3 100.00% 15.3 3 100.00% 6.6 10 100.00% 2.3 4.6 3 66.67% 7.41 47.1

3 0 0.00% 0.00 3 100.00% 7.3 3 100.00% 5.4 10 100.00% 3.5 0.0 3 0.00% 0.00 0.0

2 2 0.00% 23.308 3 100.00% 32.1 3 100.00% 11.4 10 100.00% 2.5 4.6 3 0.00% 0.00 0.0

2 2 100.00% 574.62 3 100.00% 8.9 3 100.00% 5.9 -

10

0

10

-

8 80.00% 37.3

0 0.00% 0.0

10 100.00% 43.1

-

59 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Section 6

Summary • •

SWOT Analysis for Airtel Key findings

SWOT Analysis for Airtel Strengths

Weaknesses

• • • •

• High HTTP browsing time • Higher ping RTT • Poor data performance in cluster 3 in terms of downlink throughputs and RTT • Cluster 3 has poor 3G coverage compared to other clusters

Airtel has least call setup time.

Airtel has best Accessibility and Voice call Retainability.

Airtel has best DL speech quality.

Airtel has 100% FTP UL success rate and best FTP Downlink and Uplink throughput.

Opportunities • 3G coverage can further be improved by improving it in cluster 3 • Ping latency can be improved by optimizing routing nodes and delay for each hops

Threats

• Web Browsing experience is lower compared to other 3G Cities

61 This report is generated in Phimetrics Proprietary format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Observations and Recommendations •

Airtel has the best 3G experience for both voice and data, which can be capitalized given the importance of this tourist place.

•

Cluster 1 and 2 still have few areas which can be further improved for indoor coverage.

•

The Browsing experience can be further improved to widen the gap with its competitors by improving latency.

62 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel3G for other reports. Phimetrics reserves the right to use this format for its other customers if required.

Thank You Prepared by: Sanket Jain Verified by:

Hardik Patel

Attested by:

Mohit Lohani

63