You are on page 1of 98

EI KPI Scoring

Test Item Result Measured Value


Voice
Good RxQual samples (0-5) > 96% PASS 98.85%
Good EcNo samples (>-14 dB) > 95% N/A 100.00%
CSFB Redirection success rate > 99% N/A
Accessibility
Frame loss rate < 1% N/A
Good SINR samples (>7dB) > 95% N/A
3G Latency < 150 ms N/A
4G Latency < 50 ms N/A
Sample Count Passed Count

2338 2311
KPI Report v1.7(99)

Radio KPIs

Radio Access Technology Coverage


Overall MS1
Technology Coverage LTE (%) -
Technology Coverage WCDMA (%) -
Technology Coverage GSM (%) 100.00
Technology Coverage CDMA (%) -
Number of InterRAT Handover LTE To WCDMA -
Number of InterRAT Handover WCDMA To GSM -
Number of InterRAT Handover WCDMA To LTE -
Number of InterRAT Handover GSM To WCDMA -
InterRAT Handover LTE To WCDMA Success Rate (%) -
InterRAT Handover WCDMA To GSM Success Rate (%) -
InterRAT Handover WCDMA To LTE Success Rate (%) -
InterRAT Handover GSM To WCDMA Success Rate (%) -
Location Update Success Rate (%) -
3G to 2G HO Service Interrupt Time avg (S.) -

LTE Radio Measurements


Overall MS1
PCC SINR[0] Avg (dB) -
PCC SINR[1] Avg (dB) -
PCC SINR Avg (dB) -
PCC RSRP Avg (dBm) -
PCC RSRQ Avg (dB) -
PCC RSSI Avg (dBm) -
PCC Tx Power Avg (dBm) -
PCC PUCCH Tx Power Avg (dBm) -
PCC PUSCH Tx Power Avg (dBm) -
SCC SINR[0] Avg (dB) -
SCC SINR[1] Avg (dB) -
SCC SINR Avg (dB) -
SCC RSRP Avg (dBm) -
SCC RSRQ Avg (dB) -
SCC RSSI Avg (dBm) -
SCC Tx Power Avg (dBm) -
SCC PUCCH Tx Power Avg (dBm) -
SCC PUSCH Tx Power Avg (dBm) -
Number of Handover Attempt -
Number of Handover Success -
Number of Handover Fail -
Handover Success Rate (%) -
Number of Cell Reselection -

LTE Data Measurements


Overall MS1
Combined L1 PDSCH Throughput (Mbps) -
PCC L1 PDSCH Throughput (Mbps) -
PCC CQI Codeword[0] Avg -
PCC CQI Codeword[1] Avg -
PCC BLER Avg -
PCC Traffic-To-Pilot Ratio Avg 1.00
PCC Serving N Tx Ant Avg 2.00
PCC LTE PDSCH Stream[0] TBS Avg 224.00
PCC LTE PDSCH Stream[1] TBS Avg -
PCC MCS Index Avg 7.00
SCC L1 PDSCH Throughput (Mbps) -
SCC CQI Codeword[0] Avg -
SCC CQI Codeword[1] Avg -
SCC BLER Avg -
SCC Traffic-To-Pilot Ratio Avg -
SCC Serving N Tx Ant Avg -
SCC LTE PDSCH Stream[0] TBS Avg -
SCC LTE PDSCH Stream[1] TBS Avg -
SCC MCS Index Avg -

WCDMA Radio Measurements


Overall MS1
Ec/Io Avg (First Best) (dB) -
RSCP Avg (First Best) (dBm) -
Ec/Io Avg (Active Set Avg) (dB) -
RSCP Avg (Active Set Avg) (dBm) -
RSSI Avg (dBm) -
Tx Power Avg (dBm) -
BLER Avg (%) -
ActiveSetUpdate Success Rate (%) -
N ASET Cells Avg -
Number of WCDMA Cell Reselection -
Number of WCDMA Missing Neighbors -
Soft Handover Success Rate (%) -
Number of Handover Attempt -
Number of Handover Success -
Number of Handover Fail -
Handover Success Rate (%) -
Total Number of Serving cells -
WCDMA Data Measurements
Overall MS1
HSDPA/HSPA+ Throughput Avg (kbps) -
HSUPA Throughput Avg (kbps) -
DL RLC Throughput Avg (kbps) -
UL RLC Throughput Avg (kbps) -
HSDPA CQI Avg -
HSDPA HS-SCCH Usage (%) -
HSDPA/HSPA+ SBLER Avg (%) -
HSDPA/HSPA+ SBLER on 1st Transmission Avg (%) -
HSDPA/HSPA+ N Code Used Avg -
HSDPA/HSPA+ MOD 64QAM Avg (%) -
HSDPA/HSPA+ MOD 16QAM Avg (%) -
HSDPA/HSPA+ MOD QPSK Avg (%) -
HSPA+ CQI B Avg -
HSPA+ CQI A Avg -
HSPA+ CQI DC Primary Carrier -
Data HSPAP CQI DC Secondary Carrier -
HSPA+ CQI DC Secondary Carrier -
HSPA+ Dual Carrier ON (%) -
HSPA+ 2TB Requested Avg (%) -
HSPA+ 1TB Requested Avg (%) -
HSPA+ 64QAM Configured (%) -
HSPA+ MIMO Enabled (%) -
HSDPA Retransmission rate avg (%) -
HSUPA Setup Success rate (%)(FTP UL, HTTP UL) -
HSDPA Setup Success rate (%)(FTP DL, HTTP DL) -

GSM Radio Measurements


Overall MS1
RxLev Avg (dBm) -78.89
RxQual Avg 0.58
C/I Worst (dB) 6.53
C/I Avg (dB) -
Tx Power Avg (GSM-Power Level) 6.50
TA Avg 1.56
Number of Routing area update -
Handover Success Rate (%) 100.00
Number of Handover Attempt 4.00
Number of Handover Success 4.00
Number of Handover Fail -
Number of Serving cells 3.00
Number of GSM Cell Reselection -
Number of Routing Area Update Complete -
Number of GSM Missing Neighbors -

GSM Data Measurements


Overall MS1
DL RLC Throughput Avg (kbps) 4.31
UL RLC Throughput Avg (kbps) 7.46
DL RLC BLER (%) 10.35
DL coding scheme Avg 4.29
UL coding scheme Avg 6.00
DL used Time slot Avg 1.90
UL used Time slot Avg 1.25
GPRS C/I Avg (dB) 9.92
C/I >12 (%) (dB) 50.05
Service KPIs

Voice
Overall MS1
Number of Android Dial by OS 1
Number of Call Attempts by Modem 1
Number of Block calls -
Number of SDCCH Block calls -
SDCCH Block calls (%) -
Number of Call Setup -
Number of Call Established 1.00
Number of Drop calls -
Number of MT Block calls -
Number of MT Drop calls -
CSSR (%) 100.00
CBR (%) -
CDR (%) -
Call Setup Time Avg (s) 5.708
95th Percentile Call Setup Time (s) 5.71
MOS Score Avg -
CSFB MS1
Number of CSFB calls 0
Number of Reselect Back 1
CSFB Success Rate. -
AVG CSFB Call Setup Duration -
AVG CSFB Reselect Back Duration -

Data
Overall MS1
DL Application Throughput Avg (kbps) -
UL Application Throughput Avg (kbps) -
PDP Context Activation Success Rate (%) -
Attached Success Rate (%) -
PS Attach Time Avg (s) -
PDP Context Activation Time Avg (s) -
PDP Context Deactivation Time Avg (s) -
PS drop call rate (%)(FTP DL, FTP UL, HTTP DL, HTTP UL) -
PS call setup time (S.)(Time to first byte FTP, HTTP) -
FTP Download MS1
Test Count -
Application Throughput Avg (kbps) -
Application Throughput Avg (kbps)(Success Session) -
Max Application Throughput (kbps)
Session Setup Success Rate (%) -
Session Complete (%) -
FTP Upload MS1
Test Count -
Application Throughput Avg (kbps) -
Application Throughput Avg (kbps)(Success Session) -
Max Application Throughput (kbps)
Session Setup Success Rate (%) -
Session Complete (%) -
Browse MS1
Test Count -
Application Throughput Avg (kbps) -
Application Throughput Avg (kbps)(Success Session) -
Max Application Throughput (kbps)
Session Setup Success Rate (%) -
Session Complete (%) -
Duration Avg (s.) -
Browse Infomation MS1
Browse Attempt -
Browse Success -
Browse Fail -
Browse Timeout -
Detailed Browse Infomation MS1
Full-Page Load Duration Avg (s.) -
Full-Page Load Duration Avg (s.)(Success Session Only) -
Avg.Browse objects -
Avg.DNS lookup duration (ms.) -
Avg.TCP Sessions -
Avg.TCP Sesstion Setup Durtaion (ms.) -
HTTP Download MS1
Test Count -
Application Throughput Avg (kbps) -
Application Throughput Avg (kbps)(Success Session) -
Max Application Throughput (kbps)
Session Setup Success Rate (%) -
Session Complete (%) -
Duration Avg (s.) -
HTTP Upload MS1
Test Count -
Application Throughput Avg (kbps) -
Application Throughput Avg (kbps)(Success Session) -
Max Application Throughput (kbps)
Session Setup Success Rate (%) -
Session Complete (%) -
Duration Avg (s.) -
Ping MS1
Ping Count -
Packet Sent -
Packet Lost (%) -
Latency (Round Trip time Avg) (ms) -
Max Round Trip time (ms) -
Ookla Speedtest MS1
Test Count -
Download Throughput Avg (kbps) -
Upload Throughput Avg (kbps) -
Latency Avg (ms.) -
Facebook MS1
Post Status Test Count -
Post Photo Test Count -
Download Photo Test Count -
Post Status Success (%) -
Post Photo Success (%) -
Download Photo Success (%) -
Post Photo Throughput Avg (kbps) -
Download Photo Throughput Avg (kbps) -
CVT MS1
CVT AVG LTE CA DL L1 Throughput -
CVT MAX LTE CA DL L1 Throughput -
CVT AVG LTE Non CA DL L1 Throughput -
CVT MAX LTE Non CA DL L1 Throughput -
CVT AVG HSDPA DL L1 Throughput -
CVT MAX HSDPA DL L1 Throughput -
CVT AVG GSM DL L1 Throughput -
CVT MAX GSM DL L1 Throughput -

SMS
Overall MS1
Send Count -
Send Success (%) -
Delivery Success but exceeded timeout limit (%) -
Delivery Time (s) -

MMS
Overall MS1
Send Count -
Send Success (%) -
MMS AP Enable Success (%) -
VoLTE KPI Scoring
RF coverage&quality MS1
RSRP -
SINR -
RSSI -
Accessability MS1
LTE RRC Connection Setup Success Rate -
VoLTE Bearer Setup Success Rate -
Retainability/HO Metrics MS1
LTE Handover Success Rate -
LTE RRC Connection Drop Rate -
Handover Latency -
SIP Metrices MS1
SIP Session Setup Success Rate (SIP Invite to 180 Ringing) -
SIP Session Success Rate (SIP Invite 200 OK to Bye 200 OK) -
SIP Invite to 100 Trying Success Rate -
SIP Setup Time 180 Ringing (SIP Invite to 180 Ringing) -
SIP Handshake Latency (PRACK to PRACK 200 OK) -
SIP Registration Success Rate -
SIP Registration Latency -
SIP Session Disconnect Success Rate -
SIP Disconnect Time (SIP Bye to SIP Bye 200 OK) -
Audio Quality Metrics MS1
MOS (Percentile) -
MOS (Avg.) -
SRVCC MS1
Mobility from EUTRAN to UTRAN success rate -
Mobility from EUTRAN TO UTRAN duration -
Log Information
Overall
Android Version
Android Edition
TAG
Script_Name
Tablet_UUID
Tablet_MAC_Address
Tablet_Start_Script_Time
IMEI
IMSI
Start Time
End Time
Duration
Distance (km.)
Distance (miles)
Original Report Download Link
Original Report Download Link (available for outdoor testing)
Original CSV & MIF Download Link (available for some license)
Original AZQ Replay Log Download Link
MS1
v3.0.742
99
omini hospital kothapet 1st floor 2g
30mins call
-
-
-
'357715074419419
'404490196134107
'2/1/2018 13:59:51.778
'2/1/2018 14:19:35.282
0 hr 19 min 43sec
-
-
http://ei.azenqos.com/logs/2018_1/357715074419419 2_1_2018 14.19.36.xlsx
http://ei.azenqos.com/logs/2018_1/357715074419419 2_1_2018 14.19.36_kml.zip
http://ei.azenqos.com/logs/2018_1/357715074419419 2_1_2018 14.19.36.zip
http://ei.azenqos.com/logs/2018_1/357715074419419 2_1_2018 14.19.36.azl
Voice Report
os_dial_time type phone_number init_time alerting_time
2018-1-2 14:00:43.329 MO '9849080077 2018-1-2 14:00:43.775
answer_time end_time setup_duration (ms.) ringing_duration (ms.)
2018-1-2 14:00:49.483 2018-1-2 14:19:27.323 5708.00
call_duration (ms.) end_type end_cause APN APN_Username
1117840.00 Call End User ended call{9849080077}
APN_Password APN_MCC APN_MNC lat lon lat_setup
0.520464716387585 0.450140655503369
lon_setup mos_score speech_codec_rx
-1 AMR:7.40 Kbps,AMR:12.20 Kbps,AMR:4.75 Kbps,AMR:5.90 Kbps
Start_Technology End_Technology Start_SubTechnology End_SubTechnology technology
2G 2G 2G 2G 2G
Summary_Technology Technology_CA_Area gsm_band wcdma_band lte_band lte_pcc
2G GSM 900
lte_scc lte_PCI lte_TAC lte_eNB_ID lte_eNB_Local_Cell_ID time_usage_2g
1121.795
time_usage_2g_850 time_usage_2g_900 time_usage_2g_1800 time_usage_3g time_usage_3g_850
0 1119.248 0 0 0
time_usage_3g_900 time_usage_3g_1800 time_usage_3g_2100 time_usage_4g
0 0 0 0
time_usage_4g_850 time_usage_4g_900 time_usage_4g_1800 time_usage_4g_2100
0 0 0 0
time_usage_4g_2300 RxLev Avg. RxQual Avg. C/I Avg. Ec/Io Avg. Rscp Avg.
0 -78.8781530568619 0.582549187339606
Rsrp Avg. Rsrq Avg. Sinr Avg. Lac CellID GSM_ARFCN_BCCH SC UARFCN
7001 24263 31
lte_earfcn Operator lte_bw MCC MNC frequency_gsm_band frequency_wcdma_band
airtel 404 49 900
frequency_lte_band SIP Setup Time 180 Ringing (SIP Invite to 180 Ringing)
SIP Handshake Latency (PRACK to PRACK 200 OK) SIP Registration Latency
SIP Disconnect Time (SIP Bye to SIP Bye 200 OK) Is CSFB Is CSFB Setup Success
No
CSFB Call Setup Duration CSFB - Reselect back to LTE Duration
CSFB - EMM_ExtendedServiceRequest to MM_CM_SERVICE_REQUEST duration
MM_CM_SERVICE_REQUEST to CC_SETUP duration CC_SETUP to CC_ALERTING duration
896 4810
Remark
This call did not contain CC_ALERTING so CC_CONNECT was used to calculate. CC_SETUP to CC_ALERTING duration instead(nor
Ref Wav File MOS score detail Silent MOS count
N/A 0
RxLev Sub (dBm)

RxLev Sub (dBm)


1200 100.00
90.00
1000
80.00
70.00
800
60.00
Samples Count

Percentage (%)
N Samples
600 50.00 RxLev Sub (dBm) %
40.00 Cumulative %
400
30.00
20.00
200
10.00
0 0.00
-120 to -100 -100 to -90 -90 to -80 -80 to -70 -70 to -10
Range

MS1
from to(excl.) Range RxLev Sub (dBm) % Cumulative % N Samples
-120.00 -100.00 -120 to -100 0.00 0.00 0
-100.00 -90.00 -100 to -90 5.52 5.52 130
-90.00 -80.00 -90 to -80 35.92 41.44 846
-80.00 -70.00 -80 to -70 45.10 86.54 1062
-70.00 -10.00 -70 to -10 13.46 100.00 317

Summary
N 2355
Mean -78.89
SD 7.09
Max -58.00
Median -79.00
Min 0.00

Range Percent(%) N Color


-120 <= x < -100 0 0
-100 <= x < -90 5.52 130
-90 <= x < -80 35.92 846
-80 <= x < -70 45.1 1062
-70 <= x < -10 13.46 317
N Samples
RxLev Sub (dBm) %
Cumulative %
RxQual Sub

RxQual Sub
2500 100.00

2000 95.00

1500 90.00
Samples Count

Percentage (%)
N Samples
RxQual Sub %
1000 85.00 Cumulative %

500 80.00

0 75.00
0 to 2 2 to 4 4 to 6 6 to 8
Range

MS1
from to(excl.) Range RxQual Sub % Cumulative % N Samples
0.00 2.00 0 to 2 85.21 85.21 1993
2.00 4.00 2 to 4 6.88 92.09 161
4.00 6.00 4 to 6 6.76 98.85 158
6.00 8.00 6 to 8 1.15 100.00 27

Summary
N 2339
Mean 0.58
SD 1.39
Max 7.00
Median 0.00
Min 1.00

Range Percent(%) N Color


0 <= x < 2 85.21 1993
2 <= x < 4 6.88 161
4 <= x < 6 6.76 158
6 <= x <= 7 1.15 27
N Samples
RxQual Sub %
Cumulative %
ARFCN BCCH
ARFCN BCCH Color N N(%)
26 30 1.27
31 1951 82.85
109 374 15.88

You might also like