Professional Documents
Culture Documents
SECRET
Reviewed by Date
Reviewed by Date
Approved by Date
Revision record
Contents
1. SSV Test....................................................................................................................................................................4
2. KPI Test.....................................................................................................................................................................7
3. Measure Method......................................................................................................................................................33
1. SSV Test
1) First should check the azimuth and tilt, any problem the work should be
only 6 points needed) to do the network entry/ Download/ upload/ ping test.
3) If the teams find any problem (include but not only: wrong BSID or PCI; low
throughput; high ping delay) in the test they should report it to coordinator
right now. Take care on the feeder across! At last finish and submit the SSV
supervisor. And the remaining test for this site should be stopped.
5) Throughput test should be done with FTP. Currently, there is one Huawei
because it can download several files together.) to download the files (at
10.212.195.139 –n 100” > enter-> wait until output 10 ping delay result on
2. KPI Test
If the SSV test is clear, the teams can go ahead to the KPI test. KPI test include
Drier test and Points test.
1) Tools prepared:
iv. GPS
2) Softwares prepared:
vi. Inster LTE Dongle in your laptop, you will see the picture on “My
Computer”, then Double-click this picture, auto install the software.
viii. Please confirm the LTE Dongle、GPS and Probe Dog in your laptop.
xix. Add MS
xxiv. Loading-in Test Plan, the test plan will be provided by huawei. But you need
to change FTP Upload file to your local file(20M).
xxvii. Select Map File(TAR file), the map file will be provided by huawei
xxx. Finish all setting, then “connect” to LTE Dongle and GPS.
xxxi. Please begin the log recording before DT, you need to open test plan, then
Huawei Confidential No spreading without permission Page 23 of 34
SECRET
LTE KPI DT GUIDE & MEASURE METHOD
3) Begin DT
ii. All the streets should be covered. The speed should less than 30km/h. In
the DT engineers should always pay attention on the PCI/RSRP/SINR. If
any problem happened they should click the “pause” button to pause the
test and after solving continue the test. Any problems like KPI fail to
achieve must be informed to Huawei on time. After DT the log should be
transferred to Huawei.
iii. In the DT the team should always take care the PCI and performance, the
bad performance DT log or wrong test log will need repeating work. It is ok
Huawei Confidential No spreading without permission Page 25 of 34
SECRET
LTE KPI DT GUIDE & MEASURE METHOD
that feedback the problems to Huawei when you meet some problems.
4) Begin PT
To the cell edge coverage probability, select 20 edge points (SINR is higher
than 0dB but lower than 5dB & RSRP is lower than -100dB) to perform ftp
download, each point last 1 min. Record the detail coordinates and test results.
The RSRP and SINR must be check from Probe, you can use test plan to
sector level” pictures, check the RSRP and SINR like this picture:
Record the average throughput of the 3 points. This test should be implemented
for 20% of sectors per cluster.
The RSRP must be check from Probe, then you can test plan to finish this
work.This test plan PT will be provided by huawei. And you need to take a
Snapshots like the “Average downstream throughput – sector level” pictures.
DL:
UL:
Please pay more attention to the DL throughput of one point must over 35M.
The DL throughput of the other point must over 15M.
In addition, you need to add MCS to your PT logs, like this snapshot to open
MCS, and check DL MCS:
The Rank2 SINR1 and MCS must be check from Probe, you can use FileZilla or
test plan, this test plan PT will be provided by huawei. And you need to take a
Snapshots like this:
DL Snapshot
UL Snapshot
To the Maximum round trip latency, select 1 edge point to perform the ping test.
This point must be meet the condition of -100<RSRP<-90.The ping packet size
is 32KB and the ping repeat time is 100. Record the average ping delay. This
test should be implemented for 20% of sectors per cluster.
v. Maximum Jitteryf
Calculate the maximum jitter based on above ping result. 5 biggest jitter values
can be canceled. This test should be implemented for 20% of sectors per
cluster.
The LTE Stationary KPI template in here, please finish this PT test report use
this template.
Wimax<E
Mobi l y_LTE PT report t empl et e. xl s
i. SSV report;
ii. DT logs.
Snapshots for Cell edge coverage probability, sector level throughput, terminal
level throughput; the result summary table (refer to attachment)
3. Measure Method
KPI Test includes DT and PT (point test).
1) DT:
i. The DT will follow before confirmed wimax DT boundary. Using Huawei
E398s USB terminal and Huawei Genex Probe&Assistant DT software
to perform the DT. During the DT the engineers should parallel
perform network entry, minimum guarantee DownLoad/UpLoad test.
By this after the DT can get the test result of coverage probability/
successful setup rate / session establish delay/ dropped session rate/
minimum rate guarantee of downstream&upstream/ handoff/ HSR/
wireless link burst error rate.
ii. To the coverage probability, need to show out the statistic of points
percentage of RSRP>-110dBm&SINR>-3dB, show the RSRP & SINR &
PCI map picture.
iii. Successful setup rate= ERAB Setup Success Counter / ( ERAB Setup
Success Counter + ERAB Setup Failure Counter);
iv. Session establishment delay= T(Attach CMP)-T(Attach REQ);
v. Dropped session rate= ERAB Abnormal Rel Counter / ERAB Setup Suc
Counter.
vi. To the minimum rate guarantee of downstream&upstream, the
engineers will perform ftp download and upload by one fixed size file
(DL 80MB and UL 20MB) with non-GBR account, the
download&upload will be ceaselessly repeated until finish the DT.
Then calculate the average throughput of these tests. The test result
will be filtered as contract requirements and only the valid service
result will be calculated. This after filter result will be the KPI result of
this test item.
vii. Handover successful rate(HSR)= HO Success Counter / ( HO Success
Counter + HO Failure Counter);
viii. In any 1 min of the DT cannot happen more than 6 times HO, if this
not happen, the handoff test is passed.
ix. To the wireless link burst error rate, calculate the average RBLER in
the DT, the average RBLER of the DT should be less than 1% to
achieve the contract KPI.
x. All the above test result will be filtered as the RF test condition
defined in contract and the final result listed in the report should
base on the test result after this filter. The service drop or test fail
happened at bad RF points defined by contract will be excluded.
Besides, Huawei should provide all the original logs when submit the
KPI reports.
Huawei Confidential No spreading without permission Page 33 of 34
SECRET
LTE KPI DT GUIDE & MEASURE METHOD
2) PT:
xi. To the cell edge coverage probability, select 20 edge points (SINR is
higher than 0dB but lower than 5dB & RSRP is lower than -95dBm) to
perform ftp download, each point last 1 min. Do a statistic for the
successful service points percentage.
xii. To the average downstream/upstream throughput (terminal level),
select 3 points (RSRP=-105~-95 / -95~-80/ >-80) to perform the ftp
download/ upload for 1 min. Record the average throughput of the 3
points. This test should be implemented for 20% of sectors per
cluster
xiii. To the average downstream/upstream throughput (sector level), use 2
or 3 terminals (can be negotiated by Mobily & Huawei to detail test
requiremtns) to perform the ftp download/ upload for 1 min at the
same time. In the 2 terminals condition the modulation should be
around 64QAM and 16QAM. This test should be implemented for 20%
of sectors per cluster.
xiv. To the Maximum round trip latency, select 1 edge point (RSRP=-100~-
90) to perform the ping test. The ping packet size is 32KB and the
ping repeat times is 100. Record the average ping delay. This test
should be implemented for 20% of sectors per cluster.
xv. Calculate the maximum jitter based on above ping result. 5 biggest
jitter values should be canceled. This test should be implemented for
20% of sectors per cluster.
xvi. As contract requirements, if the site has other commercial users, the
throughput KPI is not must achieved, DT team just normally record
the test result & the slot occupy rate from NOC M2000. For that the
test is a long term work and the ftp problem is always met, as to
avoid any delay by the ftp server, to all the ftp related test items
Huawei can use either Mobily ftp server (ftp.bayanat.com.sa) or
Huawei server.
xvii. Huawei should provide all the original logs when submit the KPI
reports.
xviii. KPI test report template
LTE- KPI
Report_Dawadmi. ppt