2. HUAWEITECHNOLOGIES CO., LTD. HUAWEIConfidential
DTtest is the most direct approach to obtain
network information. DT tests on GPRS
services in the network can collect a serial
of network data for RNO projects. By
analyzing the collected network data, you
can find and correct the existing problems
in the network, thus improving the overall
quality of the network.
Correct and effective DT tests on GPRS
services can provide basis for our future
work.
Introduction
3. HUAWEITECHNOLOGIES CO., LTD. HUAWEIConfidential
Content
Chapter 1: Test Preparations
Chapter 2: Test Specifications
Chapter 3: Test Instances
4. HUAWEITECHNOLOGIES CO., LTD. HUAWEIConfidential
Key Points for Test Preparation
Site test
Environment detection
Test
terminals
Test software
FTP servers
used for test
5. HUAWEITECHNOLOGIES CO., LTD. HUAWEIConfidential
Key Point 1: On-site Environment Detection
Selection of test cells
Perform lock frequency test to avoid handovers
Select the best test route
Selection of test time segments
Select non-hot spot cells for the test
Signal level in the service cell – signal level in neighbor ≥20dB
6. HUAWEITECHNOLOGIES CO., LTD. HUAWEIConfidential
Key Point 2: Requirements for Test Terminals
•Composition of typical drive test equipment
Information of
SIM card
Multislot
capability
Connected to
the laptop
Disconnected with other
networks
Close network access
tasks
Change TCP window in
the register table
Set GPS
correctly
7. HUAWEITECHNOLOGIES CO., LTD. HUAWEIConfidential
Key Points 2: Requirements for Test Terminals
Peak throughput
in PDP context
setting
NCK mode on LLC layer
ACK mode on RLC layer
•SIM cards used for test
8. HUAWEITECHNOLOGIES CO., LTD. HUAWEIConfidential
Key Point 3: FTP Server Used for Test
Test FTP address
provided by the
operator
•Select FTP servers with reliable performance for test
9. HUAWEITECHNOLOGIES CO., LTD. HUAWEIConfidential
key Point 4: Selection of Test Software
Drive test software used by Huawei
Genex Probe
Ericsson TEMS Investigation
Pilot Premier
CDS
12. HUAWEITECHNOLOGIES CO., LTD. HUAWEIConfidential
Test software Installation Interface Workbench Test item Test script Report output Stability
TEMS Complex Friendly
Complete
variety
Many
Can be
edited
Various/comple
x
Good
Premier
Comparatively
complex
Common Single Few Fixed Single/simple
No
response
often
key Point 4: Selection of Test Software
Pilot Premier
TEMS
Investigation
VS
13. HUAWEITECHNOLOGIES CO., LTD. HUAWEIConfidential
Content
Chapter 1 Test Preparations
Chapter 2 Test Specifications
Chapter 3 Test Instances
14. HUAWEITECHNOLOGIES CO., LTD. HUAWEIConfidential
Test Items
Test specifications
CQT DT
Attach
Ping
WAP
FTP
Cell reselection
WEB
FTP
WAP
RAU
Coverage rate
15. HUAWEITECHNOLOGIES CO., LTD. HUAWEIConfidential
GPRS Attach Test
Test method
Perform this test through multiple logging on to GPRS network
Key indexes
Attach success rate
Average attach time
Attach success rate = (Successful GPRS attaches/Total GPRS attach attempts) x100%
Average attach time = Total time for successful GPRS attches/Times for successful GPRS attaches
16. HUAWEITECHNOLOGIES CO., LTD. HUAWEIConfidential
GPRS Attach Test
GPRS Attach interface for TEMS test
detac
h
attac
h
17. HUAWEITECHNOLOGIES CO., LTD. HUAWEIConfidential
Ping Test
Test method
Perform Ping test in the sites of GGSN LAN with the customized of package length
Key indexes
Ping success rate
Average Ping delay
Ping success rate = (Successful Pings/Ping attempts x 100%
Average Ping delay = Sum of time for successful Pings/Successful Pings
18. HUAWEITECHNOLOGIES CO., LTD. HUAWEIConfidential
Ping Test
Edit interface of TEMS test script
Packet length: 32
byte
Times for test
20. HUAWEITECHNOLOGIES CO., LTD. HUAWEIConfidential
WAP Test
Test method
WAP site login test or WAP page refresh test
Key indexes
PDP activation success rate
Average time for PDP activation
PDP activation success rate: successful PDP activations/Total PDP activation attempts ×100%
Average time for PDP activation: Sum of time for successful PDP activations/Successful PDP activations
22. HUAWEITECHNOLOGIES CO., LTD. HUAWEIConfidential
FTP Download Test
Test method
Upload/download files with customized length on the specified server
Key index
FTP download rate on application layer
FTP download rate on application layer = Data amount (Byte) actually downloaded/Actual time (s) for download
24. HUAWEITECHNOLOGIES CO., LTD. HUAWEIConfidential
Mail Download/Upload Test in WEB Mode
Test method
Upload a 100-kByte mail once
Download a 500-kByte mail once
Key indexes
Upload rate on application layer
Download rate of application layer
Upload rate on application layer = Data amount (Byte) actually uploaded/Actual time (s) for upload
Download rate on application layer = Data amount (Byte) actually downloaded/Actual time (s) for download
25. HUAWEITECHNOLOGIES CO., LTD. HUAWEIConfidential
DT Test
1. WAP site login success rate
2. Average time for WAP first page
display
3. WAP page refresh success rate
4. WAP page refresh duration
5. WAP download success rate
6. WAP download rate
7. Average RAU time interval
8. Average RAU distance interval
9. Average cell reselection time interval
10. Average cell reselection distance
interval
11. Coverage rate
12. Call drop rate
13. FTP download rate
Main contents for DT test
26. HUAWEITECHNOLOGIES CO., LTD. HUAWEIConfidential
DT Test
Serial
number
Record items of DT test Definition of item
1 WAP site login success rate Successful WAP site logins/WAP site login attempts ×100%
2 Average time for WAP first page display Sum of time for successful WAP first page display/Successful WAP first page displays
3 WAP page refresh success rate Successful WAP page refreshes/WAP page refresh attempts ×100%
4 WAP page refresh duration Sum of time for successful WAP page refresh/Successful WAP page refreshes
5 WAP download success rate
Successful WAP ringtones and graphics downloads/WAP ringtones and graphics download
attempts ×100%
6 WAP download rate Data amount (Byte) downloaded successfully/Time (s) for successful downloads
7 Average RAU time interval Total RAU times/Total test time (s)
8 Average RAU distance interval Total RAU times/Total test distance (Km)
9 Average cell reselection time interval Total cell reselection times/Total test time (s)
10
Average cell reselection distance
interval
Total cell reselection times/Total test distance (Km)
11 Coverage rate GPRS coverage distance (Km)/Total test distance (Km) X100%
12 Call drop rate Call drops/Total FTP download attempts X100%
13 FTP download rate Total data amount of FTP download/Total time for FTP download (s)
Record items of DT test and their definitions
29. HUAWEITECHNOLOGIES CO., LTD. HUAWEIConfidential
Content
Chapter 1 Test Preparations
Chapter 2 Test Specifications
Chapter 3 Test Instances
30. HUAWEITECHNOLOGIES CO., LTD. HUAWEIConfidential
GPRS Network Optimization Test in Nantong
Test comparison before and after the cutover in some business halls of
Rudong county
Serial
number
Name of business hall
ATTACH duration PDP activation duration PING delay FTP download rate k/s
Before
cutover
After
cutover
Before
cutover
After
cutover
Before cutover After cutover
Before
cutover
After cutover
1 Nanyu business hall 1893 1802 1170 611 1792 1522 3.56 3.74
2 Shidian business hall 4136 1846 1576 772 1696 918 2.9 3.58
3 Tongye garden 1770 1880 856 755 1479 1245 4.78 4.32
4 Yinquan business hall 1583 2267 895 739 959 1086 4.92 4.29
5 Sunyao business hall 1880 1924 878 898 1068 941 4.73 4.1
6 Huanzhen business hall 1577 2217 993 795 957 1372 5.02 3.97
7 Linghe business hall 1875 1975 909 814 1430 943 3.86 3.55
8 Shiping business hall 1679 1882 1194 751 1261 927 3.3 4.27
9 Tongdian business hall 1621 1867 942 767 914 955 3.31 4.42
10 Huafeng business hall 1609 1782 934 746 903 990 4.42 4.76
11 Xiangtai business hall 2029 2345 896 753 836 998 5 4.54
12 Mianchang business hall 1828 1815 932 753 1603 929 5.09 4.64
31. HUAWEITECHNOLOGIES CO., LTD. HUAWEIConfidential
GPRS Network Optimization Test in Baiyin
Test contents
GPRS DT test in main trunk roads
GPRS CQT test in main downtown areas
Test tools
SAGEM OT190
Nokia 6230
Motorola A760
Stopwatch
Laptop
Test software
DingLi Pilot Premier
32. HUAWEITECHNOLOGIES CO., LTD. HUAWEIConfidential
Test item
Test result of
Huawei
Test result before
the optimization
Test result
after the
optimization
Attach test
Attach success rate 100.00% 95.00% 97.00%
Average time (s) 2.0325 1.81 1.77
PDP activation test
PDP activation success rate 100.00% 97.00% 100.00%
Average PDP activation time (s) 2.1279 0.86 0.81
PING test
Success rate 99.00% 95.00% 97.00%
Average delay (s) 2.1336 1.63 1.46
FTP test FTP download (KB/S) 3.0546 3.2 3.52
WAP test
WAP login success rate 94.00% 99.70% 100.00%
Time for first page display (s) 10.7626 9.28 6.01
Refresh success rate 100.00% 100.00% 100.00%
Time for page refresh (s) 4.7886 5.74 4.33
Graphics and ringtones download
success rate
99.00% 99.00% 100.00%
Graphics and ringtones download rate
(Kb/s)
11.5432 17.8 18.9
KJava test
Mobile KJava download rate (Kb/s) 12.6173 15.5 15.9
Mobile KJava download success rate 84.00% 96.20% 96.00%
SMS test
SMS test success rate 100.00% 100.00% 100.00%
SMS end-to-end delay 4.3042 5.2 5.3
MMS test
Push message success rate 100.00% 100.00% 100.00%
Average Push message delay 8.7660 6.5 6.2
Color message end-to-end success rate 87.50% 97.30% 97.00%
CQT Test Result
33. HUAWEITECHNOLOGIES CO., LTD. HUAWEIConfidential
Summary of DT Test Results
Test type Test Item
Test result before the
optimization
Test result after the
optimization
WAP test
WAP site login success rate 97.50% 98.50%
Time for WAP first page display 15.38 13.56
FTP test
Mileage without coverage 0 0
Coverage rate 100.00% 100.00%
Attempted downloads 37 42
Call drops 0 0
Call drop rate 0.00% 0.00%
Average throughput rate (KB/s) on
application layer
2.34 2.77
34. HUAWEITECHNOLOGIES CO., LTD. HUAWEIConfidential
Test Analysis 1 Coverage of RXlevel (RxLevFull) in GPRS network
35. HUAWEITECHNOLOGIES CO., LTD. HUAWEIConfidential
Test Analysis 2 Distribution of downlink RLC BLERs in GPRS network
36. HUAWEITECHNOLOGIES CO., LTD. HUAWEIConfidential
Test Analysis 3 Having no cell for direct coverage, the area between two BTSs has a high bit error rate.
A
37. HUAWEITECHNOLOGIES CO., LTD. HUAWEIConfidential
Test Analysis 4 Distribution of downlink PDCH channels in GPRS network
38. HUAWEITECHNOLOGIES CO., LTD. HUAWEIConfidential
Test Analysis 5
A
There are only two downlink PDCH channels in area A and it affects the download rate.
39. HUAWEITECHNOLOGIES CO., LTD. HUAWEIConfidential
Test Analysis 6 Distribution of Downlink CS Coding Modes in GPRS Network
40. HUAWEITECHNOLOGIES CO., LTD. HUAWEIConfidential
Test Analysis 7
Distribution of Cell Reselection in GPRS Network