Field testing of mobile devices involves:
- Testing the device's interoperability with live public networks to ensure robust performance and minimize returns.
- A development cycle that includes field testing where the device is connected to a live network under real conditions to identify software quality issues and customer experience.
- Testing features such as call quality, roaming, handover, signal strength, and data performance under different conditions such as urban, suburban, and moving environments.
NETWORK PROBLEM IDENTIFICATION
REQUIREMENT FOR DRIVE TESTING
DRIVE TEST PROCESS
DRIVE TEST OUTPUTS
MEASUREMENT METRICS
DRIVE TEST ANALYSIS
NEPTUNE AND PROBE
Drive Test
OMC Statistics
Customer feedback
NETWORK PROBLEM IDENTIFICATION
REQUIREMENT FOR DRIVE TESTING
DRIVE TEST PROCESS
DRIVE TEST OUTPUTS
MEASUREMENT METRICS
DRIVE TEST ANALYSIS
NEPTUNE AND PROBE
Drive Test
OMC Statistics
Customer feedback
Topics covered in this presentation:
1. What is drive testing?
2. Need for drive testing?
3. Types of drive testing
4. Key Performance Indicators and Parameters
5. Test Methods
Michael Monaghan - Evolution of New Feature Verification in 3G NetworksTEST Huddle
EuroSTAR Software Testing Conference 2009 presentation on Evolution of New Feature Verification in 3G Networks by Michael Monaghan. See more at conferences.eurostarsoftwaretesting.com/past-presentations/
MaxEye Technologies enables multiple Digital Video and Audio broadcasting standards using single hardware platform. This reduces testing time and cost significantly compared to traditional testing.
Topics covered in this presentation:
1. What is drive testing?
2. Need for drive testing?
3. Types of drive testing
4. Key Performance Indicators and Parameters
5. Test Methods
Michael Monaghan - Evolution of New Feature Verification in 3G NetworksTEST Huddle
EuroSTAR Software Testing Conference 2009 presentation on Evolution of New Feature Verification in 3G Networks by Michael Monaghan. See more at conferences.eurostarsoftwaretesting.com/past-presentations/
MaxEye Technologies enables multiple Digital Video and Audio broadcasting standards using single hardware platform. This reduces testing time and cost significantly compared to traditional testing.
𝘼𝙣𝙩𝙞𝙦𝙪𝙚 𝙋𝙡𝙖𝙨𝙩𝙞𝙘 𝙏𝙧𝙖𝙙𝙚𝙧𝙨 𝙞𝙨 𝙫𝙚𝙧𝙮 𝙛𝙖𝙢𝙤𝙪𝙨 𝙛𝙤𝙧 𝙢𝙖𝙣𝙪𝙛𝙖𝙘𝙩𝙪𝙧𝙞𝙣𝙜 𝙩𝙝𝙚𝙞𝙧 𝙥𝙧𝙤𝙙𝙪𝙘𝙩𝙨. 𝙒𝙚 𝙝𝙖𝙫𝙚 𝙖𝙡𝙡 𝙩𝙝𝙚 𝙥𝙡𝙖𝙨𝙩𝙞𝙘 𝙜𝙧𝙖𝙣𝙪𝙡𝙚𝙨 𝙪𝙨𝙚𝙙 𝙞𝙣 𝙖𝙪𝙩𝙤𝙢𝙤𝙩𝙞𝙫𝙚 𝙖𝙣𝙙 𝙖𝙪𝙩𝙤 𝙥𝙖𝙧𝙩𝙨 𝙖𝙣𝙙 𝙖𝙡𝙡 𝙩𝙝𝙚 𝙛𝙖𝙢𝙤𝙪𝙨 𝙘𝙤𝙢𝙥𝙖𝙣𝙞𝙚𝙨 𝙗𝙪𝙮 𝙩𝙝𝙚 𝙜𝙧𝙖𝙣𝙪𝙡𝙚𝙨 𝙛𝙧𝙤𝙢 𝙪𝙨.
Over the 10 years, we have gained a strong foothold in the market due to our range's high quality, competitive prices, and time-lined delivery schedules.
5 Warning Signs Your BMW's Intelligent Battery Sensor Needs AttentionBertini's German Motors
IBS monitors and manages your BMW’s battery performance. If it malfunctions, you will have to deal with an array of electrical issues in your vehicle. Recognize warning signs like dimming headlights, frequent battery replacements, and electrical malfunctions to address potential IBS issues promptly.
Core technology of Hyundai Motor Group's EV platform 'E-GMP'Hyundai Motor Group
What’s the force behind Hyundai Motor Group's EV performance and quality?
Maximized driving performance and quick charging time through high-density battery pack and fast charging technology and applicable to various vehicle types!
Discover more about Hyundai Motor Group’s EV platform ‘E-GMP’!
What Exactly Is The Common Rail Direct Injection System & How Does It WorkMotor Cars International
Learn about Common Rail Direct Injection (CRDi) - the revolutionary technology that has made diesel engines more efficient. Explore its workings, advantages like enhanced fuel efficiency and increased power output, along with drawbacks such as complexity and higher initial cost. Compare CRDi with traditional diesel engines and discover why it's the preferred choice for modern engines.
"Trans Failsafe Prog" on your BMW X5 indicates potential transmission issues requiring immediate action. This safety feature activates in response to abnormalities like low fluid levels, leaks, faulty sensors, electrical or mechanical failures, and overheating.
What Does the Active Steering Malfunction Warning Mean for Your BMWTanner Motors
Discover the reasons why your BMW’s Active Steering malfunction warning might come on. From electrical glitches to mechanical failures and software anomalies, addressing these promptly with professional inspection and maintenance ensures continued safety and performance on the road, maintaining the integrity of your driving experience.
What Does the PARKTRONIC Inoperative, See Owner's Manual Message Mean for You...Autohaus Service and Sales
Learn what "PARKTRONIC Inoperative, See Owner's Manual" means for your Mercedes-Benz. This message indicates a malfunction in the parking assistance system, potentially due to sensor issues or electrical faults. Prompt attention is crucial to ensure safety and functionality. Follow steps outlined for diagnosis and repair in the owner's manual.
Symptoms like intermittent starting and key recognition errors signal potential problems with your Mercedes’ EIS. Use diagnostic steps like error code checks and spare key tests. Professional diagnosis and solutions like EIS replacement ensure safe driving. Consult a qualified technician for accurate diagnosis and repair.
In this presentation, we have discussed a very important feature of BMW X5 cars… the Comfort Access. Things that can significantly limit its functionality. And things that you can try to restore the functionality of such a convenient feature of your vehicle.
Why Is Your BMW X3 Hood Not Responding To Release CommandsDart Auto
Experiencing difficulty opening your BMW X3's hood? This guide explores potential issues like mechanical obstruction, hood release mechanism failure, electrical problems, and emergency release malfunctions. Troubleshooting tips include basic checks, clearing obstructions, applying pressure, and using the emergency release.
Things to remember while upgrading the brakes of your carjennifermiller8137
Upgrading the brakes of your car? Keep these things in mind before doing so. Additionally, start using an OBD 2 GPS tracker so that you never miss a vehicle maintenance appointment. On top of this, a car GPS tracker will also let you master good driving habits that will let you increase the operational life of your car’s brakes.
Comprehensive program for Agricultural Finance, the Automotive Sector, and Empowerment . We will define the full scope and provide a detailed two-week plan for identifying strategic partners in each area within Limpopo, including target areas.:
1. Agricultural : Supporting Primary and Secondary Agriculture
• Scope: Provide support solutions to enhance agricultural productivity and sustainability.
• Target Areas: Polokwane, Tzaneen, Thohoyandou, Makhado, and Giyani.
2. Automotive Sector: Partnerships with Mechanics and Panel Beater Shops
• Scope: Develop collaborations with automotive service providers to improve service quality and business operations.
• Target Areas: Polokwane, Lephalale, Mokopane, Phalaborwa, and Bela-Bela.
3. Empowerment : Focusing on Women Empowerment
• Scope: Provide business support support and training to women-owned businesses, promoting economic inclusion.
• Target Areas: Polokwane, Thohoyandou, Musina, Burgersfort, and Louis Trichardt.
We will also prioritize Industrial Economic Zone areas and their priorities.
Sign up on https://profilesmes.online/welcome/
To be eligible:
1. You must have a registered business and operate in Limpopo
2. Generate revenue
3. Sectors : Agriculture ( primary and secondary) and Automative
Women and Youth are encouraged to apply even if you don't fall in those sectors.
2. Field Trials conducted on terminals ensure that the interoperability of
the terminal with the public networks will be robust and minimizes
returns from the market.
3. Development Cycle
Product
Planning
Product validation
( Field Testing)
Product Validation
(LAB Testing)
Final QA
Commercial Sample
QA
•Platform Design & Reference Architecture
•Full protocol stack and man machine interface software
•Functional and Performance Specifications
•Protocol Testing (RF/USIM/Protocols)
•Pre-Conformance-physical & signaling)
•Power consumption testing
•Live Network Testing
•IOT
•Inter-RAT
•Field Trials
•KPI
•DATA performance testing
•Check All the Reported issues should be
closed.
•Carrier approval confirmation.
•Operator Acceptance.
A quick review of all the major issues
Reported.
Field Trial.
OEM/Operator Specific requirement.
Production Issues.
4. Live Network Field Trials & IOT
• Field Testing is carried out with the product connected to a live network in real
conditions. Field trials give confidence in end to-end product performance. This
highlights software quality and stability issues and how the product performs for the
customer. This testing can be carried out to customer-specific requirements, network
operator requirements or to the GCF field trial recommendations.
– References :
– DG 11Field Trial Guidelines
– 3GPP org
– Test Case provided by:
• OEM/ODM
• Operator Acceptance
• User Acceptance (UAT)
5. Features Tested in a Field Trials
Some of the features tested in a field trial are:
• Cell selection and reselection
• Network selection
• Location updating
• Speech quality (FR / HR / EFR, AMR)
• Roaming
• Hand over (GSM/GPRS)
• Signal strength
• Routing area updates for GPRS
• GPRS attach and detach
• GPRS PDP activation and deactivation
• Verification of different QOS Parameters.
• TCP/IP traffic (UL/DL) with different Multi slot configurations
• GPRS Authentication
6. Field Test Preparation
• Field test objective definitions (Performance Test: RF Drive test, Call
Test )
• Diagnostic monitor*
• Laptop computer
• Test and reference mobiles, chargers, extra batteries, etc.
• Mass storage device
• GPS receiver ( For guided RF Drive Test , normally applicable to
typical topographies)
• Data/RF cables
• Dual UART for data testing
• Extension cord (s)
• USIM/ RUIM card reader/writer along with its software (for RUIM-
capable mobiles)
7. Field Testing Tools
• Phone Flashing Tool:
Generally these tools are used to download or upgrade the software in phone using desktop/laptop
with the help of data cables.
• Logging/Tracing Tool:
Tracing tool are used to capture the message of device, exchanged between the different layer and
with network while in operation .This help in debugging the errors and problem with the device or
network.
8. Field Testing Tools
• DUT and reference device:
– During a testing phase of a device there should be a reference model for benchmarking and
comparing the performance of the DUT.
• Engineering Mode:
– Engineering Mode is designed to allow a field engineer to view and test the network
information received by a handset, when the handset is either in idle mode or dedicated mode
(that is: with a call active). In each mode, the engineer is able to view network interaction for
the “serving cell” (the cell the handset is currently registered with) or for the neighboring cells.
Test cases:
– Test Case of OEM/ODM (Open Market)
– Test Case Operator Acceptance (operator specific)
• QM Management tool:
– Web based Defect tracking tool, Repository & Centrally Controlled Tool
– Organize & Manage all Phases of Testing Process
– Specifying Testing Requirements
– Planning Tests
– Executing Tests
– Tracking Defects (e.g.. Test Director)
9. Test Environment
• Dense Urban
Dense urban environments consist of lots of multi paths, and 4-, 5-, and 6-way handoffs are
highly visible. Also, the network is usually loaded.
• Urban
Urban environments also have enough multi paths to test 3-, 4-, 5-, and 6-way handoffs. The
network is usually loaded, as well.
• Suburban
There are some multi paths present in suburban environments, but not a lot. Usually, 1- or 2-way
handoffs are normal, and the network is lightly loaded. The mobile may not be locked to one
active Pilot in traffic.
10. Test Environment (Contd..)
• Stationary Environment (MP)
Stationary environments can be divided into near, middle, and far scenarios.
Good (near) coverage area, Rx -70 dBm or better
Medium (middle) coverage area, Rx -70 to -85 dBm
Poor (far) coverage area, Rx -85 to -103 dBm
Most mobile feature and conformance testing is done in a good
GSM/WCDMA coverage area.
• Moving Environment (MR)
Moving environments are very dynamic, and most mobile field testing is carried out in
moving conditions.
25–45 km/h
45–65 km/h
65–100 km/h
Variable speed
11. Drive test Route Selection
• Test Route
A test route is a prescribed traveling/driving route in a GSM/CDMA/WCDMA coverage area used
for field testing in a real, dynamic RF environment.
Depending on the feature being tested and the test equipment involved, the test route can be walked.
• The test route plays a key role in field testing.
Most field testing of network features can be performed in a stationary location in a good
GSM/CDMA/WCDMA coverage area.
• A drive route may consist of, but is not limited to, these features:
• Various received signal strengths along the drive route (coverage
areas)
• Known cell site locations
• Soft/softer handoff areas
• Boundaries of hard handoff, idle handoff, SID/NID, Zone and IP
registrations, etc.
• Various vehicle speeds along the drive route (stop signs, intersections,
freeways, boulevards, etc.)
• Single- and dual-mode areas, CDMA ,GSM,WCDMA, etc.
• GSM, CDMA,WCDMA boundaries and vice versa
12. Quality of Service Testing
Network Services are considered end-to-end, this means from a Terminal Equipment (TE) to
another TE. An End-to-End Service may have a certain Quality of Service (QoS) which is
provided for the user of a network service. It is the user that decides whether he is satisfied
with the provided QoS or not.
To realize a certain network QoS a Bearer Service with clearly defined characteristics and
functionality is to be set up from the source to the destination of a service.
A bearer service includes all aspects to enable the provision of a contracted QoS. These
aspects are among others the control signaling, user plane transport and QoS management
functionality.
Measuring Voice and Data Service Quality
Traditionally, wireless operators have used a number of metrics that collectively provide a
measurement of network service quality from the user perspective. Various operators may
define and measure network performance somewhat differently, but overall service quality
will generally be determined by a combination of the following four key performance
indicators (KPIs).
– System coverage
– Call blockage
– Voice quality
– BER bit error rate
13. Data throughput measurements
Downlink Performance under Mobility Conditions Description
Verify the downlink data performance of EGPRS implementation in live networks.
Reason for test
To ensure that the downlink GPRS/EGPRS/HSDPA data throughput of the ME under test is acceptable under
mobility conditions.
Initial configuration
The MS is GPRS and IMSI attached.
Use the MS in tethered mode as a modem for laptop
Identify a route with 2-3 cell reselections and a Routing Area Update
Test procedure
1. Activate PDP Context
2. Start on the identified route
3. Use DOS FTP to download a 2-15MB file. If possible, utilize a server with minimal latency to the GGSN.
4. Repeat the test 5 times, record the average FTP throughput.
Expected behavior
1. The results of this test are highly dependent upon the number of cell reselections, RAU, and average signal
strength along the drive route. Average downlink throughput under mobility conditions for a two-slot
device should exceed 40 kbps, three-slot devices should exceed 55 kbps, and four-slot devices should
exceed 70 kbps averaged over five FTPs.
2. The data histogram for each test run should indicate relatively few data stalls in excess of 10 seconds.
3. The GPRS connection and file download shall be stable during cell reselection and RAU
14. Call Performance Criterion
All The Short/Medium/Long Call Made during A CP Test Should be under following Test
Condition
– Half Rate Channel
– Full Rate Channel
– Enhance Full rate Channel
RX Sensitivity (RxLev and Rx_Qual)
Short/Medium/Long Call Made during A CP Test Should be under following Test
Condition
Attempt Call in Low Network Area and low RxQuality when
Rxlev <20(90 dbm) and upto RxLev ~5 (105 dbm)
RX Quality (full)
– 0 - less than 0.2% bit errors
– 1 - 0.2 - 0.4% bit errors
– 2 - 0.41 - 0.8% bit errors
– 3 - 0.81 - 1.6% bit errors
– 4 - 1.61 - 3.2% bit errors
– 5 - 3.21 - 6.4% bit errors
– 6 - 6.41 - 12.8% bit errors
– 7 - more than 12.8% bit errors
RXLEV value 0(-110 dbm) to 63(-48 dbm)
– RXLEV 0 = less than -110 dBm.
– RXLEV 1 = -110 dBm to -109 dBm.
– RXLEV 2 = -109 dBm to -108 dBm.
– :
– :
– RXLEV 62 = -49 dBm to -48 dBm.
– RXLEV 63 = greater than -48 dBm.
15. Multimedia Testing
Testing of multimedia services and next-generation handsets is critical to their successful
launch and adoption. However, quality and functional testing of mobile multimedia
applications is not a trivial task, and is distinctly different from testing traditional broadcast
and network-based video services. Developers must contend with network reliability
problems, handset interoperability issues, multiple operating systems, and variations in
service delivery platforms.
16. Application Testing
Application testing and signing programs perform testing at the application-acceptance-
testing level to ensure that your application meets the model’s requirements. This means
that Symbian Signed and Java™ Verified Program criteria documents must be used when
considering application requirements.