This document discusses how to maximize the efficiency of benchmarking mobile networks and delivering optimal customer experience. It recommends taking a customer-centric approach using active testing and monitoring in addition to passive monitoring to identify issues before customers and reduce troubleshooting time. Active monitoring from probes can provide network statistics, traces, and user experience metrics to help operators efficiently manage network capacity and customer experience on complex 4G networks experiencing high traffic growth.

1. How to
Maximize
Benchmarking
Efficiency
Muhannad Alabweh
Tech Sales & Services Manager
Ascom Network Testing
Deliver Optimal Customer Experience

2. 2Presentation Name Month Year, © Ascom
AGENDA
CONFIDENTIAL
 Today’s Mobile Services’ Trend
 Subscribers’ Perception
 Video Streaming Testing
 QoE/QoS/KPIs Mapping
 Customer Centric Approach
 Active Testing vs Passive Monitoring

3. 3
47K
App Downloads
6 Million
Facebook views
2+ Million
Google Search queries
1.3 Million
Youtube video views
100K
New tweets
200 Million
Email sent
}1Internet Minute
Today’s Mobile Services’ Trend

4. LTE Asia 2015 - How to Maximize Benchmarking Efficiency and Deliver Optimal Customer Experience 4
MOBILE DEVICES TRAFFIC IMPACT:
105% CRGA 2013-2018
MOBILE DATA TRAFFIC:
52% WILL BE
OFFLOADED
FROM MOBILE
DEVICES
BY 2018
51% WILL BE Via
4G network
BY 2018
Smart phones and
video apps are the
main drivers of the
4G eco-system

5. LTE Asia 2015 - How to Maximize Benchmarking Efficiency and Deliver Optimal Customer Experience 5
Mobile Video
Services and
Applications
75%
ACCOUNTS FOR
IN MOBILE
DATA CONSUMPTION

6. 6
SUBSCRIBERS’
PERCEPTION
DURING
VIDEO STREAMING

7. 7
Voice
POLQA (ITU-T P.863)
Parametric (non-intrusive)
Solutions
P.120x.x (ITU standard ) – PD/RTP,
x=1,2
P.NATS (on going ITU work) – DASH
3rd parties (e.g. VQMon support for PD
and adaptive HTTP/TCP)
Solutions
J.343.x, x=1-6
(TCP based)
3rd parties PEVQ-S
2
3
IP transport/payload parameters of Video packet streams
POLQA (ITU-T P.863)
Voice
Solutions
P.120x.x (ITU standard ) – PD/RTP,
x=1,2
P.NATS (on going ITU work) –
DASH
3rd parties (e.g. VQMon support for
PD and adaptive HTTP/TCP)
IP transport/payload parameters of Video packet streams
Parametric (non-intrusive)
2
HOW CAN WE
TEST AND
BENCHMARK THE
NETWORK
LIKE A REAL
USER?
3
Solutions
J.343.x, x=1-6
(TCP based)
3rd parties PEVQ-S

8. 8
OPTIMIZATION
BEST
PRACTICE

9. KPI
QoS
QoE
Application Layer
(integrity, accessibility,
retainability)
Upper Layers (IP/UDP,
IP/TCP)
(throughput, delay,
Layer 2&3(MAC, RLC, LLC
(messaging reports related to
QoE dimensions e.g. PDP
context, HO info, codec
usage)
Physical layer
(e.g. coverage,
interference)
SUBSCRIBERS’ PERCEPTION
Relationship between QoE, QoS, KPIs
Customer
Experience
Network
Performance

10. 10
QoE QoS/SLA
Service availability (anywhere)
Service accessibility (anytime)
Service retainability
(continuity of service connection)
Ratio: of covered/not covered area (%)
Ratio of refused connections;
blocked call rate (%)
Service access time Average call or session setup time(s)
Service interruption or completion
ratio, drop call rate (%)
Service reliability
(% of satisfied subscribers)
SUBSCRIBERS’ PERCEPTION
Relationship between QoE, QoS, KPIs

11. SUBSCRIBERS’ PERCEPTION
Relationship between QoE, QoS, KPIs
11
QoE QoS/SLA
Service integrity
(Quality of Session/Call)
- Mean Opinion Score -
Average bearer bit rate achieved as ratio
of bit rate demand by application (%)
Bearer stability: Bit rate variation
around negotiated bit rate (%)
Average throughput toward mobile (kb/s)
Average end-to-end delay (ms/s)
Delay variation/jitter (%)

12. 12
SUBSCRIBERS’ PERCEPTION
AT THE CORE OF MOBILE NETWORKS
SUBSCRIBERS: Focus on their perceived
experience with offered network quality and services
SMART DEVICES
CHANGED HOW
USER PERCEIVE &
HOW TO USE MOBILE
NW & SERVICES

13. LTE Asia 2015 - How to Maximize Benchmarking Efficiency and Deliver Optimal Customer Experience
Improve
OPERATIONAL EFFICIENCY
(Coverage/Interference control)
Build
NETWORK
CAPACITY
(capacity management and
optimization)
Manage
CUSTOMER
EXPERIENCE
Multi RAT
Multi core
IMS**
RCS*/
Mobile Cloud
*IP Multimedia Subsystem
**Rich Communication Suite
13
OPERATORS: Cost efficiently manage/control complex
4G networks while coping with high traffic growth
SUBSCRIBERS’ PERCEPTION
AT THE CORE OF MOBILE NETWORKS

14. 14
SOLUTION: Customer experience centric NW testing&
monitoring, network optimization process automation

15. 15
PASSIVE MONITORING SERVICE AVAILABILITY AND QUALITY
6 Subscriber databases4
10 Network Elements2
3 Network Centres3
1 Call – Service Availability and Quality
Money
Time
Resources
When this approach is applied to multiple services for all subscribers for real
time visibility, significant money, time and resource capacity would be
required.
Return >
28 Network Interfaces1

16. 16
CUSTOMER CENTRIC APPROACH
ACTIVE TESTING AND MONITORING
Probes
Network Stats and Traces
CDRs
Logs
Passive Monitoring
Active Monitoring
Customer Complains
User Experience
DPI (Deep Packet Inspection)
TDF (Traffic Detection Function)
Performance Self
Reporting
Node Stats
Find issues before customer do
and reduce MTTR (>60%) with Root Cause of Failure analysis

17. Learn more, visit us at our website:
WWW.ASCOM.COM/NT