Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Advanced network performance
measurement techniques
Dr Neil Davies
Predictable Network Solutions Ltd
Peter Thompson
Predic...
Dr Neil Davies
Co-founder, Predictable Network Solutions Ltd
Peter Thompson
CTO, Predictable Network Solutions Ltd
Martin ...
The only ex ante network performance
engineering company in the world.
Consultancy on the future of
telecoms and the Inter...
Context for this presentation
We are all in the business of “information translocation”
The timely movement of information...
What affects the timeliness?
• The timeliness of application outcomes is dependent on the
end-to-end loss and delay charac...
Good measurement is
NOT about averages
• The average number of legs of a Swedish person is 1.9
– Now find me one!
• Measur...
One-point measures
• This is the typical information captured by equipment
today
– Counters (e.g. packets passed, packet s...
Multipoint measures
• Measure a value between different points
– Not just counting things
• Same “information translocatio...
Different measurement approaches
Average Instantaneous
Single
Point
Offered Load
and Utilisation
(mean values only)
Limite...
Interpreting the two-point measure
© Predictable Network Solutions 2013
Raw data: There’s no discernable structure here
– ...
Sort by packet size:
a clear structure
emerges
Serialisation (or
size-related) delay
S
Packets with bigger payloads experience more structural delay:
it takes longer to ...
Geographic delay
Serialisation delay
Variable contention
delay
G
S
V
Example multi-point measure
The bi-directional, end-to-end path of a small cell
deployment over commodity infrastructure
How to read the information
• Different views tell different stories
• We’ll see some of those stories in the
following sl...
Key to following charts
Two point
measures (by time)
GSV view
(by packet)
V (by time) V (by packet size)
V cumulative
dist...
E to A direction (user experience)Return Transit (run dd0a2310-d235-495b-8d2f-a4dc
0
0.05
0.1
0.15
0.2
0 50 100 150 200 25...
E -> A (by packet)
This ‘spike’ doesn’t appear to be related to a particular packet size
(note ‘striations’ in the S value...
E -> A (Dynamic response)
Removing G and S influences clearly highlights
the magnitude of the contention issue
Spatial Isolation
Same magnitude
issue between D
to B
But not between
D and C
Spatial Isolation (2)
It is occurring
between C and B
NOTE: this is the effect that we are measuring
– NOT the cause (whic...
∆Q for ADSL line
© Predictable Network Solutions 2013
Compare and contrast: baseline data for an ADSL line
∆Q for Femto (over ADSL)
© Predictable Network Solutions 2013
Now run a femtocell over that same line: much worse performa...
Summary
• Multipoint distribution based measurement gives
access to all the information available through
observation
– “o...
Upcoming workshops:
Sustainable Public Service Networks
London, 19th September 2013
Fundamentals of
Network Performance
Lo...
Neil Davies
Neil.Davies@pnsol.com
Peter Thompson
Peter.Thompson@pnsol.com
Martin Geddes
mail@martingeddes.com
PREDICTABLE
...
You’ve finished this document.
Upcoming SlideShare
New Opportunities in Voice and Messaging workshop - ITU Telecom World 2013
Next
Upcoming SlideShare
New Opportunities in Voice and Messaging workshop - ITU Telecom World 2013
Next

Share

Advanced network performance measurement techniques

See how multi-point measures allow you to isolate network performance issues both temporally and spatially.

Related Books

Free with a 30 day trial from Scribd

See all

Related Audiobooks

Free with a 30 day trial from Scribd

See all

Advanced network performance measurement techniques

  1. 1. Advanced network performance measurement techniques Dr Neil Davies Predictable Network Solutions Ltd Peter Thompson Predictable Network Solutions Ltd Martin Geddes Martin Geddes Consulting Ltd PREDICTABLE NETWORK SOLUTIONS © 2013 All Rights Reserved
  2. 2. Dr Neil Davies Co-founder, Predictable Network Solutions Ltd Peter Thompson CTO, Predictable Network Solutions Ltd Martin Geddes Founder, Martin Geddes Consulting Ltd PREDICTABLE NETWORK SOLUTIONS
  3. 3. The only ex ante network performance engineering company in the world. Consultancy on the future of telecoms and the Internet. PREDICTABLE NETWORK SOLUTIONS
  4. 4. Context for this presentation We are all in the business of “information translocation” The timely movement of information from one computational process to another The value lies in delivering application outcomes That people will pay for You are reading this because you are interested in delivering successful outcomes And understanding the causes of failure, so they can be mitigated You may be working in a culture of deflecting the attribution of blame We’d like to help you turn away from the path to the Dark Side
  5. 5. What affects the timeliness? • The timeliness of application outcomes is dependent on the end-to-end loss and delay characteristics of the translocation • We call this end-to-end property ∆Q – ∆Q applies in each direction – not just the round trip – These characteristics need to be suitably bounded • ∆Q depends on the offered load – “Bandwidth” is an aspect of the relationship between offered load and ∆Q This presentation is about measuring ∆Q – and the benefits that approach brings
  6. 6. Good measurement is NOT about averages • The average number of legs of a Swedish person is 1.9 – Now find me one! • Measuring average throughput on a 1Gb link over 10 mins is like measuring the traffic on the M5 motorway over two years – No indicator of my likely travel experience • Need to know the instantaneous properties – The ∆Q the “next packet” is going to get • It is all about the probability distribution of quality attenuation – This is what determines timeliness of application outcomes
  7. 7. One-point measures • This is the typical information captured by equipment today – Counters (e.g. packets passed, packet sizes, packets dropped) – Sampled over a period • Does not capture ∆Q – Not end-to-end • Multiple one-point measures don’t help • Creates an equipment-centric view – Focuses on the equipment, not the service to the customers – Leads to focus on capacity, and ignores schedulability
  8. 8. Multipoint measures • Measure a value between different points – Not just counting things • Same “information translocation” at various points – Measuring the dynamics of the flow • Isolates issues, in both space and time – Excellent diagnostic power • Leads to a focus on schedulability and trading – Which in turn focuses on the outcomes for the customer
  9. 9. Different measurement approaches Average Instantaneous Single Point Offered Load and Utilisation (mean values only) Limited predictive power Arrival Patterns Temporal predictive power, localised assurance (compliance with arrival pattern policy) Multiple Point Delay and Loss (mean and variance) Spatial predictive power Temporal and spatial predictive power Assurance of both arrival and service (demand and supply) – represents all that can be known about a system (by observation) PLUS PLUS
  10. 10. Interpreting the two-point measure © Predictable Network Solutions 2013 Raw data: There’s no discernable structure here – not possible to work with data like this.
  11. 11. Sort by packet size: a clear structure emerges
  12. 12. Serialisation (or size-related) delay S Packets with bigger payloads experience more structural delay: it takes longer to turn the packet into a bitstream, and back again into a packet at the next network element . © Predictable Network Solutions 2013
  13. 13. Geographic delay Serialisation delay Variable contention delay G S V
  14. 14. Example multi-point measure The bi-directional, end-to-end path of a small cell deployment over commodity infrastructure
  15. 15. How to read the information • Different views tell different stories • We’ll see some of those stories in the following slides • The focus on V is because that is where the issues of schedulability manifest themselves
  16. 16. Key to following charts Two point measures (by time) GSV view (by packet) V (by time) V (by packet size) V cumulative distribution function (main) V cumulative distribution function (tail)
  17. 17. E to A direction (user experience)Return Transit (run dd0a2310-d235-495b-8d2f-a4dc 0 0.05 0.1 0.15 0.2 0 50 100 150 200 250 delay(s) run time (s) Observed Delay against Experiment Run Time E->A 0 0.05 0.1 0.15 0.2 0 delay(s) 0.02 0.04 0.06 0.08 0.1 0.12 0.14 delay(s) Observed Delay Variability (V) against Experiment Run Time E->A 0.02 0.04 0.06 0.08 0.1 0.12 0.14 delay(s) Note the delay spike during the test run @ approx 60 seconds in How can be begin to analyse this performance issue?
  18. 18. E -> A (by packet) This ‘spike’ doesn’t appear to be related to a particular packet size (note ‘striations’ in the S value is an artefact of 3GPP scheduling)
  19. 19. E -> A (Dynamic response) Removing G and S influences clearly highlights the magnitude of the contention issue
  20. 20. Spatial Isolation Same magnitude issue between D to B But not between D and C
  21. 21. Spatial Isolation (2) It is occurring between C and B NOTE: this is the effect that we are measuring – NOT the cause (which in this case was not the access network but elsewhere) Armed with this information, we can begin to analyse root causes (e.g. what is over-driving this link?)
  22. 22. ∆Q for ADSL line © Predictable Network Solutions 2013 Compare and contrast: baseline data for an ADSL line
  23. 23. ∆Q for Femto (over ADSL) © Predictable Network Solutions 2013 Now run a femtocell over that same line: much worse performance
  24. 24. Summary • Multipoint distribution based measurement gives access to all the information available through observation – “observation” is key – independent of equipment – Captures the influence of technology etc • G,S & V gives you a way of extracting both temporal and spatial details • Becomes extremely powerful when combined with analysis – E.g. you have a model of what V should be, or what G and S should be given the network layout
  25. 25. Upcoming workshops: Sustainable Public Service Networks London, 19th September 2013 Fundamentals of Network Performance London, 20th September 2013 www.sustainablebroadband.com PREDICTABLE NETWORK SOLUTIONS
  26. 26. Neil Davies Neil.Davies@pnsol.com Peter Thompson Peter.Thompson@pnsol.com Martin Geddes mail@martingeddes.com PREDICTABLE NETWORK SOLUTIONS
  • AvinashHarale5

    Sep. 23, 2018
  • Amy_Zhao

    Jan. 5, 2018
  • GavinYoung

    Apr. 14, 2017
  • fidelio77

    Jul. 24, 2015
  • vashistvishal

    Aug. 10, 2013

See how multi-point measures allow you to isolate network performance issues both temporally and spatially.

Views

Total views

4,374

On Slideshare

0

From embeds

0

Number of embeds

1,807

Actions

Downloads

0

Shares

0

Comments

0

Likes

5

×