Pruning Edge Research with Latency Shears

N
Nitinder MohanPost doctoral fellow at Technical University of Munich
Pruning Edge Research
with Latency Shears
ACM Workshop on Hot Topics in Networks (HotNets) 2020
Nitinder Mohan𝚫 Lorenzo CorneoΦ Aleksandr ZavodovskiΦ Suzan BayhanΘ
Walter Wong
⊺
Jussi Kangasharju
⊺
𝚫 Technical University of Munich ΦUppsala University ΘUniversity of Twente
⊺
University of Helsinki
Cloud
Centralization to Clouds
Cloud
Decentralize to Edge
Edge
Edge
Edge
Cloud
Next Generation
Applications
Edge
Edge
Edge
“Next-generation applications impose strict
latency and bandwidth demands that
current cloud infrastructure cannot satisfy”*
*Introduction section of (almost) every edge computing research paper and
blog
10MB >1TB
100MB 10GB 100GB
5ms
1hr
50ms
100ms
10min
Required
Latency
Data generated/entity
Requirements
of Next-
Generation
Applications
Motion-to-Photon (10-20ms)
Perceivable
Latency (80-100ms)
Human
Reaction Time
Delay between input and
effect
Results in motion sickness
Latency becomes noticeable
to user
Results in lags
(230-250ms)
Delay between stimulus and response
Delays active human engagement
High latency, Small data
Low latency, Small data Low latency, Large data
High latency, Large data
Requirements
of Next-
Generation
Applications
Can the cloud really not support the
requirements of these applications?
101 cloud
regions from 7
major cloud
providers
Cloud Reachability
Measurements
Cloud Reachability
Measurements
RIPE Atlas probes
3200+ probes
globally
• Filtered out all the probes that are clearly installed in privileged locations,
e.g., in datacenters, ISP infrastructure, from our measurements using their
user-defined tags – 3200+ probes in 166 countries
• Measured end-to-end [probe-to-cloud] latencies via ICMP pings every two
hours
• Results based on nine months of data collected since September 2019
[~3.2M datapoints]
• Dataset is available for public use*
*check out paper for the link
Cloud Reachability
Measurements
Least possible latency to cloud
Least possible latency to cloud
• 32 countries can access cloud < 10ms
& 21 countries (totaling 70% world
population) can access cloud between
10 – 20 ms [MTP bound]
• 80% of the probes (and every probe
in EU, NA & SA) can reach cloud
within < 100ms [PL bound]
• Almost every probe (except few in
Africa) can access cloud < 250 ms
[HRT bound]
For detailed results, please refer to the paper
So where is the latency?
MTP PL HRT
PL “always” achievable in
EU, NA, AU, not elsewhere
You have to be insanely
lucky to reach cloud within
MTP bounds
Almost everyone can reach
cloud within HRT except
Africa and parts of Asia
Latency at last-mile
Wired
120
110
100
10
0
20
30
40
50
60
70
80
90
RTT
(ms)
Wireless
2.5x
• Many previous studies over LTE and WiFi have shown last-mile
to be the major bottleneck due to frequent packet drops,
buffebloating due to handovers, etc. [1][2]
• Filtered probes tagged “ethernet, broadband, ..” as wired and
“lte, wifi, wlan, ..” as wireless in similar regions connecting to
same cloud DC
• Results show users can experience 10-40 ms longer when
accessing over wireless (in line with previous studies [3])
• 5G promises shorter latencies (≈1 ms) but recent investigations
report otherwise [4]
Revisiting Edge-Enabling
Applications
10MB >1TB
100MB 10GB 100GB
1hr
50ms
100ms
10min
Smart home
Weather
Smart city
Wearables
Camera/
Traffic
Monitoring
Required
Latency
Data generated/entity
D2D
<$100Bn $100-300Bn $300-700Bn >$700Bn
Streaming
Remote
Surgery
Farm
360o
video
AR/VR
Gaming
AV
MTP
HRT
PL
10ms
Edge FZ
10MB >1TB
100MB 10GB 100GB
1hr
50ms
100ms
10min
Smart home
Weather
Smart city
Wearables
Camera/
Traffic
Monitoring
Required
Latency
Data generated/entity
D2D
<$100Bn $100-300Bn $300-700Bn >$700Bn
Streaming
Remote
Surgery
Farm
360o
video
AR/VR
Gaming
AV
MTP
HRT
PL
10ms
Latency Feasibility Zone
• Lower threshold is 10 ms limited by current
wireless last-mile access performance
• Higher threshold is Human Reaction Time
as current cloud deployment can easily
support it
Revisiting Edge-Enabling
Applications
Bandwidth Feasibility Zone
Bandwidth aggregation gains for Edge doesn’t
make sense for sensors producing small data
volume
• Lower threshold is set at 1GB/sensor based
on our measurements*
• Higher threshold is as much as possible
10MB >1TB
100MB 10GB 100GB
1hr
50ms
100ms
10min
Smart home
Weather
Smart city
Wearables
Camera/
Traffic
Monitoring
Required
Latency
Data generated/entity
D2D
<$100Bn $100-300Bn $300-700Bn >$700Bn
Streaming
Remote
Surgery
Farm
360o
video
AR/VR
Gaming
AV
MTP
HRT
PL
10ms
1GB
Revisiting Edge-Enabling
Applications
10MB >1TB
100MB 10GB 100GB
1hr
50ms
100ms
10min
Smart home
Weather
Smart city
Wearables
Camera/
Traffic
Monitoring
Required
Latency
Data generated/entity
D2D
<$100Bn $100-300Bn $300-700Bn >$700Bn
Streaming
Remote
Surgery
Farm
360o
video
AR/VR
Gaming
AV
MTP
HRT
PL
10ms
1GB
Edge Feasibility Zone
• Edge makes sense for only few applications
• Many hyped applications do not really
benefit from edge
• Market share of “sweet spot” is relatively
small
Revisiting Edge-Enabling
Applications
We do not herald the end
of Edge Computing!
Privacy via local processing Trust and Security
Distributed AI Bandwidth aggregation
The purpose of our work is to sway research
perception away from latency-centric hype and
towards areas where edge is truly beneficial
Dataset: https://mediatum.ub.tum.de/1574595
1 of 20

Recommended

Fog computing by
Fog computingFog computing
Fog computingHari Priyanka
28.3K views24 slides
Rain technology ppt by
Rain technology pptRain technology ppt
Rain technology pptDC Graphics
2.6K views24 slides
Fog computing by
Fog computingFog computing
Fog computingkarunsajeev
98 views17 slides
Rain technology by
Rain technologyRain technology
Rain technologyYamuna Devi
84.2K views18 slides
From Cloud Computing to Edge Computing by
From Cloud Computing to Edge ComputingFrom Cloud Computing to Edge Computing
From Cloud Computing to Edge ComputingJulien SIMON
4.4K views33 slides
Fog computing and internet of things by
Fog computing and internet of thingsFog computing and internet of things
Fog computing and internet of thingsRahul Yadav
903 views3 slides

More Related Content

What's hot

Interconnect Your Future With Mellanox by
Interconnect Your Future With MellanoxInterconnect Your Future With Mellanox
Interconnect Your Future With MellanoxMellanox Technologies
1.8K views23 slides
Mellanox 2013 Analyst Day by
Mellanox 2013 Analyst DayMellanox 2013 Analyst Day
Mellanox 2013 Analyst DayMellanox Technologies
784 views20 slides
rain technology by
rain technologyrain technology
rain technologySneha Nitta
1.1K views20 slides
Cloud computing by
Cloud computingCloud computing
Cloud computingsfu-kras
924 views11 slides
MeshDynamics Disruption Tolerant Networks by
MeshDynamics Disruption Tolerant NetworksMeshDynamics Disruption Tolerant Networks
MeshDynamics Disruption Tolerant NetworksMeshDynamics
887 views23 slides
“5G and AI Transforming the Next Generation of Robotics,” a Presentation from... by
“5G and AI Transforming the Next Generation of Robotics,” a Presentation from...“5G and AI Transforming the Next Generation of Robotics,” a Presentation from...
“5G and AI Transforming the Next Generation of Robotics,” a Presentation from...Edge AI and Vision Alliance
164 views18 slides

What's hot(20)

rain technology by Sneha Nitta
rain technologyrain technology
rain technology
Sneha Nitta1.1K views
Cloud computing by sfu-kras
Cloud computingCloud computing
Cloud computing
sfu-kras924 views
MeshDynamics Disruption Tolerant Networks by MeshDynamics
MeshDynamics Disruption Tolerant NetworksMeshDynamics Disruption Tolerant Networks
MeshDynamics Disruption Tolerant Networks
MeshDynamics887 views
“5G and AI Transforming the Next Generation of Robotics,” a Presentation from... by Edge AI and Vision Alliance
“5G and AI Transforming the Next Generation of Robotics,” a Presentation from...“5G and AI Transforming the Next Generation of Robotics,” a Presentation from...
“5G and AI Transforming the Next Generation of Robotics,” a Presentation from...
Real-Time Cloud Robotics in Practical Smart City Applications by C2RO Cloud Robotics
Real-Time Cloud Robotics in Practical Smart City ApplicationsReal-Time Cloud Robotics in Practical Smart City Applications
Real-Time Cloud Robotics in Practical Smart City Applications
C2RO Cloud Robotics1.3K views
Abi research over the edge by myehuman
Abi research over the edgeAbi research over the edge
Abi research over the edge
myehuman100 views
Cloud and grid computing by Leen Blom, Centric by Centric
Cloud and grid computing by Leen Blom, CentricCloud and grid computing by Leen Blom, Centric
Cloud and grid computing by Leen Blom, Centric
Centric1.1K views
Artificial Intelligence in the Network by Michelle Holley
Artificial Intelligence in the Network Artificial Intelligence in the Network
Artificial Intelligence in the Network
Michelle Holley1.4K views
Basic Overview Of Cloud Computing by GAURAV SINHA
Basic Overview Of Cloud ComputingBasic Overview Of Cloud Computing
Basic Overview Of Cloud Computing
GAURAV SINHA803 views
DPDK - Data Plane Development Kit by Vinay Pandey
DPDK - Data Plane Development KitDPDK - Data Plane Development Kit
DPDK - Data Plane Development Kit
Vinay Pandey110 views
SeGW Whitepaper from Radisys by Shah Sheikh
SeGW Whitepaper from RadisysSeGW Whitepaper from Radisys
SeGW Whitepaper from Radisys
Shah Sheikh1.8K views

Similar to Pruning Edge Research with Latency Shears

liaison-2019-09-30-itu-t-tsag-ietf-iab-ls-on-new-ip-shaping-future-network-at... by
liaison-2019-09-30-itu-t-tsag-ietf-iab-ls-on-new-ip-shaping-future-network-at...liaison-2019-09-30-itu-t-tsag-ietf-iab-ls-on-new-ip-shaping-future-network-at...
liaison-2019-09-30-itu-t-tsag-ietf-iab-ls-on-new-ip-shaping-future-network-at...MohammadSwerki2
3 views28 slides
Towards a New Internet for the Year 2030 and Beyond by
Towards a New Internet for the Year 2030 and BeyondTowards a New Internet for the Year 2030 and Beyond
Towards a New Internet for the Year 2030 and Beyond3G4G
9.1K views21 slides
Wang lab introduction_1204_2018 by
Wang lab introduction_1204_2018Wang lab introduction_1204_2018
Wang lab introduction_1204_2018俊廷 陳
1.3K views20 slides
Lte 5 g latim america 2017 what ran and small cell developments will make 5... by
Lte 5 g latim america 2017   what ran and small cell developments will make 5...Lte 5 g latim america 2017   what ran and small cell developments will make 5...
Lte 5 g latim america 2017 what ran and small cell developments will make 5...Alberto Boaventura
1.3K views19 slides
LCU13: Networking Summit Keynote by
LCU13: Networking Summit KeynoteLCU13: Networking Summit Keynote
LCU13: Networking Summit KeynoteLinaro
640 views17 slides
Wang lab introduction_1204_2018 by
Wang lab introduction_1204_2018Wang lab introduction_1204_2018
Wang lab introduction_1204_2018俊廷 陳
65 views20 slides

Similar to Pruning Edge Research with Latency Shears(20)

liaison-2019-09-30-itu-t-tsag-ietf-iab-ls-on-new-ip-shaping-future-network-at... by MohammadSwerki2
liaison-2019-09-30-itu-t-tsag-ietf-iab-ls-on-new-ip-shaping-future-network-at...liaison-2019-09-30-itu-t-tsag-ietf-iab-ls-on-new-ip-shaping-future-network-at...
liaison-2019-09-30-itu-t-tsag-ietf-iab-ls-on-new-ip-shaping-future-network-at...
MohammadSwerki23 views
Towards a New Internet for the Year 2030 and Beyond by 3G4G
Towards a New Internet for the Year 2030 and BeyondTowards a New Internet for the Year 2030 and Beyond
Towards a New Internet for the Year 2030 and Beyond
3G4G9.1K views
Wang lab introduction_1204_2018 by 俊廷 陳
Wang lab introduction_1204_2018Wang lab introduction_1204_2018
Wang lab introduction_1204_2018
俊廷 陳1.3K views
Lte 5 g latim america 2017 what ran and small cell developments will make 5... by Alberto Boaventura
Lte 5 g latim america 2017   what ran and small cell developments will make 5...Lte 5 g latim america 2017   what ran and small cell developments will make 5...
Lte 5 g latim america 2017 what ran and small cell developments will make 5...
Alberto Boaventura1.3K views
LCU13: Networking Summit Keynote by Linaro
LCU13: Networking Summit KeynoteLCU13: Networking Summit Keynote
LCU13: Networking Summit Keynote
Linaro640 views
Wang lab introduction_1204_2018 by 俊廷 陳
Wang lab introduction_1204_2018Wang lab introduction_1204_2018
Wang lab introduction_1204_2018
俊廷 陳65 views
Low latency for DCI and mobile applications by ADVA
Low latency for DCI and mobile applicationsLow latency for DCI and mobile applications
Low latency for DCI and mobile applications
ADVA456 views
Accelerating 5G enterprise networks with edge computing and latency assurance by ADVA
Accelerating 5G enterprise networks with edge computing and latency assuranceAccelerating 5G enterprise networks with edge computing and latency assurance
Accelerating 5G enterprise networks with edge computing and latency assurance
ADVA392 views
5G Technology Tutorial by APNIC
5G Technology Tutorial5G Technology Tutorial
5G Technology Tutorial
APNIC15.8K views
IoT (and M2M and WoT) From the Operators (CSP) perspective by Samuel Dratwa
IoT (and M2M and WoT) From the Operators (CSP) perspectiveIoT (and M2M and WoT) From the Operators (CSP) perspective
IoT (and M2M and WoT) From the Operators (CSP) perspective
Samuel Dratwa216 views
A high level perspective on 5G technologies and applications by ariannabenaja
A high level perspective on 5G technologies and applicationsA high level perspective on 5G technologies and applications
A high level perspective on 5G technologies and applications
ariannabenaja324 views
IoT Connectivity: The Technical & Potential by Andri Yadi
IoT Connectivity: The Technical & PotentialIoT Connectivity: The Technical & Potential
IoT Connectivity: The Technical & Potential
Andri Yadi447 views
Cy31439446 by IJMER
Cy31439446Cy31439446
Cy31439446
IJMER308 views

More from Nitinder Mohan

Edge Computing Platforms and Protocols - Ph.D. thesis by
Edge Computing Platforms and Protocols - Ph.D. thesisEdge Computing Platforms and Protocols - Ph.D. thesis
Edge Computing Platforms and Protocols - Ph.D. thesisNitinder Mohan
541 views77 slides
DeCloud: Truthful Decentralized Double Auction for Edge Clouds by
DeCloud: Truthful Decentralized Double Auction for Edge CloudsDeCloud: Truthful Decentralized Double Auction for Edge Clouds
DeCloud: Truthful Decentralized Double Auction for Edge CloudsNitinder Mohan
189 views33 slides
Big Data Frameworks: A primer on Apache Spark and MapReduce by
Big Data Frameworks: A primer on Apache Spark and MapReduceBig Data Frameworks: A primer on Apache Spark and MapReduce
Big Data Frameworks: A primer on Apache Spark and MapReduceNitinder Mohan
90 views38 slides
Open Infrastructure for Edge: A Distributed Ledger Outlook by
Open Infrastructure for Edge: A Distributed Ledger OutlookOpen Infrastructure for Edge: A Distributed Ledger Outlook
Open Infrastructure for Edge: A Distributed Ledger OutlookNitinder Mohan
172 views11 slides
ExEC: Elastic Extensible Edge Cloud by
ExEC: Elastic Extensible Edge Cloud ExEC: Elastic Extensible Edge Cloud
ExEC: Elastic Extensible Edge Cloud Nitinder Mohan
209 views31 slides
ICON: Intelligent Container Overlays by
ICON: Intelligent Container OverlaysICON: Intelligent Container Overlays
ICON: Intelligent Container OverlaysNitinder Mohan
236 views56 slides

More from Nitinder Mohan(12)

Edge Computing Platforms and Protocols - Ph.D. thesis by Nitinder Mohan
Edge Computing Platforms and Protocols - Ph.D. thesisEdge Computing Platforms and Protocols - Ph.D. thesis
Edge Computing Platforms and Protocols - Ph.D. thesis
Nitinder Mohan541 views
DeCloud: Truthful Decentralized Double Auction for Edge Clouds by Nitinder Mohan
DeCloud: Truthful Decentralized Double Auction for Edge CloudsDeCloud: Truthful Decentralized Double Auction for Edge Clouds
DeCloud: Truthful Decentralized Double Auction for Edge Clouds
Nitinder Mohan189 views
Big Data Frameworks: A primer on Apache Spark and MapReduce by Nitinder Mohan
Big Data Frameworks: A primer on Apache Spark and MapReduceBig Data Frameworks: A primer on Apache Spark and MapReduce
Big Data Frameworks: A primer on Apache Spark and MapReduce
Nitinder Mohan90 views
Open Infrastructure for Edge: A Distributed Ledger Outlook by Nitinder Mohan
Open Infrastructure for Edge: A Distributed Ledger OutlookOpen Infrastructure for Edge: A Distributed Ledger Outlook
Open Infrastructure for Edge: A Distributed Ledger Outlook
Nitinder Mohan172 views
ExEC: Elastic Extensible Edge Cloud by Nitinder Mohan
ExEC: Elastic Extensible Edge Cloud ExEC: Elastic Extensible Edge Cloud
ExEC: Elastic Extensible Edge Cloud
Nitinder Mohan209 views
ICON: Intelligent Container Overlays by Nitinder Mohan
ICON: Intelligent Container OverlaysICON: Intelligent Container Overlays
ICON: Intelligent Container Overlays
Nitinder Mohan236 views
Redesigning MPTCP in Edge clouds by Nitinder Mohan
Redesigning MPTCP in Edge cloudsRedesigning MPTCP in Edge clouds
Redesigning MPTCP in Edge clouds
Nitinder Mohan238 views
Anveshak: Placing Edge Servers In The Wild by Nitinder Mohan
Anveshak: Placing Edge Servers In The WildAnveshak: Placing Edge Servers In The Wild
Anveshak: Placing Edge Servers In The Wild
Nitinder Mohan285 views
MUTE: Multi-Tier Edge networks by Nitinder Mohan
MUTE: Multi-Tier Edge networksMUTE: Multi-Tier Edge networks
MUTE: Multi-Tier Edge networks
Nitinder Mohan354 views
Managing data in computational edge clouds by Nitinder Mohan
Managing data in computational edge cloudsManaging data in computational edge clouds
Managing data in computational edge clouds
Nitinder Mohan506 views
Edge-Fog Cloud: Scaling IoT computations on the edge by Nitinder Mohan
Edge-Fog Cloud: Scaling IoT computations on the edgeEdge-Fog Cloud: Scaling IoT computations on the edge
Edge-Fog Cloud: Scaling IoT computations on the edge
Nitinder Mohan1.1K views

Recently uploaded

Disinfectants & Antiseptic by
Disinfectants & AntisepticDisinfectants & Antiseptic
Disinfectants & AntisepticSanket P Shinde
10 views36 slides
Conventional and non-conventional methods for improvement of cucurbits.pptx by
Conventional and non-conventional methods for improvement of cucurbits.pptxConventional and non-conventional methods for improvement of cucurbits.pptx
Conventional and non-conventional methods for improvement of cucurbits.pptxgandhi976
18 views35 slides
Nitrosamine & NDSRI.pptx by
Nitrosamine & NDSRI.pptxNitrosamine & NDSRI.pptx
Nitrosamine & NDSRI.pptxNileshBonde4
13 views22 slides
DATABASE MANAGEMENT SYSTEM by
DATABASE MANAGEMENT SYSTEMDATABASE MANAGEMENT SYSTEM
DATABASE MANAGEMENT SYSTEMDr. GOPINATH D
7 views50 slides
Chromatography ppt.pptx by
Chromatography ppt.pptxChromatography ppt.pptx
Chromatography ppt.pptxvarshachandgudesvpm
18 views1 slide
application of genetic engineering 2.pptx by
application of genetic engineering 2.pptxapplication of genetic engineering 2.pptx
application of genetic engineering 2.pptxSankSurezz
9 views12 slides

Recently uploaded(20)

Conventional and non-conventional methods for improvement of cucurbits.pptx by gandhi976
Conventional and non-conventional methods for improvement of cucurbits.pptxConventional and non-conventional methods for improvement of cucurbits.pptx
Conventional and non-conventional methods for improvement of cucurbits.pptx
gandhi97618 views
Nitrosamine & NDSRI.pptx by NileshBonde4
Nitrosamine & NDSRI.pptxNitrosamine & NDSRI.pptx
Nitrosamine & NDSRI.pptx
NileshBonde413 views
application of genetic engineering 2.pptx by SankSurezz
application of genetic engineering 2.pptxapplication of genetic engineering 2.pptx
application of genetic engineering 2.pptx
SankSurezz9 views
Experimental animal Guinea pigs.pptx by Mansee Arya
Experimental animal Guinea pigs.pptxExperimental animal Guinea pigs.pptx
Experimental animal Guinea pigs.pptx
Mansee Arya15 views
"How can I develop my learning path in bioinformatics? by Bioinformy
"How can I develop my learning path in bioinformatics?"How can I develop my learning path in bioinformatics?
"How can I develop my learning path in bioinformatics?
Bioinformy23 views
A Ready-to-Analyze High-Plex Spatial Signature Development Workflow for Cance... by InsideScientific
A Ready-to-Analyze High-Plex Spatial Signature Development Workflow for Cance...A Ready-to-Analyze High-Plex Spatial Signature Development Workflow for Cance...
A Ready-to-Analyze High-Plex Spatial Signature Development Workflow for Cance...
InsideScientific49 views
Distinct distributions of elliptical and disk galaxies across the Local Super... by Sérgio Sacani
Distinct distributions of elliptical and disk galaxies across the Local Super...Distinct distributions of elliptical and disk galaxies across the Local Super...
Distinct distributions of elliptical and disk galaxies across the Local Super...
Sérgio Sacani31 views
Small ruminant keepers’ knowledge, attitudes and practices towards peste des ... by ILRI
Small ruminant keepers’ knowledge, attitudes and practices towards peste des ...Small ruminant keepers’ knowledge, attitudes and practices towards peste des ...
Small ruminant keepers’ knowledge, attitudes and practices towards peste des ...
ILRI5 views
Open Access Publishing in Astrophysics by Peter Coles
Open Access Publishing in AstrophysicsOpen Access Publishing in Astrophysics
Open Access Publishing in Astrophysics
Peter Coles808 views
Metatheoretical Panda-Samaneh Borji.pdf by samanehborji
Metatheoretical Panda-Samaneh Borji.pdfMetatheoretical Panda-Samaneh Borji.pdf
Metatheoretical Panda-Samaneh Borji.pdf
samanehborji16 views

Pruning Edge Research with Latency Shears

  • 1. Pruning Edge Research with Latency Shears ACM Workshop on Hot Topics in Networks (HotNets) 2020 Nitinder Mohan𝚫 Lorenzo CorneoΦ Aleksandr ZavodovskiΦ Suzan BayhanΘ Walter Wong ⊺ Jussi Kangasharju ⊺ 𝚫 Technical University of Munich ΦUppsala University ΘUniversity of Twente ⊺ University of Helsinki
  • 4. Cloud Next Generation Applications Edge Edge Edge “Next-generation applications impose strict latency and bandwidth demands that current cloud infrastructure cannot satisfy”* *Introduction section of (almost) every edge computing research paper and blog
  • 5. 10MB >1TB 100MB 10GB 100GB 5ms 1hr 50ms 100ms 10min Required Latency Data generated/entity Requirements of Next- Generation Applications Motion-to-Photon (10-20ms) Perceivable Latency (80-100ms) Human Reaction Time Delay between input and effect Results in motion sickness Latency becomes noticeable to user Results in lags (230-250ms) Delay between stimulus and response Delays active human engagement
  • 6. High latency, Small data Low latency, Small data Low latency, Large data High latency, Large data Requirements of Next- Generation Applications
  • 7. Can the cloud really not support the requirements of these applications?
  • 8. 101 cloud regions from 7 major cloud providers Cloud Reachability Measurements
  • 10. 3200+ probes globally • Filtered out all the probes that are clearly installed in privileged locations, e.g., in datacenters, ISP infrastructure, from our measurements using their user-defined tags – 3200+ probes in 166 countries • Measured end-to-end [probe-to-cloud] latencies via ICMP pings every two hours • Results based on nine months of data collected since September 2019 [~3.2M datapoints] • Dataset is available for public use* *check out paper for the link Cloud Reachability Measurements
  • 12. Least possible latency to cloud • 32 countries can access cloud < 10ms & 21 countries (totaling 70% world population) can access cloud between 10 – 20 ms [MTP bound] • 80% of the probes (and every probe in EU, NA & SA) can reach cloud within < 100ms [PL bound] • Almost every probe (except few in Africa) can access cloud < 250 ms [HRT bound] For detailed results, please refer to the paper
  • 13. So where is the latency?
  • 14. MTP PL HRT PL “always” achievable in EU, NA, AU, not elsewhere You have to be insanely lucky to reach cloud within MTP bounds Almost everyone can reach cloud within HRT except Africa and parts of Asia
  • 15. Latency at last-mile Wired 120 110 100 10 0 20 30 40 50 60 70 80 90 RTT (ms) Wireless 2.5x • Many previous studies over LTE and WiFi have shown last-mile to be the major bottleneck due to frequent packet drops, buffebloating due to handovers, etc. [1][2] • Filtered probes tagged “ethernet, broadband, ..” as wired and “lte, wifi, wlan, ..” as wireless in similar regions connecting to same cloud DC • Results show users can experience 10-40 ms longer when accessing over wireless (in line with previous studies [3]) • 5G promises shorter latencies (≈1 ms) but recent investigations report otherwise [4]
  • 16. Revisiting Edge-Enabling Applications 10MB >1TB 100MB 10GB 100GB 1hr 50ms 100ms 10min Smart home Weather Smart city Wearables Camera/ Traffic Monitoring Required Latency Data generated/entity D2D <$100Bn $100-300Bn $300-700Bn >$700Bn Streaming Remote Surgery Farm 360o video AR/VR Gaming AV MTP HRT PL 10ms Edge FZ
  • 17. 10MB >1TB 100MB 10GB 100GB 1hr 50ms 100ms 10min Smart home Weather Smart city Wearables Camera/ Traffic Monitoring Required Latency Data generated/entity D2D <$100Bn $100-300Bn $300-700Bn >$700Bn Streaming Remote Surgery Farm 360o video AR/VR Gaming AV MTP HRT PL 10ms Latency Feasibility Zone • Lower threshold is 10 ms limited by current wireless last-mile access performance • Higher threshold is Human Reaction Time as current cloud deployment can easily support it Revisiting Edge-Enabling Applications
  • 18. Bandwidth Feasibility Zone Bandwidth aggregation gains for Edge doesn’t make sense for sensors producing small data volume • Lower threshold is set at 1GB/sensor based on our measurements* • Higher threshold is as much as possible 10MB >1TB 100MB 10GB 100GB 1hr 50ms 100ms 10min Smart home Weather Smart city Wearables Camera/ Traffic Monitoring Required Latency Data generated/entity D2D <$100Bn $100-300Bn $300-700Bn >$700Bn Streaming Remote Surgery Farm 360o video AR/VR Gaming AV MTP HRT PL 10ms 1GB Revisiting Edge-Enabling Applications
  • 19. 10MB >1TB 100MB 10GB 100GB 1hr 50ms 100ms 10min Smart home Weather Smart city Wearables Camera/ Traffic Monitoring Required Latency Data generated/entity D2D <$100Bn $100-300Bn $300-700Bn >$700Bn Streaming Remote Surgery Farm 360o video AR/VR Gaming AV MTP HRT PL 10ms 1GB Edge Feasibility Zone • Edge makes sense for only few applications • Many hyped applications do not really benefit from edge • Market share of “sweet spot” is relatively small Revisiting Edge-Enabling Applications
  • 20. We do not herald the end of Edge Computing! Privacy via local processing Trust and Security Distributed AI Bandwidth aggregation The purpose of our work is to sway research perception away from latency-centric hype and towards areas where edge is truly beneficial Dataset: https://mediatum.ub.tum.de/1574595