SlideShare a Scribd company logo
The Cloud’s Hidden Lock-In:
Network Latency
Tom Hughes-Croucher
Carlos Bueno
No Villains
Latency + Metering = Lock-in
Lock-in isn’t about APIs
and Data Formats
Latency, always sucks
Metering, sometimes sucks
Latency + Metering = Lock-in
Lock-in is whatever makes
it hard to switch vendors
Not a new problem
1840




Manila to Boston
1840




Manila → Panama
1840




Panama → Other side Panama
1840




Panama → Boston
1872




Manila to Boston
1872




Manila → Hong Kong
1872




Hong Kong → San Francisco
1872




San Francisco → Boston
1890




Manila to Boston
1890




Manila → San Francisco
1890




San Francisco → Boston
The treaty of Bern
• Peering
   o reciprocal agreements, flat rates
• Compatibility
   o charge by weight, address standards
• Portability
   o envelopes and stamps
• Better Infrastructure
   o trains, steamships



Mail Interoperability
• Peering
   o reciprocal agreements, flat rates
• Compatibility
   o open APIs and formats
• Portability
   o standard VMs and images
• Better Infrastructure
   o reduce inter-cloud latency



Cloud Interoperability
Peering

           Compatibility


             Portability

        Better Infrastructure



Interoperability
Where we are today?
Peering

           Compatibility


             Portability

        Better Infrastructure



Stuck in the middle
CloudKick
Rightscale
“Open” Cloud “Manifesto”
Cisco
Yahoo! OpenCap
Peering

           Compatibility


             Portability

        Better Infrastructure



Interoperability
Making it happen
Better Infrastructure
Datacenters Flock Together
      cloud-peering.com
Cloud Peering
Concrete example
Peering Agreement: $0
Firewall rules: 5 mins ($0)
Cross-over cable: $15.99
Free, fat Pipe: Priceless
Recommendations
If you are a CTO
If you are a startup
If you run a cloud
What’s in it for Cloud Vendors?
What’s in it for Cloud Vendors?
250% to 900% increase
 in SMS message volume per customer




Interop = Network Effects
Turn data storage into a commodity that
  can be traded, sold, swapped, reserved
          for future delivery, etc.




Spot Market for Storage
University Networks
What is Y! doing about it?
Apache Traffic Server
Yahoo! Query Language
Peering

          Compatibility


            Portability

       Better Infrastructure



Conclusion
tom
            @sh1mmer
            kid666.com

            carlos
            carlos.
            bueno.org




Questions
express000          lwr                   ogil
minds-eye           manchesterunitedman   postaletrice
get directly down   1                     russelldavies
catsegovia          martindew             simongurr
darwinbell          midorisyu             stansich
deadhorse           mikebaird             tueksta
fservayge           mrwizzard             usnationalarchives
gbaku               mwichary
guitrento           neenahhistory
jdlasica            nicholaslaughlin
julishannon         normanbleventhalmap
lightcliff          center
livenature          oceanviews




CC Flickr Photo Credits

More Related Content

Similar to The Cloud's Hidden Lock-in: Network Latency

Building the silver lining seminar slides
Building the silver lining   seminar slidesBuilding the silver lining   seminar slides
Building the silver lining seminar slides
Exponential_e
 
10 fn s18
10 fn s1810 fn s18
10 fn s18
Scott Foster
 
10 fn s18
10 fn s1810 fn s18
10 fn s18
Scott Foster
 
Building High Fidelity Data Streams (QCon London 2023)
Building High Fidelity Data Streams (QCon London 2023)Building High Fidelity Data Streams (QCon London 2023)
Building High Fidelity Data Streams (QCon London 2023)
Sid Anand
 
Top IX: interoperability and neutrality, the idea of an InterCloud Exchange
Top IX: interoperability and neutrality, the idea of an InterCloud ExchangeTop IX: interoperability and neutrality, the idea of an InterCloud Exchange
Top IX: interoperability and neutrality, the idea of an InterCloud Exchange
Gabriele Bozzi
 
Harvesting The Web With Cloud Computing
Harvesting The Web With Cloud ComputingHarvesting The Web With Cloud Computing
Harvesting The Web With Cloud Computing
King Huang
 
02 internet transit
02 internet transit02 internet transit
02 internet transit
William Norton
 
Microservice communication with RabbitMQ - Tetiana Chupryna
Microservice communication with RabbitMQ - Tetiana ChuprynaMicroservice communication with RabbitMQ - Tetiana Chupryna
Microservice communication with RabbitMQ - Tetiana Chupryna
Ruby Meditation
 
Dmk blackops2006
Dmk blackops2006Dmk blackops2006
Dmk blackops2006
Dan Kaminsky
 
Designing Delay-tolerant Data Services for the Network of Things
Designing Delay-tolerant Data Services for the Network of ThingsDesigning Delay-tolerant Data Services for the Network of Things
Designing Delay-tolerant Data Services for the Network of Things
Daniel Austin
 
The Fog Around the Cloud- Nathaniel Borenstein
The Fog Around the Cloud- Nathaniel BorensteinThe Fog Around the Cloud- Nathaniel Borenstein
The Fog Around the Cloud- Nathaniel Borenstein
Mimecast
 
Understanding Remote Peering - Connecting to the Core of the Internet
Understanding Remote Peering - Connecting to the Core of the InternetUnderstanding Remote Peering - Connecting to the Core of the Internet
Understanding Remote Peering - Connecting to the Core of the Internet
William Norton
 
Lost layer talk 2014
Lost layer talk 2014Lost layer talk 2014
Lost layer talk 2014
ICT PRISTINE
 
Application-engaged Dynamic Orchestration of Optical Network Resources
Application-engaged Dynamic Orchestration of Optical Network ResourcesApplication-engaged Dynamic Orchestration of Optical Network Resources
Application-engaged Dynamic Orchestration of Optical Network Resources
Tal Lavian Ph.D.
 
HKNOG 6.0: Death in Transit
HKNOG 6.0: Death in TransitHKNOG 6.0: Death in Transit
HKNOG 6.0: Death in Transit
Bhadrika Magan
 
HKNOG 6.0: Death in Transit
HKNOG 6.0: Death in TransitHKNOG 6.0: Death in Transit
HKNOG 6.0: Death in Transit
APNIC
 
Digital Transformation | AWS Webinar
Digital Transformation | AWS WebinarDigital Transformation | AWS Webinar
Digital Transformation | AWS Webinar
Amazon Web Services
 
38th TWNIC OPM: Future network needs
38th TWNIC OPM: Future network needs38th TWNIC OPM: Future network needs
38th TWNIC OPM: Future network needs
APNIC
 
Windows Azure VPN Workshop
Windows Azure VPN WorkshopWindows Azure VPN Workshop
Windows Azure VPN Workshop
Juan Pablo
 
Saas and the Cloud Ten Years In
Saas and the Cloud Ten Years InSaas and the Cloud Ten Years In
Saas and the Cloud Ten Years In
Rory O'Driscoll
 

Similar to The Cloud's Hidden Lock-in: Network Latency (20)

Building the silver lining seminar slides
Building the silver lining   seminar slidesBuilding the silver lining   seminar slides
Building the silver lining seminar slides
 
10 fn s18
10 fn s1810 fn s18
10 fn s18
 
10 fn s18
10 fn s1810 fn s18
10 fn s18
 
Building High Fidelity Data Streams (QCon London 2023)
Building High Fidelity Data Streams (QCon London 2023)Building High Fidelity Data Streams (QCon London 2023)
Building High Fidelity Data Streams (QCon London 2023)
 
Top IX: interoperability and neutrality, the idea of an InterCloud Exchange
Top IX: interoperability and neutrality, the idea of an InterCloud ExchangeTop IX: interoperability and neutrality, the idea of an InterCloud Exchange
Top IX: interoperability and neutrality, the idea of an InterCloud Exchange
 
Harvesting The Web With Cloud Computing
Harvesting The Web With Cloud ComputingHarvesting The Web With Cloud Computing
Harvesting The Web With Cloud Computing
 
02 internet transit
02 internet transit02 internet transit
02 internet transit
 
Microservice communication with RabbitMQ - Tetiana Chupryna
Microservice communication with RabbitMQ - Tetiana ChuprynaMicroservice communication with RabbitMQ - Tetiana Chupryna
Microservice communication with RabbitMQ - Tetiana Chupryna
 
Dmk blackops2006
Dmk blackops2006Dmk blackops2006
Dmk blackops2006
 
Designing Delay-tolerant Data Services for the Network of Things
Designing Delay-tolerant Data Services for the Network of ThingsDesigning Delay-tolerant Data Services for the Network of Things
Designing Delay-tolerant Data Services for the Network of Things
 
The Fog Around the Cloud- Nathaniel Borenstein
The Fog Around the Cloud- Nathaniel BorensteinThe Fog Around the Cloud- Nathaniel Borenstein
The Fog Around the Cloud- Nathaniel Borenstein
 
Understanding Remote Peering - Connecting to the Core of the Internet
Understanding Remote Peering - Connecting to the Core of the InternetUnderstanding Remote Peering - Connecting to the Core of the Internet
Understanding Remote Peering - Connecting to the Core of the Internet
 
Lost layer talk 2014
Lost layer talk 2014Lost layer talk 2014
Lost layer talk 2014
 
Application-engaged Dynamic Orchestration of Optical Network Resources
Application-engaged Dynamic Orchestration of Optical Network ResourcesApplication-engaged Dynamic Orchestration of Optical Network Resources
Application-engaged Dynamic Orchestration of Optical Network Resources
 
HKNOG 6.0: Death in Transit
HKNOG 6.0: Death in TransitHKNOG 6.0: Death in Transit
HKNOG 6.0: Death in Transit
 
HKNOG 6.0: Death in Transit
HKNOG 6.0: Death in TransitHKNOG 6.0: Death in Transit
HKNOG 6.0: Death in Transit
 
Digital Transformation | AWS Webinar
Digital Transformation | AWS WebinarDigital Transformation | AWS Webinar
Digital Transformation | AWS Webinar
 
38th TWNIC OPM: Future network needs
38th TWNIC OPM: Future network needs38th TWNIC OPM: Future network needs
38th TWNIC OPM: Future network needs
 
Windows Azure VPN Workshop
Windows Azure VPN WorkshopWindows Azure VPN Workshop
Windows Azure VPN Workshop
 
Saas and the Cloud Ten Years In
Saas and the Cloud Ten Years InSaas and the Cloud Ten Years In
Saas and the Cloud Ten Years In
 

More from Tom Croucher

Using Node.js to Build Great Streaming Services - HTML5 Dev Conf
Using Node.js to  Build Great  Streaming Services - HTML5 Dev ConfUsing Node.js to  Build Great  Streaming Services - HTML5 Dev Conf
Using Node.js to Build Great Streaming Services - HTML5 Dev Conf
Tom Croucher
 
Streams are Awesome - (Node.js) TimesOpen Sep 2012
Streams are Awesome - (Node.js) TimesOpen Sep 2012 Streams are Awesome - (Node.js) TimesOpen Sep 2012
Streams are Awesome - (Node.js) TimesOpen Sep 2012
Tom Croucher
 
Using Node.js to improve the performance of Mobile apps and Mobile web
Using Node.js to improve  the performance of  Mobile apps and Mobile webUsing Node.js to improve  the performance of  Mobile apps and Mobile web
Using Node.js to improve the performance of Mobile apps and Mobile web
Tom Croucher
 
Writing robust Node.js applications
Writing robust Node.js applicationsWriting robust Node.js applications
Writing robust Node.js applications
Tom Croucher
 
Creating the Internet of Things with JavaScript - Fluent Conf
Creating the Internet of Things with JavaScript - Fluent ConfCreating the Internet of Things with JavaScript - Fluent Conf
Creating the Internet of Things with JavaScript - Fluent Conf
Tom Croucher
 
Using Node.js to make HTML5 work for everyone
Using Node.js to make HTML5 work for everyone Using Node.js to make HTML5 work for everyone
Using Node.js to make HTML5 work for everyone
Tom Croucher
 
A million connections and beyond - Node.js at scale
A million connections and beyond - Node.js at scaleA million connections and beyond - Node.js at scale
A million connections and beyond - Node.js at scale
Tom Croucher
 
OSCON 2011 - Node.js Tutorial
OSCON 2011 - Node.js TutorialOSCON 2011 - Node.js Tutorial
OSCON 2011 - Node.js Tutorial
Tom Croucher
 
Lessons from a coding veteran - Web Directions @Media
Lessons from a coding veteran - Web Directions @MediaLessons from a coding veteran - Web Directions @Media
Lessons from a coding veteran - Web Directions @Media
Tom Croucher
 
Multi-tiered Node Architectures - JSConf 2011
Multi-tiered Node Architectures - JSConf 2011Multi-tiered Node Architectures - JSConf 2011
Multi-tiered Node Architectures - JSConf 2011
Tom Croucher
 
A language for the Internet: Why JavaScript and Node.js is right for Internet...
A language for the Internet: Why JavaScript and Node.js is right for Internet...A language for the Internet: Why JavaScript and Node.js is right for Internet...
A language for the Internet: Why JavaScript and Node.js is right for Internet...
Tom Croucher
 
A language for the Internet: Why JavaScript and Node.js is right for Internet...
A language for the Internet: Why JavaScript and Node.js is right for Internet...A language for the Internet: Why JavaScript and Node.js is right for Internet...
A language for the Internet: Why JavaScript and Node.js is right for Internet...
Tom Croucher
 
How to stop writing spaghetti code
How to stop writing spaghetti codeHow to stop writing spaghetti code
How to stop writing spaghetti code
Tom Croucher
 
Doing Horrible Things with DNS - Web Directions South
Doing Horrible Things with DNS - Web Directions SouthDoing Horrible Things with DNS - Web Directions South
Doing Horrible Things with DNS - Web Directions South
Tom Croucher
 
Doing Horrible Things to DNS in the Name of Science - SF Performance Meetup
Doing Horrible Things to DNS in the Name of Science - SF Performance MeetupDoing Horrible Things to DNS in the Name of Science - SF Performance Meetup
Doing Horrible Things to DNS in the Name of Science - SF Performance Meetup
Tom Croucher
 
JavaScript is the new black - Why Node.js is going to rock your world - Web 2...
JavaScript is the new black - Why Node.js is going to rock your world - Web 2...JavaScript is the new black - Why Node.js is going to rock your world - Web 2...
JavaScript is the new black - Why Node.js is going to rock your world - Web 2...
Tom Croucher
 
How to stop writing spaghetti code - JSConf.eu 2010
How to stop writing spaghetti code - JSConf.eu 2010How to stop writing spaghetti code - JSConf.eu 2010
How to stop writing spaghetti code - JSConf.eu 2010Tom Croucher
 
Sf perf
Sf perfSf perf
Sf perf
Tom Croucher
 
Node.js and How JavaScript is Changing Server Programming
Node.js and How JavaScript is Changing Server Programming  Node.js and How JavaScript is Changing Server Programming
Node.js and How JavaScript is Changing Server Programming
Tom Croucher
 
Server Side JavaScript - You ain't seen nothing yet
Server Side JavaScript - You ain't seen nothing yetServer Side JavaScript - You ain't seen nothing yet
Server Side JavaScript - You ain't seen nothing yet
Tom Croucher
 

More from Tom Croucher (20)

Using Node.js to Build Great Streaming Services - HTML5 Dev Conf
Using Node.js to  Build Great  Streaming Services - HTML5 Dev ConfUsing Node.js to  Build Great  Streaming Services - HTML5 Dev Conf
Using Node.js to Build Great Streaming Services - HTML5 Dev Conf
 
Streams are Awesome - (Node.js) TimesOpen Sep 2012
Streams are Awesome - (Node.js) TimesOpen Sep 2012 Streams are Awesome - (Node.js) TimesOpen Sep 2012
Streams are Awesome - (Node.js) TimesOpen Sep 2012
 
Using Node.js to improve the performance of Mobile apps and Mobile web
Using Node.js to improve  the performance of  Mobile apps and Mobile webUsing Node.js to improve  the performance of  Mobile apps and Mobile web
Using Node.js to improve the performance of Mobile apps and Mobile web
 
Writing robust Node.js applications
Writing robust Node.js applicationsWriting robust Node.js applications
Writing robust Node.js applications
 
Creating the Internet of Things with JavaScript - Fluent Conf
Creating the Internet of Things with JavaScript - Fluent ConfCreating the Internet of Things with JavaScript - Fluent Conf
Creating the Internet of Things with JavaScript - Fluent Conf
 
Using Node.js to make HTML5 work for everyone
Using Node.js to make HTML5 work for everyone Using Node.js to make HTML5 work for everyone
Using Node.js to make HTML5 work for everyone
 
A million connections and beyond - Node.js at scale
A million connections and beyond - Node.js at scaleA million connections and beyond - Node.js at scale
A million connections and beyond - Node.js at scale
 
OSCON 2011 - Node.js Tutorial
OSCON 2011 - Node.js TutorialOSCON 2011 - Node.js Tutorial
OSCON 2011 - Node.js Tutorial
 
Lessons from a coding veteran - Web Directions @Media
Lessons from a coding veteran - Web Directions @MediaLessons from a coding veteran - Web Directions @Media
Lessons from a coding veteran - Web Directions @Media
 
Multi-tiered Node Architectures - JSConf 2011
Multi-tiered Node Architectures - JSConf 2011Multi-tiered Node Architectures - JSConf 2011
Multi-tiered Node Architectures - JSConf 2011
 
A language for the Internet: Why JavaScript and Node.js is right for Internet...
A language for the Internet: Why JavaScript and Node.js is right for Internet...A language for the Internet: Why JavaScript and Node.js is right for Internet...
A language for the Internet: Why JavaScript and Node.js is right for Internet...
 
A language for the Internet: Why JavaScript and Node.js is right for Internet...
A language for the Internet: Why JavaScript and Node.js is right for Internet...A language for the Internet: Why JavaScript and Node.js is right for Internet...
A language for the Internet: Why JavaScript and Node.js is right for Internet...
 
How to stop writing spaghetti code
How to stop writing spaghetti codeHow to stop writing spaghetti code
How to stop writing spaghetti code
 
Doing Horrible Things with DNS - Web Directions South
Doing Horrible Things with DNS - Web Directions SouthDoing Horrible Things with DNS - Web Directions South
Doing Horrible Things with DNS - Web Directions South
 
Doing Horrible Things to DNS in the Name of Science - SF Performance Meetup
Doing Horrible Things to DNS in the Name of Science - SF Performance MeetupDoing Horrible Things to DNS in the Name of Science - SF Performance Meetup
Doing Horrible Things to DNS in the Name of Science - SF Performance Meetup
 
JavaScript is the new black - Why Node.js is going to rock your world - Web 2...
JavaScript is the new black - Why Node.js is going to rock your world - Web 2...JavaScript is the new black - Why Node.js is going to rock your world - Web 2...
JavaScript is the new black - Why Node.js is going to rock your world - Web 2...
 
How to stop writing spaghetti code - JSConf.eu 2010
How to stop writing spaghetti code - JSConf.eu 2010How to stop writing spaghetti code - JSConf.eu 2010
How to stop writing spaghetti code - JSConf.eu 2010
 
Sf perf
Sf perfSf perf
Sf perf
 
Node.js and How JavaScript is Changing Server Programming
Node.js and How JavaScript is Changing Server Programming  Node.js and How JavaScript is Changing Server Programming
Node.js and How JavaScript is Changing Server Programming
 
Server Side JavaScript - You ain't seen nothing yet
Server Side JavaScript - You ain't seen nothing yetServer Side JavaScript - You ain't seen nothing yet
Server Side JavaScript - You ain't seen nothing yet
 

Recently uploaded

Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Malak Abu Hammad
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
MichaelKnudsen27
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Safe Software
 
GenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizationsGenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizations
kumardaparthi1024
 
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing InstancesEnergy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Alpen-Adria-Universität
 
Nunit vs XUnit vs MSTest Differences Between These Unit Testing Frameworks.pdf
Nunit vs XUnit vs MSTest Differences Between These Unit Testing Frameworks.pdfNunit vs XUnit vs MSTest Differences Between These Unit Testing Frameworks.pdf
Nunit vs XUnit vs MSTest Differences Between These Unit Testing Frameworks.pdf
flufftailshop
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
ssuserfac0301
 
Recommendation System using RAG Architecture
Recommendation System using RAG ArchitectureRecommendation System using RAG Architecture
Recommendation System using RAG Architecture
fredae14
 
AWS Cloud Cost Optimization Presentation.pptx
AWS Cloud Cost Optimization Presentation.pptxAWS Cloud Cost Optimization Presentation.pptx
AWS Cloud Cost Optimization Presentation.pptx
HarisZaheer8
 
Skybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoptionSkybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoption
Tatiana Kojar
 
Trusted Execution Environment for Decentralized Process Mining
Trusted Execution Environment for Decentralized Process MiningTrusted Execution Environment for Decentralized Process Mining
Trusted Execution Environment for Decentralized Process Mining
LucaBarbaro3
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
panagenda
 
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying AheadDigital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Wask
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
akankshawande
 
Serial Arm Control in Real Time Presentation
Serial Arm Control in Real Time PresentationSerial Arm Control in Real Time Presentation
Serial Arm Control in Real Time Presentation
tolgahangng
 
Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)
Jakub Marek
 
June Patch Tuesday
June Patch TuesdayJune Patch Tuesday
June Patch Tuesday
Ivanti
 
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
saastr
 
5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides
DanBrown980551
 
Letter and Document Automation for Bonterra Impact Management (fka Social Sol...
Letter and Document Automation for Bonterra Impact Management (fka Social Sol...Letter and Document Automation for Bonterra Impact Management (fka Social Sol...
Letter and Document Automation for Bonterra Impact Management (fka Social Sol...
Jeffrey Haguewood
 

Recently uploaded (20)

Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
 
GenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizationsGenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizations
 
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing InstancesEnergy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
 
Nunit vs XUnit vs MSTest Differences Between These Unit Testing Frameworks.pdf
Nunit vs XUnit vs MSTest Differences Between These Unit Testing Frameworks.pdfNunit vs XUnit vs MSTest Differences Between These Unit Testing Frameworks.pdf
Nunit vs XUnit vs MSTest Differences Between These Unit Testing Frameworks.pdf
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
 
Recommendation System using RAG Architecture
Recommendation System using RAG ArchitectureRecommendation System using RAG Architecture
Recommendation System using RAG Architecture
 
AWS Cloud Cost Optimization Presentation.pptx
AWS Cloud Cost Optimization Presentation.pptxAWS Cloud Cost Optimization Presentation.pptx
AWS Cloud Cost Optimization Presentation.pptx
 
Skybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoptionSkybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoption
 
Trusted Execution Environment for Decentralized Process Mining
Trusted Execution Environment for Decentralized Process MiningTrusted Execution Environment for Decentralized Process Mining
Trusted Execution Environment for Decentralized Process Mining
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
 
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying AheadDigital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying Ahead
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
 
Serial Arm Control in Real Time Presentation
Serial Arm Control in Real Time PresentationSerial Arm Control in Real Time Presentation
Serial Arm Control in Real Time Presentation
 
Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)
 
June Patch Tuesday
June Patch TuesdayJune Patch Tuesday
June Patch Tuesday
 
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
 
5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides
 
Letter and Document Automation for Bonterra Impact Management (fka Social Sol...
Letter and Document Automation for Bonterra Impact Management (fka Social Sol...Letter and Document Automation for Bonterra Impact Management (fka Social Sol...
Letter and Document Automation for Bonterra Impact Management (fka Social Sol...
 

The Cloud's Hidden Lock-in: Network Latency

Editor's Notes

  1. Tom - Welcome to our talk, about the cloud as you can see it’s a pretty nice picture Carlos - But it’s still a dirt road, we have a long way to go
  2. -Tom Hughes-Croucher -Work for Yahoo! Developer Network -Get to work with a lot of startups -Met Carlos in an internet cafe in San Francisco
  3. Hi, I'm Carlos Bueno, an Engineer with Yahoo Mail. Perviously I've founded a startup which was what I was doing when I met Tom. My startup head trouble using two clouds together. Before we start, lemme take a poll: how many of you work for a startup? Less than 50 people? Ok. And how many enterprise folks do we have? Right. How many are technical? You check in code? And business? How many people use the cloud? Planning to? Ok. Good mixed bag. There's a lot to say for all of you.
  4. Tom - Talk is "Cloud's Hidden Lockin" - hidden and dangerous. not sinister in being planned.  Carlos - no guy in the shadows twirling his moustache. artefact of how platform evolved.  Tom - planned or not still dangerous. describe how trap functions, what to do in near term, help solve in medium term. --- The title of this talk is the "Cloud's Hidden Lockin", which sounds kind of sinister. And it is, in the sense of being hidden and dangerous. It's not sinister in the sense of being planned.  There's no guy in the shadows twirling his moustache. The traps we're talking about are an artefact of how this platform evolves.  Whether or not it's planned it's still dangerous. What we want to do in this talk is  to tell you how it functions, what you can do about it in the near term, and how you can help solve it in the medium term.
  5. Carlos - Tommorow’s lock-in about where data lives Tom - And how fast and expensive it it to move to where you need it Carlos - Right. If too expensive/slow to use services from cloud A on cloud B you are locked-in --- The lock-in of tomorrow is going to be about where your data lives and how fast and how expensive it will be to move it to where you need it. You can have all the open formats you want, but if it costs more money to physically move your data than to maintain it where it is, or if it's too slow to feasibly use Service A on Cloud B, you're effectively locked-in to one vendor.
  6. Tom - One take away: lock-in not just about APIs and data formats Carlos - open-source doesn’t solve lock-in. some kinds of problems you can't code your way out of. Tom - Thinking like this is fighting the last interoperability battle --- If there's one thing to take away from this talk, it's that lock-in is not just about APIs and data formats. It's a BIG mistake to think that lock-in has gone away because we have open-source software. There are some kinds of problems that you can't program your way out of.
  7. Tom - So what is latency? Carlos - time it takes to send a bit of data from point A to point B. Tom - Punchline Carlos - Hosting companies spend time and money to reduce the network latency within and between the buildings they own. Tom - as a customer intra-colo traffic is fast and free. Low latency makes it feasible to use Amazon S3 with Amazon EC2. Carlos - But between colos is kind of a no-man's land. You are left on your own. --- Latency is roughly the time it takes to send a bit of data from point A to point B. Everyone in the hosting game: cloud vendors, managed hosting vendors, colo providers, etc, spend enormous amounts of time and money to reduce the network latency within and between the buildings they own. The benefit to you as a customer is that intra-colo traffic is fast and free. Low latency is why it's feasible to use Amazon S3 with Amazon EC2. Why does latency suck? ... Well, ... because ... it makes everything slower. But between colos is kind of a no-man's land. You are left on your own.
  8. Carlos - Even if you were ok with high latency between cloud A to cloud B, the way things are going you'll pay twice for each byte sent between them. Tom - Trend started with AWS. simple model, data in-colo free / all data out-colo fixed price per byte. Carlos - There are lots of business reasons for this pricing model.  Tom - no distinction between data over the open 'net and freepeer cuts off many interesting uses of the cloud. Carlos - And paying twice is no fun --- Bandwidth metering is the other jaw of the trap. Even if you were ok with high latency between cloud A to cloud B, the way things are going you'll pay twice for each byte sent between them. This trend started with Amazon Web Services. They introduced a simple model, where all data in-colo was free and all data out-colo had a fixed price per byte. There are lots of business reasons for this pricing model.  But by making no distinction between data that goes out over the open 'net and data that goes over a freepeer, they cut off many interesting uses of the cloud.
  9. Carlos - the proposition is pretty stark. Stay inside one cloud and everything is fast and cheap. Stray outside and suddenly everything gets slow and expensive. Tom - It’s not so much a cloud as a bunch of bubbles --- Put it that way and the proposition is pretty stark. Stay inside one cloud and everything is fast and cheap. Stray outside and suddenly everything gets slow and expensive.
  10. Tom - lockin is in whatever makes it expensive to switch between or interoperate with different vendors Carlos - There are some problems you can’t code your way out of. Today if you ask an engineer how to use Cloud Server A with Cloud Database B, she’ll tell you it’s a) impossible and b) stupid. Tom - Of course copying a gigabyte from Amazon to Rackspace is slow: it goes over the open internet. Of course you should be charged twice for the same byte: how else can they make money? Carlos - really? is this the internet we know and love? is this the 21st century or the 19th? --- The essence of lockin is in whatever makes it expensive to switch between or interoperate with different vendors. Cloud computing in particular brings up some new problems you can't code your way out of. In the cloud world today it's taken as a given that you can't mix and match services from different cloud vendors. Of course copying a gigabyte from Amazon to Rackspace is slow: it goes over the open internet. Of course you should be charged twice for the same byte: how else can they make money? You know what that sounds like? It sounds like the postal service circa 1840.
  11. Tom - Back in the day every country had their own rules and infrastructure. You had to think very hard about the best routes and accounting for all of the delays and expenses along the way. Carlos - Countries slowly figured out that simple rules and flat postal rates inside their borders encouraged commerce by reducing friction and overhead. Tom - But it took a while for that idea to extend worldwide. A lot of infrastructure --and, frankly, a lot of trust-- had not yet been built up.
  12. carlos - a letter from manila, Philippines to Boston, USA took a long, sad route.
  13. Every link was slow. Different portage fees and taxes at each point.
  14. Tom - Early 1870's two things. US and British Empire signed a flat rate treaty: 16 cents/oz anywhere in British Empire to anywhere US, no questions asked.
  15. Tom - This was not necessarily cheaper, but it as much simpler and faster. So crafty folk in Manila started sending letters to the US through Hong Kong to take advantage of the special rates.
  16. Tom - The United States completed its transcontinental railroad.
  17. Carlos - Fun fact: an 8oz letter along this route cost about the same, inflation-adjusted, as a FedEx letter in 2009: 16c/oz is equivelent to $4/oz of todays money.
  18. Carlos - This worked so well that it only took another generation before a big chunk of the world agreed to a single treaty, the Bern Treaty. Which allowed global mail at a flat fee.
  19. Carlos - The Bern Treaty, with three simple rules: Uniform letter rate between countries Equal treatment for foreign and domestic mail Origin country keeps the money That third bit is the keystone: instead of everyone scrambling for their little cut, the treaty worked on the principle that every letter begat a reply so things pretty much came out even anyway. So the sending country keeps the money and makes it simpler for everybody.
  20. There were four separate things needed to bring about what we think of as the modern international mail system.  First you needed better infrastructure inside and between countries.  You needed literally more portable objects, envelopes with stamps on them, instead of loose sheets, scrolls, wax seals, etc. You also needed standardization of the rates and address formats so one letter can travel anywhere.  Last was a uniform rate, no-questions-asked promise to deliver via optimized routes, what we would now call a "peering agreement". Two ends of the agreement would treat each other as peers, and honor each others' comminucations as they would their own.
  21. It's that kind of system we don't have, but should, in the cloud. We need better infrastructure in the form of optimized routes between clouds. We need to be able to move our virtual machines and configurations around without special help. We need to make sure we don't get locked-in by screwball APIs or data formats. Most of all, we need the various cloud and web services vendors to commit to honoring each other's traffic without clobbering us, their customers, with metered billing.
  22. Tom - Or to look at it another way, true interoperability is built on top of these foundations.
  23. Carlos - The state of the cloud is pretty close the state of the postal system circa 1840. We have better infrastructure between our colos than they had between countries but it's still too expensive to move large amounts of data around. It's also too slow to send important, time-sensitive data around at volume. Tom - Meaning you can't feasibly use database A with cloud B.
  24. Carlos - The most visible work people are doing seems to be around compatibility and portability. Not much is being done about infrastructure and peering. Tom - It's nice that some day you'll be able to migrate machines from one cloud to another via Microsoft Simple Virtual Machine Object Protocol 2.0, but if moving the data is slow and expensive, who cares?
  25. Carlos - Many startups are helping to make it easier to move between clouds.
  26. Carlos - Rightscale.. manage backup scaling performance
  27. Not: - Open - About Cloud Customers - A Manifesto - Holding to anything
  28. Carlos - Protocol for shuttling virtual machines around
  29. Tom - OpenCap (proposed IETF standard) language for specifying how to manage clouds automatically deal with bloated OS stack incompatible apis automation
  30. Carlos - But Tom and I want to hit the full stack, the things we just mentioned only cover the middle two pieces
  31. Tom - So how do we make it happen?
  32. Tom - As we all know the internet is a series of tubes Carlos - But seriously, it’s not such a bad analogy. We need better connections between colos.
  33. Carlos - The interesting but unsurprising fact about datacenters is that they tend to cluster in the same areas. Anywhere there is cheap land, electricity, tax breaks and good backbone, there will usually be some aggressively anonymous buildings containing millions of dollars of hardware. So when the big internet players of the world decide to hook up, they will find that it’s relatively cheap. Often their counterparts are in the next building or just across town. Tom - We are compiling a map of known datacenters form Yahoo, Google, Amazon, Microsoft, etc.
  34. Carlos - The last component is the peering agreements around these new fast inter-cloud routes. A peering agreement is simple in principle though the details differ. Remember the flat-rate treaty between the US and UK? That was an agreement to see each other as peers, and to treat the other’s mail just as you would treat your own. Tom - So far the only instance of explicit cloud peering, ie, two parties did the work specifically to make it easier for their common customers to interoperate, was between Joyent and Facebook in late 2007. Joyent and Yahoo (2009).
  35. I used to work for a search advertising startup called Terespondo. We were based in Miami. We brokered user web searches at very high volume between a certain large software company in Seattle with partners in Brasil.  Needless to say, our business depended on how fast and how cheap we could do this. We discovered that one of our partners had some servers in the same datacenter as we did in miami.  So we did up an agreement over email and connected our servers with a cheap network cable, and we were off to the races.
  36. If anyone from Mastercard is here, apologies for parodying your excellent ads. Please don’t sue us. There was a very direct effect on our top line, because we could service more searches faster,  and bottom line, because we we spending less on bandwidth.
  37. We're not  in the promised land yet, but there are things you can do to avoid lock-in and also help push the evolution along.
  38. Tom - If you are a CTO at a large company you are in a good position. If the vendors start talking about VPN, ask them why it's so slow and expensive to use it. Right now, before you hand over your data, you have the most leverage you ever will. You all know more about high-level negotiation than I. All I'm saying is that you should really push them on latency and cost of the bandwidth. If you are a Fortune 1000 you are probably big enough to swing a peering agreement on your own. Pick “best of breed”
  39. if you are  smaller company with major operations in the cloud, I recommend using two separate vendors -- call them Cloud A and B. Host your site as normal in Cloud A. There's no reason to try to run them in parallel. Host your development / staging systems in Cloud B. Also keep a mirror of all your data backups in Cloud B. This forces good habits. You'll never get stuck writing cloud-specific code because you have to deal with both all the time as a normal part of your deployment and testing.  Second you'll have off-site backups, always a good thing. Third, you'll have a complete copy of production data to test on. Once you have this warm spare running on cloud B, you're in a good position. In the event of a disaster you can provision servers and spin up at the new location in less time than it takes for the DNS change to propogate. All that is good hygine, but it's even better as leverage.  Make sure that both Cloud A and B know what you are up to. Call up the salespeople and say, "Hey, I love you guys!. But I'm doing backups to B. It says here on cloud-peering.com that you and B have datacenters next to each other. Why am I paying you so much to send data across the street? Why don't you two set up a peering agreement? If you do that I'll be able to spend more money on servers instead of backups."  Make it a very straightforward, win-win, top and bottom-line issue.
  40. Tom - Now, why would the cloud vendors, the ones who apparently benefit most from lock-in, want to do peering? image: http://www.flickr.com/photos/wheatfields/2587147000/
  41. Carlos - Instead of fighting for a piece of the little pie, they can make the pie much much bigger. image: http://www.flickr.com/photos/diamondjoe/122553453/sizes/o/
  42. Network effects. Throughout history, the minute competing networks have interconnected, total usage went off the gauge. 8 months after SMS interop went live in the UK, Portugal and Australia in 1999, network usage jumped as much as 900%. Holy Shit, Batman! Image credit: http://www.flickr.com/photos/kiwanja/3170279816/sizes/o/ Source: http://www.verisign.com/stellent/groups/public/documents/white_paper/001962.pdf
  43. Tom - Widespread peering opens up things were not possible before. For example, why not selling data storage on the open market? Companies could trade in units of terabyte/seconds, swap storage in remote locations, etc. Just like they do with shipping containers and physical storage. Carlos - (Note: this will leave current privacy, crimes investigation, and censorship laws in the dust) Image Credit: http://www.flickr.com/photos/thewalkingirony/3051500551/sizes/o/
  44. An extreme example of peering for data transfer is “Internet2”, a private network universities use to send large blobs of research around. For example, the University of San Diego Supercomputing Center has projects that swap data with sites in Tokyo and New Jersey. A big reason they don’t put their data or compute nodes in the cloud is the cost of transit. So instead they use their own systems and Internet2. Average throughput: 9.08 gigabits per second roundtrip Tokyo -> Seattle -> Amsterdam -> Tokyo
  45. Tom - Are not currently offering open cloud. Providing services for our internal customers Tom - But we are opening sourcing our cloud infrastructure. Tom - and Providing aggregator for Web Services. YQL is Hong Kong.
  46. ats used to be called yts (yaho! traffic server) open source project for a fast caching proxy part of the infrastructure needed between cloud vendors is caching. e.g. storing repeated requests between each other for their customers
  47. blind peering on behalf of smaller services
  48. Carlos - just to recap, true interopability not just about software/data formats. It’s about flat rates and the ability to use more than one vendor Tom - It’s about building an economy where everyone benefits, not just the cloud vendors, or the customers. Carlos - bringing the cloud into the 21st c, at least as sophisticated as the mail system circa 1894