Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Building a Layer 3 network with Cumulus Linux

518 views

Published on

Learn how Outbrain, the world's leading discovery platform, broke their network and found their way to a disaggregated model. Using Cumulus Linux, they architected an open network built for performance, scalability and automation. To see the full recorded webinar, visit https://cumulusnetworks.com/lp/cumulus-outbrain-webinar/

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Building a Layer 3 network with Cumulus Linux

  1. 1. Switches, Penguins and One Bad Cable Alex Balk
  2. 2. Back on AUGUST 13th 2015
  3. 3. ADI NAVEH ALEX BALK ALEX KARASIK CHEN SHABI DAFNA FRANK DORI SHMUEL GAI RADZI GERARDO LARACUENTE GUY MAZUZ RYAN MCQUILLAN SHAHAF SAGES YAFIT MELES We Are Core
  4. 4. OUR PURPOSE OUTBRAIN helps people discover content that they find interesting.
  5. 5. 250 Billion Content Recommendations Every Month ½ Billion People Worldwide OUTBRAIN BY THE NUMBERS
  6. 6. THE BEGINNING
  7. 7. AVAILABILITYMANAGEMENT Two Main Networking Challenges
  8. 8. AVAILABILITYMANAGEMENT
  9. 9. 4 racks 80 nodes 320 nodes 1 switch
  10. 10. 4 racks 80 nodes 320 nodes 1 switch
  11. 11. AVAILABILITYMANAGEMENT
  12. 12. Node Stack A Stack B Backbone NodeNode
  13. 13. SCALE IS ABOUT DOING MORE WITH LESS
  14. 14. 6 Million Metrics generated every minute 150 Releases To production every day OUTBRAIN BY THE NUMBERS
  15. 15. SCALE IS ABOUT TURNING THE LIGHTS ON Network (gasp!) was 100% Manual! • Every change = risk • Switching stack proprietary • Debugging = fight or just a hit-n-miss • Lead time to set-up new stack measured in weeks! • No way to scale to the next 10X
  16. 16. June 2017
  17. 17. OUTBRAIN OFFICES
  18. 18. New Data Center = Clos Fabric — running BGP end-to-end
  19. 19. Node Leaf A Leaf B Spine NodeNode SpineSpine No bonding. No backbone. Everything is just a router!
  20. 20. All possible paths to all possible destinations constructed — hop-by-hop
  21. 21. Node Leaf A Spine NodeNode SpineSpine Leaf B ECMP = “Send it down any available path, they’re all the same”.
  22. 22. SIMPLE PREDICTABLE SCALABLE A Network That is Now
  23. 23. DEVICE MANAGEMENT CABLE MANAGEMENT SETUP TIME MONITORING TESTING
  24. 24. SCALE IS ABOUT BUILDING THE RIGHT CULTURE
  25. 25. SCALE IS ABOUT CHOOSING THE RIGHT TOOLS To bootstrap the new datacenter5 DAYS 99% Of code worked as expected 1 Bad cable...out of 3,000
  26. 26. END SOLUTION MODULES DRAFT 051116 Thank You
  27. 27. Hardcore Tech Stuff Slides shamelessly “borrowed” from Adi Naveh’s internal tech talk
  28. 28. Infranet Team Gai Adi Yafit Chen
  29. 29. Traditional Network Topology Aggregation Core Access
  30. 30. Traditional Network Topology Access Aggregation Core Services Clients North-South Traffic
  31. 31. Load Balancers Load Balancers ISP Traditional Network Topology in Data Center Access Aggregation Core Services North-South Traffic East-West Traffic

×