Building a Layer 3 network with Cumulus Linux

•Download as PPTX, PDF•

0 likes•916 views

Learn how Outbrain, the world's leading discovery platform, broke their network and found their way to a disaggregated model. Using Cumulus Linux, they architected an open network built for performance, scalability and automation. To see the full recorded webinar, visit https://cumulusnetworks.com/lp/cumulus-outbrain-webinar/

Technology

Switches, Penguins and
One Bad Cable
Alex Balk

ADI NAVEH
ALEX BALK
ALEX KARASIK
CHEN SHABI
DAFNA FRANK
DORI SHMUEL
GAI RADZI
GERARDO LARACUENTE
GUY MAZUZ
RYAN MCQUILLAN
SHAHAF SAGES
YAFIT MELES
We Are
Core

OUR PURPOSE
OUTBRAIN helps people discover
content that they find interesting.

250 Billion
Content Recommendations
Every Month
½ Billion
People Worldwide
OUTBRAIN
BY THE NUMBERS

AVAILABILITYMANAGEMENT
Two Main Networking Challenges

6 Million
Metrics generated every minute
150 Releases
To production every day
OUTBRAIN
BY THE NUMBERS

SCALE IS ABOUT
TURNING THE LIGHTS ON
Network (gasp!)
was 100% Manual!
• Every change =
risk
• Switching stack
proprietary
• Debugging = fight
or just a hit-n-miss
• Lead time to set-up
new stack
measured in
weeks!
• No way to scale to
the next 10X

New Data Center = Clos Fabric — running BGP end-to-end

Node
Leaf A Leaf B
Spine
NodeNode
SpineSpine
No bonding.
No backbone.
Everything is just a router!

All possible paths to all possible destinations constructed —
hop-by-hop

Node
Leaf A
Spine
NodeNode
SpineSpine
Leaf B
ECMP = “Send it down any available path, they’re all the same”.

SIMPLE
PREDICTABLE
SCALABLE
A Network That is Now

DEVICE
MANAGEMENT
CABLE
MANAGEMENT
SETUP TIME
MONITORING
TESTING

SCALE IS ABOUT
BUILDING THE RIGHT CULTURE

SCALE IS ABOUT
CHOOSING THE RIGHT TOOLS
To bootstrap the new datacenter5 DAYS
99% Of code worked as expected
1 Bad cable...out of 3,000

END SOLUTION MODULES
DRAFT 051116
Thank
You

Hardcore Tech Stuff
Slides shamelessly “borrowed”
from Adi Naveh’s internal tech talk

Traditional Network Topology
Aggregation
Core
Access

Traditional Network Topology
Access
Aggregation
Core
Services
Clients
North-South Traffic

Load Balancers Load Balancers
ISP
Traditional Network Topology in Data Center
Access
Aggregation
Core
Services
North-South Traffic
East-West Traffic

Network operators are slowly but surely embracing L3-based leaf-spine designs. However, either due to legacy applications or certain multi-tenancy requirements, the need for L2 across racks is still present. How do you solve the problem of providing L2 across multiple racks? EVPN is quickly emerging as the best answer to this question. In this episode of our 2-part series on EVPN, we start with a discussion of the use cases, a review of the technologies EVPN competes with, and dive into an evaluation of the pros and cons of each. For a recording of the live event, go to http://go.cumulusnetworks.com/l/32472/2017-09-22/95t27t

Best practices for network troubleshooting

Cumulus Networks

Slides from our Demystifying Networking web series. Take a look and learn why multipathing, Network virtualization, microservices and other data center realities are making troubleshooting more challenging. Traceroute and other troubleshooting "solutions" are often ineffectual and time consuming. Learn what new tools and technologies are available to network operators for fast, effective troubleshooting.

NetDevOps 202: Life After Configuration

Cumulus Networks

This webinar presentation from July 2017 talks about the challenges that network operators and IT folks face after the network is configured. How do you handle changes after the initial configuration? What about rolling in new racks or DCs? Learn how DevOps can help with validation, troubleshooting, and life cycle management. Full recording of webinar can be accessed at http://go.cumulusnetworks.com/l/32472/2017-05-04/91sy7b

Cumulus Networks: Automating Network Configuration

Cumulus Networks

How deep is your buffer – Demystifying buffers and application performance

Cumulus Networks

Packet buffer memory is among the oldest topics in networking, and yet it never seems to fade in popularity. Starting from the days of buffers sized by the bandwidth delay product to what is now called "buffer bloat", from the days of 10Mbps to 100Gbps, the discussion around how deep should the buffers be never ceases to evoke opinionated responses. In this webinar we will be joined by JR Rivers, co-founder and CTO of Cumulus Networks, a man who has designed many ultra-successful switching chips, switch products, and compute platforms, to discuss the innards of buffering. This webinar will cover data path theory, tools to evaluate network data path behavior, and the configuration variations that affect application visible outcomes.

Demystifying Networking: Data Center Networking Trends 2017

Cumulus Networks

Today, all data centers need high-performance networking that’s efficient, automated and scales affordably. But with big data, those needs are especially acute. How can you build less congested networks with easier scheduling? Is disaggregation with open networking the right fit for big data? Watch this presentation to learn about: Lowering CapEx while building big networks Eradicating Layer 2 issues with Layer 3 fabrics OpEx savings from simpler scaling and automation using your Linux server tools Reducing congestion and problems with locality Easier scheduling of big data jobs and better utilization of compute resources

Mlag invisibile layer 2 redundancy

Cumulus Networks

It's neither a standard nor a protocol, but everyone's doing it. In this presentation, we'll begin by describing the use cases where Multi-Chassis Link Aggregation, or MLAG, can be used to improve the reliability of your network. This will lead into a detailed discussion of how MLAG works as well as what pitfalls you'll need to avoid. Then, we'll explore the interactions with other system components such as LACP, Spanning Tree, and IGMP. Finally, we'll present about how to configure and monitor MLAG in Cumulus Linux.

UiPath Test Automation using UiPath Test Suite series, part 6

DianaGray10

Welcome to UiPath Test Automation using UiPath Test Suite series part 6. In this session, we will cover Test Automation with generative AI and Open AI. UiPath Test Automation with generative AI and Open AI webinar offers an in-depth exploration of leveraging cutting-edge technologies for test automation within the UiPath platform. Attendees will delve into the integration of generative AI, a test automation solution, with Open AI advanced natural language processing capabilities. Throughout the session, participants will discover how this synergy empowers testers to automate repetitive tasks, enhance testing accuracy, and expedite the software testing life cycle. Topics covered include the seamless integration process, practical use cases, and the benefits of harnessing AI-driven automation for UiPath testing initiatives. By attending this webinar, testers, and automation professionals can gain valuable insights into harnessing the power of AI to optimize their test automation workflows within the UiPath ecosystem, ultimately driving efficiency and quality in software development processes. What will you get from this session? 1. Insights into integrating generative AI. 2. Understanding how this integration enhances test automation within the UiPath platform 3. Practical demonstrations 4. Exploration of real-world use cases illustrating the benefits of AI-driven test automation for UiPath Topics covered: What is generative AI Test Automation with generative AI and Open AI. UiPath integration with generative AI Speaker: Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP

Epistemic Interaction - tuning interfaces to provide information for AI support

Alan Dix

Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024 https://alandix.com/academic/papers/synergy2024-epistemic/ As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.

Recently uploaded

UiPath Test Automation using UiPath Test Suite series, part 6

DianaGray10

Epistemic Interaction - tuning interfaces to provide information for AI support

Alan Dix

zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs

Alex Pruden

This paper presents Reef, a system for generating publicly verifiable succinct non-interactive zero-knowledge proofs that a committed document matches or does not match a regular expression. We describe applications such as proving the strength of passwords, the provenance of email despite redactions, the validity of oblivious DNS queries, and the existence of mutations in DNA. Reef supports the Perl Compatible Regular Expression syntax, including wildcards, alternation, ranges, capture groups, Kleene star, negations, and lookarounds. Reef introduces a new type of automata, Skipping Alternating Finite Automata (SAFA), that skips irrelevant parts of a document when producing proofs without undermining soundness, and instantiates SAFA with a lookup argument. Our experimental evaluation confirms that Reef can generate proofs for documents with 32M characters; the proofs are small and cheap to verify (under a second). Paper: https://eprint.iacr.org/2023/1886

PCI PIN Basics Webinar from the Controlcase Team

ControlCase

Introduction to CHERI technology - Cybersecurity

mikeeftimakis1

Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI

Vladimir Iglovikov, Ph.D.

Presented by Vladimir Iglovikov: - https://www.linkedin.com/in/iglovikov/ - https://x.com/viglovikov - https://www.instagram.com/ternaus/ This presentation delves into the journey of Albumentations.ai, a highly successful open-source library for data augmentation. Created out of a necessity for superior performance in Kaggle competitions, Albumentations has grown to become a widely used tool among data scientists and machine learning practitioners. This case study covers various aspects, including: People: The contributors and community that have supported Albumentations. Metrics: The success indicators such as downloads, daily active users, GitHub stars, and financial contributions. Challenges: The hurdles in monetizing open-source projects and measuring user engagement. Development Practices: Best practices for creating, maintaining, and scaling open-source libraries, including code hygiene, CI/CD, and fast iteration. Community Building: Strategies for making adoption easy, iterating quickly, and fostering a vibrant, engaged community. Marketing: Both online and offline marketing tactics, focusing on real, impactful interactions and collaborations. Mental Health: Maintaining balance and not feeling pressured by user demands. Key insights include the importance of automation, making the adoption process seamless, and leveraging offline interactions for marketing. The presentation also emphasizes the need for continuous small improvements and building a friendly, inclusive community that contributes to the project's growth. Vladimir Iglovikov brings his extensive experience as a Kaggle Grandmaster, ex-Staff ML Engineer at Lyft, sharing valuable lessons and practical advice for anyone looking to enhance the adoption of their open-source projects. Explore more about Albumentations and join the community at: GitHub: https://github.com/albumentations-team/albumentations Website: https://albumentations.ai/ LinkedIn: https://www.linkedin.com/company/100504475 Twitter: https://x.com/albumentations

Generative AI Deep Dive: Advancing from Proof of Concept to Production

Aggregage

Uni Systems Copilot event_05062024_C.Vlachos.pdf

Uni Systems S.M.S.A.

FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf

FIDO Alliance

By Design, not by Accident - Agile Venture Bolzano 2024

Pierluigi Pugliese

Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!

SOFTTECHHUB

As the digital landscape continually evolves, operating systems play a critical role in shaping user experiences and productivity. The launch of Nitrux Linux 3.5.0 marks a significant milestone, offering a robust alternative to traditional systems such as Windows 11. This article delves into the essence of Nitrux Linux 3.5.0, exploring its unique features, advantages, and how it stands as a compelling choice for both casual users and tech enthusiasts.

Artificial Intelligence for XMLDevelopment

Octavian Nadolu

In the rapidly evolving landscape of technologies, XML continues to play a vital role in structuring, storing, and transporting data across diverse systems. The recent advancements in artificial intelligence (AI) present new methodologies for enhancing XML development workflows, introducing efficiency, automation, and intelligent capabilities. This presentation will outline the scope and perspective of utilizing AI in XML development. The potential benefits and the possible pitfalls will be highlighted, providing a balanced view of the subject. We will explore the capabilities of AI in understanding XML markup languages and autonomously creating structured XML content. Additionally, we will examine the capacity of AI to enrich plain text with appropriate XML markup. Practical examples and methodological guidelines will be provided to elucidate how AI can be effectively prompted to interpret and generate accurate XML markup. Further emphasis will be placed on the role of AI in developing XSLT, or schemas such as XSD and Schematron. We will address the techniques and strategies adopted to create prompts for generating code, explaining code, or refactoring the code, and the results achieved. The discussion will extend to how AI can be used to transform XML content. In particular, the focus will be on the use of AI XPath extension functions in XSLT, Schematron, Schematron Quick Fixes, or for XML content refactoring. The presentation aims to deliver a comprehensive overview of AI usage in XML development, providing attendees with the necessary knowledge to make informed decisions. Whether you’re at the early stages of adopting AI or considering integrating it in advanced XML development, this presentation will cover all levels of expertise. By highlighting the potential advantages and challenges of integrating AI with XML development tools and languages, the presentation seeks to inspire thoughtful conversation around the future of XML development. We’ll not only delve into the technical aspects of AI-powered XML development but also discuss practical implications and possible future directions.

Essentials of Automations: The Art of Triggers and Actions in FME

Safe Software

In this second installment of our Essentials of Automations webinar series, we’ll explore the landscape of triggers and actions, guiding you through the nuances of authoring and adapting workspaces for seamless automations. Gain an understanding of the full spectrum of triggers and actions available in FME, empowering you to enhance your workspaces for efficient automation. We’ll kick things off by showcasing the most commonly used event-based triggers, introducing you to various automation workflows like manual triggers, schedules, directory watchers, and more. Plus, see how these elements play out in real scenarios. Whether you’re tweaking your current setup or building from the ground up, this session will arm you with the tools and insights needed to transform your FME usage into a powerhouse of productivity. Join us to discover effective strategies that simplify complex processes, enhancing your productivity and transforming your data management practices with FME. Let’s turn complexity into clarity and make your workspaces work wonders!

Securing your Kubernetes cluster_ a step-by-step guide to success !

KatiaHIMEUR1

Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster. However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks. In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.

Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...

James Anderson

Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management. The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM). Speakers: Bob Boule Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle. Gopinath Rebala Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.

Monitoring Java Application Security with JDK Tools and JFR Events

Ana-Maria Mihalceanu

Pushing the limits of ePRTC: 100ns holdover for 100 days

Adtran

LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...

DanBrown980551

Do you want to learn how to model and simulate an electrical network from scratch in under an hour? Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)! During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook. PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides: - A fully editable and extendable library for grid component modelling; - Visualization tools to display your network; - Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses; The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well. What you will learn during the webinar: - For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills; - For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.

20240605 QFM017 Machine Intelligence Reading List May 2024

Matthew Sinclair

20240607 QFM018 Elixir Reading List May 2024

Matthew Sinclair

Recently uploaded (20)

UiPath Test Automation using UiPath Test Suite series, part 6

Epistemic Interaction - tuning interfaces to provide information for AI support

zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs

PCI PIN Basics Webinar from the Controlcase Team

Introduction to CHERI technology - Cybersecurity

Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI

Generative AI Deep Dive: Advancing from Proof of Concept to Production

Uni Systems Copilot event_05062024_C.Vlachos.pdf

FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf

By Design, not by Accident - Agile Venture Bolzano 2024

Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!

Artificial Intelligence for XMLDevelopment

Essentials of Automations: The Art of Triggers and Actions in FME

Securing your Kubernetes cluster_ a step-by-step guide to success !

Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...

Monitoring Java Application Security with JDK Tools and JFR Events

Pushing the limits of ePRTC: 100ns holdover for 100 days

LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...

20240605 QFM017 Machine Intelligence Reading List May 2024

20240607 QFM018 Elixir Reading List May 2024

Building a Layer 3 network with Cumulus Linux

1. Switches, Penguins and One Bad Cable Alex Balk

2. Back on AUGUST 13th 2015

3. ADI NAVEH ALEX BALK ALEX KARASIK CHEN SHABI DAFNA FRANK DORI SHMUEL GAI RADZI GERARDO LARACUENTE GUY MAZUZ RYAN MCQUILLAN SHAHAF SAGES YAFIT MELES We Are Core

4. OUR PURPOSE OUTBRAIN helps people discover content that they find interesting.

5. 250 Billion Content Recommendations Every Month ½ Billion People Worldwide OUTBRAIN BY THE NUMBERS

6. THE BEGINNING

10. AVAILABILITYMANAGEMENT Two Main Networking Challenges

11. AVAILABILITYMANAGEMENT

12. 4 racks 80 nodes 320 nodes 1 switch

13. 4 racks 80 nodes 320 nodes 1 switch

14. AVAILABILITYMANAGEMENT

15. Node Stack A Stack B Backbone NodeNode

16. SCALE IS ABOUT DOING MORE WITH LESS

17.

18.

19. 6 Million Metrics generated every minute 150 Releases To production every day OUTBRAIN BY THE NUMBERS

20. SCALE IS ABOUT TURNING THE LIGHTS ON Network (gasp!) was 100% Manual! • Every change = risk • Switching stack proprietary • Debugging = fight or just a hit-n-miss • Lead time to set-up new stack measured in weeks! • No way to scale to the next 10X

21. June 2017

22. OUTBRAIN OFFICES

23. New Data Center = Clos Fabric — running BGP end-to-end

24. Node Leaf A Leaf B Spine NodeNode SpineSpine No bonding. No backbone. Everything is just a router!

25. All possible paths to all possible destinations constructed — hop-by-hop

26. Node Leaf A Spine NodeNode SpineSpine Leaf B ECMP = “Send it down any available path, they’re all the same”.

27. SIMPLE PREDICTABLE SCALABLE A Network That is Now

28. DEVICE MANAGEMENT CABLE MANAGEMENT SETUP TIME MONITORING TESTING

29. SCALE IS ABOUT BUILDING THE RIGHT CULTURE

30. SCALE IS ABOUT CHOOSING THE RIGHT TOOLS To bootstrap the new datacenter5 DAYS 99% Of code worked as expected 1 Bad cable...out of 3,000

31. END SOLUTION MODULES DRAFT 051116 Thank You

32. Hardcore Tech Stuff Slides shamelessly “borrowed” from Adi Naveh’s internal tech talk

33. Infranet Team Gai Adi Yafit Chen

34. Traditional Network Topology Aggregation Core Access

35. Traditional Network Topology Access Aggregation Core Services Clients North-South Traffic

36. Load Balancers Load Balancers ISP Traditional Network Topology in Data Center Access Aggregation Core Services North-South Traffic East-West Traffic

Editor's Notes

Publishers from all around the world
In fact, when we designed the new datacenter, We wrote Chef cookbooks to automate provisioning and config We wrote unit and integration tests using Chef’s toolchain. And setup a CI pipeline for the code. We even simulated the entire datacenter, switches, servers and all, Using Vagrant. It worked so well, that bootstrapping the new datacenter took us just 5 days. Think about it. The first time we ever saw a real Dell switch running Linux, was when we arrived onsite for the buildout. And yet, 99% of our code worked as expected. In 5 days, we were able to setup a LAN, VPN, server provisioning, DNS, LDAP, and dealt with some quirky BIOS configs. On the servers, mind you, not the switches. We even hooked Cumulus’ built-in cabling validation, To our Prometheus based monitoring system. So that right after we turned monitoring on, we got an alert. On one bad cable. Out of 3000.

Building a Layer 3 network with Cumulus Linux

Recommended

Recommended

More Related Content

More from Cumulus Networks

More from Cumulus Networks (20)

Recently uploaded

Recently uploaded (20)

Building a Layer 3 network with Cumulus Linux

Editor's Notes