SlideShare a Scribd company logo
Confidential │ ©2019 VMware, Inc.
Accelerating Public
Cloud Migration with
Multi-Cloud Load
Balancing
Abhinav Modi
Group Product Line Manager at VMware
10th October 2019
Confidential │ ©2019 VMware, Inc.
Agenda
2
Challenges with Application Delivery in a Multi-cloud
Environment
Introduction to Avi - VMware NSX Advanced Load Balancer
Live Demo
Multi-cloud Use Cases
Q&A
Confidential │ ©2019 VMware, Inc. 3
Multi-Cloud is Both the Challenge and the Opportunity
• 84% have multi-cloud strategy
• On average, enterprises have
almost 5 clouds
• Running 3.4 clouds
• Experimenting 1.5 clouds
• 24% Public Cloud growth
• 8% Private Cloud growth
Confidential │ ©2019 VMware, Inc. 4
Hardware / Virtual Load Balancer Challenges
DC1 DC2
DEPT1 DEPT2
Standby
0%
Active
15%
Separate control points:
Operational complexity,
hard to automate, painful
upgrades
Capacity management:
Manual VIP placement,
costly overprovisioning, no
capacity pooling
Not designed for modern, new
environments
ON-PREMISES CLOUD CONTAINER
Confidential │ ©2019 VMware, Inc. 5
Load Balancing Challenges in the Public Cloud
Limited features and performance
Migration can slow down due to refactoring, lack of consistency, speed, and automation.
Cloud Provider LB
ON-PREMISES
?
DNS WAF
IPAM LOG
…
Automation and elasticity
Limited visibility
Need to stitch together multiple tools
Lack of multi-cloud consistency
?
Legacy LB
Virtual editions are
NOT cloud-native
No automation or
elasticity
Feature rich
Confidential │ ©2019 VMware, Inc. 6
BARE METAL VIRTUALIZED CONTAINERSON PREMISES PUBLIC CLOUDVIRTUALIZED CONTAINERS
VMware Advanced Load Balancer (by Avi Networks)
Modern, Scalable, Multi-Cloud Architecture
CONTROLLER
SERVICE
ENGINE
SEPARATE CONTROL
& DATA PLANE
ELASTICITY
INTELLIGENCE AUTOMATIONMULTI-CLOUD
Confidential │ ©2019 VMware, Inc. 7
Consistent Application Services Across a Multi-Cloud Fabric
CONTROLLER
EPG
Ingress
Proxy
Istio
Security
group
vCenter group
NSX manager
Automatic
deployment
• Built-in ecosystem integration
• Native cloud connectors
• SaaS or customer-managed
Software Load Balancer
Intelligent
Web Application Firewall
Container Ingress
Scale Set,
IAM, VNET
resource
groups
VPC,
EC2
Route53
APIC
Nova,
Neutron
Keystone
LBaas
Rest API
Istio
Confidential │ ©2019 VMware, Inc. 8
VMware NSX Advanced Load Balancer (by Avi Networks)
• Web App Firewall
• SSL Termination
• DDoS Protection
• L3-4 ACLs
• L7 Rules/Policies
• Rate Limiting
SECURITY
• Application Map
• Service Health Score
• Network Performance
• App Performance
• Request Logging
• Security Insights
ANALYTICS
• Central Management
• 100% REST API / SDK
• Self-Service
• Multi-Tenancy
• Service Discovery
• IPAM/DNS
PLATFORM
• L7 (HTTP) LB
• L4 (TCP/UDP) LB
• Global Load Balancing
• Content Switching
• Caching/Compression
• Autoscaling
LOAD BALANCING
Features
(K8S, OpenShift, PKS, AKS, GKE,
EKS, ...)
• Enterprise-grade Ingress
• Converged LB, Security, Analytics
• Service Discovery & App Map
• Multi-cluster and Multi-cloud
Containers
Use
Cases
(ESXi, x86, NSX, ACI, OpenStack…)
• Central Management
• Real-time Analytics
• SDN Integration and Automation
• Cost Savings
SDDC / On-Prem
(AWS, Azure, GCP, VMC, …)
• Cloud-native Automation
• Enterprise-grade Features
• Real-time Analytics
• Multi-cloud Consistency
Public Cloud
Comprehensive Application Services Platform and Full Lifecycle Automation
Confidential │ ©2019 VMware, Inc. 9
Avi and VMware Integration
VM VMWeb-tier
10.10.1.0/24
Web-2 Web-3
.21 .22
Avi SE
Active-Active
VM
Web-1
.20
10.10.1.10
Security-Group
Web-Tier
Avi
Controller
Client
VM VMWeb-Tier
10.10.1.0/24
Web-2 Web-3
.21 .22
Avi SE
Active-Active
VM
Web-1
.20
10.10.1.10 10.10.1.11
vCenter
Avi
Controller
Client
vCenter
NSX
10.10.1.10 10.10.1.11
Confidential │ ©2019 VMware, Inc. 10
Avi and AWS Integration
11Confidential │ ©2019 VMware, Inc.
Demo
A single application
services fabric across
multiple clouds
BARE METAL VIRTUALIZED CONTAINERS
ON-
PREMISES
AZURE
VIRTUALIZED CONTAINERS
CONTROLLER
SERVIC
E
ENGINE
AWS
VIRTUALIZED CONTAINERS
Confidential │ ©2019 VMware, Inc. 12
Avi and Microsoft Azure Integration
Confidential │ ©2019 VMware, Inc. 13
Avi and VMC Integration
Confidential │ ©2019 VMware, Inc. 14
Million scale
Google Cloud Platform – Autoscaling to 1 Million SSL TPS!
Confidential │ ©2019 VMware, Inc. 15
Global Server Load Balancing
Leader Site - DC 1
VS-A1 VS-B1
DNS
VS-A4
DNS
All GSLB configuration is performed at
the “Leader” Controller
“Leader” Controller syncs the
configuration to all the “Follower” sites
Active Follower Site - AWS
Admin
VS-B3
Active Follower Site - DC 2
VS-A2
DNS
Passive Follower Site Azure
VS-B2
VS-A3
• Geo algorithm – user-proximity
• Two-level nested algorithm support
• DNS policies and Topology policies for
preferred/fallback site and other site
selection logic
• Active/Active - Application high availability
across data center failures.
• Active/Standby - Disaster recovery
• Hybrid cloud with “cloud bursting”
Use Cases
Features
Confidential │ ©2019 VMware, Inc. 16
SoftLayer
GCP
Branch
Model 4 (Large US Retail): Public Cloud backend, Branch front-end
On-Prem AWS
Model 1 (Global Telco IT): AWS as extension of on-prem DC
Direct
Connect
Model 2 (Global Bank): Azure and On-Prem DC as peer DCs hosting apps
On-Prem Azure
Direct
Connect
On-Prem Azure
...
...
Direct Connect
Model 3 (Global Payments): On-prem DC + GCP for backend and remote SEs
On-Prem
On-Prem
...
GCP
Remote GCPs
Multi-Cloud Deployment Models
Confidential │ ©2019 VMware, Inc. 17
Adobe Accelerates Cloud Initiatives with Microsoft Azure
Delivering applications reliably and
securely both on-premises and in
the cloud
By reliably and securely
delivering our applications,
Avi Networks has become a
key partner for our adoption
of Azure.
Brandon Pulsipher
Vice President, Product Technical Operations
Migrate the Adobe Experience Cloud to the
Azure with enterprise-grade support
Deliver thousands of SSL transactions per
second, and elastic scale of load balancers
and app servers based on real-time traffic
Improve operations with app insights and
central management of all load balancers
Confidential │ ©2019 VMware, Inc. 18
Infrastructure-centric Silos to Application-centric Multi-cloud Strategy
Manual, Complex and Fragmented Single, Universal and Automated
BARE METAL VIRTUALIZED CONTAINERS
ON-PREMISES
CONSISTENCY
SIMPLICITY
VISIBILITY
1. Multi-cloud
world today
2. Siloed point
products & services
3. Automate &
orchestrate, visualize
and monitor
Confidential │ ©2019 VMware, Inc.
Thank You

More Related Content

What's hot

What's hot (20)

Working From Anywhere​ with​ Advanced Load Balancing​ and ​ VMware Horizon VDI
Working From Anywhere​ with​ Advanced Load Balancing​ and ​ VMware Horizon VDI Working From Anywhere​ with​ Advanced Load Balancing​ and ​ VMware Horizon VDI
Working From Anywhere​ with​ Advanced Load Balancing​ and ​ VMware Horizon VDI
 
Multi-Cloud Load Balancing – Separating Fact from Fiction
Multi-Cloud Load Balancing – Separating Fact from FictionMulti-Cloud Load Balancing – Separating Fact from Fiction
Multi-Cloud Load Balancing – Separating Fact from Fiction
 
Avi v20.1 — What’s New in Scalable, Multi-Cloud Load Balancing
Avi v20.1 — What’s New in Scalable, Multi-Cloud Load BalancingAvi v20.1 — What’s New in Scalable, Multi-Cloud Load Balancing
Avi v20.1 — What’s New in Scalable, Multi-Cloud Load Balancing
 
Design Best Practices for High Availability in Load Balancing
Design Best Practices for High Availability in Load BalancingDesign Best Practices for High Availability in Load Balancing
Design Best Practices for High Availability in Load Balancing
 
Multi Cloud Load Balancing 101 and Hands On Lab
Multi Cloud Load Balancing 101 and Hands On LabMulti Cloud Load Balancing 101 and Hands On Lab
Multi Cloud Load Balancing 101 and Hands On Lab
 
Prevent threats With Analytics Driven Web Application Firewall
Prevent threats With Analytics Driven Web Application FirewallPrevent threats With Analytics Driven Web Application Firewall
Prevent threats With Analytics Driven Web Application Firewall
 
Securing Web Applications with Deep Automation with VMware NSX Advanced Load ...
Securing Web Applications with Deep Automation with VMware NSX Advanced Load ...Securing Web Applications with Deep Automation with VMware NSX Advanced Load ...
Securing Web Applications with Deep Automation with VMware NSX Advanced Load ...
 
How to Eliminate Load Balancer Upgrade Disruptions
How to Eliminate Load Balancer Upgrade DisruptionsHow to Eliminate Load Balancer Upgrade Disruptions
How to Eliminate Load Balancer Upgrade Disruptions
 
Advanced Web Application Security with an Intelligent WAF
Advanced Web Application Security with an Intelligent WAFAdvanced Web Application Security with an Intelligent WAF
Advanced Web Application Security with an Intelligent WAF
 
Avi workshop-101
Avi workshop-101Avi workshop-101
Avi workshop-101
 
L4-L7 Application Services with Avi Networks
L4-L7 Application Services with Avi NetworksL4-L7 Application Services with Avi Networks
L4-L7 Application Services with Avi Networks
 
Multi-Cloud Load Balancing 101 and Hands-On Lab
Multi-Cloud Load Balancing 101 and Hands-On LabMulti-Cloud Load Balancing 101 and Hands-On Lab
Multi-Cloud Load Balancing 101 and Hands-On Lab
 
Deep Automation and ML-Driven Analytics for Application Services
Deep Automation and ML-Driven Analytics for Application ServicesDeep Automation and ML-Driven Analytics for Application Services
Deep Automation and ML-Driven Analytics for Application Services
 
Deliver Modern Applications with an Elastic Load Balancing Fabric Powered by ...
Deliver Modern Applications with an Elastic Load Balancing Fabric Powered by ...Deliver Modern Applications with an Elastic Load Balancing Fabric Powered by ...
Deliver Modern Applications with an Elastic Load Balancing Fabric Powered by ...
 
7 Virtues of a Next-gen ADC
7 Virtues of a Next-gen ADC7 Virtues of a Next-gen ADC
7 Virtues of a Next-gen ADC
 
Bringing SaaS Simplicity to Proactive Support & Live Threat Updates
Bringing SaaS Simplicity to Proactive Support & Live Threat UpdatesBringing SaaS Simplicity to Proactive Support & Live Threat Updates
Bringing SaaS Simplicity to Proactive Support & Live Threat Updates
 
Multi Cloud Load balancing 101 and Hands-on Lab
Multi Cloud Load balancing 101 and Hands-on LabMulti Cloud Load balancing 101 and Hands-on Lab
Multi Cloud Load balancing 101 and Hands-on Lab
 
7 Requirements for Modern Load Balancers
7 Requirements for Modern Load Balancers7 Requirements for Modern Load Balancers
7 Requirements for Modern Load Balancers
 
Multi-Cloud Load Balancing and Application Services
Multi-Cloud Load Balancing and Application ServicesMulti-Cloud Load Balancing and Application Services
Multi-Cloud Load Balancing and Application Services
 
State of Load Balancing 2020
State of Load Balancing 2020State of Load Balancing 2020
State of Load Balancing 2020
 

Similar to Accelerating Public Cloud Migration with Multi-Cloud Load Balancing

Radware bringing mission and performance critical applications to cloud sta...
Radware   bringing mission and performance critical applications to cloud sta...Radware   bringing mission and performance critical applications to cloud sta...
Radware bringing mission and performance critical applications to cloud sta...
ShapeBlue
 

Similar to Accelerating Public Cloud Migration with Multi-Cloud Load Balancing (20)

One And Done Multi-Cloud Load Balancing Done Right.pptx
One And Done Multi-Cloud Load Balancing Done Right.pptxOne And Done Multi-Cloud Load Balancing Done Right.pptx
One And Done Multi-Cloud Load Balancing Done Right.pptx
 
AWS and VMware: How to Architect and Manage Hybrid Environments
AWS and VMware: How to Architect and Manage Hybrid EnvironmentsAWS and VMware: How to Architect and Manage Hybrid Environments
AWS and VMware: How to Architect and Manage Hybrid Environments
 
VMworld 2015: No App is An Island
VMworld 2015: No App is An IslandVMworld 2015: No App is An Island
VMworld 2015: No App is An Island
 
Cloud_controllers_public_webinar_aug31_v1.pptx
Cloud_controllers_public_webinar_aug31_v1.pptxCloud_controllers_public_webinar_aug31_v1.pptx
Cloud_controllers_public_webinar_aug31_v1.pptx
 
Selecting the Best VPC Network Architecture (CPN208) | AWS re:Invent 2013
Selecting the Best VPC Network Architecture (CPN208) | AWS re:Invent 2013Selecting the Best VPC Network Architecture (CPN208) | AWS re:Invent 2013
Selecting the Best VPC Network Architecture (CPN208) | AWS re:Invent 2013
 
Ask The Architect: RightScale & AWS Dive Deep into Hybrid IT
Ask The Architect: RightScale & AWS Dive Deep into Hybrid ITAsk The Architect: RightScale & AWS Dive Deep into Hybrid IT
Ask The Architect: RightScale & AWS Dive Deep into Hybrid IT
 
Virtualize Application Security Today - Hardware is No Longer Needed.pptx
 Virtualize Application Security Today - Hardware is No Longer Needed.pptx Virtualize Application Security Today - Hardware is No Longer Needed.pptx
Virtualize Application Security Today - Hardware is No Longer Needed.pptx
 
MongoDB World 2019: Wipro Software Defined Everything Powered by MongoDB
MongoDB World 2019: Wipro Software Defined Everything Powered by MongoDBMongoDB World 2019: Wipro Software Defined Everything Powered by MongoDB
MongoDB World 2019: Wipro Software Defined Everything Powered by MongoDB
 
Radware bringing mission and performance critical applications to cloud sta...
Radware   bringing mission and performance critical applications to cloud sta...Radware   bringing mission and performance critical applications to cloud sta...
Radware bringing mission and performance critical applications to cloud sta...
 
NSX_Advanced_Load_Balancer_Solution_with_Oracle.pptx
NSX_Advanced_Load_Balancer_Solution_with_Oracle.pptxNSX_Advanced_Load_Balancer_Solution_with_Oracle.pptx
NSX_Advanced_Load_Balancer_Solution_with_Oracle.pptx
 
A complete Open Source cloud: Storage, Virt, IaaS, PaaS
A complete Open Source cloud: Storage, Virt, IaaS, PaaSA complete Open Source cloud: Storage, Virt, IaaS, PaaS
A complete Open Source cloud: Storage, Virt, IaaS, PaaS
 
Intel IT Open Cloud - What's under the Hood and How do we Drive it?
Intel IT Open Cloud - What's under the Hood and How do we Drive it?Intel IT Open Cloud - What's under the Hood and How do we Drive it?
Intel IT Open Cloud - What's under the Hood and How do we Drive it?
 
GigaSpaces CCF 4 Xap
GigaSpaces CCF 4 XapGigaSpaces CCF 4 Xap
GigaSpaces CCF 4 Xap
 
Navops talk at hpc in the cloud meetup 19 march 2019
Navops talk at hpc in the cloud meetup 19 march 2019Navops talk at hpc in the cloud meetup 19 march 2019
Navops talk at hpc in the cloud meetup 19 march 2019
 
An Easy Way to Adopt Hybrid Cloud, Datacomm Solution
An Easy Way to Adopt Hybrid Cloud, Datacomm SolutionAn Easy Way to Adopt Hybrid Cloud, Datacomm Solution
An Easy Way to Adopt Hybrid Cloud, Datacomm Solution
 
RightScale Webinar: Key Considerations For Cloud Migration and Portability
RightScale Webinar:  Key Considerations For Cloud Migration and PortabilityRightScale Webinar:  Key Considerations For Cloud Migration and Portability
RightScale Webinar: Key Considerations For Cloud Migration and Portability
 
VMworld 2013: Three Advantages of Running Cloud Foundry in a VMware Private C...
VMworld 2013: Three Advantages of Running Cloud Foundry in a VMware Private C...VMworld 2013: Three Advantages of Running Cloud Foundry in a VMware Private C...
VMworld 2013: Three Advantages of Running Cloud Foundry in a VMware Private C...
 
Migration, Protection, and Availability with AWS
Migration, Protection, and Availability with AWSMigration, Protection, and Availability with AWS
Migration, Protection, and Availability with AWS
 
Varrow VMworld Update and vCHS Lunch and Learn Presentation
Varrow VMworld Update and vCHS Lunch and Learn PresentationVarrow VMworld Update and vCHS Lunch and Learn Presentation
Varrow VMworld Update and vCHS Lunch and Learn Presentation
 
Webinar: What's New in DC/OS 1.11
Webinar: What's New in DC/OS 1.11Webinar: What's New in DC/OS 1.11
Webinar: What's New in DC/OS 1.11
 

More from Avi Networks

More from Avi Networks (6)

DR On Demand At Fraction of the Cost (1).pptx
DR On Demand At Fraction of the Cost (1).pptxDR On Demand At Fraction of the Cost (1).pptx
DR On Demand At Fraction of the Cost (1).pptx
 
Top 4 Reasons to Migrate From NSX Load Balancing to NSX Advanced Load Balancer
Top 4 Reasons to Migrate From NSX Load Balancing to NSX Advanced Load BalancerTop 4 Reasons to Migrate From NSX Load Balancing to NSX Advanced Load Balancer
Top 4 Reasons to Migrate From NSX Load Balancing to NSX Advanced Load Balancer
 
23.06.15 NSX ALB and vCD integration deepdive_webinar0615.pptx
23.06.15 NSX ALB and vCD integration deepdive_webinar0615.pptx23.06.15 NSX ALB and vCD integration deepdive_webinar0615.pptx
23.06.15 NSX ALB and vCD integration deepdive_webinar0615.pptx
 
Enterprises-Have-Replaced-12000-ADCs-See-Why.pptx
Enterprises-Have-Replaced-12000-ADCs-See-Why.pptxEnterprises-Have-Replaced-12000-ADCs-See-Why.pptx
Enterprises-Have-Replaced-12000-ADCs-See-Why.pptx
 
Deploying Elastic Self-Service Load Balancing
Deploying Elastic Self-Service Load BalancingDeploying Elastic Self-Service Load Balancing
Deploying Elastic Self-Service Load Balancing
 
Delivering Turnkey Load Balancing in VMware Cloud with Day 0 Automation
Delivering Turnkey Load Balancing in VMware Cloud with Day 0 Automation Delivering Turnkey Load Balancing in VMware Cloud with Day 0 Automation
Delivering Turnkey Load Balancing in VMware Cloud with Day 0 Automation
 

Recently uploaded

Search and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical FuturesSearch and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical Futures
Bhaskar Mitra
 

Recently uploaded (20)

Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
 
10 Differences between Sales Cloud and CPQ, Blanka Doktorová
10 Differences between Sales Cloud and CPQ, Blanka Doktorová10 Differences between Sales Cloud and CPQ, Blanka Doktorová
10 Differences between Sales Cloud and CPQ, Blanka Doktorová
 
Salesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
Salesforce Adoption – Metrics, Methods, and Motivation, Antone KomSalesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
Salesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
 
UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1
 
"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi
 
Search and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical FuturesSearch and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical Futures
 
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptxUnpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
 
Speed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in MinutesSpeed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in Minutes
 
In-Depth Performance Testing Guide for IT Professionals
In-Depth Performance Testing Guide for IT ProfessionalsIn-Depth Performance Testing Guide for IT Professionals
In-Depth Performance Testing Guide for IT Professionals
 
SOQL 201 for Admins & Developers: Slice & Dice Your Org’s Data With Aggregate...
SOQL 201 for Admins & Developers: Slice & Dice Your Org’s Data With Aggregate...SOQL 201 for Admins & Developers: Slice & Dice Your Org’s Data With Aggregate...
SOQL 201 for Admins & Developers: Slice & Dice Your Org’s Data With Aggregate...
 
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
 
Introduction to Open Source RAG and RAG Evaluation
Introduction to Open Source RAG and RAG EvaluationIntroduction to Open Source RAG and RAG Evaluation
Introduction to Open Source RAG and RAG Evaluation
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
Exploring UiPath Orchestrator API: updates and limits in 2024 🚀
Exploring UiPath Orchestrator API: updates and limits in 2024 🚀Exploring UiPath Orchestrator API: updates and limits in 2024 🚀
Exploring UiPath Orchestrator API: updates and limits in 2024 🚀
 

Accelerating Public Cloud Migration with Multi-Cloud Load Balancing

  • 1. Confidential │ ©2019 VMware, Inc. Accelerating Public Cloud Migration with Multi-Cloud Load Balancing Abhinav Modi Group Product Line Manager at VMware 10th October 2019
  • 2. Confidential │ ©2019 VMware, Inc. Agenda 2 Challenges with Application Delivery in a Multi-cloud Environment Introduction to Avi - VMware NSX Advanced Load Balancer Live Demo Multi-cloud Use Cases Q&A
  • 3. Confidential │ ©2019 VMware, Inc. 3 Multi-Cloud is Both the Challenge and the Opportunity • 84% have multi-cloud strategy • On average, enterprises have almost 5 clouds • Running 3.4 clouds • Experimenting 1.5 clouds • 24% Public Cloud growth • 8% Private Cloud growth
  • 4. Confidential │ ©2019 VMware, Inc. 4 Hardware / Virtual Load Balancer Challenges DC1 DC2 DEPT1 DEPT2 Standby 0% Active 15% Separate control points: Operational complexity, hard to automate, painful upgrades Capacity management: Manual VIP placement, costly overprovisioning, no capacity pooling Not designed for modern, new environments ON-PREMISES CLOUD CONTAINER
  • 5. Confidential │ ©2019 VMware, Inc. 5 Load Balancing Challenges in the Public Cloud Limited features and performance Migration can slow down due to refactoring, lack of consistency, speed, and automation. Cloud Provider LB ON-PREMISES ? DNS WAF IPAM LOG … Automation and elasticity Limited visibility Need to stitch together multiple tools Lack of multi-cloud consistency ? Legacy LB Virtual editions are NOT cloud-native No automation or elasticity Feature rich
  • 6. Confidential │ ©2019 VMware, Inc. 6 BARE METAL VIRTUALIZED CONTAINERSON PREMISES PUBLIC CLOUDVIRTUALIZED CONTAINERS VMware Advanced Load Balancer (by Avi Networks) Modern, Scalable, Multi-Cloud Architecture CONTROLLER SERVICE ENGINE SEPARATE CONTROL & DATA PLANE ELASTICITY INTELLIGENCE AUTOMATIONMULTI-CLOUD
  • 7. Confidential │ ©2019 VMware, Inc. 7 Consistent Application Services Across a Multi-Cloud Fabric CONTROLLER EPG Ingress Proxy Istio Security group vCenter group NSX manager Automatic deployment • Built-in ecosystem integration • Native cloud connectors • SaaS or customer-managed Software Load Balancer Intelligent Web Application Firewall Container Ingress Scale Set, IAM, VNET resource groups VPC, EC2 Route53 APIC Nova, Neutron Keystone LBaas Rest API Istio
  • 8. Confidential │ ©2019 VMware, Inc. 8 VMware NSX Advanced Load Balancer (by Avi Networks) • Web App Firewall • SSL Termination • DDoS Protection • L3-4 ACLs • L7 Rules/Policies • Rate Limiting SECURITY • Application Map • Service Health Score • Network Performance • App Performance • Request Logging • Security Insights ANALYTICS • Central Management • 100% REST API / SDK • Self-Service • Multi-Tenancy • Service Discovery • IPAM/DNS PLATFORM • L7 (HTTP) LB • L4 (TCP/UDP) LB • Global Load Balancing • Content Switching • Caching/Compression • Autoscaling LOAD BALANCING Features (K8S, OpenShift, PKS, AKS, GKE, EKS, ...) • Enterprise-grade Ingress • Converged LB, Security, Analytics • Service Discovery & App Map • Multi-cluster and Multi-cloud Containers Use Cases (ESXi, x86, NSX, ACI, OpenStack…) • Central Management • Real-time Analytics • SDN Integration and Automation • Cost Savings SDDC / On-Prem (AWS, Azure, GCP, VMC, …) • Cloud-native Automation • Enterprise-grade Features • Real-time Analytics • Multi-cloud Consistency Public Cloud Comprehensive Application Services Platform and Full Lifecycle Automation
  • 9. Confidential │ ©2019 VMware, Inc. 9 Avi and VMware Integration VM VMWeb-tier 10.10.1.0/24 Web-2 Web-3 .21 .22 Avi SE Active-Active VM Web-1 .20 10.10.1.10 Security-Group Web-Tier Avi Controller Client VM VMWeb-Tier 10.10.1.0/24 Web-2 Web-3 .21 .22 Avi SE Active-Active VM Web-1 .20 10.10.1.10 10.10.1.11 vCenter Avi Controller Client vCenter NSX 10.10.1.10 10.10.1.11
  • 10. Confidential │ ©2019 VMware, Inc. 10 Avi and AWS Integration
  • 11. 11Confidential │ ©2019 VMware, Inc. Demo A single application services fabric across multiple clouds BARE METAL VIRTUALIZED CONTAINERS ON- PREMISES AZURE VIRTUALIZED CONTAINERS CONTROLLER SERVIC E ENGINE AWS VIRTUALIZED CONTAINERS
  • 12. Confidential │ ©2019 VMware, Inc. 12 Avi and Microsoft Azure Integration
  • 13. Confidential │ ©2019 VMware, Inc. 13 Avi and VMC Integration
  • 14. Confidential │ ©2019 VMware, Inc. 14 Million scale Google Cloud Platform – Autoscaling to 1 Million SSL TPS!
  • 15. Confidential │ ©2019 VMware, Inc. 15 Global Server Load Balancing Leader Site - DC 1 VS-A1 VS-B1 DNS VS-A4 DNS All GSLB configuration is performed at the “Leader” Controller “Leader” Controller syncs the configuration to all the “Follower” sites Active Follower Site - AWS Admin VS-B3 Active Follower Site - DC 2 VS-A2 DNS Passive Follower Site Azure VS-B2 VS-A3 • Geo algorithm – user-proximity • Two-level nested algorithm support • DNS policies and Topology policies for preferred/fallback site and other site selection logic • Active/Active - Application high availability across data center failures. • Active/Standby - Disaster recovery • Hybrid cloud with “cloud bursting” Use Cases Features
  • 16. Confidential │ ©2019 VMware, Inc. 16 SoftLayer GCP Branch Model 4 (Large US Retail): Public Cloud backend, Branch front-end On-Prem AWS Model 1 (Global Telco IT): AWS as extension of on-prem DC Direct Connect Model 2 (Global Bank): Azure and On-Prem DC as peer DCs hosting apps On-Prem Azure Direct Connect On-Prem Azure ... ... Direct Connect Model 3 (Global Payments): On-prem DC + GCP for backend and remote SEs On-Prem On-Prem ... GCP Remote GCPs Multi-Cloud Deployment Models
  • 17. Confidential │ ©2019 VMware, Inc. 17 Adobe Accelerates Cloud Initiatives with Microsoft Azure Delivering applications reliably and securely both on-premises and in the cloud By reliably and securely delivering our applications, Avi Networks has become a key partner for our adoption of Azure. Brandon Pulsipher Vice President, Product Technical Operations Migrate the Adobe Experience Cloud to the Azure with enterprise-grade support Deliver thousands of SSL transactions per second, and elastic scale of load balancers and app servers based on real-time traffic Improve operations with app insights and central management of all load balancers
  • 18. Confidential │ ©2019 VMware, Inc. 18 Infrastructure-centric Silos to Application-centric Multi-cloud Strategy Manual, Complex and Fragmented Single, Universal and Automated BARE METAL VIRTUALIZED CONTAINERS ON-PREMISES CONSISTENCY SIMPLICITY VISIBILITY 1. Multi-cloud world today 2. Siloed point products & services 3. Automate & orchestrate, visualize and monitor
  • 19. Confidential │ ©2019 VMware, Inc. Thank You