Traffic Management In The Cloud

Traffic Management in the Cloud
Raja Srinivasan
Chief Cloud Evangelist
Zeus Technology

© Zeus Technology 2008
Slide 2
Let’s buy load balancers

Slide 3
Taxonomy of Traffic Managers
There’s a range of functionality:
Layer 4 load balancers:
basic packet redirection
Layer 7 load balancers:
understand HTTP, can apply some optimizations
Intelligent Traffic Managers:
Application proxies that can be programmed to manage traffic in many different ways

Layer 4 load balancers
Slide 4
SSL Decryption
Load Balancing
Session Persistence
request
Virtual Server (client connections)
Pool(server connections)
response
Layer 4 load balancer
A layer 4 load balancer can typically:
Load balance TCP packets and apply basic session persistence
Perform SSL decryption
(features and capabilities vary by product)

Layer 7 load balancers
Slide 5
SSL Decryption
DoS Protection
TCP Offload
Load Balancing
Session Persistence
SSL Encryption
HTTP Multiplexing
request
response
Layer 7 load balancer
Content Compression
HTTP Caching
TCP Offload
Bandwidth Shaping
A layer 7 load balancer understands HTTP
(features and capabilities vary by product)

Intelligent Traffic Managers
Slide 6
SSL Decryption
Service Protection
TCP Offload
Rate Shaping
Load Balancing
Session Persistence
Bandwidth Shaping
SSL Encryption
HTTP Multiplexing
Request rules
RuleBuilder
TrafficScript
Java Extensions
request
response
Content Compression
HTTP Caching
TCP Offload
Service Level Monitoring
Bandwidth Shaping
Transaction Logging
Response rules
RuleBuilder
TrafficScript
Java Extensions
SOAP-based Control API
Event Handling API
Web and CLI interface (CLI in version 5.2)

Cloud Traffic Management Challenges
Policy-based traffic management and control point for transactions with the cloud, based on availability, cost, performance, locale etc
Routing
Performance and SLA management
Access to services
Compliance
Visibility:
Monitoring
Analytics
Cloud usage tracking
Security:
Managing access to apps & services
Sharing data with trusted parties only
Application & transaction security
Validation & Audit
Transaction logging & reporting
Deployment:
On-premises or in the cloud
Cloud 1
Service 2
Application 1
Service 1
Private or public cloud
Policy-based traffic management & control
Integration with Cloud Management System
Cloud Management System
AppLogic / RightScale
Enterprise
Physical-Virtual-Cloud
Slide 7
Slide 7

Slide 8
Rapid Application Changes
The Cloud is all about “Rapid Application Deployment”
Scenario:
Your application has a fault
You need to reduce the attack surface by sealing the bug from attackers

Slide 9
Rapid Application Changes
TrafficScript
$contentType = http.getResponseHeader( "Content-Type" );
if( $contentType != "text/html" ) break;
$body = http.getResponseBody();
$body = string.regexSub( $body, "{3}-{2}-{4}", "", "g" );
http.setResponseBody( $body );

Slide 10
Example - Gilt Groupe
C
C
C
C
C
C
C
C
C
C
C
C
C
C
C
C
C
C
C
C
C
C
C
C
Basic Load Balancer
400 Ruby on Rails nodes

Slide 11
Gilt Groupe
C
C
C
C
C
C
C
C
C
C
C
C
C
C
C
C
C
C
C
C
C
C
C
C
Cache
Traffic Manager
400 Ruby on Rails nodes

Different cache rules for different content types
Different versions of cached pages for different users
Controlling Caching with TrafficScript
Slide 12
TrafficScript
$ct = http.getResponseHeader( "Content-Type" );
if(http.getResponseCode() >= 400 ) {
cache.setExpiry( 5 );
} else if( startsWith( $ct, "image/" ) ) {
} else {
}
“We found that with Content Caching and TrafficScriptTM, Zeus Traffic Manager is much more than a great load balancer – Zeus Traffic Manager is really an extension of our applications because of what it enables us to do.”
Phong Nguyen, VP R&D, Founder, Gilt Groupe
TrafficScript
/*... Get user status from cookie... */
cache.setCacheKey( $status );

Slide 13
Managing your apps in the cloud
Your ‘app’ becomes an infinitely divisible quantity

Smooth application upgrade process...
Three application instances running
Slide 14

Clone one and direct developer users to it
Slide 15

Ready to deploy... Clone the new application version
Slide 16

Smoothly migrate users from ‘old’ to ‘new’
Slide 17

Reap the old application once all sessions are complete
Slide 18
No downtime
No interruption in service
No time pressure during testing
Fully process controlled
Can roll-back at any point

Migrating users
How do you migrate users
from one generation of an application
to another, seamlessly?
Slide 19
TrafficScript
$cookie = http.getCookie( "MyPool" );

if( $cookie ) {
pool.select( $cookie );
}
# If no cookie, Zeus will use the default pool
TrafficScript
$cookie = http.getCookie( "MyPool" );

if( !$cookie ) {
http.setResponseCookie( "MyPool", connection.getPool() );
}

Slide 20
Let’s buy load balancers
Where do I install this?
How do I audit and track changes?
Do I have access to the Data Center?
Dev, test and production?
What if I want to move my app?

Load Balancer Taxonomy
Microsoft NLB
Zeus Traffic Manager
Zeus Load Balancer
Commercial
Software
ClusterScale
Netscaler VPX
Pound
Open
Source
Linux Virtual Server / IPVS
HAProxy
nginx
PerlBal
Kemp
Cisco CSS
Cisco ACE
Hardware
Load
Balancers
Barracuda
Nortel / Alteon
Citrix Netscaler
loadbalancer.org
F5 BigIP
Radware
Coyotepoint
Layer 7+
App. Delivery Controllers
Layer 7Advanced LBs
Layer 4Load Balancers
Slide 21

Load Balancer Taxonomy
Commercial
Software
Microsoft NLB
Zeus Load Balancer
ClusterScale
Netscaler VPX
Pound
Open
Source
HAProxy
nginx
PerlBal
Kemp
Cisco CSS
Cisco ACE
Hardware
Load
Balancers
Barracuda
Nortel / Alteon
Citrix Netscaler
loadbalancer.org
F5 BigIP
Radware
Coyotepoint
Layer 7+
Layer 7Advanced LBs
Slide 22

Traffic Managers in the Cloud
Commercial
Software
Microsoft NLB
Zeus Load Balancer
ClusterScale
Netscaler VPX
Pound
Open
Source
HAProxy
nginx
PerlBal
Kemp
Cisco CSS
Cisco ACE
Hardware
Load
Balancers
Barracuda
Nortel / Alteon
Citrix Netscaler
loadbalancer.org
F5 BigIP
Radware
Coyotepoint
Layer 7+
Layer 7Advanced LBs
Slide 23

Slide 24
Talk to Zeus
http://www.zeus.com
Raja Srinivasan, rsrinivasan@zeus.com

Traffic Management In The Cloud

by CloudCamp on Oct 23, 2009

Accessibility

Categories

Tags

Upload Details

Usage Rights

2 Embeds 18

Statistics

Traffic Management In The Cloud — Presentation Transcript

http://www.slideshare.net	14
http://jisi.dreamblog.jp	4