PaaS on Openstack

PaaS on OpenStack
@natishalom
CTO & Founder
GigaSpaces

Agenda
® Copyright 2011 Gigaspaces Ltd. All Rights Reserved
2

Defining the PaaS
There is a difference between knowing the PaaS (path), and walking the PaaS (path).
Morpheus in “The Matrix”
Quiz: What do you
expect from a PaaS?
3

Agenda
4

Different Paths to PaaS
Productivity vs. Control tradeoffs
5

Google App Engine Architecture
6

Control assumptions
7
You
HW configuration
Operating system
Language (Java/Paython)
Middleware stack (data-base, messaging,…)
Architecture
Performance (Quota : CPU, Mem, Net,..)
Data center location
Application Code
Selecting the middleware stack from a predefined list.

Heroku Architecture
8
Routing Mesh
DynoGrid
SQL Database
Memory Cache

Control assumptions
9
You
HW configuration
Operating system
Language (Ruby)
Middleware stack (data-base, messaging…)
Flexibility of choices
Architecture
Performance (dyno)
Data center location
Application Code
Selecting the middleware stack from a predefined list

Elastic Beanstalk Architecture
Elastic Beanstalk
Application
http://myapp-staging.elasticbeanstalk.com/
Version
Environment
Elastic Load Balancer
Auto
Scaling
EC2 Instances
EC2 Instances
EC2 Instances
Version
Version
Apache
Elastic Beanstalk
Host Manager
Tomcat
Your Running Application
Amazon Linux AMI
10

Control assumptions
Amazon
Operating system
Language (Java)
Middleware stack (tomcat, RDS…)
Can be easily extended
Architecture (Web)
Storage
Data center
You
Application Code
Selecting the middleware stack (anything beyond tomcat)
HW configuration
Performance
Limited control over the OS using linux tools
JVM tuning/configuration
11

Productivity Myths
You have to give up control for more simplicity
Not always…
Less code = more productivity
Productivity is measured by units of features being delivered (not lines of code)
Opinionated architecture (Rails/Grails) is extremely productive
12
“..developing on GAE introduced such a design complexity that working around it pushes us 5 months behind schedule.”
Carlos Ble's post Goodbye Google App Engine

So Who’s Better?
Google/Heroku
Top-down sandbox approach
Highly opinionated
Designed for extreme simplicity at expense of user control
Amazon
Bottom-up approach
Designed for extreme simplicity with a significantly higher degree of control
13
Fits a small subset of apps
Fits a larger spectrum of apps

Agenda
14

PaaS on OpenStack – Aim Higher
Anyone should be able to:
Build their own PaaS in a snap
Run on any cloud (public/private)
Gain multi-tenancy, elasticity… Without code changes.
Provide a significantly higher degree of control without substantial complexity
Language choice
OS
Middleware stack
Should come pre-integrated with popular stack
Spring,Tomcat, DevOps, NoSQL, Hadoop…
Designed to run the most demanding mission-critical apps
15

The Building Blocks..
16

Service Orchestration Layer
17
GigaSpaces Application Cluster
Deploy
Control
Grid Service Container
Grid Service Manager
Agent
Agent
Agent
Public Cloud
Private Cloud
Bare metal
Scale-in
Scale-out
Data Center/Cloud

Life cycle
Provisioning
Monitoring
Statistics
Agent
Zoom-In…
18

Service Recipe (Proposal)
service { name "cassandra-service" icon new File("icon.png") defaultScalingUnit "small" IpRange "*.*.*.*" lifecycle { //life cycle events can be shell scripts or groovy closures that receive the admin as a parameter //here you can implement logic to download binaries from any repository or file server install {ServiceContextserviceContext -> myCalculatedParam = serviceContext.serviceInstance.localHostAddress.hostName; masterNodeIp = serviceContext.getServiceInstanceMatching(name("cassandra-master")).localHostAddress.hostName serviceContext.environmentParameters["localHostName"] = myCalculatedParam; port = serviceContext.portLocator.nextAvailablePort serviceContext.environmentParameters["port"] = port //inject runtime parameters to a config file / script using a utility class serviceContext.templateReplacer.replace("cassandra.yaml", serviceContext.environmentParameters) "install.sh".execute(); } uninstall "install.sh" relocate "relocate.sh" preStart "pre-start.sh" start "start.sh" postStart "post-start.sh" preShutdown "pre-shutdown.sh" shutdown "shutdown.sh" postShutdown "post-shutdown.sh" }
® Copyright 2011 GigaSpaces Ltd. All Rights Reserved
19

Service Recipe Monitors & SLA
monitoring { pluginClass "org.openspaces.usm.JmxMetricsCollector" config { jmxOperations["org.apache.cassandra.db:CompactionManager:CompletedTasks:Cassandra": "Completed Tasks", "org.apache.cassandra.db:CompactionManager:PendingTasks:Cassandra": "Pending Tasks", "org.apache.cassandra.db:CompactionManager:ColumnFamilyInProgress:Cassandra": "Column Family In Progress"]; jmxHost "127.0.0.1"; jmxPort 8080; } } sla { deploymentConstraints { scalingUnit small } scalingRules { rule { priority 1 when {thisSerice().anyInstace."Disk Space".lessThan(30.MB) } add 2.ScalingUnits } rule { priority 2 when {thisSerice().anyInstace."CPU Utilization".lessThan(30.Percent).for(5.Minutes)} remove 1.ScalingUnit } rule { when (alertOfType("CPU Utilization").raisedFor(anyServiceNode())) } // } }
® Copyright 2011 GigaSpaces Ltd. All Rights Reserved
20

Agenda
21

How does it work?
You take the control seat.

The Demo
Use Cassandra as a private case for a service
Demonstrate what it takes to
Deploy
Manage
Handle failure
Scale
Monitor
23

The Deployment Process
24
Elastic Service
Manager
DevOps CLI
2) Pack
Cassandra
Installation
6) Start cassandra
3) Deploy
5) Start containers
Agent
Cassandra
Instances
1) Deploy Cassandra
4) Provision a
Machine and install
GigaSpaces
Agent
Cassandra
Instances
7) Add instance

Continuous Availability
25
Instance failure
USM starts new instance
Machine failure
Agent
Agent
Elastic Service
Manager
Elastic manager starts a new instance on another machine
Cassandra
Instances
Cassandra
Instances

Continuous Scalability
26
Not enough resources to meet the SLA
Add resources to meet the SLA
Elastic Service
Manager
Agent
Agent
Agent
Agent
Cassandra
Instances
Cassandra
Instances
Cassandra
Instances
Cassandra
Instances
Monitor

Multi-Tenancy
27
Elastic Service
Manager
Add shared
tenant
Tenant B
Agent
Agent
Tenant A
Tenant C
Add private
tenant

Composite Application
28
Elastic Service
Manager
Agent
Agent
Apache
Tomcat
Agent
Cassandra

Monitoring
Redirect console output
Monitor statistics through JMX
Pluggable monitoring
Management console:
Web
CLI
API (REST, Groovy, Java)
Alerts
29

Current Status
JClouds provider for OpenStack is ready
Developed in Collaboration with GridDynamics & Adrian Cole
Integrated with OpenStack/Cactus build
Required a few patch updates to OpenStack code base
Continuous collaboration with Citrix
Integrate the platform with the underlying IaaS stack
Better performance/utilization
Full stack (pre-engineered) enterprise-ready solution
30

Join the Effort
Call for action
Try out the provider jclouds
Establish a PaaS working group to drive PaaS within OpenStack community
Register now for the beta program
www.gigaspaces.com
Learn more..
natishalom.typepad.com
blog.gigaspaces.com
31

Summary
Curving out complexity, opinionated architecture, relying on someone else’s stack is only one way to achieve productivity at the expense of control
With OpenStack we can aim higher and make the application infrastructure simpler and better suited for the cloud in the first place
32

GigaSpaces Cloud Enabled Platform gigaspaces.com/paas-enablement
gigaspaces.com/saas-enablement
GigaSpaces XAP Product Overview:
http://www.gigaspaces.com/wiki/

PaaS on Openstack

by Open Stack on Apr 27, 2011

Accessibility

Categories

Tags

Upload Details

Usage Rights

1 Embed 2

Statistics

PaaS on Openstack — Presentation Transcript