Getting Ready for the Cloud Nati Shalom CTO GigaSpaces Technologies natishalom.typepad.com

A Word Before We Start “ The Chinese use two brush strokes to write the word 'crisis.‘ One brush stroke stands for danger ; the other for opportunity . In a crisis, be aware of the danger - but recognize the opportunity.” - John F. Kennedy, Indianapolis, April 12, 1959 危 機 会 Crisis Danger Opportunity 險

“ The Chinese use two brush strokes to write the word 'crisis.‘

One brush stroke stands for danger ; the other for opportunity .

In a crisis, be aware of the danger - but recognize the opportunity.”

- John F. Kennedy, Indianapolis, April 12, 1959

100+ direct enterprise customers, 2000+ embedded deployments A Scale-Out Application Server ideally suited for today’s Enterprise Environments and ISV’s building Grid, SaaS and Cloud enabled offerings Cloud tools and packaging Public Cloud providers (i.e. EC2, Flexiscale, GoGrid, Joyent and more). Introduction to GigaSpaces

100+ direct enterprise customers, 2000+ embedded deployments

A Scale-Out Application Server ideally suited for today’s Enterprise Environments and ISV’s building Grid, SaaS and Cloud enabled offerings

Cloud tools and packaging Public Cloud providers (i.e. EC2, Flexiscale, GoGrid, Joyent and more).

Goals Demonstrate what you can do with cloud today! How you can develop application that will be ready for cloud but not: Locked to specific cloud Run in on your local environment and cloud without code changes Typical use case: Test in the cloud, Production – locally Build on standard middleware Java, .Net Highly reliable

Demonstrate what you can do with cloud today!

How you can develop application that will be ready for cloud but not:

Locked to specific cloud

Run in on your local environment and cloud without code changes

Typical use case:

Test in the cloud, Production – locally

Build on standard middleware

Java, .Net

Highly reliable

Cloud Computing – it’s great, right? The next phase in computing Benefit from economies of scale and expertise Don’t worry about the infrastructure Only pay for what you need, when you need it The answer to the huge gap between peak and average loads Volatile and unpredictable growth rates Changing loads Transactions, data and user growth

The next phase in computing

Benefit from economies of scale and expertise

Don’t worry about the infrastructure

Only pay for what you need, when you need it

The answer to the huge gap between peak and average loads

Volatile and unpredictable growth rates

Changing loads

Transactions, data and user growth

But… there is a missing link! Traditional middleware was NOT built for the cloud

Moving from N-Tier to Virtualized: Do You See the Problem? Business/Services Tier Back-up Back-up Back-up Back-up Data Tier Messaging B C A

Traditional middleware was not built for the cloud Traditional middleware doesn’t allow application to scale on demand Traditional middleware doesn’t scale linearly Diminishing returns Hits a “salability wall” at some point The Scalability Wall

Traditional middleware doesn’t allow application to scale on demand

Traditional middleware doesn’t scale linearly

Diminishing returns

Hits a “salability wall” at some point

Software architecture is undergoing a “once in a decade” transformation: Each paradigm transformation undermines the existing technologies. The current transformation signals the decline of traditional application-servers, RDBMSs etc. The new paradigm is virtualization, grid, cloud computing, PaaS, SaaS IDC on Cloud Computing: "This is about the IT industry's new model for the next 20 years," Vernon Turner, head of enterprise infrastructure, consumer and telecoms research. Market Trends – The need for a change Mainframe N-tier Client Server Virtualized 1980s 1990s 2000s Change

Software architecture is undergoing a “once in a decade” transformation:

Each paradigm transformation undermines the existing technologies. The current transformation signals the decline of traditional application-servers, RDBMSs etc.

The new paradigm is virtualization, grid, cloud computing, PaaS, SaaS

IDC on Cloud Computing: "This is about the IT industry's new model for the next 20 years,"

Vernon Turner, head of enterprise infrastructure, consumer and telecoms research.

The need for change (different perspectives) The innovative The cynical The passive

Solution Demo

Solution

Demo

Demo Application – Logical Architecture Space

Demo Application – Physical Architecture OS Virtualization The Cloud Local Cache

The Solution - Make your application “Cloud Ready”

Which way to go? Avoid radical change Look for a solution that will enable gradual change Choose architecture that fits the scale-out model Avoid vendor lock-in Look for solution that could run on more then one product Minimize lock in: Use of standard where possible (be aware of lack of standards) Abstraction – decouple the application from the implementation Future proof your application Don’t make decision today, but be ready to make one without major effort Avoid long-term commitment – choose the right licensing model

Avoid radical change

Look for a solution that will enable gradual change

Choose architecture that fits the scale-out model

Avoid vendor lock-in

Look for solution that could run on more then one product

Minimize lock in:

Use of standard where possible (be aware of lack of standards)

Abstraction – decouple the application from the implementation

Future proof your application

Don’t make decision today, but be ready to make one without major effort

Avoid long-term commitment – choose the right licensing model

Application Platform as a Service (Gartner) Need a new type of application server XTP — Extreme Transaction Processing MT — Multitenancy Application Platform as a Service (APaaS) Hardware Grid System Infrastructure SaaS-Enabled Application Platform AppDev AppServer XTP MT Business Data Metadata SaaS-Enabled Business Application Tenant App. View Users Tenant App. View Tenant App. View Users Users Business Application as a Service Application Provider User Organizations Platform Supplier Host

Automate manual process Move manual process to SLA driven deployment Scale only when you need Self healing

Move manual process to SLA driven deployment

Scale only when you need

Self healing

How? Middleware virtualization Middleware Virtualization OpenSpaces – GigaSpaces Development framework Messaging Services Data " All problems in computer science can be solved by another level of indirection" ( Butler Lampson ) Similar principles to storage virtualization Decouple the application from the deployment environment Use partitioning to split the load and the data. Support JEE, .Net SaaS-Enabled Business Application Tenant App. View Users Tenant App. View Tenant App. View Users Users Business Application as a Service

" All problems in computer science can be solved by another level of indirection" ( Butler Lampson )

Similar principles to storage virtualization

Decouple the application from the deployment environment

Use partitioning to split the load and the data.

Support JEE, .Net

The future: GridEcon story New: sell your computing power! Use it yourself during the day Sell it during the night, the weekends and holidays Hook up every business computer and the worlds largest super computer is born! Make it more interesting with value added services. gridecon.eu

New: sell your computing power!

Use it yourself during the day

Sell it during the night, the weekends and holidays

Hook up every business computer and the worlds largest super computer is born!

Make it more interesting with value added services.

Summary Cloud enabled = business agility = efficiency Consistent response time under fluctuating load “ A brokerage can lose up to $4M per 1ms of latency” - The Tabb Group “ An additional 500ms delay resulted in -20% traffic” - Google “ An additional 100ms in latency resulted in -1% sales” - Amazon Reducing the cost of over provisioning ( Pay-per-use model) Reduced HW cost - Improving the efficiency of application (Memory based solution) Reducing the cost of power consumption (large part of the CPU cycles of existing software is spent on backups and database transactions) Reducing the development time and maintenance complexity Cost $$ Speed Reliability

Cloud enabled = business agility = efficiency

Consistent response time under fluctuating load

“ A brokerage can lose up to $4M per 1ms of latency” - The Tabb Group

“ An additional 500ms delay resulted in -20% traffic” - Google

“ An additional 100ms in latency resulted in -1% sales” - Amazon

Reducing the cost of over provisioning ( Pay-per-use model)

Reduced HW cost - Improving the efficiency of application (Memory based solution)

Reducing the cost of power consumption (large part of the CPU cycles of existing software is spent on backups and database transactions)

Reducing the development time and maintenance complexity

Thank You

BazuMedia Real time tracking, messaging, and scoring for global athletic events In Production with GigaSpaces on EC2

Background Real time tracking, messaging, and scoring for global athletic events Athletic event data management Live online results and tracking Initial stage startup (currently financed by founders) and initial revenue stream Events range in scalability and size requirements Variable/unpredictable peak and off-peak times Downtimes between events

Real time tracking, messaging, and scoring for global athletic events

Athletic event data management

Live online results and tracking

Initial stage startup (currently financed by founders) and initial revenue stream

Events range in scalability and size requirements

Variable/unpredictable peak and off-peak times

Downtimes between events

Bazu Messaging Gigaspaces/EC2 Architecture

“ By combining the GigaSpaces scale-out middleware with the Amazon EC2 cloud computing service, we now have a cost-effective application infrastructure that is fault-tolerant, flexible and scalable” “ Our application, built on top of the GigaSpaces scale-out application server, is able to linearly scale on demand to handle peaks in traffic.” “ Running GigaSpaces on Amazon EC2 allows us to utilize an on-demand, pay-per-use computing utility – meaning we only pay for hardware and software we actually use, without any upfront infrastructure investments.” Paul Itoi, President, BazuMedia, https://register.bazumedia.com/

“ By combining the GigaSpaces scale-out middleware with the Amazon EC2 cloud computing service, we now have a cost-effective application infrastructure that is fault-tolerant, flexible and scalable”

“ Our application, built on top of the GigaSpaces scale-out application server, is able to linearly scale on demand to handle peaks in traffic.”

“ Running GigaSpaces on Amazon EC2 allows us to utilize an on-demand, pay-per-use computing utility – meaning we only pay for hardware and software we actually use, without any upfront infrastructure investments.”

Paul Itoi, President, BazuMedia, https://register.bazumedia.com/

Miwok Airways On-Demand Air-Travel Production Q1 09 with GigaSpaces on EC2

Background On-demand private air travel at economy class prices. Passengers are able to set their own flight schedules, and prices Miwok provides a real-time pricing engine and reservation system Constant fare changes based on passengers, route and time of day lead to a data-intensive booking system that requires extremely high-scalability. The pricing engine requires a cost-effective, easily scalable system that can handle the complex transactional and data-intensive booking process

On-demand private air travel at economy class prices. Passengers are able to set their own flight schedules, and prices

Miwok provides a real-time pricing engine and reservation system

Constant fare changes based on passengers, route and time of day lead to a data-intensive booking system that requires extremely high-scalability.

The pricing engine requires a cost-effective, easily scalable system that can handle the complex transactional and data-intensive booking process

Solution XAP on EC2 enables Miwok Airways to Scale to meet spikes in demand, and shrink again when the extra servers are no longer necessary Deliver a fault-tolerant system with rapid response times "We need a system that can deal with a massive amount of transactional data on a daily basis and required a solution that could easily scale and work well with Amazon EC2. GigaSpaces was the only application server on the market we could find that met these needs“ Gad Barnea, MiWok CEO

XAP on EC2 enables Miwok Airways to

Scale to meet spikes in demand, and shrink again when the extra servers are no longer necessary

Deliver a fault-tolerant system with rapid response times

"We need a system that can deal with a massive amount of transactional data on a daily basis and required a solution that could easily scale and work well with Amazon EC2. GigaSpaces was the only application server on the market we could find that met these needs“

Gad Barnea, MiWok CEO

The Reservation System (MARS) – Web 2.0

Pricing Model - Heavy Calculations Calculate in real time 9 prices based on: Location User profile Path Directionality Date Season Demand Booking time

Calculate in real time 9 prices based on:

Location

User profile

Path

Directionality

Date

Season

Demand

Booking time

Customer Testimonial - Blackhawk Networks “ GigaSpaces took a tremendous burden off my architecture teams and we could focus on functional development of our solution rather than work on the framework.” Ashmit Bhattacharya, Vice President Engineering

“ GigaSpaces took a tremendous burden off my architecture teams and we could focus on functional development of our solution rather than work on the framework.”

Ashmit Bhattacharya, Vice President Engineering