Cloud Computing Meets Data Warehousing Omer Trajman Sr. Dir. for Cloud and Virtualization Vertica Systems [email_address]

What is….Cloud? What are Cloud Services? Other Peoples’ Software What are Cloud Platforms? Other Peoples’ Frameworks What is Cloud Infrastructure? Other Peoples’ Hardware

What are Cloud Services?

Other Peoples’ Software

What are Cloud Platforms?

Other Peoples’ Frameworks

What is Cloud Infrastructure?

Other Peoples’ Hardware

Data Warehousing in the Cloud Applications, e.g. Birst, LogiXML, Lucidera Web app providing data services Analytic SaaS – Full stack solution Platforms, e.g. Google AppEngine, MSFT Azure Programming API (Java, Python, .Net) Integrated data access Infrastructure, e.g. Amazon Web Services Favorite OS on demand (Linux, Solaris, Windows) Additional services (Simple DB, Queue, Storage)

Applications, e.g. Birst, LogiXML, Lucidera

Web app providing data services

Analytic SaaS – Full stack solution

Platforms, e.g. Google AppEngine, MSFT Azure

Programming API (Java, Python, .Net)

Integrated data access

Infrastructure, e.g. Amazon Web Services

Favorite OS on demand (Linux, Solaris, Windows)

Additional services (Simple DB, Queue, Storage)

Security is a Tradeoff “ Security costs money, but it also costs in time, convenience, capabilities,… ” -Bruce Schneier Assess how important it is to secure your data What are the risks with in-house and cloud? Why not keep it under your mattress ?

“ Security costs money, but it also costs in time, convenience, capabilities,… ”

-Bruce Schneier

Assess how important it is to secure your data

What are the risks with in-house and cloud?

Why not keep it under your mattress ?

Full Stack Offerings Birst Hosted data access Spreadsheet in the Cloud LogiXML Framework for online Analytic SaaS Reporting, Dashboard, ETL Lucidera Vertical apps focused Analysis Tools (e.g. Pipeline Healthcheck)

Birst

Hosted data access

Spreadsheet in the Cloud

LogiXML

Framework for online Analytic SaaS

Reporting, Dashboard, ETL

Lucidera

Vertical apps focused

Analysis Tools (e.g. Pipeline Healthcheck)

DIY Analytics in the Cloud Google AppEngine, Microsoft Azure Java, Python, .Net driven UI to capture and display GQL or SQL to query (limited joins, no aggs) Use client tool to upload app Amazon Ecosystems Provision via API or service e.g. RightScale Pick your UI and ETL – Jasper, Pentaho , etc. Pick your DB – MySql, Oracle, SQLServer, Vertica

Google AppEngine, Microsoft Azure

Java, Python, .Net driven UI to capture and display

GQL or SQL to query (limited joins, no aggs)

Use client tool to upload app

Amazon Ecosystems

Provision via API or service e.g. RightScale

Pick your UI and ETL – Jasper, Pentaho , etc.

Pick your DB – MySql, Oracle, SQLServer, Vertica

Key Questions Is my data safe and secure? Can I get fast access to my data in the cloud? What does this cost? Do I need a detailed plan for growth? How much IT do I need?

Is my data safe and secure?

Can I get fast access to my data in the cloud?

What does this cost?

Do I need a detailed plan for growth?

How much IT do I need?

Securing the Cloud Create a VPN Firewall the host Encrypt the disk Consider where to keep sensitive data

Create a VPN

Firewall the host

Encrypt the disk

Consider where to keep sensitive data

Upload and Beyond PUT it, one object at a time Web page upload…a few MB at a time Bulk upload via FTP, SCP at 1+GB/ hour Use an ETL Tool Is data already in the cloud?

PUT it, one object at a time

Web page upload…a few MB at a time

Bulk upload via FTP, SCP at 1+GB/ hour

Use an ETL Tool

Is data already in the cloud?

Economics of DW in the Cloud Getting and keeping data in the cloud Cloud applications are a source of data Upload services (sneakernet) Scale on demand Transparent scaling Managed or API based scaling Pay as you go Operational cost by resource or volume Incremental changes on demand

Getting and keeping data in the cloud

Cloud applications are a source of data

Upload services (sneakernet)

Scale on demand

Transparent scaling

Managed or API based scaling

Pay as you go

Operational cost by resource or volume

Incremental changes on demand

Get Set… Check out Analytic SaaS Vendors Birst, LogiXML, Lucidera Are you a coder? Look for a Framework Google AppEngine, MSFT Azure, Elastic MR Looking for Classic BI ? Best of breed on the cloud Amazon, GoGrid, RightScale, Joyent Questions? [email_address]

Check out Analytic SaaS Vendors

Birst, LogiXML, Lucidera

Are you a coder? Look for a Framework

Google AppEngine, MSFT Azure, Elastic MR

Looking for Classic BI ?

Best of breed on the cloud

Amazon, GoGrid, RightScale, Joyent

Questions? [email_address]