Columbus & The Cloud
http://code.zynga.com/2012/02/the-evolution-of-zcloud/
http://code.mixpanel.com/2010/11/08/amazon-vs-rackspace/
Realization: What You Really Care about Is App Portability
http://techblog.netflix.com/2012/07/benchmarking-high-performance-io-with.html
A Typical Big Data App…
• Auto start VMs• Install and configure app components• Monitor• Repair• (Auto) Scale• Burst…
Making thedeployment,installation, scaling, fail-over looks the samethrough the entire stack
Running Bare-Metal forhigh I/O workload, Publiccloud for sporadicworkloads ..
• Available under different distributions• Cloudera• IBM BigInsights• MapR• Hortonworks
• Run on Any Cloud Putting • Consistent MGT • Dynamic ScalingCloudify and • Auto...
Few Snippets..
Demo Time..
http://www.cloudifysource.orghttp://github.com/CloudifySourcehttps://github.com/CloudifySource/cloudify-recipes/tree/maste...
Putting Hadoop on any Cloud. NATI SHALOM at Big Data Spain 2012
Putting Hadoop on any Cloud. NATI SHALOM at Big Data Spain 2012
Putting Hadoop on any Cloud. NATI SHALOM at Big Data Spain 2012
Putting Hadoop on any Cloud. NATI SHALOM at Big Data Spain 2012
Putting Hadoop on any Cloud. NATI SHALOM at Big Data Spain 2012
Putting Hadoop on any Cloud. NATI SHALOM at Big Data Spain 2012
Putting Hadoop on any Cloud. NATI SHALOM at Big Data Spain 2012
Putting Hadoop on any Cloud. NATI SHALOM at Big Data Spain 2012
Putting Hadoop on any Cloud. NATI SHALOM at Big Data Spain 2012
Putting Hadoop on any Cloud. NATI SHALOM at Big Data Spain 2012
Putting Hadoop on any Cloud. NATI SHALOM at Big Data Spain 2012
Upcoming SlideShare
Loading in …5
×

Putting Hadoop on any Cloud. NATI SHALOM at Big Data Spain 2012

659 views

Published on

Session presented at Big Data Spain 2012 Conference
16th Nov 2012
ETSI Telecomunicacion UPM Madrid
www.bigdataspain.org
More info: http://www.bigdataspain.org/es-2012/conference/putting-hadoop-cloud/nati-shalom

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
no profile picture user

  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
659
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
14
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • • Dynamic Scaling – provision and add cloud servers to the BigInsights cluster on demand.• Failover – Transparently restart nodes or start new nodes in the case of failure.• Role assignments – Assign new roles to the BigInsights nodes from the Cloudify console.• Monitoring – Monitor deployments using the Cloudify UI with smooth integration to the BigInsights UI. • Data Rebalancing – Kick off Hadoop cluster rebalancing from the Cloudify console. • Hadoop operations – Run Hadoop DFS & DFSAdmin operations from the Cloudify console.

    • Putting Hadoop on any Cloud. NATI SHALOM at Big Data Spain 2012

    1. 1. Columbus & The Cloud
    2. 2. http://code.zynga.com/2012/02/the-evolution-of-zcloud/
    3. 3. http://code.mixpanel.com/2010/11/08/amazon-vs-rackspace/
    4. 4. Realization: What You Really Care about Is App Portability
    5. 5. http://techblog.netflix.com/2012/07/benchmarking-high-performance-io-with.html
    6. 6. A Typical Big Data App…
    7. 7. • Auto start VMs• Install and configure app components• Monitor• Repair• (Auto) Scale• Burst…
    8. 8. Making thedeployment,installation, scaling, fail-over looks the samethrough the entire stack
    9. 9. Running Bare-Metal forhigh I/O workload, Publiccloud for sporadicworkloads ..
    10. 10. • Available under different distributions• Cloudera• IBM BigInsights• MapR• Hortonworks
    11. 11. • Run on Any Cloud Putting • Consistent MGT • Dynamic ScalingCloudify and • Auto Recovery Hadoop • Auto Scaling Together • Role Assignments • Monitoring • Simple maintenance
    12. 12. Few Snippets..
    13. 13. Demo Time..
    14. 14. http://www.cloudifysource.orghttp://github.com/CloudifySourcehttps://github.com/CloudifySource/cloudify-recipes/tree/master/services/biginsights

    ×