BIG DATA APPSON OPENSTACK
about:meHead of Product @ GigaSpaces          @uri1803      github.com/uric
“Big data and cloud technology  go hand-in-hand. Big data needs        clusters of servers forprocessing, which clouds can...
Why OpenStack?• Everyone (well, almost…) is in  – HP, RackSpace, Dell, IBM, RedHat• Same API for public & private clouds  ...
The 3 V’s of Big Data
Big Data Is Not Just About Elephants
Distributed File System
Map/Reduce
Data Mining
Data Access
Discovery & Orchestration
Real Time Event Processing
HDFS, in Reality
Map/Reduce, in Reality
Mongo, in Reality
Storm
Storm, In Reality
And What about Other Parts     of Your App??
And This is What Your Big Data App Will Eventually Look Like
Managing All of That In the Cloud•   Start VMs•   Install and configure components•   Monitor•   Repair•   (Auto) Scale•  ...
Managing Big       Managing Big Data Apps     ≠      Data
Some Existing (partial) Solutions
Introducing Cloudifythe Open Paas Stack (Pun Intended)
When PaaS Met DevOps…
Your App, Your Recipe
How It Works  Process                                            Install                                  Bootstrap Applic...
DemoApache
Q&A
THANK YOU! GET IT TODAY, FOR FREE:WWW.CLOUDIFYSOURCE.ORG
Big Data Apps on OpenStack
Big Data Apps on OpenStack
Upcoming SlideShare
Loading in...5
×

Big Data Apps on OpenStack

2,922

Published on

The massive computing and storage resources that are needed to support big data applications make cloud environments an ideal fit, and more so OpenStack, which is open and is emerging as a standard for both public and private clouds.
But managing your big data app is no walk in the park - configuration, orchestration, HA, auto-scaling are all quite hard to do - which is where Cloudify fits in.

Published in: Technology, Education
1 Comment
14 Likes
Statistics
Notes
No Downloads
Views
Total Views
2,922
On Slideshare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
1
Comments
1
Likes
14
Embeds 0
No embeds

No notes for slide
  • Primary and Backup dependency Moving data around for scaling Availability - moving data without losing it.Moving processes to the data rather than the other way aroundManaging the app as a whole
  • Transcript of "Big Data Apps on OpenStack"

    1. 1. BIG DATA APPSON OPENSTACK
    2. 2. about:meHead of Product @ GigaSpaces @uri1803 github.com/uric
    3. 3. “Big data and cloud technology go hand-in-hand. Big data needs clusters of servers forprocessing, which clouds can readily provide.” Ed Dumbill, The O’Reilly Radar
    4. 4. Why OpenStack?• Everyone (well, almost…) is in – HP, RackSpace, Dell, IBM, RedHat• Same API for public & private clouds – Cloud bursting – Portability
    5. 5. The 3 V’s of Big Data
    6. 6. Big Data Is Not Just About Elephants
    7. 7. Distributed File System
    8. 8. Map/Reduce
    9. 9. Data Mining
    10. 10. Data Access
    11. 11. Discovery & Orchestration
    12. 12. Real Time Event Processing
    13. 13. HDFS, in Reality
    14. 14. Map/Reduce, in Reality
    15. 15. Mongo, in Reality
    16. 16. Storm
    17. 17. Storm, In Reality
    18. 18. And What about Other Parts of Your App??
    19. 19. And This is What Your Big Data App Will Eventually Look Like
    20. 20. Managing All of That In the Cloud• Start VMs• Install and configure components• Monitor• Repair• (Auto) Scale• Burst…
    21. 21. Managing Big Managing Big Data Apps ≠ Data
    22. 22. Some Existing (partial) Solutions
    23. 23. Introducing Cloudifythe Open Paas Stack (Pun Intended)
    24. 24. When PaaS Met DevOps…
    25. 25. Your App, Your Recipe
    26. 26. How It Works Process Install Bootstrap Application Configure Java & Cloudify Recipe Start Agent Monitor & Ensures H/ACommands ResourceAllocation Invokes IaaS API Compute Services
    27. 27. DemoApache
    28. 28. Q&A
    29. 29. THANK YOU! GET IT TODAY, FOR FREE:WWW.CLOUDIFYSOURCE.ORG

    ×