Big data in the cloud Welcome to cost oriented design

1. Big data in the cloud
welcome to cost oriented design
Arnon Rotem-Gal-Oz
Chief Data Officer

2. Cost oriented design Cheap
(but hopefully cheaper)
Caveat Emptor

4. security
performanceavailability
correctness
scalability
solution cost

5. “Traditional” design for cost
POC
(choose technologies,
understand
constraints)
Size needed hardware purchase HW + SW Optimize

6. Amdocs TeraScale
Source: https://www.youtube.com/watch?v=0N2KhuMKAxM

7. Optimize &
maximize utilization

8. Big data in the cloud

9. Let’s drill down

10. A

11. Retention

12. Analytic Database
Vertica
vs.
RedShift

13. security
performanceavailability
correctness
scalability
solution initial cost

14. security
performanceavailability
correctness
scalability
Initial cost
Variable running
costs

15. Dedicated Servers vs. S3 with EC2

16. Spot instances

17. security
performanceavailability
correctness
scalability
Initial cost
Continuous cost
optimization
variable cost

18. Analytics database
(take 2)
Redshift, TokuMX
vs.
Druid

19. Google BigQuery

20. What do users actually need?“You can’t always get
what you want,
But if you try,
sometimes, you might find
you get what you need”
The rolling stones

21. Initial cost
variable cost
continuous cost
optimization

22. “COST ORIENTATION”
YOU KEEP USING THESE WORDS
I DON’T THINK THEY MEAN
WHAT YOU THINK THEY MEAN