The Big Data Challenge

1,102 views

Published on

How Big Data is a changing businesses and society? Where is the gold in all of that data and how can it improve productivity, profitability, competitive advantage, and personal efficiencies?

André Simões - BI Architect and Big Data Evangelist, @Xpand IT

Xpand IT presentation during the Pentaho & Big Data Ecosystem - Live Seminar 2013

Published in: Technology
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,102
On SlideShare
0
From Embeds
0
Number of Embeds
13
Actions
Shares
0
Downloads
35
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

The Big Data Challenge

  1. 1. THE BIG DATA challenge André Simões andre.simoes@xpand-it.com
  2. 2. “Everyone talks about it Nobody really knows how to do it Everyone thinks everyone else is doing it So everyone claims they are doing it…” (Dan  Ariely,  Duke  University)   BIG DATA IS LIKE TEENAGE SEX
  3. 3. BEING ABLE TO USe More than 5% OF YOUR DATA FOR ANALYSIS THE CHALLENGES
  4. 4. CAPTURING MORE THAN 1/4 OF YOUR YEARLY DATA FOR ANALYSIS THE CHALLENGES
  5. 5. MAKE YOUR TEAM ABLE TO KEEP UP WITH THE THE CHALLENGES CHANGES
  6. 6. WHERE TO START ?
  7. 7. V olume V ariety V elocity THE 3 V’S
  8. 8. WHY BUY AN AIRPLANE When you can… SCALE OUT THE CHALLENGES
  9. 9. DISTRIBUTED filesystems
  10. 10. COMODITY HARDWARE REPLICATION DISTRIBUTED COMPUTATION STEEP LEARNING CURVE DISTRIBUTED DATABASES
  11. 11. ETL DEVELOPERS ARE EASY TO FIND MAP/REDUCE DEVELOPERS ARE DISTRIBUTED FILESYSTEMS NOT
  12. 12. FORTUNATELY, PENTAHO THOUGHT ABOUT THIS… DISTRIBUTED FILESYSTEMS
  13. 13. EASY FOR ETL DEVELOPERS SEAMLESS INTEGRATION DISTRIBUTED COMPUTATION VERY SMALL LEARNING CURVE DISTRIBUTED DATABASESO MAP/REDUCE
  14. 14. SOMETIMES YOUR MIGHT ALSO LOOK LIKE THIS… THE CHALLENGES DATA WHAT TO DO?
  15. 15. NOSQL
  16. 16. UNSTRUCTURED PARADIGM SHIFT SCHEMALESS DESIGN FAST, very fast! NOSQL
  17. 17. But most of the time, when you think of Big Data… THE CHALLENGES
  18. 18. … you just really need a better infrastructure! THE CHALLENGES
  19. 19. ANALYTICAL DATABASES
  20. 20. SQL Very FAST REads GOOD OLD Slower writes SMALL LEARNING ANALYTICAL DATABASES CURVE
  21. 21. DO YOU REALLY NEED BIG DATA ?
  22. 22. REMEMBER to ALWAYS DO YOUR HOMEWORK FIRST!
  23. 23. And if you need help... WE ARE BIG DATA experts
  24. 24. THANK YOU! THE BIG DATA challenge André Simões andre.simoes@xpand-it.com

×