Big data today and tomorrow

395 views
321 views

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
395
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
5
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Big data today and tomorrow

  1. 1. BIGdatatodayand tomorrow Mariusz Gil
  2. 2. / ABOUT ME /
  3. 3. BIGDATA This talk is about
  4. 4. BIGDATA? What is...
  5. 5. VOLUMElarge amounts of data
  6. 6. VELOCITYneeds to be analyzed quickly
  7. 7. VARIETYdifferent types of structured and unstructured data
  8. 8. Big Data is data that is too large, complex and dynamics for any conventional data tools to capture, store, manage and analyze.
  9. 9. 30 billion pieces of content we added past month
  10. 10. more than 2 billion videos were watched yesterday
  11. 11. more than 58 millions messages were send yesterday
  12. 12. WHY?
  13. 13. 690 nodes Hadoop cluster for predictions and analytics
  14. 14. HOW?
  15. 15. HBASE COLUMNAR STORAGE HIVE SQLDATA WAREHOUSE ENGINE AVRO DATA SERIALIZATION MAHOUT SCALABLE MACHINE LEARNING OOZIE WORKFLOWS ORCHESTRATION ZOOKEEPER DISTRIBUTED COORDINATION SERVICE FLUME LOG COLLECTOR HDFS HADOOP DISTRIBUTED FILE SYSTEM YARN / MapReduce v2 DISTRIBUTED PROCESSING FRAMEWORK AMBARI PROVISIONING, MANAGING AND MONITORING CLUSTERS WHIRR RUNNING CLOUD SERVICES
  16. 16. EVOLVE
  17. 17. HADOOP! The future is not only
  18. 18. REALTIME Future is low latency and
  19. 19. Apache Drill Storm
  20. 20. BIGTHING Data is the next
  21. 21. thanksmariusz@mariuszgil.com

×