Tools and Tech for Big Data Success

1,329 views

Published on

What do you need to succeed in working with Big Data? RedMonk analyst Donnie Berkholz will present quantitative research on the state of the field, covering the breadth of languages, tools, and infrastructure, to show you which choices to make today and which ones you'll need to get ready for, soon.

Published in: Technology, Business
  • Be the first to comment

  • Be the first to like this

Tools and Tech for Big Data Success

  1. 1. Tools and techfor Big Data successDonnie Berkholz, Ph.D.IT Industry Analyst@dberkholz[Imagine cheesy clipart of hammers, silicon, etc.]
  2. 2. Tools and tech — huh?● Languages● Infrastructure● Tooling● Its not about the what, its about the how
  3. 3. Thesis: Technology adoptionis increasingly bottom-up
  4. 4. The new kingmakers
  5. 5. The best DX wins
  6. 6. Its all about barriers to entry
  7. 7. Ecosystems matter
  8. 8. The challengesIT pros delivering data solutions60/36 IT/bizTalend, summer 2012
  9. 9. The skills gapNVP survey of execs, summer 2012
  10. 10. What can we learn from book sales?
  11. 11. What about the data analysts?KDNuggets, summer 2012
  12. 12. What about the data analysts?KDNuggets, summer 2012
  13. 13. Its not all about popularity...
  14. 14. The real growth isnt in SQL interfaces
  15. 15. Developers vs. marketersGoogle Trends
  16. 16. IT pros delivering data solutions60/36 IT/bizTalend, summer 2012
  17. 17. Hadoop distributions: popularityGoogle Trends: $VENDOR hadoop
  18. 18. Developers choose whats easiest
  19. 19. How to run: bare metal / DC, privatecloud, public cloud
  20. 20. Storing Data: HDFS, Ceph, Gluster
  21. 21. Open Building Blocks but not OpenSource: EMR on AWS
  22. 22. Realtime: Impala, Druid
  23. 23. In-memory: Redis, Memcached
  24. 24. Streaming: Storm, S4
  25. 25. Other Options: Hadoop YARN,HPCC, Cassandra, Mongo, Riak
  26. 26. Other Options: Spark/Shark/Mesos
  27. 27. Abstraction: Mortar, Continuuity,Qubole, Concurrent Lingual, etc.
  28. 28. Conclusion: KISS
  29. 29. Donnie Berkholz, Ph.D.Analyst, RedMonk@dberkholzDisclosure: 10gen, Amazon, Basho, Cloudera,Continuuity, IBM, MapR, Microsoft, and VMware areclients.

×