Big Data | Small Problems

7,522 views
6,865 views

Published on

Given at OSCON 2011. Version with notes available here: http://dl.dropbox.com/u/348446/big-data-small-problems_with-notes.pdf

Published in: Technology
0 Comments
6 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
7,522
On SlideShare
0
From Embeds
0
Number of Embeds
2,549
Actions
Shares
0
Downloads
95
Comments
0
Likes
6
Embeds 0
No embeds

No notes for slide

Big Data | Small Problems

  1. Big SmallData ProblemsA PRESENTATION BY @timangladEFROM YOUR FRIENDS AT @cloudant
  2. NOSQL SUmmer .orgNOSQL TApes.com
  3. Big DataBig EFFING DEAL
  4. Do we need to goover this again?Look out! HE’s got GRAPHS!
  5. Consumer Cost per GB1,000,000 100,000 10,000 1,000 100 10 1 1981 1985 1990 1994 1998 2003 2007 Sources: Ivan Smith + IDC, 2008
  6. WorldWIDE STORAGE CAPACITY / CAPITA 50,000 37,500 25,000 12,500 0 1986 1994 2002 2010Source: The World’s Technological Capacity to Store, Communicate, and Compute Information, Hilbert, et al. Science 1 April 2011: 60-65.
  7. Just Data SIZE?if I’m asking, you probably know the answer!
  8. The Big Data Trifecta 1. Gigabytes 2. IOPS 3. DOLLARS
  9. Why NOW?
  10. Just technology?
  11. What Ails US…
  12. AILMENT #1Digital Disconnect
  13. AILMENT #2DimensionalOVERLOAD
  14. AILMENT #3Infobesity
  15. Text
  16. AILMENT #4DeterminismDISORDER
  17. AILMENT #5YEARNINGFOR MEANING
  18. AILMENT #6REVOLUTIONDELUSION
  19. AILMENT #7BUBBLYBUZZWORDBUG
  20. AILMENT #8BLACK BOX
  21. AILMENT #9CARGO CULTS
  22. AILMENT #10SCALE-OIL SALESMEN
  23. How do IBig DATA?
  24. RULE #1PAPER / Practice
  25. RULE #2Only UseNOSQL (or Newsql)if you have to.
  26. RULE #3Distribution modelDATA MODELDISK STRUCTURE
  27. RULE #4CATCHY PHRASESARE RED HERRINGS
  28. RULE #5WHO DO YOU TRUST?
  29. A Word aboutRELATIONAL SYSTEMS
  30. A Word aboutSWITCHING
  31. NOSQL / NewSQL
  32. Did we reallyNEED A SEQUEL?
  33. Did we reallyNEED A REMAKE?
  34. NEWSQL
  35. VoltdbClustrixGenieDBXEROUNDDrizzleAzureAMAZON RDS
  36. I CAN HAZPARTITIONTOLERANCE?
  37. NewSQLis about BEING…IT-FriendlyCompliance-Friendly
  38. NOSQL
  39. MongodbCouchdbRIAKCassandraNEO4J(BigCOUCH)Redis?Hadoop?
  40. 3 NOSQL TRENDS
  41. TREND #180% vs. 20%
  42. 80% Databases
  43. 20% Databases
  44. ALSO Hadoop REDIS
  45. TREND #2Storage Separation
  46. You GOTYOUR CASSANDRAIN MY HADOOP
  47. You GOTYOUR ACUNUIN MY CASSANDRA
  48. You GOTYOUR LEVELDBIN MY RIAK
  49. TREND #3Ease of ACCESS
  50. Riak SeARCH PIPE SECONDARY IND.CLOUDANT SEARCHCASSANDRA CQL
  51. NOSQLis about…Dev-FriendlyOPS-Friendly
  52. .com
  53. Thank You@timangladetim@cloudant.com

×