Thursday, November 3, 11
Thursday, November 3, 11
Data Grids vs                            Databases                               Galder Zamarreño                         ...
Galder Zamarreño                           •   R&D Engineer, Red Hat Inc.                           •   Infinispan develop...
Agenda                           •   Why do we need Data Grids?                           •   What are exactly In-memory D...
Traditionally...                           Store everything in a DB!Thursday, November 3, 11
Modern requirements                           DBs not particularly good at                           horizontal scaling......
One size doesn’t fill all!                           DBs are not bad, but they’re                           not the soluti...
Data GridsThursday, November 3, 11
Data Grids are not new                           Mainstream traction only                           recent: vertical scali...
Who’s offering                            Data Grids?Thursday, November 3, 11
The Players                           • Open Source:                            • Infinispan, EhCache, Hazelcast...       ...
But, what are                           In-memory DGs?Thursday, November 3, 11
Definition                           In-memory data structures that                           offer extremely fast access ...
Maps are popular!                           Normally come with a Map-like                           API, but often come wi...
Data distribution                           Store data in a subset of the                           grid to provide failov...
With failure in mind                           Suitable for commodity                           hardware because they can ...
Elastic                           Remain available during                           topology changesThursday, November 3, 11
Durability                           More durability achieved                           flushing to a persistent storeThur...
Access patterns                           Embedded (client and DG in                           same VM)                   ...
ACID or BASE                           Transactions or Eventual                           Consistency?Thursday, November 3...
DGs + DBs?Thursday, November 3, 11
Caching!                           Use Data Grids as caches to                           enhance Database access          ...
Can a Data Grid                            replace a DB?Thursday, November 3, 11
Reiterating benefits                           Speed, scalability, cloud-                           friendliness...etcThur...
What are the Data                           Grid challenges?Thursday, November 3, 11
Access patterns                           Migrating from SQL to Map or                           alternative APIs not easy...
Skill set                           Different skill set:                           OO programmer vs SQLThursday, November ...
Application data layer                           Data layer to take data                           collocation into accoun...
E.g. with a DB...Thursday, November 3, 11
Same with InfinispanThursday, November 3, 11
Map/Reduce in detailThursday, November 3, 11
Technology to                            bridge gap?Thursday, November 3, 11
What about JPA?                           Hibernate OGM (Object/Grid                           Mapper) uses JPA to store i...
Most frequent use                            cases for DGs?Thursday, November 3, 11
Use cases                           •   Analytic systems, i.e. financial/trading apps                           •   XTP   ...
Do I see DGs as DB                             replacements?Thursday, November 3, 11
DBs are here to stay!                           No. DBs are proven, mature,                           well understood plus...
One size doesn’t fill all!                           DBs are not a universal data                           storage system...
Consider Data Grids                           For their speed, capabilities as                           data store, and c...
Still some way to go                           More deployments and                           standardization (JSR-107,   ...
Questions                           infinispan.org - @infinispan                           speakerrate.com/galderThursday,...
Upcoming SlideShare
Loading in...5
×

Data Grids vs Databases

5,285

Published on

Published in: Technology

Data Grids vs Databases

  1. 1. Thursday, November 3, 11
  2. 2. Thursday, November 3, 11
  3. 3. Data Grids vs Databases Galder Zamarreño Senior Software Engineer Red Hat, Inc 3rd October 2011, Soft ShakeThursday, November 3, 11
  4. 4. Galder Zamarreño • R&D Engineer, Red Hat Inc. • Infinispan developer • 5+ years exp. with distributed data systems • Twitter: @galderz • Blog: zamarreno.comThursday, November 3, 11
  5. 5. Agenda • Why do we need Data Grids? • What are exactly In-memory Data Grids? • Data Grids + Databases • Data Grids without a Database • Can Data Grids replace Databases?Thursday, November 3, 11
  6. 6. Traditionally... Store everything in a DB!Thursday, November 3, 11
  7. 7. Modern requirements DBs not particularly good at horizontal scaling...Thursday, November 3, 11
  8. 8. One size doesn’t fill all! DBs are not bad, but they’re not the solution to every problem eitherThursday, November 3, 11
  9. 9. Data GridsThursday, November 3, 11
  10. 10. Data Grids are not new Mainstream traction only recent: vertical scaling needs, cheaper memory... and cloud!Thursday, November 3, 11
  11. 11. Who’s offering Data Grids?Thursday, November 3, 11
  12. 12. The Players • Open Source: • Infinispan, EhCache, Hazelcast... • Commercial: • Oracle Coherence, Gigaspaces, Gemfire, IBM eXtreme ScaleThursday, November 3, 11
  13. 13. But, what are In-memory DGs?Thursday, November 3, 11
  14. 14. Definition In-memory data structures that offer extremely fast access to dataThursday, November 3, 11
  15. 15. Maps are popular! Normally come with a Map-like API, but often come with alternativesThursday, November 3, 11
  16. 16. Data distribution Store data in a subset of the grid to provide failover while being able to scale up!Thursday, November 3, 11
  17. 17. With failure in mind Suitable for commodity hardware because they can handle failureThursday, November 3, 11
  18. 18. Elastic Remain available during topology changesThursday, November 3, 11
  19. 19. Durability More durability achieved flushing to a persistent storeThursday, November 3, 11
  20. 20. Access patterns Embedded (client and DG in same VM) or Remote (just like DBs)Thursday, November 3, 11
  21. 21. ACID or BASE Transactions or Eventual Consistency?Thursday, November 3, 11
  22. 22. DGs + DBs?Thursday, November 3, 11
  23. 23. Caching! Use Data Grids as caches to enhance Database access performance!Thursday, November 3, 11
  24. 24. Can a Data Grid replace a DB?Thursday, November 3, 11
  25. 25. Reiterating benefits Speed, scalability, cloud- friendliness...etcThursday, November 3, 11
  26. 26. What are the Data Grid challenges?Thursday, November 3, 11
  27. 27. Access patterns Migrating from SQL to Map or alternative APIs not easyThursday, November 3, 11
  28. 28. Skill set Different skill set: OO programmer vs SQLThursday, November 3, 11
  29. 29. Application data layer Data layer to take data collocation into account and do more validation (less strict schema)Thursday, November 3, 11
  30. 30. E.g. with a DB...Thursday, November 3, 11
  31. 31. Same with InfinispanThursday, November 3, 11
  32. 32. Map/Reduce in detailThursday, November 3, 11
  33. 33. Technology to bridge gap?Thursday, November 3, 11
  34. 34. What about JPA? Hibernate OGM (Object/Grid Mapper) uses JPA to store in DGs as opposed to DBsThursday, November 3, 11
  35. 35. Most frequent use cases for DGs?Thursday, November 3, 11
  36. 36. Use cases • Analytic systems, i.e. financial/trading apps • XTP • Event driven apps, i.e. CEP • Clustering toolkitThursday, November 3, 11
  37. 37. Do I see DGs as DB replacements?Thursday, November 3, 11
  38. 38. DBs are here to stay! No. DBs are proven, mature, well understood plus, there are millions of systems out there!Thursday, November 3, 11
  39. 39. One size doesn’t fill all! DBs are not a universal data storage system any moreThursday, November 3, 11
  40. 40. Consider Data Grids For their speed, capabilities as data store, and cloud friendlinessThursday, November 3, 11
  41. 41. Still some way to go More deployments and standardization (JSR-107, JSR-347)Thursday, November 3, 11
  42. 42. Questions infinispan.org - @infinispan speakerrate.com/galderThursday, November 3, 11

×