In-memory Data Management Trends & Techniques

899 views

Published on

www.hazelcast.com

Published in: Software, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
899
On SlideShare
0
From Embeds
0
Number of Embeds
13
Actions
Shares
0
Downloads
34
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

In-memory Data Management Trends & Techniques

  1. 1. Lightning Talk
 In-Memory Data Management 
 Trends & Techniques" GREG LUCK! CTO HAZELCAST
  2. 2. 2 In-Memory Hardware Trends How to Use It
  3. 3. 3 Von Neumann Architecture 3
  4. 4. Hardware Trends 4
  5. 5. 5 Commodity Multi-core Servers 5 0 4 8 12 16 20 Cores/CPU
  6. 6. UMA -> NUMA
  7. 7. 7 Commodity 64 bit servers 7 4GB32 18EB64
  8. 8. 8 50 Years of RAM Prices Historical and Projected 8
  9. 9. 9 50 Years of Disk Prices 9
  10. 10. 10 SSD Prices 10 Average Price $1/GB
  11. 11. 11 Cost Comparison: USD/GB 2012 11 Disk: $0.04 SSD: $1 25x DRAM: $21 525x $4k $100k $2.1m 100TB
  12. 12. 12 Max RAM Per Commodity Server 12 0 1 2 3 4 5 6 7 8 9 2010 2011 2012 2013 TB
  13. 13. 13 Latency across the network 13 0 10 20 30 40 50 60 70 µs
  14. 14. 14 Access Times & Sizes 14 Level RR Latency Typical Size Technology Managed By Registers <1 ns 1 KB Custom CMOS Compiler L1 Cache 1 ns 8 – 128 KB SRAM Hardware L2 Cache 3 ns .5 – 8 MB SRAM Hardware L3 Cache (oc) 10-15 ns 4 – 30 MB SRAM Hardware Main Memory 60 ns 16GB – TB DRAM OS/App SSD 50 -100us 400GB – 6TB Flash Memory OS/App Main Memory over Network 2-100us Unbounded DRAM/ Ethernet/ Infinband OS/App Disk 4 - 7ms Multiple TBs Magnetic Rotational Disk OS/App Disk over Network 6 - 10ms Unbounded Disk/Ethernet/ Infiniband OS/App
  15. 15. 15 Access Times & Sizes 15 Level RR Latency Typical Size Technology Managed By Registers <1 ns 1 KB Custom CMOS Compiler L1 Cache 1 ns 8 – 128 KB SRAM Hardware L2 Cache 3 ns .5 – 8 MB SRAM Hardware L3 Cache (oc) 10-15 ns 4 – 30 MB SRAM Hardware Main Memory 60 ns 16GB – TB DRAM OS/App SSD 50 -100us 400GB – 6TB Flash Memory OS/App Main Memory over Network 2-100us Unbounded DRAM/ Ethernet/ Infinband OS/App Disk 4 - 7ms Multiple TBs Magnetic Rotational Disk OS/App Disk over Network 6 - 10ms Unbounded Disk/Ethernet/ Infiniband OS/App Cache up to 30 times faster than memory. Memory 106 times faster than disk. Network Memory 103 times faster than disk. SSD 102 faster than disk
  16. 16. Techniques 16
  17. 17. Exploit Data Locality Data is more likely to be read if: •  It was recently read (temporal locality) •  If it is adjacent to other data (e.g. arrays, fields in an object) •  If it is part of a pattern (e.g. looping, relations) •  Some data is naturally accessed more frequently e.g. Pareto Distribution
  18. 18. Working with the CPU’s Cache Hierarchy •  Memory up to 30x slower than cache •  Alleviated somewhat by NUMA, wide

×