Terracotta Ditch the Disk webcast

600 views

Published on

Everyone's buzzing about the incredible performance gains from in-memory data management. But how do you move all of your data into RAM while still ensuring enterprise-grade availability, consistency, and control?
Join us as we highlight the benefits of a great in-memory architecture, the challenges of building one, and emerging best practices in the field.

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
600
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
7
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • In-Memory Technologies can help e-commerce companies keep pace.Over last several decades there has been a huge drop in memory prices and massive increase in the size of commodity serversIt’s time to ditch the disk… to stop locking data away in slow, disk-bound databases which are expensive and difficult to runInstead, you can store data in memory, right where the application runs for ultra-fast access (at least 100x faster)
  • A few years back, building an in-memory solution was too expensive. But now the good news is that the explosion in data – combined with a steep drop in RAM prices - is creating some exciting new opportunities to rethink the way we look at data management.
  • Brief writeup on AdJuggler.
  • Terracotta Ditch the Disk webcast

    1. 1. Ditch the Disk: Designing great in-memory architectures © 2013 Terracotta Inc. | Internal Use Only
    2. 2. Your speakers Gagan Mehra Chief Evangelist Terracotta Orion Letizi Co-founder Terracotta © 2013 Terracotta Inc. | Internal Use Only 2
    3. 3. What we’ll cover in this webcast • Why enterprises are ditching their disks • The top challenges in designing great in-memory architectures • Emerging best practices • Case study: AdJuggler • How to start ditching your disks • Q&A © 2013 Terracotta Inc. | Internal Use Only 3
    4. 4. Why enterprises are ditching the disks © 2013 Terracotta Inc. | Internal Use Only 4 © 2013 Terracotta Inc. | Internal Use Only 4
    5. 5. The Internet has revealed weaknesses in the standard disk-based architecture © 2013 Terracotta Inc. | Internal Use Only 5
    6. 6. Ad-hoc data management built into applications results in inconsistent speed, scale, and reliability © 2013 Terracotta Inc. | Internal Use Only 6
    7. 7. The in-memory data management revolution From disk to RAM 90% of Data in Database Memory    Slow Expensive Difficult to scale 90% of Data in Memory modernize Database    Ultra fast Cost-efficient TB-scale servers © 2013 Terracotta Inc. | Internal Use Only 7
    8. 8. Why in-memory now? Low-cost RAM meets Big Data In-Memory Maximize inexpensive memory Steep drop in price of RAM Big Data Unlock the value in your data Explosion in volume of business data © 2013 Terracotta Inc. | Internal Use Only 8
    9. 9. Who’s ditching the disk? FINANCIAL SERVICES GOVERNMENT TELECOMMUNICATIONS MEDIA ENTERTAINMENT ECOMMERCE FRAUD DETECTION TRANSPORTATION HEALTHCARE TRAVEL TECHNOLOGY © 2013 Terracotta Inc. | Internal Use Only 9
    10. 10. The business case for ditching the disk (ROI) Additional revenue/profit $10 million to $2 billion (based on media, financial services, e-commerce) Ability to handle more customers (speed at scale) Smarter selling and cross-selling Faster insights Database license savings: Oracle Enterprise edition per processor = $47,500 + 20% license support Other ROI opportunities: Reduced monitoring and management overhead (people and tools) Reduced penalties for failing to meet SLAs Smarter business decisions with faster access to data © 2013 Terracotta Inc. | Internal Use Only 10
    11. 11. A clear correlation with Big Data success According to Aberdeen Group*: 44% of best-in-class Big Data performers are already using in-memory data management, and more are planning to deploy it. 0% of Big Data laggards use inmemory data management. *In-memory Computing: Lifting the Burden of Big Data (Jan 2012) © 2013 Terracotta Inc. | Internal Use Only 11
    12. 12. The top 6 challenges in designing great in-memory architectures © 2013 Terracotta Inc. | Internal Use Only 12 © 2013 Terracotta Inc. | Internal Use Only 12
    13. 13. 1 PERFORMANCE Achieving predictable low latency to Big Data Latency NOT PREDICTABLE! Time Obstacles • Network latency (for distributed in-memory data sets) • Marshalling and unmarshalling of data structures • Garbage collection pauses (Java) © 2013 Terracotta Inc. | Internal Use Only 13
    14. 14. 2 SCALE Minimal server footprint with large data sets 1 TB IN-MEMORY DATA GREAT NOT SO GREAT Obstacles • Limits on in-memory storage per node • Data replication overhead • Other management overhead © 2013 Terracotta Inc. | Internal Use Only 14
    15. 15. 3 RELIABILITY Fault tolerance and high availability DISTRIBUTED IN-MEMORY DATA X Obstacles • RAM is volatile • Replicating data across nodes can become complex and expensive • Failover must be immediate and seamless © 2013 Terracotta Inc. | Internal Use Only 15
    16. 16. 4 RESILIENCY Fast Restartability X Obstacles • Large data sets can require very long reload times • Traditional databases are not well suited as persistent storage for in-memory data (slow reloads) © 2013 Terracotta Inc. | Internal Use Only 16
    17. 17. 5 CONSISTENCY Synching data across distributed data sets X=1 X=2 X=? DISTRIBUTED IN-MEMORY DATA Obstacles • Network latency • Consistency flexibility (eventual, strong, transactional) • WAN replication (across regional data centers) © 2013 Terracotta Inc. | Internal Use Only 17
    18. 18. 6 CONTROL Monitoring and Management Obstacles • Few standardized tools • Many in-memory data management tools ship without management and monitoring dashboards © 2013 Terracotta Inc. | Internal Use Only 18
    19. 19. Emerging best practices © 2013 Terracotta Inc. | Internal Use Only 19 © 2013 Terracotta Inc. | Internal Use Only 19
    20. 20. Emerging best practices around in-memory data management challenges 1 2 Scale: 3 Performance: Off-heap storage Storing data off the Java heap lets you keep massive amounts of data in-process by increasing predictability and decreasing latency. Tiers, not grids Classic P2P data grids require as many as 5x the number of servers due to management overhead. (More if off-heap storage unavailable.) Reliability: Mirrored stripes With an active and mirror for each server stripe in your array, you can failover automatically to increase availability and reliability. © 2013 Terracotta Inc. | Internal Use Only 20
    21. 21. Emerging best practices around in-memory data management challenges (cont.) 4 Consistency: 5 Control: 6 Resiliency: Fast restartable stores The best in-memory architectures optimize persistent transaction storage for very fast reload. Loading a terabyte should take minutes, not days. Configurable guarantees Allow your data management team to set consistency guarantees for each data set: eventual, strong, transactional. In-memory dashboards Build or buy a dashboard for advanced in-memory views and controls showing latency, utilization, and capacity over time. © 2013 Terracotta Inc. | Internal Use Only 21
    22. 22. Case study: AdJuggler © 2013 Terracotta Inc. | Internal Use Only 22 © 2013 Terracotta Inc. | Internal Use Only 22
    23. 23. “At AdJuggler, we’re building a 1 million transaction-per-second advertising marketplace. Speed at scale is everything, and we are past the point where we can do things in traditional ways.” - AdJuggler VP of Technology Ben Lindquist © 2013 Terracotta Inc. | Internal Use Only © 2013 Terracotta Inc. 23
    24. 24. AdJuggler in-memory architecture I wanted to throw out the database and, with it, the disks. — AdJuggler VP of Technology Ben Lindquist © 2013 Terracotta Inc. | Internal Use Only 24
    25. 25. How to start ditching your disks © 2013 Terracotta Inc. | Internal Use Only 25 © 2013 Terracotta Inc. | Internal Use Only 25
    26. 26. How to start ditching your disks? • Start with a low-risk, high-return opportunity with potential for a quick win • Get early buy-in from senior executives • Define and track success metrics so you can expand your “ditch the disk” project © 2013 Terracotta Inc. | Internal Use Only 26
    27. 27. Ditch the Disk: Q & A Questions Please type yours in the “Questions” panel or in the chat window. © 2013 Terracotta Inc. | Internal Use Only 27
    28. 28. Want to learn more about designing in-memory architectures? 1. Download “Ditch the Disk” white paper Visit: www.terracotta.org (Resources > White Papers) 2. Contact Gagan to discuss your in-memory architecture challenges Email: gagan@terracotta.org 3. Follow us on Twitter Follow: @big_memory © 2013 Terracotta Inc. | Internal Use Only 28

    ×