• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
Terracotta Ditch the Disk webcast
 

Terracotta Ditch the Disk webcast

on

  • 391 views

Everyone's buzzing about the incredible performance gains from in-memory data management. But how do you move all of your data into RAM while still ensuring enterprise-grade availability, consistency, ...

Everyone's buzzing about the incredible performance gains from in-memory data management. But how do you move all of your data into RAM while still ensuring enterprise-grade availability, consistency, and control?
Join us as we highlight the benefits of a great in-memory architecture, the challenges of building one, and emerging best practices in the field.

Statistics

Views

Total Views
391
Views on SlideShare
391
Embed Views
0

Actions

Likes
0
Downloads
9
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • In-Memory Technologies can help e-commerce companies keep pace.Over last several decades there has been a huge drop in memory prices and massive increase in the size of commodity serversIt’s time to ditch the disk… to stop locking data away in slow, disk-bound databases which are expensive and difficult to runInstead, you can store data in memory, right where the application runs for ultra-fast access (at least 100x faster)
  • A few years back, building an in-memory solution was too expensive. But now the good news is that the explosion in data – combined with a steep drop in RAM prices - is creating some exciting new opportunities to rethink the way we look at data management.
  • Brief writeup on AdJuggler.

Terracotta Ditch the Disk webcast Terracotta Ditch the Disk webcast Presentation Transcript

  • © 2013 Terracotta Inc. | Internal Use OnlyDitch the Disk:Designing greatin-memoryarchitectures
  • © 2013 Terracotta Inc. | Internal Use Only 2Your speakersGagan MehraChief EvangelistTerracottaOrion LetiziCo-founderTerracotta
  • © 2013 Terracotta Inc. | Internal Use Only 3What we’ll cover in this webcast• Why enterprises are ditching their disks• The top challenges in designinggreat in-memory architectures• Emerging best practices• Case study: AdJuggler• How to start ditching your disks• Q & A
  • © 2013 Terracotta Inc. | Internal Use Only 44© 2013 Terracotta Inc. | Internal Use OnlyWhy enterprises areditching the disks
  • © 2013 Terracotta Inc. | Internal Use Only 5The Internet has revealed weaknesses in thestandard disk-based architecture
  • © 2013 Terracotta Inc. | Internal Use Only 6Ad-hoc data management built into applicationsresults in inconsistent speed, scale, and reliability
  • © 2013 Terracotta Inc. | Internal Use Only 7The in-memory data management revolutionFrom disk to RAMMemory90% of Data inDatabaseDatabase90% of Data inMemorySlowExpensiveDifficult to scaleUltra fastCost-efficientTB-scale serversmodernize
  • © 2013 Terracotta Inc. | Internal Use Only 8In-MemoryExplosion involume ofbusiness dataBig DataWhy in-memory now?Low-cost RAM meets Big DataUnlock the value in your dataMaximize inexpensive memorySteep drop inprice of RAM
  • © 2013 Terracotta Inc. | Internal Use Only 9© 2013 Terracotta Inc. | Internal Use Only 9Who’s ditching the disk?FINANCIALSERVICESGOVERNMENT TELECOMMUNICATIONSMEDIAENTERTAINMENTECOMMERCEFRAUDDETECTIONTRANSPORTATION HEALTHCARE TRAVEL TECHNOLOGY
  • © 2013 Terracotta Inc. | Internal Use Only 10© 2013 Terracotta Inc. | Internal Use Only 10The business case for ditching the disk (ROI)Additional revenue/profit$10 million to $2 billion (based on media, financial services, e-commerce)Ability to handle more customers (speed at scale)Smarter selling and cross-sellingFaster insightsDatabase license savings:Oracle Enterprise edition per processor = $47,500 + 20% license supportOther ROI opportunities:Reduced monitoring and management overhead (people and tools)Reduced penalties for failing to meet SLAsSmarter business decisions with faster access to data
  • © 2013 Terracotta Inc. | Internal Use Only 11© 2013 Terracotta Inc. | Internal Use Only 11A clear correlation with Big Data success44% of best-in-class Big Dataperformers are already usingin-memory data management, andmore are planning to deploy it.0% of Big Data laggards use in-memory data management.According to Aberdeen Group*:*In-memory Computing: Lifting the Burden of Big Data (Jan 2012)
  • © 2013 Terracotta Inc. | Internal Use Only 1212© 2013 Terracotta Inc. | Internal Use OnlyThe top 6 challenges in designinggreat in-memory architectures
  • © 2013 Terracotta Inc. | Internal Use Only 13PERFORMANCEAchieving predictable low latency to Big Data1Obstacles• Network latency (for distributed in-memory data sets)• Marshalling and unmarshalling of data structures• Garbage collection pauses (Java)TimeLatencyNOT PREDICTABLE!
  • © 2013 Terracotta Inc. | Internal Use Only 14SCALEMinimal server footprint with large data sets2Obstacles• Limits on in-memory storage per node• Data replication overhead• Other management overheadGREAT NOT SO GREAT1 TB IN-MEMORY DATA
  • © 2013 Terracotta Inc. | Internal Use Only 15RELIABILITYFault tolerance and high availability3Obstacles• RAM is volatile• Replicating data across nodes can become complex andexpensive• Failover must be immediate and seamlessDISTRIBUTED IN-MEMORY DATAX
  • © 2013 Terracotta Inc. | Internal Use Only 16RESILIENCYFast Restartability4Obstacles• Large data sets can require very long reload times• Traditional databases are not well suited as persistentstorage for in-memory data (slow reloads)X
  • © 2013 Terracotta Inc. | Internal Use Only 17CONSISTENCYSynching data across distributed data sets5Obstacles• Network latency• Consistency flexibility (eventual, strong, transactional)• WAN replication (across regional data centers)X=1 X=2 X=?DISTRIBUTED IN-MEMORY DATA
  • © 2013 Terracotta Inc. | Internal Use Only 18CONTROLMonitoring and Management6Obstacles• Few standardized tools• Many in-memory data management tools ship withoutmanagement and monitoring dashboards
  • © 2013 Terracotta Inc. | Internal Use Only 1919© 2013 Terracotta Inc. | Internal Use OnlyEmerging best practices
  • © 2013 Terracotta Inc. | Internal Use Only 20Emerging best practices around in-memorydata management challengesPerformance: Off-heap storageStoring data off the Java heap lets you keep massive amounts of data in-process byincreasing predictability and decreasing latency.Scale: Tiers, not gridsClassic P2P data grids require as many as 5x the number of servers due tomanagement overhead. (More if off-heap storage unavailable.)Reliability: Mirrored stripesWith an active and mirror for each server stripe in your array, you can failoverautomatically to increase availability and reliability.321
  • © 2013 Terracotta Inc. | Internal Use Only 21Emerging best practices around in-memorydata management challenges (cont.)Resiliency: Fast restartable storesThe best in-memory architectures optimize persistent transaction storage for very fastreload. Loading a terabyte should take minutes, not days.Consistency: Configurable guaranteesAllow your data management team to set consistency guarantees for each data set:eventual, strong, transactional.Control: In-memory dashboardsBuild or buy a dashboard for advanced in-memory views and controls showing latency,utilization, and capacity over time.654
  • © 2013 Terracotta Inc. | Internal Use Only 2222© 2013 Terracotta Inc. | Internal Use OnlyCase study: AdJuggler
  • © 2013 Terracotta Inc. | Internal Use Only 23© 2013 Terracotta Inc. 23- AdJuggler VP of Technology Ben Lindquist“At AdJuggler, we’re building a 1 milliontransaction-per-second advertisingmarketplace. Speed at scale is everything,and we are past the point where we can dothings in traditional ways.”
  • © 2013 Terracotta Inc. | Internal Use Only 24AdJuggler in-memory architectureI wanted to throw outthe database and, withit, the disks.— AdJuggler VP ofTechnology BenLindquist
  • © 2013 Terracotta Inc. | Internal Use Only 2525© 2013 Terracotta Inc. | Internal Use OnlyHow to startditching your disks
  • © 2013 Terracotta Inc. | Internal Use Only 26© 2013 Terracotta Inc. | Internal Use Only 26How to start ditching your disks?• Start with a low-risk, high-return opportunitywith potential for a quick win• Get early buy-in from senior executives• Define and track success metrics so you canexpand your “ditch the disk” project
  • © 2013 Terracotta Inc. | Internal Use Only 27Ditch the Disk: Q & AQuestionsPlease type yours in the “Questions” panel or in the chat window.
  • © 2013 Terracotta Inc. | Internal Use Only 28Want to learn more about designing in-memoryarchitectures?1. Download “Ditch the Disk” white paperVisit: www.terracotta.org (Resources > White Papers)2. Contact Gagan to discuss your in-memoryarchitecture challengesEmail: gagan@terracotta.org3. Follow us on TwitterFollow: @big_memory