Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Big Memory Webcast

119 views

Published on

On May 19, 2020, analyst firm IDC; vendors Intel, MemVerge, Net
App and Penguin Computing; and end-user Credit Suisse, introduced a new category called Big Memory. Big Memory hardware and software together transform scarcity and volatility into abundance, persistence, and high-availability.

Published in: Software
  • Be the first to comment

  • Be the first to like this

Big Memory Webcast

  1. 1. Opening the Door for Big Memory
  2. 2. Presentation Team Joe Barnes Director MemVerge Eric Burgener VP IDC Kristie Mann Sr. Director Intel Charles Fan CEO MemVerge Kevin Tubbs Sr. VP Penguin Computing Darrell Westbury Sr. Director Credit Suisse Brett Roscoe VP NetApp
  3. 3. Agenda Time Topic Presenter 9:00 – 9:05 Introductions Joe Barnes, MemVerge 9:05 – 9:15 New “Big Memory” Category Eric Burgener, IDC 9:15 – 9:25 Re-Architecting The Data Landscape Kristie Mann, Intel 9:25 – 9:35 Big Memory Software: Memory Machine Charles Fan, MemVerge 9:35 – 9:45 Why MemVerge? Brett Roscoe, NetApp 9:45 – 9:55 Big Memory: A Case Study Kevin Tubbs, Penguin Computing 9:55 – 10:05 Customer PoV: Where Big Memory Fits Darrell Westbury, Credit Suisse 10:05 – 10:15 Q&A Joe Barnes, MemVerge
  4. 4. Digital Transformation Driving New “Big Memory” Requirements Eric Burgener, Research Vice President Infrastructure Systems, Platforms and Technologies Group May 2020 © IDC
  5. 5. © IDC 5 What Is Digital Transformation (DX)? The digitization of business models, processes, products and services Sets enterprises up to optimally take advantage of big data analytics
  6. 6. © IDC 6 91.1% of enterprises undergoing DX in the next three years More data-centric business models will drive AI/ML-infused analytics Performance and availability implications for enterprise storage Market evolution will drive demand for persistent memory technologies Digital Transformation is Widespread DX Maturity Distribution
  7. 7. © IDC 7 35 30 25 20 15 10 5 0 Worldwide, data is growing at a 26.0% CAGR, and in 2024 there will be 143 zettabytes of data created By 2021, 60-70% of the Global 2000 will have at least one mission- critical real-time workload Real-Time Workloads Are On The Rise
  8. 8. © IDC 8 PM Revenue Forecast, 2019 - 2023 $0.00 $500.00 $1,000.00 $1,500.00 $2,000.00 $2,500.00 $3,000.00 Revneue ($M) 2019 2020 2021 2022 2023 REVENUE($M) $2609M248% CAGR 2019-2023 $65M
  9. 9. © IDC 9 CONFLUENCE OF AVAILABLE TECHNOLOGIES ▪ Artificial intelligence and machine learning ▪ More concentrated compute power than ever before ▪ Emerging persistent memory technologies ▪ Memory virtualization with intelligent data placement MARKET EVOLUTION TO REAL-TIME ▪ Upping the ante: massive data sets, real-time orientation ▪ For accelerated computing, storage is still the bottleneck ▪ Value propositions include competitive differentiation, increased revenue Business Drivers TARGET WORKLOADS ▪ Latency-sensitive transactional workloads (trading floor apps, etc.) ▪ Real-time big data analytics in financial services, healthcare, retail, etc. ▪ AI/ML analytics and inferencing (fraud analytics, social media, etc.)
  10. 10. © IDC 10 Defining “Big Memory Computing” ▪ Enables the ability to run applications in memory for improved performance and efficiency ▪ Leverages byte addressable memory media ▪ Includes enterprise-class data services to handle tier 1 availability and management requirements ▪ Runs on a software-based memory virtualization layer on industry standard hardware without application modification ▪ The technology enabler for mission-critical real- time computing CAPACITY STORAGE BIG MEMORY (DRAM, PM) COMPUTE CAPACITY STORAGE MEMORY COMPUTE PERFORMANCE STORAGE OLD MODEL BIG MEMORY COMPUTING
  11. 11. Kristie Mann Sr. Director of Products 11
  12. 12. Density Computedemandaccelerating Dramisnotscaling ADAPTINGTOTHECHANGINGDATALANDSCAPE Source: Intel estimates; ”3D NAND Technology – Implications for Enterprise Storage Applications” by J.Yoon (IBM), 2015 Flash Memory Summit; “DRAM Market Monitor Q1-20" by Yole Development 121Mb 4Mb 64Mb 16Mb 128Mb 256Mb 512Mb 1Gb 2Gb 4Gb 8Gb 16Gb Phase3 Density increase ~2X/4years Phase2 Density increase ~2X/2years Phase1 Density increase ~4X/3years 1980 1985 1995 2000 2005 2010 2015 2020 Density Largememorysystemsgrowing 2020 2021 2022 2023 2024 2025 <512GB >512GB
  13. 13. 13 GapsintheMemory/StorageHierarchy
  14. 14. 14 THEBESTOFMEMORYANDSTORAGEWITHPERSISTENTMEMORY 10s GB <100 nanoseconds 10s TB <100 microseconds 10s TB <10 milliseconds 100s GB <1 microsecond 1s TB <10 microseconds
  15. 15. 15 Intel®Optane™PersistentMemoryisunique Revolutionary material Most significant memory and storage advancement in the last 20 years Writeinplace Set or reset data as needed, no need to erase media lowlatency …together delivering remarkably fast media BYTEADDRESSABLE Every memory cell can be individually addressed Thebestofmemoryandstorage
  16. 16. 16 TheOpportunityisImmense In-Memory Database Advanced analytics cloudworkloadVirtualized and Hybrid Yettobe Discovered HCI Compute Speedtime-to-Valueandinsightfor Data-intensiveworkloads
  17. 17. 17 SoftwareOptimizationDrivesValueforcustomersApplicationModificationEffort Utilization of PMem Capabilities OptimizedSoftware–Soyoudon’thaveto • Virtualized pools of memory • Byte-addressable persistence without code changes • Data Services for High Availability and Durability • Super-charged performance and flexibility in memory Storage Over AD
  18. 18. Big Memory Software: Memory Machine Charles Fan
  19. 19. ➢ New Big Memory Computing category ➢ New round of $19M investment led by Intel Capital, joined by Cisco Investments, NetApp and SK hynix ➢ Memory Machine™ software available via Early Access Program What We Announced on May 12 19
  20. 20. Our BIG MEMORY vision All applications live in memory 20
  21. 21. Bringing Mission Critical Apps to Big Memory Data Services Quick crash recovery Plug-and-play No App rewrite needed Scale Memory Beyond a single server 22
  22. 22. MemVerge Memory Machine™ Software Subscription Low Latency PMEM over RDMA Virtualizes DRAM & PMEM Plug Compatible No re-writes Replication 23 Memory Machine Memory Machine Memory Data Services ZeroIO™ Snapshot Tiering
  23. 23. Uses Cases: Real-Time Workloads AI/ML analytics and inferencing like fraud detection and social media Latency-sensitive transactional workloads such as trading applications According to IDC, by 2021, 60-70% of the Global 2000 organizations will have at least one mission-critical real- time workload. Below are just a few examples of use cases that are implementing Big Memory now. Real-time big data analytics in financial services, healthcare, and retail
  24. 24. Our mission Open the door to Big Memory A world of abundance, persistence and high availability 25
  25. 25. NetApp and MemVerge: Continued innovation to accelerate business © 2020 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL — Brett Roscoe Vice President of Product Management, HCI May 19, 2020
  26. 26. 27 © 2020 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL — RELENTLESS INNOVATION Over 27 Years of Customer-Focused
  27. 27. © 2020 NetApp, Inc. All rights reserved.28 1993 1st NAS Appliance Snapshots 1996 Network Based Backup Protocol Multiprotocol NAS Appliance NFSv2 AutoSupport 1997 Database Solutions HA NAS 2002 Unified NAS/SAN SnapVault SnapLock NearStore Native Infiniband Direct Access File System (DAFS) 2004 Data ONTAP 7G FlexVol FlexClone Thin Provisioning 2005 MetroCluster SM for SQL NFSv4 FAS3020/3050 w/ATA Decru Acquisition 2006 Scale Out Data ONTAP® GX SnapManager for Oracle FlexShare & MultiStore Kilo Client Lab in RTP (Genesis of FlexPod) 2007 Deduplication for Tier 1 & 2 Rapid RAID Recovery 1992 Write Anywher e File Layout 1999 SnapRestor e SnapMirror 200 0 SnapManage r Exchange 2003 iSCSI V-Series RAID-DP® Data ONTAP 8 Data Motion FlexPod Bycast/StorageGRID Acquisition SSD Aggregates 2010 History of NetApp 2011 Flash Cache II FAS Compression Flash Pool Engenio/E-Series Acquisition Akorri/OCI & OPM Acquisition 2013 EF540 Flash Array UTA NPS for Azure & IBM SoftLayer QoS 2016 Data ONTAP 9 NVMe Inline Data Compaction RAID-TEC FlexGroups Volume Encryption 40GbE & 32Gb FC Trident - Storage Orchestrator for Containers 2015 SolidFire Acquisition Erasure Coding Data Fabric AFF enhancements, In-line zero block dedupe, adaptive compression, deduplication 2017 FabricPool/Cloud Tiering Active IQ Azure NetApp Files NPS for Google Cloud NetApp HCI SaaS Backup for Office 365 Cloud Sync 27 Years of Customer-Focused Storage Innovation 2009 Flash Cache I FCoE Protection Manager File Level FlexClone 2008 PAM SM for VMware, Hyper-V, SharePoint, SAP Onaro/OnCommand Insight Acquisition 2014 FAS2500 FAS8000 All Flash FAS (AFF) StorageGRID WebScale ONTAP Cloud 2012 Clustered Data ONTAP Flash Pool ONTAP Edge NPS for AWS Dynamic Disk Pools 201 8 1st End To End NVMe/FC Host to Flash Array 1st 100GbE connectivity NetApp ONTAP AI w/NVIDIA Azure NetApp Files & CVS for AWS & Google Ansible Modules, Cloud Insights & MAX Data MCC 100GbE IP, 100GbE NVMe/RoCE 2019 200th Flash Patent Second Generation End to End NVMe Array Keystone Subscription/Ownership All SAN Array with Symmetric Active/Active Low End MetroCluster NKS/Trident for HCME Flash Based StorageGrid HCI w/GPUs for AI/VDI NDAS – Cloud Backup/Snapshots CVO for GCP Cloud Insight & CloudSecure ONTAP REST APIs & Revamped System Manager
  28. 28. NetApp’s Innovation Continues into the Public Clouds Only NetApp provides a cloud native shared storage experience on the cloud of your choice​ The #1 Platform for Shared Storage, Modern Workplace, and Continuous Optimization on the cloud of your choice ▪ #1 Platform for SAP Hana with >200 deployments on Azure and Google Cloud Platform​ ▪ #1 platform for WVD Enterprise (deployments >200 users)​ ▪ #1 platform for High Performance Compute​ ▪ Azure NetApp Files (ANF) is faster than block based premium SSD's
  29. 29. NetApp and MemVerge: Continuing our history of innovation The next evolution in innovation in application and data acceleration ▪ NetApp has a long-term industry view ▪ We constantly leverage in-house and industry innovations to accelerate the data we manage and the businesses it drives ▪ The market and competitive transitions are accelerating with COVID-19 ▪ NetApp has been working to accelerate applications that are data centric including AI and machine learning ▪ Near zero latency will drive another round of innovation in data centric applications ▪ MemVerge is bringing lightning-fast, in-memory support of tier 1 applications that promises to deliver another disruption in performance and capabilities RELENTLESS INNOVATION
  30. 30. 31 © 2018 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL — MAAKETERMA KASIH RAIBH MAITH AGAT GRACIAS MULTUMESC MERCI MOCHCHAKKERAM GRAZIE CHOKRANE CHOKRANE MATUR NUWUN MATONDOUA TSAUG RAUKOJ DANK JERAIBH MAITH AGAT SPASIBO MAAKE OBRIGADO WELALINSPASIBO ARIGATOMOCHCHAKKERAM OBRIGADO SPASIBO DANKON MOCHCHAKKERAM KIITOS NIRRINGRAZZJAK MULTUMESC NIRRINGRAZZJAK VINAKA MAMANA DANK JE OBRIGADO GRACIAS MOCHCHAKKERAM UA TSAUG RAU KOJ ASANTE MOCHCHAKKERAMOBRIGADO MERCIRAIBH MAITH AGAT CAM ON BAN SALAMAT MULTUMESC JUSPAXAR CHOKRANE KIAORA OBRIGADO MATONDO KIITOS MOCHCHAKKERAM SALAMAT THANK MERCI YOUMATONDO
  31. 31. Big Memory: Case Study Kevin Tubbs
  32. 32. Deep Learning Recommendation on Persistent Memory Motivation Facebook DLRM DLRM: An advanced, open source deep learning recommendation model https://ai.facebook.com/blog/dlrm-an-advanced-open-source-deep-learning-recommendation-model/
  33. 33. Market Trends • Hardware Abstraction & Workload Driven Architectures • Software Defined Architectures • AI / Machine Learning, Advanced Analytics & Real-time workloads • Workload Portability & Cloud Native Technologies Datacenter and Cloud Scale Computing Embedded Computing Wireless Computing Compute Anywhere – Edge to Core Technology Core Near Edge Far Edge ( Real-time Workloads ) (Advanced Analytics) (AI / ML)
  34. 34. Customer Dynamics Current Trends & Requirements Solution Large model & embedding table size • Model size to GB level, embedding table size to TB level • Multiple models on single server Fast for online inference service • Need be finished in tens of цs Put models and embedding tables into DRAM цs Model Size GB Embedding Table Size TB
  35. 35. Customer Dynamics Limitations Solution High TCO Limited DRAM Space Volatile Models and embedding tables in DRAM + PMEM DRAM PMEM
  36. 36. Case Study: AI / Machine Learning – Facebook’s DLRM Context: • Scalable Model and Data Capabilities • Enterprise Class Data Services • Big Memory Computing Performance Demands ➢ Deep learning recommendation model for personalization and recommendation systems • Consists of dense and sparse features • Dense feature: a vector of floating-point values • Sparse feature: a list of sparse indices into embedding tables • Open source: Background Penguin, MemVerge and Intel Solution Business Challenge: • Dynamic and Scalable Production Inferencing Customer Type: AL / ML Customer
  37. 37. Background Business Challenge: • Dynamic and Scalable Production Inferencing Result: • Customer has state of the art AI/ML Big Memory Platform that is can scale and deliver performance when Data is Greater than Memory • Achieved flexible software defined platform Big Memory Computing capabilities and poised for future dynamic model and data growth Case Study: AI / Machine Learning – Facebook’s DLRM Customer Type: AL / ML Customer Platform: • Innovative Big Memory Computing platform for leveraging persistent memory for real- time, AI/ML and Advanced Analytics and extensible to all memory – Centric workloads. Software: • Software Defined Architecture extracting performance benefits of cutting edge hardware supporting workload portability to truly compute anywhere with the memory speeds. TotalInferenceTime(ms) Penguin, MemVerge and Intel Solution ~400GB swap on NVMe is on, 20480 samples evaluated
  38. 38. • How to improve the fault tolerance of new model publishing? • Pushing new model into production is risky • If failed, revert to last workable version ASAP • Rollback/Model reloading takes time (for large models) due to slow I/O • Leveraging PMEM’s persistence • Take a snapshot of the model serving application • Restore a snapshot without reloading from disk or remote storage • Snapshot can be published to many serving nodes through our fast pub/sub service • Solution • Instantaneous snapshot without interrupting online inference • Instantaneous rollback without loading and publishing time • Snapshot, rollback, and recovery are within 1 second Instant Model Snapshot and Rollback/Recovery for Online Serving Snapshot Rollback Recovery 1 Second
  39. 39. Customer PoV: Where Big Memory Fits Darrell Westbury
  40. 40. Gradients of Memory and Storage Balancing the Cost of Performance and Density Type Approx. Latency Density Scale Relative Cost CPU Registers 1 clock cycle Bytes N/A (within CPU die) CPU Cache L1 Cache 4 clock cycles Kilobytes (210) N/A (within CPU die) L2 Cache 10 clock cycles Kilobytes (210) N/A (within CPU die) L3 Cache 20 clock cycles Megabytes (220) Premium (Special CPU SKU) Main Memory DRAM 100 nanoseconds (10-9) Gigabytes (230) High 3D XPoint 250 nanoseconds (10-9) Gigabytes (230) Medium-High Primary Storage NVMe SSD 150 microseconds (10-6) Terabytes (240) Moderate SAS SSD 500 microseconds (10-6) Terabytes (240) Reasonable SAS HDD 3 milliseconds (10-3) Terabytes (240) Low BETTERPERFORMANCE HIGHERDENSITY LOWERCOST
  41. 41. Big Memory Lakes are now possible Aided by ultra-low latency network such as RDMA and/or PCIe bridging technologies PMEM DRAM Big Memory SW PMEM DRAM PMEM DRAM RDMA Big Memory SW Big Memory SW RDMA Enterprise-Class Data Services MemVerge software enables memory pooling and real- time replication
  42. 42. What’s magical and becomes possible in the near future: Instantaneous snapshots of memory, combined with CXL, will make the dream of dynamically composable infrastructure possible. Pools of Disaggregated Resources Memory bus technologies, such as Intel’s Compute Express Link (CXL) will further reduce inter-server latency
  43. 43. Thank-you Try it Contact andrew.degnan@memverge.com to sign-up for a PoC Download this presentation at: https://www.memverge.com/opening-the-door-to-big-memory/ View this webinar on the MemVerge YouTube Channel https://www.youtube.com/channel/UCLT4fehLcQiW4bfQgrHIlpg/featured
  44. 44. Q&A
  45. 45. What happens in memory stays in memory…

×