This document proposes a software-defined approach called SDPM (Software-Defined Persistent Memory) to abstract the heterogeneity of emerging persistent memory technologies and enable their use across different hardware configurations. It describes SDPM's design goals of supporting various local and remote persistent memory attach points while providing a unified programming model. The proposed architecture introduces a persistent memory manager and a file system to manage data placement and provide memory-like and storage-like access. An evaluation shows the prototype delivering near-optimal performance for local and remote persistent memory configurations.
E’ un’estensione di VMware vCenter che fornisce ai professionisti IT la possibilità di disaster recovery, migrazione di siti e funzionalità di test non distruttive.
Rightsizing Your Silicon Design Environment: Elastic Clusters for EDA Workloa...Amazon Web Services
The static nature of on-premises electronic design automation (EDA) data centers can limit workloads from scaling to meet unforeseen deadlines and aggressive tape-out schedules. The elasticity of the cloud puts virtually unlimited compute capacity at your fingertips and can enable semiconductor companies to quickly scale up in ways they couldn't before, reducing time to market. In this hands-on workshop, you work alongside solutions architects and the AWS internal silicon design infrastructure team to dive deep into scalable architectures for designing chips in the cloud. You deploy an elastic computing cluster that is optimized for EDA workloads and scales dynamically using AWS services. We cover compute, storage, network, security options, and best practices. Within your AWS account, you will retain a silicon design environment running in the cloud. Come prepared to build with a laptop and an existing AWS account. AWS credits will be provided.
The Slide Explains the concepts of Cloud Computing. Covers various definitions of Cloud Computing. Its Models, Types, Advantages, Challenges. A must to understand what is Cloud Computing.
E’ un’estensione di VMware vCenter che fornisce ai professionisti IT la possibilità di disaster recovery, migrazione di siti e funzionalità di test non distruttive.
Rightsizing Your Silicon Design Environment: Elastic Clusters for EDA Workloa...Amazon Web Services
The static nature of on-premises electronic design automation (EDA) data centers can limit workloads from scaling to meet unforeseen deadlines and aggressive tape-out schedules. The elasticity of the cloud puts virtually unlimited compute capacity at your fingertips and can enable semiconductor companies to quickly scale up in ways they couldn't before, reducing time to market. In this hands-on workshop, you work alongside solutions architects and the AWS internal silicon design infrastructure team to dive deep into scalable architectures for designing chips in the cloud. You deploy an elastic computing cluster that is optimized for EDA workloads and scales dynamically using AWS services. We cover compute, storage, network, security options, and best practices. Within your AWS account, you will retain a silicon design environment running in the cloud. Come prepared to build with a laptop and an existing AWS account. AWS credits will be provided.
The Slide Explains the concepts of Cloud Computing. Covers various definitions of Cloud Computing. Its Models, Types, Advantages, Challenges. A must to understand what is Cloud Computing.
Using OPC-UA to Extract IIoT Time Series Data from PLC and SCADA SystemsInfluxData
Algist Bruggeman NV produces yeast for large-scale bakeries and home bakers. The company lacked insight into its fermentation process as its sensor data collection process was manual. Production data was committed to paper, making it difficult to compare batches, aggregate production parameters or detect anomalies.
Factry.IO’s data historian, built on InfluxDB, has helped the company collect process data, enabling it to gain more insight into its production process and provide predictive maintenance.
In this webinar, learn about Algist Bruggeman NV’s business outcomes and the technical setup of linking time series data with ERP, planning and quality data for operational improvement.
What does a typical day as an SRE look like? In this presentation I will discuss the challenges we face while running a SaaS platform that is used 24 / 7 / 365 around the globe. In doing so, we have embraced the core principles described in the Google SRE handbook. While we are not Google by any means, most of the principles apply to our daily work one way or another. Having a fully distributed team running a distributed system can be quite challenging. In this talk I’ll be covering:
- Core SRE principles
- How Instana has applied them to our daily work
- Lessons learned along the way
Dissecting Media Asset Management Architecture and Media Archive TCO (MAE301)...Amazon Web Services
Every M&E migration strategy to AWS requires the customer and partners to design and implement a content ingest workflow. These services vary from simple file transfer to fairly complex workflows that do quality control, proxy creation, and metadata augmentation. In this session, we present a baseline process for moving content into a Media Asset Management system in AWS, leveraging common open-source tools for asset registry and using AWS ML services to augment the metadata associated with assets. We also talk about common considerations that M&E organizations should consider when moving their assets and workflows to the cloud. Topics include metadata input, modeling, storage services and policies, security considerations, and managing increased content demands. We also visit the different storage tiers for different archive use cases and offer a TCO model.
Learn more about the basics of hybrid cloud with VMware Cloud on AWS. Links in slides: http://cloud.vmware.com/govcloud/roadmap
https://cloud.vmware.com/vmc-aws/roadmap
Virtual desktop infrastructure (VDI) is a term used to describe a system that emulates the typical desktop operating environment. VDI allows an individual client to connect to a server and access applications and computing resources as needed, without purchasing and maintaining the hardware required for this set-up. To know more visit Ace Cloud Hosting
Enterprise messaging and IBM MQ is a critical part of any system, this session shows you how MQ is rapidly evolving to meet your needs. Irrespective of your platform or environment, this session introduces many of the updates to MQ in 2019 and 2020, whether that's in administration, building fault tolerant, scalable messaging solutions, or securing your systems.
Basic principles of backup policies by Andrea Mauro, Backup AcademyVeeam Software
In this new Backup Academy video our new professor Andrea Mauro (vExpert) explains in details:
- What is a backup policy
- Design a backup plan
- What defines a backup policy
- Where do backups go
- How will backups be performed
For more sessions and certification exam please visit http://www.backupacademy.com
In this talk, Oded Hareven, Co-Founder & CEO of Akeyless.io, discusses the history of the movement toward best practices in password, token, key, and credential management, including HSMs, KMSs, PAMs, and PKI management. He explores how secrets management is now a MUST for DevOps and security teams of all enterprises and why the right tool needs to be cloud-agnostic, cloud-native, integrable with any DevOps pipelines, and infinitely scalable.
C++ Programming and the Persistent Memory Developers KitIntel® Software
Topics
Introduction to Persistent Memory
Introduction to Persistent Memory Developers Kit (PMDK)
Working with PMDK
Persistent Memory Programming with PMDK C++ Bindings
Using OPC-UA to Extract IIoT Time Series Data from PLC and SCADA SystemsInfluxData
Algist Bruggeman NV produces yeast for large-scale bakeries and home bakers. The company lacked insight into its fermentation process as its sensor data collection process was manual. Production data was committed to paper, making it difficult to compare batches, aggregate production parameters or detect anomalies.
Factry.IO’s data historian, built on InfluxDB, has helped the company collect process data, enabling it to gain more insight into its production process and provide predictive maintenance.
In this webinar, learn about Algist Bruggeman NV’s business outcomes and the technical setup of linking time series data with ERP, planning and quality data for operational improvement.
What does a typical day as an SRE look like? In this presentation I will discuss the challenges we face while running a SaaS platform that is used 24 / 7 / 365 around the globe. In doing so, we have embraced the core principles described in the Google SRE handbook. While we are not Google by any means, most of the principles apply to our daily work one way or another. Having a fully distributed team running a distributed system can be quite challenging. In this talk I’ll be covering:
- Core SRE principles
- How Instana has applied them to our daily work
- Lessons learned along the way
Dissecting Media Asset Management Architecture and Media Archive TCO (MAE301)...Amazon Web Services
Every M&E migration strategy to AWS requires the customer and partners to design and implement a content ingest workflow. These services vary from simple file transfer to fairly complex workflows that do quality control, proxy creation, and metadata augmentation. In this session, we present a baseline process for moving content into a Media Asset Management system in AWS, leveraging common open-source tools for asset registry and using AWS ML services to augment the metadata associated with assets. We also talk about common considerations that M&E organizations should consider when moving their assets and workflows to the cloud. Topics include metadata input, modeling, storage services and policies, security considerations, and managing increased content demands. We also visit the different storage tiers for different archive use cases and offer a TCO model.
Learn more about the basics of hybrid cloud with VMware Cloud on AWS. Links in slides: http://cloud.vmware.com/govcloud/roadmap
https://cloud.vmware.com/vmc-aws/roadmap
Virtual desktop infrastructure (VDI) is a term used to describe a system that emulates the typical desktop operating environment. VDI allows an individual client to connect to a server and access applications and computing resources as needed, without purchasing and maintaining the hardware required for this set-up. To know more visit Ace Cloud Hosting
Enterprise messaging and IBM MQ is a critical part of any system, this session shows you how MQ is rapidly evolving to meet your needs. Irrespective of your platform or environment, this session introduces many of the updates to MQ in 2019 and 2020, whether that's in administration, building fault tolerant, scalable messaging solutions, or securing your systems.
Basic principles of backup policies by Andrea Mauro, Backup AcademyVeeam Software
In this new Backup Academy video our new professor Andrea Mauro (vExpert) explains in details:
- What is a backup policy
- Design a backup plan
- What defines a backup policy
- Where do backups go
- How will backups be performed
For more sessions and certification exam please visit http://www.backupacademy.com
In this talk, Oded Hareven, Co-Founder & CEO of Akeyless.io, discusses the history of the movement toward best practices in password, token, key, and credential management, including HSMs, KMSs, PAMs, and PKI management. He explores how secrets management is now a MUST for DevOps and security teams of all enterprises and why the right tool needs to be cloud-agnostic, cloud-native, integrable with any DevOps pipelines, and infinitely scalable.
C++ Programming and the Persistent Memory Developers KitIntel® Software
Topics
Introduction to Persistent Memory
Introduction to Persistent Memory Developers Kit (PMDK)
Working with PMDK
Persistent Memory Programming with PMDK C++ Bindings
Internet of Things (IoT) data frequently has a location and time component. Getting value out of this "geotemporal" data can be tricky. We'll explore when and how to leverage Cassandra, DSE Search and DSE Analytics to surface meaningful information from your geotemporal data.
Analytics, Big Data and Nonvolatile Memory Architectures – Why you Should Car...StampedeCon
This session will begin with an overview of current non-volatile memory (NVM, aka persistent memory) architectures and its relationship between several levels of memory and storage hierarchy, both near- and far-processor. A discussion on its significant impact on computing analytic workloads now and in the near future will ensue, including use cases and the concept of very large persistent memory surfaces as applied to both analytic computation and storage for big data workflows. The presentation will end with ‘why you should care’ about such technologies which inevitably will completely change the way we think about solving data-intensive problems.
Webinar: OpenEBS - Still Free and now FASTEST Kubernetes storageMayaData Inc
Webinar Session - https://youtu.be/_5MfGMf8PG4
In this webinar, we share how the Container Attached Storage pattern makes performance tuning more tractable, by giving each workload its own storage system, thereby decreasing the variables needed to understand and tune performance.
We then introduce MayaStor, a breakthrough in the use of containers and Kubernetes as a data plane. MayaStor is the first containerized data engine available that delivers near the theoretical maximum performance of underlying systems. MayaStor performance scales with the underlying hardware and has been shown, for example, to deliver in excess of 10 million IOPS in a particular environment.
Heterogeneous Computing : The Future of SystemsAnand Haridass
Charts from NITK-IBM Computer Systems Research Group (NCSRG)
- Dennard Scaling,Moore's Law, OpenPOWER, Storage Class Memory, FPGA, GPU, CAPI, OpenCAPI, nVidia nvlink, Google Microsoft Heterogeneous system usage
Introduction to HPC & Supercomputing in AITyrone Systems
Catch up with our live webinar on Natural Language Processing! Learn about how it works and how it applies to you. We have provided all the information in our video recording you would not miss out on.
Watch the Natural Language Processing webinar here!
High Performance Object Storage in 30 Minutes with Supermicro and MinIORebekah Rodriguez
The Supermicro Cloud DC is the perfect combination of performance, reliability, craftsmanship and flexibility for deploying MinIO object storage. MinIO on the Cloud DC platform outperforms and is more cost-effective than equivalently-sized hardware from other manufacturers. We recently benchmarked a cluster of four Cloud DC servers with NVMe drives and measured an impressive 42.57 GB/s average read (GET) throughput and 24.69 GB/s average write (PUT) throughput. This first class performance demonstrates that MinIO on Supermicro Cloud DC is a compelling solution for object storage intensive workloads such as advanced analytics, AI/ML and other modern, cloud-native applications.
In this webinar, you will learn:
Best use cases and deployment considerations for MinIO object storage
How to design and size a MinIO object storage cluster on Supermicro Cloud DC
How to deploy a distributed MinIO cluster onto a Cloud DC server cluster
Watch the Webinar: https://www.brighttalk.com/webcast/17278/519401
In this deck from DDN booth at SC18, John Bent from DDN presents: IME - Unlocking the Potential of NVMe.
"DDN’s Infinite Memory Engine (IME) is a scale-out, software-defined, flash storage platform that streamlines the data path for application I/O. IME interfaces directly to applications and secures I/O via a data path that eliminates file system bottlenecks. With IME, architects can realize true flash-cache economics with a storage architecture that separates capacity from performance."
Learn more: https://www.ddn.com/products/ime-flash-native-data-cache/
Sign up for our insideHPC Newsletter: http://insidehpc.com/newsletter
Are you ready for NVMe? IBM FlashSystem uses NVMe inside, and is NVMe-ready for use with FCP and Ethernet fabrics. This session explains FC-NVMe and NVMe-OF and how IBM FlashSystem uses NVMe inside.
Similar to Towards Software Defined Persistent Memory (20)
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
JMeter webinar - integration with InfluxDB and GrafanaRTTS
Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application.
In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics.
Length: 30 minutes
Session Overview
-------------------------------------------
During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana:
- What out-of-the-box solutions are available for real-time monitoring JMeter tests?
- What are the benefits of integrating InfluxDB and Grafana into the load testing stack?
- Which features are provided by Grafana?
- Demonstration of InfluxDB and Grafana using a practice web application
To view the webinar recording, go to:
https://www.rttsweb.com/jmeter-integration-webinar
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualityInflectra
In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring.
Learn about:
• The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks.
• Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective.
• Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification.
• Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process.
Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
Towards Software Defined Persistent Memory
1. Towards Software-defined Persistent Memory:
Rethinking Software Support for Heterogeneous Memory Architectures
Swaminathan Sundararaman*
NishaTalagala*
Dhananjoy Das Amar Mudrankit*
Dulcardo Arteaga*
*Work done at Fusion-io/SanDisk
2. CONFIDENTIAL
PARALLEL MACHINES CONFIDENTIAL 2
Memory-Storage Convergence (Trend 1)
L1, L2, L3 CPU Caches DRAM Hard Drives
MicrosecondsNanoseconds
CPU WAIT CYCLES
Tiered Memory Solutions
Main Memory System Storage Systems
Milliseconds
ACCESS DELAY
2 cycles 1,000,000s100s 1,000s 10,000s
chasm
2
Flash
Memory
Persistent
Memories
PM blurs the line between storage and memory
3. CONFIDENTIAL
PARALLEL MACHINES CONFIDENTIAL 3
Challenges with Current Persistent Memory Solutions
Access Granularity Byte (Memory) Block (I/O) Hybrid
Memory Technology PCM
ReRAM/
Memristor
SRAM
(backed by Cap.)
NVDIMM
Capacity 1 - 100s GB 1 - 100s GB 32K – 2GB 4 – 32GB
Local Attach Point PCIe NVMe SAS DDR
Access Mechanism File System Object Store KV Store …
Memory Location Local Remote Replicated
Network Connect Infiniband Ethernet PCIe …
3
Many possible combinations!
4. CONFIDENTIAL
PARALLEL MACHINES CONFIDENTIAL 4
• Rewrite applications for different deployments
▪ Not practical given the number of scenarios
• What about existing applications / deployments?
• User data is constantly growing and needs not fit in persistent
memory
What Should Application Developers Do?
4
5. CONFIDENTIAL
PARALLEL MACHINES CONFIDENTIAL 5
Moving Towards a Software-defined World… (Trend 2)
Software-Defined Networking (SDN)
Enables administrators to manage network services
by abstracting higher level functionality
Abstraction of logical storage services and capabilities
from the underlying physical storage systems
Software-Defined Storage (SDS) Software-Defined Flash (SDF)
Abstract or expose flash specific details to enable software to
realize the raw bandwidth and storage capacity of Flash
Software-Defined Data Center (SDDC)
All elements of the infrastructure such as networking, storage,
CPU and security are virtualized and delivered as a service
5
Abstraction of logical storage services and capabilities from the
underlying physical persistent memory hardware and interconnect
Software-Defined Persistent Memory (SDPM)
6. CONFIDENTIAL
PARALLEL MACHINES CONFIDENTIAL 6
Our SDPM Solution
• The first instance of a software defined approach to PM that can bring
the benefits of PM to a gamut of practical deployments.
• Abstract the heterogeneity in PM hardware from applications
• Provide file system API & programming libraries to access PM
• Use currently available PM hardware to show the feasibility of an
SDPM
▪ PCIe & DDR4 attached PM (both local & remote attach)
▪ Using Infiniband & 10G Ethernet for remote access
• The prototype architecture provides good performance and near
optimal acceleration for a range of local and remote PM configurations
6
8. CONFIDENTIAL
PARALLEL MACHINES CONFIDENTIAL 8
• Support a variety of local and remote attach points with differing
performance but identical functionality and semantic guarantees.
• Enable tiering of data between PM and flash, with caching in DRAM,
to enable different cost/performance configurations
• Support hybrid (i.e., both memory and I/O) access, traditional
storage management, and persistence guarantees to combine the
best of memory and storage worlds.
• Enable a single application programming model to work across a
variety of hardware
SDPM Design Goals
8
9. CONFIDENTIAL
PARALLEL MACHINES CONFIDENTIAL 9
Software Defined Persistent-Memory Architecture
Applications
Programming
Libraries
File System
Persistent Memory
Manager
Block Device
Driver
SDPM
PCIe/
DDR
SAS/
SATA/
NVMe
PM
Infiniband/
Ethernet/
PCIe/…
Memory/
Block (I/O)
• Persistent Memory Manager
▪ Abstracts hardware and interconnect
details from the file system / applications
▪ Exports APIs to guarantee persistence
• File System
▪ Unified persistent namespace to PM &
Flash
▪ Hybrid access to PM
▪ Transparent & non-transparent
acceleration
• Programming Libraries
▪ Unified access APIs to applications
▪ OS bypass for remote access
10. CONFIDENTIAL
PARALLEL MACHINES CONFIDENTIAL 10
• A flash-optimized POSIX compliant Linux file system
▪ Extended NVMFS to support PM in addition to Flash
• Provides a unified and persistent namespace to both PM and flash
▪ Hybrid (memory & I/O) access to PM and applications can switch back and
forth
▪ Transparent application acceleration (by tiering data between PM & flash)
▪ Supports “direct” mmap mode to directly map and use PM without caching in
DRAM
▪ Supports a single programming model via a combination of application specific
libraries over direct mmap and transparent access via POSIX APIs
Non-Volatile Memory File System (NVMFS)
10
11. CONFIDENTIAL
PARALLEL MACHINES CONFIDENTIAL 11
Persistent Memory Manager: Hardware Abstractions
• Memory Mapping Types
▪ PM can be mapped in multiple ways depending on the hardware. We need to
ensure that each memory type is default mapped to the optimal model possible
for its physical attach (by default map it to write combining)
▪ Enable FS operations that allow the app. to control the per file memory mapping.
• Guaranteeing Persistence
▪ We need mechanism(s) to guarantee all acknowledged in-flight data (such as in
CPU caches, registers, etc.) have reached the PM device independent of its
attach point
▪ PMM provides a barrier() operation (to NVMFS and user space libraries) that
guarantees that all data is moved to the persistence domain as needed for the
attach point
11
20. CONFIDENTIAL
PARALLEL MACHINES CONFIDENTIAL
Conclusions
• PM is going to change the storage-memory landscape
• Many different forms / capacities / attach points / performance
• SDPM: a software-defined approach to using persistent memory
• Abstracts heterogeneity in memory hardware
• Applications can transparently run on local & remote persistent memory
• Selectively abstracts PM characteristics to provide optimal performance
• Transparently tier data between PM & Flash to exploit both existing & new
applications written to run on PM.
• Our evaluation shows near optimal performance for local & remote attach PM
20