import rdma: zero-copy networking with RDMA and Python
•Download as ODP, PDF•
3 likes•2,606 views
The document discusses using RDMA (Remote Direct Memory Access) for high performance networking in Python. It describes how traditional sockets involve multiple memory copies that reduce performance. RDMA allows data to be directly placed in the receiving application's memory without intermediate copies. The document outlines an implementation of RDMA sockets in Python, called RdmaSocket, that exposes an interface similar to regular sockets but uses RDMA under the hood. Examples are given showing how it can simplify high performance networking applications in Python.
Report
Share
Report
Share
![Plan ,[object Object]](data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7)
Recommended
Dpdk applications
Here are some useful GDB commands for debugging:
- break <function> - Set a breakpoint at a function
- break <file:line> - Set a breakpoint at a line in a file
- run - Start program execution
- next/n - Step over to next line, stepping over function calls
- step/s - Step into function calls
- finish - Step out of current function
- print/p <variable> - Print value of a variable
- backtrace/bt - Print the call stack
- info breakpoints/ib - List breakpoints
- delete <breakpoint#> - Delete a breakpoint
- layout src - Switch layout to source code view
- layout asm - Switch layout
If AMD Adopted OMI in their EPYC Architecture
AMD's EPYC Architecture has paved the way forward towards Heterogeneous Data Centric Computing, but it is still limited by it's parallel DDR interfaces. This presentation shows the potential for the EPYC architecture if it adopted the Open Memory Interface, OMI, for it's Near Memory interface.
SR-IOV Introduce
This document discusses SR-IOV (Single Root I/O Virtualization), which allows a PCIe device to appear as multiple separate devices. It describes how SR-IOV works by introducing physical functions and virtual functions. It then outlines the steps to enable SR-IOV on a Xen hypervisor, including configuring the network device, enabling virtual functions, binding VFs to the pciback driver, and assigning VFs to guest VMs. Reference links are also provided for additional information on SR-IOV and its implementation in Xen.
Embedded Hypervisor for ARM
Agenda:
(1) Virtualization from The Past
(2) Hypervisor Design
(3) Embedded Hypervisors for ARM
(4) Toward ARM Cortex-A15
Shared Memory Centric Computing with CXL & OMI
Discusses how CXL can be better utilized as a separate Fabric Cache domain to a processors own Local Cache Domain. This is done by leveraging a Shared Memory Centric architectures that utilize both the Open Memory Interface OMI, and Compute eXpress Link, CXL, for the memory ports.
What are latest new features that DPDK brings into 2018?
We will provide an overview of the new features of the latest DPDK release including source code browsing and API listing of top two new features of latest DPDK release. And on top of that, there will be a hands-on lab, on the Intel® microarchitecture servers, to learn how getting started with DPDK will become much simpler and powerful.
SK hynix CXL Disaggregated Memory Solution
During the CXL Forum at OCP Global Summit, memory system architect Jungmin Choi of SK hynix talks about the need for memory bandwidth and capacity, and the SK hynix Niagara solution.
Recommended
Dpdk applications
Here are some useful GDB commands for debugging:
- break <function> - Set a breakpoint at a function
- break <file:line> - Set a breakpoint at a line in a file
- run - Start program execution
- next/n - Step over to next line, stepping over function calls
- step/s - Step into function calls
- finish - Step out of current function
- print/p <variable> - Print value of a variable
- backtrace/bt - Print the call stack
- info breakpoints/ib - List breakpoints
- delete <breakpoint#> - Delete a breakpoint
- layout src - Switch layout to source code view
- layout asm - Switch layout
If AMD Adopted OMI in their EPYC Architecture
AMD's EPYC Architecture has paved the way forward towards Heterogeneous Data Centric Computing, but it is still limited by it's parallel DDR interfaces. This presentation shows the potential for the EPYC architecture if it adopted the Open Memory Interface, OMI, for it's Near Memory interface.
SR-IOV Introduce
This document discusses SR-IOV (Single Root I/O Virtualization), which allows a PCIe device to appear as multiple separate devices. It describes how SR-IOV works by introducing physical functions and virtual functions. It then outlines the steps to enable SR-IOV on a Xen hypervisor, including configuring the network device, enabling virtual functions, binding VFs to the pciback driver, and assigning VFs to guest VMs. Reference links are also provided for additional information on SR-IOV and its implementation in Xen.
Embedded Hypervisor for ARM
Agenda:
(1) Virtualization from The Past
(2) Hypervisor Design
(3) Embedded Hypervisors for ARM
(4) Toward ARM Cortex-A15
Shared Memory Centric Computing with CXL & OMI
Discusses how CXL can be better utilized as a separate Fabric Cache domain to a processors own Local Cache Domain. This is done by leveraging a Shared Memory Centric architectures that utilize both the Open Memory Interface OMI, and Compute eXpress Link, CXL, for the memory ports.
What are latest new features that DPDK brings into 2018?
We will provide an overview of the new features of the latest DPDK release including source code browsing and API listing of top two new features of latest DPDK release. And on top of that, there will be a hands-on lab, on the Intel® microarchitecture servers, to learn how getting started with DPDK will become much simpler and powerful.
SK hynix CXL Disaggregated Memory Solution
During the CXL Forum at OCP Global Summit, memory system architect Jungmin Choi of SK hynix talks about the need for memory bandwidth and capacity, and the SK hynix Niagara solution.
Arm DynamIQ: Intelligent Solutions Using Cluster Based Multiprocessing
DynamIQ is Arm's new cluster-based multiprocessing architecture that allows for heterogeneous processing. It features the DynamIQ Shared Unit that connects CPU cores and manages shared resources like caches. The new Cortex-A75 and Cortex-A55 CPU cores are the first built on DynamIQ. Cortex-A75 provides a significant performance boost while Cortex-A55 improves efficiency. Together they enable scalable solutions from edge to cloud.
Introduction to DPDK
DPDK is a set of drivers and libraries that allow applications to bypass the Linux kernel and access network interface cards directly for very high performance packet processing. It is commonly used for software routers, switches, and other network applications. DPDK can achieve over 11 times higher packet forwarding rates than applications using the Linux kernel network stack alone. While it provides best-in-class performance, DPDK also has disadvantages like reduced security and isolation from standard Linux services.
Static partitioning virtualization on RISC-V
This document summarizes a presentation on static partitioning virtualization for RISC-V. It discusses the motivation for embedded virtualization, an overview of static partitioning hypervisors like Jailhouse and Xen, and the Bao hypervisor. It then provides an overview of the RISC-V hypervisor specification and extensions, including implemented features. It evaluates the performance overhead and interrupt latency of a prototype RISC-V hypervisor implementation with and without interference mitigations like cache partitioning.
DPDK KNI interface
KNI (Kernel Network Interface) is one of the approach, used in DPDK, to connect its user space libs with the Linux kernel network stack.
Network Programming: Data Plane Development Kit (DPDK)
This presentation introduces Data Plane Development Kit overview and basics. It is a part of a Network Programming Series.
First, the presentation focuses on the network performance challenges on the modern systems by comparing modern CPUs with modern 10 Gbps ethernet links. Then it touches memory hierarchy and kernel bottlenecks.
The following part explains the main DPDK techniques, like polling, bursts, hugepages and multicore processing.
DPDK overview explains how is the DPDK application is being initialized and run, touches lockless queues (rte_ring), memory pools (rte_mempool), memory buffers (rte_mbuf), hashes (rte_hash), cuckoo hashing, longest prefix match library (rte_lpm), poll mode drivers (PMDs) and kernel NIC interface (KNI).
At the end, there are few DPDK performance tips.
Tags: access time, burst, cache, dpdk, driver, ethernet, hub, hugepage, ip, kernel, lcore, linux, memory, pmd, polling, rss, softswitch, switch, userspace, xeon
Intel dpdk Tutorial
DPDK greatly improves packet processing performance and throughput by allowing applications to directly access hardware and bypass kernel involvement. It can improve performance by up to 10 times, allowing over 80 Mbps throughput on a single CPU or double that with two CPUs. This enables telecom and networking equipment manufacturers to develop products faster and with lower costs. DPDK achieves these gains through techniques like dedicated core affinity, userspace drivers, polling instead of interrupts, and lockless synchronization.
DPDK In Depth
DPDK in depth
This document provides an overview of DPDK (Data Plane Development Kit):
1. DPDK is an open source project for data plane programming and network acceleration. It started at Intel in 2010 and is now maintained by the Linux Foundation.
2. DPDK provides poll mode drivers (PMDs), libraries, and sample applications for fast packet processing. It uses hugepages and avoids kernel involvement for high performance.
3. The document outlines several DPDK projects, libraries, PMDs, advantages and disadvantages, development process, and demonstrates a simple DPDK application (l2fwd) and the testpmd tool.
DPDK in Containers Hands-on Lab
This document provides an agenda and overview for a hands-on lab on using DPDK in containers. It introduces Linux containers and how they use fewer system resources than VMs. It discusses how containers still use the kernel network stack, which is not ideal for SDN/NFV usages, and how DPDK can be used in containers to address this. The hands-on lab section guides users through building DPDK and Open vSwitch, configuring them to work with containers, and running packet generation and forwarding using testpmd and pktgen Docker containers connected via Open vSwitch.
Micron: Memory Expansion with CXL Modules: Benefits, Use Cases and Enriching ...
During the CXL Forum at OCP Global Summit, Poorna Kale of Micron describe the company's CXL memory expansion modules and their use cases
03_03_Implementing_PCIe_ATS_in_ARM-based_SoCs_Final
The document discusses implementing PCIe Address Translation Services (ATS) in ARM-based systems-on-chips (SoCs). It describes an example ARM server system with various components like CPUs, memory controllers, and I/O devices. It then explains how ATS works to improve memory access performance by allowing devices to cache address translations locally instead of relying solely on the IOMMU. The document outlines the typical components involved in ATS like the address translation cache, translating agent, and address translation protection table. It also describes how the ARM System MMU (SMMU) implements ATS and supports distributed address translation caching by endpoints.
Decoupling Compute from Memory, Storage and IO with OMI
Redefining Computing Architecture from a Data Centric Perspective with easily distributable Heterogeneous Compute Resources.
05.2 virtio introduction
The document discusses Virtio, an interface for virtualized I/O devices. It introduces Virtio's architecture, which involves Virtqueues and Vrings to facilitate communication between guest drivers and hypervisor-level device emulators. It outlines the five Virtio APIs for adding, kicking, getting buffers and enabling/disabling callbacks. It also provides an overview of steps for adding new Virtio devices and drivers.
Notes on NUMA architecture
The document discusses NUMA (Non-Uniform Memory Access) architecture and optimization. With NUMA, memory is divided across multiple nodes and latency depends on memory location. Local memory has the lowest latency while remote memory has higher latency. The document provides examples of local and remote memory access and discusses how process-parallel and shared-memory threading applications are affected by NUMA. It also covers NUMA-aware operating system differences, techniques for process affinity, and NUMA optimization strategies like minimizing remote memory access.
Reliability, Availability and Serviceability on Linux
Linux Kernel Multmedia Subsystem maintainer and Samsung OSG team member Mauro Chehab presents his thoughts on how to apply RAS to Linux platforms.
FD.IO Vector Packet Processing
Kirill Tsym discusses Vector Packet Processing:
* Linux Kernel data path (in short), initial design, today's situation, optimization initiatives
* Brief overview of DPDK, Netmap, etc.
* Userspace Networking projects comparison: OpenFastPath, OpenSwitch, VPP.
* Introduction to VPP: architecture, capabilities and optimization techniques.
* Basic Data Flow and introduction to vectors.
* VPP Single and Multi-thread modes.
* Router and switch for namespaces example.
* VPP L4 protocol processing - Transport Layer Development Kit.
* VPP Plugins.
Kiril is a software developer at Check Point Software Technologies, part of Next Generation Gateway and Architecture team, developing proof of concept around DPDK and FD.IO VPP. He has years of experience in software, Linux kernel and networking development and has worked for Polycom, Broadcom and Qualcomm before joining Check Point.
MemVerge: The Software Stack for CXL Environments
During the CXL Forum at OCP Global Summit, MemVerge software architect Steve Scargall defines the CXL software stack and where the development is being done.
DPDK & Layer 4 Packet Processing
Learn about Transport Layer Development Kit and let us accelerate beyond the Layer 2/Layer 3.
Author: Muthurajan (M Jay) Jayakumar
Introduction to parallel computing using CUDA
Supercomputers in our lab
CUDA - history, api, gpu vs cpu, etc.
Practical examples
Thanks to Nvidia for the pictures
Mixed-critical adaptive AUTOSAR stack based on VxWorks, Linux, and virtualiza...
Since the first release of its standard in 2003, AUTOSAR has established itself as one of the primary software development standards for the global automotive industry. As the automotive industry is a now undergoing one of the significant changes in its history toward autonomous driving, connectivity and electrification new standards are needed to handle the complexity regarding software architecture for controlling the high-end processors, Ethernet communication, and over-the-air updates in the cloud-connected automobiles. The recent advent of the Adaptive AUTOSAR standard can help accommodate the extensive and complex requirements of autonomous driving by enabling a flexible, dynamic, and service based platform while still maintaining the integrity of high degree of functional safety standards and also properly engaging with established platforms. The standard itself replies on some technologies which are already established in the industry such as virtualization, POSIX PSE51, C++11/14 for application development, ISO26262/ASIL compliance, etc.
This presentation provides example of an implementation of mixed critical Adaptive AUTOSAR stack based on VxWorks RTOS, embedded Linux, and virtualization profile from Wind River. As one of the very few solutions available on the market which is already fulfilling the requirements described above, VxWorks is a strong example of a foundational software platform for Adaptive AUTOSAR-based autonomous driving development. We will also explain what challenges we have encounter with during this process and make some suggestions to the AUTOSAR consortium of how to overcome them in the future.
Revisit DCA, PCIe TPH and DDIO
This document discusses techniques for improving CPU access to data from IO devices, including Direct Cache Access (DCA), PCIe Transaction Layer Processing Hints (TPH), and Data Direct I/O (DDIO). DCA allows the CPU to access cache data from IO devices to avoid memory access, but requires driver intervention. PCIe TPH and DDIO aim to prefetch or retain IO write data in the cache without driver involvement. DDIO is specific to Intel platforms and accelerates local socket performance, while DCA does not differentiate sockets. The document provides details on how each technique functions and references further reading.
10 things i wish i'd known before using spark in production
Vous avez récemment commencé à travailler sur Spark et vos jobs prennent une éternité pour se terminer ? Cette présentation est faite pour vous.
Himanshu Arora et Nitya Nand YADAV ont rassemblé de nombreuses bonnes pratiques, optimisations et ajustements qu'ils ont appliqué au fil des années en production pour rendre leurs jobs plus rapides et moins consommateurs de ressources.
Dans cette présentation, ils nous apprennent les techniques avancées d'optimisation de Spark, les formats de sérialisation des données, les formats de stockage, les optimisations hardware, contrôle sur la parallélisme, paramétrages de resource manager, meilleur data localité et l'optimisation du GC etc.
Ils nous font découvrir également l'utilisation appropriée de RDD, DataFrame et Dataset afin de bénéficier pleinement des optimisations internes apportées par Spark.
Optimizing Servers for High-Throughput and Low-Latency at Dropbox
I'm going to discuss the efficiency/performance optimizations of different layers of the system. Starting from the lowest levels like hardware and drivers: these tunings can be applied to pretty much any high-load server. Then we’ll move to Linux kernel and its TCP/IP stack: these are the knobs you want to try on any of your TCP-heavy boxes. Finally, we’ll discuss library and application-level tunings, which are mostly applicable to HTTP servers in general and nginx/envoy specifically.
For each potential area of optimization I’ll try to give some background on latency/throughput tradeoffs (if any), monitoring guidelines, and, finally, suggest tunings for different workloads.
Also, I'll cover more theoretical approaches to performance analysis and the newly developed tooling like `bpftrace` and new `perf` features.
More Related Content
What's hot
Arm DynamIQ: Intelligent Solutions Using Cluster Based Multiprocessing
DynamIQ is Arm's new cluster-based multiprocessing architecture that allows for heterogeneous processing. It features the DynamIQ Shared Unit that connects CPU cores and manages shared resources like caches. The new Cortex-A75 and Cortex-A55 CPU cores are the first built on DynamIQ. Cortex-A75 provides a significant performance boost while Cortex-A55 improves efficiency. Together they enable scalable solutions from edge to cloud.
Introduction to DPDK
DPDK is a set of drivers and libraries that allow applications to bypass the Linux kernel and access network interface cards directly for very high performance packet processing. It is commonly used for software routers, switches, and other network applications. DPDK can achieve over 11 times higher packet forwarding rates than applications using the Linux kernel network stack alone. While it provides best-in-class performance, DPDK also has disadvantages like reduced security and isolation from standard Linux services.
Static partitioning virtualization on RISC-V
This document summarizes a presentation on static partitioning virtualization for RISC-V. It discusses the motivation for embedded virtualization, an overview of static partitioning hypervisors like Jailhouse and Xen, and the Bao hypervisor. It then provides an overview of the RISC-V hypervisor specification and extensions, including implemented features. It evaluates the performance overhead and interrupt latency of a prototype RISC-V hypervisor implementation with and without interference mitigations like cache partitioning.
DPDK KNI interface
KNI (Kernel Network Interface) is one of the approach, used in DPDK, to connect its user space libs with the Linux kernel network stack.
Network Programming: Data Plane Development Kit (DPDK)
This presentation introduces Data Plane Development Kit overview and basics. It is a part of a Network Programming Series.
First, the presentation focuses on the network performance challenges on the modern systems by comparing modern CPUs with modern 10 Gbps ethernet links. Then it touches memory hierarchy and kernel bottlenecks.
The following part explains the main DPDK techniques, like polling, bursts, hugepages and multicore processing.
DPDK overview explains how is the DPDK application is being initialized and run, touches lockless queues (rte_ring), memory pools (rte_mempool), memory buffers (rte_mbuf), hashes (rte_hash), cuckoo hashing, longest prefix match library (rte_lpm), poll mode drivers (PMDs) and kernel NIC interface (KNI).
At the end, there are few DPDK performance tips.
Tags: access time, burst, cache, dpdk, driver, ethernet, hub, hugepage, ip, kernel, lcore, linux, memory, pmd, polling, rss, softswitch, switch, userspace, xeon
Intel dpdk Tutorial
DPDK greatly improves packet processing performance and throughput by allowing applications to directly access hardware and bypass kernel involvement. It can improve performance by up to 10 times, allowing over 80 Mbps throughput on a single CPU or double that with two CPUs. This enables telecom and networking equipment manufacturers to develop products faster and with lower costs. DPDK achieves these gains through techniques like dedicated core affinity, userspace drivers, polling instead of interrupts, and lockless synchronization.
DPDK In Depth
DPDK in depth
This document provides an overview of DPDK (Data Plane Development Kit):
1. DPDK is an open source project for data plane programming and network acceleration. It started at Intel in 2010 and is now maintained by the Linux Foundation.
2. DPDK provides poll mode drivers (PMDs), libraries, and sample applications for fast packet processing. It uses hugepages and avoids kernel involvement for high performance.
3. The document outlines several DPDK projects, libraries, PMDs, advantages and disadvantages, development process, and demonstrates a simple DPDK application (l2fwd) and the testpmd tool.
DPDK in Containers Hands-on Lab
This document provides an agenda and overview for a hands-on lab on using DPDK in containers. It introduces Linux containers and how they use fewer system resources than VMs. It discusses how containers still use the kernel network stack, which is not ideal for SDN/NFV usages, and how DPDK can be used in containers to address this. The hands-on lab section guides users through building DPDK and Open vSwitch, configuring them to work with containers, and running packet generation and forwarding using testpmd and pktgen Docker containers connected via Open vSwitch.
Micron: Memory Expansion with CXL Modules: Benefits, Use Cases and Enriching ...
During the CXL Forum at OCP Global Summit, Poorna Kale of Micron describe the company's CXL memory expansion modules and their use cases
03_03_Implementing_PCIe_ATS_in_ARM-based_SoCs_Final
The document discusses implementing PCIe Address Translation Services (ATS) in ARM-based systems-on-chips (SoCs). It describes an example ARM server system with various components like CPUs, memory controllers, and I/O devices. It then explains how ATS works to improve memory access performance by allowing devices to cache address translations locally instead of relying solely on the IOMMU. The document outlines the typical components involved in ATS like the address translation cache, translating agent, and address translation protection table. It also describes how the ARM System MMU (SMMU) implements ATS and supports distributed address translation caching by endpoints.
Decoupling Compute from Memory, Storage and IO with OMI
Redefining Computing Architecture from a Data Centric Perspective with easily distributable Heterogeneous Compute Resources.
05.2 virtio introduction
The document discusses Virtio, an interface for virtualized I/O devices. It introduces Virtio's architecture, which involves Virtqueues and Vrings to facilitate communication between guest drivers and hypervisor-level device emulators. It outlines the five Virtio APIs for adding, kicking, getting buffers and enabling/disabling callbacks. It also provides an overview of steps for adding new Virtio devices and drivers.
Notes on NUMA architecture
The document discusses NUMA (Non-Uniform Memory Access) architecture and optimization. With NUMA, memory is divided across multiple nodes and latency depends on memory location. Local memory has the lowest latency while remote memory has higher latency. The document provides examples of local and remote memory access and discusses how process-parallel and shared-memory threading applications are affected by NUMA. It also covers NUMA-aware operating system differences, techniques for process affinity, and NUMA optimization strategies like minimizing remote memory access.
Reliability, Availability and Serviceability on Linux
Linux Kernel Multmedia Subsystem maintainer and Samsung OSG team member Mauro Chehab presents his thoughts on how to apply RAS to Linux platforms.
FD.IO Vector Packet Processing
Kirill Tsym discusses Vector Packet Processing:
* Linux Kernel data path (in short), initial design, today's situation, optimization initiatives
* Brief overview of DPDK, Netmap, etc.
* Userspace Networking projects comparison: OpenFastPath, OpenSwitch, VPP.
* Introduction to VPP: architecture, capabilities and optimization techniques.
* Basic Data Flow and introduction to vectors.
* VPP Single and Multi-thread modes.
* Router and switch for namespaces example.
* VPP L4 protocol processing - Transport Layer Development Kit.
* VPP Plugins.
Kiril is a software developer at Check Point Software Technologies, part of Next Generation Gateway and Architecture team, developing proof of concept around DPDK and FD.IO VPP. He has years of experience in software, Linux kernel and networking development and has worked for Polycom, Broadcom and Qualcomm before joining Check Point.
MemVerge: The Software Stack for CXL Environments
During the CXL Forum at OCP Global Summit, MemVerge software architect Steve Scargall defines the CXL software stack and where the development is being done.
DPDK & Layer 4 Packet Processing
Learn about Transport Layer Development Kit and let us accelerate beyond the Layer 2/Layer 3.
Author: Muthurajan (M Jay) Jayakumar
Introduction to parallel computing using CUDA
Supercomputers in our lab
CUDA - history, api, gpu vs cpu, etc.
Practical examples
Thanks to Nvidia for the pictures
Mixed-critical adaptive AUTOSAR stack based on VxWorks, Linux, and virtualiza...
Since the first release of its standard in 2003, AUTOSAR has established itself as one of the primary software development standards for the global automotive industry. As the automotive industry is a now undergoing one of the significant changes in its history toward autonomous driving, connectivity and electrification new standards are needed to handle the complexity regarding software architecture for controlling the high-end processors, Ethernet communication, and over-the-air updates in the cloud-connected automobiles. The recent advent of the Adaptive AUTOSAR standard can help accommodate the extensive and complex requirements of autonomous driving by enabling a flexible, dynamic, and service based platform while still maintaining the integrity of high degree of functional safety standards and also properly engaging with established platforms. The standard itself replies on some technologies which are already established in the industry such as virtualization, POSIX PSE51, C++11/14 for application development, ISO26262/ASIL compliance, etc.
This presentation provides example of an implementation of mixed critical Adaptive AUTOSAR stack based on VxWorks RTOS, embedded Linux, and virtualization profile from Wind River. As one of the very few solutions available on the market which is already fulfilling the requirements described above, VxWorks is a strong example of a foundational software platform for Adaptive AUTOSAR-based autonomous driving development. We will also explain what challenges we have encounter with during this process and make some suggestions to the AUTOSAR consortium of how to overcome them in the future.
Revisit DCA, PCIe TPH and DDIO
This document discusses techniques for improving CPU access to data from IO devices, including Direct Cache Access (DCA), PCIe Transaction Layer Processing Hints (TPH), and Data Direct I/O (DDIO). DCA allows the CPU to access cache data from IO devices to avoid memory access, but requires driver intervention. PCIe TPH and DDIO aim to prefetch or retain IO write data in the cache without driver involvement. DDIO is specific to Intel platforms and accelerates local socket performance, while DCA does not differentiate sockets. The document provides details on how each technique functions and references further reading.
What's hot (20)
Arm DynamIQ: Intelligent Solutions Using Cluster Based Multiprocessing
Arm DynamIQ: Intelligent Solutions Using Cluster Based Multiprocessing
Network Programming: Data Plane Development Kit (DPDK)
Network Programming: Data Plane Development Kit (DPDK)
Micron: Memory Expansion with CXL Modules: Benefits, Use Cases and Enriching ...
Micron: Memory Expansion with CXL Modules: Benefits, Use Cases and Enriching ...
03_03_Implementing_PCIe_ATS_in_ARM-based_SoCs_Final
03_03_Implementing_PCIe_ATS_in_ARM-based_SoCs_Final
Decoupling Compute from Memory, Storage and IO with OMI
Decoupling Compute from Memory, Storage and IO with OMI
Reliability, Availability and Serviceability on Linux
Reliability, Availability and Serviceability on Linux
Mixed-critical adaptive AUTOSAR stack based on VxWorks, Linux, and virtualiza...
Mixed-critical adaptive AUTOSAR stack based on VxWorks, Linux, and virtualiza...
Similar to import rdma: zero-copy networking with RDMA and Python
10 things i wish i'd known before using spark in production
Vous avez récemment commencé à travailler sur Spark et vos jobs prennent une éternité pour se terminer ? Cette présentation est faite pour vous.
Himanshu Arora et Nitya Nand YADAV ont rassemblé de nombreuses bonnes pratiques, optimisations et ajustements qu'ils ont appliqué au fil des années en production pour rendre leurs jobs plus rapides et moins consommateurs de ressources.
Dans cette présentation, ils nous apprennent les techniques avancées d'optimisation de Spark, les formats de sérialisation des données, les formats de stockage, les optimisations hardware, contrôle sur la parallélisme, paramétrages de resource manager, meilleur data localité et l'optimisation du GC etc.
Ils nous font découvrir également l'utilisation appropriée de RDD, DataFrame et Dataset afin de bénéficier pleinement des optimisations internes apportées par Spark.
Optimizing Servers for High-Throughput and Low-Latency at Dropbox
I'm going to discuss the efficiency/performance optimizations of different layers of the system. Starting from the lowest levels like hardware and drivers: these tunings can be applied to pretty much any high-load server. Then we’ll move to Linux kernel and its TCP/IP stack: these are the knobs you want to try on any of your TCP-heavy boxes. Finally, we’ll discuss library and application-level tunings, which are mostly applicable to HTTP servers in general and nginx/envoy specifically.
For each potential area of optimization I’ll try to give some background on latency/throughput tradeoffs (if any), monitoring guidelines, and, finally, suggest tunings for different workloads.
Also, I'll cover more theoretical approaches to performance analysis and the newly developed tooling like `bpftrace` and new `perf` features.
Stress your DUT
Using open source tools for network device dataplane testing.
Our experiences from redGuardian DDoS mitigation scrubber testing.
Presented at PLNOG 20 (2018).
PLNOG20 - Paweł Małachowski - Stress your DUT–wykorzystanie narzędzi open sou...
Wybór docelowej platformy sieciowej (np. routera, firewalla, scrubbera DDoS) jest często poprzedzony jej testami. Jednym z celów testów jest sprawdzenie, czy parametry wydajnościowe deklarowane przez producenta odpowiadają rzeczywistości. Zespół rozwijający redGuardian Anty DDoS testuje rozwiązanie regresyjnie i wydajnościowo w sposób zautomatyzowany od początku jego istnienia. W czasie prezentacji przeanalizujemy aspekty, na które warto zwrócić uwagę w czasie testów wydajnościowych urządzeń IP oraz przyjrzymy się narzędziom open source pomocnym w realizacji tego zadania.
Using GPUs to handle Big Data with Java by Adam Roberts.
Modern graphics processing units (GPUs) are efficient general-purpose stream processors. Learn how Java can exploit the power of GPUs to optimize high-performance enterprise and technical computing applications such as big data and analytics workloads. This presentation covers principles and considerations for GPU programming from Java and looks at the software stack and developer tools available. It also presents a demo showing GPU acceleration and discusses what is coming in the future.
Varnish http accelerator
The Varnish Roadshow is a performance focused presentation on Varnish, an open source HTTP accelerator. It discusses how Varnish was created to address the shortcomings of traditional caching solutions like Squid that do not take advantage of modern computing architectures. Varnish uses a custom configuration language called VCL, has a split manager/worker process design for high performance, and provides real-time statistics and management via shared memory and command line tools.
The New Systems Performance
A brief talk on systems performance for the July 2013 meetup "A Midsummer Night's System", video: http://www.youtube.com/watch?v=P3SGzykDE4Q. This summarizes how systems performance has changed from the 1990's to today. This was the reason for writing a new book on systems performance, to provide a reference that is up to date, covering new tools, technologies, and methodologies.
Offloading for Databases - Deep Dive
A deep five into offloading techniques for Oracle database servers, that takes both hardware and software solution into consideration. The focus is clearly to boost the efficiency of your already paid licenses.
Tcpdump
This document provides an overview of TCPDUMP including:
- Introducing TCPDUMP as a command line network packet analyzer that comes pre-installed on Unix systems.
- Explaining how to decipher data packets captured by TCPDUMP.
- Detailing basic and intermediate TCPDUMP command line options and usage including filtering, reading from and writing to files.
- Outlining steps for network hacking techniques like footprinting, scanning, and DDoS attacks.
D. Fast, Simple User-Space Network Functions with Snabb (RIPE 77)
By Andy Wingo.
Snabb is an open-source toolkit for building fast, flexible network functions. Since its beginnings in 2012, Snabb has seen some modest deployment success ranging from simple one-off diagnosis tools to border routers that process all IPv4 traffic for entire countries. This talk will give an introduction to Snabb. After going over Snabb's fundamental components and how they combine, the talk will move on to examples of how network engineers are taking advantage of Snabb in practice, mentioning a few of the many open-source network functions built on Snabb.
(c) RIPE 77
15 - 19 October 2018
Amsterdam, Netherlands
https://ripe77.ripe.net
Caching and tuning fun for high scalability
Caching has been a 'hot' topic for a few years. But caching takes more than merely taking data and putting it in a cache : the right caching techniques can improve performance and reduce load significantly. But we'll also look at some major pitfalls, showing that caching the wrong way can bring down your site. If you're looking for a clear explanation about various caching techniques and tools like Memcached, Nginx and Varnish, as well as ways to deploy them in an efficient way, this talk is for you.
RAPIDS Overview
The RAPIDS suite of software libraries gives you the freedom to execute end-to-end data science and analytics pipelines entirely on GPUs. It relies on NVIDIA® CUDA® primitives for low-level compute optimization, but exposes that GPU parallelism and high-bandwidth memory speed through user-friendly Python interfaces.
RAPIDS – Open GPU-accelerated Data Science
RAPIDS – Open GPU-accelerated Data Science
RAPIDS is an initiative driven by NVIDIA to accelerate the complete end-to-end data science ecosystem with GPUs. It consists of several open source projects that expose familiar interfaces making it easy to accelerate the entire data science pipeline- from the ETL and data wrangling to feature engineering, statistical modeling, machine learning, and graph analysis.
Corey J. Nolet
Corey has a passion for understanding the world through the analysis of data. He is a developer on the RAPIDS open source project focused on accelerating machine learning algorithms with GPUs.
Adam Thompson
Adam Thompson is a Senior Solutions Architect at NVIDIA. With a background in signal processing, he has spent his career participating in and leading programs focused on deep learning for RF classification, data compression, high-performance computing, and managing and designing applications targeting large collection frameworks. His research interests include deep learning, high-performance computing, systems engineering, cloud architecture/integration, and statistical signal processing. He holds a Masters degree in Electrical & Computer Engineering from Georgia Tech and a Bachelors from Clemson University.
LinuxCon2009: 10Gbit/s Bi-Directional Routing on standard hardware running Linux
This talk my 2009 updates on the progress of doing 10Gbit/s routing on standard hardware running Linux. The results are good, BUT to achieve these results, a lot of tuning is required of hardware queues, MSI interrupts and SMP affinity, together with some (now) submitted patches. I\'ll explain the concept of network hardware queues and why interrupt and SMP tuning is essential. I\'ll present results from different hardware both 10GbE netcards and CPUs (current CPUs under test is AMD phenom and Core i7). Many future challenges still exists, especially in the area of more easy tuning. A high knowledge level about the Linux kernel is required to follow all the details.
Troubleshooting real production problems
1. The document discusses various steps and tools for troubleshooting real production problems related to CPU spikes, thread dumps, memory leaks, and garbage collection issues.
2. It provides guidance on using tools like 'top', 'jstack', 'jmap', 'jcmd', Eclipse MAT and HeapHero to analyze thread dumps, capture heap dumps, and diagnose memory leaks.
3. The document also emphasizes the importance of enabling GC logs and capturing the right system metrics like thread states, file descriptors, and GC throughput to detect problems early.
Learning spark ch10 - Spark Streaming
This chapter discusses Spark Streaming and provides an overview of its key concepts. It describes the architecture and abstractions in Spark Streaming including transformations on data streams. It also covers input sources, output operations, fault tolerance mechanisms, and performance considerations for Spark Streaming applications. The chapter concludes by noting how knowledge from Spark can be applied to streaming and real-time applications.
20170602_OSSummit_an_intelligent_storage
Slides at Open Source Summit Japan 2017 - Brief introduction of SSD-to-GPU Direct SQL Execution and its future.
High Availability With DRBD & Heartbeat
This document discusses using DRBD (Distributed Replicated Block Device) and Heartbeat to provide high availability for services like MySQL, Apache, Samba and others. It provides an overview of how DRBD works to replicate data in real-time across two nodes, and how Heartbeat is used to monitor the nodes and trigger failover of services if one node fails. The document shares the author's specific configuration and setup using these tools on two Linux servers connected by a crossover cable, and demonstrates DRBD and failover in action.
Apidays Paris 2023 - Forget TypeScript, Choose Rust to build Robust, Fast and...
Apidays Paris 2023 - Software and APIs for Smart, Sustainable and Sovereign Societies
December 6, 7 & 8, 2023
Forget TypeScript, Choose Rust to build Robust, Fast and Cheap APIs
Zacaria Chtatar, Backend Software Engineer at HaveSomeCode
------
Check out our conferences at https://www.apidays.global/
Do you want to sponsor or talk at one of our conferences?
https://apidays.typeform.com/to/ILJeAaV8
Learn more on APIscene, the global media made by the community for the community:
https://www.apiscene.io
Explore the API ecosystem with the API Landscape:
https://apilandscape.apiscene.io/
Node js meetup
This document provides an overview of Node.js including its history, key features, and common questions. Node.js is a JavaScript runtime environment for building server-side and networking applications. It is based on Google's V8 JavaScript engine and uses an event-driven, non-blocking I/O model that makes it lightweight and efficient, especially for real-time applications that require high throughput and scalability. The Node.js package ecosystem and large developer community help make it a full-stack JavaScript platform for building fast and scalable network applications.
Similar to import rdma: zero-copy networking with RDMA and Python (20)
10 things i wish i'd known before using spark in production
10 things i wish i'd known before using spark in production
Optimizing Servers for High-Throughput and Low-Latency at Dropbox
Optimizing Servers for High-Throughput and Low-Latency at Dropbox
PLNOG20 - Paweł Małachowski - Stress your DUT–wykorzystanie narzędzi open sou...
PLNOG20 - Paweł Małachowski - Stress your DUT–wykorzystanie narzędzi open sou...
Using GPUs to handle Big Data with Java by Adam Roberts.
Using GPUs to handle Big Data with Java by Adam Roberts.
D. Fast, Simple User-Space Network Functions with Snabb (RIPE 77)
D. Fast, Simple User-Space Network Functions with Snabb (RIPE 77)
LinuxCon2009: 10Gbit/s Bi-Directional Routing on standard hardware running Linux
LinuxCon2009: 10Gbit/s Bi-Directional Routing on standard hardware running Linux
Apidays Paris 2023 - Forget TypeScript, Choose Rust to build Robust, Fast and...
Apidays Paris 2023 - Forget TypeScript, Choose Rust to build Robust, Fast and...
Recently uploaded
Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...
Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...Pitangent Analytics & Technology Solutions Pvt. Ltd
Discover top-tier mobile app development services, offering innovative solutions for iOS and Android. Enhance your business with custom, user-friendly mobile applications.Skybuffer SAM4U tool for SAP license adoption
Manage and optimize your license adoption and consumption with SAM4U, an SAP free customer software asset management tool.
SAM4U, an SAP complimentary software asset management tool for customers, delivers a detailed and well-structured overview of license inventory and usage with a user-friendly interface. We offer a hosted, cost-effective, and performance-optimized SAM4U setup in the Skybuffer Cloud environment. You retain ownership of the system and data, while we manage the ABAP 7.58 infrastructure, ensuring fixed Total Cost of Ownership (TCO) and exceptional services through the SAP Fiori interface.
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Simplify your search for a reliable Python development partner! This list presents the top 10 trusted US providers offering comprehensive Python development services, ensuring your project's success from conception to completion.
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks creates AI-boosted business software that helps employees work more efficiently and effectively. Managing data across multiple RDBMS and NoSQL databases was already a challenge at their current scale. To prepare for 10X growth, they knew it was time to rethink their database strategy. Learn how they architected a solution that would simplify scaling while keeping costs under control.
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
A Mix Chart displays historical data of numbers in a graphical or tabular form. The Kalyan Rajdhani Mix Chart specifically shows the results of a sequence of numbers over different periods.
June Patch Tuesday
Ivanti’s Patch Tuesday breakdown goes beyond patching your applications and brings you the intelligence and guidance needed to prioritize where to focus your attention first. Catch early analysis on our Ivanti blog, then join industry expert Chris Goettl for the Patch Tuesday Webinar Event. There we’ll do a deep dive into each of the bulletins and give guidance on the risks associated with the newly-identified vulnerabilities.
Mutation Testing for Task-Oriented Chatbots
Conversational agents, or chatbots, are increasingly used to access all sorts of services using natural language. While open-domain chatbots - like ChatGPT - can converse on any topic, task-oriented chatbots - the focus of this paper - are designed for specific tasks, like booking a flight, obtaining customer support, or setting an appointment. Like any other software, task-oriented chatbots need to be properly tested, usually by defining and executing test scenarios (i.e., sequences of user-chatbot interactions). However, there is currently a lack of methods to quantify the completeness and strength of such test scenarios, which can lead to low-quality tests, and hence to buggy chatbots.
To fill this gap, we propose adapting mutation testing (MuT) for task-oriented chatbots. To this end, we introduce a set of mutation operators that emulate faults in chatbot designs, an architecture that enables MuT on chatbots built using heterogeneous technologies, and a practical realisation as an Eclipse plugin. Moreover, we evaluate the applicability, effectiveness and efficiency of our approach on open-source chatbots, with promising results.
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays, June 2024 with Maria Copot 20
Taking AI to the Next Level in Manufacturing.pdf
Read Taking AI to the Next Level in Manufacturing to gain insights on AI adoption in the manufacturing industry, such as:
1. How quickly AI is being implemented in manufacturing.
2. Which barriers stand in the way of AI adoption.
3. How data quality and governance form the backbone of AI.
4. Organizational processes and structures that may inhibit effective AI adoption.
6. Ideas and approaches to help build your organization's AI strategy.
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
AppSec PNW: Android and iOS Application Security with MobSF
Mobile Security Framework - MobSF is a free and open source automated mobile application security testing environment designed to help security engineers, researchers, developers, and penetration testers to identify security vulnerabilities, malicious behaviours and privacy concerns in mobile applications using static and dynamic analysis. It supports all the popular mobile application binaries and source code formats built for Android and iOS devices. In addition to automated security assessment, it also offers an interactive testing environment to build and execute scenario based test/fuzz cases against the application.
This talk covers:
Using MobSF for static analysis of mobile applications.
Interactive dynamic security assessment of Android and iOS applications.
Solving Mobile app CTF challenges.
Reverse engineering and runtime analysis of Mobile malware.
How to shift left and integrate MobSF/mobsfscan SAST and DAST in your build pipeline.
Fueling AI with Great Data with Airbyte Webinar
This talk will focus on how to collect data from a variety of sources, leveraging this data for RAG and other GenAI use cases, and finally charting your course to productionalization.
Artificial Intelligence and Electronic Warfare
Artificial Intelligence and Electronic WarfarePapadakis K.-Cyber-Information Warfare Analyst & Cyber Defense/Security Consultant-Hellenic MoD
AI & Electronic WarfareGenerating privacy-protected synthetic data using Secludy and Milvus
During this demo, the founders of Secludy will demonstrate how their system utilizes Milvus to store and manipulate embeddings for generating privacy-protected synthetic data. Their approach not only maintains the confidentiality of the original data but also enhances the utility and scalability of LLMs under privacy constraints. Attendees, including machine learning engineers, data scientists, and data managers, will witness first-hand how Secludy's integration with Milvus empowers organizations to harness the power of LLMs securely and efficiently.
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
Folding is a recent technique for building efficient recursive SNARKs. Several elegant folding protocols have been proposed, such as Nova, Supernova, Hypernova, Protostar, and others. However, all of them rely on an additively homomorphic commitment scheme based on discrete log, and are therefore not post-quantum secure. In this work we present LatticeFold, the first lattice-based folding protocol based on the Module SIS problem. This folding protocol naturally leads to an efficient recursive lattice-based SNARK and an efficient PCD scheme. LatticeFold supports folding low-degree relations, such as R1CS, as well as high-degree relations, such as CCS. The key challenge is to construct a secure folding protocol that works with the Ajtai commitment scheme. The difficulty, is ensuring that extracted witnesses are low norm through many rounds of folding. We present a novel technique using the sumcheck protocol to ensure that extracted witnesses are always low norm no matter how many rounds of folding are used. Our evaluation of the final proof system suggests that it is as performant as Hypernova, while providing post-quantum security.
Paper Link: https://eprint.iacr.org/2024/257
"Choosing proper type of scaling", Olena Syrota
Imagine an IoT processing system that is already quite mature and production-ready and for which client coverage is growing and scaling and performance aspects are life and death questions. The system has Redis, MongoDB, and stream processing based on ksqldb. In this talk, firstly, we will analyze scaling approaches and then select the proper ones for our system.
Choosing The Best AWS Service For Your Website + API.pptx
Have you ever been confused by the myriad of choices offered by AWS for hosting a website or an API?
Lambda, Elastic Beanstalk, Lightsail, Amplify, S3 (and more!) can each host websites + APIs. But which one should we choose?
Which one is cheapest? Which one is fastest? Which one will scale to meet our needs?
Join me in this session as we dive into each AWS hosting service to determine which one is best for your scenario and explain why!
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...Edge AI and Vision Alliance
For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2024/06/how-axelera-ai-uses-digital-compute-in-memory-to-deliver-fast-and-energy-efficient-computer-vision-a-presentation-from-axelera-ai/
Bram Verhoef, Head of Machine Learning at Axelera AI, presents the “How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-efficient Computer Vision” tutorial at the May 2024 Embedded Vision Summit.
As artificial intelligence inference transitions from cloud environments to edge locations, computer vision applications achieve heightened responsiveness, reliability and privacy. This migration, however, introduces the challenge of operating within the stringent confines of resource constraints typical at the edge, including small form factors, low energy budgets and diminished memory and computational capacities. Axelera AI addresses these challenges through an innovative approach of performing digital computations within memory itself. This technique facilitates the realization of high-performance, energy-efficient and cost-effective computer vision capabilities at the thin and thick edge, extending the frontier of what is achievable with current technologies.
In this presentation, Verhoef unveils his company’s pioneering chip technology and demonstrates its capacity to deliver exceptional frames-per-second performance across a range of standard computer vision networks typical of applications in security, surveillance and the industrial sector. This shows that advanced computer vision can be accessible and efficient, even at the very edge of our technological ecosystem.GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
Tomaz Bratanic
Graph ML and GenAI Expert - Neo4j
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...Edge AI and Vision Alliance
For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2024/06/temporal-event-neural-networks-a-more-efficient-alternative-to-the-transformer-a-presentation-from-brainchip/
Chris Jones, Director of Product Management at BrainChip , presents the “Temporal Event Neural Networks: A More Efficient Alternative to the Transformer” tutorial at the May 2024 Embedded Vision Summit.
The expansion of AI services necessitates enhanced computational capabilities on edge devices. Temporal Event Neural Networks (TENNs), developed by BrainChip, represent a novel and highly efficient state-space network. TENNs demonstrate exceptional proficiency in handling multi-dimensional streaming data, facilitating advancements in object detection, action recognition, speech enhancement and language model/sequence generation. Through the utilization of polynomial-based continuous convolutions, TENNs streamline models, expedite training processes and significantly diminish memory requirements, achieving notable reductions of up to 50x in parameters and 5,000x in energy consumption compared to prevailing methodologies like transformers.
Integration with BrainChip’s Akida neuromorphic hardware IP further enhances TENNs’ capabilities, enabling the realization of highly capable, portable and passively cooled edge devices. This presentation delves into the technical innovations underlying TENNs, presents real-world benchmarks, and elucidates how this cutting-edge approach is positioned to revolutionize edge AI across diverse applications.Recently uploaded (20)
Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...
Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
AppSec PNW: Android and iOS Application Security with MobSF
AppSec PNW: Android and iOS Application Security with MobSF
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
import rdma: zero-copy networking with RDMA and Python
- 1. import rdma: zero-copy networking with RDMA and Python Andy Grover @groveronline http://groveronline.com http://blogs.oracle.com/linuxnstuff
- 4. Issues I ran into
- 7. server: recvfrom() -> (“get data.tgz”)
- 8. server: data = open(“data.tgz”).read()
- 9. server: sock.sendto(client, “OK “ + data)
- 10. client: recvfrom() -> data
- 12. 2 on S, 2 on C
- 13. S: read from user buffer, write to kernel buffer by OS
- 14. S: read from kernel buffer by HW
- 15. C: write to kernel buffer by HW
- 16. C: read from kernel buffer, write to user buffer (OS)
- 18. Extra copy on each side consumes CPU
- 19. Also consumes 3x RAM bandwidth!
- 20. What do we do???
- 21. Direct Data Placement (RDMA)
- 23. Sender tells HW data buffer and key, Target HW uses key to place received data directly in user buffer
- 24. Done!
- 25. Way complicated
- 27. Supports RDMA
- 28. RHEL 5.4+ supports natively
- 30. Full disclosure: my day job
- 31. Guaranteed delivery of datagrams
- 32. Allows RDMA ops via sendmsg() and CMSGs
- 33. Hides complexity of IB Verbs
- 37. Can it be done?
- 38. Pythonically?
- 40. Interpreted, but fits in per-CPU cache
- 41. Many CPU cores these days
- 42. Shared RAM
- 43. Cache misses on the data
- 46. Buffers shared behind the scenes
- 48. sliceable etc.
- 52. Solution: external library, python-eunuchs
- 55. Solution: forget inheritance, just implement socket object methods
- 58. C Module solely to return an address
- 60. client: cookie = sock.get_mr(m)
- 61. client: sock.sendto(server. “get data.tgz, my cookie is <cookieval>”)
- 62. server: recvmsg() -> (“get data.tgz, my cookie is <cookieval>”
- 63. server: m = mmap(“data.tgz”)
- 64. server: sock.rdma_sendmsg(client, m, cookieval, length, token, “OK”)
- 65. client: recvmsg() -> “OK”
- 67. Copied “OK” instead of “OK”+8K, CPU and cache win
- 68. It worked!
- 70. Dogfood it -- simplify RDS utility apps
- 71. RDMA loves async: go Twisted