XPDS13: Xen on ARM Update - Stefano Stabellini, Citrix

•

0 likes•18,060 views

Many significant improvements have been made to Xen and Linux for the ARM architecture since September 2012, when initial support for Xen on ARM was introduced in the kernel. The number of contributors considerably increased as the number of different companies behind them. Xen on ARM has become a true multivendor project. Today Linux 3.11 can run on Xen on ARM as a DomU or Dom0, 32-bit or 64-bit, with one or more CPUs. Xen 4.3, out since July 2013, is the first hypervisor release to support ARMv7 and ARMv8 platforms. This talk will discuss the current status of the project, the principal technical advancements achieved during the last year of development and the problems still left unsolved. It will relate the experience of porting Xen to many new ARM SoCs and working with multiple hardware vendors in the ARM ecosystem, within and outside the Linaro Enterprise working Group.

Technology

Xen on ARM
A success story

Stefano Stabellini - Citrix Xen Project Team

Achievements of one year
Xen support for ARM
upstream in Linux 3.7

Xen support for ARM64
upstream in Linux 3.11

Xen 64-bit
on ARM64

You are here
11/11

08/12 09/12

Part-time Xen ARM
hacking starts

11/12

Xen running on real
ARM hardware

First Xen on ARM talk at
Xen Summit 2012

01/13

03/13

Citrix announces
that will be joining
Linaro

06/13

07/13

Xen 4.3 released with
ARM and ARM64
support

A growing community
Xen-devel ARM traffic from August 2012:
● 4685 emails: 360 emails per month!
● 39% of which are not from Citrix

Hardware support
Upstream:
● Versatile Express Cortex A15
● Arndale board
● ARMv8 FVP
In progress:
●
●
●
●
●

Calxeda “Midway”
Applied Micro “Mustang”
Cubieboard2
Broadcom Brahma-B15
OMAP5

Upstream features
Xen v4.3:
● basic lifecycle operations
● memory ballooning
● scheduler configurations and vcpu pinning
Linux v3.11:
● dom0 and domU support
● 32-bit and 64-bit support
● SMP support
● PV disk, network and console

Coming in Xen 4.4
● 64-bit guest support
● live-migration
● SWIOTLB

The problem

1 Stage

physical address

machine address

hardware

2 stage

Xen

Linux

virtual address

The problem: dom0 DMA

1 Stage

physical address

machine address

Device DMA

2 stage

Xen

Linux

virtual address

The best solution: IOMMU

MMU

physical address
2 stage

Linux

virtual address

Device DMA

IOMMU

Xen

machine address

The workaround:
Dom0 1:1 mapping

physical address = machine address

Xen

Linux

virtual address

Device DMA

The workaround:
Dom0 1:1 mapping
●
●
●
●

rigid solution
no ballooning in dom0
no page sharing in dom0
does not work with foreign grant table
mappings

The alternative: SWIOTLB

MMU

virtual address

machine address

Device DMA

DMA ops

Linux

physical address

The alternative: SWIOTLB
● use memory_exchange_and_pin hypercall
○ create a contiguous buffer in machine memory
○ retrieve the machine address of the buffer

● introduce an additional memcpy
● remove the need for the 1:1 workaround

SWIOTLB:
the improved version
pin and unpin hypercalls:
● dynamically retrieve P2M mappings
● pin a mapping for DMA
● remove additional memcpy
map_page

pfn
XENMEM_pin

pfn

mfn
pin
mfn

SWIOTLB:
the “improved” version
● Linux rbtree maintenance is expensive
● too many uncached address translations in
Xen
○ guest virtual to machine
○ guest physical to machine

cpu utilization increase

SWIOTLB: the compromise
● keep the dom0 1:1 workaround
○ dom0 without ballooning and page sharing is the
default configuration in XenServer x86 today

● use the swiotlb only to handle DMA involving
foreign grants
○ we already know the p2m mappings of grants
■ no need for pin and unpin hypercalls
○ can take shortcuts: avoid many tree lookups
○ tree lookups are much faster
○ avoidable with IOMMU support

SWIOTLB: the compromise
Testing platform:
● 1.5Ghz quad-core Cortex A15
● 1 Gbit link
Benchmark results:
● same network throughput as native (line
rate)
● < 2% cpu usage increase

SWIOTLB: where to find it
The patches (swiotlb-xen v8):
http://marc.info/?l=linux-kernel&m=138203180707683&w=2

The kernel tree:
git://git.kernel.org/pub/scm/linux/kernel/git/sstabellini/xen.git swiotlb-xen-8

Xen 4.5+
●
●
●
●

IOMMU support in Xen
device assignment
UEFI booting
ACPI support

XPDS13: Xen on ARM Update - Stefano Stabellini, Citrix

Xen role, details of implementation and problems in a sample solution based on OSS (Android, Linux and Xen) that addresses Automotive requirements such as ultra-fast RVC boot time, quick IVI system boot time, cloud connectivity and multimedia capabilities, reliability and security through hardware virtualization. Secure CAN/LIN/MOST bus integration handled by Linux on Dom0 while Android runs customizable QML-based HMI in a sandbox of DomU. These case studies will include but not be limited to: computing power requirements, memory requirements, virtualization, stability, boot-time sequence and optimization, video clips showing results of the work done. Case study is built on TexasInstruments OMAP5 SoC.

ALSF13: Xen on ARM - Virtualization for the Automotive Industry - Stefano Sta...

The Linux Foundation

During the last few months of 2011 the Xen Community started an effort to port Xen to ARMv7 with virtualization extensions, using the Cortex A15 processor as reference platform. The new Xen port is exploiting this set of hardware capabilities to run guest VMs in the most efficient way possible while keeping the ARM specific changes to the hypervisor and the Linux kernel to a minimum. Developing the new port we took the chance to remove legacy concepts like PV or HVM guests and only support a single kind of guests that is comparable to "PVH" in the Xen X86 world. Linux 3.7 was the first kernel release to run on Xen on ARM as Dom0 and DomU. Xen 4.3, out in July 2013, is the first hypervisor release to support ARMv7 with virtualization extensions and ARMv8. This talk will explain why ARM virtualization is set to be increasingly relevant for the automotive industry in the coming years. We will go on to describe how Xen exploits the strengths of the hardware to meet the requirements of the industry. We will illustrate the early design choices and we will evaluate whether they were proven successful or a failure.

XPDS14 - RT-Xen: Real-Time Virtualization in Xen - Sisu Xi, Washington Univer...

The Linux Foundation

Recent years have seen an increasing demand for supporting real-time systems in virtualized environments. To combine real-time and virtualization, a real-time scheduler at the hypervisor level is needed to provide timing guarantees to the guest virtual machines. RT-Xen provides a suite of multi-core real-time schedulers to deliver real-time performance to domains running on the Xen hypervisor. Work is underway to incorporate RT-Xen in the Xen distribution to replace the legacy SEDF scheduler. We have implemented and empirically compared a diverse set of multicore real-time scheduling policies within the RT-Xen scheduling framework. Based on extensive experiments of different scheduling policies, we plan to submit a patch on global EDF scheduler to the xen-devel as the first step to incorporate multicore real-time scheduling support within the Xen hypervisor.

XPDS13: Performance Optimization on Xen-based Android Device - Jack Ren, Inte...

The Linux Foundation

Mobile devices, such as smart phones and tablets, are becoming de-facto everyday computing and communication devices, virtualization can bring additional benfits to mobile devices for both security and manageability. IT department may use hypervisor, as a highly secure solution, to manage autherized mobile devices, such as for network traffic monitoring, filtering, scan (for virus detection), and/or OS update/patching even when the guest OS becomes completely dead. We insert Xen to the mobile OS Android to deprivilege Android as guest for security and manageability purpose. However, the usage case of mobile device is quit different with that of server, for example mobile devices runs completely different benchmarks (mostly multimedia focused) vs. that in server (mostly responsiveness focused). We analyze the gap of Xen as a mobile hypervisor and present how we improve the performance.

XPDS13: Dual-Android on Nexus 10 - Lovene Bhatia, Samsung

The Linux Foundation

Samsung will present the challenges of creating a dual-Android platform on the Nexus 10 using Xen on ARM. Running two copies of Android is a strong use-case to satisfy the security needs for BYOD (Bring Your Own Device), where one Android can be designated as “work” and is secure and isolated from the users “home” Android. Achieving a good user-experience in both Android is essential for this technology to succeed commercially. The Nexus 10 has ARM Cortex A15 processors. For a good user-experience, both Android need high-performance GPU-accelerated graphics which demand high throughput and low latency. Samsung will discuss the issues encountered using Xen on a mobile device in this demanding use-case, and how the changes for Xen for mobile can be contributed into the community.

XPDS13: Performance Evaluation of Live Migration based on Xen ARM PVH - Jaeyo...

The Linux Foundation

Electricity charge for operating data centers is reaching approximately 27% of total operation cost. For this reason, ARM servers have been getting more attention for future energy-efficient data centers and the performance of ARM processors keeps increasing (i.e., almost 3GHz). For efficiently utilizing ARM cores, ARM PVH has been introduced in Xen 4.3, and based on this, we have implemented live migration feature and evaluated on top of dualcore ARM board. More specifically, we choose multimedia streaming workload, measure the maximum concurrent clients, and calculate clients per watt (CPW) as the performance metric. From this, we have found out that even dualcore ARM processor (with virtualization) gives higher CPW (7 CPW) over x86 case (6 CPW). In addition we could reduce the energy consumption around 70% (4-to-1 consolidation for low-loaded servers) by using server consolidation.

PVH : PV Guest in HVM containerThe Linux Foundation

XPDS16: Porting Xen on ARM to a new SOC - Julien Grall, ARM

The Linux Foundation

Adding support for you new shiny board in Xen on ARM is a simple task once you get a kernel running on bare metal. This session will cover the different steps to port Xen on ARM from the firmware to the shell prompt in DOM0. We will give you tips on the common pitfalls when you have your hypervisor, or your DOM0 kernel crashing. We will also provide suggestion on how to debug when the console is not working.

Static partitioning is becoming increasingly common in embedded. A static hypervisor, such as Xen dom0less, is employed to split the hardware resources into multiple domains and run a different OS in each domain. For instance, Linux and Zephyr. Only the simplest static partitioning configurations don't involve any data exchanges between the domains. Often, communication and data exchanges between two or more environments are required to complete the data processing pipeline that implements the target application. However, the VM-to-VM communication mechanisms available in static partitioning configurations are typically more limited compared to general-purpose hypervisors. For example, PV drivers are not available to Xen dom0less domains. This presentation will discuss the need for communication in static partitioning setups and it will present the technical challenges involved in getting traditional communication methods to work, including Xen PV drivers and VirtIO. The talk will also provide simpler alternatives based on shared memory and interrupt notifications to set up domain-to-domain data streams: simpler techniques that are easily exploitable both by Linux and by tiny baremetal applications as well.

Xen Project for ARM Servers

Stefano Stabellini

Rootlinux17: An introduction to Xen Project Virtualisation

The Linux Foundation

This talk provides an overview of the Xen Project eco-system and its main use-cases in a number of important market segments: it covers server virtualization, cloud computing and embedded, automotive and related. Lars Kurth highlights why the Xen Project is relevant in these market segments: he provides an overview of the Xen Project's architecture, relevant existing functionality and ongoing and planned developments. To complement the picture, he covers open-source projects that are related to Xen and are of interest for these use-cases. Excellent Software security is key to all of these use-cases. Thus, Lars specifically covers the Xen Project's security features, track record and touches on the project's security practices. He concludes with a few resources that help you get started with the Xen Project and highlight Internship Programs which the project supports. The talk was delivered at Root Linux Conference 2017. Learn more: http://linux.globallogic.com/materials. The video is available at https://www.youtube.com/watch?v=sjQnAIJji4k

Xen iowangyuanzhf

XPDDS18: CPUFreq in Xen on ARM - Oleksandr Tyshchenko, EPAM Systems

The Linux Foundation

The motivation of hypervisor based CPUFreq is to enable the one of the main PM use-cases (Dynamic voltage and frequency scaling) in virtualized system powered by Xen hypervisor. Rationale behind this activity is that CPU virtualization is done by hypervisor and the guest OS doesn't actually know anything about physical CPUs because it is running on virtual CPUs. In this talk Oleksandr will briefly describe the possible approach of generic CPUFreq in Xen on ARM, the advantages and disadvantages of having DVFS support on ARM boards powered by Xen hypervisor and share results of his CPUFreq PoC which implies power consumption measurements with and without CPUFreq enabled on R-Car Gen3 based board as an example.

Rootlinux17: Hypervisors on ARM - Overview and Design Choices by Julien Grall...

The Linux Foundation

Hypervisors are used in a broad range of domains ranging from Embedded systems, Automotive to big iron servers. The choice of hypervisor has a strong impact on the overall design of your project and its performance. This talk introduces the state of virtualization on ARM, and provides a description of three popular open source hypervisors: KVM, Jailhouse and Xen. Julien Grall explains respective key features, technical differences and suitability of the hypervisor for different application domains. Julien Grall is a Software Virtualisation Engineer at ARM. The talk was delivered at Root Linux Conference 2017. Learn more: http://linux.globallogic.com/materials. The video recording is available at https://www.youtube.com/watch?v=jZNXtqFJpuc

XPDS13: HVM Dom0 - Any unmodified OS as Dom0 - Will Auld, Intel

The Linux Foundation

It should be great if we can use an unmodified guest for dom0 or the driver domain. We found a way to achieve that. Since Xen's inception, the first guest on Xen is always a para-virtualized domain, and it can be modified Linux, NetBSD, and Solaris etc. In this way, dom0 can achieve near-native performance, so it is commonly used in the server market. However, modifications to guest kernels also implies limitations. For example, it can't support Windows OS as the dom0 or the driver domain. With the rapid evolution of hardware-assisted virtualization (e.g. VMX, VT-d technologies), HVM domains also can achieve comparable performance with para-virtualization. And, it's high time for Xen to such an unmodified guest as the dom0. In the presentation, we discuss its architectural changes and its benefits compared with the traditional PV or HVM dom0, and we also introduce what we have done.

LinuxCon Japan 13 : 10 years of Xen and BeyondThe Linux Foundation

LFCollab14: Xen vs Xen Automotive

The Linux Foundation

The accompanying demo (slide 15) can be found at https://vimeo.com/90534015 The presentation will cover Xen vs Xen Automotive gaps and analysis. We will elaborate technical solutions for the identified gaps: * ARM architecture - support HW virtualization extensions for embedded systems * Stability requirements * RT Scheduler * Rich virtualized peripheral support (WiFi, Gfx, MM, USB, etc.) * Performance benchmarking * Security The audience is anyone interesting in building OSS based IVI systems. Attendees can expect the OSS stack detailed architecture, current status of the project, the challenges seen, road map and much more.

XPDS14: Porting FreeRTOS to Xen on the ARM Cortex A15 - Jonathan Daugherty, G...

The Linux Foundation

Autonomous vehicles need to run robust autopilot software in resource-constrained environments. Such vehicles are increasingly built on ARM platforms with resources to spare. We have begun investigating the feasibility of using this spare capacity to implement other interesting services on these vehicles by using Xen to separate the real-time autopilot software from a richer, non-real-time Linux system. In order to make this work, we have ported FreeRTOS, a popular minimal operating system for microcontrollers, to run as a Xen guest on the ARM Cortex A15.

LF Collaboration Summit: Xen Project 4 4 Features and Futures

The Linux Foundation

XPDS13: Enabling Fast, Dynamic Network Processing with ClickOS - Joao Martins...

The Linux Foundation

While virtualization technologies like Xen have been around for a long time, it is only in recent years that they have started to be targeted as viable systems for implementing middlebox processing (e.g., firewalls, NATs). But can they provide this functionality while yielding the high performance expected from hardware-based middlebox offerings? In this talk Joao Martins will introduce ClickOS, a tiny, MiniOS-based virtual machine tailored for network processing. In addition to the vm itself, Joao Martins will describe performance improvements done to the entire Xen I/O pipe. Finally, Joao Martins will discuss an evaluation showing that ClickOS can be instantiated in 30 msecs, can process traffic at 10Gb/s for almost all packet sizes, introduces delay of 40 microseconds and can run middleboxes at rates of 5 Mp/s.

XPDS16: libvirt and Tools: What's New and What's Next - James Fehlig, SUSE

The Linux Foundation

A year has passed since the last Xen Developer Summit and it is time to announce the quiet progress made on the libvirt libxl driver and related tooling. New features include memory, cpu, block device, and network interface statistics reporting, support for pvUSB, support for migration stream V2, peer-to-peer migration, UEFI for HVM guests via OVMF, and domain capabilities reporting to name a few. There are also many noteworthy improvements such as better conversion of xl.cfg to/from libvirt domXML, allowing users to easily switch between the xl+libxl and libvirt+libxl toolstacks. The summit also provides an opportunity to discuss new proposals such as better control of domain placement on NUMA systems, exposing Xen's cpu pool feature in libvirt, supporting non-volatile memory for UEFI variables, and improved capabilities reporting. Much of libvirt's value for Xen is in the tools built upon it: virt-manager, virt-viewer, virt-install, virt-builder, kimchi, OpenStack nova, etc. These tools also deserve a quick status update as they relate to Xen. The audience is encouraged to participate, e.g. by requesting a sorely missing feature, warning of an upcoming Xen change that may affect libvirt, or simply suggesting a change that makes virtualization management life a bit easier.

Xen on ARM for embedded and IoT: from secure containers to dom0less systems

Stefano Stabellini

Hypervisors are becoming increasingly widespread in embedded environments. Their use-case is different from server virtualization, and so are their requirements. The ability to run containerized applications is often a requirement. Xen on ARM is embracing the new challenges with innovative solutions. This talk will discuss cutting-edge Xen on ARM features for embedded deployments, including dom0less, where multiple domains are started directly by Xen at boot. The presentation will explain the reasons why Xen is an excellent runtime environment for containerized apps and will introduce a new proposal for a Xen Project sub-project to create the ideal platform for secure containers in embedded.

Redesigning Xen Memory Sharing (Grant) MechanismThe Linux Foundation

Xen and the art of embedded virtualization (ELC 2017)

Stefano Stabellini

Hypervisors are becoming more and more widespread in embedded environments, from automotive to medical and avionics. Their use case is different from traditional server and desktop virtualization, and so are their requirements. This talk will explain why hypervisors are used in embedded, and the unique challenges posed by these environments to virtualization technologies. Xen, a popular open source hypervisor, was born to virtualize x86 Linux systems for the data center. It is now the leading open source hypervisor for ARM embedded platforms. The presentation will show how the ARM port of Xen differs from its x86 counterpart. It will go through the fundamental design decisions that made Xen a good choice for ARM embedded virtualization. The talk will explain the implementation of key features such as device assignment and interrupt virtualization.

Xen Memory Management

The Linux Foundation

Fosdem 17 - Towards a HVM-like Dom0 for Xen

The Linux Foundation

Subtitle: Reducing the OS burden while taking advantage of new hardware features Xen is a hypervisor using a microkernel design that allows running multiple concurrent operating systems on the same hardware. One of the key features of Xen is that it is OS agnostic, meaning that any OS (with proper support) can be used as a host. Xen has a long history going back to the 90s when it was designed and the early 2000s when it was released. As a consequence of this, many of the assumptions and virtualization techniques backed into it are now superseeded by new hardware features, that make virtualization more transparent from an OS point of view. This talk provides an overview on the different kind of guests supported by Xen and how these new hardware features are used in order to improve and evolve them. It also describes the design and implementation of a new guest type, called PVHv2, and how it can be used as a control domain (Dom0). Also see: https://fosdem.org/2017/schedule/event/iaas_towahvm/

XPDDS18: Windows PV Drivers Project: Status and Updates - Paul Durrant, Citri...

The Linux Foundation

Bare-Metal Hypervisor as a Platform for Innovation

The Linux Foundation

Detecting Silent Data Corruptions using Linux DMA Debug API

Samsung Open Source Group

XenSummit NA 2012: Xen on ARM Cortex A15

The Linux Foundation

During the last few months of 2011 the Xen Community started an effort to port Xen to ARMv7 with virtualization extensions, using the Cortex A15 processor as reference platform.The new Xen port is exploiting this set of hardware capabilities to run guest VMs in the most efficient way possible while keeping the ARM specific changes to the hypervisor and the Linux kernel to a minimum. Developing the new port we took the chance to remove legacy concepts like PV or HVM guests and only support a single kind of guests that is comparable to "PV on HVM" in the Xen X86 world. This talk will explain the reason behind this and other design choices that we made during the early development process and it will go through the main technical challenges that we had to solve in order to accomplish our goal. Notable examples are the way Linux guests issue hypercalls and receive event channels notifications from Xen.

What's hot

ELC21: VM-to-VM Communication Mechanisms for Embedded

Stefano Stabellini

Xen Project for ARM Servers

Stefano Stabellini

Rootlinux17: An introduction to Xen Project Virtualisation

The Linux Foundation

Xen iowangyuanzhf

XPDDS18: CPUFreq in Xen on ARM - Oleksandr Tyshchenko, EPAM Systems

The Linux Foundation

Rootlinux17: Hypervisors on ARM - Overview and Design Choices by Julien Grall...

The Linux Foundation

XPDS13: HVM Dom0 - Any unmodified OS as Dom0 - Will Auld, Intel

The Linux Foundation

LinuxCon Japan 13 : 10 years of Xen and BeyondThe Linux Foundation

LFCollab14: Xen vs Xen Automotive

The Linux Foundation

XPDS14: Porting FreeRTOS to Xen on the ARM Cortex A15 - Jonathan Daugherty, G...

The Linux Foundation

LF Collaboration Summit: Xen Project 4 4 Features and Futures

The Linux Foundation

XPDS13: Enabling Fast, Dynamic Network Processing with ClickOS - Joao Martins...

The Linux Foundation

XPDS16: libvirt and Tools: What's New and What's Next - James Fehlig, SUSE

The Linux Foundation

Xen on ARM for embedded and IoT: from secure containers to dom0less systems

Stefano Stabellini

Redesigning Xen Memory Sharing (Grant) MechanismThe Linux Foundation

Xen and the art of embedded virtualization (ELC 2017)

Stefano Stabellini

Xen Memory Management

The Linux Foundation

Fosdem 17 - Towards a HVM-like Dom0 for Xen

The Linux Foundation

XPDDS18: Windows PV Drivers Project: Status and Updates - Paul Durrant, Citri...

The Linux Foundation

Bare-Metal Hypervisor as a Platform for Innovation

The Linux Foundation

What's hot (20)

ELC21: VM-to-VM Communication Mechanisms for Embedded

Xen Project for ARM Servers

Rootlinux17: An introduction to Xen Project Virtualisation

Xen io

XPDDS18: CPUFreq in Xen on ARM - Oleksandr Tyshchenko, EPAM Systems

Rootlinux17: Hypervisors on ARM - Overview and Design Choices by Julien Grall...

XPDS13: HVM Dom0 - Any unmodified OS as Dom0 - Will Auld, Intel

LinuxCon Japan 13 : 10 years of Xen and Beyond

LFCollab14: Xen vs Xen Automotive

XPDS14: Porting FreeRTOS to Xen on the ARM Cortex A15 - Jonathan Daugherty, G...

LF Collaboration Summit: Xen Project 4 4 Features and Futures

XPDS13: Enabling Fast, Dynamic Network Processing with ClickOS - Joao Martins...

XPDS16: libvirt and Tools: What's New and What's Next - James Fehlig, SUSE

Xen on ARM for embedded and IoT: from secure containers to dom0less systems

Redesigning Xen Memory Sharing (Grant) Mechanism

Xen and the art of embedded virtualization (ELC 2017)

Xen Memory Management

Fosdem 17 - Towards a HVM-like Dom0 for Xen

XPDDS18: Windows PV Drivers Project: Status and Updates - Paul Durrant, Citri...

Bare-Metal Hypervisor as a Platform for Innovation

Viewers also liked

Detecting Silent Data Corruptions using Linux DMA Debug API

Samsung Open Source Group

XenSummit NA 2012: Xen on ARM Cortex A15

The Linux Foundation

During the last few months of 2011 the Xen Community started an effort to port Xen to ARMv7 with virtualization extensions, using the Cortex A15 processor as reference platform.The new Xen port is exploiting this set of hardware capabilities to run guest VMs in the most efficient way possible while keeping the ARM specific changes to the hypervisor and the Linux kernel to a minimum. Developing the new port we took the chance to remove legacy concepts like PV or HVM guests and only support a single kind of guests that is comparable to "PV on HVM" in the Xen X86 world. This talk will explain the reason behind this and other design choices that we made during the early development process and it will go through the main technical challenges that we had to solve in order to accomplish our goal. Notable examples are the way Linux guests issue hypercalls and receive event channels notifications from Xen.

Zynq mp勉強会資料

一路川染

Continguous Memory Allocator in the Linux Kernel

Kernel TLV

5. IO virtualization

Hwanju Kim

XPDS16: High-Performance Virtualization for HPC Cloud on Xen - Jun Nakajima &...

The Linux Foundation

We have been working to get Xen up and running on self-boot Intel® Xeon Phi processors to build HPC clouds. We see several challenges because of the unique (but not unusual for HPC) hardware technologies and performance requirements. For example, such hardware technologies include 1) >256 CPUs, 2) MCDRAM (high-bandwidth memory), 3) integrated fabric (i.e. Intel® Omni-Path). Unlike the “coprocessor“ model, supporting self-boot with >256 CPUs has various implications to Xen, including scheduling and scalability. We need to allow user applications to use MCDRAM directly to perform optimally. Also, we need to enable the integrated HPC fabric for the VM to use by direct I/O assignment. In addition, we have only a single VM on each node to meet the high-performance requirements of HPC clouds. This (i.e. non-shared) model allowed us to optimize Xen more. In this talk, we share our design and lessons, and discuss the options we considered to achieve high-performance virtualization for HPC.

Performance Tuning Xen

The Linux Foundation

仮想化環境におけるパケットフォワーディング

Takuya ASADA

10GbE時代のネットワークI/O高速化

Takuya ASADA

10GbE、40GbEなどの極めて高速な通信をサポートするNICが、PCサーバの領域でも使われるようになってきている。このような速度の通信をソフトウェア（OS）で処理し高い性能を得るには様々な障害があり、ハードウェア・ソフトウェア両面の実装を見直す必要がある。本セッションでは、ハードウェア・ソフトウェア両面にどのような改良が行われてきており、性能を引き出すにはどのようにこれらを使用したらよいのかについて紹介する。

Viewers also liked (9)

Detecting Silent Data Corruptions using Linux DMA Debug API

XenSummit NA 2012: Xen on ARM Cortex A15

Zynq mp勉強会資料

Continguous Memory Allocator in the Linux Kernel

5. IO virtualization

XPDS16: High-Performance Virtualization for HPC Cloud on Xen - Jun Nakajima &...

Performance Tuning Xen

仮想化環境におけるパケットフォワーディング

10GbE時代のネットワークI/O高速化

Similar to XPDS13: Xen on ARM Update - Stefano Stabellini, Citrix

Improving Scalability of Xen: The 3,000 Domains Experiment

The Linux Foundation

Machines are getting powerful these days and more and more VMs will run on a single machine. This work started off with a simple goal - to run 3,000 domains on a single host and address any scalability issues come across. I will start with Xen internal then state the problems and solutions. Several improvements are made, from hypervisor, Linux kernel to user space components like console backend and xenstore backend. The main improvement for hypervisor and Dom0 Linux kernel is the new event channel infrastructure, which enable Dom0 to handle much more events simultaneously - the original implementation only allows 1024 and 4096 respectively. The targeting audiences are cloud developers, kernel developers and those who are interested in Xen scalability and internals. They need to have general knowledge of Linux, knowledge of Xen is not required but nice to have.

Linaro connect : Introduction to Xen on ARM

The Linux Foundation

Oscon 2012 : From Datacenter to the Cloud - Featuring Xen and XCP

The Linux Foundation

Do you dream of being able to spin up ten or twenty (or a thousand) virtual machines in an instant? Discover and repair resource bottlenecks without moving a finger? Dodge the loss of an entire storage array with no-one noticing? Span across data centers with a fleet of virtual machines? This is no sales pitch; during this tutorial, we’ll demonstrate how to leverage truly FOSS tools to build a powerful, scalable cloud that easily competes with those proprietary solutions! This deep-dive into Xen, Xen Cloud Platform, and other FOSS cloud tools and concepts is intended both for those ready to wholeheartedly embrace virtualization and for those already seasoned in general virtualization practices. You’ll leave with a collection of pre-made tools that you can use right out of the box or modify to your liking. You’ll also leave with immediately useful knowledge on best practices and common pitfalls, presented by actual FOSS practitioners like you. We begin this tutorial by discussing Xen, Xen Cloud Platform (XCP), and XCP cloud concepts (pools, hosts, storage, networks, etc.). We then explore in detail the API that makes Xen so useful for building a cloud, explore provisioning of hosts and guests using PXE, and discuss templating and installing guest virtual machines. Critical to understanding potential bottlenecks, identifying tuning opportunities and planning for the future, we will discuss performance monitoring and methodologies. Next, we teach you how to make the most of your new FOSS cloud capabilities and discuss in detail high availability infrastructure for storage and networking, advanced networking capabilities like bonding/VLANs, and the cloud orchestration tools that save you time and money. All of this with a focus on XCP in enterprise environments. Tools discussed include DRBD, Pacemaker, Open vSwitch, Cloudstack, Openstack, and more. We conclude by shedding light on exciting developments: Xen 4.2 has recently been released, with just over a year of development time and nearly 3,000 changesets. We will discuss many of the new features introduced in 4.2, as well as what changes we have in store for the 4.3 release as well as other exciting developments.

Memory Management in TIZEN - Samsung SW Platform Team

Ryo Jin

Current and Future of Non-Volatile Memory on Linux

mountpoint.io

UKUUG presentation about µCLinux on Pluto 6

edlangley

Xen and the Art of VirtualizationSusheel Thakur

Introduction to Core 4simonjj

RHEL5 XEN HandOnTraining_v0.4.pdf

Paul Yang

Xen 4.3 Roadmap

The Linux Foundation

Jaime Peñalba - Kernel exploitation. ¿El octavo arte? [rooted2019]

RootedCON

Emerging Persistent Memory Hardware and ZUFS - PM-based File Systems in User ...

Kernel TLV

In this talk, Dr. Amit Golander looks into emerging PM/NVDIMM devices, the value they bring to applications and most importantly how they revolutionize the storage stack. In the second part, Boaz Harrosh and Shachar Sharon dive into new opportunities to develop memory-based filesystems in user space, leveraging a new open source project called ZUFS. ZUFS was presented in the last Linux Plumbers conference and unlike FUSE it focuses on delivering low latency and zero copy. Dr. Amit Golander was the CTO of Plexistor, which developed the first enterprise-grade PM-based file system, and which was acquired earlier this year by NetApp. Boaz Harrosh and Shachar Sharon are ZUFS maintainers and longtime Storage and Linux veterans.

µCLinux on Pluto 6 Project presentation

edlangley

Armbian linux

igorpecovnik

XPDS13: Xen and XenServer Storage Performance - Felipe Franciosi, Citrix

The Linux Foundation

The development of low latency storage media such as modern Solid State Drives (SSD) brings new challenges to virtualisation platforms. For the first time, we are witnessing storage back ends which are so fast that the CPU time spent in processing data significantly impacts the delivered throughput. This is aggravated by CPU speeds remaining largely constant while storage solutions get faster by orders of magnitude. To meet user demands and fully exploit SSD performance under Xen, new technologies are necessary. This talk will discuss the Xen storage virtualisation data path when using various back ends (e.g. blkback, tapdisk, qemu). It will explain why it is hard to exploit SSD performance with current technologies and present measurement data for a variety of workloads. Finally, it will show how techniques such as persistent grants and indirect I/O can help to mitigate the problem.

LMG Lightning Talks - SFO17-205

Linaro

Session ID: SFO17-205 Session Name: LMG Lightning Talks - SFO17-205 Speaker: Sam Protsenko - Amit Pundir - Bero Rosenkränzer Track: LMG ★ Session Summary ★ An update of various LMG activities since last Connect, including: - LLCT efforts - Arm64 Hibernate backport effort - learnings - uBoot upstreaming learnings - Zstd compression effort - Native aarch64 hosted builds for Android --------------------------------------------------- ★ Resources ★ Event Page: http://connect.linaro.org/resource/sfo17/sfo17-205/ Presentation: ? Video: https://www.youtube.com/watch?v=Zv7Uo2QXK4E --------------------------------------------------- ★ Event Details ★ Linaro Connect San Francisco 2017 (SFO17) 25-29 September 2017 Hyatt Regency San Francisco Airport --------------------------------------------------- Keyword: 'http://www.linaro.org' 'http://connect.linaro.org' --------------------------------------------------- Follow us on Social Media https://www.facebook.com/LinaroOrg https://twitter.com/linaroorg https://www.youtube.com/user/linaroorg?sub_confirmation=1 https://www.linkedin.com/company/1026961

Armbian balcoon

igorpecovnik

Kernel Recipes 2014 - The Linux graphics stack and Nouveau driver

Anne Nicolas

The Linux graphics stack is constantly evolving to add support for new hardware. This evolution and new software specifications have forced the X graphical server to be split into several components including a now rotates in the Linux kernel, the Direct Rendering Manager (DRM). A quick presentation of these components and their role will be carried out before looking at new major change in the common code, the NVIDIA Optimus technology. One equipped with Optimus technology laptop has two graphics processing units (GPUs), one from Intel and one from NVIDIA. This technology combines the low power Intel GPU when the machine is not used to the performance of NVIDIA GPUs when the user plays. This technology, however, is a nightmare to manage kernel-side although the final building blocks necessary for its complete management are being finalized. Further explanation of this issue will be made and we’ll see how this new software architecture has added graphics acceleration on embedded processor SoCs like Tegra. The case of open source NVIDIA driver, called “New” will then be studied. This is the graphics driver community as it is developed without the help of NVIDIA and attracted several regular contributors, including myself! We’ll take a quick history of the project before talking about the current developments and issues related to the lack of documentation. The end of this presentation will then be left to the participants so they can ask more general questions about the graphics stack, if they wish. Martin Peres, Laboratoire Bordelais de Recherche en Informatique

2015 02-10 xen server master class

Citrix

Implementing Hyper V virtualization Service Pack 1Lai Yoong Seng

Similar to XPDS13: Xen on ARM Update - Stefano Stabellini, Citrix (20)

Improving Scalability of Xen: The 3,000 Domains Experiment

Linaro connect : Introduction to Xen on ARM

Oscon 2012 : From Datacenter to the Cloud - Featuring Xen and XCP

Memory Management in TIZEN - Samsung SW Platform Team

Current and Future of Non-Volatile Memory on Linux

UKUUG presentation about µCLinux on Pluto 6

Xen and the Art of Virtualization

Introduction to Core 4

RHEL5 XEN HandOnTraining_v0.4.pdf

Xen 4.3 Roadmap

Jaime Peñalba - Kernel exploitation. ¿El octavo arte? [rooted2019]

Emerging Persistent Memory Hardware and ZUFS - PM-based File Systems in User ...

µCLinux on Pluto 6 Project presentation

Armbian linux

XPDS13: Xen and XenServer Storage Performance - Felipe Franciosi, Citrix

LMG Lightning Talks - SFO17-205

Armbian balcoon

Kernel Recipes 2014 - The Linux graphics stack and Nouveau driver

2015 02-10 xen server master class

Implementing Hyper V virtualization Service Pack 1

More from The Linux Foundation

ELC2019: Static Partitioning Made Simple

The Linux Foundation

Static partitioning is used to split an embedded system into multiple domains, each of them having access only to a portion of the hardware on the SoC. It is key to enable mixed-criticality scenarios, where a critical application, often based on a small RTOS, runs alongside a larger non-critical app, typically based on Linux. The two domains cannot interfere with each other. This talk will explain how to use Xen for static partitioning. It will introduce dom0-less, a new Xen feature written for the purpose. Dom0-less allows multiple VMs to start at boot time directly from the Xen hypervisor, decreasing boot times drastically. It makes it very easy to partition the system without virtualization overhead. Dom0 becomes unnecessary. This presentation will go into details on how to setup a Xen dom0-less system. It will show configuration examples and explain device assignment. The talk will discuss its implications for latency-sensitive and safety-critical environments.

XPDDS19: How TrenchBoot is Enabling Measured Launch for Open-Source Platform ...

The Linux Foundation

TrenchBoot is a cross-community OSS integration project for hardware-rooted, late launch integrity of open and proprietary systems. It provides a general purpose, open-source DRTM kernel for measured system launch and attestation of device integrity to trust-centric access infrastructure. TrenchBoot closes the UEFI Measurement Gap and reduces the need to trust system firmware. This talk will introduce TrenchBoot architecture and a recent collaboration with Oracle to launch the Linux kernel directly with Intel TXT or AMD SVM Secure Launch. It will propose mechanisms for integrating the Xen hypervisor into a TrenchBoot system launch. DRTM-enabled capabilities for client, server and embedded platforms will be presented for consideration by the Xen community.

XPDDS19 Keynote: Xen in Automotive - Artem Mygaiev, Director, Technology Solu...

The Linux Foundation

Artem will briefly cover what has been done since the first talk on Xen in Automotive domain back in 2013, what is going on now and what is still missing for broad adaptation of Xen in vehicles. The following topics will be covered: Embedded/automotive features of Xen Collaboration with AGL and GENIVI organizations for standardization Efforts on Functional Safety compliance Artem will also go over typical automotive use scenarios for Xen which may not be the same as generic computing use of hypervisor.

XPDDS19 Keynote: Xen Project Weather Report 2019 - Lars Kurth, Director of Op...

The Linux Foundation

XPDDS19 Keynote: Unikraft Weather Report

The Linux Foundation

In recent years unikernels have shown immense performance potential (e.g., boot times of only a few ms, image sizes of only hundreds of KBs).The fundamental drawback of unikernels is that they require that applications be manually ported to the underlying minimalistic OS, needing both expert work and often considerable amount of time. The Unikraft project provides a unikernel code base and build system that significantly simplifies the building of unikernels. In addition to support for a number CPU architectures, languages and frameworks, Unikraft provides debugging and tracing features that are generally sorely missing from unikernel projects. In this talk we will talk about these features, show a set of preliminary performance numbers, and provide a roadmap for the project's future.

XPDDS19 Keynote: Secret-free Hypervisor: Now and Future - Wei Liu, Software E...

The Linux Foundation

XPDDS19 Keynote: Xen Dom0-less - Stefano Stabellini, Principal Engineer, Xilinx

The Linux Foundation

This talk will introduce Dom0-less: a new way of using Xen to build mixed-criticality solutions. Dom0-less is a Xen feature that adds a novel approach to static partitioning based on virtualization. It allows multiple domains to start at boot time directly from the Xen hypervisor, decreasing boot times dramatically. Xen userspace tools, such as xl and libvirt, become optional. Dom0-less extends the existing device tree based Xen boot protocol to cover information required by additional domains. Binaries, such as kernels and ramdisks, are loaded by the bootloader (u-boot) and advertised to Xen via new device tree bindings. The audience will learn how to use Dom0-less to partition the system. Uboot and device tree configuration details will be explained to enable the audience to get the most out of this feature. The talk will include a status update and details on future plans.

XPDDS19 Keynote: Patch Review for Non-maintainers - George Dunlap, Citrix Sys...

The Linux Foundation

As the number of contributions grow, reviewer bandwidth becomes a bottleneck; and maintainers are always asking for more help. However, ultimately maintainers must at least Ack every patch that goes in; so if you're not a maintainer, how can you contribute? Why should anyone care about your opinion? This talk will try to lay out some advice and guidelines for non-maintainers, for how they can do code review in a way which will effectively reduce the load on maintainers when they do come to review a patch.

XPDDS19: Memories of a VM Funk - Mihai Donțu, Bitdefender

The Linux Foundation

This talk is a follow-up to our Summit 2017 presentation in which we covered our plans for Intel VMFUNC and #VE, as well as related use-cases. This year, we will provide a report on what we have accomplished in Xen 4.12, and what remains to be addressed. We will also give a brief status update of VMI on AMD hardware. The session will end with some real-world numbers of the Hypervisor Introspection solution running on Citrix Hypervisor 8.0 with #VE enabled.

OSSJP/ALS19: The Road to Safety Certification: Overcoming Community Challeng...

The Linux Foundation

Safety certification is one of the essential requirements for software to be used in highly regulated industries. Besides technical and compliance issues (such as ISO 26262 vs IEC 611508) transitioning an existing project to become more easily safety certifiable requires significant changes to development practices within an open source project. In this session, we will lay out some challenges of making safety certification achievable in open source and the Xen Project. We will outline the process the Xen Project has followed thus far and highlight lessons learned along the way. The talk will primarily focus on necessary process, tooling changes and community challenges that can prevent progress. We will be offering an in-depth review of how Xen Project is approaching this challenging goal and try to derive lessons for other projects and contributors.

OSSJP/ALS19: The Road to Safety Certification: How the Xen Project is Making...

The Linux Foundation

Safety certification is one of the essential requirements for software to be used in highly regulated industries. The Xen Project, a secure and stable hypervisor that is used in many different markets, has been exploring the feasibility of building safety certified products on top of Xen for a year, looking at key aspects of its code base and development practices. In this session, we will lay out the motivation and challenges of making safety certification achievable in open source and the Xen Project. We will outline the process the project has followed thus far and highlight lessons learned along the way. The talk will cover technical enablers, necessary process and tooling changes and community challenges offering an in-depth review of how Xen Project is approaching this exciting and and challenging goal.

XPDDS19: Speculative Sidechannels and Mitigations - Andrew Cooper, Citrix

The Linux Foundation

2018 saw fundamental shifts in security boundaries which were previously taken for granted. A lot of work has been done in the past 2 years, and largely in secret under embargo, but there is plenty more work to be done to strengthen the existing mitigations and to try to recover some performance without reopening security holes. This talk will look at speculative execution sidechannels, the work which has already been done to mitigate the security holes, and future work which hopes to bring some improvements.

XPDDS19: Keeping Coherency on Arm: Reborn - Julien Grall, Arm ltd

The Linux Foundation

The Arm architecture provides a set of guidelines that any software should abide by when accessing the memory with MMU off and update page-tables. Failing to do so may result in getting TLB conflicts or breaking coherency. In a previous talk ("Keeping coherency on Arm"), we focused on updating safely the stage-2 (aka P2M) page-tables. This talk will focus on the boot code and Xen memory management. During this session, we will introduce some of the guidelines and when they should be used. We will also discuss how Xen boot sequence needs to be reworked to avoid breaking the guidelines.

XPDDS19: QEMU PV Backend 'qdevification'... What Does it Mean? - Paul Durrant...

The Linux Foundation

For many years the QEMU codebase has contained PV backends for Xen guests, giving them paravirtual access to storage, network, keyboard, mouse, etc. however these backends have not been configurable as QEMU devices as their implementation did not fully adhere to the QEMU Object Model (QOM). Particularly the PV storage backend not using proper QOM devices, or qdevs, meant that the QEMU block layer needed to maintain legacy code that was cluttering up the source. This was causing push-back from the maintainers who did not want to accept any patches relating to that Xen backend until it was 'qdevified'. In this talk, I'll explain the modifications I made to QEMU to achieve 'qdevification' of the PV storage backend, how compatibility with the libxl toolstack was maintained, and what the next steps in both QEMU and libxl development should be.

XPDDS19: Status of PCI Emulation in Xen - Roger Pau Monné, Citrix Systems R&D

The Linux Foundation

PCI is a local computer bus for attaching hardware devices in a computer, and is the main peripheral bus on modern x86 systems. As such, having a proper way to emulate it is crucial for Xen to be able to expose both fully emulated devices or passthrough devices to guests. This talk will focus on the current status of PCI emulation in Xen, how and where it is used, what are its main limitations and future plans to improve it in order to be more robust and modular.

XPDDS19: [ARM] OP-TEE Mediator in Xen - Volodymyr Babchuk, EPAM Systems

The Linux Foundation

XPDDS19: Bringing Xen to the Masses: The Story of Building a Community-driven...

The Linux Foundation

Xen is a very powerful hypervisor with a talented and diverse developers community. Despite the fact it's almost everywhere (from the Cloud to the embedded world), it can be difficult to set up and manage as a system administrator. General purpose distros have Xen packages, but that's just a start in your Xen journey: you need some tooling and knowledge to have a working and scalable platform. XCP-ng was built to overcome those issues: by bringing Xen to the masses with a fully turnkey distro with Xen as its core. It's the logical sequel to the XCP project, with a community focus from the start. We'll see how it happened, what we did, and what's next. Finally, we'll see the impact of XCP-ng on the Xen Project.

XPDDS19: Will Robots Automate Your Job Away? Streamlining Xen Project Contrib...

The Linux Foundation

XPDDS19: Client Virtualization Toolstack in Go - Nick Rosbrook & Brendan Kerr...

The Linux Foundation

High level toolstacks for server and cloud virtualization are very mature with large communities using and supporting them. Client virtualization is a much more niche community with unique requirements when compared to those found in the server space. In this talk, we’ll introduce a client virtualization toolstack for Xen (redctl) that we are using in Redfield, a new open-source client virtualization distribution that builds upon the work done by the greater virtualization and Linux communities. We will present a case for maturing libxl’s Go bindings and discuss what advantages Go has to offer for high level toolstacks, including in the server space.

XPDDS19: Core Scheduling in Xen - Jürgen Groß, SUSE

The Linux Foundation

Today Xen is scheduling guest virtual cpus on all available physical cpus independently from each other. Recent security issues on modern processors (e.g. L1TF) require to turn off hyperthreading for best security in order to avoid leaking information from one hyperthread to the other. One way to avoid having to turn off hyperthreading is to only ever schedule virtual cpus of the same guest on one physical core at the same time. This is called core scheduling. This presentation shows results from the effort to implement core scheduling in the Xen hypervisor. The basic modifications in Xen are presented and performance numbers with core scheduling active are shown.

More from The Linux Foundation (20)