Xen Project Release and Roadmap Process (4.7+)

•Download as PPTX, PDF•

2 likes•38,497 views

Very short overview of the Xen Project Release and Roadmap Process (for the blog). It covers the process valid up to and including Xen 4.6, and the approved proposal for Xen 4.7 and newer.

Technology

Release and Roadmap Process
Vinovyn @ Flickr

Release Manager: Wei Liu
Accepted Proposal: Tweaked Release Process for Xen 4.7
lists.xenproject.org/archives/html/xen-devel/2015-11/msg00073.html

Reduce release cycle length to 6 months:
– 4 months development
– 2 months freeze, with earlier creation of release branch based on risk assessment
– Xen 4.7 will be slightly longer to support future June / December releases
Fixed and predictable Release dates
– Beginning of June and December of each year
– Eat into next cycle if we don't release on time
Fixed cut-off date:
– Freeze dates: last day of March and September of each year
– No more freeze exceptions, but heads-up mails about freeze will be sent a few weeks
beforehand
Maintenance support: no changes

Master branch on xen.git
Wait period
to clear test pushgate
RC’s
RELEASE-4.6.0 branch on xen.git
RELEASE-4.7.0 branch
based on risk assessment
Release
Announcement
Feature Development
Feature
Freeze
point
Last
Posting
Date

Release Manager declares that only bug fixes deemed blockers can be accepted
Creation of RELEASE-4.7.0 branch based on risk assessment
Master/Release branch on xen.git
Feature Development RC’s
This is when patches for the ongoing
release need to be submitted for review
Wait period
to clear test pushgate
No new features will be accepted
No Freeze Exceptions, will be allowed
Bug fixes are allowed, with approval by Maintainers/Release Manager

Release Manager:
Sends Monthly
Xen x.y Development Update
email on xen-devel@
Contributors:
Expected to reply if they are working on a feature that is not
on the list of tracked features
Expected to provide Status updates on features & bugs on the list
Not engaging with the process may lead to removal or downgrading
Release Manager:
Sends first
Xen x.y Development Update
email on xen-devel@
Deferred features from previous
release, Timetable, etc.
Contributors:
Expected to reply if they are working on a feature that is not
on the list of tracked features and tracked bugs
Release Manager:
RC Announcements, Test Days
Contributors:
Expected to provide Status updates on tracked bugs on the list
Release Manager:
Release Announcement

Release Manager: Wei Liu
Proposal: Tweaked Release Process for Xen 4.6
lists.xenproject.org/archives/html/xen-devel/2015-02/msg01214.html

Master branch on xen.git
Feature Development
Feature
Freeze
point
Wait period
to clear test pushgate
RC’s
Release
Announcement
RELEASE-4.5.0 branch on xen.git

Master branch on xen.git
Feature Development RC’s
This is when patches for the ongoing release
need to be submitted for review
Wait period
to clear test pushgate
No new features will be accepted, unless there is a Freeze Exception
Bug fixes are allowed, with approval by Maintainers/Release Manager
Release Manager declares that only bug fixes deemed
blockers can be accepted

Master branch on xen.git
Feature Development
Code
Freeze
Point
Feature
Freeze
point
Hardening
RC’s
Release
Announcement
RELEASE-4.5.0 branch on xen.git

Master branch on xen.git
Feature Development
Hardening
RC’s
This is when patches for the ongoing release
need to be submitted for review
No new Features
The focus of Hardening is on Bug Fixes
No bug fixes will be accepted, unless they are
deemed a blocker

This presentation covers the following topics - Theory: Open Source Flywheel - The demands on what vendors and users want from Xen Project is changing using the Flywheel to illustrate - The project has a recent history of change - Example: The history of the Security Vulnerability Management Process - Other examples of recent and ongoing changes - New demands on the project: New Features/Community Growth vs. Review Process and Review Capacity - New demands on the project: New Features/Community Growth vs. Quality and Security - Feature Lifecycle Management and Documentation

Release This! Tools for a Smooth Release Cycle

Guerrilla

Development 020810rohit3318

Webinar: Stop Midnight Release Madness!XebiaLabs

02-version control(DevOps Series)

Mohammed Shaban

Linked In Weekly Status Report (062011 062511)(1)RuxanaT

Sane Plugin Updates - WordCamp New York City, 2014

Pippin Williamson

Software Quality Management of Opensource Project ( ubuntu and django )uisp dsin

The Xen Project’s code contributions have been growing 10% a year. However, during this period of growth, the code review process became much slower, leading to issues in the community. Code review in the Xen Project—as in many other FOSS projects—is performed on mailing lists. During the last few years, the project observed an increase in the number of messages devoted to code review—in particular, an increase in the number of code review messages per patch series or individual patch. Everyone in the community had a different theory as to the root causes of the issues based on their observations: some developers believed we didn’t have enough reviewers, some felt the project’s maintainers had become more aggressive, and some felt code review was not coordinated enough. Many observations contradicted each other and were based only on opinions. Consequently, key members of the project could not agree on how to deal with the perceived issues. Lars Kurth and Daniel Izquierdo explain why the project decided to use data mining techniques using software development analytics to address the issue. The project needed a detailed analysis to verify which theories were valid, which were not, and which were missed. To do this, the team defined a number of parameters in the code review process to determine if it was deteriorating in some way and pinpoint the root causes of this deterioration, if any. Lars and Daniel cover the project’s journey through a number of stories and explore the techniques that enabled the community to improve their review process.

XPDS16: High-Performance Virtualization for HPC Cloud on Xen - Jun Nakajima &...

The Linux Foundation

We have been working to get Xen up and running on self-boot Intel® Xeon Phi processors to build HPC clouds. We see several challenges because of the unique (but not unusual for HPC) hardware technologies and performance requirements. For example, such hardware technologies include 1) >256 CPUs, 2) MCDRAM (high-bandwidth memory), 3) integrated fabric (i.e. Intel® Omni-Path). Unlike the “coprocessor“ model, supporting self-boot with >256 CPUs has various implications to Xen, including scheduling and scalability. We need to allow user applications to use MCDRAM directly to perform optimally. Also, we need to enable the integrated HPC fabric for the VM to use by direct I/O assignment. In addition, we have only a single VM on each node to meet the high-performance requirements of HPC clouds. This (i.e. non-shared) model allowed us to optimize Xen more. In this talk, we share our design and lessons, and discuss the options we considered to achieve high-performance virtualization for HPC.

Virtualization Architecture & KVM

Pradeep Kumar

Xen and the art of embedded virtualization (ELC 2017)

Stefano Stabellini

Hypervisors are becoming more and more widespread in embedded environments, from automotive to medical and avionics. Their use case is different from traditional server and desktop virtualization, and so are their requirements. This talk will explain why hypervisors are used in embedded, and the unique challenges posed by these environments to virtualization technologies. Xen, a popular open source hypervisor, was born to virtualize x86 Linux systems for the data center. It is now the leading open source hypervisor for ARM embedded platforms. The presentation will show how the ARM port of Xen differs from its x86 counterpart. It will go through the fundamental design decisions that made Xen a good choice for ARM embedded virtualization. The talk will explain the implementation of key features such as device assignment and interrupt virtualization.

virtualization and hypervisorsGaurav Suri

Hypervisors and Virtualization - VMware, Hyper-V, XenServer, and KVM

vwchu

With co-presenter Maninder Singh, delivered a presentation about hypervisors and virtualization technology for an independent topic study project for the Operating System Design (EECS 4221) course at York University, Canada in October 2014. Virtualization, briefly, is the separation of resources or requests for a service from the underlying physical delivery of that service. It is a concept in which access to a single underlying piece of hardware is coordinated so that multiple guest operating systems can share a single piece of hardware, with no guest operating system being aware that it is actually sharing anything at all.

LF Collaboration Summit: Xen Project 4 4 Features and Futures

The Linux Foundation

Performance Tuning Xen

The Linux Foundation

Xen Project: Windows PV Drivers

The Linux Foundation

마이크로서비스 아키텍처로 개발하기

Jaewoo Ahn

Xen Project Release and Roadmap Process

The Linux Foundation

XPDS16: Xen Development Update

The Linux Foundation

Branching and merging strategy

Rahul Janghel

Release With Maveneugenn

A successful Git branching model abodeltae

1st board meeting_20181011

Heejae(Kyungtaak) Noh

A simplified Gitflow

Geshan Manandhar

Lifecycle of a Product Requirement in RMsis

Optimizory Technologies Pvt. Ltd.

Lifecycle of a Product Requirement in RMsis

Optimizory Technologies Pvt. Ltd.

[WroclawJUG] Continuous Delivery in OSS using Shipkit

MarcinStachniuk

Lifecycle of a Product Requirement in RMsis

Optimizory Technologies Pvt. Ltd.

Reno: A new way to manage release notes

doughellmann

reno is a tool for managing release notes in projects that support multiple branches of development simultaneously. It lets you manage release notes within patches that fix bugs, and makes it easier to cherry-pick changes between branches for back- or forward-ports. This talk will cover the requirements, and constraints, that led us to design and build reno. I will also show how to use it to create notes, and publish them in your packages and via Sphinx-based documentation.

Viewers also liked

OSCON16: Analysis of the Xen code review process: An example of software deve...

The Linux Foundation

XPDS16: High-Performance Virtualization for HPC Cloud on Xen - Jun Nakajima &...

The Linux Foundation

Virtualization Architecture & KVM

Pradeep Kumar

Xen and the art of embedded virtualization (ELC 2017)

Stefano Stabellini

virtualization and hypervisorsGaurav Suri

Hypervisors and Virtualization - VMware, Hyper-V, XenServer, and KVM

vwchu

LF Collaboration Summit: Xen Project 4 4 Features and Futures

The Linux Foundation

Performance Tuning Xen

The Linux Foundation

Xen Project: Windows PV Drivers

The Linux Foundation

마이크로서비스 아키텍처로 개발하기

Jaewoo Ahn

Viewers also liked (10)

OSCON16: Analysis of the Xen code review process: An example of software deve...

XPDS16: High-Performance Virtualization for HPC Cloud on Xen - Jun Nakajima &...

Virtualization Architecture & KVM

Xen and the art of embedded virtualization (ELC 2017)

virtualization and hypervisors

Hypervisors and Virtualization - VMware, Hyper-V, XenServer, and KVM

LF Collaboration Summit: Xen Project 4 4 Features and Futures

Performance Tuning Xen

Xen Project: Windows PV Drivers

마이크로서비스 아키텍처로 개발하기

Similar to Xen Project Release and Roadmap Process (4.7+)

Xen Project Release and Roadmap Process

The Linux Foundation

XPDS16: Xen Development Update

The Linux Foundation

Branching and merging strategy

Rahul Janghel

Release With Maveneugenn

A successful Git branching model abodeltae

1st board meeting_20181011

Heejae(Kyungtaak) Noh

A simplified Gitflow

Geshan Manandhar

Lifecycle of a Product Requirement in RMsis

Optimizory Technologies Pvt. Ltd.

Lifecycle of a Product Requirement in RMsis

Optimizory Technologies Pvt. Ltd.

[WroclawJUG] Continuous Delivery in OSS using Shipkit

MarcinStachniuk

Lifecycle of a Product Requirement in RMsis

Optimizory Technologies Pvt. Ltd.

Reno: A new way to manage release notes

doughellmann

Continuous Delivery in OSS using Shipkit.org

MarcinStachniuk

Do you know how Continuous Delivery of Java Open Source libraries looks? How big is your release overhead? Do you update release notes and include contributors manually? How do you handle versioning? Do you use semantic versioning? During this workshop, you will learn how to set up Continuous Delivery for your library. You’ll never have to manually release new versions again. We will use the following tools: GitHub, TravisCI, Bintray, Maven Central. We will glue everything using Shipkit.org - a project born from Mockito (and still used there). You’ll additionally learn SerVer. This workshop is mostly for Java open source and Gradle plugins developers. We will use a library prepared especially for this training, so no worries if you don’t have your own open source project (yet). Prerequisites: GitHub account, Java & Gradle basics.

Reno A New Way to Manage Release Notes

doughellmann

Release Management Plan

Krishna Murthy RVN

Strategy to setup Subversion for Salesforce development for Agile Team

Buyan Thyagarajan

Git collaboration

Pham Quy (Jack)

Multi-QA Environment, parallel development with Git

dopejam

Source code management with Git

Radu Barbu

Multi-Branched development with Git Source Code Management

dopejam

Similar to Xen Project Release and Roadmap Process (4.7+) (20)

Xen Project Release and Roadmap Process

XPDS16: Xen Development Update

Branching and merging strategy

Release With Maven

A successful Git branching model

1st board meeting_20181011

A simplified Gitflow

Lifecycle of a Product Requirement in RMsis

[WroclawJUG] Continuous Delivery in OSS using Shipkit

Lifecycle of a Product Requirement in RMsis

Reno: A new way to manage release notes

Continuous Delivery in OSS using Shipkit.org

Reno A New Way to Manage Release Notes

Release Management Plan

Strategy to setup Subversion for Salesforce development for Agile Team

Git collaboration

Multi-QA Environment, parallel development with Git

Source code management with Git

Multi-Branched development with Git Source Code Management

More from The Linux Foundation

ELC2019: Static Partitioning Made Simple

The Linux Foundation

Static partitioning is used to split an embedded system into multiple domains, each of them having access only to a portion of the hardware on the SoC. It is key to enable mixed-criticality scenarios, where a critical application, often based on a small RTOS, runs alongside a larger non-critical app, typically based on Linux. The two domains cannot interfere with each other. This talk will explain how to use Xen for static partitioning. It will introduce dom0-less, a new Xen feature written for the purpose. Dom0-less allows multiple VMs to start at boot time directly from the Xen hypervisor, decreasing boot times drastically. It makes it very easy to partition the system without virtualization overhead. Dom0 becomes unnecessary. This presentation will go into details on how to setup a Xen dom0-less system. It will show configuration examples and explain device assignment. The talk will discuss its implications for latency-sensitive and safety-critical environments.

XPDDS19: How TrenchBoot is Enabling Measured Launch for Open-Source Platform ...

The Linux Foundation

TrenchBoot is a cross-community OSS integration project for hardware-rooted, late launch integrity of open and proprietary systems. It provides a general purpose, open-source DRTM kernel for measured system launch and attestation of device integrity to trust-centric access infrastructure. TrenchBoot closes the UEFI Measurement Gap and reduces the need to trust system firmware. This talk will introduce TrenchBoot architecture and a recent collaboration with Oracle to launch the Linux kernel directly with Intel TXT or AMD SVM Secure Launch. It will propose mechanisms for integrating the Xen hypervisor into a TrenchBoot system launch. DRTM-enabled capabilities for client, server and embedded platforms will be presented for consideration by the Xen community.

XPDDS19 Keynote: Xen in Automotive - Artem Mygaiev, Director, Technology Solu...

The Linux Foundation

Artem will briefly cover what has been done since the first talk on Xen in Automotive domain back in 2013, what is going on now and what is still missing for broad adaptation of Xen in vehicles. The following topics will be covered: Embedded/automotive features of Xen Collaboration with AGL and GENIVI organizations for standardization Efforts on Functional Safety compliance Artem will also go over typical automotive use scenarios for Xen which may not be the same as generic computing use of hypervisor.

XPDDS19 Keynote: Xen Project Weather Report 2019 - Lars Kurth, Director of Op...

The Linux Foundation

XPDDS19 Keynote: Unikraft Weather Report

The Linux Foundation

In recent years unikernels have shown immense performance potential (e.g., boot times of only a few ms, image sizes of only hundreds of KBs).The fundamental drawback of unikernels is that they require that applications be manually ported to the underlying minimalistic OS, needing both expert work and often considerable amount of time. The Unikraft project provides a unikernel code base and build system that significantly simplifies the building of unikernels. In addition to support for a number CPU architectures, languages and frameworks, Unikraft provides debugging and tracing features that are generally sorely missing from unikernel projects. In this talk we will talk about these features, show a set of preliminary performance numbers, and provide a roadmap for the project's future.

XPDDS19 Keynote: Secret-free Hypervisor: Now and Future - Wei Liu, Software E...

The Linux Foundation

XPDDS19 Keynote: Xen Dom0-less - Stefano Stabellini, Principal Engineer, Xilinx

The Linux Foundation

This talk will introduce Dom0-less: a new way of using Xen to build mixed-criticality solutions. Dom0-less is a Xen feature that adds a novel approach to static partitioning based on virtualization. It allows multiple domains to start at boot time directly from the Xen hypervisor, decreasing boot times dramatically. Xen userspace tools, such as xl and libvirt, become optional. Dom0-less extends the existing device tree based Xen boot protocol to cover information required by additional domains. Binaries, such as kernels and ramdisks, are loaded by the bootloader (u-boot) and advertised to Xen via new device tree bindings. The audience will learn how to use Dom0-less to partition the system. Uboot and device tree configuration details will be explained to enable the audience to get the most out of this feature. The talk will include a status update and details on future plans.

XPDDS19 Keynote: Patch Review for Non-maintainers - George Dunlap, Citrix Sys...

The Linux Foundation

As the number of contributions grow, reviewer bandwidth becomes a bottleneck; and maintainers are always asking for more help. However, ultimately maintainers must at least Ack every patch that goes in; so if you're not a maintainer, how can you contribute? Why should anyone care about your opinion? This talk will try to lay out some advice and guidelines for non-maintainers, for how they can do code review in a way which will effectively reduce the load on maintainers when they do come to review a patch.

XPDDS19: Memories of a VM Funk - Mihai Donțu, Bitdefender

The Linux Foundation

This talk is a follow-up to our Summit 2017 presentation in which we covered our plans for Intel VMFUNC and #VE, as well as related use-cases. This year, we will provide a report on what we have accomplished in Xen 4.12, and what remains to be addressed. We will also give a brief status update of VMI on AMD hardware. The session will end with some real-world numbers of the Hypervisor Introspection solution running on Citrix Hypervisor 8.0 with #VE enabled.

OSSJP/ALS19: The Road to Safety Certification: Overcoming Community Challeng...

The Linux Foundation

Safety certification is one of the essential requirements for software to be used in highly regulated industries. Besides technical and compliance issues (such as ISO 26262 vs IEC 611508) transitioning an existing project to become more easily safety certifiable requires significant changes to development practices within an open source project. In this session, we will lay out some challenges of making safety certification achievable in open source and the Xen Project. We will outline the process the Xen Project has followed thus far and highlight lessons learned along the way. The talk will primarily focus on necessary process, tooling changes and community challenges that can prevent progress. We will be offering an in-depth review of how Xen Project is approaching this challenging goal and try to derive lessons for other projects and contributors.

OSSJP/ALS19: The Road to Safety Certification: How the Xen Project is Making...

The Linux Foundation

Safety certification is one of the essential requirements for software to be used in highly regulated industries. The Xen Project, a secure and stable hypervisor that is used in many different markets, has been exploring the feasibility of building safety certified products on top of Xen for a year, looking at key aspects of its code base and development practices. In this session, we will lay out the motivation and challenges of making safety certification achievable in open source and the Xen Project. We will outline the process the project has followed thus far and highlight lessons learned along the way. The talk will cover technical enablers, necessary process and tooling changes and community challenges offering an in-depth review of how Xen Project is approaching this exciting and and challenging goal.

XPDDS19: Speculative Sidechannels and Mitigations - Andrew Cooper, Citrix

The Linux Foundation

2018 saw fundamental shifts in security boundaries which were previously taken for granted. A lot of work has been done in the past 2 years, and largely in secret under embargo, but there is plenty more work to be done to strengthen the existing mitigations and to try to recover some performance without reopening security holes. This talk will look at speculative execution sidechannels, the work which has already been done to mitigate the security holes, and future work which hopes to bring some improvements.

XPDDS19: Keeping Coherency on Arm: Reborn - Julien Grall, Arm ltd

The Linux Foundation

The Arm architecture provides a set of guidelines that any software should abide by when accessing the memory with MMU off and update page-tables. Failing to do so may result in getting TLB conflicts or breaking coherency. In a previous talk ("Keeping coherency on Arm"), we focused on updating safely the stage-2 (aka P2M) page-tables. This talk will focus on the boot code and Xen memory management. During this session, we will introduce some of the guidelines and when they should be used. We will also discuss how Xen boot sequence needs to be reworked to avoid breaking the guidelines.

XPDDS19: QEMU PV Backend 'qdevification'... What Does it Mean? - Paul Durrant...

The Linux Foundation

For many years the QEMU codebase has contained PV backends for Xen guests, giving them paravirtual access to storage, network, keyboard, mouse, etc. however these backends have not been configurable as QEMU devices as their implementation did not fully adhere to the QEMU Object Model (QOM). Particularly the PV storage backend not using proper QOM devices, or qdevs, meant that the QEMU block layer needed to maintain legacy code that was cluttering up the source. This was causing push-back from the maintainers who did not want to accept any patches relating to that Xen backend until it was 'qdevified'. In this talk, I'll explain the modifications I made to QEMU to achieve 'qdevification' of the PV storage backend, how compatibility with the libxl toolstack was maintained, and what the next steps in both QEMU and libxl development should be.

XPDDS19: Status of PCI Emulation in Xen - Roger Pau Monné, Citrix Systems R&D

The Linux Foundation

PCI is a local computer bus for attaching hardware devices in a computer, and is the main peripheral bus on modern x86 systems. As such, having a proper way to emulate it is crucial for Xen to be able to expose both fully emulated devices or passthrough devices to guests. This talk will focus on the current status of PCI emulation in Xen, how and where it is used, what are its main limitations and future plans to improve it in order to be more robust and modular.

XPDDS19: [ARM] OP-TEE Mediator in Xen - Volodymyr Babchuk, EPAM Systems

The Linux Foundation

XPDDS19: Bringing Xen to the Masses: The Story of Building a Community-driven...

The Linux Foundation

Xen is a very powerful hypervisor with a talented and diverse developers community. Despite the fact it's almost everywhere (from the Cloud to the embedded world), it can be difficult to set up and manage as a system administrator. General purpose distros have Xen packages, but that's just a start in your Xen journey: you need some tooling and knowledge to have a working and scalable platform. XCP-ng was built to overcome those issues: by bringing Xen to the masses with a fully turnkey distro with Xen as its core. It's the logical sequel to the XCP project, with a community focus from the start. We'll see how it happened, what we did, and what's next. Finally, we'll see the impact of XCP-ng on the Xen Project.

XPDDS19: Will Robots Automate Your Job Away? Streamlining Xen Project Contrib...

The Linux Foundation

XPDDS19: Client Virtualization Toolstack in Go - Nick Rosbrook & Brendan Kerr...

The Linux Foundation

High level toolstacks for server and cloud virtualization are very mature with large communities using and supporting them. Client virtualization is a much more niche community with unique requirements when compared to those found in the server space. In this talk, we’ll introduce a client virtualization toolstack for Xen (redctl) that we are using in Redfield, a new open-source client virtualization distribution that builds upon the work done by the greater virtualization and Linux communities. We will present a case for maturing libxl’s Go bindings and discuss what advantages Go has to offer for high level toolstacks, including in the server space.

XPDDS19: Core Scheduling in Xen - Jürgen Groß, SUSE

The Linux Foundation

Today Xen is scheduling guest virtual cpus on all available physical cpus independently from each other. Recent security issues on modern processors (e.g. L1TF) require to turn off hyperthreading for best security in order to avoid leaking information from one hyperthread to the other. One way to avoid having to turn off hyperthreading is to only ever schedule virtual cpus of the same guest on one physical core at the same time. This is called core scheduling. This presentation shows results from the effort to implement core scheduling in the Xen hypervisor. The basic modifications in Xen are presented and performance numbers with core scheduling active are shown.

More from The Linux Foundation (20)