SlideShare a Scribd company logo
1 of 25
Download to read offline
Practical Xen Testing at Intel
                              Nov. 2009


        Haicheng Li <haicheng.li@intel.com>
            Jiajun Xu <jiajun.xu@intel.com>


                       Xen Summit Asia 2009
Legal Information

•   INFORMATION IN THIS DOCUMENT IS PROVIDED IN CONNECTION WITH INTEL
    PRODUCTS. NO LICENSE, EXPRESS OR IMPLIED, BY ESTOPPEL OR OTHERWISE, TO
    ANY INTELLECTUAL PROPERTY RIGHTS IS GRANTED BY THIS DOCUMENT. EXCEPT
    AS PROVIDED IN INTEL'S TERMS AND CONDITIONS OF SALE FOR SUCH PRODUCTS,
    INTEL ASSUMES NO LIABILITY WHATSOEVER AND INTEL DISCLAIMS ANY EXPRESS
    OR IMPLIED WARRANTY, RELATING TO SALE AND/OR USE OF INTEL PRODUCTS
    INCLUDING LIABILITY OR WARRANTIES RELATING TO FITNESS FOR A PARTICULAR
    PURPOSE, MERCHANTABILITY, OR INFRINGEMENT OF ANY PATENT, COPYRIGHT OR
    OTHER INTELLECTUAL PROPERTY RIGHT.
•   Intel may make changes to specifications, product descriptions, and plans at any time, without
    notice.
•   All products, computer systems, dates, and figures specified are preliminary based on current
    expectations, and are subject to change without notice.
•   Performance tests and ratings are measured using specific computer systems and/or
    components and reflect the approximate performance of Intel products as measured by those
    tests. Any difference in system hardware or software design or configuration may affect
    actual performance.
•   Intel is a trademark of Intel Corporation in the U.S. and other countries.
•   *Other names and brands may be claimed as the property of others.
•   Copyright © 2009, Intel Corporation. All rights are protected.



                                                                  Software and Services Group
                                                                                                     2
                                                                                                     2
Agenda
• The Overview – how test helps Xen?
• Test Infrastructure – the world under automation
• Best Practices – practical test approaches
• Some Proposals – to improve Xen quality




                                               Software and Services Group
                                                                             3
                                                                             3
The Overview




               Software and Services Group
                                             4
                                             4
Progressive Xen Testing
                                              VT-x                                                SR-IOV
Intel VT
                                 VT- i                                                VT-d


           Dec. 2005       Oct. 2006     May. 2007      Jan. 2008         Aug. 2008                   Apr. 2009
           Xen-3.0.0       Xen-3.0.3     Xen-3.1.0      Xen-3.2.0         Xen-3.3.0                   Xen-3.4.0

XEN
                            • Hundreds of Xen patches Monthly !!!
                                                        XEN Development



                            •   How can TEST help?
                                  •
Test             HVM x86/IA64          PV Guest      Timers     NUMA      EPT      Power Management            RAS
Coverage
                 SMP VM                  Expose regression timely
                                 Live Migration
                                              TXT Real Mode Device Pass-Through                                SR-IOV


                                  •
                       3.0.x Release
                                         Ensure release quality
                                          3.1.x Release 3.2.x Release 3.3.x Release                   3.4.x Release
Test                   Test Reports         Test Reports       Test Reports        Test Reports       Test Reports
Deliverables
                          Nightly Test Reports                   Weekly Test Reports              Biweekly Test Reports

                                                           Actively Bug Tracking




                                                                                     Software and Services Group
                                                                                                                          5
                                                                                                                          5
Progressive Xen Testing
                                              VT-x                                               SR-IOV
Intel VT
                                 VT- i                                                 VT-d


           Dec. 2005       Oct. 2006     May. 2007      Jan. 2008          Aug. 2008                 Apr. 2009
           Xen-3.0.0       Xen-3.0.3     Xen-3.1.0      Xen-3.2.0          Xen-3.3.0                 Xen-3.4.0

XEN
                                                        XEN Development




Test             HVM x86/IA64          PV Guest      Timers      NUMA      EPT      Power Management           RAS
Coverage
                 SMP VM          Live Migration      TXT       Real Mode       Device Pass-Through             SR-IOV



                       3.0.x Release        3.1.x Release
                                                                ~300 major Release reported,
                                                                3.2.x Release 3.3.x
                                                                                    bugs 3.4.x Release
Test
Deliverables
                       Test Reports         Test Reports               20% of Xen Bugzilla
                                                                Test Reports  Test Reports Test Reports

                          Nightly Test Reports                    Weekly Test Reports           Biweekly Test Reports

                                                            Actively Bug Tracking




                                                                                     Software and Services Group
                                                                                                                        6
                                                                                                                        6
Test Infrastructure




                  Software and Services Group
                                                7
                                                7
Solid Test Infrastructure
• Test Automation in Everywhere
   – auto daily testing
   – auto release resting
   – auto patch testing
• Test Infrastructure is The Basis


                   •   Extendable Test Framework
                   •   Auto Build System
                   •   Test Result Center
                   •   Patch Test System


                                            Software and Services Group
                                                                          8
                                                                          8
Extendable Test Framework
                                                         Manual Testing
                                 Regular Testing
  Auto Build                     *XVS            Result submitter to Result Center




                        Common lib              *XVS: eXtendable Validation System
       Management Module
                                                                                      VT-d/
Controller             Report Generator                           VT-d                | -- VT-d lib
                                                                                      | -- test1
                                                                                      | -- test2
       Call with Scenario file
                                                                SR-IOV

                                          Test Suite Pool




                                                                     …
             Harness                                                                  SR-IOV/
                                                                 Power                | -- IOV lib
        Test Harness
                                                                                      | -- test1
                                                                                      | -- test2
                                                                  RAS



                                                              Software and Services Group
                                                                                                      9
                                                                                                      9
Test Result Center




    Find Defects Out
         Timely!




                  Software and Services Group
                                                10
                                                10
Patch Test System

           Recipe Submit UI         Machine Status UI           Result UI

        DB Tool                                                       Web UI




                        Receive
                                     Core Management
   Runtime DB            Recipe
                                                          Test Schedule                 Test Box 1
                                                                     Local Control
                          Scheduler
                                                                       Machine          Test Box 2
 Recipe




                                                                                              …
           Test Info                                                      Test Machine
R-Queue                                                                        Pool
                        Test Info            XVS
             Users                                                                      Test Box N
                                       Test Resources
  OSD

            Results                  Results Processing
Machines




                                                                Software and Services Group
                                                                                                     11
                                                                                                     11
Patch Test System




Ensure Patch Quality Before
     Submitting Out!




                     Software and Services Group
                                                   12
                                                   12
Best Practices




                 Software and Services Group
                                               13
                                               13
Power Management Testing
• Challenge
   – How to achieve integrated Power Management testing?
• Test Approach
   – Automated functionality testing.
        •   Interface : xenpm, hypercall, sysfs interface
        •   Coverage : idle, runtime, Dom0/HVM S3
   –   Performance measurement.
        •   Scenario : idle, runtime, benchmarks
        •   Platform : laptop & server
        •   OS          : Linux, Windows
        •   Publish : web site




                                                            Software and Services Group
                                                                                          14
                                                                                          14
Power Management Testing
• Challenge
   – How to achieve integrated power testing?
• Test Approach
   – Automated functionality testing.
        •   Interface : xenpm, hypercall, sys i/f
        •   Coverage : idle, runtime, Dom0/HVM S3
   –   Performance measurement.
        •   Scenario : idle, runtime, benchmarks
        •   Platform : laptop & server
        •   OS          : Linux, Windows
        •   Publish : web site




                                                    Software and Services Group
                                                                                  15
                                                                                  15
RAS Testing
• Challenge
   – How to achieve good test coverage?
• Test Approach
   – Add test stub to Xen to dump page types.
   – Add test stub to Xen to translate address from guest to host.
   – Use ACPI4.0/APEI to trigger CPU/Mem *MCE to specific pages.
• To Do
   – How to stress?
         •   Option: add more software test interface to *MCE handlers.
   –   CPU Migration
   –   MEM hot-plug
                                                *MCE: Machine Check Exception




                                                           Software and Services Group
                                                                                         16
                                                                                         16
RAS Testing
• Challenge
   – How to achieve good test coverage?
• Test Approach
   – Add test stub to Xen to dump page types.
   – Add test stub to Xen to What MCE test i/f guest to host.
                              translate address from Linux provides?
   – Use ACPI4.0/APEI to trigger CPU/Mem to trigger fake MCE
                             • MCE injector *MCE to specific pages.
                                • madvise syscall to poison page
• To Do                         • HWPosion injector to poison page
   – How to stress?             •……
         •   Option: add more software test interface to *MCE handlers.
   –   CPU Migration
   –   MEM hot-plug
                                                *MCE: Machine Check Error




                                                           Software and Services Group
                                                                                         17
                                                                                         17
VT-d/SR-IOV Testing
• Challenge
   – Hardware variety & complexity : platforms + devices
• Test Approach
   – Select typical test configurations.
         •   Platform : laptop -> desktop -> server
         •   Device : NIC, USB, SATA
         •   PCI type : PCIE MSI, PCIE INTx, PCI INTx
         •   OS         : Linux, Windows
   –   Use NIC to achieve test automation.
         •   Methods : ping, scp (file copy), ssh
         •   Coverage : static assignment + VT-d hotplug
         •   Multiple-devices assignment.




                                                           Software and Services Group
                                                                                         18
                                                                                         18
Some Proposals




                 Software and Services Group
                                               19
                                               19
Improve Xen Quality
• Source Control
   – Synchronize source control for Ioemu, Dom0 and Xen.
        •   E.g. VT-d is usually broken by ioemu check-in

• Bug Tracking
   – Well track bug state in Xen Bugzilla
        •   Current Xen BZ full of obsolete bug data
        •   ~500 bugs , 30% Xen Bugzilla, are NEW!

• Xen Testability
   – More built-in test features for Xen?
        •   It’s a trend for Linux: memleak checker, fault injector, ...




                                                                Software and Services Group
                                                                                              20
                                                                                              20
Questions?




             Software and Services Group
                                           21
                                           21
Backup




         Software and Services Group
                                       22
                                       22
Regular Testing

To keep Xen from regressions

                 Build Check        Booting Tests      Basic Functional Tests


      C/S Pull   Auto Build          Auto Install       Regression Testing              Bug Verification
           Daily Build                                          *BAT Testing

                                         Daily *BAT Test Cycle
                                                                *BAT: Build Acceptance Test
         Full Scope Functional Tests


            Functionality Testing        Performance Testing        Stress Testing          Others

                                               System Testing

                                       Monthly System Test Cycle



                                                                          Software and Services Group
                                                                                                           23
                                                                                                           23
Release Testing

To make qualified Xen release

                 Build Check        Booting Tests      Basic Functional Tests


      C/S Pull   Auto Build          Auto Install       Regression Testing              Bug Verification
          Release Build                                         *BAT Testing

                                       Release *BAT Test Cycle
                                                                *BAT: Build Acceptance Test
         Full Scope Functional Tests


            Functionality Testing        Performance Testing        Stress Testing          Others

                                               System Testing

                                       Release System Test Cycle



                                                                          Software and Services Group
                                                                                                           24
                                                                                                           24
Patch Testing

To ensure patch quality for Xen



                        Build Check   Booting Tests      Basic Functional Tests


                        Auto Build     Auto Install           Regression Testing
         Unit Testing                         Patch Testing

                                Patch Test Cycle




                                                                    Software and Services Group
                                                                                                  25
                                                                                                  25

More Related Content

Similar to Practical Xen Testing At Intel

Testing in an Open Source Middleware Platform Space The WSO2 Way.
Testing in an Open Source Middleware Platform Space  The WSO2 Way.Testing in an Open Source Middleware Platform Space  The WSO2 Way.
Testing in an Open Source Middleware Platform Space The WSO2 Way.WSO2
 
Agile Open Source Performance Testing Workshop for Business Managers
Agile Open Source Performance Testing Workshop for Business ManagersAgile Open Source Performance Testing Workshop for Business Managers
Agile Open Source Performance Testing Workshop for Business ManagersClever Moe
 
Accelerated test case - Anish bhanu
Accelerated test case - Anish bhanuAccelerated test case - Anish bhanu
Accelerated test case - Anish bhanuRoopa Nadkarni
 
Continuous deployment
Continuous deploymentContinuous deployment
Continuous deploymentMshwalbe
 
Continuous Delivery in the real world - techniques to reduce the developers b...
Continuous Delivery in the real world - techniques to reduce the developers b...Continuous Delivery in the real world - techniques to reduce the developers b...
Continuous Delivery in the real world - techniques to reduce the developers b...Nikolai Blackie
 
Releasing fast code - The DevOps approach
Releasing fast code - The DevOps approachReleasing fast code - The DevOps approach
Releasing fast code - The DevOps approachMichael Kopp
 
Ashwini - Effective use of CI by QA
Ashwini - Effective use of CI by QAAshwini - Effective use of CI by QA
Ashwini - Effective use of CI by QAvodQA
 
Parasoft Concerto A complete ALM platform that ensures quality software can b...
Parasoft Concerto A complete ALM platform that ensures quality software can b...Parasoft Concerto A complete ALM platform that ensures quality software can b...
Parasoft Concerto A complete ALM platform that ensures quality software can b...Engineering Software Lab
 
Unosquare SlideShare Presentation
Unosquare SlideShare PresentationUnosquare SlideShare Presentation
Unosquare SlideShare PresentationMichael Barrett
 
Continuous Deployment – Nextdoor.fi released every day at Scan-Agile 2011
Continuous Deployment – Nextdoor.fi released every day at Scan-Agile 2011Continuous Deployment – Nextdoor.fi released every day at Scan-Agile 2011
Continuous Deployment – Nextdoor.fi released every day at Scan-Agile 2011Marko Taipale
 
Testing Microservices
Testing MicroservicesTesting Microservices
Testing MicroservicesNathan Jones
 
Principles and Practices in Continuous Deployment at Etsy
Principles and Practices in Continuous Deployment at EtsyPrinciples and Practices in Continuous Deployment at Etsy
Principles and Practices in Continuous Deployment at EtsyMike Brittain
 
Agile Open Source Performance Test Workshop for Developers, Testers, IT Ops
Agile Open Source Performance Test Workshop for Developers, Testers, IT OpsAgile Open Source Performance Test Workshop for Developers, Testers, IT Ops
Agile Open Source Performance Test Workshop for Developers, Testers, IT OpsClever Moe
 
Business processes, business rules, complex event processing, the JBoss way
Business processes, business rules, complex event processing, the JBoss wayBusiness processes, business rules, complex event processing, the JBoss way
Business processes, business rules, complex event processing, the JBoss wayKris Verlaenen
 
Continuous Integration with TestMaker, Hudson, Jenkins, Bamboo
Continuous Integration with TestMaker, Hudson, Jenkins, BambooContinuous Integration with TestMaker, Hudson, Jenkins, Bamboo
Continuous Integration with TestMaker, Hudson, Jenkins, BambooClever Moe
 
資安控管實務技術
資安控管實務技術資安控管實務技術
資安控管實務技術bv8af4
 
System Testing and Integration: Test Strategy for Brahmaputra
System Testing and Integration: Test Strategy for BrahmaputraSystem Testing and Integration: Test Strategy for Brahmaputra
System Testing and Integration: Test Strategy for BrahmaputraOPNFV
 
Agile Testing Practices
Agile Testing PracticesAgile Testing Practices
Agile Testing PracticesPaul King
 

Similar to Practical Xen Testing At Intel (20)

Testing in an Open Source Middleware Platform Space The WSO2 Way.
Testing in an Open Source Middleware Platform Space  The WSO2 Way.Testing in an Open Source Middleware Platform Space  The WSO2 Way.
Testing in an Open Source Middleware Platform Space The WSO2 Way.
 
Agile Open Source Performance Testing Workshop for Business Managers
Agile Open Source Performance Testing Workshop for Business ManagersAgile Open Source Performance Testing Workshop for Business Managers
Agile Open Source Performance Testing Workshop for Business Managers
 
Accelerated test case - Anish bhanu
Accelerated test case - Anish bhanuAccelerated test case - Anish bhanu
Accelerated test case - Anish bhanu
 
Continuous deployment
Continuous deploymentContinuous deployment
Continuous deployment
 
Continuous Delivery in the real world - techniques to reduce the developers b...
Continuous Delivery in the real world - techniques to reduce the developers b...Continuous Delivery in the real world - techniques to reduce the developers b...
Continuous Delivery in the real world - techniques to reduce the developers b...
 
Releasing fast code - The DevOps approach
Releasing fast code - The DevOps approachReleasing fast code - The DevOps approach
Releasing fast code - The DevOps approach
 
Ashwini - Effective use of CI by QA
Ashwini - Effective use of CI by QAAshwini - Effective use of CI by QA
Ashwini - Effective use of CI by QA
 
Parasoft Concerto A complete ALM platform that ensures quality software can b...
Parasoft Concerto A complete ALM platform that ensures quality software can b...Parasoft Concerto A complete ALM platform that ensures quality software can b...
Parasoft Concerto A complete ALM platform that ensures quality software can b...
 
Unosquare SlideShare Presentation
Unosquare SlideShare PresentationUnosquare SlideShare Presentation
Unosquare SlideShare Presentation
 
Continuous Deployment – Nextdoor.fi released every day at Scan-Agile 2011
Continuous Deployment – Nextdoor.fi released every day at Scan-Agile 2011Continuous Deployment – Nextdoor.fi released every day at Scan-Agile 2011
Continuous Deployment – Nextdoor.fi released every day at Scan-Agile 2011
 
Testing Microservices
Testing MicroservicesTesting Microservices
Testing Microservices
 
Continuous Integration & the Release Maturity Model
Continuous Integration & the Release Maturity Model Continuous Integration & the Release Maturity Model
Continuous Integration & the Release Maturity Model
 
Principles and Practices in Continuous Deployment at Etsy
Principles and Practices in Continuous Deployment at EtsyPrinciples and Practices in Continuous Deployment at Etsy
Principles and Practices in Continuous Deployment at Etsy
 
Agile Open Source Performance Test Workshop for Developers, Testers, IT Ops
Agile Open Source Performance Test Workshop for Developers, Testers, IT OpsAgile Open Source Performance Test Workshop for Developers, Testers, IT Ops
Agile Open Source Performance Test Workshop for Developers, Testers, IT Ops
 
Business processes, business rules, complex event processing, the JBoss way
Business processes, business rules, complex event processing, the JBoss wayBusiness processes, business rules, complex event processing, the JBoss way
Business processes, business rules, complex event processing, the JBoss way
 
Continuous Integration with TestMaker, Hudson, Jenkins, Bamboo
Continuous Integration with TestMaker, Hudson, Jenkins, BambooContinuous Integration with TestMaker, Hudson, Jenkins, Bamboo
Continuous Integration with TestMaker, Hudson, Jenkins, Bamboo
 
資安控管實務技術
資安控管實務技術資安控管實務技術
資安控管實務技術
 
System Testing and Integration: Test Strategy for Brahmaputra
System Testing and Integration: Test Strategy for BrahmaputraSystem Testing and Integration: Test Strategy for Brahmaputra
System Testing and Integration: Test Strategy for Brahmaputra
 
Agile Testing Practices
Agile Testing PracticesAgile Testing Practices
Agile Testing Practices
 
Performance testing material
Performance testing materialPerformance testing material
Performance testing material
 

More from The Linux Foundation

ELC2019: Static Partitioning Made Simple
ELC2019: Static Partitioning Made SimpleELC2019: Static Partitioning Made Simple
ELC2019: Static Partitioning Made SimpleThe Linux Foundation
 
XPDDS19: How TrenchBoot is Enabling Measured Launch for Open-Source Platform ...
XPDDS19: How TrenchBoot is Enabling Measured Launch for Open-Source Platform ...XPDDS19: How TrenchBoot is Enabling Measured Launch for Open-Source Platform ...
XPDDS19: How TrenchBoot is Enabling Measured Launch for Open-Source Platform ...The Linux Foundation
 
XPDDS19 Keynote: Xen in Automotive - Artem Mygaiev, Director, Technology Solu...
XPDDS19 Keynote: Xen in Automotive - Artem Mygaiev, Director, Technology Solu...XPDDS19 Keynote: Xen in Automotive - Artem Mygaiev, Director, Technology Solu...
XPDDS19 Keynote: Xen in Automotive - Artem Mygaiev, Director, Technology Solu...The Linux Foundation
 
XPDDS19 Keynote: Xen Project Weather Report 2019 - Lars Kurth, Director of Op...
XPDDS19 Keynote: Xen Project Weather Report 2019 - Lars Kurth, Director of Op...XPDDS19 Keynote: Xen Project Weather Report 2019 - Lars Kurth, Director of Op...
XPDDS19 Keynote: Xen Project Weather Report 2019 - Lars Kurth, Director of Op...The Linux Foundation
 
XPDDS19 Keynote: Unikraft Weather Report
XPDDS19 Keynote:  Unikraft Weather ReportXPDDS19 Keynote:  Unikraft Weather Report
XPDDS19 Keynote: Unikraft Weather ReportThe Linux Foundation
 
XPDDS19 Keynote: Secret-free Hypervisor: Now and Future - Wei Liu, Software E...
XPDDS19 Keynote: Secret-free Hypervisor: Now and Future - Wei Liu, Software E...XPDDS19 Keynote: Secret-free Hypervisor: Now and Future - Wei Liu, Software E...
XPDDS19 Keynote: Secret-free Hypervisor: Now and Future - Wei Liu, Software E...The Linux Foundation
 
XPDDS19 Keynote: Xen Dom0-less - Stefano Stabellini, Principal Engineer, Xilinx
XPDDS19 Keynote: Xen Dom0-less - Stefano Stabellini, Principal Engineer, XilinxXPDDS19 Keynote: Xen Dom0-less - Stefano Stabellini, Principal Engineer, Xilinx
XPDDS19 Keynote: Xen Dom0-less - Stefano Stabellini, Principal Engineer, XilinxThe Linux Foundation
 
XPDDS19 Keynote: Patch Review for Non-maintainers - George Dunlap, Citrix Sys...
XPDDS19 Keynote: Patch Review for Non-maintainers - George Dunlap, Citrix Sys...XPDDS19 Keynote: Patch Review for Non-maintainers - George Dunlap, Citrix Sys...
XPDDS19 Keynote: Patch Review for Non-maintainers - George Dunlap, Citrix Sys...The Linux Foundation
 
XPDDS19: Memories of a VM Funk - Mihai Donțu, Bitdefender
XPDDS19: Memories of a VM Funk - Mihai Donțu, BitdefenderXPDDS19: Memories of a VM Funk - Mihai Donțu, Bitdefender
XPDDS19: Memories of a VM Funk - Mihai Donțu, BitdefenderThe Linux Foundation
 
OSSJP/ALS19: The Road to Safety Certification: Overcoming Community Challeng...
OSSJP/ALS19:  The Road to Safety Certification: Overcoming Community Challeng...OSSJP/ALS19:  The Road to Safety Certification: Overcoming Community Challeng...
OSSJP/ALS19: The Road to Safety Certification: Overcoming Community Challeng...The Linux Foundation
 
OSSJP/ALS19: The Road to Safety Certification: How the Xen Project is Making...
 OSSJP/ALS19: The Road to Safety Certification: How the Xen Project is Making... OSSJP/ALS19: The Road to Safety Certification: How the Xen Project is Making...
OSSJP/ALS19: The Road to Safety Certification: How the Xen Project is Making...The Linux Foundation
 
XPDDS19: Speculative Sidechannels and Mitigations - Andrew Cooper, Citrix
XPDDS19: Speculative Sidechannels and Mitigations - Andrew Cooper, CitrixXPDDS19: Speculative Sidechannels and Mitigations - Andrew Cooper, Citrix
XPDDS19: Speculative Sidechannels and Mitigations - Andrew Cooper, CitrixThe Linux Foundation
 
XPDDS19: Keeping Coherency on Arm: Reborn - Julien Grall, Arm ltd
XPDDS19: Keeping Coherency on Arm: Reborn - Julien Grall, Arm ltdXPDDS19: Keeping Coherency on Arm: Reborn - Julien Grall, Arm ltd
XPDDS19: Keeping Coherency on Arm: Reborn - Julien Grall, Arm ltdThe Linux Foundation
 
XPDDS19: QEMU PV Backend 'qdevification'... What Does it Mean? - Paul Durrant...
XPDDS19: QEMU PV Backend 'qdevification'... What Does it Mean? - Paul Durrant...XPDDS19: QEMU PV Backend 'qdevification'... What Does it Mean? - Paul Durrant...
XPDDS19: QEMU PV Backend 'qdevification'... What Does it Mean? - Paul Durrant...The Linux Foundation
 
XPDDS19: Status of PCI Emulation in Xen - Roger Pau Monné, Citrix Systems R&D
XPDDS19: Status of PCI Emulation in Xen - Roger Pau Monné, Citrix Systems R&DXPDDS19: Status of PCI Emulation in Xen - Roger Pau Monné, Citrix Systems R&D
XPDDS19: Status of PCI Emulation in Xen - Roger Pau Monné, Citrix Systems R&DThe Linux Foundation
 
XPDDS19: [ARM] OP-TEE Mediator in Xen - Volodymyr Babchuk, EPAM Systems
XPDDS19: [ARM] OP-TEE Mediator in Xen - Volodymyr Babchuk, EPAM SystemsXPDDS19: [ARM] OP-TEE Mediator in Xen - Volodymyr Babchuk, EPAM Systems
XPDDS19: [ARM] OP-TEE Mediator in Xen - Volodymyr Babchuk, EPAM SystemsThe Linux Foundation
 
XPDDS19: Bringing Xen to the Masses: The Story of Building a Community-driven...
XPDDS19: Bringing Xen to the Masses: The Story of Building a Community-driven...XPDDS19: Bringing Xen to the Masses: The Story of Building a Community-driven...
XPDDS19: Bringing Xen to the Masses: The Story of Building a Community-driven...The Linux Foundation
 
XPDDS19: Will Robots Automate Your Job Away? Streamlining Xen Project Contrib...
XPDDS19: Will Robots Automate Your Job Away? Streamlining Xen Project Contrib...XPDDS19: Will Robots Automate Your Job Away? Streamlining Xen Project Contrib...
XPDDS19: Will Robots Automate Your Job Away? Streamlining Xen Project Contrib...The Linux Foundation
 
XPDDS19: Client Virtualization Toolstack in Go - Nick Rosbrook & Brendan Kerr...
XPDDS19: Client Virtualization Toolstack in Go - Nick Rosbrook & Brendan Kerr...XPDDS19: Client Virtualization Toolstack in Go - Nick Rosbrook & Brendan Kerr...
XPDDS19: Client Virtualization Toolstack in Go - Nick Rosbrook & Brendan Kerr...The Linux Foundation
 
XPDDS19: Core Scheduling in Xen - Jürgen Groß, SUSE
XPDDS19: Core Scheduling in Xen - Jürgen Groß, SUSEXPDDS19: Core Scheduling in Xen - Jürgen Groß, SUSE
XPDDS19: Core Scheduling in Xen - Jürgen Groß, SUSEThe Linux Foundation
 

More from The Linux Foundation (20)

ELC2019: Static Partitioning Made Simple
ELC2019: Static Partitioning Made SimpleELC2019: Static Partitioning Made Simple
ELC2019: Static Partitioning Made Simple
 
XPDDS19: How TrenchBoot is Enabling Measured Launch for Open-Source Platform ...
XPDDS19: How TrenchBoot is Enabling Measured Launch for Open-Source Platform ...XPDDS19: How TrenchBoot is Enabling Measured Launch for Open-Source Platform ...
XPDDS19: How TrenchBoot is Enabling Measured Launch for Open-Source Platform ...
 
XPDDS19 Keynote: Xen in Automotive - Artem Mygaiev, Director, Technology Solu...
XPDDS19 Keynote: Xen in Automotive - Artem Mygaiev, Director, Technology Solu...XPDDS19 Keynote: Xen in Automotive - Artem Mygaiev, Director, Technology Solu...
XPDDS19 Keynote: Xen in Automotive - Artem Mygaiev, Director, Technology Solu...
 
XPDDS19 Keynote: Xen Project Weather Report 2019 - Lars Kurth, Director of Op...
XPDDS19 Keynote: Xen Project Weather Report 2019 - Lars Kurth, Director of Op...XPDDS19 Keynote: Xen Project Weather Report 2019 - Lars Kurth, Director of Op...
XPDDS19 Keynote: Xen Project Weather Report 2019 - Lars Kurth, Director of Op...
 
XPDDS19 Keynote: Unikraft Weather Report
XPDDS19 Keynote:  Unikraft Weather ReportXPDDS19 Keynote:  Unikraft Weather Report
XPDDS19 Keynote: Unikraft Weather Report
 
XPDDS19 Keynote: Secret-free Hypervisor: Now and Future - Wei Liu, Software E...
XPDDS19 Keynote: Secret-free Hypervisor: Now and Future - Wei Liu, Software E...XPDDS19 Keynote: Secret-free Hypervisor: Now and Future - Wei Liu, Software E...
XPDDS19 Keynote: Secret-free Hypervisor: Now and Future - Wei Liu, Software E...
 
XPDDS19 Keynote: Xen Dom0-less - Stefano Stabellini, Principal Engineer, Xilinx
XPDDS19 Keynote: Xen Dom0-less - Stefano Stabellini, Principal Engineer, XilinxXPDDS19 Keynote: Xen Dom0-less - Stefano Stabellini, Principal Engineer, Xilinx
XPDDS19 Keynote: Xen Dom0-less - Stefano Stabellini, Principal Engineer, Xilinx
 
XPDDS19 Keynote: Patch Review for Non-maintainers - George Dunlap, Citrix Sys...
XPDDS19 Keynote: Patch Review for Non-maintainers - George Dunlap, Citrix Sys...XPDDS19 Keynote: Patch Review for Non-maintainers - George Dunlap, Citrix Sys...
XPDDS19 Keynote: Patch Review for Non-maintainers - George Dunlap, Citrix Sys...
 
XPDDS19: Memories of a VM Funk - Mihai Donțu, Bitdefender
XPDDS19: Memories of a VM Funk - Mihai Donțu, BitdefenderXPDDS19: Memories of a VM Funk - Mihai Donțu, Bitdefender
XPDDS19: Memories of a VM Funk - Mihai Donțu, Bitdefender
 
OSSJP/ALS19: The Road to Safety Certification: Overcoming Community Challeng...
OSSJP/ALS19:  The Road to Safety Certification: Overcoming Community Challeng...OSSJP/ALS19:  The Road to Safety Certification: Overcoming Community Challeng...
OSSJP/ALS19: The Road to Safety Certification: Overcoming Community Challeng...
 
OSSJP/ALS19: The Road to Safety Certification: How the Xen Project is Making...
 OSSJP/ALS19: The Road to Safety Certification: How the Xen Project is Making... OSSJP/ALS19: The Road to Safety Certification: How the Xen Project is Making...
OSSJP/ALS19: The Road to Safety Certification: How the Xen Project is Making...
 
XPDDS19: Speculative Sidechannels and Mitigations - Andrew Cooper, Citrix
XPDDS19: Speculative Sidechannels and Mitigations - Andrew Cooper, CitrixXPDDS19: Speculative Sidechannels and Mitigations - Andrew Cooper, Citrix
XPDDS19: Speculative Sidechannels and Mitigations - Andrew Cooper, Citrix
 
XPDDS19: Keeping Coherency on Arm: Reborn - Julien Grall, Arm ltd
XPDDS19: Keeping Coherency on Arm: Reborn - Julien Grall, Arm ltdXPDDS19: Keeping Coherency on Arm: Reborn - Julien Grall, Arm ltd
XPDDS19: Keeping Coherency on Arm: Reborn - Julien Grall, Arm ltd
 
XPDDS19: QEMU PV Backend 'qdevification'... What Does it Mean? - Paul Durrant...
XPDDS19: QEMU PV Backend 'qdevification'... What Does it Mean? - Paul Durrant...XPDDS19: QEMU PV Backend 'qdevification'... What Does it Mean? - Paul Durrant...
XPDDS19: QEMU PV Backend 'qdevification'... What Does it Mean? - Paul Durrant...
 
XPDDS19: Status of PCI Emulation in Xen - Roger Pau Monné, Citrix Systems R&D
XPDDS19: Status of PCI Emulation in Xen - Roger Pau Monné, Citrix Systems R&DXPDDS19: Status of PCI Emulation in Xen - Roger Pau Monné, Citrix Systems R&D
XPDDS19: Status of PCI Emulation in Xen - Roger Pau Monné, Citrix Systems R&D
 
XPDDS19: [ARM] OP-TEE Mediator in Xen - Volodymyr Babchuk, EPAM Systems
XPDDS19: [ARM] OP-TEE Mediator in Xen - Volodymyr Babchuk, EPAM SystemsXPDDS19: [ARM] OP-TEE Mediator in Xen - Volodymyr Babchuk, EPAM Systems
XPDDS19: [ARM] OP-TEE Mediator in Xen - Volodymyr Babchuk, EPAM Systems
 
XPDDS19: Bringing Xen to the Masses: The Story of Building a Community-driven...
XPDDS19: Bringing Xen to the Masses: The Story of Building a Community-driven...XPDDS19: Bringing Xen to the Masses: The Story of Building a Community-driven...
XPDDS19: Bringing Xen to the Masses: The Story of Building a Community-driven...
 
XPDDS19: Will Robots Automate Your Job Away? Streamlining Xen Project Contrib...
XPDDS19: Will Robots Automate Your Job Away? Streamlining Xen Project Contrib...XPDDS19: Will Robots Automate Your Job Away? Streamlining Xen Project Contrib...
XPDDS19: Will Robots Automate Your Job Away? Streamlining Xen Project Contrib...
 
XPDDS19: Client Virtualization Toolstack in Go - Nick Rosbrook & Brendan Kerr...
XPDDS19: Client Virtualization Toolstack in Go - Nick Rosbrook & Brendan Kerr...XPDDS19: Client Virtualization Toolstack in Go - Nick Rosbrook & Brendan Kerr...
XPDDS19: Client Virtualization Toolstack in Go - Nick Rosbrook & Brendan Kerr...
 
XPDDS19: Core Scheduling in Xen - Jürgen Groß, SUSE
XPDDS19: Core Scheduling in Xen - Jürgen Groß, SUSEXPDDS19: Core Scheduling in Xen - Jürgen Groß, SUSE
XPDDS19: Core Scheduling in Xen - Jürgen Groß, SUSE
 

Recently uploaded

Microsoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - QuestionnaireMicrosoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - QuestionnaireExakis Nelite
 
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...ScyllaDB
 
Google I/O Extended 2024 Warsaw
Google I/O Extended 2024 WarsawGoogle I/O Extended 2024 Warsaw
Google I/O Extended 2024 WarsawGDSC PJATK
 
UiPath manufacturing technology benefits and AI overview
UiPath manufacturing technology benefits and AI overviewUiPath manufacturing technology benefits and AI overview
UiPath manufacturing technology benefits and AI overviewDianaGray10
 
Vector Search @ sw2con for slideshare.pptx
Vector Search @ sw2con for slideshare.pptxVector Search @ sw2con for slideshare.pptx
Vector Search @ sw2con for slideshare.pptxjbellis
 
State of the Smart Building Startup Landscape 2024!
State of the Smart Building Startup Landscape 2024!State of the Smart Building Startup Landscape 2024!
State of the Smart Building Startup Landscape 2024!Memoori
 
Frisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdf
Frisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdfFrisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdf
Frisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdfAnubhavMangla3
 
Intro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptxIntro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptxFIDO Alliance
 
Oauth 2.0 Introduction and Flows with MuleSoft
Oauth 2.0 Introduction and Flows with MuleSoftOauth 2.0 Introduction and Flows with MuleSoft
Oauth 2.0 Introduction and Flows with MuleSoftshyamraj55
 
ChatGPT and Beyond - Elevating DevOps Productivity
ChatGPT and Beyond - Elevating DevOps ProductivityChatGPT and Beyond - Elevating DevOps Productivity
ChatGPT and Beyond - Elevating DevOps ProductivityVictorSzoltysek
 
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptxHarnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptxFIDO Alliance
 
Syngulon - Selection technology May 2024.pdf
Syngulon - Selection technology May 2024.pdfSyngulon - Selection technology May 2024.pdf
Syngulon - Selection technology May 2024.pdfSyngulon
 
The Metaverse: Are We There Yet?
The  Metaverse:    Are   We  There  Yet?The  Metaverse:    Are   We  There  Yet?
The Metaverse: Are We There Yet?Mark Billinghurst
 
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...TrustArc
 
WebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM PerformanceWebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM PerformanceSamy Fodil
 
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)Paige Cruz
 
(Explainable) Data-Centric AI: what are you explaininhg, and to whom?
(Explainable) Data-Centric AI: what are you explaininhg, and to whom?(Explainable) Data-Centric AI: what are you explaininhg, and to whom?
(Explainable) Data-Centric AI: what are you explaininhg, and to whom?Paolo Missier
 
Generative AI Use Cases and Applications.pdf
Generative AI Use Cases and Applications.pdfGenerative AI Use Cases and Applications.pdf
Generative AI Use Cases and Applications.pdfalexjohnson7307
 
1111 ChatGPT Prompts PDF Free Download - Prompts for ChatGPT
1111 ChatGPT Prompts PDF Free Download - Prompts for ChatGPT1111 ChatGPT Prompts PDF Free Download - Prompts for ChatGPT
1111 ChatGPT Prompts PDF Free Download - Prompts for ChatGPTiSEO AI
 
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...marcuskenyatta275
 

Recently uploaded (20)

Microsoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - QuestionnaireMicrosoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - Questionnaire
 
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
 
Google I/O Extended 2024 Warsaw
Google I/O Extended 2024 WarsawGoogle I/O Extended 2024 Warsaw
Google I/O Extended 2024 Warsaw
 
UiPath manufacturing technology benefits and AI overview
UiPath manufacturing technology benefits and AI overviewUiPath manufacturing technology benefits and AI overview
UiPath manufacturing technology benefits and AI overview
 
Vector Search @ sw2con for slideshare.pptx
Vector Search @ sw2con for slideshare.pptxVector Search @ sw2con for slideshare.pptx
Vector Search @ sw2con for slideshare.pptx
 
State of the Smart Building Startup Landscape 2024!
State of the Smart Building Startup Landscape 2024!State of the Smart Building Startup Landscape 2024!
State of the Smart Building Startup Landscape 2024!
 
Frisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdf
Frisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdfFrisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdf
Frisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdf
 
Intro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptxIntro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptx
 
Oauth 2.0 Introduction and Flows with MuleSoft
Oauth 2.0 Introduction and Flows with MuleSoftOauth 2.0 Introduction and Flows with MuleSoft
Oauth 2.0 Introduction and Flows with MuleSoft
 
ChatGPT and Beyond - Elevating DevOps Productivity
ChatGPT and Beyond - Elevating DevOps ProductivityChatGPT and Beyond - Elevating DevOps Productivity
ChatGPT and Beyond - Elevating DevOps Productivity
 
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptxHarnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
 
Syngulon - Selection technology May 2024.pdf
Syngulon - Selection technology May 2024.pdfSyngulon - Selection technology May 2024.pdf
Syngulon - Selection technology May 2024.pdf
 
The Metaverse: Are We There Yet?
The  Metaverse:    Are   We  There  Yet?The  Metaverse:    Are   We  There  Yet?
The Metaverse: Are We There Yet?
 
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
 
WebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM PerformanceWebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM Performance
 
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
 
(Explainable) Data-Centric AI: what are you explaininhg, and to whom?
(Explainable) Data-Centric AI: what are you explaininhg, and to whom?(Explainable) Data-Centric AI: what are you explaininhg, and to whom?
(Explainable) Data-Centric AI: what are you explaininhg, and to whom?
 
Generative AI Use Cases and Applications.pdf
Generative AI Use Cases and Applications.pdfGenerative AI Use Cases and Applications.pdf
Generative AI Use Cases and Applications.pdf
 
1111 ChatGPT Prompts PDF Free Download - Prompts for ChatGPT
1111 ChatGPT Prompts PDF Free Download - Prompts for ChatGPT1111 ChatGPT Prompts PDF Free Download - Prompts for ChatGPT
1111 ChatGPT Prompts PDF Free Download - Prompts for ChatGPT
 
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...
 

Practical Xen Testing At Intel

  • 1. Practical Xen Testing at Intel Nov. 2009 Haicheng Li <haicheng.li@intel.com> Jiajun Xu <jiajun.xu@intel.com> Xen Summit Asia 2009
  • 2. Legal Information • INFORMATION IN THIS DOCUMENT IS PROVIDED IN CONNECTION WITH INTEL PRODUCTS. NO LICENSE, EXPRESS OR IMPLIED, BY ESTOPPEL OR OTHERWISE, TO ANY INTELLECTUAL PROPERTY RIGHTS IS GRANTED BY THIS DOCUMENT. EXCEPT AS PROVIDED IN INTEL'S TERMS AND CONDITIONS OF SALE FOR SUCH PRODUCTS, INTEL ASSUMES NO LIABILITY WHATSOEVER AND INTEL DISCLAIMS ANY EXPRESS OR IMPLIED WARRANTY, RELATING TO SALE AND/OR USE OF INTEL PRODUCTS INCLUDING LIABILITY OR WARRANTIES RELATING TO FITNESS FOR A PARTICULAR PURPOSE, MERCHANTABILITY, OR INFRINGEMENT OF ANY PATENT, COPYRIGHT OR OTHER INTELLECTUAL PROPERTY RIGHT. • Intel may make changes to specifications, product descriptions, and plans at any time, without notice. • All products, computer systems, dates, and figures specified are preliminary based on current expectations, and are subject to change without notice. • Performance tests and ratings are measured using specific computer systems and/or components and reflect the approximate performance of Intel products as measured by those tests. Any difference in system hardware or software design or configuration may affect actual performance. • Intel is a trademark of Intel Corporation in the U.S. and other countries. • *Other names and brands may be claimed as the property of others. • Copyright © 2009, Intel Corporation. All rights are protected. Software and Services Group 2 2
  • 3. Agenda • The Overview – how test helps Xen? • Test Infrastructure – the world under automation • Best Practices – practical test approaches • Some Proposals – to improve Xen quality Software and Services Group 3 3
  • 4. The Overview Software and Services Group 4 4
  • 5. Progressive Xen Testing VT-x SR-IOV Intel VT VT- i VT-d Dec. 2005 Oct. 2006 May. 2007 Jan. 2008 Aug. 2008 Apr. 2009 Xen-3.0.0 Xen-3.0.3 Xen-3.1.0 Xen-3.2.0 Xen-3.3.0 Xen-3.4.0 XEN • Hundreds of Xen patches Monthly !!! XEN Development • How can TEST help? • Test HVM x86/IA64 PV Guest Timers NUMA EPT Power Management RAS Coverage SMP VM Expose regression timely Live Migration TXT Real Mode Device Pass-Through SR-IOV • 3.0.x Release Ensure release quality 3.1.x Release 3.2.x Release 3.3.x Release 3.4.x Release Test Test Reports Test Reports Test Reports Test Reports Test Reports Deliverables Nightly Test Reports Weekly Test Reports Biweekly Test Reports Actively Bug Tracking Software and Services Group 5 5
  • 6. Progressive Xen Testing VT-x SR-IOV Intel VT VT- i VT-d Dec. 2005 Oct. 2006 May. 2007 Jan. 2008 Aug. 2008 Apr. 2009 Xen-3.0.0 Xen-3.0.3 Xen-3.1.0 Xen-3.2.0 Xen-3.3.0 Xen-3.4.0 XEN XEN Development Test HVM x86/IA64 PV Guest Timers NUMA EPT Power Management RAS Coverage SMP VM Live Migration TXT Real Mode Device Pass-Through SR-IOV 3.0.x Release 3.1.x Release ~300 major Release reported, 3.2.x Release 3.3.x bugs 3.4.x Release Test Deliverables Test Reports Test Reports 20% of Xen Bugzilla Test Reports Test Reports Test Reports Nightly Test Reports Weekly Test Reports Biweekly Test Reports Actively Bug Tracking Software and Services Group 6 6
  • 7. Test Infrastructure Software and Services Group 7 7
  • 8. Solid Test Infrastructure • Test Automation in Everywhere – auto daily testing – auto release resting – auto patch testing • Test Infrastructure is The Basis • Extendable Test Framework • Auto Build System • Test Result Center • Patch Test System Software and Services Group 8 8
  • 9. Extendable Test Framework Manual Testing Regular Testing Auto Build *XVS Result submitter to Result Center Common lib *XVS: eXtendable Validation System Management Module VT-d/ Controller Report Generator VT-d | -- VT-d lib | -- test1 | -- test2 Call with Scenario file SR-IOV Test Suite Pool … Harness SR-IOV/ Power | -- IOV lib Test Harness | -- test1 | -- test2 RAS Software and Services Group 9 9
  • 10. Test Result Center Find Defects Out Timely! Software and Services Group 10 10
  • 11. Patch Test System Recipe Submit UI Machine Status UI Result UI DB Tool Web UI Receive Core Management Runtime DB Recipe Test Schedule Test Box 1 Local Control Scheduler Machine Test Box 2 Recipe … Test Info Test Machine R-Queue Pool Test Info XVS Users Test Box N Test Resources OSD Results Results Processing Machines Software and Services Group 11 11
  • 12. Patch Test System Ensure Patch Quality Before Submitting Out! Software and Services Group 12 12
  • 13. Best Practices Software and Services Group 13 13
  • 14. Power Management Testing • Challenge – How to achieve integrated Power Management testing? • Test Approach – Automated functionality testing. • Interface : xenpm, hypercall, sysfs interface • Coverage : idle, runtime, Dom0/HVM S3 – Performance measurement. • Scenario : idle, runtime, benchmarks • Platform : laptop & server • OS : Linux, Windows • Publish : web site Software and Services Group 14 14
  • 15. Power Management Testing • Challenge – How to achieve integrated power testing? • Test Approach – Automated functionality testing. • Interface : xenpm, hypercall, sys i/f • Coverage : idle, runtime, Dom0/HVM S3 – Performance measurement. • Scenario : idle, runtime, benchmarks • Platform : laptop & server • OS : Linux, Windows • Publish : web site Software and Services Group 15 15
  • 16. RAS Testing • Challenge – How to achieve good test coverage? • Test Approach – Add test stub to Xen to dump page types. – Add test stub to Xen to translate address from guest to host. – Use ACPI4.0/APEI to trigger CPU/Mem *MCE to specific pages. • To Do – How to stress? • Option: add more software test interface to *MCE handlers. – CPU Migration – MEM hot-plug *MCE: Machine Check Exception Software and Services Group 16 16
  • 17. RAS Testing • Challenge – How to achieve good test coverage? • Test Approach – Add test stub to Xen to dump page types. – Add test stub to Xen to What MCE test i/f guest to host. translate address from Linux provides? – Use ACPI4.0/APEI to trigger CPU/Mem to trigger fake MCE • MCE injector *MCE to specific pages. • madvise syscall to poison page • To Do • HWPosion injector to poison page – How to stress? •…… • Option: add more software test interface to *MCE handlers. – CPU Migration – MEM hot-plug *MCE: Machine Check Error Software and Services Group 17 17
  • 18. VT-d/SR-IOV Testing • Challenge – Hardware variety & complexity : platforms + devices • Test Approach – Select typical test configurations. • Platform : laptop -> desktop -> server • Device : NIC, USB, SATA • PCI type : PCIE MSI, PCIE INTx, PCI INTx • OS : Linux, Windows – Use NIC to achieve test automation. • Methods : ping, scp (file copy), ssh • Coverage : static assignment + VT-d hotplug • Multiple-devices assignment. Software and Services Group 18 18
  • 19. Some Proposals Software and Services Group 19 19
  • 20. Improve Xen Quality • Source Control – Synchronize source control for Ioemu, Dom0 and Xen. • E.g. VT-d is usually broken by ioemu check-in • Bug Tracking – Well track bug state in Xen Bugzilla • Current Xen BZ full of obsolete bug data • ~500 bugs , 30% Xen Bugzilla, are NEW! • Xen Testability – More built-in test features for Xen? • It’s a trend for Linux: memleak checker, fault injector, ... Software and Services Group 20 20
  • 21. Questions? Software and Services Group 21 21
  • 22. Backup Software and Services Group 22 22
  • 23. Regular Testing To keep Xen from regressions Build Check Booting Tests Basic Functional Tests C/S Pull Auto Build Auto Install Regression Testing Bug Verification Daily Build *BAT Testing Daily *BAT Test Cycle *BAT: Build Acceptance Test Full Scope Functional Tests Functionality Testing Performance Testing Stress Testing Others System Testing Monthly System Test Cycle Software and Services Group 23 23
  • 24. Release Testing To make qualified Xen release Build Check Booting Tests Basic Functional Tests C/S Pull Auto Build Auto Install Regression Testing Bug Verification Release Build *BAT Testing Release *BAT Test Cycle *BAT: Build Acceptance Test Full Scope Functional Tests Functionality Testing Performance Testing Stress Testing Others System Testing Release System Test Cycle Software and Services Group 24 24
  • 25. Patch Testing To ensure patch quality for Xen Build Check Booting Tests Basic Functional Tests Auto Build Auto Install Regression Testing Unit Testing Patch Testing Patch Test Cycle Software and Services Group 25 25