DISTRIBUTED CONTINUOUS INTEGRATION
Gonéri Le Bouder
Senior Software Engineer
R&D Common Components
2
● OSP is in sync with OpenStack upstream and follow the cadence.
● OpenStack comes with a lot of drivers
● Red Hat works with a large number of partners
● Partners want to prepare their solution before OSP GA
● Customers may also have complex topology
● Testing testing time
A Bit of context
3
● Allows Partners and Customers to work on the latest Red Hat OpenStack builds
available, as soon as possible, in their own environment.
● Shortens the time and effort for RHOSP Certification since it can run the certification
test suite on every change.
● Simplifies the upgrade progress by testing incremental changes.
● Provides automated feedback to Red Hat with helpful logs.
● Focus debugging efforts on the subset of the code that has changed.
● Include RHOSP tests as well as Partner's and customer's specific tests.
● Gives customers the ability to continue to test RHOSP beyond GA.
WHY DISTRIBUTED CONTINUOUS
INTEGRATION?
DCI aims to change the way partners interact with Red Hat OpenStack.
4
OBJECTIVES:
DCI aims to change the way Partners interact with Red Hat. The main objectives are
to:
● Improve the influence of key use cases in the development of the product by
enabling a mechanism to provide automated and actionable feedback on any
given release.
● Continuous certification.
● A path for fast adoption of new releases.
● Cross-product continuous integration.
5 OPENSTACK SUMMIT BARCELONA
6
7
DCI Workflow: From our internal CI to the partner, the big picture
Release
mgmt
Control
Server
Remote CI #1
New version
of Product A
New tests of
Product A
Remote CI #2
Artifact
repository
Red Hat Internal
network Internet Veritas’ networks
RH-OSP
CI
Partner
config
Outside
of DCI
DCI Workflow: Inside the Veritas Wall
Control
Server
Artifact
repository
Partner’s networksInternet
DCI Agent
Node Director Node
computes controllers storage
Schedule new jobs
Sends back test results and logs
● deploy
● test
● destroy
Partner’s
repository
DCI Technical stack
Web UI
DCI API
Control Server
Ansible modules CLI
python-dciclient
Agent
1
1
CUSTOMER and PARTNER BENEFITS
● Provide an opinionated feedback
from an important use case at the
right time for action.
● Validating what’s coming on the next
release on their environment
● Access the latest Red Hat
OpenStack builds available, as soon
as possible, in their own
environment.
● Simplifies the upgrade progress by
testing incremental changes.
● Focus debugging efforts on the
subset of the code that has changed.
● Tooling for continuous Certification
WHAT’S IN IT FOR ME?
OPENSTACK SUMMIT BARCELONA
1
2
CUSTOMER and PARTNER BENEFITS
● Provide an opinionated feedback
from an important use case at the
right time for action.
● Validating what’s coming on the next
release on their environment
● Access the latest Red Hat
OpenStack builds available, as soon
as possible, in their own
environment.
● Simplifies the upgrade progress by
testing incremental changes.
● Focus debugging efforts on the
subset of the code that has changed.
● Tooling for continuous Certification
WHAT’S IN IT FOR ME?
PRODUCT AND PROJECT BENEFITS
● Provides automated feedback to Red
Hat with helpful logs.
● Better awareness of production
scenarios
● Expand the CI reach to 100s of
environments
● Enhance Red Hat Partnerships and be
the catalysts in the OpenStack
community
OPENSTACK SUMMIT BARCELONA
1
3
DCI
Agent: https://github.com/redhat-cip/dci-agent
Server: https://github.com/redhat-cip/dci-control-server
UI: https://github.com/redhat-cip/dci-ui
IS THIS OPEN SOURCE?
SHOW ME THE SOURCE!
OPENSTACK SUMMIT BARCELONA
THANK YOU
plus.google.com/+RedHat
linkedin.com/company/red-hat
youtube.com/user/RedHatVideos
facebook.com/redhatinc
twitter.com/RedHatNews

DCI presentation during OpenStack Montréal - 2018-06

  • 1.
    DISTRIBUTED CONTINUOUS INTEGRATION GonériLe Bouder Senior Software Engineer R&D Common Components
  • 2.
    2 ● OSP isin sync with OpenStack upstream and follow the cadence. ● OpenStack comes with a lot of drivers ● Red Hat works with a large number of partners ● Partners want to prepare their solution before OSP GA ● Customers may also have complex topology ● Testing testing time A Bit of context
  • 3.
    3 ● Allows Partnersand Customers to work on the latest Red Hat OpenStack builds available, as soon as possible, in their own environment. ● Shortens the time and effort for RHOSP Certification since it can run the certification test suite on every change. ● Simplifies the upgrade progress by testing incremental changes. ● Provides automated feedback to Red Hat with helpful logs. ● Focus debugging efforts on the subset of the code that has changed. ● Include RHOSP tests as well as Partner's and customer's specific tests. ● Gives customers the ability to continue to test RHOSP beyond GA. WHY DISTRIBUTED CONTINUOUS INTEGRATION? DCI aims to change the way partners interact with Red Hat OpenStack.
  • 4.
    4 OBJECTIVES: DCI aims tochange the way Partners interact with Red Hat. The main objectives are to: ● Improve the influence of key use cases in the development of the product by enabling a mechanism to provide automated and actionable feedback on any given release. ● Continuous certification. ● A path for fast adoption of new releases. ● Cross-product continuous integration.
  • 5.
  • 6.
  • 7.
  • 8.
    DCI Workflow: Fromour internal CI to the partner, the big picture Release mgmt Control Server Remote CI #1 New version of Product A New tests of Product A Remote CI #2 Artifact repository Red Hat Internal network Internet Veritas’ networks RH-OSP CI Partner config Outside of DCI
  • 9.
    DCI Workflow: Insidethe Veritas Wall Control Server Artifact repository Partner’s networksInternet DCI Agent Node Director Node computes controllers storage Schedule new jobs Sends back test results and logs ● deploy ● test ● destroy Partner’s repository
  • 10.
    DCI Technical stack WebUI DCI API Control Server Ansible modules CLI python-dciclient Agent
  • 11.
    1 1 CUSTOMER and PARTNERBENEFITS ● Provide an opinionated feedback from an important use case at the right time for action. ● Validating what’s coming on the next release on their environment ● Access the latest Red Hat OpenStack builds available, as soon as possible, in their own environment. ● Simplifies the upgrade progress by testing incremental changes. ● Focus debugging efforts on the subset of the code that has changed. ● Tooling for continuous Certification WHAT’S IN IT FOR ME? OPENSTACK SUMMIT BARCELONA
  • 12.
    1 2 CUSTOMER and PARTNERBENEFITS ● Provide an opinionated feedback from an important use case at the right time for action. ● Validating what’s coming on the next release on their environment ● Access the latest Red Hat OpenStack builds available, as soon as possible, in their own environment. ● Simplifies the upgrade progress by testing incremental changes. ● Focus debugging efforts on the subset of the code that has changed. ● Tooling for continuous Certification WHAT’S IN IT FOR ME? PRODUCT AND PROJECT BENEFITS ● Provides automated feedback to Red Hat with helpful logs. ● Better awareness of production scenarios ● Expand the CI reach to 100s of environments ● Enhance Red Hat Partnerships and be the catalysts in the OpenStack community OPENSTACK SUMMIT BARCELONA
  • 13.
    1 3 DCI Agent: https://github.com/redhat-cip/dci-agent Server: https://github.com/redhat-cip/dci-control-server UI:https://github.com/redhat-cip/dci-ui IS THIS OPEN SOURCE? SHOW ME THE SOURCE! OPENSTACK SUMMIT BARCELONA
  • 14.