CI Introduction Create YAML file Build jobs using JJB Triggers

1. CI for ALL

2. Agenda
● CI - Why, What & How
● YAML file and JJB
● CI Work-flow
● Build triggers
● Parameterize the jobs
● Build jobs using JJB
● Q&A session

3. Why CI?
● Company Goal
● Delay in response
● Env issues & User errors
● Inefficient use of tools/resources
● Duplicate test reports
● Compromise in Quality

4. What does CI do?
● Automatic execution of tests
● Integrate different tools
● Latest & greatest pkgs
● Clean env
● TIER based runs
● Centralized reporting

5. How to setup CI?
● Jenkins Master/Slave
– Install/Config/Plugin
● Requirements and project details
– YAML file
– JJB – Jenkins Job Builder
● Triggers
● Repo creation
● Provision & teardown
● Runtest

6. ● YAML file and JJB
YAML file
Global defaults
Project vars & Jobs
Jenkins vars
Json file
Restraint xml
Builders
Parameters
Jobs
Jenkins Jobs
Trigger
Repo creation
Provision
Runtest
Teardown
Build jobs from Jenkins
JJB(Python script)
GIT repo
Jenkins
Master
Config
file(Creds)

7. ● CI work-flow
Brew
Trigger
Provision
Resources
Runtest
Teardown
Resources
Brew build
Redhat CI
PluginYAML file
Mail
Notifications
IRC
Notifications
JMS
Selector
Brew
bus
Jenkins Jobs
JJB

8. Project variables
● jobs:
- '{prefix}-{testsuite}-{arch}-provision'
- '{prefix}-{testsuite}-{arch}-runtest'
- '{prefix}-{testsuite}-{arch}-teardown'
● testsuite:
- test1
- test2
- test3
● Prefix: rhds
● brew-tag: rhel-7.2-candidate
● arch: x86_64

9. Variables contd...
● Replace variable with values:
– Variable within YAML file
● '{release}'
● '{prefix}-{testsuite}-{arch}-provision'
– Parameters
● $PATCH_ID
● $BUILD_ID
– Jenkins env variables
● $WORKSPACE
● $JENKINS_HOME

10. Build triggers
● Upstream job - Trigger
● Downstream – Provision
● Triggers:
- ci-trigger:
jms-selector: |
CI_TYPE IN ('brew-tag')
AND
CI_NAME IN ('389-ds-base','nss','openldap')
AND
tag IN '{brew-tag}'

11. Build triggers contd...
● Periodic build trigger
● Jenkins job trigger
– Build when jobs built
– Build when jobs promoted
– Build based on results of multiple jobs
● Script trigger – Shell script
● Gerrit trigger
– Gerrit server details
– When patchset created, merged

12. Provision
● Beaker/Openstack
– JSON File
– provision_resources.sh
● Upstream job - Trigger
● Downstream job - Runtest
● Copy artifcats
– Inject information to RESOURCES.txt

13. Provision contd...
- builder:
name: 'provision-resources'
builders:
- shell: |
#!/bin/bash
$WORKSPACE/ci-ops-
central/bootstrap/provision_resources.sh --site=$SITE
--project_defaults=dirsrv-tests/config/project_defaults
--topology={topology}-$PROVISIONER
--ssh_keyfile=dirsrv-tests/config/keys/idm-jenkins
--name={testsuite}
TR_STATUS=$?

14. JSON File
"family": "RedHatEnterpriseLinux7",
“arch": "x86_64",
"tag": ["RTT_ACCEPTED"],
"variant": "Server",
"hostrequire": ["arch=x86_64"]
"name": "ci-ops-rhel-7-1",
"count": "1",
"flavor": "m1.medium",
"image": "RHEL-7.2-Server-x86_64-latest",
"ip": "10.8.60.20",
"name": "nocp9.idm.lab.eng.rdu2.redhat.com",
"private_ip": "10.8.60.20”

15. Runtest
● Restraint xml file
– Beaker task
– Install, configure and execute tests
● Ansible
– Ansible playbook
– Install pkgs
– Run your tests
● Upstream – provision
– Bkr job ID, IP address & Hostname
● Downstream - teardown

16. Config file
[jenkins]
user=idm-jenkins
password=Secret123
url=https://idm-qe-jenkins.rhev-ci-
vms.eng.rdu2.redhat.com
ignore_cache=False

17. ● Jenkins Job Builder
builders:
- shell: |
JENKINS_URL=${JENKINS_URL:-"https://localhost/"}
pushd $WORKSPACE/dirsrv-tests
Popd
cd $WORKSPACE
python -m jenkins_jobs.cmd --conf $WORKSPACE/
$CONIG_FILE --flush-cache update $WORKSPACE/
$GIT_REPO/$CI_DIR
Example for RHDS:
python -m jenkins_jobs.cmd --conf
$WORKSPACE/dirsrv-tests/jobs/config --flush-cache update
$WORKSPACE/dirsrv-tests/jobs/rhel72

18. Parameterize jobs
● Change variable values
– Troubleshooting & Manual execution
● choice:
name: tag
choices:
- rhel-7.2-z-candidate
- rhel-7.2-candidate
description: "Brew tag for this build."
● string:
name: REPORT_EMAIL
default: redhat-list@redhat.com
description: Default email id for reports

19. JJB with Gerrit refspec
● Add a parameter - GERRIT_REFSPEC
● Add a build step – Execute shell
pushd $WORKSPACE/dirsrv-tests
git pull
https://code.engineering.redhat.com/gerrit/dirsrv-tests
$GERRIT_REFSPEC
popd
● cd $WORKSPACE
● python -m jenkins_jobs.cmd --conf
$WORKSPACE/dirsrv-tests/jobs/config --flush-cache
update $WORKSPACE/dirsrv-tests/jobs/
$GIT_BRANCH

20. References
About CI in MOJO - https://mojo.redhat.com/search.jspa?q=CI
%20workflow
Setup CI with Jenkins -
http://www.vogella.com/tutorials/Jenkins/article.html
Jenkins CI plugin - https://mojo.redhat.com/docs/DOC-986839
CI Reference guide - https://mojo.redhat.com/docs/DOC-1030059

21. Questions