This document discusses Prow, an open source Kubernetes-based CI/CD system for GitHub repositories. It provides an overview of Prow's architecture and components including Hook, Plank, Tide, Deck, and others. The document also describes Prow's CI/CD process from opening a PR through merging. It concludes with instructions for setting up Prow on GCP or manually, and adding ProwJobs to repositories.

1. PROW
CHATOPS FOR OPEN SOURCE PROJECTS
CLOUD NATIVE ASTURIAS JAN’21
@vicsufer
/in/vicsufer

2. CLOUD NATIVE ASTURIAS JAN’21
AGENDA
1. What is Prow?
2. Architecture
3. CI/CD Process
4. Setup

3. WHAT IS PROW?

4. CLOUD NATIVE ASTURIAS JAN’21
PROW
▸ Kubernetes based CI/CD System.
▸ Stateless.
▸ Dashboards.
▸ Metrics.

5. CLOUD NATIVE ASTURIAS JAN’21
PROW
▸ Batch merges.
1 2
HEAD
3 4 5
PR1 PR2 PR3
Test Test
Test

6. CLOUD NATIVE ASTURIAS JAN’21
PROW
▸ Batch merges.
1 2
HEAD
3
4 5
PR2 PR3
Test
Test

7. CLOUD NATIVE ASTURIAS JAN’21
PROW
▸ Batch merges.
1 2
HEAD
3 4 5
PR1 PR2 PR3

8. CLOUD NATIVE ASTURIAS JAN’21
PROW
▸ Batch merges.
1 2
HEAD
3 4 5
PR1 PR2 PR3
Merge pool
Test

9. CLOUD NATIVE ASTURIAS JAN’21
PROW
▸ Batch merges.
1 2
HEAD
3 4
5
PR3

10. CLOUD NATIVE ASTURIAS JAN’21
PROW
▸ Batch merges.
1 2
HEAD
3+4
5
PR3

11. CLOUD NATIVE ASTURIAS JAN’21
PROW
▸ ChatOps system via /foo style commands

12. CLOUD NATIVE ASTURIAS JAN’21
PROW
▸ ChatOps system via /foo style commands

13. CLOUD NATIVE ASTURIAS JAN’21
PROW
▸ ChatOps system via /foo style commands

14. CLOUD NATIVE ASTURIAS JAN’21
PROW
▸ ChatOps system via /foo style commands

15. CLOUD NATIVE ASTURIAS JAN’21
PROW
▸ Per directory code reviewers/approvers.
/test-infra/prow/deck/OWNERS
/prow/OWNERS

16. CLOUD NATIVE ASTURIAS JAN’21
PROW
▸ Introducing ProwJobs:

17. ARCHITECTURE

18. CLOUD NATIVE ASTURIAS JAN’21
ARCHITECTURE
Hook
‣ Listen to GitHub webhooks.
‣ Plugins implement behaviours.

19. CLOUD NATIVE ASTURIAS JAN’21
ARCHITECTURE
Plank
‣ Manages ProwJobs
‣ Provide extra functionality
(Timeout, GracePeriods, etc)
‣ Updates Job status

20. CLOUD NATIVE ASTURIAS JAN’21
ARCHITECTURE
Tide
‣ Manage retesting.
‣ Merge PRs.

21. CLOUD NATIVE ASTURIAS JAN’21
ARCHITECTURE
Deck
‣ Web UI.
‣ Job status and logs.
‣ Automation history.

22. CLOUD NATIVE ASTURIAS JAN’21
ARCHITECTURE
‣ Horologium: Cron jobs.
‣ Sinker: Garbage collector.
‣ Crier: Notifications.
Other componts

23. CLOUD NATIVE ASTURIAS JAN’21
CI/CD PROCESS
1. Open a PR
2. Hook receives webhook and trigger some plugins.

24. CLOUD NATIVE ASTURIAS JAN’21
CI/CD PROCESS
3. Reviewer comments PR with “/ok-to-test”.
4. Hook route webhook to trigger plugin.

25. CLOUD NATIVE ASTURIAS JAN’21
CI/CD PROCESS
5. Trigger plugin create presubmit Prowjob.
6. The Prowjob is run and the PR is updated based on the exit code.

26. CLOUD NATIVE ASTURIAS JAN’21
CI/CD PROCESS
7. Approver approves the PR, “approve” label is applyed.
8. Tide checks if merge conditions are met.
9. Tide merges PR.

27. CLOUD NATIVE ASTURIAS JAN’21
CI/CD PROCESS
Life of a ProwJob
Sequence diagram

28. PROW SETUP

29. CLOUD NATIVE ASTURIAS JAN’21
GITHUB SETUP
1. Create a GitHub account for the bot.
2. Create a personal access token.
3. Fork kubernetes/test-infra repository.

30. CLOUD NATIVE ASTURIAS JAN’21
DEPLOYING ON GCP
1. Install Bazel.
2. Run bazel run //prow/cmd/tackle

31. CLOUD NATIVE ASTURIAS JAN’21
MANUAL DEPLOYMENT
1. Create RBAC.
2. Create secret with the GitHub Token
3. Apply Prow’s manifests.
1. kubectl apply -f config/prow/cluster/starter-gcs.yaml
2. kubectl apply -f config/prow/cluster/starter-s3.yaml

32. CLOUD NATIVE ASTURIAS JAN’21
ADDING PROWJOBS
Valid pod spec
Edit /config/prow/config.yml.
Run make update-config

33. CLOUD NATIVE ASTURIAS JAN’21
ADDING PROWJOBS PER REPOSITORY
Enable inrepoconfig.

34. Q&A
?