Downloaded 23 times
Uploaded byKohsuke Kawaguchi
Workflow, container, and beyond
The document discusses Jenkins 2.0 and outlines goals to position Jenkins as a continuous delivery platform. It proposes three pillars for Jenkins 2.0: updated messaging and website to focus on continuous delivery, an improved out-of-the-box experience centered around workflow and pipeline functionality, and targeted internal changes like library upgrades and deprecated API removal. Potential pitfalls are also identified around scope, disruption, backwards compatibility and massive internal changes.
More Related Content
Similar to Workflow, container, and beyond
Workflow, container, and beyond
- 1. ©2015CloudBees,Inc.AllRightsReserved 1 ©2015CloudBees,Inc.AllRightsReserved Workflow, Containers, & Beyond KohsukeKawaguchi Creator of Jenkins @kohsukekawa
- 2. ©2015CloudBees,Inc.AllRightsReserved 2 © 2015 CloudBees,Inc. All Rights Reserved 2
- 3.
- 4.
- 5.
- 6.
- 7. ©2015CloudBees,Inc.AllRightsReserved 7 node(“linux”) { git ‘https://github.com/foo/bar.git’ sh“mvn install” parallel( { sh “./regression-test.sh” }, { sh “./performance-test.sh” } ) … }
- 8. ©2015CloudBees,Inc.AllRightsReserved 8 Key Features • Pipelineas Code • Parallel, other interesting control flow • Allocate slave nodes and workspaces –As many as you like, whenever and wherever • Standard project concepts –SCM, artifacts, test reports, …
- 9.
- 10.
- 11.
- 12. ©2015CloudBees,Inc.AllRightsReserved 12 node(“linux”) { git ‘https://github.com/foo/bar.git’ sh“mvn install” parallel( { sh “./regression-test.sh” }, { sh “./performance-test.sh” } ) … }
- 13.
- 14.
- 15. ©2015CloudBees,Inc.AllRightsReserved 15 vars/acme_service.groovy def call(name) { node(“linux”){ git “https://github.com/foo/${name}.git” sh “mvn install” parallel( { sh “./regression-test.sh” }, { sh “./performance-test.sh” } ) … } }
- 16. ©2015CloudBees,Inc.AllRightsReserved 16 Use Cases • Ihave lots of repos that are built, tested, & deployed the same way (e.g., micro-services) • I want to maintain centralized control of the build process • My product developers aren’t Jenkins experts
- 17. ©2015CloudBees,Inc.AllRightsReserved 17 Using Workflow isas easy as 1, 2, 3 1. Create “Jenkinsfile” in repo 2. Create job in Jenkins 3. Specify SCM URL
- 18.
- 19.
- 20. ©2015CloudBees,Inc.AllRightsReserved 20 © 2015 CloudBees,Inc. All Rights Reserved 20
- 21.
- 22.
- 23.
- 24.
- 25.
- 26.
- 27.
- 28.
- 29. ©2015CloudBees,Inc.AllRightsReserved 29 Too many imageproblems • Image names change all the time • ‘latest’ changes what it points to • Image gets transformed all the time
- 30.
- 31.
- 32.
- 33.
- 34. ©2015CloudBees,Inc.AllRightsReserved 35 © 2015 CloudBees,Inc. All Rights Reserved 35
- 35.
- 36.
- 37.
- 38.
- 39.
- 40.
- 41. ©2015CloudBees,Inc.AllRightsReserved 42 Jenkins needs toadjust to this change • Our pitch on website hasn’t changed • We still bundle CVS & Subversion plugins • Lots of new stuff being done, but requires hand-assembly
- 42.
- 43. ©2015CloudBees,Inc.AllRightsReserved 44 Goals • Claim ContinuousDelivery space –We have lots of pieces, but we are not communicating any of them very well • Revisit out-of-the-box experience of Jenkins –Things people use everyday has been stale • Keep the ecosystem that makes Jenkins great 2.0 sends a clear signal that we are moving forward
- 44. ©2015CloudBees,Inc.AllRightsReserved 45 Aspirational Timeline • Announceintention publicly (now) • Discuss and nail the details of 2.0 (Sep-Oct) • Execution (Oct-Dec) –Periodic alpha/beta releases & feedbacks –PR activities –RC • Work on plugin “2.0 readiness” (Jan) –Ensure key plugins are compatible • Release (end-Jan) • Drop 1.x development
- 45.
- 46.
- 47.
- 48.
- 49.
- 50.
- 51. ©2015CloudBees,Inc.AllRightsReserved 52 Pitfalls to avoid Focusingtoo much on internals
- 52. ©2015CloudBees,Inc.AllRightsReserved 53 That means … •Jenkins 2.0 needs to be limited-scope “evolutionary improvements” exercise • Not “let’s start from scratch” kind of 2.0
- 53. ©2015CloudBees,Inc.AllRightsReserved 54 Three Pillars 1. Messagingchanges 2. Out of the box experience that caters to CD needs 3. Targeted internal plumbing changes
- 54. ©2015CloudBees,Inc.AllRightsReserved 55 Messaging •jenkins-ci.org → jenkins.cd •Moreup-to-date feature list page •Authoritative & curated getting started guide •Easier-to-contribute blog •Room for future growth –Better plugin directory
- 55. ©2015CloudBees,Inc.AllRightsReserved 56 Messaging Infra •Infra thatenables –Drupal → static site generation –Confluence retirement (?)
- 56. ©2015CloudBees,Inc.AllRightsReserved 57 OOTB Experience •Initial setupwizard –Recommend initial set of plugins •UX refresh
- 57. ©2015CloudBees,Inc.AllRightsReserved 58 OOTB Experience forCD •Deliver modern functionalities, OOTB –Workflow –Pipeline as Code –Folders •CloudBees is open-sourcing workflow stage view
- 58. ©2015CloudBees,Inc.AllRightsReserved 59 Internals • Policy forremoving deprecated APIs • Brand-new frontend development method • Selected library upgrades –Limited to “should be compatible” kinds • Java 8 & Servlet 3.0
- 59.
- 60. ©2015CloudBees,Inc.AllRightsReserved 61 © 2015 CloudBees,Inc. All Rights Reserved 61
- 61.
- 62.
- 63.
Editor's Notes
- #6 assembly a complex CD workflow today is like a LEGO model assembly
- #7 Workflow does this in one job
- #8 and in text / not just calling other jobs, but do stuff within itself
- #10 Tolerate loss of master & slaves
- #13 and in text / not just calling other jobs, but do stuff within itself
- #14 and in text / not just calling other jobs, but do stuff within itself
- #15 As an architect of the CD pipeline, you can define them as code in one place. Then product teams get to reuse them
- #22 Docker is driving changes in software development, and Jenkins is no exception. I want to discuss the continuous delivery in the world of containers
- #23 Let’s start with the simplest use case, containerizing app / how hard can it be? / Even simple things like this can be made simpler / Credentials management
- #24 Common credential across all the docker plugins
- #25 Your container building often depends on another container.
- #27 trigger plugin is also useful / ex. JIRA + LDAP
- #28 If a test pass, what do you do? You want to publish images to another repository / tag.
- #29 You’ve got stuff coming in, test it, reject it, test it, accept it / the same problem with these guys /
- #30 Not a new problem, the same with files / but Docker is worse
- #31 We need our own tracking tags
- #32 Tags get scanned everywhere / find where it is / And what we released so far is just a starter. We are going to expand it
- #33 for example, know what went into that container / important view point because it lets you focus on how things are flowing through the system
- #38 I did first handful of plugins myself
- #47 We know how to assemble LEGO / our pain points are often different.
- #48 Need to have enough to justify 2.0 but not everything for everyone / direction setting
- #49 We know how to assemble LEGO / our pain points are often different.
- #50 We know how to assemble LEGO / our pain points are often different.
- #51 We know how to assemble LEGO / our pain points are often different.
- #52 We know how to assemble LEGO / our pain points are often different.
- #53 We know how to assemble LEGO / our pain points are often different.
- #64 References to images get baked somewhere / these ideally live in a VCS / trigger activities in Jenkins
- #65 And then you start putting things together / the whole thing starts to look eerily similar. Artifacts are different, languages are different, but they all follow the same paradigm.