Download to read offline
Uploaded byMark Waite
Git for jenkins faster and better
The document discusses techniques to improve Git performance in Jenkins, focusing on reducing clone time and disk usage through methods such as reference repositories, narrow refspecs, shallow clones, and large file support. It outlines the advantages and disadvantages of each technique and suggests using pipeline syntax and third-party sources like GitHub and Bitbucket for better integration. The overall aim is to optimize workspace storage and network data transfer while maintaining efficiency in CI/CD processes.
More Related Content
![[AI] ML Operationalization with Microsoft Azure](https://cdn.slidesharecdn.com/ss_thumbnails/wds-mlops-trainer-kyle-akepanidtaworn-v03-190924094657-thumbnail.jpg?width=640&height=640&fit=bounds)
![[AWS Container Service] Getting Started with Cloud Map, App Mesh and Firecracker](https://cdn.slidesharecdn.com/ss_thumbnails/200gettingstartedwithcloudmapappmeshandfirecraker-190326085953-thumbnail.jpg?width=640&height=640&fit=bounds)
Similar to Git for jenkins faster and better
![Docker and Jenkins [as code]](https://cdn.slidesharecdn.com/ss_thumbnails/dockerandjenkinsascode-190815233617-thumbnail.jpg?width=640&height=640&fit=bounds)
Git for jenkins faster and better
- 1. Git for Jenkins Fasterand Better Reducing Clone Time and Disc Use
- 2. Git for Jenkins Fasterand Better Reducing Clone Time and Disc UseLightning Talk
- 3. © 2019 AllRights Reserved. 3 Git for Jenkins – Faster and Better Reducing Clone Time and Disc Use Git • Repo Master • Polling • Pipeline Agents • Workspace • Pipeline
- 4. © 2019 AllRights Reserved. 4 Help the Remote • Remote Repository Content & Tasks • Includes all history • Sends requested history • Includes all large files • Sends requested large files • Techniques to Help the Remote • Reference repository • Narrow refspec • Shallow clone • Large file support Git • Repo Master • Polling • Pipeline Agents • Workspace • Pipeline This Photo by Unknown Author is licensed under CC BY-SA
- 5. © 2019 AllRights Reserved. 5 Help the Master • Master Content & Tasks • Needs all history • Requests most recent large files • Scans repositories for changes • Computes changes • Clones and executes pipelines and their shared libraries • Techniques to Help the Master • Reference repository • Large file support Git • Repo Master • Polling • Pipeline Agents • Workspace • Pipeline
- 6. © 2019 AllRights Reserved. 6 Help the Agents • Agent Content & Tasks • Needs most recent files • Needs most recent large files • Workspace checkout • Techniques to Help the Agent • Narrow refspec • Shallow clone • Reference repository • Large file support • Sparse checkout Git • Repo Master • Polling • Pipeline Agents • Workspace • Pipeline
- 7. © 2019 AllRights Reserved. 7 Reference Repository • New repositories can “reference” another repository Avoid download and storage of existing data • Advantage • Reduce network data transfer • Reduce local workspace storage • Disadvantage • Reference repositories not automatically update • Destroying reference copy damages all referring workspaces Git • Repo Master • Polling • Pipeline Agents • Workspace • Pipeline
- 8. © 2019 AllRights Reserved. 8 Narrow Refspec • Refspec limits history retrieval (breadth of history – request a subset of branches) • Advantage • Retrieve only the required branches • Reduce local repository storage • Disadvantage • Copies history only for the requested subset • Refspec patterns are limited Git • Repo Master • Polling • Pipeline Agents • Workspace • Pipeline
- 9. © 2019 AllRights Reserved. 9 Shallow Clone • Shallow clone limits history retrieval depth • Advantage • Reduce workspace storage by subset clone • Disadvantage • Breaks merge workflows • Incomplete change history reports • Command line git only (no JGit support) Git • Repo Master • Polling • Pipeline Agents • Workspace • Pipeline
- 10. © 2019 AllRights Reserved. 10 Large File Support • Extension stores large files outside the repository • Advantage • High performance (parallel download, https transport, …) • Very active development • Reduces local repository storage • Disadvantage • Requires LFS extension on agents and master • Requires extra support from hosting provider • Requires authentication and remote access for merge Git • Repo Master • Polling • Pipeline Agents • Workspace • Pipeline
- 11. © 2019 AllRights Reserved. 11 Sparse Checkout • Sparse checkout defines directories for checkout (workspace breadth) • Advantage • Reduce workspace storage by subset checkout • Disadvantage • Reduced workspace does not include all workspace files Git • Repo Master • Polling • Pipeline Agents • Workspace • Pipeline
- 12. © 2019 AllRights Reserved. 12 Pipeline Specifics • Use the Pipeline Syntax helper for checkout syntax • Use reference repositories • If using Git as branch source, define narrow refspec to specific branch • Narrow refspec for specific branch is automatic with higher level branch sources • Use GitHub rather than Git as branch source • Use Bitbucket rather than Git as branch source • Use Gitea rather than Git as branch source Git • Repo Master • Polling • Pipeline Agents • Workspace • Pipeline
- 13. DevOptics Software Delivery Visibility &Insights Core Unified Software Delivery & Governance CodeShip CI/CD as a Service Flow Adaptive Release Orchestration DevOps ExcellenceJenkins CloudBees Jenkins Distribution CloudBees Jenkins X Distribution 24x7 Technical Support Assisted Updates Support Accelerator Training Customer Success Managers DevOps Consultants Rollout Feature Flag Management Continuous Delivery Products and Services
Editor's Notes
- #4 This chart uses custom formatting. To retain custom formatting, do one of the following options: Duplicate and Edit Data Copy and paste this chart/slide to desired location With the chart selected, go to the Chart Design tab and select Edit Data (this should open the data sheet in Excel) Update the data cells on the data sheet in Excel and Save Save this custom chart style as a template With the chart selected, go to the Chart Design tab and select Save as Template [Note: MAC users click Change Chart Type and select Save as Template from the dropdown] Name the style as desired and Save To apply the template, first select desired chart, then go to the Chart Design tab, select Change Chart Type Select the Template folder at the top of the list and choose the custom saved style you wish to apply, then click OK Note: you will need to do this for each type of chart (column, line, pie). Name your Template styles accordingly for efficiency. BEST PRACTICES: PC users should open Excel before creating charts in PowerPoint