ConcourseCi overview
•
10 likes•3,055 views
Overview about ConcourseCI system. Unit testing and continuous integration
Recommended
More Related Content
What's hot
What's hot (20)
Viewers also liked
Viewers also liked (20)
Similar to ConcourseCi overview
Similar to ConcourseCi overview (20)
More from Gwenn Etourneau
Recently uploaded
Recently uploaded (20)
ConcourseCi overview
- 2. About me Etourneau Gwenn Sr Solution Architect Bef.: Platform Architect https://github.com/shinji62 https://twitter.com/the_shinji62
- 3. Pivotal • Spring Framework • RabbitMQ • Concourse • Cloud Foundry • Pivotal Tracker • Gemfire
- 4. Agenda • Yet Another CI / CD • Architecture • Usage • Demo • Q&A
- 5. Yet Another CI / CD
- 7. But
- 8. Why not Jenkins ? (v1) • Snowflakes • No strict isolation • Too much dependency • well java …. ( ) • V2 really ?! pipeline yes ! but Groovy ..
- 9. Why not Jenkins ? (v1) • Snowflakes • No strict isolation • Too much dependency • well java …. • V2 really ?! pipeline yes ! but Groovy ..
- 10. Why not ? • No pipeline • Difficult to debug, commit to debug • Difficult to use / configure .. • Learning curve is high • Difficult to see everything
- 11. WE ARE ENGINEER
- 12. Concourse • Pluggable Resource Interface • Running builds in Containers Natively • Zero Snowflake-able Configuration • Submitting builds from the local file system up to run in CI • Pipeline pipeline pipeline !!! • Reproducible
- 13. Concourse
- 14. Concourse • Pluggable Resource Interface • Running builds in Containers Natively • Zero Snowflake-able Configuration • Submitting builds from the local file system up to run in CI • Pipeline pipeline pipeline !!! • Reproducible
- 16. Concourse
- 17. Download Yaml Set-pipeline in concourse Concourse
- 18. Concourse • Pluggable Resource Interface • Running builds in Containers Natively • Zero Snowflake-able Configuration • Submitting builds from the local file system up to run in CI • Pipeline pipeline pipeline !!! • Reproducible
- 19. Architecture
- 22. Architecture ATC Air Traffic Controller • Brain • Web UI (ELM) • Responsible for Pipeline scheduling ELM
- 23. Architecture TSA Travel Security Agency • Register workers against ATC • Unregister workers against ATC
- 24. Architecture Workers • No State • Run the task • Container inside Garden container • Register themselves to the TSA
- 25. Architecture Workers Garden image_resource: type: docker-image source: repository: ubuntu/…. Garden image_resource: type: docker-image source: repository: ubuntu/…. Garden image_resource: type: docker-image source: repository: ubuntu/…. Garden image_resource: type: docker-image source: repository: ubuntu/…. VM Operating System
- 26. Concourse • Pluggable Resource Interface • Running builds in Containers Natively • Zero Snowflake-able Configuration • Submitting builds from the local file system up to run in CI • Pipeline pipeline pipeline !!! • Reproducible
- 27. Concept
- 28. Three main concept • Jobs • Resource } PIPELINE • Task
- 29. Task • Smallest configurable unit in a Concourse pipeline • Always behave same ways if inputs are the same result should be the same • Basically run things into containers • Input and output • Exit 0 ==> Success • Exit != 0 ==> failed
- 30. Task platform image_resource inputs run Worker type Docker image used to run the task input used by the task what to do unit-testing.yml
- 32. Concourse • Pluggable Resource Interface • Running builds in Containers Natively • Zero Snowflake-able Configuration • Submitting builds from the local file system up to run in CI • Pipeline pipeline pipeline !!! • Reproducible
- 33. Pipeline
- 35. Pipeline
- 37. Resource • Objects used for jobs in the pipeline. • Base on the resource type, ex : git, s3, github-release, semver, slack…. even your own • As well as input or output • Git • Git-release • Docker Image • S3 • Semver • Etc .. • Slack • Twitter • Perforce • Bintray • Flowdoc • Etc … Official Community
- 38. name type Source, etc… Name of resource resource type in this case git resource depend of the resource Resource
- 39. Resource (own resource type) Can import new resource type directly into the pipeline
- 40. Concourse • Pluggable Resource Interface • Running builds in Containers Natively • Zero Snowflake-able Configuration • Submitting builds from the local file system up to run in CI • Pipeline pipeline pipeline !!! • Reproducible
- 41. Job Job Job Job
- 42. Job • Determine “actions” of the pipeline • Plan, which resource, which task and in which order • Basically • What I need to do ? ==> Task • What I need to use ? ==> Resource • What I need to produce ? ==> Resource
- 43. Job name public serial plan Name of jobs Visibility input used by the task builds_plan pipeline.yml
- 44. Get Job Build-plans Input resource trigger the job new version of the resource 1 Job = 1 build-plan Task Run the task unit-testing pipeline.yml
- 45. VM Operating System Garden Basic Rootfs base on busybox git clone myrepos ./concourse-meetup-goserve-ci Task unit testing . is mounted ./concourse-meetup-goserve-ci/ci/unit-testin/unit-testing.yml
- 46. Usage
- 47. Installation Vagrant for local deployment Bosh for Cluster deployment, aws, azure, gce vagrant init concourse/lite vagrant up Configure your deployment file Deploy your cluster docker, chef etc… you can use the concourse binary
- 48. Installation Concourse Binary You can use the concourse binary with your favorite tool. Or no tool at all https://github.com/concourse/bin
- 49. First Step $ fly -t blite sync To be sure your client is on the same version of your Concourse deployment sync $ fly -t blite login --concourse-url https://ci.example.com login and create target to be use for all command login
- 50. One off-Task $ fly -t blite execute -c my-task.yml --input my-input-res=. Run one-off task from the local directoryexecute I want to execute the task my-task.yml using my local directory as input my-input-res
- 51. Pipeline $ fly -t blite set-pipeline -p pipeline-name -c ci/pipeline.yml --load-vars-from=/secret/credentials.yml set-pipeline Set or update the pipeline I want to setup the pipeline defined in ci/pipeline.yml and I will use the file credentials.ml for variable
- 52. Demo
- 53. One off-Task $fly -t clocal execute -c ci/unit-testing/unit-testing.yml --input concourse-meetup-goserv-ci=. Running unit-testing task
- 54. Pipeline $ fly -t clocal set-pipeline -p -p concourse-meetup-c ci/ pipeline.yml set-pipeline Set or update the pipeline
- 55. Online Resource
- 56. Documentation Tutorials • Official documentation http://concourse.ci • S&B https://github.com/starkandwayne/concourse-tutorial • Flight-School http://concourse.ci/flight-school.html
- 57. Public Pipeline • Buildpack • http://buildpacks-ci.cfapps.io/ • CF Release • https://runtime.ci.cf-app.com/pipelines/cf-release • Bosh • https://main.bosh-ci.cf-app.com/ • Concourse • https://ci.concourse.ci/
- 59. Q & A
- 60. Thank You !!