Where the Helm are your binaries? as presented at Canada Kubernetes Meetups

•

1 like•382 views

Do you always know what’s going on with your product artifacts since the moment they are built by the CI server from Git sources all the way to being deployed by Helm into Kuberenetes? In this talk, we will show how to build a reliable and transparent pipeline from code to cluster using Git, Artifactory, Docker, Kubernetes, and Helm. We’ll show how you such a pipeline can help you answer the big questions: What to deploy, What is deployed, and what is this artifact that I am looking for. This kind of transparency is critical for today’s environments, and Kubernetes with Helm shouldn’t be an exception.

Technology

shownotes
•www.jfrog.com/shownotes
•Slides
•Video (tomorrow!)
•All the links!
•Ratings, comments
•Raffle!
@jbaruch www.jfrog.com/shownotes

What the helm is helm?
Dependency manager for Kubernetes
@jbaruch www.jfrog.com/shownotes

What Dependency managers and
printers have in common?
@jbaruch www.jfrog.com/shownotes

How to deploy anything to k8s
• Copy YAML
• Paste YAML
• Fix indents
• Repeat
@jbaruch www.jfrog.com/shownotes

Kubernetes resource
{
"kind": "Deployment",
"apiVersion": "extensions/v1beta1",
"metadata": {
"name": "my-release-docker-app-chart"
},
"spec": {
"containers": [
{
"name": "docker-app-chart",
"image": "docker.artifactory/docker-app:1.0",
@jbaruch www.jfrog.com/shownotes

Let’s build a new one!
> docker build –t docker.artifactory/docker-app:1.1
@jbaruch www.jfrog.com/shownotes

One last thing…
> sed –i.bak
`s#docker.artifactory/docker-app:1.1#${imageTag}#`
deployment.yaml
@jbaruch www.jfrog.com/shownotes

Or just use :latest
"image": "docker.artifactory/docker-app:latest"
@jbaruch www.jfrog.com/shownotes

Enter helm
@jbaruch www.jfrog.com/shownotes

Encapsulated packages of Kubernetes deployments
All this…
xrayxray-analysis
xray-event
xray-indexer
xray-nfs-server
xray-persist
Becomes this
xray
@jbaruch www.jfrog.com/shownotes

Powerful templating for descriptor files
{
"kind": "Deployment",
"apiVersion": "extensions/v1beta1",
"metadata": {
"name": "{{ template "docker-app.fullname" . }}"
},
"spec": {
"containers": [
{
"name": "{{ template "docker-app.name" . }}",
"image": "{{ .Values.image.repository }}:
{{ .Values.image.tag }}"
@jbaruch www.jfrog.com/shownotes

Values:
# Default values for docker-app.
# This is a YAML-formatted file.
# Declare name/value pairs to be passed into your templates.
image:
repository: docker.artifactory/docker-app
tag: 1.1
secretName: regsecret
pullPolicy: Always
@jbaruch www.jfrog.com/shownotes

Simple!
• Templates
• Values
• Metadata
@jbaruch www.jfrog.com/shownotes

Chart <-> image relationship
• Using templates we can reuse charts for multiple image
versions
• Chart versions != Image versions
@jbaruch www.jfrog.com/shownotes

Kubernetes cluster control
@jbaruch www.jfrog.com/shownotes

Two parts
Helm client
• Local chart development
• Managing repositories
• Interacting with the Tiller
server
Tiller Server
• Listening for incoming
requests from the Helm client
• Combining a chart and
configuration to build a release
• Installing charts into
Kubernetes, and then tracking
the subsequent release
• Upgrading and uninstalling
charts by interacting with
Kubernetes
@jbaruch www.jfrog.com/shownotes

Helm commands
>helm init
>helm search
>helm install
>helm status
>helm repo
@jbaruch www.jfrog.com/shownotes

Helm repositories
• Official repository - kubeapps.com
@jbaruch www.jfrog.com/shownotes

Helm repositories
• Official repository - kubeapps.com
• Get a local one!
• Option 1: Create your own:
• Run an http server with index.yaml
• Run helm repo index to generate one the index
• Option 2: Use JFrog Artifactory
• Universal Artifact Repository which supports Docker, Helm and
everything else
@jbaruch www.jfrog.com/shownotes

Use Artifactory:
Take your metadata seriously
Where the helm is my binary?
@jbaruch www.jfrog.com/shownotes

The Age of Binaries
IoT
Docker
Microservices
DevOps
CD
CI
Agile2001
2018

The big picture
@jbaruch www.jfrog.com/shownotes

Who cares about those binaries anyway?
@jbaruch www.jfrog.com/shownotes

Demo time
Talk is cheap, show me the code!
@jbaruch www.jfrog.com/shownotes

QA and links
•www.jfrog.com/shownotes
•Slides
•Video (tomorrow!)
•All the links!
•Ratings, comments
•Raffle!
@jbaruch www.jfrog.com/shownotes

What's hot

Teaching a Designer to Use GitHub

Liam Dempsey

ConcourseCI love Minio

Gwenn Etourneau

Git Started With Git

Nick Quaranto

Avoiding integration hell

aaronbassett

Continous integration and delivery for single page applications

Sunil Dalal

Grails 3.1 enhances and improves the profile system introduced in Grails 3.0. One of the new profiles ease the creation and development of applications where the the front-end is an Angular JS application, and the backend is a Grails REST API. In this session, Álvaro (member of the Grails team at OCI, Grails committer and author of several plugins) will demonstrate how to use the Angular profile to create an application using Grails 3.1, Angular JS and Spring Security REST.

Creating applications with Grails, Angular JS and Spring Security - G3 Summit...

Alvaro Sanchez-Mariscal

Git branching strategies

jstack

Ceylon is a new modern, elegant programming language for the JVM and JavaScript VM, designed for team work. But it's more than that, it is a full platform with modularity, an SDK, tools and IDEs. We will present Ceylon the language, the platform, and its ecosystem. You will see everything from starting a new project in the IDE to publishing it on Herd, our module repository, including using the SDK. We will also discuss the ongoing Ceylon projects such as the build system, Vert.x integration or Cayla, the new web framework. Finally we will discuss the plans for Ceylon 1.2 and further.

Ceylon From Here to Infinity: The Big Picture and What's Coming

Virtual JBoss User Group

JHipster

Yuen-Kuei Hsueh

Basic Git Intro

Yoad Snapir

Game of Codes: the Battle for CI

Atlassian

COSCUP 開源工作坊：Git workflows

Carl Su

Git branching-model

Aaron Huang

CI/CD and Asset Serving for Single Page Apps

Mike North

淺談 Startup 公司的軟體開發流程 v2

Wen-Tien Chang

Linux containers and Docker specifically have revolutionized the way applications are run at scale, but testing can greatly benefit from those technologies too.Containers allow to run tests in isolation with a minimum performance penalty, increased speed with respect to virtual machine based tests and easier configuration and less complexity for integration testing. Testing with containers allows running tests in a new, clean environment for each execution, minimizing false positives and environment corruption. At the same time it allows reusing container clusters to run development, testing and production workloads.You will learn to effectively use Jenkins with Docker and Kubernetes, a multi host Docker clustering technology, to run your Jenkins jobs in isolated containers for each execution at scale. http://www.agiletestingdays.com/session/using-docker-for-testing/

Using Docker for Testing

Carlos Sanchez

Git tips and tricks

Chris Ballance

@KileNiklawski with @IpponUSA presents on how we built a job board in one week using JHipster. About JHipster: Our goal is to generate for you a complete and modern Web app, unifying: - A high-performance and robust Java stack on the server side with Spring Boot - A sleek, modern, mobile-first front-end with AngularJS and Bootstrap - A powerful workflow to build your application with Yeoman, Bower, Grunt and Maven

How we built a job board in one week with JHipster

Kile Niklawski

Kubeflow Development Environment

Weiqiang Zhuang

enjoy sublime plugin

Lim Hyung-Joo

What's hot (20)

Teaching a Designer to Use GitHub

ConcourseCI love Minio

Git Started With Git

Avoiding integration hell

Continous integration and delivery for single page applications

Creating applications with Grails, Angular JS and Spring Security - G3 Summit...

Git branching strategies

Ceylon From Here to Infinity: The Big Picture and What's Coming

JHipster

Basic Git Intro

Game of Codes: the Battle for CI

COSCUP 開源工作坊：Git workflows

Git branching-model

CI/CD and Asset Serving for Single Page Apps

淺談 Startup 公司的軟體開發流程 v2

Using Docker for Testing

Git tips and tricks

How we built a job board in one week with JHipster

Kubeflow Development Environment

enjoy sublime plugin

Similar to Where the Helm are your binaries? as presented at Canada Kubernetes Meetups

While Docker has enabled an unprecedented velocity of software production, it is all too easy to spin out of control. A promotion-based model is required to control and track the flow of Docker images as much as it is required for a traditional software development lifecycle. New tools often introduce new paradigms. We will examine the patterns and the antipatterns for Docker image management, and what impact the new tools have on the battle-proven paradigms of the software development lifecycle.

Patterns and antipatterns in Docker image lifecycle as was presented at DC Do...

Baruch Sadogursky

Package your Java EE Application using Docker and Kubernetes

Arun Gupta

WSO2ConEU 2016 Tutorial - Deploying WSO2 Middleware on Containers

Lakmal Warusawithana

Deploying WSO2 Middleware on Containers

Imesh Gunaratne

How to debug IoT Agents

Fernando Lopez Aguilar

Patterns and antipatterns in Docker image lifecycle as was presented at Globa...

Baruch Sadogursky

A private Java (Maven or Gradle) repository as a service can be set up in the cloud. A private Docker registry as a service can be easily set up in the cloud. But what if you want to build a holistic CI/CD pipeline on the cloud of your choice? Baruch Sadogursky walks you through setting up a universal artifact repository, which can serve for both Java and Docker. You’ll learn how to build a CI/CD pipeline with traceable metadata from the Java source files all the way to Docker images. Baruch uses Amazon, Azure, and Google Cloud as examples, although the recipes shown are applicable to other clouds as well.

Building a private CI/CD pipeline with Java and Docker in the cloud as presen...

Baruch Sadogursky

Landscape of Eclipse MicroProfile Tools

YK Chang

CT Software Developers Meetup: Using Docker and Vagrant Within A GitHub Pull ...

E. Camden Fisher

The “rise” of the containers created very interesting opportunities for running and deploying micro-services and distributed software in general, like any good thing, it comes with a price. Building a Cloud-Native CI/CD infrastructure utilizing the advantages of containers is quite challenging. In this session, we will introduce the challenges of CI/CD in the cloud native world including building our CI/CD infrastructure as code and working with dynamic workers. We will explore popular projects aiming to help us with these challenges: Bloody Jenkins, Jenkins X and more.

Cloud native - CI/CD

Elad Hirsch

Dropwizard and Groovy

tomaslin

Patterns and antipatterns in Docker image lifecycle as was presented at Oracl...

Baruch Sadogursky

JFrog container registry - DevOps extravaganza

Batel Zohar Tova

Patterns and antipatterns in Docker image lifecycle as was presented at Scale...

Baruch Sadogursky

FIWARE Wednesday Webinars - How to Debug IoT Agents

FIWARE

Come Sail Away With Me (you guys): Node.js MVC Web API's Using Sails.js

Eric Nograles

Modern identity management platforms must be agile and secure enough to respond to demanding business timelines. As a result, many organizations are seeking cloud-based approaches to digital security and need offerings that are optimized for environments including Cloud Foundry, Azure, GCE, AWS and OpenStack. Your dev-ops strategy could be the difference between hitting or missing business-critical deadlines. In this webinar, learn how we are enhancing the ForgeRock Identity Platform to enable developers to use container-oriented technologies such as Kubernetes and Docker to accelerate deployment.

DevOps Unleashed: Strategies that Speed Deployments

ForgeRock

habitat at docker bud

Mandi Walls

What Big Data Folks Need to Know About DevOps

Matt Ray

JBoss Developer Webinar: Cloud: BoxGrinder & SteamCannon

bobmcwhirter

Similar to Where the Helm are your binaries? as presented at Canada Kubernetes Meetups (20)

Patterns and antipatterns in Docker image lifecycle as was presented at DC Do...

Package your Java EE Application using Docker and Kubernetes

WSO2ConEU 2016 Tutorial - Deploying WSO2 Middleware on Containers

Deploying WSO2 Middleware on Containers

How to debug IoT Agents

Patterns and antipatterns in Docker image lifecycle as was presented at Globa...

Building a private CI/CD pipeline with Java and Docker in the cloud as presen...

Landscape of Eclipse MicroProfile Tools

CT Software Developers Meetup: Using Docker and Vagrant Within A GitHub Pull ...

Cloud native - CI/CD

Dropwizard and Groovy

Patterns and antipatterns in Docker image lifecycle as was presented at Oracl...

JFrog container registry - DevOps extravaganza

Patterns and antipatterns in Docker image lifecycle as was presented at Scale...

FIWARE Wednesday Webinars - How to Debug IoT Agents

Come Sail Away With Me (you guys): Node.js MVC Web API's Using Sails.js

DevOps Unleashed: Strategies that Speed Deployments

habitat at docker bud

What Big Data Folks Need to Know About DevOps

JBoss Developer Webinar: Cloud: BoxGrinder & SteamCannon

More from Baruch Sadogursky

So, you want to update the software for your user, be it the nodes in your K8s cluster, a browser on user’s desktop, an app in user’s smartphone or even a user’s car. What can possibly go wrong? In this talk, we’ll analyze real-world software update fails and how multiple DevOps patterns, that fit a variety of scenarios, could have saved the developers. Manually making sure that everything works before sending an update and expecting the user to do acceptance tests before they update is most definitely not on the list of such patterns. Join us for some awesome and scary continuous update horror stories and some obvious (and some not so obvious) proven ideas for improvement and best practices you can start following tomorrow.

DevOps Patterns & Antipatterns for Continuous Software Updates @ NADOG April ...

Baruch Sadogursky

DevOps Patterns & Antipatterns for Continuous Software Updates @ DevOps.com A...

Baruch Sadogursky

In this talk, we’ll take you to a scaling journey, from 3 developers to a 100. We’ll talk about the challenges each milestone in this growth brings, both technological and methodological, and how to solve those challenges using the right mix of people, the right selection of tools and the correctly crafted process. The speakers excel in the different aspects of this triangle and went through this journey (more than once) themselves. And the fun and entertaining presentation as a Greek tragedy can’t hurt, can it?

DevOps @Scale (Greek Tragedy in 3 Acts) as it was presented at Oracle Code NY...

Baruch Sadogursky

Devops is usually viewed from a traditional perspective of a collaboration of Dev, Ops, and QA, driven by the change in Culture, People, and Process. But how do you know where you stand and where to move? As in almost any field, data and metrics give you the gauges and instruments. In this talk, we’ll talk about the key measurements for the DevOps transformation process and provide you with 3 metrics you can start measuring tomorrow.

Data driven devops as presented at QCon London 2018

Baruch Sadogursky

A Research Study Into DevOps Bottlenecks as presented at Oracle Code LA 2018

Baruch Sadogursky

Java Puzzlers NG S03 a DevNexus 2018

Baruch Sadogursky

By Baruch Sadogursky Devops is usually viewed from a traditional perspective of a collaboration of Dev, Ops and QA, driven by the change in Culture, People and Process. But how do you know where you stand and were to move? As in almost any field, data and metrics give you the gauges and instruments. In this talk we’ll talk about the key measurements for the DevOps transformation process and provide you with 3 metrics you can start measuring tomorrow.

Data driven devops as presented at Codemash 2018

Baruch Sadogursky

A Research Study into DevOps Bottlenecks as presented at Codemash 2018

Baruch Sadogursky

By Baruch Sadogursky There are three hard things in computer science: cache invalidation, naming things, and off-by-one errors. This session tackles naming, especially Docker version naming. Labels, tags, checksums...how should you use them to keep track of Docker versions? What about dev versus prod images—how best to distinguish those? What about the “latest” tag? What about cleanup? Could we do more? Versioning often seems like a simple problem, but when you have a tool that gives you as much power and flexibility as Docker does, it often helps to develop guidelines. The presentation examines the tools available for managing Docker images and some simple patterns you can employ in various use cases for CI/CD to keep track of your containers.

Best Practices for Managing Docker Versions as presented at JavaOne 2017

Baruch Sadogursky

Debugging applications in production is like being the detective in a crime movie. Especially with microservices. Especially with containers. Especially in the cloud. Trying to see what’s going on in a production deployment at scale is impossible without proper tools! Google has spent over a decade deploying containerized Java applications at unprecedented scale and the infrastructure and tools developed by Google have made it uniquely possible to manage, troubleshoot, and debug, at scale. Join this session to see how you can diagnose and troubleshoot production issues w/ out of the box Kubernetes tools, as well as getting insight from the ecosystem with Weave Scope, JFrog Artifactory & Stackdriver tools.

Troubleshooting & Debugging Production Microservices in Kubernetes as present...

Baruch Sadogursky

DevOps @Scale (Greek Tragedy in 3 Acts) as it was presented at Devoxx 2017

Baruch Sadogursky

Amazon Alexa Skills vs Google Home Actions, the Big Java VUI Faceoff as prese...

Baruch Sadogursky

DevOps @Scale (Greek Tragedy in 3 Acts) as it was presented at DevOps Days Be...

Baruch Sadogursky

Moar puzzlers! The more we work with Java 8, the more we go into the rabbit hole. Did they add all those streams, lambdas, monads, Optionals and CompletableFutures only to confuse us? It surely looks so! And Java 9 that heads our way brings even more of what we like the most, more puzzlers, of course! In this season we as usual have a great batch of the best Java WTF, great jokes to present them and great prizes for the winners!

Java Puzzlers NG S02: Down the Rabbit Hole as it was presented at The Pittsbu...

Baruch Sadogursky

DevOps @Scale (Greek Tragedy in 3 Acts) as it was presented at The Pittsburgh...

Baruch Sadogursky

Let’s Wing It: A Study in DevRel Strategy

Baruch Sadogursky

In this talk, Baruch Sadogursky presents the challenges of a high demand SaaS product incident triage at scale, as well as discuss the sources of log items, including the platform, tenants and other types of log sources. He will show practical examples of collector and filters configuration and will take you through a number of real world examples of problems investigations using Artifactory and Sumo Logic.

Log Driven First Class Customer Support at Scale

Baruch Sadogursky

No relationship in DevOps is more important than that between your CI/CD server and your Binary Repository. Jenkins has long been the go-to server for CI/CD, and JFrog Artifactory has long been one of the most popular integrations with it. This webinar focuses on the new features of the integration, leveraging the Jenkins Pipeline DSL for infrastructure-as-code of your favorite artifactory features whether it be generic, maven, gradle or Docker, and will show an end-to-end example of pipelines across multiple technologies and how powerful these new capabilities are.

[Webinar] The Frog And The Butler: CI Pipelines For Modern DevOps

Baruch Sadogursky

Groovy Puzzlers S04: The Bytecode Bites Back at Gr8Conf US 2017

Baruch Sadogursky

DevOps @Scale (Greek Tragedy in 3 Acts) as it was presented at Gr8Conf 2017

Baruch Sadogursky

More from Baruch Sadogursky (20)