A private Java (Maven or Gradle) repository as a service can be set up in the cloud. A private Docker registry as a service can be easily set up in the cloud. But what if you want to build a holistic CI/CD pipeline on the cloud of your choice? Baruch Sadogursky walks you through setting up a universal artifact repository, which can serve for both Java and Docker. You’ll learn how to build a CI/CD pipeline with traceable metadata from the Java source files all the way to Docker images. Baruch uses Amazon, Azure, and Google Cloud as examples, although the recipes shown are applicable to other clouds as well.

2. whoami
Baruch Sadogursky, JFrog Developer Advocate, @jbaruch

3. Shownotes!
• www.jfrog.com/shownotes
– Slides
– Video (tomorrow)
– Links
– Feedback
– Raffle

4. Poll Time!

5. Poll Time!
üHeard about Docker
üCan do the tutorial
üPoCing, playing etc.
üProduction, baby!
@jbaruch #oscon www.jfrog.com/shownotes

9. @jbaruch #oscon www.jfrog.com/shownotes

10. Docker Workflow

11. Union File System
@jbaruch #oscon www.jfrog.com/shownotes

12. Image Layers - OpenJDK
@jbaruch #oscon www.jfrog.com/shownotes

13. Getting Started with Docker
@jbaruch #oscon www.jfrog.com/shownotes

16. @jbaruch #oscon www.jfrog.com/shownotes

17. JFrog Artifactory + Docker
@jbaruch #oscon www.jfrog.com/shownotes

18. Who’s using Docker and nothing else?

21. The Promotion Pyramid
Development builds
Dev Integration tests
Integr. tests
Staging
Pre-Prod
Prod
Amount of builds
Build/Deploy time
Amount of
binaries

22. Pipeline: Quality Gates and Visibility
Source: Agile ALM, Michael Hüttermann, Manning Publications Co.
@jbaruch #oscon www.jfrog.com/shownotes

23. $docker build
@jbaruch #oscon www.jfrog.com/shownotes

25. Too easy!
@jbaruch #oscon www.jfrog.com/shownotes

27. That’s why.
FROM ubuntu
RUN apt-get install -y software-properties-common python
RUN apt-get install -y nodejs
RUN mkdir /var/www
ADD app.js /var/www/app.js
CMD ["/usr/bin/node", "/var/www/app.js"]
Latest version
Latest version
Latest version
Latest version
@jbaruch #oscon www.jfrog.com/shownotes

28. That’s why.
FROM ubuntu:14.04
RUN apt-get install -y software-properties-common python
RUN apt-get install -y nodejs
RUN mkdir /var/www
ADD app.js /var/www/app.js
CMD ["/usr/bin/node", "/var/www/app.js"]
Better now?
@jbaruch #oscon www.jfrog.com/shownotes

29. That’s why.
FROM ubuntu:4033353383af19ec179c01dda7f355a246c6adcafaf93c8f98
RUN apt-get install -y software-properties-common python
RUN apt-get install -y nodejs
RUN mkdir /var/www
ADD app.js /var/www/app.js
CMD ["/usr/bin/node", "/var/www/app.js"]
And now?
@jbaruch #oscon www.jfrog.com/shownotes

30. That’s why.
FROM ubuntu:4033353383af19ec179c01dda7f355a246c6adcafaf93c8f98
RUN apt-get install -y software-properties-common python
RUN apt-get install -y nodejs
RUN mkdir /var/www
ADD app.js /var/www/app.js
CMD ["/usr/bin/node", "/var/www/app.js"]
And now?What about those?
@jbaruch #oscon www.jfrog.com/shownotes

31. That’s why.
FROM ubuntu:4033353383af19ec179c01dda7f355a246c6adcafaf93c8f98
RUN mvn clean install
CMD ”java –jar Main.class"
What about this?
@jbaruch #oscon www.jfrog.com/shownotes

32. That’s why.
FROM ubuntu:4033353383af19ec179c01dda7f355a246c6adcafaf93c8f98
RUN download_random_sh*t_from_the_internet.sh
CMD ["/usr/bin/node", "/var/www/app.js"]
And how about this?
@jbaruch #oscon www.jfrog.com/shownotes

33. That’s why you don’t trust Docker
@jbaruch #oscon www.jfrog.com/shownotes

34. Traditional Server Pattern
http://martinfowler.com/bliki/ImmutableServer.html
@jbaruch #oscon www.jfrog.com/shownotes

35. Immutable Server Pattern
http://martinfowler.com/bliki/ImmutableServer.html
@jbaruch #oscon www.jfrog.com/shownotes

38. What’s up with the gates?!

39. @jbaruch #oscon www.jfrog.com/shownotes

40. What’s up with the gates?!

41. What’s up with the gates?!
- QA shouldn’t test dev images

42. What’s up with the gates?!
- QA shouldn’t test dev images
- non-tested images shouldn't be
staged

43. What’s up with the gates?!
- QA shouldn’t test dev images
- non-tested images shouldn't be
staged
- non-staged, non-tested or dev
images shouldn’t end up in
production!!!

44. Not so fast…

45. Trumped-up limitations

46. The Anatomy of Docker Tag
@jbaruch #oscon www.jfrog.com/shownotes

47. Wait a second, how can I
have more than one
repository per host now?!

48. How can we support this?
https://host:8081/artifactory/docker-dev/busybox
https://host:8081/artifactory/docker-staging/busybox
https://host:8081/artifactory/docker-qa/busybox
https://host:8081/artifactory/docker-prod/busybox
@jbaruch #oscon www.jfrog.com/shownotes

49. “ONEREGISTRYPERHOSTOUGHTTOBEENOUGHFORANYBODY.”

50. Panic!
@jbaruch #oscon www.jfrog.com/shownotes

51. Virtual hosts/ports to the rescue
Registry host Tag name
docker tag host:port/busybox
@jbaruch #oscon www.jfrog.com/shownotes

52. Virtual hosts/ports to the rescue
https://host:port/v2/busybox
Registry host Tag name
docker tag host:port/busybox
@jbaruch #oscon www.jfrog.com/shownotes

53. Virtual hosts/ports to the rescue
https://host:8081/artifactory/docker-dev/busybox
Virtual repository name Tag name
https://host:port/v2/busybox
Context name
Registry host Tag name
docker tag host:port/busybox

54. server {
listen 5001;
server_name 192.168.99.100;
if ($http_x_forwarded_proto = '') {
set $http_x_forwarded_proto $scheme;
}
rewrite ^/(v1|v2)/(.*) /artifactory/api/docker/docker-dev/$1/$2;
…
}
}
@jbaruch #oscon www.jfrog.com/shownotes

55. But then you realize…
Wait a second, now I need
to pull, retag and push for
every step?!

58. Anatomy of a container
@jbaruch #oscon www.jfrog.com/shownotes

59. Our Layers
Application:
••.war file
Framework:
••JDK8 + Wildfly
Base:
••CentOS

60. Framework build
- Verified base image
- Add system dependencies
from artifactory
- JDK
- wildfly
- Own it!

61. Minimal Framework build Dockerfile
FROM centos:7
MAINTAINER you@yourorg.com
@jbaruch #oscon www.jfrog.com/shownotes

62. Application build
- Framework is your base
- Run a java build
- Add a file to base
- Done!

63. Application build Dockerfile
FROM yourorg-docker.jfrog.io/yourorg/framework:latest
MAINTAINER you@yourorg.com
ADD https://yourorg.jfrog.io/yourorg/java-release-local/…/app-[RELEASE].war
/opt/jboss/wildfly/standalone/deployments/app.war
@jbaruch #oscon www.jfrog.com/shownotes

64. Application build Dockerfile
FROM yourorg-docker.jfrog.io/yourorg/framework:latest
MAINTAINER you@yourorg.com
ADD https://yourorg.jfrog.io/yourorg/java-release-local/…/app-[RELEASE].war
/opt/jboss/wildfly/standalone/deployments/app.war
@jbaruch #oscon www.jfrog.com/shownotes

65. Application build Dockerfile
FROM yourorg-docker.jfrog.io/yourorg/framework:latest
MAINTAINER you@yourorg.com
ADD https://yourorg.jfrog.io/yourorg/java-release-local/…/app-[RELEASE].war
/opt/jboss/wildfly/standalone/deployments/app.war
@jbaruch #oscon www.jfrog.com/shownotes

67. @jbaruch #oscon www.jfrog.com/shownotes

68. Framework Pipeline
Application Pipeline

69. Framework Pipeline
Application Pipeline

70. Framework Pipeline
Application Pipeline

73. Q&A Time!
• www.jfrog.com/shownotes
– Slides
– Video (tomorrow)
– Links
– Feedback
– Raffle
• http://swampUP.jfrog.com
– Devops and JFrog leaders
– Devops and JFrog content
– Napa Valley in May!