Puppet & Jenkins

•

7 likes•11,038 views

Puppet, Jenkins, and continuous integration (CI) were discussed. The presentation covered installing Jenkins as a master and slaves using Puppet, integrating Github pull requests with Jenkins and Mergeatron, and testing Puppet code with tools like Puppet Lint, Rspec-Puppet, and eventually running Puppet code on VMs. Future work may involve catalog checking and running Puppet code against real systems.

Puppet, Jenkins & CI

SNAP Interactive, Inc.

Presented by:

Matthew Barr
Technical Architect

Thursday, February 21, 13

Company Overview
• SNAP Interactive, Inc.

• AreYouInterested.com

• Believes it is one of the largest social discovery platforms on the web
(based on monthly active users)

• More than 5 million monthly active users

• Over 1 billion total pieces of structured data from its users

• Synced to millions of Facebook proﬁles

• Receives over 1,000 real-time updates per minute on like actions from
Facebook

• Subscription-based business model

• SNAP is publicly traded - Ticker: STVI
www.snap-interactive.com
Thursday, February 21, 13

About me
• Team lead for the operations group
• Sysadmin for over 15 years
• Dev/ops, WebOps, etc.

www.snap-interactive.com
Thursday, February 21, 13

Continuous Integration
• The practice of frequently integrating one's
new or changed code with the existing code
repository

• Maintain a • Make the • Everyone
code build self- can see the
repository testing results of the
latest build
• Automate • Keep the
the build build fast

www.snap-interactive.com
Thursday, February 21, 13

Puppet
• Puppet Labs
• https://puppetlabs.com/
• You’re at PuppetNYC :)

www.snap-interactive.com
Thursday, February 21, 13

Jenkins
• An extendable open source continuous integration
server

• http://jenkins-ci.org/

www.snap-interactive.com
Thursday, February 21, 13

So, let’s do this!
• Puppet Dynamic Environments
• Install Jenkins (master)
• Install Jenkins slaves (swarm clients)
• Mergeatron
• Puppet Parsing & Linting
• Puppet Testing
www.snap-interactive.com
Thursday, February 21, 13

Puppet Dynamic Env’s
• google: puppet dynamic environments
• Git based
• Each branch is it’s own environment
• Commit hook / web
• https://puppetlabs.com/blog/git-workﬂow-
and-puppet-environments/

www.snap-interactive.com
Thursday, February 21, 13

Jenkins install
• puppet module install rtyler-jenkins
• Puppet forge module: rtyler/puppet-jenkins
• But: this code hasn’t been merged :(
• It’s in my github repo:
• https://github.com/matthewbarr/puppet-
jenkins

www.snap-interactive.com
Thursday, February 21, 13

Jenkins Master
include jenkins
jenkins::plugin {'swarm':}
OR
class {'jenkins':
lts => 1, # Long term Stable version
repo => 0, # Disable Jenkins repo conﬁg
}
jenkins::plugin {'swarm':}

www.snap-interactive.com
Thursday, February 21, 13

Jenkins Slave: Easy!

include jenkins::slave

www.snap-interactive.com
Thursday, February 21, 13

$Jenkins Slave: Features! class {'jenkins::slave': masterurl => 'http://jenkins01.ayisnap.com:8080', ui_user => 'UI_USER', ui_pass => 'UI_PASS', # version => '1.8', executors => 4, # manage_slave_user => 1, slave_user => $slave_user, slave_uid => '600', slave_home => $slave_home, } www.snap-interactive.com Thursday, February 21, 13$

Github
• Private repos for organizations
• Pull Requests!

www.snap-interactive.com
Thursday, February 21, 13

Demo!

www.snap-interactive.com
Thursday, February 21, 13

PR: Swarm plugin code

www.snap-interactive.com
Thursday, February 21, 13

Mergeatron
• Developed in house
• Open Source
• Nodejs
• Not yet in NPM :(
• http://snapinteractive.github.com/
mergeatron/

www.snap-interactive.com
Thursday, February 21, 13

Mergeatron ^2
• Monitors github (or other) for a pull
request
• Triggers a Jenkins “build”
• Build can do anything: unit tests, etc

www.snap-interactive.com
Thursday, February 21, 13

Mergeatron ^3
• We use it to monitor 2 repo’s
• Web site code
• phpunit
• phpcs
• jshint
• Ops repo (Puppet) - puppet parser
www.snap-interactive.com
Thursday, February 21, 13

Puppet Testing
• Puppet Lint
• http://puppet-lint.com/
• Rspec-Puppet
• http://rspec-puppet.com/
• ERB Parsing:erb
-‐P
-‐x
-‐T
'-‐'
mytempl.erb
|
ruby
-‐c

• Cucumber-puppet
• (Discontinued.)
www.snap-interactive.com
Thursday, February 21, 13

Puppet Testing - Future
• Parsing is a nice start
• Catalog checks can help, especially for
supporting systems & edge cases
• Actually running it, though, is the only real
test that matters.
• VM’s, functional / unit tests agains real
systems that deliver your app.

www.snap-interactive.com
Thursday, February 21, 13

Updates
• Catalog checker w/ other facts- Ohad Levy:
• https://github.com/ohadlevy/manitest

• Github Pull Request Checker for Jenkins
• https://wiki.jenkins-ci.org/display/JENKINS/GitHub+pull+request+builder+plugin

www.snap-interactive.com
Thursday, February 21, 13

Contact Us
• SNAP Interactive, Inc.
www.snap-interactive.com

• Matthew Barr
Technical Architect
mbarr@snap-interactive.com
Twitter & Github:
@MatthewBarr

www.snap-interactive.com
Thursday, February 21, 13

This document discusses using Jenkins, Puppet, and Mcollective to implement a continuous delivery pipeline. It recommends using infrastructure as code with Puppet, nodeless Puppet configurations, and Mcollective to operate on collectives of servers. Jenkins is used for continuous integration and triggering deployments. Packages are uploaded to a repository called Seli that provides a REST API and can trigger deployment pipelines when new packages are uploaded. The goal is to continuously test, deploy, and release changes through full automation of the software delivery process.

Securing jenkins

CloudBees

Jenkinsconf Presentation - Advance jenkins management with multiple projects.

Ohad Basan

Large scale automation with jenkins

Kohsuke Kawaguchi

1. The document discusses various ways to configure complex workflows in Jenkins using plugins like the Parameterized Trigger Plugin, Multi-Configuration Project, Promoted Builds Plugin, and Fingerprint Plugin. 2. Key aspects covered include passing parameters between jobs, running jobs in parallel configurations, promoting builds between stages like testing and production, and tracking artifacts and dependencies between jobs. 3. Advanced workflow capabilities in Jenkins allow automating multi-step build, test, and deployment processes in a flexible and reusable manner.

OSDC 2017 - Julien Pivotto - Automating Jenkins

NETWAYS

Jenkins is a unique piece of software, lots of people and enterprises use it to deploy and build their software and also their infrastructure. It has tons of plugins, and can do virtually anything. It is important for both devs and ops. This talk will be about how you can automate and test your Jenkins instances. In the past, the tooling around it was not so great, but it has changed. Tools like Jenkins Pipeline and Job DSL plugin has entered the game and are here to stay.

Who *is* Jenkins?

Andrew Bayer

This document provides an overview of using Jenkins for continuous integration and automation tasks. It begins with introducing Jenkins and its common uses. The presenter then explains that the workshop will provide examples of tasks that can be automated with Jenkins rather than being an exhaustive Jenkins tutorial. Examples of jobs that could be automated include continuously building a project, running tests, and checking for errors. The document walks through setting up a sample Jenkins project that checks out code files from a Git repository, builds them into an RPM package, adds the RPM to a repository, and loads the files onto a server. It provides details on configuring the project, scheduling automatic builds, and viewing the output of the initial test build.

Let’s start Continuous Integration with jenkins

Tomohide Kakeya

Best Practices for Mission-Critical Jenkins

mrooney7828

An Open-Source Chef Cookbook CI/CD Implementation Using Jenkins Pipelines

Steffen Gebert

This document discusses implementing continuous integration and continuous delivery (CI/CD) for Chef cookbooks using Jenkins pipelines. It introduces Jenkins pipelines and how they can be used to test, version, and publish Chef cookbooks. Key steps include linting, dependency resolution, test-kitchen testing, version bumping, and uploading to the Chef Server. The jenkins-chefci cookbook automates setting up Jenkins with the necessary tools to run pipelines defined in a shared Groovy library for cookbook CI/CD.

Jenkins tutorial

Mamun Rashid, CCDH

Jenkins is a tool that allows users to automate multi-step processes that involve dependencies across multiple servers. It can be used to continuously build, test, and deploy code by triggering jobs that integrate code, run tests, deploy updates, and more. Jenkins provides a web-based interface to configure and manage recurring jobs and can scale to include slave agents to perform tasks on other machines. It offers many plugins to support tasks like testing, deployment, and notifications.

7 Habits of Highly Effective Jenkins Users

Jules Pierre-Louis

The document discusses 7 habits of highly effective Jenkins users. It recommends using long-term support releases, breaking up large jobs into smaller modular jobs, and defining Jenkins tasks programmatically using scripts and pipelines rather than manually configuring through the UI. Key plugins are also discussed like Pipeline, Job DSL, and others that help automate Jenkins configuration and integration.

Building Jenkins Pipelines at Scale

Julien Pivotto

The document outlines Julien Pivotto's presentation on building pipelines at scale using Jenkins and Puppet. It discusses how Puppet can be used to define Jenkins job configurations and pipelines for applications and infrastructure to allow easy deployment of new pipelines. It also covers alternative approaches using Jenkins plugins to define pipelines through Groovy scripts to reduce complexity compared to Puppet management.

Jenkins Shared Libraries Workshop

Julien Pivotto

Introduction to jenkins

Abe Diaz

Managing Jenkins with Jenkins (Jenkins User Conference Palo Alto, 2013)

Gareth Bowles

Gareth from Netflix is giving a talk about how they use Jenkins' System Groovy Scripts feature to automate management of their large Jenkins infrastructure. Some examples of tasks they automate include disabling jobs that haven't built successfully in 90 days, relabeling slaves when updating EC2 configurations, monitoring slaves for remoting errors and notifying owners about disconnected custom slaves. System Groovy Scripts provide full access to Jenkins like a plugin but are easier to write and maintain.

Jenkins Pipelines

Steffen Gebert

This document discusses Jenkins Pipelines, which allow defining continuous integration and delivery (CI/CD) pipelines as code. Key points: - Pipelines are defined using a Groovy domain-specific language (DSL) for stages, steps, and environment configuration. - This provides configuration as code that is version controlled and reusable across projects. - Jenkins plugins support running builds and tests in parallel across Docker containers. - Notifications can be sent to services like Slack on failure. - The Blue Ocean UI in Jenkins focuses on visualization of pipeline runs.

Jenkins Scriptler in 90mins

Larry Cai

The document outlines exercises for learning Jenkins Scriptler, which allows administering Jenkins scripts to troubleshoot, diagnose, and automate tasks. The exercises include writing a "Hello World" script, hooking into Jenkins to retrieve and print job names, using the Jenkins Java API to find necessary methods, putting a script into the Scriptler catalog, and learning Groovy loops and closures. References for the Scriptler catalog, Groovy, and Jenkins scripting guidelines are also provided.

Hudson

8x8

Continuous integration is a practice where developers integrate code changes frequently from the main code repository. This allows for multiple integrations per day. An automated build is run on each check-in, including running tests to detect errors early. Hudson is a free continuous integration tool written in Java that runs builds, tests, and reports issues. It integrates with source control and build tools via plugins. Eclipse plugins can also be built with Hudson and Buckminster to automate their creation and publication.

Jenkins, pipeline and docker

AgileDenver

The Jenkins open source continuous integration server now provides a “pipeline” scripting language which can define jobs that persist across server restarts, can be stored in a source code repository and can be versioned with the source code they are building. By defining the build and deployment pipeline in source code, teams can take full control of their build and deployment steps. The Docker project provides lightweight containers and a system for defining and managing those containers. The Jenkins pipeline and Docker containers are a great combination to improve the portability, reliability, and consistency of your build process. This session will demonstrate Jenkins and Docker in the journey from continuous integration to DevOps.

Using Docker for Testing

Carlos Sanchez

Linux containers and Docker specifically have revolutionized the way applications are run at scale, but testing can greatly benefit from those technologies too.Containers allow to run tests in isolation with a minimum performance penalty, increased speed with respect to virtual machine based tests and easier configuration and less complexity for integration testing. Testing with containers allows running tests in a new, clean environment for each execution, minimizing false positives and environment corruption. At the same time it allows reusing container clusters to run development, testing and production workloads.You will learn to effectively use Jenkins with Docker and Kubernetes, a multi host Docker clustering technology, to run your Jenkins jobs in isolated containers for each execution at scale. http://www.agiletestingdays.com/session/using-docker-for-testing/

Jenkins Workflow Webinar - Dec 10, 2014

CloudBees

The document discusses the new Jenkins Workflow engine. It provides an overview of continuous delivery and how Jenkins is used to orchestrate continuous delivery processes. The new Workflow engine in Jenkins allows defining complex build pipelines using a Groovy DSL, with features like stages, interactions with humans, and restartable builds. Examples of using the new Workflow syntax are demonstrated. Possible future enhancements to Workflow are also discussed.

Jenkins CI presentation

Jonathan Holloway

Jenkins is a continuous integration server that detects changes to code repositories, running tasks like building, testing, and deploying code. It helps integrate code more frequently to detect errors early. Jenkins has over 47,000 installations and 600+ plugins. It coordinates running tasks as part of workflows to compile, test, package, and deploy code. Common alternatives to Jenkins include TeamCity and Bamboo.

SD DevOps Meet-up - Jenkins 2.0 and Pipeline-as-Code

Brian Dawson

Jenkins

Roger Xia

Jenkins is a tool that supports continuous integration by automatically building, testing, and deploying code changes. It integrates code changes frequently, at least daily, to avoid "big bang" integrations. Jenkins runs builds and tests across multiple platforms using slave nodes. It supports various source control systems and build tools and notifies developers of failed builds or tests through email or other plugins.

Testing with Docker

toffermann

This document discusses using Docker containers to test Python applications in varied environments. The proposed solution is to: 1. Create Docker images for dependencies like databases. 2. Build a test image with the source code and testing tools. 3. Run tests by launching a container from the test image linked to dependency containers. 4. The packnsend tool is used to initialize images, run tests across multiple environments, and clean up containers after testing.

Infrastructure testing with Jenkins, Puppet and Vagrant - Agile Testing Days ...

Carlos Sanchez

Extend Continuous Integration to automatically test your infrastructure. Continuous Integration can be extended to test deployments and production environments, in a Continuous Delivery cycle, using infrastructure-as-code tools like Puppet, allowing to manage multiple servers and their configurations, and test the infrastructure the same way continuous integration tools do with developers’ code. Puppet is an infrastructure-as-code tool that allows easy and automated provisioning of servers, defining the packages, configuration, services, … in code. Enabling DevOps culture, tools like Puppet help drive Agile development all the way to operations and systems administration, and along with continuous integration tools like Jenkins, it is a key piece to accomplish repeatability and continuous delivery, automating the operations side during development, QA or production, and enabling testing of systems configuration. Using Vagrant, a command line automation layer for VirtualBox, we can easily spin off virtual machines with the same configuration as production servers, run our test suite, and tear them down afterwards. We will show how to set up automated testing of an application and associated infrastructure and configurations, creating on demand virtual machines for testing, as part of your continuous integration process.

CI and CD with Jenkins

Martin Málek

Continuous integration involves developers committing code changes daily which are then automatically built and tested. Continuous delivery takes this further by automatically deploying code changes that pass testing to production environments. The document outlines how Jenkins can be used to implement continuous integration and continuous delivery through automating builds, testing, and deployments to keep the process fast, repeatable and ensure quality.

What's hot

At Your Service: Using Jenkins in Operations

Mandi Walls

Let’s start Continuous Integration with jenkins

Tomohide Kakeya

Best Practices for Mission-Critical Jenkins

mrooney7828

An Open-Source Chef Cookbook CI/CD Implementation Using Jenkins Pipelines

Steffen Gebert

Jenkins tutorial

Mamun Rashid, CCDH

7 Habits of Highly Effective Jenkins Users

Jules Pierre-Louis

Building Jenkins Pipelines at Scale

Julien Pivotto

Jenkins Shared Libraries Workshop

Julien Pivotto

Introduction to jenkins

Abe Diaz

Managing Jenkins with Jenkins (Jenkins User Conference Palo Alto, 2013)

Gareth Bowles

Jenkins Pipelines

Steffen Gebert

Jenkins Scriptler in 90mins

Larry Cai

Hudson

8x8

Jenkins, pipeline and docker

AgileDenver

Using Docker for Testing

Carlos Sanchez

Jenkins Workflow Webinar - Dec 10, 2014

CloudBees

Jenkins CI presentation

Jonathan Holloway

SD DevOps Meet-up - Jenkins 2.0 and Pipeline-as-Code

Brian Dawson

Jenkins

Roger Xia

Testing with Docker

toffermann

What's hot (20)

At Your Service: Using Jenkins in Operations

Let’s start Continuous Integration with jenkins

Best Practices for Mission-Critical Jenkins

An Open-Source Chef Cookbook CI/CD Implementation Using Jenkins Pipelines

Jenkins tutorial

7 Habits of Highly Effective Jenkins Users

Building Jenkins Pipelines at Scale

Jenkins Shared Libraries Workshop

Introduction to jenkins

Managing Jenkins with Jenkins (Jenkins User Conference Palo Alto, 2013)

Jenkins Pipelines

Jenkins Scriptler in 90mins

Hudson

Jenkins, pipeline and docker

Using Docker for Testing

Jenkins Workflow Webinar - Dec 10, 2014

Jenkins CI presentation

SD DevOps Meet-up - Jenkins 2.0 and Pipeline-as-Code

Jenkins

Testing with Docker

Viewers also liked

Infrastructure testing with Jenkins, Puppet and Vagrant - Agile Testing Days ...

Carlos Sanchez

CI and CD with Jenkins

Martin Málek

Yale Jenkins Show and Tell

E. Camden Fisher

The document discusses how Jenkins helps improve the software development process at Yale. It outlines challenges without Jenkins, such as slow and error-prone builds, difficult testing and code coverage, and lack of change control for deployments. With Jenkins, builds are automated and consistent, testing and code coverage are automated, changes are tracked, and deployments are easier. Jenkins supports continuous integration, containerized artifacts, and managed deployments to improve agility, catch bugs early, and standardize environments. The document also discusses how Jenkins supports non-Java languages and future plans.

Puppet camp 2015 phoenix david patterson

Puppet

This document discusses using Puppet for configuration management and summarizing the benefits and concerns of getting management and developers onboard. It outlines a two phase process of pre-presentation to gather information and address concerns, and a development/implementation phase with communication. Benefits include stability, consistency, control and time savings while concerns include time to implement, accountability and being "another tool". The document advocates treating dev and ops as symbiotic and providing necessary documentation and resources.

Agile Deployments with Puppet

Puppet

Jenkins and Groovy

Kiyotaka Oku

This document discusses using Groovy with Jenkins for continuous integration. It describes how to install Groovy on Jenkins, use Groovy scripts for initialization and through the Jenkins CLI, and leverage Groovy features like Grape for dependencies. Examples are given of initializing Jenkins, running scripts against it from the CLI or Groovy shell, and developing Groovy-based plugins. Benefits highlighted include Groovy's Java interoperability and how it enables dynamic Jenkins configurations and automation through scripts.

CONTINUOUS INTEGRATION WITH JENKINS AND GIT

Benjamin Lutaaya

The document discusses continuous integration using Jenkins and Git. Continuous integration involves integrating code changes frequently from developers on a project to avoid integration problems late in a project. Jenkins is a free and open source continuous integration server that can be used with version control systems like Git to automatically build code, run tests, and generate reports each time changes are committed to the repository. Setting up continuous integration involves installing Jenkins, configuring a Git repository, and configuring Jenkins to clone the repository, build the code, run tests, and generate reports on each change notification from Git.

Building an Extensible, Resumable DSL on Top of Apache Groovy

jgcloudbees

Presented at: https://apacheconeu2016.sched.org/event/8ULR n 2014, a few Jenkins hackers set out to implement a new way of defining continuous delivery pipelines in Jenkins. Dissatisfied with chaining jobs together, configured in the web UI, the effort started with Apache Groovy as the foundation and grew from there. Today the result of that effort, named Jenkins Pipeline, supports a rich DSL with "steps" provided by a Jenkins plugins, built-in auto-generated documentation, and execution resumability which allow Pipelines to continue executing while the master is offline. In this talk we'll take a peek behind the scenes of Jenkins Pipeline. Touring the various constraints we started with, whether imposed by Jenkins or Groovy, and discussing which features of Groovy were brought to bear during the implementation. If you're embedding, extending or are simply interested in the internals of Groovy this talk should have plenty of food for thought.

PuppetConf 2016: Continuous Delivery and DevOps with Jenkins and Puppet Enter...

Puppet

This document discusses continuous delivery and DevOps practices using Jenkins and Puppet. It defines DevOps as addressing security at every stage and having high-performing teams that spend less time fixing issues. It also discusses the DevOps trinity of people, processes, and tools. Jenkins Pipelines and infrastructure as code with Puppet are presented as key practices for continuous delivery. The integration of Jenkins and Puppet Enterprise is demonstrated for automating application deployments.

Jenkins and Chef: Infrastructure CI and Automated Deployment

Dan Stine

This presentation discusses two key components of our deployment pipeline: Continuous integration of Chef code and automated deployment of Java applications. CI jobs for Chef code run static analysis and then provision, configure and test EC2 instances. Release jobs publish new cookbook versions to the Chef server. Deployment jobs identify target EC2 and VMware nodes and orchestrate Chef client runs. The flexibility of Jenkins is essential to our overall delivery architecture.

Automated Infrastructure Testing

Ranjib Dey

The document discusses automated infrastructure testing. It explains that infrastructure testing involves automating the testing of code, infrastructure as code, and deployed infrastructure. This is done through unit, functional, integration and monitoring tests. The document recommends collaborating with operations and building thorough monitoring and analytics. Automating tests helps ensure battle tested code and infrastructure health. Cloud infrastructure also requires more testing across providers. Lessons include starting with most time consuming tasks and understanding domain concepts.

Continuous Integration (Jenkins/Hudson)

Dennys Hsieh

Jenkins is an open-source tool for continuous integration that allows developers to integrate code changes frequently from a main branch using an automated build process. It detects errors early, measures code quality, and improves delivery speed. Jenkins supports various source control, build tools, and plugins to customize notifications and reporting. Security features allow restricting access and privileges based on user roles and projects.

Continuous Delivery with Jenkins and Wildfly (2014)

Tracy Kennedy

Anatomy of a Continuous Integration and Delivery (CICD) Pipeline

Robert McDermott

Docker Online Meetup: Announcing Docker CE + EE

Docker, Inc.

Docker Community Edition (CE) and Enterprise Edition (EE) are the best expressions of the Docker Platform to date. Whether you’re a developer, an ops team or a enterprise IT-team member, and no matter the infrastructure, Docker CE and EE gives you a way to install, upgrade and maintain Docker with the support and assurances required for your particular workload. Both Docker CE and EE are available on a wide range of popular operating systems (including Windows Server 2016) and cloud infrastructure. Developers and devOps have the freedom to run Docker on their favorite infrastructure without risk of lock-in. Michael Friis will give an overview of both editions and highlight the big enhancements to the lifecycle, maintainability and upgradability of Docker.

Flink vs. Spark

Slim Baltagi

Viewers also liked (16)

Infrastructure testing with Jenkins, Puppet and Vagrant - Agile Testing Days ...

CI and CD with Jenkins

Yale Jenkins Show and Tell

Puppet camp 2015 phoenix david patterson

Agile Deployments with Puppet

Jenkins and Groovy

CONTINUOUS INTEGRATION WITH JENKINS AND GIT

Building an Extensible, Resumable DSL on Top of Apache Groovy

PuppetConf 2016: Continuous Delivery and DevOps with Jenkins and Puppet Enter...

Jenkins and Chef: Infrastructure CI and Automated Deployment

Automated Infrastructure Testing

Continuous Integration (Jenkins/Hudson)

Continuous Delivery with Jenkins and Wildfly (2014)

Anatomy of a Continuous Integration and Delivery (CICD) Pipeline

Docker Online Meetup: Announcing Docker CE + EE

Flink vs. Spark

Similar to Puppet & Jenkins

Continuously Integrating Puppet

Puppet

SNAP Interactive is a social dating platform with over 5 million monthly active users. The presenter discusses how to implement continuous integration of Puppet code through dynamic environments, Jenkins, GitHub pull requests, static analysis, module and catalog testing, dynamic deployment testing, nightly rebuilds, and canary servers before code is released to production. Automating testing ensures code quality and that infrastructure changes do not break existing functionality.

Java User Group Cologne

Software Entwicklung Beratung Schulung

Ant, Maven and Jenkins

Kenu, GwangNam Heo

Lrug

Julian Simpson

The document discusses the convergence of system administrators and developers as programming has become more integral to system administration work. It notes that system administrators now write code using languages like Ruby, Python, and Bash just as developers do. It argues that system administrators who do not program have become merely domain experts. The document also discusses challenges around sharing system administration tools and modules, as well as testing infrastructure using approaches from software development like Cucumber testing.

Etsy chef-workflow

Daniel Schauenberg

Etsy uses Chef for infrastructure configuration and management. They have around 1000 nodes managed by around 30 devops engineers making regular changes. Chef Server and GitHub Enterprise are used to manage configuration code and changes. Knife-spork is used as the deployment tool to promote changes through development, staging, and production environments. Monitoring and notification tools like IRC alerts are used for change management and failure reporting.

Release management with NuGet/Chocolatey/JIRA

Yaroslav Serhieiev

Steamlining your puppet development workflow

Tomas Doran

The document discusses ways to streamline a Puppet development workflow including using revision control, running Puppet in noop or automatic mode, moving changes slowly through testing and using branches, reporting on changes, and implementing testing strategies like unit testing with rspec-puppet and integration testing with serverspec. It also recommends tools like Foreman, Norman, Puppetfile, and Jenkins to improve testing and deployment.

Puppet Camp New York 2014: Streamlining Puppet Development Workflow

Puppet

Continuous integration with jenkins

Pei-Tang Huang

This document provides an overview of continuous integration using Jenkins. It discusses topics like integrating code changes daily, automating builds and tests, using Jenkins plugins for static code analysis and artifact management, and best practices like fixing broken builds quickly and keeping the build fast. Jenkins is introduced as an open source automation server that supports continuous integration practices through features like built-in plugins, proxy configuration, and providing feedback to developers.

Testing Drupal with Ghosts and Gherkin

Phase2

This document discusses using CasperJS and Behat to test Drupal sites. It begins with an introduction to the speaker and covers why Simpletest and Selenium have limitations for testing complex AJAX interactions. CasperJS and PhantomJS are introduced as headless testing tools that allow testing real browser interactions without a visible browser. Examples are provided of using the CasperJS API and setting up Travis CI integration for automated testing. Behavioral testing with Behat and Gherkin syntax is also briefly discussed.

Frontend Engineer Toolbox

Ynon Perek

2018 ABRF Tools for improving rigor and reproducibility in bioinformatics

Stephen Turner

Seven Habits of Highly Effective Jenkins Users (2014 edition!)

Andrew Bayer

Mobile Web to Mobile Apps

Troy Miles

Sonian, Open Source and Sensu

Pete Cheslock

This document discusses Sonian's contributions to open source projects like Fog, Elasticsearch, OpenStack Swift, and Chef. It also describes Sensu, an open source monitoring framework developed by Sonian. Sensu is designed for dynamic cloud environments using a messaging architecture with RabbitMQ and Redis. It allows reusing existing Nagios plugins and is intended to work with configuration management tools like Chef and Puppet. The document advocates adopting an open source community approach around Sensu to help test, develop plugins/modules, and provide documentation.

Iasi code camp 20 april 2013 implement-quality-java-massol-codecamp

Codecamp Romania

This document discusses implementing quality practices on Java projects. It provides tips on API stability, such as using deprecations, CLIRR to track API changes, excluding internal packages from javadocs, and using annotations to mark unstable APIs. It also discusses preventing JAR hell by avoiding duplicate classes at runtime and ensuring correct dependency versions. The document recommends using Jacoco to enforce test coverage thresholds and failing the build when not met. It suggests strategies for improving functional test stability, such as ignoring known failure cases. Finally, it proposes designating regular bug fixing days to focus on resolving existing issues.

Culerity and Headless Full Stack Integration Testing

Patrick Huesler

Automated Acceptance Testing from Scratch

Excella

How Build Infrastructure Powers the Node.js Foundation

Gibson Fahnestock

Alfresco DevCon 2018: SDK 3 Multi Module project using Nexus 3 for releases a...

Martin Bergljung

Similar to Puppet & Jenkins (20)

Continuously Integrating Puppet

Java User Group Cologne

Ant, Maven and Jenkins

Lrug

Etsy chef-workflow

Release management with NuGet/Chocolatey/JIRA

Steamlining your puppet development workflow

Puppet Camp New York 2014: Streamlining Puppet Development Workflow

Continuous integration with jenkins

Testing Drupal with Ghosts and Gherkin

Frontend Engineer Toolbox

2018 ABRF Tools for improving rigor and reproducibility in bioinformatics

Seven Habits of Highly Effective Jenkins Users (2014 edition!)

Mobile Web to Mobile Apps

Sonian, Open Source and Sensu

Iasi code camp 20 april 2013 implement-quality-java-massol-codecamp

Culerity and Headless Full Stack Integration Testing

Automated Acceptance Testing from Scratch

How Build Infrastructure Powers the Node.js Foundation

Alfresco DevCon 2018: SDK 3 Multi Module project using Nexus 3 for releases a...

Recently uploaded

UiPath Test Automation using UiPath Test Suite series, part 6

DianaGray10

Welcome to UiPath Test Automation using UiPath Test Suite series part 6. In this session, we will cover Test Automation with generative AI and Open AI. UiPath Test Automation with generative AI and Open AI webinar offers an in-depth exploration of leveraging cutting-edge technologies for test automation within the UiPath platform. Attendees will delve into the integration of generative AI, a test automation solution, with Open AI advanced natural language processing capabilities. Throughout the session, participants will discover how this synergy empowers testers to automate repetitive tasks, enhance testing accuracy, and expedite the software testing life cycle. Topics covered include the seamless integration process, practical use cases, and the benefits of harnessing AI-driven automation for UiPath testing initiatives. By attending this webinar, testers, and automation professionals can gain valuable insights into harnessing the power of AI to optimize their test automation workflows within the UiPath ecosystem, ultimately driving efficiency and quality in software development processes. What will you get from this session? 1. Insights into integrating generative AI. 2. Understanding how this integration enhances test automation within the UiPath platform 3. Practical demonstrations 4. Exploration of real-world use cases illustrating the benefits of AI-driven test automation for UiPath Topics covered: What is generative AI Test Automation with generative AI and Open AI. UiPath integration with generative AI Speaker: Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP

Serial Arm Control in Real Time Presentation

tolgahangng

Removing Uninteresting Bytes in Software Fuzzing

Aftab Hussain

Imagine a world where software fuzzing, the process of mutating bytes in test seeds to uncover hidden and erroneous program behaviors, becomes faster and more effective. A lot depends on the initial seeds, which can significantly dictate the trajectory of a fuzzing campaign, particularly in terms of how long it takes to uncover interesting behaviour in your code. We introduce DIAR, a technique designed to speedup fuzzing campaigns by pinpointing and eliminating those uninteresting bytes in the seeds. Picture this: instead of wasting valuable resources on meaningless mutations in large, bloated seeds, DIAR removes the unnecessary bytes, streamlining the entire process. In this work, we equipped AFL, a popular fuzzer, with DIAR and examined two critical Linux libraries -- Libxml's xmllint, a tool for parsing xml documents, and Binutil's readelf, an essential debugging and security analysis command-line tool used to display detailed information about ELF (Executable and Linkable Format). Our preliminary results show that AFL+DIAR does not only discover new paths more quickly but also achieves higher coverage overall. This work thus showcases how starting with lean and optimized seeds can lead to faster, more comprehensive fuzzing campaigns -- and DIAR helps you find such seeds. - These are slides of the talk given at IEEE International Conference on Software Testing Verification and Validation Workshop, ICSTW 2022.

Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...

SOFTTECHHUB

The choice of an operating system plays a pivotal role in shaping our computing experience. For decades, Microsoft's Windows has dominated the market, offering a familiar and widely adopted platform for personal and professional use. However, as technological advancements continue to push the boundaries of innovation, alternative operating systems have emerged, challenging the status quo and offering users a fresh perspective on computing. One such alternative that has garnered significant attention and acclaim is Nitrux Linux 3.5.0, a sleek, powerful, and user-friendly Linux distribution that promises to redefine the way we interact with our devices. With its focus on performance, security, and customization, Nitrux Linux presents a compelling case for those seeking to break free from the constraints of proprietary software and embrace the freedom and flexibility of open-source computing.

Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf

Malak Abu Hammad

Discover how MongoDB Atlas and vector search technology can revolutionize your application's search capabilities. This comprehensive presentation covers: * What is Vector Search? * Importance and benefits of vector search * Practical use cases across various industries * Step-by-step implementation guide * Live demos with code snippets * Enhancing LLM capabilities with vector search * Best practices and optimization strategies Perfect for developers, AI enthusiasts, and tech leaders. Learn how to leverage MongoDB Atlas to deliver highly relevant, context-aware search results, transforming your data retrieval process. Stay ahead in tech innovation and maximize the potential of your applications. #MongoDB #VectorSearch #AI #SemanticSearch #TechInnovation #DataScience #LLM #MachineLearning #SearchTechnology

Mind map of terminologies used in context of Generative AI

Kumud Singh

Essentials of Automations: The Art of Triggers and Actions in FME

Safe Software

In this second installment of our Essentials of Automations webinar series, we’ll explore the landscape of triggers and actions, guiding you through the nuances of authoring and adapting workspaces for seamless automations. Gain an understanding of the full spectrum of triggers and actions available in FME, empowering you to enhance your workspaces for efficient automation. We’ll kick things off by showcasing the most commonly used event-based triggers, introducing you to various automation workflows like manual triggers, schedules, directory watchers, and more. Plus, see how these elements play out in real scenarios. Whether you’re tweaking your current setup or building from the ground up, this session will arm you with the tools and insights needed to transform your FME usage into a powerhouse of productivity. Join us to discover effective strategies that simplify complex processes, enhancing your productivity and transforming your data management practices with FME. Let’s turn complexity into clarity and make your workspaces work wonders!

GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...

Neo4j

Dr. Sean Tan, Head of Data Science, Changi Airport Group Discover how Changi Airport Group (CAG) leverages graph technologies and generative AI to revolutionize their search capabilities. This session delves into the unique search needs of CAG’s diverse passengers and customers, showcasing how graph data structures enhance the accuracy and relevance of AI-generated search results, mitigating the risk of “hallucinations” and improving the overall customer journey.

Mariano G Tinti - Decoding SpaceX

Mariano Tinti

みなさんこんにちはこれ何文字まで入るの？40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの？えこ...

名前です男

How to Get CNIC Information System with Paksim Ga.pptx

danishmna97

“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...

Edge AI and Vision Alliance

For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2024/06/building-and-scaling-ai-applications-with-the-nx-ai-manager-a-presentation-from-network-optix/ Robin van Emden, Senior Director of Data Science at Network Optix, presents the “Building and Scaling AI Applications with the Nx AI Manager,” tutorial at the May 2024 Embedded Vision Summit. In this presentation, van Emden covers the basics of scaling edge AI solutions using the Nx tool kit. He emphasizes the process of developing AI models and deploying them globally. He also showcases the conversion of AI models and the creation of effective edge AI pipelines, with a focus on pre-processing, model conversion, selecting the appropriate inference engine for the target hardware and post-processing. van Emden shows how Nx can simplify the developer’s life and facilitate a rapid transition from concept to production-ready applications.He provides valuable insights into developing scalable and efficient edge AI solutions, with a strong focus on practical implementation.

Uni Systems Copilot event_05062024_C.Vlachos.pdf

Uni Systems S.M.S.A.

Communications Mining Series - Zero to Hero - Session 1

DianaGray10

This session provides introduction to UiPath Communication Mining, importance and platform overview. You will acquire a good understand of the phases in Communication Mining as we go over the platform with you. Topics covered: • Communication Mining Overview • Why is it important? • How can it help today’s business and the benefits • Phases in Communication Mining • Demo on Platform overview • Q/A

Artificial Intelligence for XMLDevelopment

Octavian Nadolu

In the rapidly evolving landscape of technologies, XML continues to play a vital role in structuring, storing, and transporting data across diverse systems. The recent advancements in artificial intelligence (AI) present new methodologies for enhancing XML development workflows, introducing efficiency, automation, and intelligent capabilities. This presentation will outline the scope and perspective of utilizing AI in XML development. The potential benefits and the possible pitfalls will be highlighted, providing a balanced view of the subject. We will explore the capabilities of AI in understanding XML markup languages and autonomously creating structured XML content. Additionally, we will examine the capacity of AI to enrich plain text with appropriate XML markup. Practical examples and methodological guidelines will be provided to elucidate how AI can be effectively prompted to interpret and generate accurate XML markup. Further emphasis will be placed on the role of AI in developing XSLT, or schemas such as XSD and Schematron. We will address the techniques and strategies adopted to create prompts for generating code, explaining code, or refactoring the code, and the results achieved. The discussion will extend to how AI can be used to transform XML content. In particular, the focus will be on the use of AI XPath extension functions in XSLT, Schematron, Schematron Quick Fixes, or for XML content refactoring. The presentation aims to deliver a comprehensive overview of AI usage in XML development, providing attendees with the necessary knowledge to make informed decisions. Whether you’re at the early stages of adopting AI or considering integrating it in advanced XML development, this presentation will cover all levels of expertise. By highlighting the potential advantages and challenges of integrating AI with XML development tools and languages, the presentation seeks to inspire thoughtful conversation around the future of XML development. We’ll not only delve into the technical aspects of AI-powered XML development but also discuss practical implications and possible future directions.

“I’m still / I’m still / Chaining from the Block”

Claudio Di Ciccio

20240607 QFM018 Elixir Reading List May 2024

Matthew Sinclair

Microsoft - Power Platform_G.Aspiotis.pdf

Uni Systems S.M.S.A.

Programming Foundation Models with DSPy - Meetup Slides

Zilliz

Climate Impact of Software Testing at Nordic Testing Days

Kari Kakkonen

My slides at Nordic Testing Days 6.6.2024 Climate impact / sustainability of software testing discussed on the talk. ICT and testing must carry their part of global responsibility to help with the climat warming. We can minimize the carbon footprint but we can also have a carbon handprint, a positive impact on the climate. Quality characteristics can be added with sustainability, and then measured continuously. Test environments can be used less, and in smaller scale and on demand. Test techniques can be used in optimizing or minimizing number of tests. Test automation can be used to speed up testing.

Recently uploaded (20)

UiPath Test Automation using UiPath Test Suite series, part 6

Serial Arm Control in Real Time Presentation

Removing Uninteresting Bytes in Software Fuzzing

Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...

Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf

Mind map of terminologies used in context of Generative AI

Essentials of Automations: The Art of Triggers and Actions in FME

GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...

Mariano G Tinti - Decoding SpaceX

How to Get CNIC Information System with Paksim Ga.pptx

“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...

Uni Systems Copilot event_05062024_C.Vlachos.pdf

Communications Mining Series - Zero to Hero - Session 1

Artificial Intelligence for XMLDevelopment

“I’m still / I’m still / Chaining from the Block”

20240607 QFM018 Elixir Reading List May 2024

Microsoft - Power Platform_G.Aspiotis.pdf

Programming Foundation Models with DSPy - Meetup Slides

Climate Impact of Software Testing at Nordic Testing Days

Puppet & Jenkins

1. Puppet, Jenkins & CI SNAP Interactive, Inc. Presented by: Matthew Barr Technical Architect Thursday, February 21, 13

2. Company Overview • SNAP Interactive, Inc. • AreYouInterested.com • Believes it is one of the largest social discovery platforms on the web (based on monthly active users) • More than 5 million monthly active users • Over 1 billion total pieces of structured data from its users • Synced to millions of Facebook proﬁles • Receives over 1,000 real-time updates per minute on like actions from Facebook • Subscription-based business model • SNAP is publicly traded - Ticker: STVI www.snap-interactive.com Thursday, February 21, 13

3. About me • Team lead for the operations group • Sysadmin for over 15 years • Dev/ops, WebOps, etc. www.snap-interactive.com Thursday, February 21, 13

4. Continuous Integration • The practice of frequently integrating one's new or changed code with the existing code repository • Maintain a • Make the • Everyone code build self- can see the repository testing results of the latest build • Automate • Keep the the build build fast www.snap-interactive.com Thursday, February 21, 13

5. Puppet • Puppet Labs • https://puppetlabs.com/ • You’re at PuppetNYC :) www.snap-interactive.com Thursday, February 21, 13

6. Jenkins • An extendable open source continuous integration server • http://jenkins-ci.org/ www.snap-interactive.com Thursday, February 21, 13

7. So, let’s do this! • Puppet Dynamic Environments • Install Jenkins (master) • Install Jenkins slaves (swarm clients) • Mergeatron • Puppet Parsing & Linting • Puppet Testing www.snap-interactive.com Thursday, February 21, 13

8. Puppet Dynamic Env’s • google: puppet dynamic environments • Git based • Each branch is it’s own environment • Commit hook / web • https://puppetlabs.com/blog/git-workﬂow- and-puppet-environments/ www.snap-interactive.com Thursday, February 21, 13

9. Jenkins install • puppet module install rtyler-jenkins • Puppet forge module: rtyler/puppet-jenkins • But: this code hasn’t been merged :( • It’s in my github repo: • https://github.com/matthewbarr/puppet- jenkins www.snap-interactive.com Thursday, February 21, 13

10. Jenkins Master include jenkins jenkins::plugin {'swarm':} OR class {'jenkins': lts => 1, # Long term Stable version repo => 0, # Disable Jenkins repo conﬁg } jenkins::plugin {'swarm':} www.snap-interactive.com Thursday, February 21, 13

11. Jenkins Slave: Easy! include jenkins::slave www.snap-interactive.com Thursday, February 21, 13

12. Jenkins Slave: Features! class {'jenkins::slave': masterurl => 'http://jenkins01.ayisnap.com:8080', ui_user => 'UI_USER', ui_pass => 'UI_PASS', # version => '1.8', executors => 4, # manage_slave_user => 1, slave_user => $slave_user, slave_uid => '600', slave_home => $slave_home, } www.snap-interactive.com Thursday, February 21, 13

13. Github • Private repos for organizations • Pull Requests! www.snap-interactive.com Thursday, February 21, 13

14. Demo! www.snap-interactive.com Thursday, February 21, 13

15. PR: Swarm plugin code www.snap-interactive.com Thursday, February 21, 13

16. Mergeatron • Developed in house • Open Source • Nodejs • Not yet in NPM :( • http://snapinteractive.github.com/ mergeatron/ www.snap-interactive.com Thursday, February 21, 13

17. Mergeatron ^2 • Monitors github (or other) for a pull request • Triggers a Jenkins “build” • Build can do anything: unit tests, etc www.snap-interactive.com Thursday, February 21, 13

18. Mergeatron ^3 • We use it to monitor 2 repo’s • Web site code • phpunit • phpcs • jshint • Ops repo (Puppet) - puppet parser www.snap-interactive.com Thursday, February 21, 13

19. Puppet Testing • Puppet Lint • http://puppet-lint.com/ • Rspec-Puppet • http://rspec-puppet.com/ • ERB Parsing:erb -‐P -‐x -‐T '-‐' mytempl.erb | ruby -‐c • Cucumber-puppet • (Discontinued.) www.snap-interactive.com Thursday, February 21, 13

20. Puppet Testing - Future • Parsing is a nice start • Catalog checks can help, especially for supporting systems & edge cases • Actually running it, though, is the only real test that matters. • VM’s, functional / unit tests agains real systems that deliver your app. www.snap-interactive.com Thursday, February 21, 13

21. Updates • Catalog checker w/ other facts- Ohad Levy: • https://github.com/ohadlevy/manitest • Github Pull Request Checker for Jenkins • https://wiki.jenkins-ci.org/display/JENKINS/GitHub+pull+request+builder+plugin www.snap-interactive.com Thursday, February 21, 13

22. Contact Us • SNAP Interactive, Inc. www.snap-interactive.com • Matthew Barr Technical Architect mbarr@snap-interactive.com Twitter & Github: @MatthewBarr www.snap-interactive.com Thursday, February 21, 13

Puppet & Jenkins

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (16)

Similar to Puppet & Jenkins

Similar to Puppet & Jenkins (20)

Recently uploaded

Recently uploaded (20)

Puppet & Jenkins