A Build Engineering Team’s Journey of Infrastructure as Code - the challenges that we’ve faced and the practices that we implemented as we went along our journey.
In this technology focussed session from Seb Stormacq, AWS Technical Trainer, we will illustrate how AWS services can change the way in which applications are developed and deployed.
Deploying systems using AWS DevOps tools
You've heard a lot about DevOps, but have you ever wondered which tools to use to deploy your systems? Join Karl Schwirz and Matt Parr from Slalom Consulting as they walk through a code pipeline deployment on AWS. In this MassTLC DevOps session, Matt and Karl will walk through a real-world application deployment using CloudFormation, CodeDeploy, CodePipeline and Chef.
Docker is rapidly gaining mind-share amongst both operations and development teams. One of Docker's sweet spots is in the area of rapid development and testing. This talk will show how we use Docker containers to resolve dependency problems in tests, and how to integrate this workflow into a Bamboo continuous integration and deployment pipeline. This talk is for current Bamboo customers or those familiar with Bamboo who are interested in combining CI with Docker to it's fullest potential.
10+ Deploys Per Day: Dev and Ops Cooperation at FlickrJohn Allspaw
Communications and cooperation between development and operations isn't optional, it's mandatory. Flickr takes the idea of "release early, release often" to an extreme - on a normal day there are 10 full deployments of the site to our servers. This session discusses why this rate of change works so well, and the culture and technology needed to make it possible.
AWS DevOps Event - Innovating with DevOps on AWSIan Massingham
Hear how high growth startups and established organisations are delivering software-based innovation, disrupting markets and delivering feature rich services that their customers love.
Continuous Delivery in the Cloud with Bitbucket PipelinesAtlassian
Meet Bitbucket Pipelines: our CI/CD offering for Bitbucket, and your team's newest member. Thousands of customers have already adopted this easy option for CI/CD in the cloud that makes build failures easier to tackle, and gives team members like designers and sys-admins better visibility into what's going on with the code. Now it's your turn.
We'll show you best practices for using it with git-flow, peer reviews, and configuration as code. With Bitbucket Pipelines handling the heavy lifting associated with builds, tests, and deployments, the rest of your team can focus on creating a great product for your users.
Products covered:
Bitbucket
In this technology focussed session from Seb Stormacq, AWS Technical Trainer, we will illustrate how AWS services can change the way in which applications are developed and deployed.
Deploying systems using AWS DevOps tools
You've heard a lot about DevOps, but have you ever wondered which tools to use to deploy your systems? Join Karl Schwirz and Matt Parr from Slalom Consulting as they walk through a code pipeline deployment on AWS. In this MassTLC DevOps session, Matt and Karl will walk through a real-world application deployment using CloudFormation, CodeDeploy, CodePipeline and Chef.
Docker is rapidly gaining mind-share amongst both operations and development teams. One of Docker's sweet spots is in the area of rapid development and testing. This talk will show how we use Docker containers to resolve dependency problems in tests, and how to integrate this workflow into a Bamboo continuous integration and deployment pipeline. This talk is for current Bamboo customers or those familiar with Bamboo who are interested in combining CI with Docker to it's fullest potential.
10+ Deploys Per Day: Dev and Ops Cooperation at FlickrJohn Allspaw
Communications and cooperation between development and operations isn't optional, it's mandatory. Flickr takes the idea of "release early, release often" to an extreme - on a normal day there are 10 full deployments of the site to our servers. This session discusses why this rate of change works so well, and the culture and technology needed to make it possible.
AWS DevOps Event - Innovating with DevOps on AWSIan Massingham
Hear how high growth startups and established organisations are delivering software-based innovation, disrupting markets and delivering feature rich services that their customers love.
Continuous Delivery in the Cloud with Bitbucket PipelinesAtlassian
Meet Bitbucket Pipelines: our CI/CD offering for Bitbucket, and your team's newest member. Thousands of customers have already adopted this easy option for CI/CD in the cloud that makes build failures easier to tackle, and gives team members like designers and sys-admins better visibility into what's going on with the code. Now it's your turn.
We'll show you best practices for using it with git-flow, peer reviews, and configuration as code. With Bitbucket Pipelines handling the heavy lifting associated with builds, tests, and deployments, the rest of your team can focus on creating a great product for your users.
Products covered:
Bitbucket
Nowadays we all seem to be working with small independent services that need to talk with numerous other services. This is a problem because when developing your service, you need to have a working environment—but bringing up all your dependencies is often not an option.
In this talk, I will take you through our journey of creating a mock server to increase dev speed, and how it allowed us to write better tests.
Atlassian Connect on Serverless Platforms: Low Cost Add-OnsAtlassian
Join Atlassian developer Patrick Streule to learn about a Java- and JavaScript-based framework that makes it easy for developers to create and deploy serverless add-ons, thanks to platforms like AWS Lambdas and DynamoDB. He'll cover the overall architecture of serverless add-ons, then explain how to manage security, deployments, and integrations with various AWS services and other modern serverless providers.
Patrick Streule, Architect, Atlassian
Build a JIRA Server Add-on as a Microservice - You Can Do It!Atlassian
Here's a story that might sound familiar... A couple years ago, you implemented a modest P2 add-on. It did just what you needed. Now, this little add-on isn't so little anymore! You long for a way to make it lean and nimble again. Oh: and your instance is behind a firewall, so you can't use Atlassian Connect. (or can you?...) Join Matej for a walk-through on how to rewrite a "P2-like" add-on as a Dockerized microservice that can communicate with an instance using webhooks and entity properties. He'll discuss the differences between Atlassian Connect and "pure" usage of webhooks, as well as show you what to watch out for.
Matej Konecny, Senior Software Developer, Atlassian
Powershell DSC is the future of configuration management on Windows but it can be very frustrating when it fails, especially in Azure.
In this session we will explore how to deploy configurations to windows servers using Azure Automation and DSC.
We will go over the concepts involved and have a walk through of getting a DSC configuration to apply to a set of virtual machines. We will take a demo configuration with multiple dependencies and deploy that to a Windows Virtual Machine in Azure – we will examine what happens at each step and show you how to troubleshoot it if and when your deployment fails.
Bringing Server Add-ons to the Cloud and Back AgainAtlassian
Ever wanted to be a fly on the wall in someone else's retrospective? Now you can! Join Jon Mort and Adam Markham from Adaptavist as they walk us through recent lessons learned from their team. Hear how ScriptRunner, Adaptavist's popular Automation add-on moved into the cloud. Learn about the parts they loved as well as challenges and frustrations they faced. This honest and open talk will be easy for any add-on developer to relate to.
Jon Mort, Head of Engineering Research and Development, Adaptavist
Adam Markham, Software Developer, Adaptavist
Software Delivery at Warp Speed: Five Essential TechniquesAtlassian
The rise of microservices and containers has dramatically accelerated software delivery. With shorter release times and increased complexity, access to real-time feedback from your build pipeline can be the difference between successful and failed releases. Join Dominick from Splunk for five best practices successful teams adopt to propel software delivery to warp speed while increasing collaboration and breaking down silos. Spoiler alert: this session will include best practices for using analytics to correlate insights into a variety Atlassian tools including JIRA Service Desk, JIRA, HipChat, Bamboo, and more!
Domnick Eger, Global DevOps Practitioner, Splunk
Introduction to Infrastructure as Code & Automation / Introduction to ChefAll Things Open
All Things Open 2014 - Day 2
Thursday, October 23rd, 2014
Nathen Harvey
Co-Host of Food Fight Show & Director of Community and #LEARNCHEF / Chef
DevOps
Introduction to Infrastructure as Code & Automation / Introduction to Chef
How Atlassian's Build Engineering Team Has Scaled to 150k Builds Per Month an...Peter Leschev
Continuous integration is the lifeblood of any software house and extremely important in a fast-growing organisation like Atlassian. You'll hear about how the build engineering team have scaled their team, infrastructure and Bamboo over their four-year journey of continuous improvement to provide a build platform and services used internally within the organization. You'll hear about how the team has grown from three engineers servicing 300 Atlassians to 12 engineers handling over 1300 Atlassians, handling challenges such as balancing firefighting and project work. You'll hear how we've come from infrastructure that was a group of pets, to cattle, then to stateless machines; how we manage our internal Bamboo instances, balancing dogfooding new milestones and providing a critical service to the organization.
Day 3 - DevOps Culture - Continuous Integration & Continuous Deployment on th...Amazon Web Services
Much has been said about DevOps culture, this webinar talks about exactly what it means to exercise a DevOps methodology inside your organisation and takes a more detailed look at Continuous Integration and Continuous Deployment – two of the elements of a successful DevOps framework. With AWS’s API driven infrastructure, running a lean platform becomes possible and the ability to treat ‘Infrastructure as Code’.
Reasons to attend:
- Learn how to set up and experience the benefits of 'Continuous Integration' and 'Continuous Deployment' for your Development Environment.
- Learn about DevOps best practices and the agility that the AWS Cloud can bring your business.
- Learn how business have successfully implemented DevOps methodologies.
Add-ons and integrations for JIRA Cloud have come a long way, but there are still huge opportunities for improvement. JIRA Cloud product manager Dave Meyer will walk through some "Do"s and "Don't"s for making your add-ons simpler, faster, and more beautiful today, plus an insider look at new APIs and integration points that will enable you to take your add-on to the next level in the future.
Dave Meyer, Senior Product Manager, Atlassian
WinOps Conf 2016 - Michael Greene - Release PipelinesWinOps Conf
There are benefits to be gained when patterns and practices from developer techniques are applied to operations. Notably, a fully automated solution where infrastructure is managed as code and all changes are automatically validated before reaching production. This is a process shift that is recognized among industry innovators. For organizations already leveraging these processes, it should be clear how to leverage Microsoft platforms. For organizations that are new to the topic, it should be clear how to bring this process to your environment and what it means to your organizational culture. This presentation explains the components of a Release Pipeline for configuration as code, the value to operations, and solutions that are used when designing a new Release Pipeline architecture.
IT Operations people have several distinct challenges than software developers. Ops teams must balance large workloads and emergency tasks with assuring a stable infrastructure. Their workflow is continuous, and many times doesn't work well with timeboxes. Kanban is widely used to address the needs of IT Operations.
Nowadays we all seem to be working with small independent services that need to talk with numerous other services. This is a problem because when developing your service, you need to have a working environment—but bringing up all your dependencies is often not an option.
In this talk, I will take you through our journey of creating a mock server to increase dev speed, and how it allowed us to write better tests.
Atlassian Connect on Serverless Platforms: Low Cost Add-OnsAtlassian
Join Atlassian developer Patrick Streule to learn about a Java- and JavaScript-based framework that makes it easy for developers to create and deploy serverless add-ons, thanks to platforms like AWS Lambdas and DynamoDB. He'll cover the overall architecture of serverless add-ons, then explain how to manage security, deployments, and integrations with various AWS services and other modern serverless providers.
Patrick Streule, Architect, Atlassian
Build a JIRA Server Add-on as a Microservice - You Can Do It!Atlassian
Here's a story that might sound familiar... A couple years ago, you implemented a modest P2 add-on. It did just what you needed. Now, this little add-on isn't so little anymore! You long for a way to make it lean and nimble again. Oh: and your instance is behind a firewall, so you can't use Atlassian Connect. (or can you?...) Join Matej for a walk-through on how to rewrite a "P2-like" add-on as a Dockerized microservice that can communicate with an instance using webhooks and entity properties. He'll discuss the differences between Atlassian Connect and "pure" usage of webhooks, as well as show you what to watch out for.
Matej Konecny, Senior Software Developer, Atlassian
Powershell DSC is the future of configuration management on Windows but it can be very frustrating when it fails, especially in Azure.
In this session we will explore how to deploy configurations to windows servers using Azure Automation and DSC.
We will go over the concepts involved and have a walk through of getting a DSC configuration to apply to a set of virtual machines. We will take a demo configuration with multiple dependencies and deploy that to a Windows Virtual Machine in Azure – we will examine what happens at each step and show you how to troubleshoot it if and when your deployment fails.
Bringing Server Add-ons to the Cloud and Back AgainAtlassian
Ever wanted to be a fly on the wall in someone else's retrospective? Now you can! Join Jon Mort and Adam Markham from Adaptavist as they walk us through recent lessons learned from their team. Hear how ScriptRunner, Adaptavist's popular Automation add-on moved into the cloud. Learn about the parts they loved as well as challenges and frustrations they faced. This honest and open talk will be easy for any add-on developer to relate to.
Jon Mort, Head of Engineering Research and Development, Adaptavist
Adam Markham, Software Developer, Adaptavist
Software Delivery at Warp Speed: Five Essential TechniquesAtlassian
The rise of microservices and containers has dramatically accelerated software delivery. With shorter release times and increased complexity, access to real-time feedback from your build pipeline can be the difference between successful and failed releases. Join Dominick from Splunk for five best practices successful teams adopt to propel software delivery to warp speed while increasing collaboration and breaking down silos. Spoiler alert: this session will include best practices for using analytics to correlate insights into a variety Atlassian tools including JIRA Service Desk, JIRA, HipChat, Bamboo, and more!
Domnick Eger, Global DevOps Practitioner, Splunk
Introduction to Infrastructure as Code & Automation / Introduction to ChefAll Things Open
All Things Open 2014 - Day 2
Thursday, October 23rd, 2014
Nathen Harvey
Co-Host of Food Fight Show & Director of Community and #LEARNCHEF / Chef
DevOps
Introduction to Infrastructure as Code & Automation / Introduction to Chef
How Atlassian's Build Engineering Team Has Scaled to 150k Builds Per Month an...Peter Leschev
Continuous integration is the lifeblood of any software house and extremely important in a fast-growing organisation like Atlassian. You'll hear about how the build engineering team have scaled their team, infrastructure and Bamboo over their four-year journey of continuous improvement to provide a build platform and services used internally within the organization. You'll hear about how the team has grown from three engineers servicing 300 Atlassians to 12 engineers handling over 1300 Atlassians, handling challenges such as balancing firefighting and project work. You'll hear how we've come from infrastructure that was a group of pets, to cattle, then to stateless machines; how we manage our internal Bamboo instances, balancing dogfooding new milestones and providing a critical service to the organization.
Day 3 - DevOps Culture - Continuous Integration & Continuous Deployment on th...Amazon Web Services
Much has been said about DevOps culture, this webinar talks about exactly what it means to exercise a DevOps methodology inside your organisation and takes a more detailed look at Continuous Integration and Continuous Deployment – two of the elements of a successful DevOps framework. With AWS’s API driven infrastructure, running a lean platform becomes possible and the ability to treat ‘Infrastructure as Code’.
Reasons to attend:
- Learn how to set up and experience the benefits of 'Continuous Integration' and 'Continuous Deployment' for your Development Environment.
- Learn about DevOps best practices and the agility that the AWS Cloud can bring your business.
- Learn how business have successfully implemented DevOps methodologies.
Add-ons and integrations for JIRA Cloud have come a long way, but there are still huge opportunities for improvement. JIRA Cloud product manager Dave Meyer will walk through some "Do"s and "Don't"s for making your add-ons simpler, faster, and more beautiful today, plus an insider look at new APIs and integration points that will enable you to take your add-on to the next level in the future.
Dave Meyer, Senior Product Manager, Atlassian
WinOps Conf 2016 - Michael Greene - Release PipelinesWinOps Conf
There are benefits to be gained when patterns and practices from developer techniques are applied to operations. Notably, a fully automated solution where infrastructure is managed as code and all changes are automatically validated before reaching production. This is a process shift that is recognized among industry innovators. For organizations already leveraging these processes, it should be clear how to leverage Microsoft platforms. For organizations that are new to the topic, it should be clear how to bring this process to your environment and what it means to your organizational culture. This presentation explains the components of a Release Pipeline for configuration as code, the value to operations, and solutions that are used when designing a new Release Pipeline architecture.
IT Operations people have several distinct challenges than software developers. Ops teams must balance large workloads and emergency tasks with assuring a stable infrastructure. Their workflow is continuous, and many times doesn't work well with timeboxes. Kanban is widely used to address the needs of IT Operations.
Puppet Camp Sydney Feb 2014 - A Build Engineering Team’s Journey of Infrastru...Peter Leschev
A Build Engineering Team’s Journey of Infrastructure as Code - the challenges that we’ve faced and the practices that we implemented as we went along our journey.
Infrastructure as Code Maturity Model v1Gary Stafford
Systematically Evolving an Organization’s Infrastructure . The original version of the IaC Maturity Model. See the latest version here: https://www.slideshare.net/garystafford/how-mature-is-your-infrastructure.
Deming to devops - Devops DC June 2015 John Willis
This session will cover the history of Devops. We will look at some of it’s early influences and influencers. Also included will be some best practice case studies and an overview of some of the most widely used tools.
AWS re:Invent 2016: Chalk Talk: Succeeding at Infrastructure-as-Code (GPSCT312)Amazon Web Services
The days of manually managing infrastructure tasks are quickly coming to an end; businesses increasingly need their infrastructure teams to react with the same agility of their development teams. In this session, we discuss various approaches to infrastructure-as-code utilizing AWS solutions across the areas of templated infrastructure provisioning, configuration management, and policy as code. We invite you to bring your questions and join AWS Solutions Architects as we dive deeper into the concepts and best practices behind infrastructure-as-code.
While many organizations have started to automate their software develop processes, many still engineer their infrastructure largely by hand. Treating your infrastructure just like any other piece of code creates a “programmable infrastructure” that allows you to take full advantage of the scalability and reliability of the AWS cloud. This session will walk through practical examples of how AWS customers have merged infrastructure configuration with application code to create application-specific infrastructure and a truly unified development lifecycle. You will learn how AWS customers have leveraged tools like CloudFormation, orchestration engines, and source control systems to enable their applications to take full advantage of the scalability and reliability of the AWS cloud, create self-reliant applications, and easily recover when things go seriously wrong with their infrastructure.
Dockerizing CS50: From Cluster to Cloud to Appliance to Container by David Ma...Docker, Inc.
CS50 is Harvard University's introduction to the intellectual enterprises of computer science and the art of programming for majors and non-majors alike. The course is Harvard's largest, with 800 students in Cambridge, as well as Yale University's largest, with 300 students in New Haven. The course is also edX's largest MOOC, with 700,000 registrants online.
Prior to 2008, the course relied on a load-balanced cluster of Linux machines on campus on which students had shell accounts with which to write and debug code. In 2008, we moved the course into the cloud, replicating that infrastructure with virtual machines (VMs) using Amazon EC2. And in 2009, we moved those VMs back on campus using VMware ESX. Our goals were both technical and pedagogical. As computer scientists, we wanted more control over our course's infrastructure. As teachers, we wanted easier access to our students' work as well as the ability to grow and shrink our infrastructure as problem sets' computational requirements demanded.
In 2011, though, we replaced our centralized infrastructure with the CS50 Appliance, a client-side VM for students' own laptops and desktops. Not only did the appliance enable us to provide students with more familiar graphical interfaces, it also enabled us to provide students with their own local servers. Moreover, the appliance ensured that the course's workload no longer required constant Internet access, particularly of students abroad. And the appliance alleviated load on the course's servers, with execution of students' programs now distributed across students' own CPUs.
In 2015, we began to Dockerize the course, replacing the CS50 Appliance with CS50 IDE, a web-based equivalent based on Cloud9, underneath which is a container for each student. We also began to migrate the course's own web apps to Docker. Among our goals were to ease deployment, isolate services, and equip the course's developers with identical environments.
We present in this talk what we did right, what we did wrong, and how we did both.
Immutable Awesomeness by John Willis and Josh CormanDocker, Inc.
This presentation will show the combination of two ideas that can create 2 to 3 order of magnitude efficiencies in service delivery. We will discuss an example used in an insurance company that has experienced these efficiencies. Josh Corman will present the concept of using Open Source and Toyota Supply Chain principles as a weapon for eliminating operational costs of service delivery. By applying first order principles like fewer suppliers (e.g, less logging frameworks) and image manifests (i.e., bill of materials) he will show how an organization can cut down on bugs and issue resolution times. John Willis will then cover how these principles fit like peanut butter and chocolate when used in an immutable delivery model based on Docker. This presentation was the third highest rated session at the 2015 Devops Enterprise Summit.
Infrastructure as code: running microservices on AWS using Docker, Terraform,...Yevgeniy Brikman
This is a talk about managing your software and infrastructure-as-code that walks through a real-world example of deploying microservices on AWS using Docker, Terraform, and ECS.
How Atlassian's Build Engineering Team Has Scaled to 150k Builds Per Month an...Peter Leschev
Continuous integration is the lifeblood of any software house and extremely important in a fast-growing organisation like Atlassian. You'll hear about how the build engineering team have scaled their team, infrastructure and Bamboo over their four-year journey of continuous improvement to provide a build platform and services used internally within the organization. You'll hear about how the team has grown from three engineers servicing 300 Atlassians to 12 engineers handling over 1300 Atlassians, handling challenges such as balancing firefighting and project work. You'll hear how we've come from infrastructure that was a group of pets, to cattle, then to stateless machines; how we manage our internal Bamboo instances, balancing dogfooding new milestones and providing a critical service to the organization.
Today’s cutting edge companies have software release cycles measured in days instead of months. This agility is enabled by the DevOps practice of continuous delivery, which automates building, testing, and deploying all code changes. This automation helps you catch bugs sooner and accelerates developer productivity. In this session, we’ll share best practices (including ones followed internally at Amazon) and how you can bring them to your company by using open source and AWS services.
Speaker: Raghuraman Balachandran, Solutions Architect, Amazon India
Continuous Integration, Continuous Delivery, workflow automation, more and more tools rely on a vibrant marketplace to share extensions that add new functionality to the systems.
Unfortunately, this means you’re putting trust into a LOT of different people and many of these extensions are built by professionals and enthusiasts in their limited spare time.
GitHub has such a marketplace for Actions and Azure DevOps one for Pipelines. But how do you know whether you can trust these extensions, how do you stay up to date and if you’re building these extensions yourself, how do you keep them secure and your users on the latest version?
Jesse takes us through some of the best practices from the perspective of an extension author, user as well as the administrator of the system that loads these extensions.
Continuous Integration, Continuous Delivery, workflow automation, more and more tools rely on a vibrant marketplace to share extensions that add new functionality to the systems.
Unfortunately, this means you’re putting trust into a LOT of different people and many of these extensions are built by professionals and enthusiasts in their limited spare time.
GitHub has such a marketplace for Actions and Azure DevOps one for Pipelines. But how do you know whether you can trust these extensions, how do you stay up to date and if you’re building these extensions yourself, how do you keep them secure and your users on the latest version?
Jesse takes us through some of the best practices from the perspective of an extension author, user as well as the administrator of the system that loads these extensions.
DCEU 18: Building Your Development PipelineDocker, Inc.
Oliver Pomeroy - Solution Engineer, Docker
Laura Frank Tacho - Director of Engineering, CloudBees
Enterprises often want to provide automation and standardisation on top of their container platform, using a pipeline to build and deploy their containerized applications. However this opens up new challenges… Do I have to build a new CI/CD Stack? Can I build my CI/CD pipeline with Kubernetes orchestration? What should my build agents look like? How do I integrate my pipeline into my enterprise container registry? In this session full of examples and “how-to”s, Olly and Laura will guide you through common situations and decisions related to your pipelines. We’ll cover building minimal images, scanning and signing images, and give examples on how to enforce compliance standards and best practices across your teams.
Docker and Puppet for Continuous IntegrationGiacomo Vacca
Today developers want to change the code, build and deploy often, even several times per day.
New versions of software may need to be tested on different distributions, and with different configurations.
Achieving this with Virtual Machines it’s possible, but it’s very resource and time consuming. Docker provides an incredibly good solution for this, in particular if combined with Continuous Integration tools like Jenkins and Configuration Management tools like Puppet.
This presentation focuses on the opportunities to configure automatically Docker images, use Docker containers as disposable workers during your tests, and even running your Continuous Integration system inside Docker.
(ARC402) Deployment Automation: From Developers' Keyboards to End Users' Scre...Amazon Web Services
Some of the best businesses today are deploying their code dozens of times a day. How? By making heavy use of automation, smart tools, and repeatable patterns to get process out of the way and keep the workflow moving. Come to this session to learn how you can do this too, using services such as AWS OpsWorks, AWS CloudFormation, Amazon Simple Workflow Service, and other tools. We'll discuss a number of different deployment patterns, and what aspects you need to focus on when working toward deployment automation yourself.
Configuring and maintaining a continuous integration environment is quite a bit of work. It requires ongoing resources both in terms of manpower and hardware infrastructure. As an application evolves so does the number of ongoing projects. The challenge is creating a scalable continuous integration environment which does not impede development and can handle the complexities of Java EE testing. This session covers how to setup and configure a cloud-based continuous integration environment for Java EE applications.
The presentation will focus on demonstrating how to use Atlassian Bamboo running on AWS to build and test a Maven/Gradle Java EE project that uses Arquillian for testing. Topics that will be covered include creating a custom AWS VM for use with Bamboo, creating an Amazon VPC (Virtual Private Cloud) along with test database using Amazon RDS. The presentation will delve into the specifics of testing EJBs, WebSocket endpoints, RESTful web services, as well as performing load testing in this environment. Security, cost control, and build monitoring will be covered as well.
https://jeeconf.com/program/containerising-bootiful-microservices/
Presentation on how we implemented Kubernetes and Jenkins to deploy and keep running Spring Cloud Netflix based microservices in private cloud.
Overview of decision made about technology stack, testing strategy, tools and infrastructure components, continuous delivery/deployment pipelines and some implementation details and issues met.
Cloud-Native Builds & Deployments in Bitbucket PipelinesAtlassian
Pipelines is Bitbucket Cloud's new integrated build and release tool, and we're on a mission to give every development team a painless build and release process. Matt Ryall, Pipelines Product Manager, will talk about new features in Pipelines to enable Docker builds and database testing in your builds, and how teams are replacing their legacy build system with Pipelines to save valuable developer time. A must-see talk for teams deploying to the cloud.
Continous Delivering a PHP applicationJavier López
For the last few months we've been implementing a Continuous Delivery pipeline for the redesign of Time Out. In this talk I will demonstrate a real life example of what our pipeline looks like, the different tools we've used to get it done (phing, github, jenkins, ansible, AWS S3, ...), and peculiarities for PHP and Symfony2 projects. Most importantly, I'll be looking at things we've struggled with along the way and the lessons we've learnt.
DevOps on AWS: Deep Dive on Continuous Delivery and the AWS Developer ToolsAmazon Web Services
Today’s cutting-edge companies have software release cycles measured in days instead of months. This agility is enabled by the DevOps practice of continuous delivery, which automates building, testing, and deploying all code changes. This automation helps you catch bugs sooner and accelerates developer productivity. In this session, we’ll share the processes that Amazon’s engineers use to practice DevOps and discuss how you can bring these processes to your company by using a new set of AWS tools (AWS CodeCommit, AWS CodePipeline, and AWS CodeDeploy). These services were inspired by Amazon's own internal developer tools and DevOps culture.
A presentation given at the 2011 Amazon AWS Genomics meeting held in Seattle, WA.
This is a 30 minute talk I gave focusing mainly on practical tools, tips and methods for bootstrapping and orchestration on the cloud.
Covers examples of:
Ubuntu Cloud Init
AWS Cloud Formation
Opscode Chef
MIT StarCluster
Continuous Delivery the hard way with KubernetesLuke Marsden
This talk shows three increasingly advanced levels of continuous delivery with Kubernetes and GitLab (as an example), arguing for a continuous delivery architecture which has an explicit _Release Manager_ component. We then propose Flux, the open source project which powers the _Deploy_ feature of Weave Cloud, as an implementation of that idea. This approach is the precursor to GitOps.
Continuous Delivery the Hard Way with Kubernetes Weaveworks
Continuous Delivery (CD) with Kubernetes
- How to build a CI/CD pipeline when using Kubernetes
- Hands on: Build a CI/CD pipeline with Kubernetes & Weave Cloud
Similar to Puppet Camp Melbourne Nov 2014 - A Build Engineering Team’s Journey of Infrastructure as Code (20)
Elevating Tactical DDD Patterns Through Object CalisthenicsDorra BARTAGUIZ
After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualityInflectra
In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring.
Learn about:
• The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks.
• Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective.
• Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification.
• Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process.
Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Neuro-symbolic is not enough, we need neuro-*semantic*Frank van Harmelen
Neuro-symbolic (NeSy) AI is on the rise. However, simply machine learning on just any symbolic structure is not sufficient to really harvest the gains of NeSy. These will only be gained when the symbolic structures have an actual semantics. I give an operational definition of semantics as “predictable inference”.
All of this illustrated with link prediction over knowledge graphs, but the argument is general.
JMeter webinar - integration with InfluxDB and GrafanaRTTS
Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application.
In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics.
Length: 30 minutes
Session Overview
-------------------------------------------
During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana:
- What out-of-the-box solutions are available for real-time monitoring JMeter tests?
- What are the benefits of integrating InfluxDB and Grafana into the load testing stack?
- Which features are provided by Grafana?
- Demonstration of InfluxDB and Grafana using a practice web application
To view the webinar recording, go to:
https://www.rttsweb.com/jmeter-integration-webinar
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place.
Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects.
Here’s what you’ll gain:
- Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows.
- Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy.
- Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency.
- Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity.
We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic.
Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.
Generating a custom Ruby SDK for your web service or Rails API using Smithyg2nightmarescribd
Have you ever wanted a Ruby client API to communicate with your web service? Smithy is a protocol-agnostic language for defining services and SDKs. Smithy Ruby is an implementation of Smithy that generates a Ruby SDK using a Smithy model. In this talk, we will explore Smithy and Smithy Ruby to learn how to generate custom feature-rich SDKs that can communicate with any web service, such as a Rails JSON API.
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
4. Build Engineering today @
Atlassian
• Build platform & services used internally within the company
• 90k builds per month
• 43k automated tests just for JIRA
• Developers expect a reliable infrastructure & fast CI feedback
15. Puppet Lint https://github.com/rodjek/puppet-lint
Tim Sharpe
@rodjek
• Automated style checking
• Setup automated build that runs checks & posts results
• Setup ratchet build to detect regressions
16. Confidence of Change
HIGH
NONE
initial + Code review
Lifecycle of an infra change
confidence
Dev Code review Rollout Soak in Prod
17. Using Staging for Development
• Coding on Puppet Master
• Culture of manually modifying
production - Configuration Drift
• Impact on Builds
puppetmaster
build agents
staging puppet environment
18. Vagrant http://www.vagrantup.com/
Mitchell Hashimoto
@mitchellh
• Easily spin up Infrastructure locally on your laptop
• Reproducible / disposable environments
• Machine provisioning via Virtual Box / VMWare / AWS
• Configuration applied via Shell Scripts / Puppet / Chef
• Develop and test infrastructure changes locally
20. Vagrant
Spins up a local VM to a known state
Make some puppet changes and then run:
Destroy the VM when done
to apply your changes
SSH into your VM using:
to check your changes
http://www.vagrantup.com/
Mitchell Hashimoto
@mitchellh
21. Confidence of Change
HIGH
NONE
initial + Code review + Vagrant
Lifecycle of an infra change
confidence
Dev Code review Rollout Soak in Prod
22. Vagrant != Production
• Vagrant basebox differences with production machines
• Originally using publicly available vagrant baseboxes
• Installed packages biggest differences
• Generating a basebox manually was a painful process
24. Basebox generation via CI
• Latest basebox generated in CI & published to fileshare
• No need to generate baseboxes locally
25. Confidence in Change
HIGH
NONE
initial + Code review + Vagrant + Packer
Lifecycle of an infra change
confidence
Dev Code review Rollout Soak in Prod
28. Cucumber & Vagrant
Vagrant
Custom Provisioner
Virtual Box
VM
puppet apply
cucumber *.features
via ssh
29. Disadvantages
• Requires cucumber dependencies to be installed on
tested VM
• Tests run within the VM making testing firewall rules
harder
30. Confidence in Change
HIGH
NONE
initial + Code review + Vagrant + Packer + Cukes
Lifecycle of an infra change
confidence
Dev Code review Rollout Soak in Prod
31. But it works on my machine!
“ – Every Developer”
32. Continuous Integration
• ‘From scratch’ provisioning
• Confidence that you can rebuild in disaster
33. The Pets: you give nice names,
you stroke them, and when they get ill,
you nurse them back to health,
taking a long time over it
The Cattle: you give them numbers. When
they get ill, you shoot them
– Tim Bell, CERN ”
“
34. Confidence in Change
HIGH
NONE
initial + Code review + Vagrant + Packer + Cukes + CI
Lifecycle of an infra change
confidence
Dev Code review CI & Rollout Soak in Prod
36. Spread out CI
provision VM #1
Moved from sequential
to parallel provisioning
provision VM #2
provision VM #3
provision VM #4
provision VM #1
provision VM #2 provision VM #3
provision VM #4
41. Delta Provisioning
• Provision locally & for CI
• Faster & different class of problems found
• Matches production state
‘from scratch’ provision delta provision
provision VM
export VM fileshare
import VM box
provision VM
on success
42. Confidence in Change
HIGH
NONE
initial + Code review + Vagrant + Packer + Cukes + CI
+ Delta CI
Lifecycle of an infra change
confidence
Dev Code review CI & Rollout Soak in Prod
45. Confidence in Change
HIGH
NONE
initial + Code review + Vagrant + Packer + Cukes
+ CI + Delta CI + Branch CI
Lifecycle of an infra change
confidence
Dev Branch CI Code review CI & Rollout Soak in Prod
49. Catalog Diff
Step 1: Generate a hash of a node’s catalog
puppet master --logdest console --compile HOSTNAME
HOSTNAME.json
- Sort elements
- Remove timestamps
- Generate shasum
f50db91e6461f5bdcb56769a8f77da1fac26943d
50. Catalog Diff
Step 2: Compare the hash of master versus your branch
to avoid unnecessary provisioning
Example 1:
master branch
f50db91e6461f5bdcb56769a8f77da1fac26943d = f50db91e6461f5bdcb56769a8f77da1fac26943d
Hash is the same, no build required
Example 2:
master branch
f50db91e6461f5bdcb56769a8f77da1fac26943d != 18033e4d21b78bab6deb3ae1ff3c147ade5a37ca
Hash is different, build required
51. Catalog Diff
Step 3: Profit!
Reduction in
feedback time
+
$$$ saved
Images: http://pixabay.com/p-30984/ https://www.flickr.com/photos/williamnyk/3598113750/
54. Painful Puppet Rollouts
• Puppet runs impacted running builds
• Disabling all the build agents
• Performing the roll out
• git clone / librarian-puppet / symlink update on puppetmaster
• Manually kick off puppet on all the build agents
• Enabling all the build agents
• Set of Puppet environments for every bamboo server
55. Graceful Service restarts
+
Bamboo Agent JVM process watches
for touch file & shutdowns when Idle
(written as a Bamboo Plugin)
56. Puppet Environments
• BEFORE - Multiple puppet envs for each Bamboo Server
• jbac_staging
• jbac_production
• cbac_staging
• cbac_production
• etc
• AFTER - Changed to use ‘staging’ & ‘production’ only
57. Updates on Puppetmaster
• BEFORE: Manually on puppetmaster
• git clone the puppet tree
• run librarian-puppet to pull external modules
• Update staging / production symlink
• AFTER: Bamboo build which performs the above steps
automatically
61. Confidence in Change
HIGH
NONE
initial + Code review + Vagrant + Packer
+ Cukes + CI + Delta CI + Branch CI
+ Frequent Releases
Lifecycle of an infra change
confidence
Dev Branch CI Code review CI & Rollout Soak in Prod
62. I’m scared!
“– Peter Leschev, 3.5” years ago
Should I be scared?
“ – Peter Leschev, 3 months a”go
64. Confidence in Change
HIGH
NONE
initial + Code review + Vagrant + Packer
+ Cukes + CI + Delta CI + Branch CI
+ Frequent Releases + Notification
Lifecycle of an infra change
confidence
Dev Branch CI Code review CI & Rollout Soak in Prod
65. Confidence in Change
HIGH
NONE
before after
Lifecycle of an infra change
confidence
Dev Branch CI Code review CI & Rollout Soak in Prod
70. Puppet Module for
Sonatype Nexus
• https://forge.puppetlabs.com/atlassian/nexus_rest
• Configure Nexus using Custom Puppet Provider Types
rather than XML files
