DevOps @Scale (Greek Tragedy in 3 Acts) as it was presented at QCon NYC 2017

•

0 likes•250 views

As in a good Greek Tragedy, scaling devops to big teams has 3 stages and usually end badly. In this play (it’s more than a talk!) we’ll present you with Pentagon Inc, and their way to scaling devops from a team of 3 engineers to a team of 100 (spoiler – it’s painful!)

Technology

@JBARUCH #QCONNYC HTTP://JFROG.COM/SHOWNOTES

Development
QAOperations
@JBARUCH #QCONNYC HTTP://JFROG.COM/SHOWNOTES

Development
QAOperations
Devops!
@JBARUCH #QCONNYC HTTP://JFROG.COM/SHOWNOTES

Technology
PeopleProcess
@JBARUCH #QCONNYC HTTP://JFROG.COM/SHOWNOTES

Technology
PeopleProcess
Devops!
@JBARUCH #QCONNYC HTTP://JFROG.COM/SHOWNOTES

JIRA GitHub Travis CI
AWS
Beanstalk
@JBARUCH #QCONNYC HTTP://JFROG.COM/SHOWNOTES

JIRA +
Confluence
GitHub Travis CI
JFrog
Artifactory
AWS
Beanstalk
Sumologic Pingdom
@JBARUCH #QCONNYC HTTP://JFROG.COM/SHOWNOTES

JIRA + Confluence GitHub
Configuration
Management
Travis CI
JFrog
Artifactory
AWS
Beanstalk
Sumologic APM

Action
@JBARUCH #QCONNYC HTTP://JFROG.COM/SHOWNOTES

JIRA + Confluence GitHub
Configuration
Management
Travis CI
JFrog
Artifactory +
Mission Control
JFrog Xray Blazemeter
Service
Virtualization
Sumologic APM
@JBARUCH #QCONNYC HTTP://JFROG.COM/SHOWNOTES

Epimyth
@JBARUCH #QCONNYC HTTP://JFROG.COM/SHOWNOTES

Tools
PeopleProcess
@JBARUCH #QCONNYC HTTP://JFROG.COM/SHOWNOTES

Technology
PeopleProcess
Change!
@JBARUCH #QCONNYC HTTP://JFROG.COM/SHOWNOTES

Q&A and Links
• @jbaruch
• http://jfrog.com/shownotEs
• VidEo
• SlidEs
• Links
• FEEdback
• RafflE! (comE Early)

While Docker has enabled an unprecedented velocity of software production, it is all too easy to spin out of control. A promotion-based model is required to control and track the flow of Docker images as much as it is required for a traditional software development lifecycle. New tools often introduce new paradigms. We will examine the patterns and the antipatterns for Docker image management, and what impact the new tools have on the battle-proven paradigms of the software development lifecycle.

Patterns and antipatterns in Docker image lifecycle as was presented at Oracl...

Baruch Sadogursky

Patterns and antipatterns in Docker image lifecycle @ Codemash 2017

Baruch Sadogursky

DevOps @Scale (Greek Tragedy in 3 Acts) as it was presented at Devoxx 2017

Baruch Sadogursky

The Guardian publishes around 350 articles of content a day. Hardly 'big data'. We deal with barely 150 million users a month. Facebook (with it's 600 million users on mobile alone), we ain't. But we do have to serve the news, and we do have to serve it fast, accurately, and on time, across multiple platforms and devices. For a company that's 192 years old, we like to think we're pretty Agile. So what do our development teams care about? What kind of qualities are we optimising for in our software and processes? How do we make sure that when the news is breaking, our software isn't broken? Or if it is, how do we fix it fast?

Rubyslava debugging with_pryolahmichal

Debugging Your Plone Site

cdw9

Patterns and antipatterns in Docker image lifecycle as was presented at Scale...

Baruch Sadogursky

Cucumber integration tests alireza zareiprofsevents

Patterns and antipatterns in Docker image lifecycle as was presented at Globa...

Baruch Sadogursky

Patterns and antipatterns in Docker image lifecycle as was presented at Devop...

Baruch Sadogursky

KubeBoot - Spring Boot deployment on Kubernetes

Alex Soto

Have you ever thought how to deploy Cloud Native Java Applications (Spring Boot) on Kubernetes? Kubernetes has now become a de-facto standard for deploying Cloud Native Applications, but still, there is the myth that they are not ready for Java workloads. The aim of this session is to break that myth to show Kubernetes is well suited for Cloud Native Java applications. The session explores the cloud native characteristics such as Discovery, Blue/Green Deployments, Elasticity, Canary Deployments, Resiliency, Pipeline(CI/CD), Authentication etc., becomes implicit characteristics to your Spring Boot Java applications that are deployed on Kubernetes In this session, we will see how to build, debug, deploy and discover Spring Boot applications on Kubernetes, covering in-depth details of the tools, libraries, and platform that could be used to make your spring boot deployment smooth and easy.

Testing in the 21st Century

Alex Soto

How our security requirements turned us into accidental chaos engineers

Paul Carleton

This talk will cover a security focused project that evolved into a chaos injection system. The system is called “Lifespan Management” and it enforces a lifespan on a cloud hosted VM. After the lifespan expires, the host is terminated, and a replacement is brought up. It has the benefits of making it easier to apply fixes for CVE’s (CVE comes out on day X, we know hosts will age out by day Y), and reducing the value of a compromised machine (“I’ve finally captured a host! It’s being shutdown?? No!”) This seemed simple enough, but the complexity it uncovered made for a fun, year-long adventure in chaos engineering. In this talk, I’ll cover the evolution of the system, and some lessons we learned along the way like: All termination API calls are not created equal Zero failing health checks does not mean a host is healthy Answering “Was this the chaos system?” quickly is essential I’ll also include anecdotes like how it helped with Spectre/Meltdown mitigations, how it mercilessly killed all our kubernetes workers, and how it locked us out of our QA environment.

Erlang - Because s**t Happens by Mahesh Paolini-Subramanya

Hakka Labs

Mahesh talks about the buddha-nature of Erlang/OTP, pointing out how the various features of the language tie together into one seamless Fault Tolerant whole. Mahesh emphasizes that Erlang begins and ends with Fault Tolerance. Fault Tolerance is baked into the very genes of Erlang/OTP - something that ends up being amazingly useful when building any kind of system. Mahesh Paolini-Subramanya is the V.P. of R&D at Ubiquiti Networks - a manufacturer of disruptive technology platforms for emerging markets. He has spent the recent past building out Erlang-based massively concurrent Cloud Services and VoIP platforms. Mahesh was previously the CTO of Vocalocity after its merger with Aptela, where he was a founder and CTO.

JPA 스터디 Week1 - 하이버네이트, 캐시

Covenant Ko

Alexa Skills Kit programing for dummies

Naotaka Jay HOTTA

Qa in production singular 2019

rouanw

team++

Neil Crosby

Building The Blocks of Trust in Automation by Sneha Viswalingam

Sauce Labs

Having followed best practices from previous Selenium Conference talks, the Zoll Lifevest team was able to shift from flaky tests to stable and reliable automated tests. During that time, Sneha Viswalingam learned the importance of building trust in the test suite to unite the team as a whole. Once trust is established in the automated tests, it became crucial to the overall software development lifecycle. In this talk, Sneha covers the following topics: - Strategies that she used to make the tests reliable - Trainings for the manual testers to contribute to the automation efforts - Importance of having an Automation Test Reporting Dashboard - Presenting the project status and test reports on a wallboard to reinforce trust By implementing these steps in her organization, Sneha has built trust not only within the test suite but into the team as a whole.

Hacking on gemsEvgeny Rahman

DevOps @Scale (Greek Tragedy in 3 Acts) as it was presented at Gr8Conf 2017

Baruch Sadogursky

DevOps @Scale (Greek Tragedy in 3 Acts) as it was presented at Oracle Code SF...

Baruch Sadogursky

DevOps @Scale (Greek Tragedy in 3 Acts) as it was presented at Oracle Code Au...

Baruch Sadogursky

Best Practices In Implementing Container Image Promotion Pipelines

All Things Open

Presented by: Baruch Sadogursky, JFrog Presented at All Things Open 2020 Abstract: Surprisingly, implementing a secure, robust and fast promotion pipelines for container images is not as easy as it might sound. Automating dependency resolution (base images), implementing multiple registries for different maturity stages and making sure that we actually run in production containers from the images we intended can be tricky. In this talk, we will compare different approaches, compile a wish-list of features and create a pipeline that checks all the boxes using free and open-source tools.

What's hot

1assignment5b

54188

Breaking News and Breaking Software by Andy Hume

SyncConf

Rubyslava debugging with_pryolahmichal

Debugging Your Plone Site

cdw9

Patterns and antipatterns in Docker image lifecycle as was presented at Scale...

Baruch Sadogursky

Cucumber integration tests alireza zareiprofsevents

Patterns and antipatterns in Docker image lifecycle as was presented at Globa...

Baruch Sadogursky

Patterns and antipatterns in Docker image lifecycle as was presented at Devop...

Baruch Sadogursky

KubeBoot - Spring Boot deployment on Kubernetes

Alex Soto

Testing in the 21st Century

Alex Soto

How our security requirements turned us into accidental chaos engineers

Paul Carleton

Erlang - Because s**t Happens by Mahesh Paolini-Subramanya

Hakka Labs

JPA 스터디 Week1 - 하이버네이트, 캐시

Covenant Ko

Alexa Skills Kit programing for dummies

Naotaka Jay HOTTA

Qa in production singular 2019

rouanw

team++

Neil Crosby

Building The Blocks of Trust in Automation by Sneha Viswalingam

Sauce Labs

Hacking on gemsEvgeny Rahman

What's hot (18)

1assignment5b

Breaking News and Breaking Software by Andy Hume

Rubyslava debugging with_pry

Debugging Your Plone Site

Patterns and antipatterns in Docker image lifecycle as was presented at Scale...

Cucumber integration tests alireza zare

Patterns and antipatterns in Docker image lifecycle as was presented at Globa...

Patterns and antipatterns in Docker image lifecycle as was presented at Devop...

KubeBoot - Spring Boot deployment on Kubernetes

Testing in the 21st Century

How our security requirements turned us into accidental chaos engineers

Erlang - Because s**t Happens by Mahesh Paolini-Subramanya

JPA 스터디 Week1 - 하이버네이트, 캐시

Alexa Skills Kit programing for dummies

Qa in production singular 2019

team++

Building The Blocks of Trust in Automation by Sneha Viswalingam

Hacking on gems

Similar to DevOps @Scale (Greek Tragedy in 3 Acts) as it was presented at QCon NYC 2017

DevOps @Scale (Greek Tragedy in 3 Acts) as it was presented at Gr8Conf 2017

Baruch Sadogursky

DevOps @Scale (Greek Tragedy in 3 Acts) as it was presented at Oracle Code SF...

Baruch Sadogursky

DevOps @Scale (Greek Tragedy in 3 Acts) as it was presented at Oracle Code Au...

Baruch Sadogursky

Best Practices In Implementing Container Image Promotion Pipelines

All Things Open

Patterns and antipatterns in Docker image lifecycle as was presented at DC Do...

Baruch Sadogursky

DevOps @Scale (Greek Tragedy in 3 Acts) as it was presented at DevNexus 2017

Baruch Sadogursky

A Research Study into DevOps Bottlenecks as presented at Codemash 2018

Baruch Sadogursky

Building a private CI/CD pipeline with Java and Docker in the cloud as presen...

Baruch Sadogursky

A private Java (Maven or Gradle) repository as a service can be set up in the cloud. A private Docker registry as a service can be easily set up in the cloud. But what if you want to build a holistic CI/CD pipeline on the cloud of your choice? Baruch Sadogursky walks you through setting up a universal artifact repository, which can serve for both Java and Docker. You’ll learn how to build a CI/CD pipeline with traceable metadata from the Java source files all the way to Docker images. Baruch uses Amazon, Azure, and Google Cloud as examples, although the recipes shown are applicable to other clouds as well.

A Research Study Into DevOps Bottlenecks as presented at Oracle Code LA 2018

Baruch Sadogursky

Data driven devops as presented at QCon London 2018

Baruch Sadogursky

Devops is usually viewed from a traditional perspective of a collaboration of Dev, Ops, and QA, driven by the change in Culture, People, and Process. But how do you know where you stand and where to move? As in almost any field, data and metrics give you the gauges and instruments. In this talk, we’ll talk about the key measurements for the DevOps transformation process and provide you with 3 metrics you can start measuring tomorrow.

Sail In The Cloud

Alex Soto

Microservices architecture has changed how companies develop and deploy applications. This change has affected testing process as well. New techniques have emerged and others have been enhanced. Does your organization wish to achieve unicorn like speed? With N deploys per day? Or a lead time (time to business value from idea to production) measured in days/weeks instead of months/years?In this session, we will not only describe how to use Istio and Kubernetes but actively demonstrate 3 specific techniques that you can use immediately following the session.

A Research Study into DevOps Bottlenecks

Baruch Sadogursky

SEO for Angular - BrightonSEO 2018

Jamie Indigo

A Research Study into DevOps Bottlenecks

Baruch Sadogursky

Let's Get Physical

Joel Lord

Did you know that your web sites can now talk to actual bluetooth devices around it? With new initiatives like the Physical Web and new APIs like Web Bluetooth, it’s now easier than ever to interact with hardware using nothing but Web technologies. In this talk, you will learn how to broadcast URLs to nearby devices and how to control hardware via bluetooth. All of this using plain old vanilla Javascript.

JFrog container registry - DevOps extravaganza

Batel Zohar Tova

Connecting Physical Devices to the Web - Event Driven Architecture using WebS...

Peter Moskovits

Before the Web, clients connected to back-end servers without compromises. As the Web came along with HTTP, we had to give up some of the power of our connectivity. With the evolving open Web communications standards, now we have a unique opportunity to move on from a request-response based REST world to a true, event-driven architecture. Learn what it takes to connect physical devices, such as Arduino and the Rasberry Pi to collect sensor data, or control physical devices over the Web. Commercial aviation's biggest challenge when things go wrong is that flight data is stuck on the plane inside the black box. Until the black box is recovered, we barely know anything about what went wrong. This presentation offers detailed insights into how IoT and modern Web communications concepts have the power to change all this. If you're a maker, you will learn about "flight sensors" attached and controlled by Arduino, data transmitted over long range WiFi as well as satellite networks. If interested in real-time Web communications, you'll learn about a highly secure WebSocket implementation with extreme scale, publishing flight data to tablets and laptops used as monitoring dashboard. If protocol layering, enterprise messaging, or JMS is your thing, this talk is for you. Code samples and plenty of interactive live demos (with Things) add color to the talk.

Contract Testing Php-pact

Daniele D'Angeli

Deploying Next Gen Systems with Zero Downtime

Twilio Inc

Beyond Squishy: The Principles of Adaptive Design

Brad Frost

Responsive web design has hit the scene like a bomb, and now designers everywhere are showing off to their bosses and peers by resizing their browser windows. "Look! The site is squishy!" While creating flexible layouts is important, there's a whole lot more that goes into truly exceptional adaptive web experiences. This session will introduce the Principles of Adaptive Design: ubiquity, flexibility, performance, enhancement and future-friendliness. We need go beyond media queries in order to preserve the web's ubiquity and move it in a future-friendly direction.

Similar to DevOps @Scale (Greek Tragedy in 3 Acts) as it was presented at QCon NYC 2017 (20)