Developing for multi component environments while keeping your sanity

•

1 like•854 views

Presented at #GeeCON 2013, Krakow Managing a modern multi-component application in a continuous integration/deployment environment can be very tricky. In this session we will concentrate on two of the aspects - environment setup, showcasing tools like Vagrant, Chef and Puppet for creating and controlling development, testing, staging, production and other environments and pushing the deliverables through those environments, using tools like Gradle, Jenkins and Artifactory. Join us and get all the little tips and tricks that will help you rule your development world.

Technology Business Travel

1. Vagrant boots centos
on virtualbox
2. Chef installs all db
and service rpms
from private YUM
repo

1. Vagrant boots centos
on virtualbox
2. Chef installs all db
and service rpms
from private YUM
repo
3. Profit!

The good
1. Easy setup
2. Same setup ( inc. Ci )

The good
1. Easy setup
2. Same setup ( inc. Ci )
3.changes provisioning

The good
1. Easy setup
2. Same setup ( inc. Ci )
3.changes provisioning
4.Kill instead of fix

The Bad
1. Chef solo != chef
server
2. Black box magic for
devs

Developing for multi component environments while keeping your sanity

Managing a modern multi-component application in a continuous integration/deployment environment can be very tricky. In this session we will concentrate on two of the aspects - environment setup, showcasing tools like Vagrant, Chef and Puppet for creating and controlling development, testing, staging, production and other environments and pushing the deliverables through those environments, using tools like Gradle, Jenkins and Artifactory. Join us and get all the little tips and tricks that will help you rule your development world.

SharePoint Disaster Recovery in Microsoft Azure

Davide Benvegnù

WSL2 and Docker Desktop

Stefan Scherer

Docker Desktop is probably the most common way to work with Linux containers on Windows 10. Also, Microsoft continues to improve Windows 10 and offers with the Windows Subsystem for Linux a very good platform to work natively with Linux. Microsoft is currently preparing a new version of WSL 2, which for the first time brings a real Linux kernel. This makes operation of the Docker Engine under WSL possible. Microsoft and Docker are working closely together to optimally enable the running of Linux containers under WSL 2. This talk will show what is going to improve on Docker Desktop on the upcoming Windows 10 version 20H1. The current status can already be tried out with the Windows Insider program and the Technical Preview of Docker Desktop.

Wslconf - Docker Desktop WSL 2 integration

Simon Ferquel

- Docker Desktop leverages WSL 2 to run Linux containers natively on Windows, allowing full Linux kernel functionality and improved I/O performance over WSL 1. - It runs a LinuxKit-based Docker daemon inside a WSL 2 instance and allows building Docker images and running containers across different WSL 2 distributions. - The startup sequence involves creating a container inside WSL 2 to run the LinuxKit Docker daemon distribution, allowing Docker Desktop features to work seamlessly across Windows and Linux.

Zephyr Cloud Workflow and Continuous Integration

Bill Fletcher

OSDC 2019 | Ignite: Microcode updates as protection against Spectre & Co. by ...

NETWAYS

Microcode updates can help protect against Spectre and other CPU vulnerabilities by patching processor firmware at a low level. However, microcode updates require coordination across software, firmware, and hardware and may not fully resolve the security issues without also updating other low-level components like the BIOS, Management Engine, and reference code. Regular updates are still needed to ensure protection.

Introduction to Docker

Jason Shepherd

Docker allows users to run applications in lightweight containers that share resources on a single operating system. Containers provide consistent environments and allow applications to be easily deployed and transferred between environments. Docker improves efficiency by eliminating inconsistencies between environments and addressing performance, cost, deployment and portability issues associated with virtual machines. The document demonstrates how to create and run containers, save changes to container images, access containers via the network, and discusses security considerations for Docker.

Build Trust in Your Build-to-Deployment Flow!

Baruch Sadogursky

Frequently deploying to production puts bigger pressure than before on DevOps to make sure the good, qualified application is provisioned with no mistakes. This session will explore some common pitfalls with traditional Continuous-Integration that increase risk, introduce manual input and human error, and generally make DevOps cringe before hitting the “deploy” button. We will then demonstrate automation techniques that overcome these issues using popular tools, like Maven, Gradle, your CI server, custom scripts and a Binary Repository. Whether you are building software for the cloud or in-house, this presentation will show you how to have completely automated production builds that release applications which are fully traceable, managed and ready to be provisioned with no fear!

The document discusses patterns and antipatterns for continuous software updates. It describes challenges with continuous updates including things that can go wrong with updates and solutions like local rollbacks, over-the-air updates, continuous rather than batch updates, automated deployments, frequent updates, state awareness, progressive delivery, observability, rollbacks, and feature flags. The goal is to transition to extremely tiny and frequent updates, called Liquid Software, to provide an illusion of software flowing continuously from development to the target.

DevOps Patterns & Antipatterns for Continuous Software Updates @ DevOps.com A...

Baruch Sadogursky

So, you want to update the software for your user, be it the nodes in your K8s cluster, a browser on user’s desktop, an app in user’s smartphone or even a user’s car. What can possibly go wrong? In this talk, we’ll analyze real-world software update fails and how multiple DevOps patterns, that fit a variety of scenarios, could have saved the developers. Manually making sure that everything works before sending an update and expecting the user to do acceptance tests before they update is most definitely not on the list of such patterns. Join us for some awesome and scary continuous update horror stories and some obvious (and some not so obvious) proven ideas for improvement and best practices you can start following tomorrow.

DevOps @Scale (Greek Tragedy in 3 Acts) as it was presented at Oracle Code NY...

Baruch Sadogursky

In this talk, we’ll take you to a scaling journey, from 3 developers to a 100. We’ll talk about the challenges each milestone in this growth brings, both technological and methodological, and how to solve those challenges using the right mix of people, the right selection of tools and the correctly crafted process. The speakers excel in the different aspects of this triangle and went through this journey (more than once) themselves. And the fun and entertaining presentation as a Greek tragedy can’t hurt, can it?

Data driven devops as presented at QCon London 2018

Baruch Sadogursky

Devops is usually viewed from a traditional perspective of a collaboration of Dev, Ops, and QA, driven by the change in Culture, People, and Process. But how do you know where you stand and where to move? As in almost any field, data and metrics give you the gauges and instruments. In this talk, we’ll talk about the key measurements for the DevOps transformation process and provide you with 3 metrics you can start measuring tomorrow.

A Research Study Into DevOps Bottlenecks as presented at Oracle Code LA 2018

Baruch Sadogursky

Java Puzzlers NG S03 a DevNexus 2018

Baruch Sadogursky

Where the Helm are your binaries? as presented at Canada Kubernetes Meetups

Baruch Sadogursky

Do you always know what’s going on with your product artifacts since the moment they are built by the CI server from Git sources all the way to being deployed by Helm into Kuberenetes? In this talk, we will show how to build a reliable and transparent pipeline from code to cluster using Git, Artifactory, Docker, Kubernetes, and Helm. We’ll show how you such a pipeline can help you answer the big questions: What to deploy, What is deployed, and what is this artifact that I am looking for. This kind of transparency is critical for today’s environments, and Kubernetes with Helm shouldn’t be an exception.

Data driven devops as presented at Codemash 2018

Baruch Sadogursky

By Baruch Sadogursky Devops is usually viewed from a traditional perspective of a collaboration of Dev, Ops and QA, driven by the change in Culture, People and Process. But how do you know where you stand and were to move? As in almost any field, data and metrics give you the gauges and instruments. In this talk we’ll talk about the key measurements for the DevOps transformation process and provide you with 3 metrics you can start measuring tomorrow.

A Research Study into DevOps Bottlenecks as presented at Codemash 2018

Baruch Sadogursky

Best Practices for Managing Docker Versions as presented at JavaOne 2017

Baruch Sadogursky

By Baruch Sadogursky There are three hard things in computer science: cache invalidation, naming things, and off-by-one errors. This session tackles naming, especially Docker version naming. Labels, tags, checksums...how should you use them to keep track of Docker versions? What about dev versus prod images—how best to distinguish those? What about the “latest” tag? What about cleanup? Could we do more? Versioning often seems like a simple problem, but when you have a tool that gives you as much power and flexibility as Docker does, it often helps to develop guidelines. The presentation examines the tools available for managing Docker images and some simple patterns you can employ in various use cases for CI/CD to keep track of your containers.

Troubleshooting & Debugging Production Microservices in Kubernetes as present...

Baruch Sadogursky

Debugging applications in production is like being the detective in a crime movie. Especially with microservices. Especially with containers. Especially in the cloud. Trying to see what’s going on in a production deployment at scale is impossible without proper tools! Google has spent over a decade deploying containerized Java applications at unprecedented scale and the infrastructure and tools developed by Google have made it uniquely possible to manage, troubleshoot, and debug, at scale. Join this session to see how you can diagnose and troubleshoot production issues w/ out of the box Kubernetes tools, as well as getting insight from the ecosystem with Weave Scope, JFrog Artifactory & Stackdriver tools.

DevOps @Scale (Greek Tragedy in 3 Acts) as it was presented at Devoxx 2017

Baruch Sadogursky

Amazon Alexa Skills vs Google Home Actions, the Big Java VUI Faceoff as prese...

Baruch Sadogursky

DevOps @Scale (Greek Tragedy in 3 Acts) as it was presented at DevOps Days Be...

Baruch Sadogursky

Java Puzzlers NG S02: Down the Rabbit Hole as it was presented at The Pittsbu...

Baruch Sadogursky

Moar puzzlers! The more we work with Java 8, the more we go into the rabbit hole. Did they add all those streams, lambdas, monads, Optionals and CompletableFutures only to confuse us? It surely looks so! And Java 9 that heads our way brings even more of what we like the most, more puzzlers, of course! In this season we as usual have a great batch of the best Java WTF, great jokes to present them and great prizes for the winners!

DevOps @Scale (Greek Tragedy in 3 Acts) as it was presented at The Pittsburgh...

Baruch Sadogursky

Let’s Wing It: A Study in DevRel Strategy

Baruch Sadogursky

Log Driven First Class Customer Support at Scale

Baruch Sadogursky

In this talk, Baruch Sadogursky presents the challenges of a high demand SaaS product incident triage at scale, as well as discuss the sources of log items, including the platform, tenants and other types of log sources. He will show practical examples of collector and filters configuration and will take you through a number of real world examples of problems investigations using Artifactory and Sumo Logic.

[Webinar] The Frog And The Butler: CI Pipelines For Modern DevOps

Baruch Sadogursky

No relationship in DevOps is more important than that between your CI/CD server and your Binary Repository. Jenkins has long been the go-to server for CI/CD, and JFrog Artifactory has long been one of the most popular integrations with it. This webinar focuses on the new features of the integration, leveraging the Jenkins Pipeline DSL for infrastructure-as-code of your favorite artifactory features whether it be generic, maven, gradle or Docker, and will show an end-to-end example of pipelines across multiple technologies and how powerful these new capabilities are.

Patterns and antipatterns in Docker image lifecycle as was presented at DC Do...

Baruch Sadogursky

While Docker has enabled an unprecedented velocity of software production, it is all too easy to spin out of control. A promotion-based model is required to control and track the flow of Docker images as much as it is required for a traditional software development lifecycle. New tools often introduce new paradigms. We will examine the patterns and the antipatterns for Docker image management, and what impact the new tools have on the battle-proven paradigms of the software development lifecycle.

Introduction of Cybersecurity with OSS at Code Europe 2024

Hiroshi SHIBATA

I develop the Ruby programming language, RubyGems, and Bundler, which are package managers for Ruby. Today, I will introduce how to enhance the security of your application using open-source software (OSS) examples from Ruby and RubyGems. The first topic is CVE (Common Vulnerabilities and Exposures). I have published CVEs many times. But what exactly is a CVE? I'll provide a basic understanding of CVEs and explain how to detect and handle vulnerabilities in OSS. Next, let's discuss package managers. Package managers play a critical role in the OSS ecosystem. I'll explain how to manage library dependencies in your application. I'll share insights into how the Ruby and RubyGems core team works to keep our ecosystem safe. By the end of this talk, you'll have a better understanding of how to safeguard your code.

"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk

Fwdays

At this talk we will discuss DDoS protection tools and best practices, discuss network architectures and what AWS has to offer. Also, we will look into one of the largest DDoS attacks on Ukrainian infrastructure that happened in February 2022. We'll see, what techniques helped to keep the web resources available for Ukrainians and how AWS improved DDoS protection for all customers based on Ukraine experience

Recently uploaded

Introduction of Cybersecurity with OSS at Code Europe 2024

Hiroshi SHIBATA

"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk

Fwdays

Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...

saastr

Apps Break Data

Ivo Velitchkov

How information systems are built or acquired puts information, which is what they should be about, in a secondary place. Our language adapted accordingly, and we no longer talk about information systems but applications. Applications evolved in a way to break data into diverse fragments, tightly coupled with applications and expensive to integrate. The result is technical debt, which is re-paid by taking even bigger "loans", resulting in an ever-increasing technical debt. Software engineering and procurement practices work in sync with market forces to maintain this trend. This talk demonstrates how natural this situation is. The question is: can something be done to reverse the trend?

Programming Foundation Models with DSPy - Meetup Slides

Zilliz

Principle of conventional tomography-Bibash Shahi ppt..pptx

BibashShahi

[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...

Jason Yip

The typical problem in product engineering is not bad strategy, so much as “no strategy”. This leads to confusion, lack of motivation, and incoherent action. The next time you look for a strategy and find an empty space, instead of waiting for it to be filled, I will show you how to fill it in yourself. If you’re wrong, it forces a correction. If you’re right, it helps create focus. I’ll share how I’ve approached this in the past, both what works and lessons for what didn’t work so well.

Northern Engraving | Nameplate Manufacturing Process - 2024

Northern Engraving

Manufacturing custom quality metal nameplates and badges involves several standard operations. Processes include sheet prep, lithography, screening, coating, punch press and inspection. All decoration is completed in the flat sheet with adhesive and tooling operations following. The possibilities for creating unique durable nameplates are endless. How will you create your brand identity? We can help!

Energy Efficient Video Encoding for Cloud and Edge Computing Instances

Alpen-Adria-Universität

Generating privacy-protected synthetic data using Secludy and Milvus

Zilliz

During this demo, the founders of Secludy will demonstrate how their system utilizes Milvus to store and manipulate embeddings for generating privacy-protected synthetic data. Their approach not only maintains the confidentiality of the original data but also enhances the utility and scalability of LLMs under privacy constraints. Attendees, including machine learning engineers, data scientists, and data managers, will witness first-hand how Secludy's integration with Milvus empowers organizations to harness the power of LLMs securely and efficiently.

Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...

saastr

Leveraging the Graph for Clinical Trials and Standards

Neo4j

9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...

saastr

GNSS spoofing via SDR (Criptored Talks 2024)

Javier Junquera

In the realm of cybersecurity, offensive security practices act as a critical shield. By simulating real-world attacks in a controlled environment, these techniques expose vulnerabilities before malicious actors can exploit them. This proactive approach allows manufacturers to identify and fix weaknesses, significantly enhancing system security. This presentation delves into the development of a system designed to mimic Galileo's Open Service signal using software-defined radio (SDR) technology. We'll begin with a foundational overview of both Global Navigation Satellite Systems (GNSS) and the intricacies of digital signal processing. The presentation culminates in a live demonstration. We'll showcase the manipulation of Galileo's Open Service pilot signal, simulating an attack on various software and hardware systems. This practical demonstration serves to highlight the potential consequences of unaddressed vulnerabilities, emphasizing the importance of offensive security practices in safeguarding critical infrastructure.

What is an RPA CoE? Session 1 – CoE Vision

DianaGray10

GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph

Neo4j

Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...

Pitangent Analytics & Technology Solutions Pvt. Ltd

Dandelion Hashtable: beyond billion requests per second on a commodity server

Antonios Katsarakis

This slide deck presents DLHT, a concurrent in-memory hashtable. Despite efforts to optimize hashtables, that go as far as sacrificing core functionality, state-of-the-art designs still incur multiple memory accesses per request and block request processing in three cases. First, most hashtables block while waiting for data to be retrieved from memory. Second, open-addressing designs, which represent the current state-of-the-art, either cannot free index slots on deletes or must block all requests to do so. Third, index resizes block every request until all objects are copied to the new index. Defying folklore wisdom, DLHT forgoes open-addressing and adopts a fully-featured and memory-aware closed-addressing design based on bounded cache-line-chaining. This design offers lock-free index operations and deletes that free slots instantly, (2) completes most requests with a single memory access, (3) utilizes software prefetching to hide memory latencies, and (4) employs a novel non-blocking and parallel resizing. In a commodity server and a memory-resident workload, DLHT surpasses 1.6B requests per second and provides 3.5x (12x) the throughput of the state-of-the-art closed-addressing (open-addressing) resizable hashtable on Gets (Deletes).

Mutation Testing for Task-Oriented Chatbots

Pablo Gómez Abajo

Conversational agents, or chatbots, are increasingly used to access all sorts of services using natural language. While open-domain chatbots - like ChatGPT - can converse on any topic, task-oriented chatbots - the focus of this paper - are designed for specific tasks, like booking a flight, obtaining customer support, or setting an appointment. Like any other software, task-oriented chatbots need to be properly tested, usually by defining and executing test scenarios (i.e., sequences of user-chatbot interactions). However, there is currently a lack of methods to quantify the completeness and strength of such test scenarios, which can lead to low-quality tests, and hence to buggy chatbots. To fill this gap, we propose adapting mutation testing (MuT) for task-oriented chatbots. To this end, we introduce a set of mutation operators that emulate faults in chatbot designs, an architecture that enables MuT on chatbots built using heterogeneous technologies, and a practical realisation as an Eclipse plugin. Moreover, we evaluate the applicability, effectiveness and efficiency of our approach on open-source chatbots, with promising results.

JavaLand 2024: Application Development Green Masterplan

Miro Wengner

Recently uploaded (20)

Introduction of Cybersecurity with OSS at Code Europe 2024

"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk

Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...

Apps Break Data

Programming Foundation Models with DSPy - Meetup Slides

Principle of conventional tomography-Bibash Shahi ppt..pptx

[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...

Northern Engraving | Nameplate Manufacturing Process - 2024

Energy Efficient Video Encoding for Cloud and Edge Computing Instances

Generating privacy-protected synthetic data using Secludy and Milvus

Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...

Leveraging the Graph for Clinical Trials and Standards

9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...

GNSS spoofing via SDR (Criptored Talks 2024)

What is an RPA CoE? Session 1 – CoE Vision

GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph

Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...

Dandelion Hashtable: beyond billion requests per second on a commodity server

Mutation Testing for Task-Oriented Chatbots

JavaLand 2024: Application Development Green Masterplan