This ignite talk was delivered at DevOpsDays Amsterdam 2015. The talk goes in short over immutable infrastructure - why it is beneficial in the modern software development and how to start using it.
The document provides an overview of the author's background and work experience. It discusses his roles as a lecturer, system engineer, and independent consultant focused on web development. It also outlines some of the technical services and tools he provides, including hosting servers, domain management, and security scanning for WordPress, Drupal, Joomla, and Moodle sites. The document shares approaches for optimizing website performance and scaling architectures from traditional LAMP stacks to LEMP, load balancing, and cloud-based infrastructure.
High Availability from the DevOps side - OpenStack Summit PortlandeNovance
This document summarizes Emilien Macchi and Sébastien Han's work on improving high availability in OpenStack. It discusses their contributions of Pacemaker resource agents and documentation updates. It also describes their experiences implementing OpenStack in a medium public cloud, noting challenges of scalability and split brains risks. Lastly, it outlines work to improve networking high availability and testing the cell architecture for horizontal scaling.
Openstack Summit HK - Ceph defacto - eNovanceeNovance
Sébastien Han presented on Ceph and its integration with OpenStack. Ceph is an open source distributed storage system that is well-suited for OpenStack deployments due to its self-managing capabilities and ability to scale storage resources easily. The integration between Ceph and OpenStack has improved significantly in recent OpenStack releases like Havana, with features like Cinder backup to Ceph and the ability to boot Nova instances using RBD images. Further integration work is planned for upcoming releases to fully leverage Ceph's capabilities.
This document discusses challenges faced by a system engineering team supporting multiple DevOps teams and projects on AWS. Manual creation and management of AWS CloudFormation stacks became inefficient. The author developed a Ruby gem called "clouds" that allows managing CloudFormation stacks from the command line similar to git, with stacks stored in source control. This allows mass stack updates in minutes rather than days, easy cloning of stacks, and self-service environment creation for developers. A demo is provided and the benefits of standardization and automation through clouds are discussed.
Bootstrapping a virtual infrastructure using OpenNebula from scratchinovex GmbH
This talk shows how to setup a virtual infrastructure using OpenNebula as cloud management platform, SaltStack for configuration management and Foreman for bare-metal/ virtual host provisioning. You will see how to combine OpenNebula with bare-metal deployment on standard server hardware using non-shared storage in an environment without physical access to the hardware and no existing base infrastructure like DNS, NTP, DHCP, VPN or other. The infrastructure installation has been done automatically using public code and free Open Source software.
Arnold Bechtoldt, inovex GmbH, Dezember 2014
Re-Think of Virtualization and ContainerizationXu Wang
The Hyper view on Container and Virtual Machine --- the similar parts and the different parts. The sildes was presented in Open Source Operating System Annual Technical Conference 2015 at Tsinghua University, Beijing on Nov 28th.
Local testing of Containerized Distributed SystemsJustin Carter
Delmo is a tool for testing containerized distributed systems locally. It allows users to define a system using Docker Compose, write test cases, and run tasks against the running system to assert expected behavior under different conditions like failures. Delmo aims to help users test smaller parts of their systems independently without needing to run the entire cloud stack locally, improving the development workflow.
The document provides an overview of the author's background and work experience. It discusses his roles as a lecturer, system engineer, and independent consultant focused on web development. It also outlines some of the technical services and tools he provides, including hosting servers, domain management, and security scanning for WordPress, Drupal, Joomla, and Moodle sites. The document shares approaches for optimizing website performance and scaling architectures from traditional LAMP stacks to LEMP, load balancing, and cloud-based infrastructure.
High Availability from the DevOps side - OpenStack Summit PortlandeNovance
This document summarizes Emilien Macchi and Sébastien Han's work on improving high availability in OpenStack. It discusses their contributions of Pacemaker resource agents and documentation updates. It also describes their experiences implementing OpenStack in a medium public cloud, noting challenges of scalability and split brains risks. Lastly, it outlines work to improve networking high availability and testing the cell architecture for horizontal scaling.
Openstack Summit HK - Ceph defacto - eNovanceeNovance
Sébastien Han presented on Ceph and its integration with OpenStack. Ceph is an open source distributed storage system that is well-suited for OpenStack deployments due to its self-managing capabilities and ability to scale storage resources easily. The integration between Ceph and OpenStack has improved significantly in recent OpenStack releases like Havana, with features like Cinder backup to Ceph and the ability to boot Nova instances using RBD images. Further integration work is planned for upcoming releases to fully leverage Ceph's capabilities.
This document discusses challenges faced by a system engineering team supporting multiple DevOps teams and projects on AWS. Manual creation and management of AWS CloudFormation stacks became inefficient. The author developed a Ruby gem called "clouds" that allows managing CloudFormation stacks from the command line similar to git, with stacks stored in source control. This allows mass stack updates in minutes rather than days, easy cloning of stacks, and self-service environment creation for developers. A demo is provided and the benefits of standardization and automation through clouds are discussed.
Bootstrapping a virtual infrastructure using OpenNebula from scratchinovex GmbH
This talk shows how to setup a virtual infrastructure using OpenNebula as cloud management platform, SaltStack for configuration management and Foreman for bare-metal/ virtual host provisioning. You will see how to combine OpenNebula with bare-metal deployment on standard server hardware using non-shared storage in an environment without physical access to the hardware and no existing base infrastructure like DNS, NTP, DHCP, VPN or other. The infrastructure installation has been done automatically using public code and free Open Source software.
Arnold Bechtoldt, inovex GmbH, Dezember 2014
Re-Think of Virtualization and ContainerizationXu Wang
The Hyper view on Container and Virtual Machine --- the similar parts and the different parts. The sildes was presented in Open Source Operating System Annual Technical Conference 2015 at Tsinghua University, Beijing on Nov 28th.
Local testing of Containerized Distributed SystemsJustin Carter
Delmo is a tool for testing containerized distributed systems locally. It allows users to define a system using Docker Compose, write test cases, and run tasks against the running system to assert expected behavior under different conditions like failures. Delmo aims to help users test smaller parts of their systems independently without needing to run the entire cloud stack locally, improving the development workflow.
Removing Environmental Differences - Simon PearsonOutlyer
Is Docker the answer to the Stack x Platform x Cloud explosion thats engulfed the Enterprise?
Is IaaS really the right model? or just the one that worked?
Has PaaS’s time finally arrived.
Can Docker make OS, library, stack choices irrelevant to hosting and Ops?
This talk looks at how Pearson is investigating and moving towards Docker, what we’ve learned so far, and what you can learn from our experiences.
1. The document discusses different approaches to parallelizing 10 million stochastic simulations across 10 scenarios, including distributing simulations across instances, using Redis, and using Dask.
2. Dask was ultimately found to be the fastest and easiest approach, allowing simulations to be run in Python using Kubernetes for elastic scaling.
3. However, the document notes that modeling the simulations directly in R may have been preferable to recreating the model in Python.
In this talk we look at the challenges of taking docker and using it as the basis for a cloud platform. We highlight the work done by one of our own Cloudsoft engineers Andrea Turli who has contributed an Apache jclouds provider for Docker and integrated this with the open source project Brooklyn.
Andrea has written about this in a recent blog post AMP for Docker and so using this as a starting point we show how we are building on this to create a lightweight dynamic Docker cloud and compare and contrast this with work we are doing with our latest partner Waratek to help them create a similar lightweight dynamic Java cloud using their Java application container technology.
Scalability is one key feature that drives OpenStack adoption around the globe. With the dispatch of OpenStack's 14th release dubbed Newton, OpenStack makers affirm that it now incorporates enhanced scaling abilities. The Operations team at the OpenStack Innovation Center decided to demonstrate that OpenStack is effortlessly scalable to 500 nodes in a single region. To complete this task, we decided to work on a tool that allows them to target a set number of servers and "partition" them; if you have 10 physical servers, split those into 100 virtual servers, and use them as compute nodes within an OpenStack deployment. In this session we will examine the simulator tool, deep dive into its internals, and run through a demo. You will learn how you might utilize it to test the scaling of various OpenStack services and decrease the cost of creating labs and staging environments within your company.
Let's build a PaaS platform, how hard could it be?DreamLab
Presentation given by Błażej Kasperczyk at Pykonik meetup in Kraków.
How many applications, and where do we put them? Why is our system so bad at keeping up with what the users want? What to do in case of a noisy neighbour?
When you're aiming to provide a platform where the developers could easily launch an application without worrying about configuring the system, you will have to code it sooner or later. As with most very simple concepts, it presents a plethora of challenges to deal with.
This document discusses VPC networking on AWS. It summarizes some key advantages of VPC like network ACLs allowing true edge blocking and security groups that can change after instance launch. It also discusses some challenges faced with VPC like figuring out networking configurations and properly sizing NAT instances. The document provides guidance on using VPC features like connecting VPCs to on-premise networks with VPN and limitations around VPC components.
OpenNebula Conf 2014 | OpenNebula as alternative to commercial virtualization...NETWAYS
It wasn’t more then 4 months between the first getting in touch with Opennebula and our productive Opennebula cluster beeing fired up. It was a quick decision that turned our to be the absolute right one. Since a little more than a year we are on our evolving way with Opennebula.
So what have we been looking for and why did we end up with Opennebula? How does our setup look like in the moment and what are our future plans with Opennebula? Learnings from a year with Opennebula.
Ceph Performance and Optimization - Ceph Day Frankfurt Ceph Community
This document summarizes a presentation about Ceph performance given at CephDays Frankfurt 2014. It discusses the good aspects of Ceph's performance including its deterministic object placement strategy and ability to aggregate IOs at the cluster and OSD levels. It also examines the bad, including issues caused by journaling, having the journal and OSD data on the same disk, filesystem fragmentation over time, lack of parallelized reads, and the impact of scrubbing. The ugly is described as multiple objects mapping to the same physical disks, causing sequential streams to get mixed and the disks to seek frequently. The document concludes with suggestions on how to properly build a Ceph cluster and considerations like hardware, data growth planning, and failure tolerance.
For all the network engineers seeking to understand PaaS components and vendor landscape. Apcera VMware OpenStack Google Docker, Inc CoreOS HashiCorp Mesosphere, Inc. Amazon Web Services
AWS Summit Melbourne 2014 | The Path to Business Agility for Vodafone: How Am...DiUS
As part of Vodafone Hutchison Australia (VHA)’s company-wide mission to win back customers, the VHA Digital Products division, with the help of DiUS, built a strategic internal agile development and innovation capability. By leveraging AWS, VHA now has the powerful ability to be more responsive, to experiment, fail-fast and in turn, to deliver an improved customer experience across all digital touchpoints.
We will share VHA’s journey so far by looking at the business objectives and diving into how people, process and technology made it happen:
Making a business case for AWS
Working within a complex technology landscape including legacy systems, COTS products as well as custom-built systems
The role AWS played in achieving change
Enabling daily deployments using Continuous Delivery and other practices and tools
What's next on VHA's agility roadmap
Presenters: Andy McCarthy, Digital Technology Manager, Vodafone Hutchison Australia, & Elliot Murry, Senior Consultant, DiUS
Cloud-Native DevOps: Simplifying application lifecycle management with AWS | ...Amazon Web Services
Organizations are migrating to the cloud in order to increase their agility and eliminate undifferentiated heavy lifting. At the same time, they’re embracing DevOps principles in order to deliver functionality faster and improve operational performance. Taken together, it’s possible to deliver agile, reliable applications with less overhead than ever before. However, it’s not always optimal to emulate traditional approaches to DevOps and configuration management in the cloud. No matter where you are in your DevOps journey, join us in this session to learn how to use AWS application lifecycle management services to focus on your mission, not your tooling.
Norway VMUG Tour - The Architecture Behind Policy-Driven Data Protection - A ...Chris Wahl
The document provides an overview of Rubrik's distributed architecture for policy-driven data protection. It discusses Rubrik's cloud data management platform and how it uses a distributed file system and task scheduler to provide scalable, self-healing backups across on-premises and cloud environments. Key policies are applied using an SLA engine to provide automated data protection based on recovery time, retention period, and other factors.
This document outlines an agenda for a talk on automating infrastructure and security scans using Cloudflare and other tools. It discusses:
1. The goals of automation like reducing administration tasks, improving inventory and scaling/deployment.
2. A overview of configuration management tools like Chef, Puppet, SaltStack and Ansible comparing their architectures, licensing, and support for containers and clouds.
3. Security principles for content delivery networks like Cloudflare focusing on hiding real server IPs.
4. The planned rollout of the Cloudflare recon tool including preparations, building virtual infrastructure, software requirements, and performing/collecting scan results.
Scylla Summit 2018: Meshify - A Case Study, or Petshop SeamonstersScyllaDB
Meshify is the IOT platform focused on wireless sensor technology for industrial/insurance IOT. This talk will provide an overview of how Meshify is using Scylla. It will also explain why, when everything else in Meshify’s platform is moving to a managed cloud service or a container based microservice, why and how the Scylla nodes are the only pet “seamonsters” in Meshify’s platform.
Machine Learning operations brings data science to the world of devops. Data scientists create models on their workstations. MLOps adds automation, validation and monitoring to any environment including machine learning on kubernetes. In this session you hear about latest developments and see it in action.
This document discusses a distributed development project called Project FreeSpace. It aims to speed up development tasks like compilation, testing, and deployment by distributing the work across multiple machines. Key benefits include getting feedback faster through continuous and parallel processing, without slowing down individual developers' machines. The system would use a plugin architecture with self-updating nodes that coordinate tasks over a private cloud infrastructure.
Microservices with Terraform, Docker and the Cloud. JavaOne 2017 2017-10-02Derek Ashmore
This document summarizes a presentation on managing microservices using Terraform, Docker, and cloud infrastructure. The presentation covered microservices and containerization with Docker, deploying microservices to the cloud with AWS using infrastructure as code with Terraform. It also compared Terraform to other configuration management tools and outlined an accompanying hands-on lab for attendees to deploy a sample Java microservice to AWS using Terraform.
RightScale Webinar: So you want to move to the cloud... but you’re not sure what that means, or where you would even start. Or you want to get your feet wet with a proof-of-concept project before you bring out the big guns. We asked Brian Adler, our Professional Services Architect who works directly with customers on cloud projects every single day, to select five cloud projects that you can get started with (and complete!) quickly. In this webinar, Brian and Rafael Saavedra, our VP of Engineering, will walk you through those five projects and will help you demonstrate success in the cloud now.
JavaOne: Efficiently building and deploying microservicesBart Blommaerts
Since Martin Fowler’s article on microservices in the beginning of 2014, there has been a lot of controversy about the topic. Although most articles talk about microservices from an architectural perspective, this session intends to go further and also provide examples of and best practices for building and deploying polyglot applications in an enterprise Java environment. In the session, the build process focuses on efficiency and shows that microservices don’t necessarily cause overhead for a project. Microservices don't imply copying and pasting the same boilerplate code over and over. The deployment process in the presentation is, of course, automated but also demonstrates best practices for integration testing between different active services.
AWS Summit Sydney 2014 | The Path to Business Agility for Vodafone: How Amazo...Amazon Web Services
This document discusses how Amazon achieved business agility through continuous delivery practices like frequent releases, automated testing, immutable infrastructure, and treating infrastructure as code. It emphasizes reducing waste and failure through resiliency, visibility, and immunity enabled by cloud services. Continuous delivery is achieved through automation at all stages from building to deploying to monitoring. The future directions discussed are taking these practices further with microservices, Docker/LXC containers, and generating new projects and deploying them with a single click.
How Percolate uses CFEngine to Manage AWS Stateless InfrastructurePercolate
The document discusses how Percolate uses CFEngine to manage their infrastructure on AWS in a stateless way. Some key points:
1) CFEngine allows Percolate to define infrastructure policies that automatically enforce the desired configuration on servers, providing a documented and scalable approach.
2) By managing all infrastructure as code in Git, and avoiding server state, Percolate's infrastructure is resilient and can be migrated or changed easily.
3) This stateless approach means Percolate avoids backup overhead and can freely launch/replace instances, reducing costs through use of spot instances.
Removing Environmental Differences - Simon PearsonOutlyer
Is Docker the answer to the Stack x Platform x Cloud explosion thats engulfed the Enterprise?
Is IaaS really the right model? or just the one that worked?
Has PaaS’s time finally arrived.
Can Docker make OS, library, stack choices irrelevant to hosting and Ops?
This talk looks at how Pearson is investigating and moving towards Docker, what we’ve learned so far, and what you can learn from our experiences.
1. The document discusses different approaches to parallelizing 10 million stochastic simulations across 10 scenarios, including distributing simulations across instances, using Redis, and using Dask.
2. Dask was ultimately found to be the fastest and easiest approach, allowing simulations to be run in Python using Kubernetes for elastic scaling.
3. However, the document notes that modeling the simulations directly in R may have been preferable to recreating the model in Python.
In this talk we look at the challenges of taking docker and using it as the basis for a cloud platform. We highlight the work done by one of our own Cloudsoft engineers Andrea Turli who has contributed an Apache jclouds provider for Docker and integrated this with the open source project Brooklyn.
Andrea has written about this in a recent blog post AMP for Docker and so using this as a starting point we show how we are building on this to create a lightweight dynamic Docker cloud and compare and contrast this with work we are doing with our latest partner Waratek to help them create a similar lightweight dynamic Java cloud using their Java application container technology.
Scalability is one key feature that drives OpenStack adoption around the globe. With the dispatch of OpenStack's 14th release dubbed Newton, OpenStack makers affirm that it now incorporates enhanced scaling abilities. The Operations team at the OpenStack Innovation Center decided to demonstrate that OpenStack is effortlessly scalable to 500 nodes in a single region. To complete this task, we decided to work on a tool that allows them to target a set number of servers and "partition" them; if you have 10 physical servers, split those into 100 virtual servers, and use them as compute nodes within an OpenStack deployment. In this session we will examine the simulator tool, deep dive into its internals, and run through a demo. You will learn how you might utilize it to test the scaling of various OpenStack services and decrease the cost of creating labs and staging environments within your company.
Let's build a PaaS platform, how hard could it be?DreamLab
Presentation given by Błażej Kasperczyk at Pykonik meetup in Kraków.
How many applications, and where do we put them? Why is our system so bad at keeping up with what the users want? What to do in case of a noisy neighbour?
When you're aiming to provide a platform where the developers could easily launch an application without worrying about configuring the system, you will have to code it sooner or later. As with most very simple concepts, it presents a plethora of challenges to deal with.
This document discusses VPC networking on AWS. It summarizes some key advantages of VPC like network ACLs allowing true edge blocking and security groups that can change after instance launch. It also discusses some challenges faced with VPC like figuring out networking configurations and properly sizing NAT instances. The document provides guidance on using VPC features like connecting VPCs to on-premise networks with VPN and limitations around VPC components.
OpenNebula Conf 2014 | OpenNebula as alternative to commercial virtualization...NETWAYS
It wasn’t more then 4 months between the first getting in touch with Opennebula and our productive Opennebula cluster beeing fired up. It was a quick decision that turned our to be the absolute right one. Since a little more than a year we are on our evolving way with Opennebula.
So what have we been looking for and why did we end up with Opennebula? How does our setup look like in the moment and what are our future plans with Opennebula? Learnings from a year with Opennebula.
Ceph Performance and Optimization - Ceph Day Frankfurt Ceph Community
This document summarizes a presentation about Ceph performance given at CephDays Frankfurt 2014. It discusses the good aspects of Ceph's performance including its deterministic object placement strategy and ability to aggregate IOs at the cluster and OSD levels. It also examines the bad, including issues caused by journaling, having the journal and OSD data on the same disk, filesystem fragmentation over time, lack of parallelized reads, and the impact of scrubbing. The ugly is described as multiple objects mapping to the same physical disks, causing sequential streams to get mixed and the disks to seek frequently. The document concludes with suggestions on how to properly build a Ceph cluster and considerations like hardware, data growth planning, and failure tolerance.
For all the network engineers seeking to understand PaaS components and vendor landscape. Apcera VMware OpenStack Google Docker, Inc CoreOS HashiCorp Mesosphere, Inc. Amazon Web Services
AWS Summit Melbourne 2014 | The Path to Business Agility for Vodafone: How Am...DiUS
As part of Vodafone Hutchison Australia (VHA)’s company-wide mission to win back customers, the VHA Digital Products division, with the help of DiUS, built a strategic internal agile development and innovation capability. By leveraging AWS, VHA now has the powerful ability to be more responsive, to experiment, fail-fast and in turn, to deliver an improved customer experience across all digital touchpoints.
We will share VHA’s journey so far by looking at the business objectives and diving into how people, process and technology made it happen:
Making a business case for AWS
Working within a complex technology landscape including legacy systems, COTS products as well as custom-built systems
The role AWS played in achieving change
Enabling daily deployments using Continuous Delivery and other practices and tools
What's next on VHA's agility roadmap
Presenters: Andy McCarthy, Digital Technology Manager, Vodafone Hutchison Australia, & Elliot Murry, Senior Consultant, DiUS
Cloud-Native DevOps: Simplifying application lifecycle management with AWS | ...Amazon Web Services
Organizations are migrating to the cloud in order to increase their agility and eliminate undifferentiated heavy lifting. At the same time, they’re embracing DevOps principles in order to deliver functionality faster and improve operational performance. Taken together, it’s possible to deliver agile, reliable applications with less overhead than ever before. However, it’s not always optimal to emulate traditional approaches to DevOps and configuration management in the cloud. No matter where you are in your DevOps journey, join us in this session to learn how to use AWS application lifecycle management services to focus on your mission, not your tooling.
Norway VMUG Tour - The Architecture Behind Policy-Driven Data Protection - A ...Chris Wahl
The document provides an overview of Rubrik's distributed architecture for policy-driven data protection. It discusses Rubrik's cloud data management platform and how it uses a distributed file system and task scheduler to provide scalable, self-healing backups across on-premises and cloud environments. Key policies are applied using an SLA engine to provide automated data protection based on recovery time, retention period, and other factors.
This document outlines an agenda for a talk on automating infrastructure and security scans using Cloudflare and other tools. It discusses:
1. The goals of automation like reducing administration tasks, improving inventory and scaling/deployment.
2. A overview of configuration management tools like Chef, Puppet, SaltStack and Ansible comparing their architectures, licensing, and support for containers and clouds.
3. Security principles for content delivery networks like Cloudflare focusing on hiding real server IPs.
4. The planned rollout of the Cloudflare recon tool including preparations, building virtual infrastructure, software requirements, and performing/collecting scan results.
Scylla Summit 2018: Meshify - A Case Study, or Petshop SeamonstersScyllaDB
Meshify is the IOT platform focused on wireless sensor technology for industrial/insurance IOT. This talk will provide an overview of how Meshify is using Scylla. It will also explain why, when everything else in Meshify’s platform is moving to a managed cloud service or a container based microservice, why and how the Scylla nodes are the only pet “seamonsters” in Meshify’s platform.
Machine Learning operations brings data science to the world of devops. Data scientists create models on their workstations. MLOps adds automation, validation and monitoring to any environment including machine learning on kubernetes. In this session you hear about latest developments and see it in action.
This document discusses a distributed development project called Project FreeSpace. It aims to speed up development tasks like compilation, testing, and deployment by distributing the work across multiple machines. Key benefits include getting feedback faster through continuous and parallel processing, without slowing down individual developers' machines. The system would use a plugin architecture with self-updating nodes that coordinate tasks over a private cloud infrastructure.
Microservices with Terraform, Docker and the Cloud. JavaOne 2017 2017-10-02Derek Ashmore
This document summarizes a presentation on managing microservices using Terraform, Docker, and cloud infrastructure. The presentation covered microservices and containerization with Docker, deploying microservices to the cloud with AWS using infrastructure as code with Terraform. It also compared Terraform to other configuration management tools and outlined an accompanying hands-on lab for attendees to deploy a sample Java microservice to AWS using Terraform.
RightScale Webinar: So you want to move to the cloud... but you’re not sure what that means, or where you would even start. Or you want to get your feet wet with a proof-of-concept project before you bring out the big guns. We asked Brian Adler, our Professional Services Architect who works directly with customers on cloud projects every single day, to select five cloud projects that you can get started with (and complete!) quickly. In this webinar, Brian and Rafael Saavedra, our VP of Engineering, will walk you through those five projects and will help you demonstrate success in the cloud now.
JavaOne: Efficiently building and deploying microservicesBart Blommaerts
Since Martin Fowler’s article on microservices in the beginning of 2014, there has been a lot of controversy about the topic. Although most articles talk about microservices from an architectural perspective, this session intends to go further and also provide examples of and best practices for building and deploying polyglot applications in an enterprise Java environment. In the session, the build process focuses on efficiency and shows that microservices don’t necessarily cause overhead for a project. Microservices don't imply copying and pasting the same boilerplate code over and over. The deployment process in the presentation is, of course, automated but also demonstrates best practices for integration testing between different active services.
AWS Summit Sydney 2014 | The Path to Business Agility for Vodafone: How Amazo...Amazon Web Services
This document discusses how Amazon achieved business agility through continuous delivery practices like frequent releases, automated testing, immutable infrastructure, and treating infrastructure as code. It emphasizes reducing waste and failure through resiliency, visibility, and immunity enabled by cloud services. Continuous delivery is achieved through automation at all stages from building to deploying to monitoring. The future directions discussed are taking these practices further with microservices, Docker/LXC containers, and generating new projects and deploying them with a single click.
How Percolate uses CFEngine to Manage AWS Stateless InfrastructurePercolate
The document discusses how Percolate uses CFEngine to manage their infrastructure on AWS in a stateless way. Some key points:
1) CFEngine allows Percolate to define infrastructure policies that automatically enforce the desired configuration on servers, providing a documented and scalable approach.
2) By managing all infrastructure as code in Git, and avoiding server state, Percolate's infrastructure is resilient and can be migrated or changed easily.
3) This stateless approach means Percolate avoids backup overhead and can freely launch/replace instances, reducing costs through use of spot instances.
How HashiCorp platform tools can make the difference in development and deplo...Dmytro Mykhailov
This is slides from my talk on Kharkiv IT Weekend on May 27, 2017.
Here is link to my blog where you can find more information about the approaches:
https://devraccoon.com/2017/05/30/hashicorp-tools-on-it-weekend-kharkiv/
Microservices with Terraform, Docker and the Cloud. IJug Chicago 2017-06-06Derek Ashmore
Much has been written about how to write Microservices, but not enough about how to effectively deploy and manage them. Microservices architecture multiplies the number of deployables IT has to manage by at least 10x. In that world, tooling to manage cloud deployments and related infrastructure becames essential for success. Terraform and Docker are increasingly being leveraged to facilitate microservice environments. Terraform has become becoming the leading coding framework for building and managing change in cloud environments.
Attendees will learn best practices for deploying and managing microservices in production. We will leverage true "infrastructure as code" using Terraform. That code is easily re-used and make changes easy. That code makes it easy to deploy and scale software including Docker images. You will learn not only how to establish that environment initially, but how changes can be effectively managed. I'll cover best practices and common mistakes along the way. AWS will be used as the cloud provider, but Terraform operates seemlessly on other cloud environments as well.
This session is targeted at architects and team leads. This session is intended to be platform-generic.
We are now witnessing a new wave of IT revolution and its effect is very similar to the Cloud and Virtualization revolutions that started in the last decade. This new wave, called Containerization, is related to technologies such as Docker and Kubernetes, which now fuel large scale solutions including Big Data and IoT.
Learn about:
- Typical DevOps challenges and modern solutions
- Using Docker as Amazon EC2 Container Service Evolution of Enterprise Architecture (Containers, IoT, Machine Learning and technologies of tomorrow)
- Business value of using advances DevOps technologies with real-life case study
- RAL operates a large HTCondor cluster supporting various HEP experiments including ALICE, ATLAS, and CMS.
- The cluster migrated to using Docker universe for all jobs over the past year which simplified the infrastructure and provided isolation between jobs.
- Monitoring of the cluster has moved from Ganglia to using Telegraf, InfluxDB, and Grafana which provides flexible dashboards of cluster health and metrics.
- Multi-core jobs account for half the cores and the cluster supports these without issues. Preemptable jobs can run on draining nodes.
- Future plans include using Kubernetes to provide a portable abstraction layer to run jobs on internal and external cloud resources like Azure.
This document provides an overview of DevOps, including:
1) It discusses Garry, a product owner whose team had slow and manual software delivery processes until discovering DevOps.
2) DevOps is defined as a culture change involving shared responsibility between development and operations teams to deliver software rapidly through practices like continuous integration, delivery, infrastructure as code, and monitoring.
3) The benefits of DevOps are outlined as faster and more frequent software delivery, improved quality, security, and compliance through automation and visibility across the software lifecycle.
4) Examples of DevOps in action include deploying a web application directly from a development machine versus through an automated build and test process on a separate build box.
Bycraft Conference - Running operations in 2 hoursErno Aapa
My presentation with comments in Bycraft DevOps and Software craftmanship -conference about how you can run operations in 2 hours a day and how you should make your self replaceable
You don’t need DTAP + Backbase implementation - Amsterdam 17-12-2015Pavel Chunyayev
DTAP is already an outdated concept in 2016. Instead an idea of immutable infrastructure should be used. Backbase in partnership with Levi9 have employed the concept of immutable infrastructure to revolutionize the way Custemer Experience Platform (CXP) is developed and released.
The infrastructure of the libre office projectEduardo Campos
Alexander Werner (https://www.facebook.com/bundeswerner) presentation in LibreOffice Conference 2014 Bern, Suíça - 02 a 05 agosto 2014.
Vitorio Yoshinori Doho Furusho (https://www.facebook.com/vfurusho) esteve lá.
Similar to DevOpsDays Ignite - Immutable infrastructure - Amsterdam 24-5-2015 (20)
Experiment and validate business ideas - Talk outline at DevOps Showcase Amst...Pavel Chunyayev
Crucial part of any business is constantly trying to stay relevant for the customers and provide better services that competitors. It’s important to not only generate ideas on how to achieve that, but also to test and validate those ideas. DevOps mindset is indispensable to achieve good business results with software development. But how exactly?
This document discusses feedback in the continuous delivery process. It notes that feedback is information about actions that is returned to the source of those actions. In continuous delivery, there are several types of testing that provide important feedback, including unit, integration, contract, end-to-end, performance, exploratory, and resilience testing. Tests should be created by both developers and testers to catch bugs and ensure stability as code is delivered frequently. Continuous feedback allows for continuous improvement of developing and releasing high quality software.
Want Continuous Delivery? Give testing a priority! 16-6-2016, Friss, UtrechtPavel Chunyayev
This talk covers the importance of automated testing in the proper Continuous Delivery process. Different types of testing are covered in the talk along with how to apply them.
Versioning schemes and branching models for Continuous Delivery - Continuous ...Pavel Chunyayev
There are many different versioning schemes and branching models. Although there’s no golden standard, some of them suit Continuous Delivery more than others. Both branching and versioning are fundamental to the software development life cycle and
I discussed different methods that communities developed over years along with their advantages and disadvantages.
This is a talk about ways Ansible could be extended through dynamic inventory, plugins, modules or API. There was a discussion during meetup and ideas generated are added to the presentation.
1) Ansible is being used at Backbase to automate the provisioning of different server configurations for testing their Customer Experience Platform (CXP).
2) A REST API and UI allow users to easily provision new environments from available server stacks configured with Ansible for testing.
3) This enables Backbase to implement continuous delivery practices like automated testing of new versions without affecting production environments.
Arch9 - A cloud based continuous delivery implementationPavel Chunyayev
Presentation shows the evolution of different configuration management tool from imperative cod on a mutable infrastructure through declarative code back to the imperative code with immutable infrastructure.
State of continuous delivery in 2015 - Minsk 15-5-2015Pavel Chunyayev
The presentation gives high-level overview of most important aspects of implementing Continuous Delivery comparing CD with Agile, DevOps and Lean software development.
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfChart Kalyan
A Mix Chart displays historical data of numbers in a graphical or tabular form. The Kalyan Rajdhani Mix Chart specifically shows the results of a sequence of numbers over different periods.
Generating privacy-protected synthetic data using Secludy and MilvusZilliz
During this demo, the founders of Secludy will demonstrate how their system utilizes Milvus to store and manipulate embeddings for generating privacy-protected synthetic data. Their approach not only maintains the confidentiality of the original data but also enhances the utility and scalability of LLMs under privacy constraints. Attendees, including machine learning engineers, data scientists, and data managers, will witness first-hand how Secludy's integration with Milvus empowers organizations to harness the power of LLMs securely and efficiently.
Dive into the realm of operating systems (OS) with Pravash Chandra Das, a seasoned Digital Forensic Analyst, as your guide. 🚀 This comprehensive presentation illuminates the core concepts, types, and evolution of OS, essential for understanding modern computing landscapes.
Beginning with the foundational definition, Das clarifies the pivotal role of OS as system software orchestrating hardware resources, software applications, and user interactions. Through succinct descriptions, he delineates the diverse types of OS, from single-user, single-task environments like early MS-DOS iterations, to multi-user, multi-tasking systems exemplified by modern Linux distributions.
Crucial components like the kernel and shell are dissected, highlighting their indispensable functions in resource management and user interface interaction. Das elucidates how the kernel acts as the central nervous system, orchestrating process scheduling, memory allocation, and device management. Meanwhile, the shell serves as the gateway for user commands, bridging the gap between human input and machine execution. 💻
The narrative then shifts to a captivating exploration of prominent desktop OSs, Windows, macOS, and Linux. Windows, with its globally ubiquitous presence and user-friendly interface, emerges as a cornerstone in personal computing history. macOS, lauded for its sleek design and seamless integration with Apple's ecosystem, stands as a beacon of stability and creativity. Linux, an open-source marvel, offers unparalleled flexibility and security, revolutionizing the computing landscape. 🖥️
Moving to the realm of mobile devices, Das unravels the dominance of Android and iOS. Android's open-source ethos fosters a vibrant ecosystem of customization and innovation, while iOS boasts a seamless user experience and robust security infrastructure. Meanwhile, discontinued platforms like Symbian and Palm OS evoke nostalgia for their pioneering roles in the smartphone revolution.
The journey concludes with a reflection on the ever-evolving landscape of OS, underscored by the emergence of real-time operating systems (RTOS) and the persistent quest for innovation and efficiency. As technology continues to shape our world, understanding the foundations and evolution of operating systems remains paramount. Join Pravash Chandra Das on this illuminating journey through the heart of computing. 🌟
This presentation provides valuable insights into effective cost-saving techniques on AWS. Learn how to optimize your AWS resources by rightsizing, increasing elasticity, picking the right storage class, and choosing the best pricing model. Additionally, discover essential governance mechanisms to ensure continuous cost efficiency. Whether you are new to AWS or an experienced user, this presentation provides clear and practical tips to help you reduce your cloud costs and get the most out of your budget.
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slackshyamraj55
Discover the seamless integration of RPA (Robotic Process Automation), COMPOSER, and APM with AWS IDP enhanced with Slack notifications. Explore how these technologies converge to streamline workflows, optimize performance, and ensure secure access, all while leveraging the power of AWS IDP and real-time communication via Slack notifications.
Introduction of Cybersecurity with OSS at Code Europe 2024Hiroshi SHIBATA
I develop the Ruby programming language, RubyGems, and Bundler, which are package managers for Ruby. Today, I will introduce how to enhance the security of your application using open-source software (OSS) examples from Ruby and RubyGems.
The first topic is CVE (Common Vulnerabilities and Exposures). I have published CVEs many times. But what exactly is a CVE? I'll provide a basic understanding of CVEs and explain how to detect and handle vulnerabilities in OSS.
Next, let's discuss package managers. Package managers play a critical role in the OSS ecosystem. I'll explain how to manage library dependencies in your application.
I'll share insights into how the Ruby and RubyGems core team works to keep our ecosystem safe. By the end of this talk, you'll have a better understanding of how to safeguard your code.
Your One-Stop Shop for Python Success: Top 10 US Python Development Providersakankshawande
Simplify your search for a reliable Python development partner! This list presents the top 10 trusted US providers offering comprehensive Python development services, ensuring your project's success from conception to completion.
Main news related to the CCS TSI 2023 (2023/1695)Jakub Marek
An English 🇬🇧 translation of a presentation to the speech I gave about the main changes brought by CCS TSI 2023 at the biggest Czech conference on Communications and signalling systems on Railways, which was held in Clarion Hotel Olomouc from 7th to 9th November 2023 (konferenceszt.cz). Attended by around 500 participants and 200 on-line followers.
The original Czech 🇨🇿 version of the presentation can be found here: https://www.slideshare.net/slideshow/hlavni-novinky-souvisejici-s-ccs-tsi-2023-2023-1695/269688092 .
The videorecording (in Czech) from the presentation is available here: https://youtu.be/WzjJWm4IyPk?si=SImb06tuXGb30BEH .
Building Production Ready Search Pipelines with Spark and MilvusZilliz
Spark is the widely used ETL tool for processing, indexing and ingesting data to serving stack for search. Milvus is the production-ready open-source vector database. In this talk we will show how to use Spark to process unstructured data to extract vector representations, and push the vectors to Milvus vector database for search serving.
HCL Notes and Domino License Cost Reduction in the World of DLAUpanagenda
Webinar Recording: https://www.panagenda.com/webinars/hcl-notes-and-domino-license-cost-reduction-in-the-world-of-dlau/
The introduction of DLAU and the CCB & CCX licensing model caused quite a stir in the HCL community. As a Notes and Domino customer, you may have faced challenges with unexpected user counts and license costs. You probably have questions on how this new licensing approach works and how to benefit from it. Most importantly, you likely have budget constraints and want to save money where possible. Don’t worry, we can help with all of this!
We’ll show you how to fix common misconfigurations that cause higher-than-expected user counts, and how to identify accounts which you can deactivate to save money. There are also frequent patterns that can cause unnecessary cost, like using a person document instead of a mail-in for shared mailboxes. We’ll provide examples and solutions for those as well. And naturally we’ll explain the new licensing model.
Join HCL Ambassador Marc Thomas in this webinar with a special guest appearance from Franz Walder. It will give you the tools and know-how to stay on top of what is going on with Domino licensing. You will be able lower your cost through an optimized configuration and keep it low going forward.
These topics will be covered
- Reducing license cost by finding and fixing misconfigurations and superfluous accounts
- How do CCB and CCX licenses really work?
- Understanding the DLAU tool and how to best utilize it
- Tips for common problem areas, like team mailboxes, functional/test users, etc
- Practical examples and best practices to implement right away
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc
How does your privacy program stack up against your peers? What challenges are privacy teams tackling and prioritizing in 2024?
In the fifth annual Global Privacy Benchmarks Survey, we asked over 1,800 global privacy professionals and business executives to share their perspectives on the current state of privacy inside and outside of their organizations. This year’s report focused on emerging areas of importance for privacy and compliance professionals, including considerations and implications of Artificial Intelligence (AI) technologies, building brand trust, and different approaches for achieving higher privacy competence scores.
See how organizational priorities and strategic approaches to data security and privacy are evolving around the globe.
This webinar will review:
- The top 10 privacy insights from the fifth annual Global Privacy Benchmarks Survey
- The top challenges for privacy leaders, practitioners, and organizations in 2024
- Key themes to consider in developing and maintaining your privacy program
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...alexjohnson7307
Predictive maintenance is a proactive approach that anticipates equipment failures before they happen. At the forefront of this innovative strategy is Artificial Intelligence (AI), which brings unprecedented precision and efficiency. AI in predictive maintenance is transforming industries by reducing downtime, minimizing costs, and enhancing productivity.
New cloud world requires new ideas
DevOps, Continuous Delivery, Automation
Especially valuable for microservices
All historic experience
Servers number - small
Situation - manageable
As the number grows, the task gets harder
Compliance
Updates
And the concept of golden image appeared
Provision from approved state
Issues:
Waiting for sysadmin to create and configure infra
How to deal with already provisioned instances
Managing live instances is the same as previously
Infrastructure as a code
Issues:
Still infrastructure is re-used
DSL (sometimes hard to learn)
Compliant only in areas covered by code
Deploying to stateful server is hard
Edge-cases
Serial deployment:
handle exceptions manually
Still not fun
Need to deploy more frequently => repetition
Easier when rebuilt from the scratch
Repetition leads to mastery
Fire drills are part of everyday life now!
You infra is self-healing
Never change – recreate!
Server state is not saved
Not like in functional programming language
Sysadmins are developers now
Code everything!
API is the key
You can program infrastructure life cycle
Create
Configure
Deploy
Operate
Dispose
Deployments suddenly get a lot easier
Create duplicate infrastructure
Test everything
Make the switch
Can be done with reusable infrastructure too
Slower
Deploy new version alongside
Gradually increase amount of traffic
Monitor constantly
If anything’s wrong – quickly revert
When reach 100% - dispose older version
Immutable
Copy-on-write allows to easily revert to known-state
Pass containers around and start without any data
Dockerfile is essentially a bash file
Is applied only once
Continuous Delivery at its best
Continuous Deployments
Fully automated and repeatable
Package application only once – and then never change it
Quick feedback if anything fails
Testing in production!
New paradigm for the cloud era and microservices architecture.
Make your life easier if you are operations – think as a developer
If you are a developer - take responsibility for environment where your application is running. It’s a lot easier than before
If you are a manager – embrace the future: Disposable infrastructure on-demand exactly when it’s needed.