- Just Eat is a leading digital marketplace for takeaway food delivery founded in 2001 operating in 13 markets globally. It has processed up to 2,500 orders per minute at peak times.
- Just Eat migrated to AWS 5 years ago and runs hundreds of EC2 instances at peak dinner times using scheduled scaling, CloudFormation, and other AWS services.
- AWS Lambda was introduced in 2014 and Just Eat started using it for micro tasks like resetting delivery times, publishing SNS messages, and provisioning instance access to reduce infrastructure costs and management compared to running EC2 fleets.
- Terraform allows infrastructure teams to more efficiently and agilely provision resources at scale across multiple production datacenters and regions.
- Key benefits include auto-scaling, self-service provisioning of services like Elasticsearch and Cassandra, and reducing new datacenter provisioning from over 12 months to just 2 months.
- Debugging and managing complex Terraform configurations, especially across modules, can currently be challenging due to limitations in Terraform's data handling and interpolation features.
How to use Ansible to automate your applications in AWS. What is Ansible and why is it different? How to control cloud deployments securely and how to control AWS resources using dynamic inventory and tags.
Setup Kubernetes Cluster On AWS Using KOPSSivaprakash
This document provides steps to set up a Kubernetes cluster on AWS using KOPS. It describes installing required tools like kubectl and KOPS, creating an SSH key and Route53 host on AWS, generating a Kubernetes cluster across multiple Availability Zones, and exposing sample applications. Finally, it covers deleting the cluster.
Create Microservice with Spring Boot and DockerSivaprakash
Spring Boot makes it easy to create standalone and production-ready Spring applications with minimal configuration. It aims to provide a faster development experience and common features like embedded servers and health checks. Spring Boot 2.0.1 requires Java 8/9 and works with embedded containers like Tomcat, Jetty and Undertow. Docker is a containerization platform that virtualizes applications and their dependencies to run on any OS without conflicts. It was developed by Docker Inc. and written in Go, with community and enterprise editions available.
Using Serverless Architectures to build and provision modern infrastructuresRamit Surana
The document discusses serverless architectures using AWS Lambda. It introduces AWS Lambda as a serverless computing platform that runs code without provisioning or managing servers. Serverless architectures distribute API calls to stateless functions that leverage external cloud services for data. The document outlines the benefits of serverless, including scalability, low costs, and not having to manage servers. It also notes challenges like difficulty monitoring and debugging, lack of control, and vendor lock-in.
- Just Eat is a leading digital marketplace for takeaway food delivery founded in 2001 operating in 13 markets globally. It has processed up to 2,500 orders per minute at peak times.
- Just Eat migrated to AWS 5 years ago and runs hundreds of EC2 instances at peak dinner times using scheduled scaling, CloudFormation, and other AWS services.
- AWS Lambda was introduced in 2014 and Just Eat started using it for micro tasks like resetting delivery times, publishing SNS messages, and provisioning instance access to reduce infrastructure costs and management compared to running EC2 fleets.
- Terraform allows infrastructure teams to more efficiently and agilely provision resources at scale across multiple production datacenters and regions.
- Key benefits include auto-scaling, self-service provisioning of services like Elasticsearch and Cassandra, and reducing new datacenter provisioning from over 12 months to just 2 months.
- Debugging and managing complex Terraform configurations, especially across modules, can currently be challenging due to limitations in Terraform's data handling and interpolation features.
How to use Ansible to automate your applications in AWS. What is Ansible and why is it different? How to control cloud deployments securely and how to control AWS resources using dynamic inventory and tags.
Setup Kubernetes Cluster On AWS Using KOPSSivaprakash
This document provides steps to set up a Kubernetes cluster on AWS using KOPS. It describes installing required tools like kubectl and KOPS, creating an SSH key and Route53 host on AWS, generating a Kubernetes cluster across multiple Availability Zones, and exposing sample applications. Finally, it covers deleting the cluster.
Create Microservice with Spring Boot and DockerSivaprakash
Spring Boot makes it easy to create standalone and production-ready Spring applications with minimal configuration. It aims to provide a faster development experience and common features like embedded servers and health checks. Spring Boot 2.0.1 requires Java 8/9 and works with embedded containers like Tomcat, Jetty and Undertow. Docker is a containerization platform that virtualizes applications and their dependencies to run on any OS without conflicts. It was developed by Docker Inc. and written in Go, with community and enterprise editions available.
Using Serverless Architectures to build and provision modern infrastructuresRamit Surana
The document discusses serverless architectures using AWS Lambda. It introduces AWS Lambda as a serverless computing platform that runs code without provisioning or managing servers. Serverless architectures distribute API calls to stateless functions that leverage external cloud services for data. The document outlines the benefits of serverless, including scalability, low costs, and not having to manage servers. It also notes challenges like difficulty monitoring and debugging, lack of control, and vendor lock-in.
Hashicorp: Delivering the Tao of DevOpsRamit Surana
HashiCorp is an open-source software company based in San Francisco, California that solves development, operations, and security challenges in infrastructure so organizations can focus on business-critical tasks. HashiCorp provides a set of open source tools and commercial product offerings.
AWS Elastic Container Service - DockerHNNguyen Anh Tu
Amazon EC2 Container Service (ECS) is a container management service that supports running and managing Docker containers on a cluster of Amazon EC2 instances. It provides built-in scheduling, cluster management, and orchestration capabilities to help run and scale containerized applications. ECS integrates with other AWS services like Elastic Load Balancing, Elastic Block Store, Virtual Private Cloud, and more. Users define tasks and services in task definitions that specify containers, resources, dependencies, and other configuration.
This document provides an overview of Amazon EC2 Container Service (ECS), which allows users to easily run and manage Docker containers. Some key points:
- ECS allows users to run Docker containers and manage them without having to worry about installing and operating Docker clusters.
- It provides core functionality like scheduling containers on EC2 instances, load balancing, and automated scaling of containers.
- Users define their containerized applications as task definitions which specify things like what images to use, CPU/memory resources, and port mappings.
- Tasks can then be run or long-running services can be created to run containers behind a load balancer for high availability.
- Additional AWS services like EBS,
This presentation covers how to use CloudFormation for deploying customized services on AWS. It goes through the background and advantages, as well as some commonly-used functions. Presented by Joseph Maxwell: lead developer at SwiftOtter Studios.
Microsoft Azure Container Service - DockerCHNguyen Anh Tu
This document provides an overview and agenda for a presentation on Microsoft Azure Container Service. The presentation will cover deploying to ACS, Mesosphere DC/OS and Marathon, Docker Swarm, and a demo. It will also provide more information on DC/OS and Docker integration with Windows.
(APP309) Running and Monitoring Docker Containers at Scale | AWS re:Invent 2014Amazon Web Services
If you have tried Docker but are unsure about how to run it at scale, you will benefit from this session. Like virtualization before, containerization (à; la Docker) is increasing the elastic nature of cloud infrastructure by an order of magnitude. But maybe you still have questions: How many containers can you run on a given Amazon EC2 instance type? Which metric should you look at to measure contention? How do you manage fleets of containers at scale?
Datadog is a monitoring service for IT, operations, and development teams who write and run applications at scale. In this session, the cofounder of Datadog presents the challenges and benefits of running containers at scale and how to use quantitative performance patterns to monitor your infrastructure at this magnitude and complexity. Sponsored by Datadog.
Using HashiCorp’s Terraform to build your infrastructure on AWS - Pop-up Loft...Amazon Web Services
Using Terraform to automate your infrastructure on AWS. What is Terraform and how is it different from Ansible. How to control cloud deployments using Terraform.
Packer and TerraForm are fundamental components of Infrastructure as Code. I recently gave a talk at a DevOps meetup, which allowed me the opportunity to discuss the basics of these two tools, and how DevOps teams should be using them
Automating aws infrastructure and code deployments using Ansible @WebEngageVishal Uderani
In this talk , we’ll cover how and why Ansible was leveraged to automate routine management of EC2 instances/EBS/EIP/ELB etc and why the Ansible approach towards automation is key for code and system deployments across 100’s of nodes and how we achieved this at Webengage. We will provide an overview of the deployment process and give a demonstration as an example
Outlines :
How ansible is a straightforward , easy way to manage multiple cloud resources
Intended Audience :
Previous experience with configuration management systems
Previous experience with AWS and Ansible
This document summarizes information from DockerCon 2016, including new features in Docker 1.12 such as Swarm Mode, an integrated clustering system. Swarm Mode uses technologies like SwarmKit for orchestration, Raft for consensus, and gossip protocols for node communication. It also details the new networking model in Docker 1.12 which gives containers IP addresses on ingress, overlay, and docker_gwbridge networks. A new Distributed Application Bundle format is introduced to package multi-service applications.
Simple Service for Managing Pools of 10s or 100s of Virtual Machines
With Provisionr we want to solve the problem of cloud portability by hiding completely the API and only focusing on building a cluster that matches the same set of assumptions on all clouds, assumptions like: running a specific operating system (e.g. Ubuntu LTS), having the same set of pre-installed packages and binaries, sane dns settings (forward & reverse ip resolution - as needed for Hadoop), ntp settings, networking settings, ssh admin access, vpn access etc.
This document summarizes an Ansible and AWS meetup. It discusses using Ansible to provision and configure AWS resources like EC2 instances, security groups, ELBs, and more through idempotent playbooks. Key points covered include Ansible's agentless architecture, dynamic AWS inventory plugin, core modules like ec2 and cloudformation, templates, roles for reuse, and examples of provisioning playbooks that launch instances and apply configurations. It also briefly mentions NetflixOSS projects that use Ansible like Aminator for AMIs and Asgard for provisioning.
This document provides an overview of Terraform, an open-source infrastructure as code tool. It discusses Terraform's goals of providing a unified view of infrastructure, composing multiple tiers of infrastructure from IaaS to PaaS to SaaS, and safely changing infrastructure over time with one workflow. Key features highlighted include being open source, using infrastructure as code, resource providers that interface with cloud APIs, and the plan and apply workflow. The document also covers topics like collaboration and version history in Terraform Enterprise, file examples, the plan and apply commands, resource providers, and new features in recent Terraform versions like destroy provisioners, remote backends, state locking, and state environments.
DockerCon 2015: Docker Engine Breakout SessionDocker, Inc.
The document summarizes a Docker Engine breakout session that covered:
- An overview of Docker Engine, including key facts about its contributors and development.
- New features in Docker Engine 1.7.0, including an experimental binary, a new networking model, and improved network performance.
- Upcoming priorities like better tooling, security enhancements, and improved management of networks and volumes.
A demo was also planned to showcase Docker Engine capabilities.
This document provides an overview of AWS services including EC2, S3, EBS, and pricing models. It discusses how EC2 allows users to launch virtual servers called instances from templates called AMIs. S3 provides simple storage, while EBS allows attaching volumes to EC2 instances. Pricing is based on instance types that vary by CPU, memory, and hourly or reserved rates. The document concludes by covering how to set up the AWS command line tools.
Deploying Highly Available Cluster with KOPS. What should be the major production consideration? Creating Kubernetes cluster on AWS by using Kubernetes Operations.
- Docker can be integrated with CloudStack in several ways, including running Docker in CloudStack virtual machine guests, packaging CloudStack as Docker containers, and using Docker orchestrators to manage containers.
- CloudStack could potentially be re-architected to run its components in Docker containers and use Docker networking for isolation, with an orchestrator like Mesos or Kubernetes managing the CloudStack application.
- There are open questions around whether CloudStack or other orchestrators should schedule virtual machines or containers as the primary compute resource in a private cloud data center.
Modern tooling to assist with developing applications on FreeBSDSean Chittenden
Discuss a workflow and the tooling for FreeBSD engineers to develop locally on their laptop (OS-X, Windows, or FreeBSD), and push applications to bare metal or the cloud. The tooling required to provide good automation from a developer laptop to production takes time to evolve, however this lecture will jumpstart a series of best practices for FreeBSD engineers who want to see their business applications run on FreeBSD.
In a dynamic infrastructure world, let's stop pretending credentials aren't public knowledge in an organization and just assume that they have already been leaked, now what?
Hashicorp: Delivering the Tao of DevOpsRamit Surana
HashiCorp is an open-source software company based in San Francisco, California that solves development, operations, and security challenges in infrastructure so organizations can focus on business-critical tasks. HashiCorp provides a set of open source tools and commercial product offerings.
AWS Elastic Container Service - DockerHNNguyen Anh Tu
Amazon EC2 Container Service (ECS) is a container management service that supports running and managing Docker containers on a cluster of Amazon EC2 instances. It provides built-in scheduling, cluster management, and orchestration capabilities to help run and scale containerized applications. ECS integrates with other AWS services like Elastic Load Balancing, Elastic Block Store, Virtual Private Cloud, and more. Users define tasks and services in task definitions that specify containers, resources, dependencies, and other configuration.
This document provides an overview of Amazon EC2 Container Service (ECS), which allows users to easily run and manage Docker containers. Some key points:
- ECS allows users to run Docker containers and manage them without having to worry about installing and operating Docker clusters.
- It provides core functionality like scheduling containers on EC2 instances, load balancing, and automated scaling of containers.
- Users define their containerized applications as task definitions which specify things like what images to use, CPU/memory resources, and port mappings.
- Tasks can then be run or long-running services can be created to run containers behind a load balancer for high availability.
- Additional AWS services like EBS,
This presentation covers how to use CloudFormation for deploying customized services on AWS. It goes through the background and advantages, as well as some commonly-used functions. Presented by Joseph Maxwell: lead developer at SwiftOtter Studios.
Microsoft Azure Container Service - DockerCHNguyen Anh Tu
This document provides an overview and agenda for a presentation on Microsoft Azure Container Service. The presentation will cover deploying to ACS, Mesosphere DC/OS and Marathon, Docker Swarm, and a demo. It will also provide more information on DC/OS and Docker integration with Windows.
(APP309) Running and Monitoring Docker Containers at Scale | AWS re:Invent 2014Amazon Web Services
If you have tried Docker but are unsure about how to run it at scale, you will benefit from this session. Like virtualization before, containerization (à; la Docker) is increasing the elastic nature of cloud infrastructure by an order of magnitude. But maybe you still have questions: How many containers can you run on a given Amazon EC2 instance type? Which metric should you look at to measure contention? How do you manage fleets of containers at scale?
Datadog is a monitoring service for IT, operations, and development teams who write and run applications at scale. In this session, the cofounder of Datadog presents the challenges and benefits of running containers at scale and how to use quantitative performance patterns to monitor your infrastructure at this magnitude and complexity. Sponsored by Datadog.
Using HashiCorp’s Terraform to build your infrastructure on AWS - Pop-up Loft...Amazon Web Services
Using Terraform to automate your infrastructure on AWS. What is Terraform and how is it different from Ansible. How to control cloud deployments using Terraform.
Packer and TerraForm are fundamental components of Infrastructure as Code. I recently gave a talk at a DevOps meetup, which allowed me the opportunity to discuss the basics of these two tools, and how DevOps teams should be using them
Automating aws infrastructure and code deployments using Ansible @WebEngageVishal Uderani
In this talk , we’ll cover how and why Ansible was leveraged to automate routine management of EC2 instances/EBS/EIP/ELB etc and why the Ansible approach towards automation is key for code and system deployments across 100’s of nodes and how we achieved this at Webengage. We will provide an overview of the deployment process and give a demonstration as an example
Outlines :
How ansible is a straightforward , easy way to manage multiple cloud resources
Intended Audience :
Previous experience with configuration management systems
Previous experience with AWS and Ansible
This document summarizes information from DockerCon 2016, including new features in Docker 1.12 such as Swarm Mode, an integrated clustering system. Swarm Mode uses technologies like SwarmKit for orchestration, Raft for consensus, and gossip protocols for node communication. It also details the new networking model in Docker 1.12 which gives containers IP addresses on ingress, overlay, and docker_gwbridge networks. A new Distributed Application Bundle format is introduced to package multi-service applications.
Simple Service for Managing Pools of 10s or 100s of Virtual Machines
With Provisionr we want to solve the problem of cloud portability by hiding completely the API and only focusing on building a cluster that matches the same set of assumptions on all clouds, assumptions like: running a specific operating system (e.g. Ubuntu LTS), having the same set of pre-installed packages and binaries, sane dns settings (forward & reverse ip resolution - as needed for Hadoop), ntp settings, networking settings, ssh admin access, vpn access etc.
This document summarizes an Ansible and AWS meetup. It discusses using Ansible to provision and configure AWS resources like EC2 instances, security groups, ELBs, and more through idempotent playbooks. Key points covered include Ansible's agentless architecture, dynamic AWS inventory plugin, core modules like ec2 and cloudformation, templates, roles for reuse, and examples of provisioning playbooks that launch instances and apply configurations. It also briefly mentions NetflixOSS projects that use Ansible like Aminator for AMIs and Asgard for provisioning.
This document provides an overview of Terraform, an open-source infrastructure as code tool. It discusses Terraform's goals of providing a unified view of infrastructure, composing multiple tiers of infrastructure from IaaS to PaaS to SaaS, and safely changing infrastructure over time with one workflow. Key features highlighted include being open source, using infrastructure as code, resource providers that interface with cloud APIs, and the plan and apply workflow. The document also covers topics like collaboration and version history in Terraform Enterprise, file examples, the plan and apply commands, resource providers, and new features in recent Terraform versions like destroy provisioners, remote backends, state locking, and state environments.
DockerCon 2015: Docker Engine Breakout SessionDocker, Inc.
The document summarizes a Docker Engine breakout session that covered:
- An overview of Docker Engine, including key facts about its contributors and development.
- New features in Docker Engine 1.7.0, including an experimental binary, a new networking model, and improved network performance.
- Upcoming priorities like better tooling, security enhancements, and improved management of networks and volumes.
A demo was also planned to showcase Docker Engine capabilities.
This document provides an overview of AWS services including EC2, S3, EBS, and pricing models. It discusses how EC2 allows users to launch virtual servers called instances from templates called AMIs. S3 provides simple storage, while EBS allows attaching volumes to EC2 instances. Pricing is based on instance types that vary by CPU, memory, and hourly or reserved rates. The document concludes by covering how to set up the AWS command line tools.
Deploying Highly Available Cluster with KOPS. What should be the major production consideration? Creating Kubernetes cluster on AWS by using Kubernetes Operations.
- Docker can be integrated with CloudStack in several ways, including running Docker in CloudStack virtual machine guests, packaging CloudStack as Docker containers, and using Docker orchestrators to manage containers.
- CloudStack could potentially be re-architected to run its components in Docker containers and use Docker networking for isolation, with an orchestrator like Mesos or Kubernetes managing the CloudStack application.
- There are open questions around whether CloudStack or other orchestrators should schedule virtual machines or containers as the primary compute resource in a private cloud data center.
Modern tooling to assist with developing applications on FreeBSDSean Chittenden
Discuss a workflow and the tooling for FreeBSD engineers to develop locally on their laptop (OS-X, Windows, or FreeBSD), and push applications to bare metal or the cloud. The tooling required to provide good automation from a developer laptop to production takes time to evolve, however this lecture will jumpstart a series of best practices for FreeBSD engineers who want to see their business applications run on FreeBSD.
In a dynamic infrastructure world, let's stop pretending credentials aren't public knowledge in an organization and just assume that they have already been leaked, now what?
The document discusses using Vagrant and cloud platforms like GCP to develop and deploy applications from development to production. It introduces Vagrant as a tool for setting up and managing development environments and shows how to use Vagrant with FreeBSD. It then demonstrates provisioning a FreeBSD VM on GCP and discusses identity and access management on the cloud platform. The document aims to provide an overview of using Vagrant for development and cloud platforms like GCP for production deployments.
PostgreSQL High-Availability and Geographic Locality using consulSean Chittenden
Virtual IPs or floating IPs have long been the workhorse mechanism for providing high-availability for database systems, however floating IP addresses have several limitations that make it problematic in modern data centers and cloud environments, notably that it requires all members be in the same Layer-2 domain. consul is a strongly consistent way of providing high-availability services in Layer-3 environments and provides fail-over across different geographic regions. In this talk we will discuss the benefits, setup, and use of consul for fail-over of PostgreSQL, both in a local data center scenario and a geographic redundancy scenario where databases are split across multiple data centers.
Using ansible vault to protect your secretsExcella
This document discusses how Ansible Vault can be used to encrypt sensitive data like passwords and private keys to protect secrets when committing infrastructure as code to source control on GitHub. It recommends encrypting only sensitive information, not all files, and splitting encrypted variable files into directories. It also provides tips for using a password script and Jenkins to automate running plays with encrypted data without exposing passwords in plain text. The document aims to help balance the security of encrypting secrets with the usability of infrastructure as code workflows.
Neil Saunders (Beamly) - Securing your AWS Infrastructure with Hashicorp Vault Outlyer
A review of AWS security concepts, leaks at Beamly, an Introduction to Hashicorp Vault and how we use use Vault at Beamly.
Watch YouTube video here: http://bit.ly/25ytNAD
Join DevOps Exchange London Meetup: http://bit.ly/22y4Var
Follow DOXLON on Twitter: http://bit.ly/1ZdugEJ
This session walks through the mechanics of AWS bill computation and consolidated billing to help you understand your bill. AWS billing has many features to help you manage and control your costs in the AWS cloud environment including detailed billing reports, programmatic access, cost allocation, billing alerts, and IAM access. We provide an overview of these features and then demonstrate how to use and incorporate them into your own account setup.
No Docker? No Problem: Automating installation and config with AnsibleJeff Potts
In this talk I show how to bring stability and repeatability to your Alfresco installation by automating install and config management with Ansible.
This talk was originally given at Alfresco DevCon 2020 (virtual edition).
This document provides an overview of application deployment on cloud platforms. It begins with an introduction to cloud computing and comparisons of SAAS, PAAS and IAAS models. The document then discusses benefits and challenges of cloud deployment. It also covers business and architectural considerations for moving applications to the cloud. Finally, it demonstrates several popular platform as a service providers like Firebase, AWS, Heroku and Cloud Foundry and provides guidance on deploying applications on each.
Eric Holmes from Remind discussed building an internal Platform as a Service (PaaS) called Empire using Docker and Amazon EC2 Container Service (ECS). Remind started on Heroku but encountered issues with scaling and visibility. Empire provides a management layer on top of ECS for deploying and scaling microservices. It implements a subset of the Heroku API and provides a single binary and CLI. Empire is running 15 of Remind's production services on ECS with improved performance over Heroku. A demo was shown of deploying a sample app with Empire.
The document discusses infrastructure as code (IAC) and its principles and categories. Some key points:
- IAC treats infrastructure like code by writing code to define, deploy, and update infrastructure. This allows infrastructure to be managed programmatically.
- Common categories of IAC include ad hoc scripts, configuration management tools like Ansible and Puppet, server templating tools like Packer, and server provisioning tools like Terraform.
- Benefits of IAC include automation, consistency, repeatability, versioning, validation, reuse, and allowing engineers to focus on code instead of manual tasks.
- AWS offers CloudFormation for provisioning AWS resources through templates. Other tools integrate with Cloud
We are sharing our process of migrating to the container based DroneCI platform and our lessons learned when scaling it up for an active open source project like ownCloud. Our journey started with a static legacy CI system, which was gradually replaced with, at first, a static DroneCI infrastructure. Over the course of half a year, we further more migrated to a cloud provider in order to dynamically scale the CI system based on the build volume. The lessons learned during this journey, were transformed and contributed to the DroneCI project and resulted in the DroneCI autoscaler - which allows for automatic scaling of infrastructure resources with common cloud providers.
AIM410R Deep Learning Applications with TensorFlow, featuring Mobileye (Decem...Julien SIMON
Mobileye adopted Amazon SageMaker to accelerate its deep learning model development, reducing time from months to under a week. Pipe Mode enabled training on Mobileye's large datasets without copying data to instances. Challenges like data format conversion and shuffling were addressed using SageMaker features and TensorFlow APIs. Adopting SageMaker provided Mobileye unlimited compute and helped simplify and scale its neural network training.
The lightning talks covered various Netflix OSS projects including S3mper, PigPen, STAASH, Dynomite, Aegisthus, Suro, Zeno, Lipstick on GCE, AnsWerS, and IBM. 41 projects were discussed and the need for a cohesive Netflix OSS platform was highlighted. Matt Bookman then gave a presentation on running Lipstick and Hadoop on Google Cloud Platform using Google Compute Engine and Cloud Storage. He demonstrated running Pig jobs on Compute Engine and discussed design considerations for cloud-based Hadoop deployments. Finally, Peter Sankauskas from @Answers4AWS discussed initial ideas around CloudFormation for Asgard and deploying various Netflix OSS
The document discusses building an enterprise integration platform on Azure using Terraform. It summarizes the challenges of traditional on-premise integration platforms like BizTalk and how Azure services can address these. It then demonstrates how to define Azure infrastructure as code using Terraform to automate the provisioning of an integration platform across environments in under 45 minutes. The document concludes by discussing how Azure DevOps pipelines can be used to manage deployments and ensure consistency.
Red Hat Storage Day LA - Persistent Storage for Linux Containers Red_Hat_Storage
This document discusses persistent storage options for Linux containers and how Red Hat Storage addresses the storage needs of containerized applications. It begins by explaining how containers package applications and dependencies for portability and ease of management. Typical workloads for containers often require persistent storage. The document then evaluates options like NFS, GlusterFS, Ceph RBD, iSCSI/FC and public cloud storage, noting that Red Hat Storage provides scalable, resilient, flexible software-defined storage. It presents Red Hat Storage and OpenShift Enterprise as a solution that allows applications and storage to run together on servers for improved utilization and costs. The document closes with two customer case studies demonstrating how Red Hat Storage supports containerized workloads at CapitalOne and Ver
This document provides an overview of a workshop on using Terraform to manage AWS infrastructure as code. The workshop objective is to get started using Terraform to build, change, and version AWS resources in an easy and efficient manner. Attendees will learn about Terraform concepts like providers, resources, execution plans, and state management. The workshop will demonstrate how to install Terraform and AWS CLI, configure credentials, and build sample infrastructure on AWS including a "Hello World" instance. It will also cover additional Terraform topics like variables, outputs, modules, and data sources.
Presentation shows how at Droplr we consider the DevOps role.
It covers topics related with Amazon Web Services, Infrastructure as Code concept (with tools like Terraform and Ansible) and going into Continuous Deployment as the key of making our company the most competitive on the market.
Presentation from the 8th Wrocław's DevOps Meeting which took place on 28.03.2017.
Altoros Cloud Foundry Training: hands-on workshop for DevOps, Architects and ...Manuel Garcia
Dealing with high-load services of all kinds makes us to seek for new generation tools to build reliable, scalable, and 100% available systems. At this workshop, you will have chance to dive deep into how Cloud Foundry solves the issues of portability, scalability, reliability and extensibility.
Hands-on agenda:
- Application lifecycle: from development to production
- Deep dive into Cloud Foundry architecture
- Where to deploy Cloud Foundry
- How to Deploy Cloud Foundry: from small evaluation to hundreds VMs High Availability production environments
- Scale up and down your infrastructure. Can you auto scale?
- Zero downtime upgrades
- Auto Healing deployments
- Cloud Foundry system logging and monitoring
- Services: types, current restrictions and expectations
- The document discusses using Fabric and Boto for automating tasks in cloud computing environments. Fabric allows running Python scripts and commands over SSH, while Boto is the Python API for interacting with AWS services like EC2.
- Examples are provided of writing basic Fabric files with tasks to run commands on remote servers. Key features covered include defining host groups with roles, enabling parallel execution of certain tasks, and setting failure handling modes.
- Automating tasks with Fabric and Boto can improve efficiency, consistency, and manageability of cloud infrastructure and deployments.
Running Cassandra in a docker environment to give you a flexible development environment that uses only a very small set of resources, both locally and with your favorite cloud provider. Lessons learned running Cassandra with a very small set of resources are applicable to both your local development environment and larger, less constrained production deployments.
From http://www.meetup.com/Docker-Santa-Clara/events/232789407/
Thursday, June 12th 2014
Discussing strategies in Rails development for keeping multiple application environments as consistent as possible for the best development, testing, and deployment experience.
20170831 - Greg Palmier: Terraform & AWS at TempusDevOps Chicago
Terraform is used at Tempus to define AWS infrastructure as code using modules and blueprints. Common utilities like a shared VPC are defined for re-use, while environment-specific configurations are generated. Applications are deployed using modules that define resources like load balancers, auto-scaling groups, and databases, allowing standardized deployment across environments in about 5 minutes. Monitoring and automation is implemented through CloudWatch, ASGs, and tools like Jenkins and PagerDuty.
Why Apache Kafka Clusters Are Like Galaxies (And Other Cosmic Kafka Quandarie...Paul Brebner
Closing talk for the Performance Engineering track at Community Over Code EU (Bratislava, Slovakia, June 5 2024) https://eu.communityovercode.org/sessions/2024/why-apache-kafka-clusters-are-like-galaxies-and-other-cosmic-kafka-quandaries-explored/ Instaclustr (now part of NetApp) manages 100s of Apache Kafka clusters of many different sizes, for a variety of use cases and customers. For the last 7 years I’ve been focused outwardly on exploring Kafka application development challenges, but recently I decided to look inward and see what I could discover about the performance, scalability and resource characteristics of the Kafka clusters themselves. Using a suite of Performance Engineering techniques, I will reveal some surprising discoveries about cosmic Kafka mysteries in our data centres, related to: cluster sizes and distribution (using Zipf’s Law), horizontal vs. vertical scalability, and predicting Kafka performance using metrics, modelling and regression techniques. These insights are relevant to Kafka developers and operators.
Unlock the Secrets to Effortless Video Creation with Invideo: Your Ultimate G...The Third Creative Media
"Navigating Invideo: A Comprehensive Guide" is an essential resource for anyone looking to master Invideo, an AI-powered video creation tool. This guide provides step-by-step instructions, helpful tips, and comparisons with other AI video creators. Whether you're a beginner or an experienced video editor, you'll find valuable insights to enhance your video projects and bring your creative ideas to life.
Baha Majid WCA4Z IBM Z Customer Council Boston June 2024.pdfBaha Majid
IBM watsonx Code Assistant for Z, our latest Generative AI-assisted mainframe application modernization solution. Mainframe (IBM Z) application modernization is a topic that every mainframe client is addressing to various degrees today, driven largely from digital transformation. With generative AI comes the opportunity to reimagine the mainframe application modernization experience. Infusing generative AI will enable speed and trust, help de-risk, and lower total costs associated with heavy-lifting application modernization initiatives. This document provides an overview of the IBM watsonx Code Assistant for Z which uses the power of generative AI to make it easier for developers to selectively modernize COBOL business services while maintaining mainframe qualities of service.
Measures in SQL (SIGMOD 2024, Santiago, Chile)Julian Hyde
SQL has attained widespread adoption, but Business Intelligence tools still use their own higher level languages based upon a multidimensional paradigm. Composable calculations are what is missing from SQL, and we propose a new kind of column, called a measure, that attaches a calculation to a table. Like regular tables, tables with measures are composable and closed when used in queries.
SQL-with-measures has the power, conciseness and reusability of multidimensional languages but retains SQL semantics. Measure invocations can be expanded in place to simple, clear SQL.
To define the evaluation semantics for measures, we introduce context-sensitive expressions (a way to evaluate multidimensional expressions that is consistent with existing SQL semantics), a concept called evaluation context, and several operations for setting and modifying the evaluation context.
A talk at SIGMOD, June 9–15, 2024, Santiago, Chile
Authors: Julian Hyde (Google) and John Fremlin (Google)
https://doi.org/10.1145/3626246.3653374
Project Management: The Role of Project Dashboards.pdfKarya Keeper
Project management is a crucial aspect of any organization, ensuring that projects are completed efficiently and effectively. One of the key tools used in project management is the project dashboard, which provides a comprehensive view of project progress and performance. In this article, we will explore the role of project dashboards in project management, highlighting their key features and benefits.
Most important New features of Oracle 23c for DBAs and Developers. You can get more idea from my youtube channel video from https://youtu.be/XvL5WtaC20A
A Comprehensive Guide on Implementing Real-World Mobile Testing Strategies fo...kalichargn70th171
In today's fiercely competitive mobile app market, the role of the QA team is pivotal for continuous improvement and sustained success. Effective testing strategies are essential to navigate the challenges confidently and precisely. Ensuring the perfection of mobile apps before they reach end-users requires thoughtful decisions in the testing plan.
Odoo releases a new update every year. The latest version, Odoo 17, came out in October 2023. It brought many improvements to the user interface and user experience, along with new features in modules like accounting, marketing, manufacturing, websites, and more.
The Odoo 17 update has been a hot topic among startups, mid-sized businesses, large enterprises, and Odoo developers aiming to grow their businesses. Since it is now already the first quarter of 2024, you must have a clear idea of what Odoo 17 entails and what it can offer your business if you are still not aware of it.
This blog covers the features and functionalities. Explore the entire blog and get in touch with expert Odoo ERP consultants to leverage Odoo 17 and its features for your business too.
An Overview of Odoo ERP
Odoo ERP was first released as OpenERP software in February 2005. It is a suite of business applications used for ERP, CRM, eCommerce, websites, and project management. Ten years ago, the Odoo Enterprise edition was launched to help fund the Odoo Community version.
When you compare Odoo Community and Enterprise, the Enterprise edition offers exclusive features like mobile app access, Odoo Studio customisation, Odoo hosting, and unlimited functional support.
Today, Odoo is a well-known name used by companies of all sizes across various industries, including manufacturing, retail, accounting, marketing, healthcare, IT consulting, and R&D.
The latest version, Odoo 17, has been available since October 2023. Key highlights of this update include:
Enhanced user experience with improvements to the command bar, faster backend page loading, and multiple dashboard views.
Instant report generation, credit limit alerts for sales and invoices, separate OCR settings for invoice creation, and an auto-complete feature for forms in the accounting module.
Improved image handling and global attribute changes for mailing lists in email marketing.
A default auto-signature option and a refuse-to-sign option in HR modules.
Options to divide and merge manufacturing orders, track the status of manufacturing orders, and more in the MRP module.
Dark mode in Odoo 17.
Now that the Odoo 17 announcement is official, let’s look at what’s new in Odoo 17!
What is Odoo ERP 17?
Odoo 17 is the latest version of one of the world’s leading open-source enterprise ERPs. This version has come up with significant improvements explained here in this blog. Also, this new version aims to introduce features that enhance time-saving, efficiency, and productivity for users across various organisations.
Odoo 17, released at the Odoo Experience 2023, brought notable improvements to the user interface and added new functionalities with enhancements in performance, accessibility, data analysis, and management, further expanding its reach in the market.
How Can Hiring A Mobile App Development Company Help Your Business Grow?ToXSL Technologies
ToXSL Technologies is an award-winning Mobile App Development Company in Dubai that helps businesses reshape their digital possibilities with custom app services. As a top app development company in Dubai, we offer highly engaging iOS & Android app solutions. https://rb.gy/necdnt
The Key to Digital Success_ A Comprehensive Guide to Continuous Testing Integ...kalichargn70th171
In today's business landscape, digital integration is ubiquitous, demanding swift innovation as a necessity rather than a luxury. In a fiercely competitive market with heightened customer expectations, the timely launch of flawless digital products is crucial for both acquisition and retention—any delay risks ceding market share to competitors.
A neural network is a machine learning program, or model, that makes decisions in a manner similar to the human brain, by using processes that mimic the way biological neurons work together to identify phenomena, weigh options and arrive at conclusions.
Top Benefits of Using Salesforce Healthcare CRM for Patient Management.pdfVALiNTRY360
Salesforce Healthcare CRM, implemented by VALiNTRY360, revolutionizes patient management by enhancing patient engagement, streamlining administrative processes, and improving care coordination. Its advanced analytics, robust security, and seamless integration with telehealth services ensure that healthcare providers can deliver personalized, efficient, and secure patient care. By automating routine tasks and providing actionable insights, Salesforce Healthcare CRM enables healthcare providers to focus on delivering high-quality care, leading to better patient outcomes and higher satisfaction. VALiNTRY360's expertise ensures a tailored solution that meets the unique needs of any healthcare practice, from small clinics to large hospital systems.
For more info visit us https://valintry360.com/solutions/health-life-sciences
E-Invoicing Implementation: A Step-by-Step Guide for Saudi Arabian CompaniesQuickdice ERP
Explore the seamless transition to e-invoicing with this comprehensive guide tailored for Saudi Arabian businesses. Navigate the process effortlessly with step-by-step instructions designed to streamline implementation and enhance efficiency.
Mobile App Development Company In Noida | Drona InfotechDrona Infotech
Drona Infotech is a premier mobile app development company in Noida, providing cutting-edge solutions for businesses.
Visit Us For : https://www.dronainfotech.com/mobile-application-development/
3. • The world’s leading digital marketplace for takeaway food delivery
• Operate in 13 markets around the globe
• Platform peak ~ 2,500 orders per minute
JUST EAT
4. TECHNOLOGY
• Migrated to AWS (Amazon Web Services) 4 years ago
• Run hundreds of Instances at peak - daily scaling to match demand
• Heavily utilise CloudFormation
5. AWS - Setup
• Multiple AWS Accounts
• QA Daily Launch and Teardown
• On average an instance less than 3 days old
6. Before Consul…..
CONFIGURATION
• JSON file bundled with application package
• Deployment step to “Generate Config”
SETTINGS
• Feature settingsapi
• key/values stored in DynamoDB
8. Consul Setup
● Consul Cluster per environment
● JSON config stored in GitHub in templated format
● Generator run via TeamCity
● Config committed to “Generated Repository”
9.
10.
11. After Consul….
• Instance joins the Consul Cluster during Deployment
• Service registered on consul cluster
• Consul-Template generates config files
12. Benefits of Consul
• No need to cycle instances (seconds vs minutes)
• PR to Github to change and validate Config
• Consistent Config
• UI - Platform and Health Overview
13. Consul MetaData
• Recently launched a “Platform Consul Cluster”
• MetaData Generated using same mechanism as Features
• Powering other tools used in Just Eat
14. Finally…. Packer
BAKED AMI (Amazon Machine Image)
• All Dependencies Pre-installed
• CloudFormation reduced (removed 500 lines of json)
• Significantly reduced deployment time (Linux and Windows)
• AMI ID pushed to Consul - Config now stores “AMI Name”
26. How we deal with it
Consul for config
...and tfstate files
27. How we deal with it
On top of the base we put the rest
28. How we deal with it
On top of the base we put the rest
29. How we deal with it
On top of the base we put the rest
30. Here our tools...
● Terraform, the base
● Ansible for provisioning
● Capistrano for some deployments
● Consul for configs and tfstate
● Vagrant for local development
● Jenkins for orchestration
31. More HashiCorp to come for us...
● Packer for sharing artifacts and images
between providers
● Vault for secrets