Devops and Immutable infrastructure - Cloud Expo 2015 NYCJohn Willis
You often hear the two titles of "DevOps" and "Immutable Infrastructure" used independently.
In his session at DevOps Summit, John Willis, Technical Evangelist for Docker, will cover the union between the two topics and why this is important. He will cover an overview of Immutable Infrastructure then show how an Immutable Continuous Delivery pipeline can be applied as a best practice for "DevOps." He will end the session with some interesting case study examples.
This document summarizes serverless design patterns and tools. It begins with a brief history of cloud computing and an introduction to serverless computing. Common serverless use cases like event-driven applications and stream processing are described. Several serverless patterns are then outlined, such as hosting a static website or REST API using AWS Lambda and API Gateway. Finally, the document demonstrates a serverless application and discusses future directions for serverless technologies.
The document provides an overview of Amazon Web Services (AWS) storage options. It discusses Elastic Block Store (EBS) which provides block-level storage volumes for EC2 instances; instance store volumes which are temporary storage attached to an EC2 host; Amazon Simple Storage Service (S3) which provides scalable object storage; and Amazon Glacier which provides low-cost archival storage. For each service, it outlines their key features and characteristics as well as ideal and non-ideal usage patterns. The document concludes with a brief recap of the main differences between EBS, S3, and Glacier storage services.
This document summarizes a presentation on containerizing applications and deploying them to cloud platforms. It discusses Docker containers and containerization as a way to package applications. It then covers deploying .NET Core applications in Docker containers and pushing the images to cloud container registries on platforms like AWS ECS and Azure Container Instances. Finally, it demonstrates containerizing other applications built with technologies like Java Spring Boot, Python Flask, and JavaScript React.
What does Serverless mean for DevOps, in practical terms? While Serverless does reduce the need for server-centric DevOps, it poses new challenges in many areas including security, app deployment and cloud resource provisioning, partly due to an explosion of "nanoservices". Based on a current project using AWS, we cover relevant tools, techniques and tips to deliver a smooth serverless experience for development through to production.
Delivered at Bristol DevOps meetup, 27 Jun 2018. To see detailed notes covering extra points not on slides, click the Notes link just below (or download the Powerpoint).
Update: here's the correct link for Gojko Adzic talk on the Backendless slide - https://www.youtube.com/watch?v=w7X4gAQTk2E
Amazon Web Services (AWS) provides Elastic Load Balancing to automatically distribute incoming web traffic across multiple Amazon Elastic Compute Cloud (Amazon EC2) instances.
With Elastic Load Balancing, you can add and remove EC2 instances as your needs change without disrupting the overall flow of information. If one EC2 instance fails, Elastic Load Balancing automatically reroutes the traffic to the remaining running EC2 instances. If the failed EC2 instance is restored, Elastic Load Balancing restores the traffic to that instance.
Elastic Load Balancing offers clients a single point of contact, and it can also serve as the first line of defense against attacks on your network. You can offload the work of encryption and decryption to Elastic Load Balancing, so your servers can focus on their main task.
Building A Dynamic Website - 31st Jan 2015Jhalak Modi
Amazon Web Services offers cloud website hosting solutions that provides businesses, non-profits, and governmental organizations with a flexible, highly scalable, and low-cost way to deliver their websites and web applications. Our agenda is "How to deploy a dynamic website using Amazon Web Services". We will discuss some special services on amazon that is AWS Elastic Cloud Compute (EC2), Relational Database Service (RDS), Elastic Load Balancing (ELB), Route 53 (R53).
Devops and Immutable infrastructure - Cloud Expo 2015 NYCJohn Willis
You often hear the two titles of "DevOps" and "Immutable Infrastructure" used independently.
In his session at DevOps Summit, John Willis, Technical Evangelist for Docker, will cover the union between the two topics and why this is important. He will cover an overview of Immutable Infrastructure then show how an Immutable Continuous Delivery pipeline can be applied as a best practice for "DevOps." He will end the session with some interesting case study examples.
This document summarizes serverless design patterns and tools. It begins with a brief history of cloud computing and an introduction to serverless computing. Common serverless use cases like event-driven applications and stream processing are described. Several serverless patterns are then outlined, such as hosting a static website or REST API using AWS Lambda and API Gateway. Finally, the document demonstrates a serverless application and discusses future directions for serverless technologies.
The document provides an overview of Amazon Web Services (AWS) storage options. It discusses Elastic Block Store (EBS) which provides block-level storage volumes for EC2 instances; instance store volumes which are temporary storage attached to an EC2 host; Amazon Simple Storage Service (S3) which provides scalable object storage; and Amazon Glacier which provides low-cost archival storage. For each service, it outlines their key features and characteristics as well as ideal and non-ideal usage patterns. The document concludes with a brief recap of the main differences between EBS, S3, and Glacier storage services.
This document summarizes a presentation on containerizing applications and deploying them to cloud platforms. It discusses Docker containers and containerization as a way to package applications. It then covers deploying .NET Core applications in Docker containers and pushing the images to cloud container registries on platforms like AWS ECS and Azure Container Instances. Finally, it demonstrates containerizing other applications built with technologies like Java Spring Boot, Python Flask, and JavaScript React.
What does Serverless mean for DevOps, in practical terms? While Serverless does reduce the need for server-centric DevOps, it poses new challenges in many areas including security, app deployment and cloud resource provisioning, partly due to an explosion of "nanoservices". Based on a current project using AWS, we cover relevant tools, techniques and tips to deliver a smooth serverless experience for development through to production.
Delivered at Bristol DevOps meetup, 27 Jun 2018. To see detailed notes covering extra points not on slides, click the Notes link just below (or download the Powerpoint).
Update: here's the correct link for Gojko Adzic talk on the Backendless slide - https://www.youtube.com/watch?v=w7X4gAQTk2E
Amazon Web Services (AWS) provides Elastic Load Balancing to automatically distribute incoming web traffic across multiple Amazon Elastic Compute Cloud (Amazon EC2) instances.
With Elastic Load Balancing, you can add and remove EC2 instances as your needs change without disrupting the overall flow of information. If one EC2 instance fails, Elastic Load Balancing automatically reroutes the traffic to the remaining running EC2 instances. If the failed EC2 instance is restored, Elastic Load Balancing restores the traffic to that instance.
Elastic Load Balancing offers clients a single point of contact, and it can also serve as the first line of defense against attacks on your network. You can offload the work of encryption and decryption to Elastic Load Balancing, so your servers can focus on their main task.
Building A Dynamic Website - 31st Jan 2015Jhalak Modi
Amazon Web Services offers cloud website hosting solutions that provides businesses, non-profits, and governmental organizations with a flexible, highly scalable, and low-cost way to deliver their websites and web applications. Our agenda is "How to deploy a dynamic website using Amazon Web Services". We will discuss some special services on amazon that is AWS Elastic Cloud Compute (EC2), Relational Database Service (RDS), Elastic Load Balancing (ELB), Route 53 (R53).
WordCamp IL 2016 - WordPress Scale on AWSBoaz Ziniman
One of the most popular CMS, WordPress, was not designed for the cloud era. Running a high demand and highly available WordPress in a cluster can be a complex task.
There are several solutions to this problem and this session will focus on one of them. Using several AWS services (EC2, RDS, S3, EFS, CloudFormation and others) and Zend Server, we will create a complex setup running in minutes and scale it up and down by demand.
This document provides an overview of serverless computing and introduces serverless frameworks for ClojureScript including CLJS-Lambda and Serverless-Cljs. It defines serverless as exposing single functions that are run on shared servers and paid for only by execution time. Recommended resources on serverless architectures and the AWS serverless page are provided. The document discusses JVM options for ClojureScript lambdas and introduces lein plugins and templates for building, testing, and deploying serverless ClojureScript functions to AWS Lambda including commands for building, deploying, and invoking functions.
Blue Chip Tek AWS Connect and Protect Presentation #2Kimberly Macias
The document discusses account, VPC and subnet design for AWS infrastructure. It recommends starting with 1 AWS account, 1 VPC, and between 9-16 subnets, with 1 subnet per availability zone and 1 subnet group per connectivity requirement. This simple design focuses on security, flexibility and ease of administration while allowing for complexity to be added later if needed.
Sascha Möllering gave a presentation on deploying applications to the AWS cloud. He began with an overview of AWS services like EC2, S3, RDS and explained how to initially create a simple cloud service with one instance each for a web application and database. He then described how to improve the architecture by separating components, adding redundancy and elasticity using services like ELB, autoscaling and read replicas. Sascha demonstrated deploying a sample application built with JHipster and Docker to AWS Elastic Beanstalk, which handles running the containers and mapping environment variables for the database connection.
This document provides an overview of serverless computing using Azure Functions. It discusses the benefits of serverless such as increased server utilization, instant scaling, and reduced time to market. Serverless allows developers to focus on business logic rather than managing servers. Azure Functions is introduced as a way to develop serverless applications using triggers and bindings in languages like C#, Node.js, Python and more. Common serverless patterns are also presented.
This document summarizes an event-driven architecture presentation using Java. It discusses using Apache Kafka/Amazon Kinesis for messaging, Docker for containerization, Vert.x for reactive applications, Apache Camel/AWS Lambda for integration, and Google Protocol Buffers for data serialization. It covers infrastructure components, software frameworks, local and AWS deployment, and integration testing between Kinesis and Kafka. The presentation provides resources for code samples and Docker images discussed.
Serverless Application Model - Executing Lambdas LocallyAlex
This document discusses using the Serverless Application Model (SAM) to develop serverless applications locally. It describes how SAM templates allow defining Lambda functions and APIs that can then be run locally using the SAM CLI. This avoids needing an internet connection to test functions and allows using local tools like debuggers. Examples are provided for local development workflows involving APIs, Lambda functions, DynamoDB, and S3 event processing. Key links are also provided to learn more about SAM templates, the SAM CLI, and running DynamoDB locally.
Serverless architectures rely on third-party services and remote procedure calls rather than maintaining servers. Azure Functions is a serverless computing service that allows developers to write code without managing infrastructure. Functions can be triggered by events and connected to other Azure services through bindings. Functions scale automatically based on demand and only charge for execution time and resources used.
Jumpstarting Your Cloud Journey with OSS on Amazon LightsailAmazon Web Services
Interested in getting started in the cloud but unsure where to start? Already working in the cloud but feeling a bit overwhelmed? In this session we're going to take a look at how you can kickstart your cloud journey by leveraging open source blueprints on Amazon Lightsail. We will start with a quick overview of cloud computing and Amazon Lightsail, from there we'll look at how Lightsail supports a variety of open source applications and dev stacks. We'll deploy and scale a MEAN stack application and finish up showing how you can use custom blueprints to deploy whatever package you like. - a talk by Mike Coleman,
Developer Advocate, Amazon Web Services, at the Open Source Summit North America, August 2018.
Scaling on Amazon AWS : From the perspective of AWS, and the application stack. Talks about the available options on AWS, and also the architecture of the scalable application.
The document discusses various ways to deploy WordPress sites, including provisioning options like Digital Ocean docs, WordPress TV, and Roots/Trellis with Ansible. It also covers deployment categories like version control, hosted options like WP Engine and Pantheon, WordPress plugins for deployment like Revisr and Versionpress, services like AWS CodeDeploy and DeployBot, and command line tools like Git, Capistrano, Ansible, and Docker. Specific examples are provided for deploying with WP Engine, Revisr, VersionPress, DeployBot, Capistrano, and Ansible. Database deployment options mentioned include WP Migrate DB Pro, WP CLI, and VersionPress.
MJ Berends talk - Women & Non-Binary Focused Intro to AWSAWS Chicago
"how to develop for aws on your local machine using localstack / moto" - MJ Berends, Data Apps Team Lead at Jellyvision // @apprxlinear (https://twitter.com/apprxlinear)
This summary outlines key information from the PRSSA general meeting:
- PRSSA is the student branch of the Public Relations Society of America (PRSA) and aims to provide members professional development opportunities and prepare them for careers in public relations.
- The meeting provided an overview of PRSSA's structure and missions, opportunities for travel, conferences, and affiliating with the PRSA. Members were encouraged to get involved in activities like the Bateman competition.
- A guest speaker discussed Michigan State University's bid for a new rare isotope research facility and how students could help with public outreach.
WordCamp IL 2016 - WordPress Scale on AWSBoaz Ziniman
One of the most popular CMS, WordPress, was not designed for the cloud era. Running a high demand and highly available WordPress in a cluster can be a complex task.
There are several solutions to this problem and this session will focus on one of them. Using several AWS services (EC2, RDS, S3, EFS, CloudFormation and others) and Zend Server, we will create a complex setup running in minutes and scale it up and down by demand.
This document provides an overview of serverless computing and introduces serverless frameworks for ClojureScript including CLJS-Lambda and Serverless-Cljs. It defines serverless as exposing single functions that are run on shared servers and paid for only by execution time. Recommended resources on serverless architectures and the AWS serverless page are provided. The document discusses JVM options for ClojureScript lambdas and introduces lein plugins and templates for building, testing, and deploying serverless ClojureScript functions to AWS Lambda including commands for building, deploying, and invoking functions.
Blue Chip Tek AWS Connect and Protect Presentation #2Kimberly Macias
The document discusses account, VPC and subnet design for AWS infrastructure. It recommends starting with 1 AWS account, 1 VPC, and between 9-16 subnets, with 1 subnet per availability zone and 1 subnet group per connectivity requirement. This simple design focuses on security, flexibility and ease of administration while allowing for complexity to be added later if needed.
Sascha Möllering gave a presentation on deploying applications to the AWS cloud. He began with an overview of AWS services like EC2, S3, RDS and explained how to initially create a simple cloud service with one instance each for a web application and database. He then described how to improve the architecture by separating components, adding redundancy and elasticity using services like ELB, autoscaling and read replicas. Sascha demonstrated deploying a sample application built with JHipster and Docker to AWS Elastic Beanstalk, which handles running the containers and mapping environment variables for the database connection.
This document provides an overview of serverless computing using Azure Functions. It discusses the benefits of serverless such as increased server utilization, instant scaling, and reduced time to market. Serverless allows developers to focus on business logic rather than managing servers. Azure Functions is introduced as a way to develop serverless applications using triggers and bindings in languages like C#, Node.js, Python and more. Common serverless patterns are also presented.
This document summarizes an event-driven architecture presentation using Java. It discusses using Apache Kafka/Amazon Kinesis for messaging, Docker for containerization, Vert.x for reactive applications, Apache Camel/AWS Lambda for integration, and Google Protocol Buffers for data serialization. It covers infrastructure components, software frameworks, local and AWS deployment, and integration testing between Kinesis and Kafka. The presentation provides resources for code samples and Docker images discussed.
Serverless Application Model - Executing Lambdas LocallyAlex
This document discusses using the Serverless Application Model (SAM) to develop serverless applications locally. It describes how SAM templates allow defining Lambda functions and APIs that can then be run locally using the SAM CLI. This avoids needing an internet connection to test functions and allows using local tools like debuggers. Examples are provided for local development workflows involving APIs, Lambda functions, DynamoDB, and S3 event processing. Key links are also provided to learn more about SAM templates, the SAM CLI, and running DynamoDB locally.
Serverless architectures rely on third-party services and remote procedure calls rather than maintaining servers. Azure Functions is a serverless computing service that allows developers to write code without managing infrastructure. Functions can be triggered by events and connected to other Azure services through bindings. Functions scale automatically based on demand and only charge for execution time and resources used.
Jumpstarting Your Cloud Journey with OSS on Amazon LightsailAmazon Web Services
Interested in getting started in the cloud but unsure where to start? Already working in the cloud but feeling a bit overwhelmed? In this session we're going to take a look at how you can kickstart your cloud journey by leveraging open source blueprints on Amazon Lightsail. We will start with a quick overview of cloud computing and Amazon Lightsail, from there we'll look at how Lightsail supports a variety of open source applications and dev stacks. We'll deploy and scale a MEAN stack application and finish up showing how you can use custom blueprints to deploy whatever package you like. - a talk by Mike Coleman,
Developer Advocate, Amazon Web Services, at the Open Source Summit North America, August 2018.
Scaling on Amazon AWS : From the perspective of AWS, and the application stack. Talks about the available options on AWS, and also the architecture of the scalable application.
The document discusses various ways to deploy WordPress sites, including provisioning options like Digital Ocean docs, WordPress TV, and Roots/Trellis with Ansible. It also covers deployment categories like version control, hosted options like WP Engine and Pantheon, WordPress plugins for deployment like Revisr and Versionpress, services like AWS CodeDeploy and DeployBot, and command line tools like Git, Capistrano, Ansible, and Docker. Specific examples are provided for deploying with WP Engine, Revisr, VersionPress, DeployBot, Capistrano, and Ansible. Database deployment options mentioned include WP Migrate DB Pro, WP CLI, and VersionPress.
MJ Berends talk - Women & Non-Binary Focused Intro to AWSAWS Chicago
"how to develop for aws on your local machine using localstack / moto" - MJ Berends, Data Apps Team Lead at Jellyvision // @apprxlinear (https://twitter.com/apprxlinear)
This summary outlines key information from the PRSSA general meeting:
- PRSSA is the student branch of the Public Relations Society of America (PRSA) and aims to provide members professional development opportunities and prepare them for careers in public relations.
- The meeting provided an overview of PRSSA's structure and missions, opportunities for travel, conferences, and affiliating with the PRSA. Members were encouraged to get involved in activities like the Bateman competition.
- A guest speaker discussed Michigan State University's bid for a new rare isotope research facility and how students could help with public outreach.
The MSU PRSSA general meeting announcement provided information on:
1) Congratulating Melissa Hackett as Member of the Month for her work on projects and being selected for the 2009 Bateman Team.
2) A reminder of deadlines for the chapter publication and for volunteering on PR campaigns.
3) Upcoming events from the Residence Halls Association and for promoting a Detroit artist that students could volunteer for.
4) Speakers at the meeting, PRSA professional development opportunities, and congratulating the 2009 Bateman Team members.
The document summarizes the agenda and announcements for a PRSSA general meeting. It thanks volunteers, announces internship and career opportunities, upcoming events including a holiday fundraising project and panel, welcomes new members and says goodbye to a departing member, and outlines the schedule for upcoming general meetings and conferences for 2009.
The document discusses various topics including famous terrorists, crime novels, movies, sports teams, dances, names, vehicles, animals, cities, and online services. It provides clues about each topic and asks the reader to identify the answer for each numbered item.
1) The MSU PRSSA chapter meeting announcement summarized upcoming speakers, events, and opportunities for students.
2) Key events included a launch party for Hubbell Connections, a bone marrow registration drive, and FRIB Frenzy day promoting a new facility on campus.
3) Students were also reminded of application deadlines for Bateman team interviews and PR internships with Martin Waymire and the Edelman public relations firm.
A Shallow Survey of Alternative Languages on the JVMCharles Anderson
This document surveys alternative languages that run on the Java Virtual Machine (JVM), including ported languages like JRuby and new languages like Groovy and Scala. It discusses why developers use these languages, noting they provide access to powerful Java platforms and libraries while allowing programming in more modern languages. Issues like performance and compatibility challenges are also outlined. Examples of code in several languages are provided.
How To Protect Yourself and Your Computer OnlineCharles Anderson
This document provides basic steps to protect yourself and your computer online from malware and fraud. It recommends keeping your operating system and software updated, using antivirus and firewall protection, and being wary of suspicious emails requesting personal information. Phishing scams try to steal information like bank accounts through fraudulent emails or websites, so the document advises to never enter details from an email link and to be suspicious of messages promising things that sound too good to be true. Taking precautions like keeping software updated and avoiding providing information from untrusted sources can help safeguard against online risks.
The document summarizes the November 18, 2008 general meeting of the MSU PRSSA chapter. It provides information on membership opportunities for graduating students, internship and job opportunities, upcoming events like PR Links and volunteer dates, and applications for Hubbell Connections client work. The next general meeting is announced for December 2nd.
The summary provides information about upcoming events for MSU PRSSA including a bone marrow registration drive, volunteering for Make A Difference Day, a workshop on self-branding, and picking up free t-shirts to promote FRIB Frenzy Day. It also recognizes the September Member of the Month and provides details on media internship and career opportunities with radio and advertising companies.
Using apache camel for microservices and integration then deploying and managing on Docker and Kubernetes. When we need to make changes to our app, we can use Fabric8 continuous delivery built on top of Kubernetes and OpenShift.
The document discusses infrastructure as code (IAC) and its principles and categories. Some key points:
- IAC treats infrastructure like code by writing code to define, deploy, and update infrastructure. This allows infrastructure to be managed programmatically.
- Common categories of IAC include ad hoc scripts, configuration management tools like Ansible and Puppet, server templating tools like Packer, and server provisioning tools like Terraform.
- Benefits of IAC include automation, consistency, repeatability, versioning, validation, reuse, and allowing engineers to focus on code instead of manual tasks.
- AWS offers CloudFormation for provisioning AWS resources through templates. Other tools integrate with Cloud
Azure Templates for Consistent DeploymentJosé Maia
Presented at NetPonto Porto 09/September/2017, by José Maia, at Farfetch.
A talk about how to use Azure Resource Manager to follow good DevOps practices.
Eric Holmes from Remind discussed building an internal Platform as a Service (PaaS) called Empire using Docker and Amazon EC2 Container Service (ECS). Remind started on Heroku but encountered issues with scaling and visibility. Empire provides a management layer on top of ECS for deploying and scaling microservices. It implements a subset of the Heroku API and provides a single binary and CLI. Empire is running 15 of Remind's production services on ECS with improved performance over Heroku. A demo was shown of deploying a sample app with Empire.
Yow Conference Dec 2013 Netflix Workshop Slides with NotesAdrian Cockcroft
This document provides an overview and agenda for a workshop on patterns for continuous delivery, high availability, DevOps and cloud native development using NetflixOSS open source tools and frameworks. The presenter introduces himself and his background. The content covers Netflix's architecture evolution from monolithic to microservices, how Netflix scales on AWS, and principles and outcomes that enable cloud native development. The workshop then dives into specific NetflixOSS projects like Eureka, Cassandra, Zuul and Hystrix that help with service discovery, data storage, routing and availability. Tools for deployment, configuration, cost analysis and developer productivity are also discussed.
The document introduces Microsoft's Windows Azure cloud platform. It summarizes that Windows Azure provides an operating system for the cloud that abstracts away hardware and provides services for automated management, scalable computing and storage. It allows developers to build applications and services that can easily scale across large, connected data centers. The talk demonstrates how Windows Azure allows building complex service architectures from simple components like web and worker roles that interact through a durable storage system. It emphasizes that the platform aims to provide a familiar development experience while handling all the complexities of highly scalable cloud services.
The document discusses Amazon's contributions to and involvement with open source software. It notes that Amazon contributes code to projects like Apache TinkerPop and Neptune and that Amazon engineers are active members of open source communities. It also lists many open source projects that Amazon supports and develops tools for, covering areas like databases, analytics, machine learning, and developer tools. Amazon takes an open source first approach and believes that customer feedback should drive their roadmap and contributions to open source.
Immutable Infrastructure: the new App DeploymentAxel Fontaine
Immutable Infrastructure: the new App Deployment
App deployment and server setup are complex, error-prone and time-consuming. They require OS installers, package managers, configuration recipes, install and deployment scripts, server tuning, hardening and more. But... Is this really necessary? Are we trapped in a mindset of doing things this way just because that's how they've always done?
What if we could start over and radically simplify all this? What if, within seconds, and with a single command, we could wrap our application into the bare minimal machine required to run it? What if this machine could then be transported and run unchanged on our laptop and in the cloud? How do the various platforms and tools like AWS, Docker, Heroku and Boxfuse fit into this picture? What are their strengths and weaknesses? When should you use them?
This talk is for developers and architects wishing to radically improve and simplify how they deploy their applications. It takes Continuous Delivery to a level far beyond what you've seen today. Welcome to Immutable Infrastructure generation. This is the new black.
Eric Holmes from Remind discusses building an internal Platform as a Service (PaaS) called Empire using Docker and AWS ECS. Remind started as a monolith but broke services apart due to scaling issues. They previously used Heroku but wanted more control. Empire provides a CLI and API for deploying Docker containers to ECS, replacing their use of CoreOS and etcd. Empire provides operational simplicity while allowing Remind to maintain deployment patterns and focus on building products. Empire is now in production at Remind, improving performance over directly using EC2.
The challenge of application distribution - Introduction to Docker (2014 dec ...Sébastien Portebois
Live recording with the demos: https://www.youtube.com/watch?v=0XRcmJEiZOM
Contents
- The application distribution challenge
- The current solutions
- Introduction to Docker, Containers, and the Matrix from Hell
- Why people care: Separation of Concerns
- Technical Discussion
- Ecosystem, momentum
- How to build Docker images
- How to make containers talk to each other, how to handle data persistence
- Demo 1: isolation
- Demo 2: real case - installing Go Math! Academy, tail –f containers, unit tests
This document provides an overview of migrating applications and workloads to AWS. It discusses key considerations for different migration approaches including "forklift", "embrace", and "optimize". It also covers important AWS services and best practices for architecture design, high availability, disaster recovery, security, storage, databases, auto-scaling, and cost optimization. Real-world customer examples of migration lessons and benefits are also presented.
The document discusses migrating a fast scaling system from physical servers to AWS. It outlines the agenda which includes an overview of physical systems and virtualization, the Topica Edumall system design, applying DevOps practices, and a Q&A. The Topica Edumall hybrid system is described as using VPS, physical servers, and AWS for core video streaming. Benefits of migrating the auto-scaling system to Docker and Kubernetes on AWS include high availability, easy scaling, auto-healing, and saving 40% costs with full utilization of AWS services. DevOps practices like CI/CD workflows are also discussed.
The document discusses DevOps workflow with Docker on AWS. It describes using Docker to isolate application environments, increasing team productivity and decreasing development team size. Key elements include using Gitlab for source control and CI/CD, building Docker images via Gitlab runners, and deploying to Kubernetes clusters. The workflow allows writing applications once and running them anywhere and forever through continuous integration and delivery of Docker images to private container registries on AWS.
Cost is often the conversation starter when customers think about moving to the cloud. AWS helps lower costs for customers through its “pay only for what you use” pricing model, frequent price drops, and pricing model choice to support variable & stable workloads. In this session, you will learn about the financial considerations of owning and operating a traditional data center or managed hosting provider versus utilizing AWS. We will detail our TCO methodology and showcase cost comparisons for some common customer use-cases. We’ll also cover a few AWS cost optimization areas, including Spot and Reserved Instances, EC2 Auto Scaling, and consolidated billing.
Presenter:
Amit Sharma, Solution Architect, Amazon Internet Services
Krishnenjit Roy, Director IT Operations, Freshdesk
This document discusses cloud computing and Microsoft's Windows Azure platform. It defines cloud computing concepts like infrastructure as a service (IaaS), platform as a service (PaaS), and software as a service (SaaS). It outlines the key components of Windows Azure including the Azure Fabric for running applications, Azure Storage for databases, and the Azure SDK. It also covers how to develop, deploy, and scale applications on the Azure platform using web and worker roles.
The lightning talks covered various Netflix OSS projects including S3mper, PigPen, STAASH, Dynomite, Aegisthus, Suro, Zeno, Lipstick on GCE, AnsWerS, and IBM. 41 projects were discussed and the need for a cohesive Netflix OSS platform was highlighted. Matt Bookman then gave a presentation on running Lipstick and Hadoop on Google Cloud Platform using Google Compute Engine and Cloud Storage. He demonstrated running Pig jobs on Compute Engine and discussed design considerations for cloud-based Hadoop deployments. Finally, Peter Sankauskas from @Answers4AWS discussed initial ideas around CloudFormation for Asgard and deploying various Netflix OSS
We often employ the "build-once-run-everywhere" principle to our application binaries. Our build server builds an artifact and puts it in a repository, this same artifact is then promoted from environment to environment, from test to production, to make sure that what ends up in production is the very same thing as what we have thoroughly tested before.
Now, in a world of virtualization, what if we were to do the same thing with our complete infrastructure? In stead of just building our application and promote it from environment to environment, what if we would build a complete virtual machine image and do the same with that? Could we?
This is what immutable infrastructure is about. Boxfuse can help you get there.
Modern PHP has grown significantly over the last 15-20 years and is now suitable for large projects. It supports object oriented programming with classes, interfaces, abstract classes and traits. Types can be hinted and nullable. Large applications can be built with namespaces and dependency management via Composer. Testing, linting and exceptions are also supported. While still allowing procedural code, PHP provides features for building maintainable, scalable software.
This talk describes how to get involved in open-source as a way to break the Catch-22 of "to get a job you need experience. to get experience you need a job." Presented at the WOU Computer Science club in January 2015.
Redis is a networked data structure server that provides fast, simple access to various data types like Strings, Lists, Sets, Sorted Sets and Hashes. It uses an abstract data type interface where operations take a key as the first parameter and match the type of object stored. For example, list operations like LPUSH take a key and value, and the LRANGE operation takes a key and range to return elements in a list. Redis supports multiple programming language clients and can be used for tasks like leader boards, shopping carts and user profiles.
Jython is a Python interpreter implemented in Java. It allows Python code to integrate with Java by compiling Python code to Java bytecodes, making all Java classes immediately available to Python code. This allows Python to call Java code and Java to call Python, enabling flexible scripting of Java applications and experimentation in an interactive Java environment.
This document introduces Groovy, a scripting language for Java. It discusses how Groovy compiles to Java bytecode and can be used with existing Java tools and libraries. Examples show how Groovy simplifies common tasks like iteration, exception handling, and building XML/HTML. The document also briefly introduces Grails, a web framework that uses Groovy's conventions to accelerate development.
"What does it really mean for your system to be available, or how to define w...Fwdays
We will talk about system monitoring from a few different angles. We will start by covering the basics, then discuss SLOs, how to define them, and why understanding the business well is crucial for success in this exercise.
"$10 thousand per minute of downtime: architecture, queues, streaming and fin...Fwdays
Direct losses from downtime in 1 minute = $5-$10 thousand dollars. Reputation is priceless.
As part of the talk, we will consider the architectural strategies necessary for the development of highly loaded fintech solutions. We will focus on using queues and streaming to efficiently work and manage large amounts of data in real-time and to minimize latency.
We will focus special attention on the architectural patterns used in the design of the fintech system, microservices and event-driven architecture, which ensure scalability, fault tolerance, and consistency of the entire system.
From Natural Language to Structured Solr Queries using LLMsSease
This talk draws on experimentation to enable AI applications with Solr. One important use case is to use AI for better accessibility and discoverability of the data: while User eXperience techniques, lexical search improvements, and data harmonization can take organizations to a good level of accessibility, a structural (or “cognitive” gap) remains between the data user needs and the data producer constraints.
That is where AI – and most importantly, Natural Language Processing and Large Language Model techniques – could make a difference. This natural language, conversational engine could facilitate access and usage of the data leveraging the semantics of any data source.
The objective of the presentation is to propose a technical approach and a way forward to achieve this goal.
The key concept is to enable users to express their search queries in natural language, which the LLM then enriches, interprets, and translates into structured queries based on the Solr index’s metadata.
This approach leverages the LLM’s ability to understand the nuances of natural language and the structure of documents within Apache Solr.
The LLM acts as an intermediary agent, offering a transparent experience to users automatically and potentially uncovering relevant documents that conventional search methods might overlook. The presentation will include the results of this experimental work, lessons learned, best practices, and the scope of future work that should improve the approach and make it production-ready.
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...Jason Yip
The typical problem in product engineering is not bad strategy, so much as “no strategy”. This leads to confusion, lack of motivation, and incoherent action. The next time you look for a strategy and find an empty space, instead of waiting for it to be filled, I will show you how to fill it in yourself. If you’re wrong, it forces a correction. If you’re right, it helps create focus. I’ll share how I’ve approached this in the past, both what works and lessons for what didn’t work so well.
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor IvaniukFwdays
At this talk we will discuss DDoS protection tools and best practices, discuss network architectures and what AWS has to offer. Also, we will look into one of the largest DDoS attacks on Ukrainian infrastructure that happened in February 2022. We'll see, what techniques helped to keep the web resources available for Ukrainians and how AWS improved DDoS protection for all customers based on Ukraine experience
ScyllaDB is making a major architecture shift. We’re moving from vNode replication to tablets – fragments of tables that are distributed independently, enabling dynamic data distribution and extreme elasticity. In this keynote, ScyllaDB co-founder and CTO Avi Kivity explains the reason for this shift, provides a look at the implementation and roadmap, and shares how this shift benefits ScyllaDB users.
What is an RPA CoE? Session 2 – CoE RolesDianaGray10
In this session, we will review the players involved in the CoE and how each role impacts opportunities.
Topics covered:
• What roles are essential?
• What place in the automation journey does each role play?
Speaker:
Chris Bolin, Senior Intelligent Automation Architect Anika Systems
AppSec PNW: Android and iOS Application Security with MobSFAjin Abraham
Mobile Security Framework - MobSF is a free and open source automated mobile application security testing environment designed to help security engineers, researchers, developers, and penetration testers to identify security vulnerabilities, malicious behaviours and privacy concerns in mobile applications using static and dynamic analysis. It supports all the popular mobile application binaries and source code formats built for Android and iOS devices. In addition to automated security assessment, it also offers an interactive testing environment to build and execute scenario based test/fuzz cases against the application.
This talk covers:
Using MobSF for static analysis of mobile applications.
Interactive dynamic security assessment of Android and iOS applications.
Solving Mobile app CTF challenges.
Reverse engineering and runtime analysis of Mobile malware.
How to shift left and integrate MobSF/mobsfscan SAST and DAST in your build pipeline.
Getting the Most Out of ScyllaDB Monitoring: ShareChat's TipsScyllaDB
ScyllaDB monitoring provides a lot of useful information. But sometimes it’s not easy to find the root of the problem if something is wrong or even estimate the remaining capacity by the load on the cluster. This talk shares our team's practical tips on: 1) How to find the root of the problem by metrics if ScyllaDB is slow 2) How to interpret the load and plan capacity for the future 3) Compaction strategies and how to choose the right one 4) Important metrics which aren’t available in the default monitoring setup.
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
Keywords: AI, Containeres, Kubernetes, Cloud Native
Event Link: https://meine.doag.org/events/cloudland/2024/agenda/#agendaId.4211
Discover the Unseen: Tailored Recommendation of Unwatched ContentScyllaDB
The session shares how JioCinema approaches ""watch discounting."" This capability ensures that if a user watched a certain amount of a show/movie, the platform no longer recommends that particular content to the user. Flawless operation of this feature promotes the discover of new content, improving the overall user experience.
JioCinema is an Indian over-the-top media streaming service owned by Viacom18.
Must Know Postgres Extension for DBA and Developer during MigrationMydbops
Mydbops Opensource Database Meetup 16
Topic: Must-Know PostgreSQL Extensions for Developers and DBAs During Migration
Speaker: Deepak Mahto, Founder of DataCloudGaze Consulting
Date & Time: 8th June | 10 AM - 1 PM IST
Venue: Bangalore International Centre, Bangalore
Abstract: Discover how PostgreSQL extensions can be your secret weapon! This talk explores how key extensions enhance database capabilities and streamline the migration process for users moving from other relational databases like Oracle.
Key Takeaways:
* Learn about crucial extensions like oracle_fdw, pgtt, and pg_audit that ease migration complexities.
* Gain valuable strategies for implementing these extensions in PostgreSQL to achieve license freedom.
* Discover how these key extensions can empower both developers and DBAs during the migration process.
* Don't miss this chance to gain practical knowledge from an industry expert and stay updated on the latest open-source database trends.
Mydbops Managed Services specializes in taking the pain out of database management while optimizing performance. Since 2015, we have been providing top-notch support and assistance for the top three open-source databases: MySQL, MongoDB, and PostgreSQL.
Our team offers a wide range of services, including assistance, support, consulting, 24/7 operations, and expertise in all relevant technologies. We help organizations improve their database's performance, scalability, efficiency, and availability.
Contact us: info@mydbops.com
Visit: https://www.mydbops.com/
Follow us on LinkedIn: https://in.linkedin.com/company/mydbops
For more details and updates, please follow up the below links.
Meetup Page : https://www.meetup.com/mydbops-databa...
Twitter: https://twitter.com/mydbopsofficial
Blogs: https://www.mydbops.com/blog/
Facebook(Meta): https://www.facebook.com/mydbops/
"Scaling RAG Applications to serve millions of users", Kevin GoedeckeFwdays
How we managed to grow and scale a RAG application from zero to thousands of users in 7 months. Lessons from technical challenges around managing high load for LLMs, RAGs and Vector databases.
inQuba Webinar Mastering Customer Journey Management with Dr Graham HillLizaNolte
HERE IS YOUR WEBINAR CONTENT! 'Mastering Customer Journey Management with Dr. Graham Hill'. We hope you find the webinar recording both insightful and enjoyable.
In this webinar, we explored essential aspects of Customer Journey Management and personalization. Here’s a summary of the key insights and topics discussed:
Key Takeaways:
Understanding the Customer Journey: Dr. Hill emphasized the importance of mapping and understanding the complete customer journey to identify touchpoints and opportunities for improvement.
Personalization Strategies: We discussed how to leverage data and insights to create personalized experiences that resonate with customers.
Technology Integration: Insights were shared on how inQuba’s advanced technology can streamline customer interactions and drive operational efficiency.
In the realm of cybersecurity, offensive security practices act as a critical shield. By simulating real-world attacks in a controlled environment, these techniques expose vulnerabilities before malicious actors can exploit them. This proactive approach allows manufacturers to identify and fix weaknesses, significantly enhancing system security.
This presentation delves into the development of a system designed to mimic Galileo's Open Service signal using software-defined radio (SDR) technology. We'll begin with a foundational overview of both Global Navigation Satellite Systems (GNSS) and the intricacies of digital signal processing.
The presentation culminates in a live demonstration. We'll showcase the manipulation of Galileo's Open Service pilot signal, simulating an attack on various software and hardware systems. This practical demonstration serves to highlight the potential consequences of unaddressed vulnerabilities, emphasizing the importance of offensive security practices in safeguarding critical infrastructure.
5. In the Beginning
• We had racks of servers, and
disks, and switches
• And lots and lots of cables
• And, we liked it!
• Sometimes known as the Iron
Age
7. Also sprach Zarathustra
• Jeff Bezos gave us Amazon
Elastic Compute Cloud (EC2)
• Configure a server machine
from a simple web-app, pay
by the hour
• Awesome - no need to dirty
our hands with hardware
9. Problems in Paradise
• Scaling - provisioning servers manually from a web
app doesn’t scale
• Inconsistency - as machines get configured
manually (by different people) they diverge
• behavior differences
• security vulnerabilities - compliance nightmare
• These are called “snowflakes” - bad
10. Problems: Fragility
• You’re never really confident about snowflakes
which means you’re afraid to change/update them
• Even if you are confident, probably too lazy -
(re)building machines manually is time consuming
11. Pets vs. Livestock
• Snowflakes are like pets
• You become attached
• Cute names
• Long-lived
• You want livestock
• Generic machines that
come and go
12. Appetite
• Add/remove nodes quickly
• Have identical nodes within the same role
• Achieve freedom to kill and rebuild at will - Phoenix
machines
• Also - similarity between production, test and
staging environments
• Bonus if you can make dev similar to production
13.
14. Results
• Consistent, scalable application and infrastructure
• Up-to-date, well-patched infrastructure
• Immutable infrastructure - c.f. immutable types
• Agile: make changes and rollback quickly
• Ability to experiment - spin up and kill machines
15. How?
• We want an API for the Cloud so we can write
“programs” to create our infrastructure
• “Amazon” is actually Amazon Web Services (AWS)
16. Infrastructure as Code
• If we write scripts/programs:
• Use version control
• Have documentation
• Can audit and/or test
• Automate and meta-automate
17. Not Just Amazon
• Although we’re talking about Amazon, there are lots
of other public cloud providers and private/on-
premises options with APIs
• Google, RackSpace, OpenStack
• Aside: (Certified) Amazon Architect is a thing
• My view is Linux-centric - Azure also has an API
• Platform as a Service (PaaS) is another option
18. Automating Amazon
• You can roll your own - there are plenty of API
libraries for AWS in various languages
• AWS CLI - command line
• AWS Cloud Formation tool - JSON
• AWS Elastic Beanstalk
• All free, as in beer but not speech
19. HashiCorp
• HashiCorp is company that makes open-source tools
for infrastructure automation
• started when Hashimoto was a student
• Packer builds images (OS + app) to deploy on nodes
- called AMIs on Amazon
• Terraform builds infrastructure - nodes, private
networks, identities, storage, DBs, etc.
• Consul - service discovery
20. IaC in the Small
• HashiCorp has two tools for building virtual
environments on your own computer
• Vagrant - provisions and starts one or more VMs for
your development environment
• Also useful to test image builds locally
• Otto - successor to Vagrant that can build
production infrastructure, too (via Terraform)
21. Free Beer!
• You can do all of this for free (at a small scale)
• Amazon, Google, others
• No longer restricted to big companies - democratizing
• All of these tools are free - tons for free docs
• HashiCorp tools are OSS - chance to contribute
22. Conclusion
• Infrastructure as Code is an evolution from the Iron
Age to the Cloud Age
• Allows rapid changes in size or function of
infrastructure
• Facilitates rapid business development - $$$
• You can get started for free