This document summarizes Droplr's evolution to a serverless cloud architecture on AWS over the past year. Some key points:
- Droplr moved from multiple programming languages and microservices to primarily using Node.js and monolith architecture.
- Monitoring was optimized using services like Pingdom, DataDog, Logz.io and Sentry.
- AWS Lambda was adopted for its cost effectiveness, scalability and reliability. It allowed Droplr to reduce costs by 60% and deploy updates in minutes.
- The current architecture uses Lambda with VPC, CloudFront, API Gateway, SNS and CloudWatch Events. Serverless improved performance and reduced response times.
Presentation shows how at Droplr we consider the DevOps role.
It covers topics related with Amazon Web Services, Infrastructure as Code concept (with tools like Terraform and Ansible) and going into Continuous Deployment as the key of making our company the most competitive on the market.
Presentation from the 8th Wrocław's DevOps Meeting which took place on 28.03.2017.
Future of Cloud Starts with ServerlessAntoni Orfin
Presentation shows how current Cloud looks like and how it will evolve with serverless technologies such as AWS Lambda, API Gateway and CloudFront.
Do we need servers?
Do we need regions?
No.
Presentation shows how at Droplr we consider the DevOps role.
It covers topics related with Amazon Web Services, Infrastructure as Code concept (with tools like Terraform and Ansible) and going into Continuous Deployment as the key of making our company the most competitive on the market.
Presentation from the 8th Wrocław's DevOps Meeting which took place on 28.03.2017.
Future of Cloud Starts with ServerlessAntoni Orfin
Presentation shows how current Cloud looks like and how it will evolve with serverless technologies such as AWS Lambda, API Gateway and CloudFront.
Do we need servers?
Do we need regions?
No.
Real World AWS Deployment With Boto, Fabric, and Cloud FormationDixon Whitmire
A real world use case of spinning up EC2 instances using a Python based frameworks (Fabric and Boto) and Cloud Formation. Source code is available on https://github.com/dixonwh/aws-provisioning
Kubernetes and AWS Lambda can play nicely togetherEdward Wilde
Vendor lock-in can be a worry for many engineers . A new innovative approach, will for the first time, allow open-source serverless to run on AWS Lambda or Kubernetes using the same deployment artefact, packaged using the tools we love: containers.
OpenFaaS is an open-source function as a service (FaaS) platform on the [CNCF serverless landscape](https://landscape.cncf.io/format=serverless).
With OpenFaaS you can package anything as a serverless function and deploy to Kubernetes using containers. Due to UNIX-like primitives in the core architecture, it was possible to extend the system to run functions on both Kubernetes and AWS Lambda depending on user preference. The core components of OpenFaaS still run on Kubernetes but the functions are deployed and invoked on AWS Lambda
Александр Снеговой, DevOps Software Engineer в DataArt Kherson. Более шести лет в IT. Сертифицированный AWS Solutions Architect Associate. Докладчик на международных научных конференциях. Религиозный фанат Docker.
Презентация:
1. Докеризация приложения.
2. Настройка CI/CD.
3. Развертывание инфраструктуры в AWS с помощью Terraform.
This will be a more advanced scenario related session during which we'll talk about API Gateway authentication use cases, Amazon Kinesis Streams, Amazon Cognito and AWS CloudFormation.
AWS to Bare Metal: Motivation, Pitfalls, and ResultsMongoDB
Like many startups, Wish grew up on AWS. As our cluster grew and the price of SSDs fell, we started exploring bare metal. Fast-forward 2 years and we have hundreds of MongoDB instances on bare metal fully integrated with our AWS infrastructure. It wasn't all smooth sailing, but the performance & cost improvements were worth it! Hear the story of how we did it and gain a framework for thinking about how to make the leap from cloud-centric architecture to a hybrid model.
WinOps Conference London 2017 session
Public Cloud IaaS vs traditional on prem and how Hashicorp Terraform is a great tool to configure Azure. Recorded here: https://www.youtube.com/watch?v=LDZXRBBuXCU
Using HashiCorp’s Terraform to build your infrastructure on AWS - Pop-up Loft...Amazon Web Services
Using Terraform to automate your infrastructure on AWS. What is Terraform and how is it different from Ansible. How to control cloud deployments using Terraform.
Mit Docker ist es einfach geworden, Applikationen lokal zu starten, ohne zusätzliche Abhängigkeiten installieren zu müssen. Einen Cluster auf seinem eigenen Rechner laufen zu lassen ist kein großes Ding mehr. Mit ECS bietet AWS einen Container-Management-Service für die Cloud an, der verspricht, Container entsprechend ihrem Ressourcenbedarf und Verfügbarkeitserfordernissen automatisch im Cluster zu platzieren.
Aber was passiert dazwischen? Und ist es wirklich so einfach?
In diesem Talk werden wir betrachten, welche existierenden Services von AWS verwendet werden können, um Container automatisch zu deployen, und was zusätzlich alles benötigt wird, um sie im Betrieb laufen zu lassen.
Alex Casalboni and Austen Collins discuss the evolution of Serverless. Learn about the exciting new trend that's redefining the cloud computing industry in this in-depth webinar designed to teach you the basics of serverless computing and design.
AWS Core services:
* The AWS web console: the entry point for configuring your infrastructure in the AWS cloud
* The Free Tier and how to setup billing alerts
* Elastic Compute Cloud (EC2) instances, and the ease with which you can pick a particular Amazon Machine Image (AMI) for your workload, and spin it up as an instance right away
* How to create and deploy a high-availability web application in AWS, with an Elastic Load Balancer (ELB) and a multi-availability-zone Relational-Database-Service (RDS) instance
* How CloudFormation can automate all of the above.
Serverless Functions:
Serverless architecture allows developers to focus on code and their business problem rather than spending time looking after backend infrastructure. Serverless architecture can help developers build scalable, high-performing, and cost-effective applications quickly
We will talk about how serverless architecture and AWS Lambda can make things easier, cheaper, and help to accelerate development of projects.
Real World AWS Deployment With Boto, Fabric, and Cloud FormationDixon Whitmire
A real world use case of spinning up EC2 instances using a Python based frameworks (Fabric and Boto) and Cloud Formation. Source code is available on https://github.com/dixonwh/aws-provisioning
Kubernetes and AWS Lambda can play nicely togetherEdward Wilde
Vendor lock-in can be a worry for many engineers . A new innovative approach, will for the first time, allow open-source serverless to run on AWS Lambda or Kubernetes using the same deployment artefact, packaged using the tools we love: containers.
OpenFaaS is an open-source function as a service (FaaS) platform on the [CNCF serverless landscape](https://landscape.cncf.io/format=serverless).
With OpenFaaS you can package anything as a serverless function and deploy to Kubernetes using containers. Due to UNIX-like primitives in the core architecture, it was possible to extend the system to run functions on both Kubernetes and AWS Lambda depending on user preference. The core components of OpenFaaS still run on Kubernetes but the functions are deployed and invoked on AWS Lambda
Александр Снеговой, DevOps Software Engineer в DataArt Kherson. Более шести лет в IT. Сертифицированный AWS Solutions Architect Associate. Докладчик на международных научных конференциях. Религиозный фанат Docker.
Презентация:
1. Докеризация приложения.
2. Настройка CI/CD.
3. Развертывание инфраструктуры в AWS с помощью Terraform.
This will be a more advanced scenario related session during which we'll talk about API Gateway authentication use cases, Amazon Kinesis Streams, Amazon Cognito and AWS CloudFormation.
AWS to Bare Metal: Motivation, Pitfalls, and ResultsMongoDB
Like many startups, Wish grew up on AWS. As our cluster grew and the price of SSDs fell, we started exploring bare metal. Fast-forward 2 years and we have hundreds of MongoDB instances on bare metal fully integrated with our AWS infrastructure. It wasn't all smooth sailing, but the performance & cost improvements were worth it! Hear the story of how we did it and gain a framework for thinking about how to make the leap from cloud-centric architecture to a hybrid model.
WinOps Conference London 2017 session
Public Cloud IaaS vs traditional on prem and how Hashicorp Terraform is a great tool to configure Azure. Recorded here: https://www.youtube.com/watch?v=LDZXRBBuXCU
Using HashiCorp’s Terraform to build your infrastructure on AWS - Pop-up Loft...Amazon Web Services
Using Terraform to automate your infrastructure on AWS. What is Terraform and how is it different from Ansible. How to control cloud deployments using Terraform.
Mit Docker ist es einfach geworden, Applikationen lokal zu starten, ohne zusätzliche Abhängigkeiten installieren zu müssen. Einen Cluster auf seinem eigenen Rechner laufen zu lassen ist kein großes Ding mehr. Mit ECS bietet AWS einen Container-Management-Service für die Cloud an, der verspricht, Container entsprechend ihrem Ressourcenbedarf und Verfügbarkeitserfordernissen automatisch im Cluster zu platzieren.
Aber was passiert dazwischen? Und ist es wirklich so einfach?
In diesem Talk werden wir betrachten, welche existierenden Services von AWS verwendet werden können, um Container automatisch zu deployen, und was zusätzlich alles benötigt wird, um sie im Betrieb laufen zu lassen.
Alex Casalboni and Austen Collins discuss the evolution of Serverless. Learn about the exciting new trend that's redefining the cloud computing industry in this in-depth webinar designed to teach you the basics of serverless computing and design.
AWS Core services:
* The AWS web console: the entry point for configuring your infrastructure in the AWS cloud
* The Free Tier and how to setup billing alerts
* Elastic Compute Cloud (EC2) instances, and the ease with which you can pick a particular Amazon Machine Image (AMI) for your workload, and spin it up as an instance right away
* How to create and deploy a high-availability web application in AWS, with an Elastic Load Balancer (ELB) and a multi-availability-zone Relational-Database-Service (RDS) instance
* How CloudFormation can automate all of the above.
Serverless Functions:
Serverless architecture allows developers to focus on code and their business problem rather than spending time looking after backend infrastructure. Serverless architecture can help developers build scalable, high-performing, and cost-effective applications quickly
We will talk about how serverless architecture and AWS Lambda can make things easier, cheaper, and help to accelerate development of projects.
AWS re:Invent 2016: Deploying Scalable SAP Hybris Clusters using Docker (CON312)Amazon Web Services
Rent-A-Center’s challenge was to architect, deploy, and manage a mission-critical SAP Hybris ecommerce platform that could scale to 2 million users a month. Together with Flux7, an AWS Advanced Consulting Partner, Rent-A-Center created an AWS-based approach that would help deliver the solution to market faster, in a secure, highly available, PCI-compliant fashion. In this session, we walk through the implementation details of this solution and its challenges, and explore how Rent-A-Center is now able to achieve ROI through agility, scalability, security, and cost savings.
Experiences with AWS immutable deploys and job processingDocker, Inc.
How Docker is used at Gilt: At Gilt we use Docker primarily as a unit of immutability and to allow a standard way of deploying all kinds of software as opposed to its container properties.
Why Gilt built Ionroller: An overview of the problems we tried to solve with Ionroller and immutable deploys. Pitfalls we've encountered with immutable deployments since Ionroller saw adoption in Gilt. Will cover issues such as DNS traffic migration, utilisation of resources ELBs not warmed up properly, Elasticbeanstalk using Nginx as proxy etc. Our experiences with Cloudformation and Codedeploy as an alternative to Ionroller and Elasticbeanstalk.
Jobs: How we used to do batch jobs. Solutions we considered such as Mesos and Chronos. An overview of Sundial, an in house solution we built in the last few months and hope to open source for running containerized Docker jobs on Amazon ECS and why we chose it as our preferred solution.
Operating Microservices at Hyperscale — Tech in Asia PDC 2019Donnie Prakoso
Presented at Tech in Asia PDC 2019 in Jakarta.
Most developers today are adopting a microservices based application design. Microservices can provide higher system reliability, fine-grained scalability, and faster development cycles. At hyperscale (thousands to millions of requests per second), however, additional thought, careful design, and greater operational rigor are required. In this session, learn fundamental design principles and best practices for hyperscale applications.
Webinar: Serverless Architectures with AWS Lambda and MongoDB AtlasMongoDB
It’s easier than ever to power serverless architectures with our managed MongoDB as a service, MongoDB Atlas. In this session, we will explore the rise of serverless architectures and how they’ve rapidly integrated into public and private cloud offerings.
Serverless DevOps to the Rescue - SRV330 - re:Invent 2017Amazon Web Services
Join this workshop for a crash course in serverless DevOps! This workshops presents a scenario in which you help out Wild Rydes (www.wildrydes.com), the world’s leading unicorn transportation startup! After building the first iteration of its serverless web application, Wild Rydes needs serverless DevOps experts like yourself to help it rapidly build and iterate upon its web app. In this workshop, you’ll help Wild Rydes set up a CI/CD pipeline that enables the company to rapidly build, test, and deploy changes to its serverless application. You’ll also learn to monitor and diagnose issues for its application. This workshop will teach you how to model and deploy serverless apps with the AWS Serverless Application Model. You’ll learn to use AWS CodePipeline and AWS CodeBuild to create a CI/CD pipeline for AWS Lambda and other services. Finally, you’ll learn to use AWS X-Ray to diagnose issues in your Lambda functions.
Requirements: Laptop, AWS account, basic Git experience. Recommended: Previous experience with the AWS Management Console and AWS CloudFormation templates, some familiarity with the AWS Developer Tools services, and preferably one of the AWS Associate certifications.
Compute Without Servers – Building Applications with AWS Lambda - Technical 301Amazon Web Services
AWS Lambda enables developers to build scalable applications without managing servers. Come learn how Lambda's event driven approach helps build backend ingestion systems, real time stream processing, and scalable API backends. We will deep dive into the different approaches that customers have taken to building applications with Lambda, typical architectures that customers use Lambda for, and best practices for authoring, deploying, and managing Lambda functions.
Speaker: Ajay Nair, Sr Product Manager Lambda, Amazon Web Services
Same basic flow as the keynote, but with a lot more detail, and we had a lot more interactive discussion rather than a presentation format. See part 2 for some more specific detail and links to other presentations.
AWS Lambda is a compute service that lets you run your code without managing any servers. Join this session to learn with live examples, how you can develop, test and run your Python functions with AWS Lambda, at any scale.
Markku Lepisto, Principal Technology Evangelist, Amazon Web Services, APAC
AWS 201 - A Walk through the AWS Cloud: App Hosting on AWS - Games, Apps and ...Amazon Web Services
Playfish, Gumi, and Halfbrick are three of many gaming companies on AWS. Pinterest, Netflix and Flipboard host web and mobile applications using the AWS Cloud. What are the best practices to build an application to take advantage of the benefits of AWS? Learn about these approaches and how customers have built highly scalable, durable and reliable infrastructures to host their internet-facing businesses on AWS. Attend this complimentary webinar to learn more.
Is your company committed to Microsoft’s application platform and Visual Studio? Learn how you can use the tools you love with the broad set of global services you need to move faster, lower costs, and scale to meet your customer’s demands. If you’re familiar with Visual Studio and SQL server but new to AWS, you’ll learn how you can use AWS without having to learn a new IDE or programming language.
Similar to A Year of Droplr Cloud Architecture Evolution with AWS and Serverless (20)
Presentation from SysOps/DevOps Wrocław MeetUp #8 (28.03.2019). I was sharing my experience of introducing DevOps in projects of various size. We started with agile ways of working with architecture (evolutionary approaches, ADR), talked about introduction of continuous security practices (DevSecOps) and ended with the ways of final business release of our applications.
Presentation shows how to use Apache Benchmark and JMeter to run load-tests. It also shows how to collect metrics from Google Analytics that are needed to configure your tests.
Testowanie poziomu bezpieczeństwa aplikacji internetowychAntoni Orfin
Niniejsza praca ma za zadanie przedstawić zagrożenia związane z bezpieczeństwem aplikacji internetowych.
Omawia najpowszechniejsze rodzaje zagrożeń, przykłady podatności i sposoby ochrony. Pozwoli na zapoznanie się z ogólnymi zasadami, którymi powinny kierować się osoby odpowiedzialne za wytwarzanie systemów webowych. Jest również bazą która pozwoli skuteczniej przeprowadzać audyty bezpieczeństwa.
Projektowanie wysokowydajnych i skalowalnych serwisów WWW - Warstwa danychAntoni Orfin
Część druga prezentacji pochodzącej z warsztatów skupiających się na zagadnieniach projektowania i wytwarzania wysokowydajnych i skalowalnych serwisów webowych.
Prezentacja opisuje problemy związane z warstwą danych:
- Replikacja (master-master, master-slave)
- Partycjonowanie (sharding)
- Wydajne przechowywanie danych (agregacja, denormalizacja)
Projektowanie wysokowydajnych i skalowalnych serwisów WWW - Warstwa aplikacjiAntoni Orfin
Część pierwsza prezentacji pochodzącej z warsztatów skupiających się na zagadnieniach projektowania i wytwarzania wysokowydajnych i skalowalnych serwisów webowych.
Prezentacja opisuje problemy związane z warstwą aplikacji:
- Rodzaje skalowania
- Architektury nastawione na zapewnienie wysokiej wydajności i skalowalności
- Zagadnienia Load-Balancingu
- Metody cache'owanie - n-Tier Cache, Varnish, Redis
- Service Oriented Architecture
Presentation covers concepts of full-text search and shows possibilites of Elasticsearch as a technology of choice to build an intelligent search engine with.
Presentation from the 2nd Wrocław's PHPErs Conference which took place on 10.08.2015.
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)MdTanvirMahtab2
This presentation is about the working procedure of Shahjalal Fertilizer Company Limited (SFCL). A Govt. owned Company of Bangladesh Chemical Industries Corporation under Ministry of Industries.
Cosmetic shop management system project report.pdfKamal Acharya
Buying new cosmetic products is difficult. It can even be scary for those who have sensitive skin and are prone to skin trouble. The information needed to alleviate this problem is on the back of each product, but it's thought to interpret those ingredient lists unless you have a background in chemistry.
Instead of buying and hoping for the best, we can use data science to help us predict which products may be good fits for us. It includes various function programs to do the above mentioned tasks.
Data file handling has been effectively used in the program.
The automated cosmetic shop management system should deal with the automation of general workflow and administration process of the shop. The main processes of the system focus on customer's request where the system is able to search the most appropriate products and deliver it to the customers. It should help the employees to quickly identify the list of cosmetic product that have reached the minimum quantity and also keep a track of expired date for each cosmetic product. It should help the employees to find the rack number in which the product is placed.It is also Faster and more efficient way.
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptxR&R Consult
CFD analysis is incredibly effective at solving mysteries and improving the performance of complex systems!
Here's a great example: At a large natural gas-fired power plant, where they use waste heat to generate steam and energy, they were puzzled that their boiler wasn't producing as much steam as expected.
R&R and Tetra Engineering Group Inc. were asked to solve the issue with reduced steam production.
An inspection had shown that a significant amount of hot flue gas was bypassing the boiler tubes, where the heat was supposed to be transferred.
R&R Consult conducted a CFD analysis, which revealed that 6.3% of the flue gas was bypassing the boiler tubes without transferring heat. The analysis also showed that the flue gas was instead being directed along the sides of the boiler and between the modules that were supposed to capture the heat. This was the cause of the reduced performance.
Based on our results, Tetra Engineering installed covering plates to reduce the bypass flow. This improved the boiler's performance and increased electricity production.
It is always satisfying when we can help solve complex challenges like this. Do your systems also need a check-up or optimization? Give us a call!
Work done in cooperation with James Malloy and David Moelling from Tetra Engineering.
More examples of our work https://www.r-r-consult.dk/en/cases-en/
Saudi Arabia stands as a titan in the global energy landscape, renowned for its abundant oil and gas resources. It's the largest exporter of petroleum and holds some of the world's most significant reserves. Let's delve into the top 10 oil and gas projects shaping Saudi Arabia's energy future in 2024.
Overview of the fundamental roles in Hydropower generation and the components involved in wider Electrical Engineering.
This paper presents the design and construction of hydroelectric dams from the hydrologist’s survey of the valley before construction, all aspects and involved disciplines, fluid dynamics, structural engineering, generation and mains frequency regulation to the very transmission of power through the network in the United Kingdom.
Author: Robbie Edward Sayers
Collaborators and co editors: Charlie Sims and Connor Healey.
(C) 2024 Robbie E. Sayers
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...Dr.Costas Sachpazis
Terzaghi's soil bearing capacity theory, developed by Karl Terzaghi, is a fundamental principle in geotechnical engineering used to determine the bearing capacity of shallow foundations. This theory provides a method to calculate the ultimate bearing capacity of soil, which is the maximum load per unit area that the soil can support without undergoing shear failure. The Calculation HTML Code included.
Welcome to WIPAC Monthly the magazine brought to you by the LinkedIn Group Water Industry Process Automation & Control.
In this month's edition, along with this month's industry news to celebrate the 13 years since the group was created we have articles including
A case study of the used of Advanced Process Control at the Wastewater Treatment works at Lleida in Spain
A look back on an article on smart wastewater networks in order to see how the industry has measured up in the interim around the adoption of Digital Transformation in the Water Industry.
Student information management system project report ii.pdfKamal Acharya
Our project explains about the student management. This project mainly explains the various actions related to student details. This project shows some ease in adding, editing and deleting the student details. It also provides a less time consuming process for viewing, adding, editing and deleting the marks of the students.
11. Serverless Revolution
AWS Lambda - run code without thinking about underlying
infrastructure
1. Crazy cheap
2. Multiple programming languages support
3. Highly-Scalable
4. Reliable
5. Fast
12. Serverless Revolution
AWS Lambda - run code without thinking about underlying
infrastructure
1. Crazy cheap
Free Tier: 1M requests per month & 400,000/GB-sec
Above: $0.0000002/request + $0.00001667/GB-sec
13. Serverless Revolution
AWS Lambda - run code without thinking about underlying
infrastructure
2. Multiple programming languages support: Node.js
(JavaScript), Python, Java (Java 8), C# (.NET Core), Go
(from 15.01.2018)
$ npm install serverless -g
$ serverless create --template hello-world
$ serverless deploy
14. Serverless Revolution
AWS Lambda - run code without thinking about underlying
infrastructure
3. Highly-Scalable out of the box
Default limit: 1,000 concurrent executions
Our Benchmark: 800 req/s per Node.js function
15. Serverless Revolution
AWS Lambda - run code without thinking about underlying
infrastructure
4. Reliable
100% uptime
in our Pingdom from start (7 months)
16. Serverless Revolution
AWS Lambda - run code without thinking about underlying
infrastructure
5. Fast
<1 ms
for Node.js Express “Hello World”
18. Droplr Current Architecture
Droplr Serverless Architecture
1. AWS Lambda in VPC
2. CloudFront in front of API Gateway
3. Web Application Firewall
4. SNS (~RabbitMQ?)
5. CloudWatch Events (~CRON?)
28. Thanks
Time for discussion :-)
- Serverless as a game-changer?
- Your ideas of using Serverless?
- Btw. Senior JavaScript/React Developer wanted! ;-)
Ref.: https://serverless.com/blog/how-droplr-scales-to-millions-serverless-framework/