Serverless lessons learned #7 rate limiting
•Download as PPTX, PDF•
0 likes•14 views
When we started building serverless applications back in 2017, there was quite a lot to learn. So we'd like to share some mistakes, important pieces, and concepts for production-ready serverless projects. This time: Rate limiting / Throttling AWS SDK retry handling: https://lnkd.in/dVwwEsat AWS SDK customize retry options: https://lnkd.in/dFrMbGfs API-GW Throttling: https://lnkd.in/dfVbVtsm
Report
Share
Report
Share
Recommended
Serverless lessons learned #8 backoff
Continuing our series of mistakes, important pieces, and concepts for production-ready serverless projects in 2022.
"exponential backoff"
In-depth backoff and jitter comparison: https://lnkd.in/disA6tQq
AWS SDK (node) custom backoff: https://lnkd.in/dFrMbGfs
Serverless lessons learned #1 custom sdk timeouts
After building serverless applications for a couple of years now, we decided to share some important pieces and concepts for production-ready serverless projects.
Let's start with: What are Custom SDK Timeouts and why you should care.
Default timeouts and troubleshooting: https://lnkd.in/dZsgxk9p
Serverless lessons learned #5 retries
When we started building serverless applications back in 2017, there was quite a lot to learn.
So we'd like to share some mistakes, important pieces, and concepts for production-ready serverless projects.
This time: Retries.
More Information:
API-Retries: https://lnkd.in/dVwwEsat
Lambda-Retries: https://lnkd.in/dEs6xXyb
SQS-Retries: https://lnkd.in/dPm2x7ZT
Serverless lessons learned #3 reserved concurrency
After building serverless applications for quite a few years, we decided to share some important pieces and concepts for production-ready serverless projects.
This time: Lambda Reserved Concurrency.
More Information: https://lnkd.in/dRxHdrCa
Serverless lessons learned #2 dead letter queues
After building serverless applications for quite a few years, we decided to share some important pieces and concepts for production-ready serverless projects.
This time: Why you should utilize Dead Letter Queues when building event-driven systems.
More Information: https://lnkd.in/dnY6cNnG
Serverless lessons learned #4 circuit breaker
The document discusses circuit breakers and their importance for distributed systems. It notes that failures are difficult to detect in distributed systems and that retrying calls against an unresponsive subsystem can lead to resource shortages or cascading failures. It then introduces the circuit breaker pattern, which detects failures and prevents retrying the same failing action until the service recovers, in order to avoid cascading failures. The circuit breaker can be in an open, closed, or half-open state depending on success or failure detection.
Load Testing Serverless Applications And Understanding How Lambda Scales
This document discusses load testing serverless applications and understanding how AWS Lambda scales. It begins with an introduction to load testing and why it is important. Common load testing tools like JMeter, Locust, and Artillery are mentioned. Serverless Artillery, which combines the Serverless Framework and Artillery for serverless load testing, is presented. The document demonstrates load testing a simple serverless application. It then explains how Lambda scales under increasing loads by increasing concurrency up to 3000 instances. Provisioned concurrency is introduced as a way to initialize a set number of Lambda execution environments.
AWS Customer Presentation - Adjack
David Boland presents at the AWS Start-Up Event in San Diego. About AdJack and their virtual infrastructure on AWS.
Recommended
Serverless lessons learned #8 backoff
Continuing our series of mistakes, important pieces, and concepts for production-ready serverless projects in 2022.
"exponential backoff"
In-depth backoff and jitter comparison: https://lnkd.in/disA6tQq
AWS SDK (node) custom backoff: https://lnkd.in/dFrMbGfs
Serverless lessons learned #1 custom sdk timeouts
After building serverless applications for a couple of years now, we decided to share some important pieces and concepts for production-ready serverless projects.
Let's start with: What are Custom SDK Timeouts and why you should care.
Default timeouts and troubleshooting: https://lnkd.in/dZsgxk9p
Serverless lessons learned #5 retries
When we started building serverless applications back in 2017, there was quite a lot to learn.
So we'd like to share some mistakes, important pieces, and concepts for production-ready serverless projects.
This time: Retries.
More Information:
API-Retries: https://lnkd.in/dVwwEsat
Lambda-Retries: https://lnkd.in/dEs6xXyb
SQS-Retries: https://lnkd.in/dPm2x7ZT
Serverless lessons learned #3 reserved concurrency
After building serverless applications for quite a few years, we decided to share some important pieces and concepts for production-ready serverless projects.
This time: Lambda Reserved Concurrency.
More Information: https://lnkd.in/dRxHdrCa
Serverless lessons learned #2 dead letter queues
After building serverless applications for quite a few years, we decided to share some important pieces and concepts for production-ready serverless projects.
This time: Why you should utilize Dead Letter Queues when building event-driven systems.
More Information: https://lnkd.in/dnY6cNnG
Serverless lessons learned #4 circuit breaker
The document discusses circuit breakers and their importance for distributed systems. It notes that failures are difficult to detect in distributed systems and that retrying calls against an unresponsive subsystem can lead to resource shortages or cascading failures. It then introduces the circuit breaker pattern, which detects failures and prevents retrying the same failing action until the service recovers, in order to avoid cascading failures. The circuit breaker can be in an open, closed, or half-open state depending on success or failure detection.
Load Testing Serverless Applications And Understanding How Lambda Scales
This document discusses load testing serverless applications and understanding how AWS Lambda scales. It begins with an introduction to load testing and why it is important. Common load testing tools like JMeter, Locust, and Artillery are mentioned. Serverless Artillery, which combines the Serverless Framework and Artillery for serverless load testing, is presented. The document demonstrates load testing a simple serverless application. It then explains how Lambda scales under increasing loads by increasing concurrency up to 3000 instances. Provisioned concurrency is introduced as a way to initialize a set number of Lambda execution environments.
AWS Customer Presentation - Adjack
David Boland presents at the AWS Start-Up Event in San Diego. About AdJack and their virtual infrastructure on AWS.
TLS302 Being Productive with the AWS SDK for Java - AWS re:Invent 2012
The document discusses how the AWS SDK for Java can help developers be more productive by providing high-level APIs and services that abstract away lower-level functionality for common tasks like uploading/downloading from S3, client-side encryption, saving data to DynamoDB, and sending emails through SES. It encourages developers to try out these services and APIs and provide feedback to help improve the SDK.
AWS Jungle - Lambda
The document discusses AWS Lambda, a serverless computing service that allows users to upload code that can be executed in response to events. It provides an overview of Lambda's advantages like flexible scaling and pay-per-use model. The document then explains how to create a Lambda function by selecting a programming language, coding the function, configuring settings like memory and timeout, and attaching triggers to specify when the function should execute. Finally, it promises a real-world example to demonstrate Lambda.
AWS Customer Presentation - Autodesk
Paul Cochrane, Systems Architect, AutoDesk discuss how they use AWS in their business and why they use AWS cloud at the AWS Enterprise Tour - SF - 2010
5 Important Points To Remember If You Want To Reduce AWS EC2 Cost
There are several ways to reduce costs for AWS EC2 instances. First, right-size instances to match resource usage to avoid overprovisioning. Second, optimize autoscaling settings like cool-down periods to avoid early terminations. Third, use reserved instances for long-term, steady usage to save substantially over on-demand instances. Fourth, stop instances when not in use, like dev/test environments after hours. Finally, leverage other AWS services where possible instead of self-hosting on EC2 to avoid additional costs.
Pragmatic adoption of serverless at umbraco
Talk from DevOpsDaysCPH about a pragmatic approach to adopting serverless. Link to session and abstract: https://www.devopsdays.org/events/2019-copenhagen/program/morten-christensen/
Kotlin for backend using serverless + aws lambda
This document discusses using Kotlin for backend development with AWS Lambda and serverless architecture. Some key advantages of Kotlin include its conciseness, type safety, IDE support, and interoperability with Java. AWS Lambda provides horizontal scaling and allows focusing on code without managing servers. The Serverless framework makes it easy to deploy event-driven functions. Some challenges of AWS Lambda include package size limits and cold start times, while the Serverless framework may have longer initial deploy times for large projects. Overall warm up functions and use additional stacks to address resource limits when using these serverless technologies.
The use of aws in the countryside
Takuya Tachibana discusses using AWS services like EC2 and Lambda for projects in rural areas with small budgets and less infrastructure. Some key points:
- He uses EC2 t2 instances, which are cost effective but can slow down if CPU credits are used up, so monitoring is important. Stress testing showed a t2.micro could handle 100 small sites.
- Lambda is used to offload CPU-intensive tasks like statistics processing and monitoring, providing auto-scaling with pay-per-use model.
- The combination of t2 instances and Lambda allows for reliable and scalable infrastructure even in rural areas with constraints, keeping costs low.
Scalr - Open Source Cloud Management
Scalr is a cloud management platform that automates scaling, security, availability, and cost management for infrastructure on cloud platforms like Amazon Web Services. It is trusted by companies like Samsung and helps users avoid time-consuming manual tasks while ensuring their cloud resources are optimized for performance, redundancy, and cost-efficiency. Press quotes praise Scalr for making AWS more powerful and providing fully redundant, self-scaling hosting capabilities.
Our Migration to AWS
Last year we migrated our entire infrastructure from a co-located setup in a Dutch datacentre to Amazon Web Services. Now that the dust has settled, I thought I’d share some insights on the migration process and what we learned.
AWS Customer Presentation - Conde Nast
Customer Presentation by Conde Nast at the AWS Cloud for the Enterprise Event in NYC on October 19, 2009
Customer Sharing: tixCraft - Success from failure: Creating Scalable Ticket S...
This session will cover the process of creating a scalable architecture, with the company's old and new architectures being shown.
Serverless data processing with Data Pipeline
How to combine different AWS services to process big amounts of data without worrying about resources.
Scalable Application Development on AWS
Presentation from Application Developers Days 3 conference (Moscow, May 2012) about best practices in scalable application development on AWS.
Understand AWS OpsWorks - A DevOps Tool from AWS
AWS OpsWorks is an application management service that makes it easy to deploy and operate applications. It allows users to define an application's architecture and components through templates or custom specifications. AWS OpsWorks provides automation to scale applications based on time or load, and dynamic configuration as the environment scales. The document then demonstrates how to use AWS OpsWorks to install an HTTP server and deploy a static website using Chef recipes.
Going serverless with Azure
In this presentation I talked about the benefits of going serverless with the Azure platform. I went a bit through the pros and cons of serverless, then I did two demos of publishing an Azure Function and chaining multiple functions for a trading bot.
Ruby Conference Belarus 2019 Apr Jets Ruby Serverless Framework
We will do a quick introduction to the Serverless world and AWS Lambda to establish a baseline for everyone. Then we'll jump into a Ruby Framework that makes Serverless easy to work with.
Ruby is the not only one of most beautiful languages in the world but also extremely powerful. The power lies in Ruby's Metaprogramming abilities. This serverless framework leverages these Ruby powers to create a DSL that essentially translates Ruby code to AWS Lambda functions. We'll introduce these Framework concepts:
* Controllers
* Routes
* Jobs
We will create a few demos and deploy it to AWS Lambda live. We will also cover some architecture pattern examples that can be built with the framework.
Kubernetes On AWS | AWS Kubernetes Tutorial | AWS EKS Tutorial | AWS Training...
( ** AWS Certification Training: https://www.edureka.co/cloudcomputing ** )
This Edureka! PPT on “AWS Kubernetes Tutorial” will help you understand how to deploy a containerized application onto a Kubernetes cluster managed by Amazon Elastic Container Service for Kubernetes (Amazon EKS).
Below is the list of topics covered in this session:
1. Introduction on AWS
2. What is Containerization?
3. Amazon EKS
4. Launch an application on EKS platform
Check out our complete AWS Playlist here: https://goo.gl/8qrfKU
Follow us to never miss an update in the future.
Instagram: https://www.instagram.com/edureka_learning/
Facebook: https://www.facebook.com/edurekaIN/
Twitter: https://twitter.com/edurekain
LinkedIn: https://www.linkedin.com/company/edureka
Aws certification roadmap yogesh-sharma
This document provides a roadmap and tips for obtaining AWS cloud certifications. It outlines the following:
1. Do hands-on work and set a target date for exams.
2. Create flashcards, take notes, and manage your time well.
3. Share your learning with others through blogs, tweets, etc. to reinforce knowledge.
It then provides links to free and paid resources like tutorials, practice exams, and courses to help prepare for exams. The final tips stress practicing extensively as the exams are challenging, and to enjoy the learning journey.
Master your Kubernetes Stack and your Cloud Services with Open Service Broker
Kubernetes is allowing seamless integration with the vast array of service brokers available in the microservice-based software ecosystem via the Service Catalog. The Open Service Broker API is an industry standard that allows service operators to integrate with multiple platforms using a single API specification. This session showcases the usage of the Open Service Broker and the Service Catalog.
Speaker: Sandra Kriemann, @skriemhild
Cloud Developer Advocate, focusing on Open Source Technologies especially Containers.
Docker Management and Kubernetes Orchestration
Docker is the de facto tool for creating containerized applications, but leveraging containers in production isn’t always straightforward. There are many options from simple hosts to complex orchestration tools. Learn how to create Docker images, load them to a custom registry and deploy them at scale with a simple example application written in Go and JavaScript. See examples of cloud deployments implemented with Azure Container Instances, Web Apps for Containers, and Azure Kubernetes Services.
Five Ways to Scale your API Without Touching Your Code
Five ways to scale an API without changing code:
1. Optimize API design by removing unnecessary methods and structuring methods to match use cases.
2. Add aggregate methods to reduce calls to base methods.
3. Implement rate limiting to reduce load and encourage efficient code.
4. Offboard caching and processing to clients to reduce server load.
5. Provide SDKs to encode best practices and optimize client code patterns.
Together these techniques can significantly improve scaling by managing load through changes to API structure and client behavior rather than requiring code changes.
GPSTEC314-GPS From Monolithic to Serverless - Why and How to Move
Is your customer worried about scaling their monolithic application for an upcoming major event and has a tight timeline? Maybe it's time you recommend moving their application to a microservices architecture. In this session, we explore how to convert a monolithic application to a microservices model by using AWS serverless services such as AWS Lambda, Amazon API Gateway, and Amazon DynamoDB. We step through the common architectural changes in moving to a microservices structure, and we discuss how to manage your application at scale. We also demonstrate a web application built using AWS serverless services.
More Related Content
What's hot
TLS302 Being Productive with the AWS SDK for Java - AWS re:Invent 2012
The document discusses how the AWS SDK for Java can help developers be more productive by providing high-level APIs and services that abstract away lower-level functionality for common tasks like uploading/downloading from S3, client-side encryption, saving data to DynamoDB, and sending emails through SES. It encourages developers to try out these services and APIs and provide feedback to help improve the SDK.
AWS Jungle - Lambda
The document discusses AWS Lambda, a serverless computing service that allows users to upload code that can be executed in response to events. It provides an overview of Lambda's advantages like flexible scaling and pay-per-use model. The document then explains how to create a Lambda function by selecting a programming language, coding the function, configuring settings like memory and timeout, and attaching triggers to specify when the function should execute. Finally, it promises a real-world example to demonstrate Lambda.
AWS Customer Presentation - Autodesk
Paul Cochrane, Systems Architect, AutoDesk discuss how they use AWS in their business and why they use AWS cloud at the AWS Enterprise Tour - SF - 2010
5 Important Points To Remember If You Want To Reduce AWS EC2 Cost
There are several ways to reduce costs for AWS EC2 instances. First, right-size instances to match resource usage to avoid overprovisioning. Second, optimize autoscaling settings like cool-down periods to avoid early terminations. Third, use reserved instances for long-term, steady usage to save substantially over on-demand instances. Fourth, stop instances when not in use, like dev/test environments after hours. Finally, leverage other AWS services where possible instead of self-hosting on EC2 to avoid additional costs.
Pragmatic adoption of serverless at umbraco
Talk from DevOpsDaysCPH about a pragmatic approach to adopting serverless. Link to session and abstract: https://www.devopsdays.org/events/2019-copenhagen/program/morten-christensen/
Kotlin for backend using serverless + aws lambda
This document discusses using Kotlin for backend development with AWS Lambda and serverless architecture. Some key advantages of Kotlin include its conciseness, type safety, IDE support, and interoperability with Java. AWS Lambda provides horizontal scaling and allows focusing on code without managing servers. The Serverless framework makes it easy to deploy event-driven functions. Some challenges of AWS Lambda include package size limits and cold start times, while the Serverless framework may have longer initial deploy times for large projects. Overall warm up functions and use additional stacks to address resource limits when using these serverless technologies.
The use of aws in the countryside
Takuya Tachibana discusses using AWS services like EC2 and Lambda for projects in rural areas with small budgets and less infrastructure. Some key points:
- He uses EC2 t2 instances, which are cost effective but can slow down if CPU credits are used up, so monitoring is important. Stress testing showed a t2.micro could handle 100 small sites.
- Lambda is used to offload CPU-intensive tasks like statistics processing and monitoring, providing auto-scaling with pay-per-use model.
- The combination of t2 instances and Lambda allows for reliable and scalable infrastructure even in rural areas with constraints, keeping costs low.
Scalr - Open Source Cloud Management
Scalr is a cloud management platform that automates scaling, security, availability, and cost management for infrastructure on cloud platforms like Amazon Web Services. It is trusted by companies like Samsung and helps users avoid time-consuming manual tasks while ensuring their cloud resources are optimized for performance, redundancy, and cost-efficiency. Press quotes praise Scalr for making AWS more powerful and providing fully redundant, self-scaling hosting capabilities.
Our Migration to AWS
Last year we migrated our entire infrastructure from a co-located setup in a Dutch datacentre to Amazon Web Services. Now that the dust has settled, I thought I’d share some insights on the migration process and what we learned.
AWS Customer Presentation - Conde Nast
Customer Presentation by Conde Nast at the AWS Cloud for the Enterprise Event in NYC on October 19, 2009
Customer Sharing: tixCraft - Success from failure: Creating Scalable Ticket S...
This session will cover the process of creating a scalable architecture, with the company's old and new architectures being shown.
Serverless data processing with Data Pipeline
How to combine different AWS services to process big amounts of data without worrying about resources.
Scalable Application Development on AWS
Presentation from Application Developers Days 3 conference (Moscow, May 2012) about best practices in scalable application development on AWS.
Understand AWS OpsWorks - A DevOps Tool from AWS
AWS OpsWorks is an application management service that makes it easy to deploy and operate applications. It allows users to define an application's architecture and components through templates or custom specifications. AWS OpsWorks provides automation to scale applications based on time or load, and dynamic configuration as the environment scales. The document then demonstrates how to use AWS OpsWorks to install an HTTP server and deploy a static website using Chef recipes.
Going serverless with Azure
In this presentation I talked about the benefits of going serverless with the Azure platform. I went a bit through the pros and cons of serverless, then I did two demos of publishing an Azure Function and chaining multiple functions for a trading bot.
Ruby Conference Belarus 2019 Apr Jets Ruby Serverless Framework
We will do a quick introduction to the Serverless world and AWS Lambda to establish a baseline for everyone. Then we'll jump into a Ruby Framework that makes Serverless easy to work with.
Ruby is the not only one of most beautiful languages in the world but also extremely powerful. The power lies in Ruby's Metaprogramming abilities. This serverless framework leverages these Ruby powers to create a DSL that essentially translates Ruby code to AWS Lambda functions. We'll introduce these Framework concepts:
* Controllers
* Routes
* Jobs
We will create a few demos and deploy it to AWS Lambda live. We will also cover some architecture pattern examples that can be built with the framework.
Kubernetes On AWS | AWS Kubernetes Tutorial | AWS EKS Tutorial | AWS Training...
( ** AWS Certification Training: https://www.edureka.co/cloudcomputing ** )
This Edureka! PPT on “AWS Kubernetes Tutorial” will help you understand how to deploy a containerized application onto a Kubernetes cluster managed by Amazon Elastic Container Service for Kubernetes (Amazon EKS).
Below is the list of topics covered in this session:
1. Introduction on AWS
2. What is Containerization?
3. Amazon EKS
4. Launch an application on EKS platform
Check out our complete AWS Playlist here: https://goo.gl/8qrfKU
Follow us to never miss an update in the future.
Instagram: https://www.instagram.com/edureka_learning/
Facebook: https://www.facebook.com/edurekaIN/
Twitter: https://twitter.com/edurekain
LinkedIn: https://www.linkedin.com/company/edureka
Aws certification roadmap yogesh-sharma
This document provides a roadmap and tips for obtaining AWS cloud certifications. It outlines the following:
1. Do hands-on work and set a target date for exams.
2. Create flashcards, take notes, and manage your time well.
3. Share your learning with others through blogs, tweets, etc. to reinforce knowledge.
It then provides links to free and paid resources like tutorials, practice exams, and courses to help prepare for exams. The final tips stress practicing extensively as the exams are challenging, and to enjoy the learning journey.
Master your Kubernetes Stack and your Cloud Services with Open Service Broker
Kubernetes is allowing seamless integration with the vast array of service brokers available in the microservice-based software ecosystem via the Service Catalog. The Open Service Broker API is an industry standard that allows service operators to integrate with multiple platforms using a single API specification. This session showcases the usage of the Open Service Broker and the Service Catalog.
Speaker: Sandra Kriemann, @skriemhild
Cloud Developer Advocate, focusing on Open Source Technologies especially Containers.
Docker Management and Kubernetes Orchestration
Docker is the de facto tool for creating containerized applications, but leveraging containers in production isn’t always straightforward. There are many options from simple hosts to complex orchestration tools. Learn how to create Docker images, load them to a custom registry and deploy them at scale with a simple example application written in Go and JavaScript. See examples of cloud deployments implemented with Azure Container Instances, Web Apps for Containers, and Azure Kubernetes Services.
What's hot (20)
TLS302 Being Productive with the AWS SDK for Java - AWS re:Invent 2012
TLS302 Being Productive with the AWS SDK for Java - AWS re:Invent 2012
5 Important Points To Remember If You Want To Reduce AWS EC2 Cost
5 Important Points To Remember If You Want To Reduce AWS EC2 Cost
Customer Sharing: tixCraft - Success from failure: Creating Scalable Ticket S...
Customer Sharing: tixCraft - Success from failure: Creating Scalable Ticket S...
Ruby Conference Belarus 2019 Apr Jets Ruby Serverless Framework
Ruby Conference Belarus 2019 Apr Jets Ruby Serverless Framework
Kubernetes On AWS | AWS Kubernetes Tutorial | AWS EKS Tutorial | AWS Training...
Kubernetes On AWS | AWS Kubernetes Tutorial | AWS EKS Tutorial | AWS Training...
Master your Kubernetes Stack and your Cloud Services with Open Service Broker
Master your Kubernetes Stack and your Cloud Services with Open Service Broker
Similar to Serverless lessons learned #7 rate limiting
Five Ways to Scale your API Without Touching Your Code
Five ways to scale an API without changing code:
1. Optimize API design by removing unnecessary methods and structuring methods to match use cases.
2. Add aggregate methods to reduce calls to base methods.
3. Implement rate limiting to reduce load and encourage efficient code.
4. Offboard caching and processing to clients to reduce server load.
5. Provide SDKs to encode best practices and optimize client code patterns.
Together these techniques can significantly improve scaling by managing load through changes to API structure and client behavior rather than requiring code changes.
GPSTEC314-GPS From Monolithic to Serverless - Why and How to Move
Is your customer worried about scaling their monolithic application for an upcoming major event and has a tight timeline? Maybe it's time you recommend moving their application to a microservices architecture. In this session, we explore how to convert a monolithic application to a microservices model by using AWS serverless services such as AWS Lambda, Amazon API Gateway, and Amazon DynamoDB. We step through the common architectural changes in moving to a microservices structure, and we discuss how to manage your application at scale. We also demonstrate a web application built using AWS serverless services.
Siebel best practices
This document provides best practices for Siebel eScripting. It recommends avoiding scripting when possible by using other configuration methods like user properties, calculated fields, state models, and workflows. When scripting is necessary, it provides tips for optimizing scripts such as caching frequently called values, delaying object instantiation, using indexed columns for search specs, avoiding scripts on frequently fired events, consolidating scripts, adding comments, and nullifying objects when no longer needed.
Rest api best practices – comprehensive handbook
This document provides an overview of REST API best practices. It discusses the key aspects of REST API design, including the 6 architectural constraints of REST (uniform interface, client-server, stateless, cacheable, layered system, and code on demand). It also outlines 12 best practices for REST API design, such as using nouns instead of verbs in URIs, plural naming conventions, implementing HATEOAS, and using Swagger for documentation. The document serves as a comprehensive guide to building robust RESTful APIs.
SRV313_Building Resilient, Multi-Region Serverless Applications
Serverless computing already provides high availability and fault tolerance for your application by default. However, you can build serverless applications that are deployed across multiple regions in order to further increase your availability and fault tolerance. In this session, we show you how to architect a multi-region serverless application with Amazon API Gateway and AWS Lambda that can route end users to the appropriate region to achieve optimal latency or availability. Learn about the different options for running an active/active versus an active/passive multi-region setup, and the setup for failing over between regions.
Building Serverless Web Applications - DevDay Los Angeles 2017
The document provides information about building serverless web applications using AWS Lambda and other AWS services. It begins with an overview of serverless computing using AWS Lambda and how it avoids the need to provision and manage servers. It then discusses various AWS compute offerings and when to use EC2, ECS, or Lambda. The rest of the document discusses serverless design patterns, demonstrates building a serverless web application using services like API Gateway and DynamoDB, and how to define and manage serverless applications using the AWS Serverless Application Model (SAM).
Building Serverless Web Applications - DevDay Austin 2017
This document provides an overview of building serverless web applications on AWS. It discusses AWS Lambda and its benefits over traditional server-based computing. Common serverless use cases and event sources that can trigger Lambda functions are described. Design patterns for building serverless applications including monolithic and microservices architectures are covered. Amazon API Gateway and AWS Serverless Application Model (SAM) are introduced as tools for developing serverless applications.
Monitoring and Troubleshooting in a Serverless World - SRV303 - re:Invent 2017
How do you monitor and troubleshoot an application made up of many ephemeral, stateless functions? How do you debug a distributed application in production? In this talk, we walk you through best practices, tools, and conventions using common troubleshooting scenarios. We'll discuss how you can use AWS services to address these scenarios, such as using Amazon CloudWatch for alarms and using AWS X-Ray to detect cross service calls.
You will also learn how Financial Engines leverages AWS X-Ray to debug, monitor, and analyze latency data for its serverless applications. It will also share some best practices for debugging and reporting.
Serverless design considerations for Cloud Native workloads
We have built a news website with more than a billion views per month and we are sharing the learnings from that experience covering Serverless architectures, Design considerations, and Gotchas.
Serverless Computing: build and run applications without thinking about servers
ISV Event
Serverless Computing: build and run applications without thinking about servers
Speaker: Diego Natali, AWS Solutions Architect
SRV310_Designing Microservices with Serverless
"When designing microservices there are a number of things to think about. Just for starters, the bounds of their functionality, how they communicate with their dependencies, and how they provide an interface for their own consumers. Serverless technologies such as AWS Lambda change paradigms around code structure, usage of libraries, and how you deploy and manage your applications. In this session, we show you how by combining microservices and serverless technologies, you can achieve the ultimate flexibility and agility that microservices aim for, while providing business value in how serverless greatly reduces operational overhead and cost.
In addition, National Geographic will share how it built its NG1 platform using a serverless, microservices architecture. The NG1 platform provides National Geographic consumers with content personalized to their preferences and behaviors in an intuitive, easy-to-use way on smartphones."
Building Serverless Web Applications
This document provides an overview of building serverless web applications using AWS Lambda and Amazon API Gateway. It discusses moving from a monolithic to microservices architecture with Lambda functions. It introduces the AWS Serverless Application Model (SAM) for defining serverless applications using CloudFormation templates. SAM supports Lambda functions, APIs, and other resources. The document also demonstrates sample SAM and CloudFormation templates and discusses frameworks like ClaudiaJS and Chalice for developing serverless applications.
Custom Development of Enterprise Services
These are the slides of my talk at SAP Mentor monday 8th november about development of Enterprise Services.
AWS Serverless patterns & best-practices in AWS
This presentation discusses serverless patterns and best practices in AWS. It defines what serverless computing is and outlines the business case for serverless, including faster time to market, reduced costs, improved reliability, and increased innovation. It then covers AWS serverless design patterns and solutions, serverless myths and anti-patterns to avoid, and best practices like using the Serverless Application Model, AWS CDK, nested stacks, managing limits and connections, and power tuning.
Data Design for Microservices - DevDay Austin 2017 Day 2
The document discusses various data design strategies and challenges for microservices architectures on AWS. It recommends using polyglot persistence to allow each microservice to choose its own database technology. It also discusses using eventual consistency between services, implementing transaction rollback mechanisms, and aggregating data from multiple services for reporting and analytics purposes.
Serverless Architecture
Learn about what a serverless architecture is, why they are growing in popularity, and who the key players are in a serverless API build on the AWS platform. Then get started building your own servless API!
Introduction to Serverless
This document discusses serverless computing and AWS Lambda. It provides an overview of virtual machines, containers, and serverless/functions as a service. It describes how AWS Lambda works, including how to author functions using various programming languages. It also discusses how to integrate Lambda with other AWS services like API Gateway, Step Functions, S3, DynamoDB and more. It introduces the AWS Serverless Application Repository and AWS SAM for defining serverless applications.
AWS Interview Questions and Answers -CREDO SYSTEMZ.pdf
Credo Systemz AWS course in Chennai is the Best Master Training Institute in the cloud platform. Our AWS training in chennai helps to acquire the in-depth AWS cloud skills. To advance in the career, Our professional trainers provide the complete AWS hands-on training. Our AWS Course focuses on the basics to advance AWS concepts, AWS architecture, AWS services with Placement support.
Aws serverless multi-tier_architectures
Serverless Logic Tier The logic tier of the three-tier architecture represents the brains of the application. This is why integrating Amazon API Gateway and AWS Lambda to
form your logic tier can be so revolutionary.
Raleigh DevDay 2017: Build a serverless web application in one day workshop
This document provides a summary of a presentation on building serverless web applications using AWS services like AWS Lambda and Amazon API Gateway. It includes an overview of AWS compute services like EC2, ECS, and Lambda and their differences. The presentation discusses why serverless is useful, common use cases, and design patterns like monolithic and microservices architectures. It also demonstrates how to define and deploy serverless applications using the AWS Serverless Application Model (SAM).
Similar to Serverless lessons learned #7 rate limiting (20)
Five Ways to Scale your API Without Touching Your Code
Five Ways to Scale your API Without Touching Your Code
GPSTEC314-GPS From Monolithic to Serverless - Why and How to Move
GPSTEC314-GPS From Monolithic to Serverless - Why and How to Move
SRV313_Building Resilient, Multi-Region Serverless Applications
SRV313_Building Resilient, Multi-Region Serverless Applications
Building Serverless Web Applications - DevDay Los Angeles 2017
Building Serverless Web Applications - DevDay Los Angeles 2017
Building Serverless Web Applications - DevDay Austin 2017
Building Serverless Web Applications - DevDay Austin 2017
Monitoring and Troubleshooting in a Serverless World - SRV303 - re:Invent 2017
Monitoring and Troubleshooting in a Serverless World - SRV303 - re:Invent 2017
Serverless design considerations for Cloud Native workloads
Serverless design considerations for Cloud Native workloads
Serverless Computing: build and run applications without thinking about servers
Serverless Computing: build and run applications without thinking about servers
Data Design for Microservices - DevDay Austin 2017 Day 2
Data Design for Microservices - DevDay Austin 2017 Day 2
AWS Interview Questions and Answers -CREDO SYSTEMZ.pdf
AWS Interview Questions and Answers -CREDO SYSTEMZ.pdf
Raleigh DevDay 2017: Build a serverless web application in one day workshop
Raleigh DevDay 2017: Build a serverless web application in one day workshop
Recently uploaded
E-commerce Development Services- Hornet Dynamics
For any business hoping to succeed in the digital age, having a strong online presence is crucial. We offer Ecommerce Development Services that are customized according to your business requirements and client preferences, enabling you to create a dynamic, safe, and user-friendly online store.
GreenCode-A-VSCode-Plugin--Dario-Jurisic
Presentation about a VSCode plugin from Dario Jurisic at the GSD Community Stage meetup
Mobile App Development Company In Noida | Drona Infotech
Drona Infotech is a premier mobile app development company in Noida, providing cutting-edge solutions for businesses.
Visit Us For : https://www.dronainfotech.com/mobile-application-development/
Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Dr. Jesús Barrasa, Head of Solutions Architecture for EMEA, Neo4j
Découvrez les dernières innovations de Neo4j, et notamment les dernières intégrations cloud et les améliorations produits qui font de Neo4j un choix essentiel pour les développeurs qui créent des applications avec des données interconnectées et de l’IA générative.
WWDC 2024 Keynote Review: For CocoaCoders Austin
Overview of WWDC 2024 Keynote Address.
Covers: Apple Intelligence, iOS18, macOS Sequoia, iPadOS, watchOS, visionOS, and Apple TV+.
Understandable dialogue on Apple TV+
On-device app controlling AI.
Access to ChatGPT with a guest appearance by Chief Data Thief Sam Altman!
App Locking! iPhone Mirroring! And a Calculator!!
Energy consumption of Database Management - Florina Jonuzi
Presentation from Florina Jonuzi at the GSD Community Stage Meetup on June 06, 2024
8 Best Automated Android App Testing Tool and Framework in 2024.pdf
Regarding mobile operating systems, two major players dominate our thoughts: Android and iPhone. With Android leading the market, software development companies are focused on delivering apps compatible with this OS. Ensuring an app's functionality across various Android devices, OS versions, and hardware specifications is critical, making Android app testing essential.
How Can Hiring A Mobile App Development Company Help Your Business Grow?
ToXSL Technologies is an award-winning Mobile App Development Company in Dubai that helps businesses reshape their digital possibilities with custom app services. As a top app development company in Dubai, we offer highly engaging iOS & Android app solutions. https://rb.gy/necdnt
Using Xen Hypervisor for Functional Safety
An update on making Xen hypervisor functionally safe and enhancing its usage in automotive and industrial use cases
Transform Your Communication with Cloud-Based IVR Solutions
Discover the power of Cloud-Based IVR Solutions to streamline communication processes. Embrace scalability and cost-efficiency while enhancing customer experiences with features like automated call routing and voice recognition. Accessible from anywhere, these solutions integrate seamlessly with existing systems, providing real-time analytics for continuous improvement. Revolutionize your communication strategy today with Cloud-Based IVR Solutions. Learn more at: https://thesmspoint.com/channel/cloud-telephony
Unveiling the Advantages of Agile Software Development.pdf
Learn about Agile Software Development's advantages. Simplify your workflow to spur quicker innovation. Jump right in! We have also discussed the advantages.
What is Master Data Management by PiLog Group
PiLog Group's Master Data Record Manager (MDRM) is a sophisticated enterprise solution designed to ensure data accuracy, consistency, and governance across various business functions. MDRM integrates advanced data management technologies to cleanse, classify, and standardize master data, thereby enhancing data quality and operational efficiency.
Fundamentals of Programming and Language Processors
Fundamentals of Programming and Language Processors
openEuler Case Study - The Journey to Supply Chain Security
openEuler Case Study - The Journey to Supply Chain Security
UI5con 2024 - Keynote: Latest News about UI5 and it’s Ecosystem
Learn about the latest innovations in and around OpenUI5/SAPUI5: UI5 Tooling, UI5 linter, UI5 Web Components, Web Components Integration, UI5 2.x, UI5 GenAI.
Recording:
https://www.youtube.com/live/MSdGLG2zLy8?si=INxBHTqkwHhxV5Ta&t=0
Measures in SQL (SIGMOD 2024, Santiago, Chile)
SQL has attained widespread adoption, but Business Intelligence tools still use their own higher level languages based upon a multidimensional paradigm. Composable calculations are what is missing from SQL, and we propose a new kind of column, called a measure, that attaches a calculation to a table. Like regular tables, tables with measures are composable and closed when used in queries.
SQL-with-measures has the power, conciseness and reusability of multidimensional languages but retains SQL semantics. Measure invocations can be expanded in place to simple, clear SQL.
To define the evaluation semantics for measures, we introduce context-sensitive expressions (a way to evaluate multidimensional expressions that is consistent with existing SQL semantics), a concept called evaluation context, and several operations for setting and modifying the evaluation context.
A talk at SIGMOD, June 9–15, 2024, Santiago, Chile
Authors: Julian Hyde (Google) and John Fremlin (Google)
https://doi.org/10.1145/3626246.3653374
Empowering Growth with Best Software Development Company in Noida - Deuglo
Do you want Software for your Business? Visit Deuglo
Deuglo has top Software Developers in India. They are experts in software development and help design and create custom Software solutions.
Deuglo follows seven steps methods for delivering their services to their customers. They called it the Software development life cycle process (SDLC).
Requirement — Collecting the Requirements is the first Phase in the SSLC process.
Feasibility Study — after completing the requirement process they move to the design phase.
Design — in this phase, they start designing the software.
Coding — when designing is completed, the developers start coding for the software.
Testing — in this phase when the coding of the software is done the testing team will start testing.
Installation — after completion of testing, the application opens to the live server and launches!
Maintenance — after completing the software development, customers start using the software.
Requirement Traceability in Xen Functional Safety
Using OpenFastTrace to trace requirements in Xen functional safety
How to write a program in any programming language
How to write a program in any programming language
Recently uploaded (20)
Mobile App Development Company In Noida | Drona Infotech
Mobile App Development Company In Noida | Drona Infotech
Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Energy consumption of Database Management - Florina Jonuzi
Energy consumption of Database Management - Florina Jonuzi
8 Best Automated Android App Testing Tool and Framework in 2024.pdf
8 Best Automated Android App Testing Tool and Framework in 2024.pdf
How Can Hiring A Mobile App Development Company Help Your Business Grow?
How Can Hiring A Mobile App Development Company Help Your Business Grow?
Transform Your Communication with Cloud-Based IVR Solutions
Transform Your Communication with Cloud-Based IVR Solutions
Unveiling the Advantages of Agile Software Development.pdf
Unveiling the Advantages of Agile Software Development.pdf
Fundamentals of Programming and Language Processors
Fundamentals of Programming and Language Processors
openEuler Case Study - The Journey to Supply Chain Security
openEuler Case Study - The Journey to Supply Chain Security
UI5con 2024 - Keynote: Latest News about UI5 and it’s Ecosystem
UI5con 2024 - Keynote: Latest News about UI5 and it’s Ecosystem
Empowering Growth with Best Software Development Company in Noida - Deuglo
Empowering Growth with Best Software Development Company in Noida - Deuglo
How to write a program in any programming language
How to write a program in any programming language
Serverless lessons learned #7 rate limiting
- 1. Rate Limiting ? Serverless on AWS lessons learned #7 Are you really production-ready?
- 2. Rate Limiting (or Throttling) is a widely adopted pattern to limit the amount of incoming requests.
- 3. Nearly every AWS API call is rate limited in some way. Sooner or later you will see something like this: RequestLimitExceeded
- 4. You will encounter rate limiting using the management API* and using a service API** * e.g. create DynamoDB tables **e.g. read data from a table
- 5. Some rate limits are fixed and some can change over time*. *e.g. throughput limits until autoscaling reacts.
- 7. You can’t avoid rate limiting. You should minimize the occurrences and adapt your services to handle them properly!
- 8. AWS SDK already handles rate limiting and retries after a short delay*. You can customize this behavior if needed. *see description for details
- 9. For 3rd party APIs with rate limiting, think about implementing a retry strategy with exponential backoff.
- 10. Define, implement and test rate limits for your own APIs*. Make them part of your service requirements. *see description for custom rate limits with AWS API-Gateway
- 11. Rate Limiting ?
- 12. thumbs up, comment, share What are your thoughts? Is anything important missing? If you liked it, please leave a comment. connect with me!