How we approached the problem of building a reliable system that must deal with complex failures, and must scale, while keeping our (Clojure) codebase simple, extensible, and verifiable. Without losing our minds.
Load Testing Serverless Applications And Understanding How Lambda ScalesVishnu Prasad
This document discusses load testing serverless applications and understanding how AWS Lambda scales. It begins with an introduction to load testing and why it is important. Common load testing tools like JMeter, Locust, and Artillery are mentioned. Serverless Artillery, which combines the Serverless Framework and Artillery for serverless load testing, is presented. The document demonstrates load testing a simple serverless application. It then explains how Lambda scales under increasing loads by increasing concurrency up to 3000 instances. Provisioned concurrency is introduced as a way to initialize a set number of Lambda execution environments.
Demonstration to show a conversation between ProIV and Alexa (Amazon Echo)
PROIV is the low-code platform that gets you from idea to reality faster than you ever imagined.
In the ever fast paced software development, Serverless came in as a boon, enabling developers concentrate primarily on the business logic and nothing more! This only calls for a stringent process flow, making Continuous Development, Countinous Integration and Continuous Delivery highly advisable. This talk will focus on local testing of the serverless functions and their associated services locally.
Continuing our series of mistakes, important pieces, and concepts for production-ready serverless projects in 2022.
"exponential backoff"
In-depth backoff and jitter comparison: https://lnkd.in/disA6tQq
AWS SDK (node) custom backoff: https://lnkd.in/dFrMbGfs
(DVO205) Monitoring Evolution: Flying Blind to Flying by InstrumentAmazon Web Services
Today, AdRoll runs its infrastructure by instrumentation: constantly asking empirical questions, analyzing data for answers, and designing new features with instrumentation in mind to understand how functionality will work upon release. AdRoll’s development methodology did not start out this way, however. It took a cultural shift and many new tools and processes to adopt this approach. In this session, AdRoll and Datadog will discuss how to evolve your organization from a state of “flying blind” to a culture focused on monitoring and data-based decisions. Session sponsored by Datadog.
Rob Gruhl and Erik Erikson - What We Learned in 18 Serverless Months at Nords...ServerlessConf
This document summarizes Nordstrom's experience with serverless technologies over the past 18 months. Some key lessons learned include that serverless architectures can reduce the amount of code needed for features, require work to ensure high availability, and make tweaking performance easy and cost-effective. Challenges include shared computing limits, API Gateway restrictions, and difficulty debugging distributed applications. Nordstrom hopes to see improvements in transparency, deployment tools, security guidance, and documentation from serverless platform providers.
How and why test Azure Front Door with AWS Lambda & PowerShell? | Osman Sahin...UK DevOps Collective
Osman Sahin, a regular attendee of our events, explains how and why he is using AWS Lambda & PowerShell to test the new Azure Front Door service.
Presented Wednesday 28th July 2019 at the London PowerShell User Group Meetup hosted by dotdigital Group.
Connect with Osman Sahin:
- LinkedIn: https://www.linkedin.com/in/osmanysahin/
Thanks to dotdigital Group (https://dotdigital.com / https://twitter.com/dotdigital) for providing the venue, food and drinks. We very much appreciate your continued support of our community of PowerShell & DevOps tech enthusiasts.
Join our next event at https://www.meetup.com/PowerShell-London-UK/. We are running at least one Meetup every month.
#PowerShell #Azure #AWS #DevOps
Load Testing Serverless Applications And Understanding How Lambda ScalesVishnu Prasad
This document discusses load testing serverless applications and understanding how AWS Lambda scales. It begins with an introduction to load testing and why it is important. Common load testing tools like JMeter, Locust, and Artillery are mentioned. Serverless Artillery, which combines the Serverless Framework and Artillery for serverless load testing, is presented. The document demonstrates load testing a simple serverless application. It then explains how Lambda scales under increasing loads by increasing concurrency up to 3000 instances. Provisioned concurrency is introduced as a way to initialize a set number of Lambda execution environments.
Demonstration to show a conversation between ProIV and Alexa (Amazon Echo)
PROIV is the low-code platform that gets you from idea to reality faster than you ever imagined.
In the ever fast paced software development, Serverless came in as a boon, enabling developers concentrate primarily on the business logic and nothing more! This only calls for a stringent process flow, making Continuous Development, Countinous Integration and Continuous Delivery highly advisable. This talk will focus on local testing of the serverless functions and their associated services locally.
Continuing our series of mistakes, important pieces, and concepts for production-ready serverless projects in 2022.
"exponential backoff"
In-depth backoff and jitter comparison: https://lnkd.in/disA6tQq
AWS SDK (node) custom backoff: https://lnkd.in/dFrMbGfs
(DVO205) Monitoring Evolution: Flying Blind to Flying by InstrumentAmazon Web Services
Today, AdRoll runs its infrastructure by instrumentation: constantly asking empirical questions, analyzing data for answers, and designing new features with instrumentation in mind to understand how functionality will work upon release. AdRoll’s development methodology did not start out this way, however. It took a cultural shift and many new tools and processes to adopt this approach. In this session, AdRoll and Datadog will discuss how to evolve your organization from a state of “flying blind” to a culture focused on monitoring and data-based decisions. Session sponsored by Datadog.
Rob Gruhl and Erik Erikson - What We Learned in 18 Serverless Months at Nords...ServerlessConf
This document summarizes Nordstrom's experience with serverless technologies over the past 18 months. Some key lessons learned include that serverless architectures can reduce the amount of code needed for features, require work to ensure high availability, and make tweaking performance easy and cost-effective. Challenges include shared computing limits, API Gateway restrictions, and difficulty debugging distributed applications. Nordstrom hopes to see improvements in transparency, deployment tools, security guidance, and documentation from serverless platform providers.
How and why test Azure Front Door with AWS Lambda & PowerShell? | Osman Sahin...UK DevOps Collective
Osman Sahin, a regular attendee of our events, explains how and why he is using AWS Lambda & PowerShell to test the new Azure Front Door service.
Presented Wednesday 28th July 2019 at the London PowerShell User Group Meetup hosted by dotdigital Group.
Connect with Osman Sahin:
- LinkedIn: https://www.linkedin.com/in/osmanysahin/
Thanks to dotdigital Group (https://dotdigital.com / https://twitter.com/dotdigital) for providing the venue, food and drinks. We very much appreciate your continued support of our community of PowerShell & DevOps tech enthusiasts.
Join our next event at https://www.meetup.com/PowerShell-London-UK/. We are running at least one Meetup every month.
#PowerShell #Azure #AWS #DevOps
AWS Community Day Bangkok 2019 - DevOps Cost Reduction using Jenkins & AWS Sp...AWS User Group - Thailand
This document discusses using Jenkins and AWS Spot Fleet to reduce DevOps costs. It recommends running Jenkins in a containerized, autoscaling architecture on AWS Spot Instances using the ec2-spot-jenkins plugin. This provides high availability, scalability, and cost optimization of up to 90% compared to on-demand instances while maintaining low maintenance. The document outlines how to set this up and provides an official AWS workshop lab to help with the implementation.
Shipping apps to eks with code pipeline and lambda functionsŠtěpán Vraný
The document discusses deploying containerized applications to Amazon EKS. It notes that Kubernetes has become the leading container orchestration tool, with 75% of organizations expected to use it by 2022. The document then outlines a multi-step manual deployment process and argues that continuous delivery practices using AWS services like CodeCommit, CodeBuild, Lambda, and CodePipeline can simplify and automate deployments to EKS. It concludes with promising a demonstration of this approach.
Those are the decks used to explain API Gateway + Lambda + internal load balancer integration. AWS meetup, Cordoba Argentina.
Follow us
https://dinocloudconsulting.com/
https://www.facebook.com/dinocloudcons
https://www.instagram.com/dinocloud_/
https://twitter.com/dinocloud_
Vorathep introduces himself as a remote software engineer and shares some personal details. He then provides an overview of serverless computing on AWS Lambda, describing how lambda functions are triggered by events and execute code without needing to manage servers. Vorathep explains that ClaudiaJS is a NodeJS tool that helps deploy lambda functions through the CLI and manage versions and permissions through code. Finally, he offers to connect further and shares his contact information.
Choosing the right messaging service for your serverless app [with lumigo]Dhaval Nagar
This document summarizes a presentation about choosing the right messaging service for serverless applications. It discusses serverless and event-driven architectures, and how functions are executed in response to events through messaging services. It then covers the main AWS messaging services: Amazon SQS for message queues, Amazon SNS for publish/subscribe, and Amazon EventBridge for managing events. It provides examples of how these services can be used with Lambda and discusses factors for selecting the appropriate service. Monitoring serverless applications is also discussed.
This document provides an overview of serverless computing using Azure Functions. It discusses the benefits of serverless such as increased server utilization, instant scaling, and reduced time to market. Serverless allows developers to focus on business logic rather than managing servers. Azure Functions is introduced as a way to develop serverless applications using triggers and bindings in languages like C#, Node.js, Python and more. Common serverless patterns are also presented.
Ben Kehoe - Serverless Architecture for the Internet of ThingsServerlessConf
Presented at ServerlessConf NYC 2016.
iRobot is transitioning the cloud infrastructure for our IoT system to AWS with the goal of using zero EC2 instances. I'll cover our general architecture (AWS IoT, API Gateway, Lambda, etc.), our CloudFormation+Lambda deployment strategy, and the hardest patterns to make serverless on AWS.
The document discusses some challenges, or "gaps", in the serverless development lifecycle including access and permission management, collaboration mechanisms, testing, and monitoring/instrumentation. It presents these gaps as problems that serverless applications currently face and offers some solutions. For access and permission management, it suggests using a framework that automatically generates necessary permissions at deployment time. For collaboration, it proposes automatically namespacing resource names. For testing, it advises implementing integration tests locally using service fakes when possible. And for monitoring, it recommends letting frameworks automatically instrument functions according to defined rules. The overall message is that while serverless applications present new challenges, frameworks can help address these gaps to streamline the development process.
My talk in Prague focused on the challenges we had with Code Deployments in the past and how we managed to solve them by leveraging AWS as our backbone.
This document discusses managing continuous delivery of code to AWS Lambda using key AWS services. It provides an overview of continuous delivery and describes AWS CodePipeline for modeling release processes. The webinar demonstrates a sample serverless application pipeline using CodePipeline and Lambda and discusses tips for implementing continuous delivery with these services, including using Lambda functions in CodePipeline actions and API/function versioning strategies.
AWS Community Day Bangkok 2019 - Build a Serverless Web Application in 30 minsAWS User Group - Thailand
This document provides instructions for building a serverless web application on AWS in 30 minutes. It includes an overview of the AWS services that will be used - S3 for static hosting, API Gateway, Lambda, DynamoDB, and CloudFront. The agenda outlines setting up S3, CloudFront, DynamoDB, Lambda, and API Gateway. Code samples and screenshots are provided to demonstrate configuring the services and integrating them to build a serverless web app that retrieves and displays data from DynamoDB through API Gateway and Lambda.
This document discusses the DevOps philosophy and how it can increase producibility. It defines DevOps as combining cultural philosophies, practices, and tools to increase an organization's ability to deliver applications and services at high velocity. Key aspects of DevOps include breaking down silos between development, QA, security and operations teams; continuous integration and delivery pipelines; automation; and real-time feedback to enable rapid, reliable, and secure delivery of updates. Many DevOps tools are available as managed services on AWS, including CodeCommit, CodeBuild, CodeDeploy, CodePipeline, CloudFormation, and CodeStar, which can help implement DevOps practices.
AWS Lambda is Amazon's serverless computing platform that allows you to run code without provisioning or managing servers. Code is run in response to events and AWS automatically manages the computing resources. Key advantages are only paying for the compute time used and not having to manage servers. Lambda supports Node.js, Python, Java, and C# and functions can be triggered by events from services like S3, DynamoDB, and API Gateway. Functions are configured and coded within the Lambda management console. Pricing is based on number of requests and compute time used, with the first million requests and 400,000 GB-seconds of compute time being free each month.
The document discusses AWS Lambda, a serverless computing service that allows users to upload code that can be executed in response to events. It provides an overview of Lambda's advantages like flexible scaling and pay-per-use model. The document then explains how to create a Lambda function by selecting a programming language, coding the function, configuring settings like memory and timeout, and attaching triggers to specify when the function should execute. Finally, it promises a real-world example to demonstrate Lambda.
Adopting DevOps in an organization can start in many ways but from the technical perspective, a solid continuous integration environment is the mandatory foundation for many of the tools used by a DevOps team. This webinar shows how to build a continuous integration environment on Amazon Web Services (AWS) using services such as Amazon EC2, Amazon RDS and AWS CloudFormation. We also cover the benefits of using Amazon VPC to enable VPN access to the environment components, such as the source code repository, or the issue tracking database.
Demos included in this webinar:
- Building a core continuous integration environment with components such as Jenkins, Git and Bugzila, using Amazon EC2, Amazon RDS and Amazon CloudFormation.
- Baseline maintenance of the continuous integration environment.
View the Recording: http://youtu.be/5dJxhX1ChT4
The document discusses serverless architectures and function as a service (FaaS) platforms, providing examples of using Apache OpenWhisk to run Python code that retweets tweets containing a hashtag in response to events and describing how serverless technologies can be used to build chatbots that integrate with services like Amazon Lex. It also outlines some common use cases for serverless computing including real-time processing of tweets and periodic triggers to run code on a schedule.
Another day, another buzzword in the world of software development! ‘Microservices’ is a new approach to structuring server-side software. But is it really new? In this talk I’ll walk you through the birth and ‘raison d’etre’ of microservices and tell about pro’s and con’s of the approach.
Having laid the foundation, we will take a look at best-practices and patterns for building micro service architectures and combine this with a tour of current technologies and development tools.
Finally, I will take a quick look at the future and discuss some of the remaining challenges. All parts of the presentation will be accompanied by structural examples based on a real ecommerse system.
Artificial Intelligence & Machine learning foundation topic in AWS Varun Manik
Varun Kumar is a senior consultant at Deloitte SEA and an AWS APN ambassador. He has over 10 years of experience in DevOps. He holds several AWS certifications and a master's degree in computer science. Some of his responsibilities include leading cloud migrations, building DevOps capabilities, and automating AWS tasks. He regularly conducts training sessions and shares his cloud knowledge.
Applying ML on your Data in Motion with AWS and Confluent | Joseph Morais, Co...HostedbyConfluent
Event-driven application architectures are becoming increasingly common as a large number of users demand more interactive, real-time, and intelligent responses. Yet it can be challenging to decide how to capture and perform real-time data analysis and deliver differentiating experiences. Join experts from Confluent and AWS to learn how to build Apache Kafka®-based streaming applications backed by machine learning models. Adopting the recommendations will help you establish repeatable patterns for high performing event-based apps.
Building and Scaling a WebSockets Pubsub SystemKapil Reddy
Talk about how we built and maintained a WebSockets platform on AWS infra.
You can will learn insights about,
* How to build and evovle a WebSockets platform on AWS
* How we made the platform more resilient to failures known and unknown
* How we saved costs by using right strategy for auto-scaling and load balancing
* How to monitor a WebSockets platform
AWS Community Day Bangkok 2019 - DevOps Cost Reduction using Jenkins & AWS Sp...AWS User Group - Thailand
This document discusses using Jenkins and AWS Spot Fleet to reduce DevOps costs. It recommends running Jenkins in a containerized, autoscaling architecture on AWS Spot Instances using the ec2-spot-jenkins plugin. This provides high availability, scalability, and cost optimization of up to 90% compared to on-demand instances while maintaining low maintenance. The document outlines how to set this up and provides an official AWS workshop lab to help with the implementation.
Shipping apps to eks with code pipeline and lambda functionsŠtěpán Vraný
The document discusses deploying containerized applications to Amazon EKS. It notes that Kubernetes has become the leading container orchestration tool, with 75% of organizations expected to use it by 2022. The document then outlines a multi-step manual deployment process and argues that continuous delivery practices using AWS services like CodeCommit, CodeBuild, Lambda, and CodePipeline can simplify and automate deployments to EKS. It concludes with promising a demonstration of this approach.
Those are the decks used to explain API Gateway + Lambda + internal load balancer integration. AWS meetup, Cordoba Argentina.
Follow us
https://dinocloudconsulting.com/
https://www.facebook.com/dinocloudcons
https://www.instagram.com/dinocloud_/
https://twitter.com/dinocloud_
Vorathep introduces himself as a remote software engineer and shares some personal details. He then provides an overview of serverless computing on AWS Lambda, describing how lambda functions are triggered by events and execute code without needing to manage servers. Vorathep explains that ClaudiaJS is a NodeJS tool that helps deploy lambda functions through the CLI and manage versions and permissions through code. Finally, he offers to connect further and shares his contact information.
Choosing the right messaging service for your serverless app [with lumigo]Dhaval Nagar
This document summarizes a presentation about choosing the right messaging service for serverless applications. It discusses serverless and event-driven architectures, and how functions are executed in response to events through messaging services. It then covers the main AWS messaging services: Amazon SQS for message queues, Amazon SNS for publish/subscribe, and Amazon EventBridge for managing events. It provides examples of how these services can be used with Lambda and discusses factors for selecting the appropriate service. Monitoring serverless applications is also discussed.
This document provides an overview of serverless computing using Azure Functions. It discusses the benefits of serverless such as increased server utilization, instant scaling, and reduced time to market. Serverless allows developers to focus on business logic rather than managing servers. Azure Functions is introduced as a way to develop serverless applications using triggers and bindings in languages like C#, Node.js, Python and more. Common serverless patterns are also presented.
Ben Kehoe - Serverless Architecture for the Internet of ThingsServerlessConf
Presented at ServerlessConf NYC 2016.
iRobot is transitioning the cloud infrastructure for our IoT system to AWS with the goal of using zero EC2 instances. I'll cover our general architecture (AWS IoT, API Gateway, Lambda, etc.), our CloudFormation+Lambda deployment strategy, and the hardest patterns to make serverless on AWS.
The document discusses some challenges, or "gaps", in the serverless development lifecycle including access and permission management, collaboration mechanisms, testing, and monitoring/instrumentation. It presents these gaps as problems that serverless applications currently face and offers some solutions. For access and permission management, it suggests using a framework that automatically generates necessary permissions at deployment time. For collaboration, it proposes automatically namespacing resource names. For testing, it advises implementing integration tests locally using service fakes when possible. And for monitoring, it recommends letting frameworks automatically instrument functions according to defined rules. The overall message is that while serverless applications present new challenges, frameworks can help address these gaps to streamline the development process.
My talk in Prague focused on the challenges we had with Code Deployments in the past and how we managed to solve them by leveraging AWS as our backbone.
This document discusses managing continuous delivery of code to AWS Lambda using key AWS services. It provides an overview of continuous delivery and describes AWS CodePipeline for modeling release processes. The webinar demonstrates a sample serverless application pipeline using CodePipeline and Lambda and discusses tips for implementing continuous delivery with these services, including using Lambda functions in CodePipeline actions and API/function versioning strategies.
AWS Community Day Bangkok 2019 - Build a Serverless Web Application in 30 minsAWS User Group - Thailand
This document provides instructions for building a serverless web application on AWS in 30 minutes. It includes an overview of the AWS services that will be used - S3 for static hosting, API Gateway, Lambda, DynamoDB, and CloudFront. The agenda outlines setting up S3, CloudFront, DynamoDB, Lambda, and API Gateway. Code samples and screenshots are provided to demonstrate configuring the services and integrating them to build a serverless web app that retrieves and displays data from DynamoDB through API Gateway and Lambda.
This document discusses the DevOps philosophy and how it can increase producibility. It defines DevOps as combining cultural philosophies, practices, and tools to increase an organization's ability to deliver applications and services at high velocity. Key aspects of DevOps include breaking down silos between development, QA, security and operations teams; continuous integration and delivery pipelines; automation; and real-time feedback to enable rapid, reliable, and secure delivery of updates. Many DevOps tools are available as managed services on AWS, including CodeCommit, CodeBuild, CodeDeploy, CodePipeline, CloudFormation, and CodeStar, which can help implement DevOps practices.
AWS Lambda is Amazon's serverless computing platform that allows you to run code without provisioning or managing servers. Code is run in response to events and AWS automatically manages the computing resources. Key advantages are only paying for the compute time used and not having to manage servers. Lambda supports Node.js, Python, Java, and C# and functions can be triggered by events from services like S3, DynamoDB, and API Gateway. Functions are configured and coded within the Lambda management console. Pricing is based on number of requests and compute time used, with the first million requests and 400,000 GB-seconds of compute time being free each month.
The document discusses AWS Lambda, a serverless computing service that allows users to upload code that can be executed in response to events. It provides an overview of Lambda's advantages like flexible scaling and pay-per-use model. The document then explains how to create a Lambda function by selecting a programming language, coding the function, configuring settings like memory and timeout, and attaching triggers to specify when the function should execute. Finally, it promises a real-world example to demonstrate Lambda.
Adopting DevOps in an organization can start in many ways but from the technical perspective, a solid continuous integration environment is the mandatory foundation for many of the tools used by a DevOps team. This webinar shows how to build a continuous integration environment on Amazon Web Services (AWS) using services such as Amazon EC2, Amazon RDS and AWS CloudFormation. We also cover the benefits of using Amazon VPC to enable VPN access to the environment components, such as the source code repository, or the issue tracking database.
Demos included in this webinar:
- Building a core continuous integration environment with components such as Jenkins, Git and Bugzila, using Amazon EC2, Amazon RDS and Amazon CloudFormation.
- Baseline maintenance of the continuous integration environment.
View the Recording: http://youtu.be/5dJxhX1ChT4
The document discusses serverless architectures and function as a service (FaaS) platforms, providing examples of using Apache OpenWhisk to run Python code that retweets tweets containing a hashtag in response to events and describing how serverless technologies can be used to build chatbots that integrate with services like Amazon Lex. It also outlines some common use cases for serverless computing including real-time processing of tweets and periodic triggers to run code on a schedule.
Another day, another buzzword in the world of software development! ‘Microservices’ is a new approach to structuring server-side software. But is it really new? In this talk I’ll walk you through the birth and ‘raison d’etre’ of microservices and tell about pro’s and con’s of the approach.
Having laid the foundation, we will take a look at best-practices and patterns for building micro service architectures and combine this with a tour of current technologies and development tools.
Finally, I will take a quick look at the future and discuss some of the remaining challenges. All parts of the presentation will be accompanied by structural examples based on a real ecommerse system.
Artificial Intelligence & Machine learning foundation topic in AWS Varun Manik
Varun Kumar is a senior consultant at Deloitte SEA and an AWS APN ambassador. He has over 10 years of experience in DevOps. He holds several AWS certifications and a master's degree in computer science. Some of his responsibilities include leading cloud migrations, building DevOps capabilities, and automating AWS tasks. He regularly conducts training sessions and shares his cloud knowledge.
Applying ML on your Data in Motion with AWS and Confluent | Joseph Morais, Co...HostedbyConfluent
Event-driven application architectures are becoming increasingly common as a large number of users demand more interactive, real-time, and intelligent responses. Yet it can be challenging to decide how to capture and perform real-time data analysis and deliver differentiating experiences. Join experts from Confluent and AWS to learn how to build Apache Kafka®-based streaming applications backed by machine learning models. Adopting the recommendations will help you establish repeatable patterns for high performing event-based apps.
Building and Scaling a WebSockets Pubsub SystemKapil Reddy
Talk about how we built and maintained a WebSockets platform on AWS infra.
You can will learn insights about,
* How to build and evovle a WebSockets platform on AWS
* How we made the platform more resilient to failures known and unknown
* How we saved costs by using right strategy for auto-scaling and load balancing
* How to monitor a WebSockets platform
Five Early Challenges Of Building Streaming Fast Data ApplicationsLightbend
This webinar discusses five early challenges of building streaming fast data applications: 1) choosing among alternative streaming frameworks like Kafka Streams, Spark Streaming, and Flink; 2) integrating microservices with streaming services; 3) understanding operational challenges of streaming services; 4) gaining competitive advantage through machine learning on fast data; and 5) optimizing resource utilization across large clusters running many components. The webinar promotes Lightbend's Fast Data Platform as providing an easy on-ramp and complete solution for these challenges.
Using Kubernetes to deliver a “serverless” serviceDoKC
Serverless promises to change the way we consume software. It allows us to potentially pay for only that which we use and can help drive down operational costs to the minimal amount of resources necessary.
Architecting for serverless requires a unique look at app logic and the way it is deployed. It takes a combination of the logical and physical worlds. An architectural pattern has emerged where we can scale ephemeral compute separate from services that need to persist.
We use Kubernetes to deliver exactly this. A “serverless” experience that is driven and enabled by compute pods and storage pods. We also have used our experience running thousands of database clusters on Kubernetes to automate the operational expertise of managing a distributed database.
In this talk, we will take a dive deep into the architecture of our application and share:
* A definition and outline of the challenges of serverless
* How we reworked our logic for a serverless approach
* How we use Kubernetes to gain serverless autoscaling
This talk was given by Jim Walker for DoK Day Europe @ KubeCon 2022.
AWS re:Invent 2016: AWS Database State of the Union (DAT320)Amazon Web Services
Raju Gulabani, vice president of AWS Database Services (AWS), discusses the evolution of database services on AWS and the new database services and features we launched this year, and shares our vision for continued innovation in this space. We are witnessing an unprecedented growth in the amount of data collected, in many different shapes and forms. Storage, management, and analysis of this data requires database services that scale and perform in ways not possible before. AWS offers a collection of such database and other data services like Amazon Aurora, Amazon DynamoDB, Amazon RDS, Amazon Redshift, Amazon ElastiCache, Amazon Kinesis, and Amazon EMR to process, store, manage, and analyze data. In this session, we provide an overview of AWS database services and discuss how our customers are using these services today.
This document provides guidance on scaling a web application from 1 user to over 10 million users on AWS. It recommends starting simply with a single EC2 instance and Route 53, then adding redundancy with multiple instances, load balancing, and SQL databases. As users grow over 1,000 techniques like caching, NoSQL, and auto scaling are introduced. Above 500,000 users more services are split out and automated. Reaching over 1 million requires database sharding or federation. The key strategies emphasized are redundancy, automation, splitting services, and leveraging managed AWS services over custom solutions.
Cloud computing gives you a number of advantages, such as the ability to scale your web application or website on demand. If you have a new web application and want to use cloud computing, you might be asking yourself, "Where do I start?" Join us in this session to understand best practices for scaling your resources from zero to millions of users. We show you how to best combine different AWS services, how to make smarter decisions for architecting your application, and how to scale your infrastructure in the cloud.
Modern Cloud-Native Streaming Platforms: Event Streaming Microservices with K...confluent
Microservices, events, containers, and orchestrators are dominating our vernacular today. As operations teams adapt to support these technologies in production, cloud-native platforms like Cloud Foundry and Kubernetes have quickly risen to serve as force multipliers of automation, productivity and value. Kafka is providing developers a critically important component as they build and modernize applications to cloud-native architecture. This talk will explore:
• Why cloud-native platforms and why run Kafka on Kubernetes?
• What kind of workloads are best suited for this combination?
• Tips to determine the path forward for legacy monoliths in your application portfolio
• Running Kafka as a Streaming Platform on Container Orchestration
Over 100 million subscribers from over 190 countries enjoy the Netflix service. This leads to over a trillion events, amounting to 3 PB, flowing through the Keystone infrastructure to help improve customer experience and glean business insights. The self-serve Keystone stream processing service processes these messages in near real-time with at-least once semantics in the cloud. This enables the users to focus on extracting insights, and not worry about building out scalable infrastructure. I’ll share the details about this platform, and our experience building it.
This document discusses testing strategies for data pipelines at scale. It recommends (1) communicating a testing strategy, (2) removing barriers to testing, (3) pursuing great staging environments, and (4) continuous end-to-end testing using a tool called Kafka Detective. Kafka Detective enables end-to-end testing by comparing data between staging and production Kafka topics and reporting any differences. The author details how Kafka Detective has found real issues in their pipelines and shares its features and roadmap for supporting more use cases.
Shattering The Monolith(s) (Martin Kess, Namely) Kafka Summit SF 2019 confluent
Namely is a late-stage startup that builds HR, Payroll and Benefits software for mid-sized businesses. Over the years, we've ended up with a number of monolithic and legacy applications covering overlapping domain concepts, which has limited our ability to deliver new and innovative features to our customers. We need a way to get our data out of the monoliths to decouple our systems and increase our velocity. We've chosen Kafka as our way to liberate our data in a reliable, scalable and maintainable way. This talk covers specific examples of successes and missteps in our move to Kafka as the backbone of our architecture. It then looks to the future - where we are trying to go, and how we plan on getting, both from the short term and long term perspectives. Key Takeaways: - Successful and unsuccessful approaches to gradually introducing Kafka to a large organization in a way that meets the short and long term needs of the business. - Successful and unsuccessful patterns for using Kafka. - Pragmaticism versus purisim: Building Kafka-first systems, and migrating legacy systems to Kafka with Debezium. - Combining event driven systems with RPC based systems. Observability, alerting and testing. - Actionable steps that you can take to your organization to help drive adoption.
Johan Edstrom discussed scaling applications by making them more asynchronous and distributed. He covered several Apache projects like Camel, Karaf, ActiveMQ, Cassandra and CXF that can help achieve this. Specifically, he showed how to:
1. Use Camel and OSGi to build asynchronous microservices that communicate via an enterprise integration pattern like a message queue.
2. Store data in Cassandra for asynchronous and high-performance access across data centers.
3. Expose APIs asynchronously using CXF and handle requests with non-blocking techniques like futures.
4. Offload business logic to an asynchronous process running on a distributed cache like HazelCast for shared data and parallel processing across nodes
The document discusses best practices for developing minimum viable products (MVPs) on AWS. It recommends releasing quickly with limited core features, iterating in production, and basing business decisions on data. It advocates decomposing monolithic architectures into loosely coupled microservices and using AWS services for undifferentiated heavy lifting to focus on core differentiators. Building block services like compute, storage, databases, and analytics are discussed. Development approaches like infrastructure as code, continuous integration/delivery, and automation are presented to help deliver changes continuously and safely to production.
Apinizer - Full API Lifecycle and Integration Platform Mustafa Yildiz
A brief presentation about Apinizer, which has API Gateway, Instant API Creator, API Monitor, API Tester, API Designer, API Analytics and API Portal modules
Liveperson has successfully adopted OpenStack over the past year to power its infrastructure. It now runs 100% of its services on OpenStack, including web and application servers supporting chat, marketing, and voice products for its 8,500 customers. Liveperson's OpenStack deployment has grown from 5 hosts and 80 VMs to over 300 hosts and 2,000 VMs. The company achieved its goals of a scalable, cost-efficient infrastructure using commodity servers to power its core SaaS business.
Cloud computing gives you a number of advantages, such as the ability to scale your web application or website on demand. If you have a new web application and want to use cloud computing, you might be asking yourself, "Where do I start?" Join us in this session to understand best practices for scaling your resources from zero to millions of users. We show you how to best combine different AWS services, how to make smarter decisions for architecting your application, and how to scale your infrastructure in the cloud.
Couchbase Singapore Meetup #2: Why Developing with Couchbase is easy !! Karthik Babu Sekar
The document discusses new features and improvements in Couchbase 4.6, including timestamp-based conflict resolution for cross datacenter replication, secret management and pluggable authentication modules for security, and new CBImport and CBExport tools. It also covers updates to search and query functionality.
Cloud computing gives you a number of advantages, such as the ability to scale your web application or website on demand. If you have a new web application and want to use cloud computing, you might be asking yourself, "Where do I start?" Join us in this session to understand best practices for scaling your resources from zero to millions of users. We show you how to best combine different AWS services, how to make smarter decisions for architecting your application, and how to scale your infrastructure in the cloud.
Data Streaming with Apache Kafka & MongoDB - EMEAAndrew Morgan
A new generation of technologies is needed to consume and exploit today's real time, fast moving data sources. Apache Kafka, originally developed at LinkedIn, has emerged as one of these key new technologies.
This webinar explores the use-cases and architecture for Kafka, and how it integrates with MongoDB to build sophisticated data-driven applications that exploit new sources of data.
Webinar: Data Streaming with Apache Kafka & MongoDBMongoDB
A new generation of technologies is needed to consume and exploit today's real time, fast moving data sources. Apache Kafka, originally developed at LinkedIn, has emerged as one of these key new technologies.
Similar to Building a reliable, scalable service with Clojure and Core.async (20)
Unveiling the Advantages of Agile Software Development.pdfbrainerhub1
Learn about Agile Software Development's advantages. Simplify your workflow to spur quicker innovation. Jump right in! We have also discussed the advantages.
How Can Hiring A Mobile App Development Company Help Your Business Grow?ToXSL Technologies
ToXSL Technologies is an award-winning Mobile App Development Company in Dubai that helps businesses reshape their digital possibilities with custom app services. As a top app development company in Dubai, we offer highly engaging iOS & Android app solutions. https://rb.gy/necdnt
Most important New features of Oracle 23c for DBAs and Developers. You can get more idea from my youtube channel video from https://youtu.be/XvL5WtaC20A
Flutter is a popular open source, cross-platform framework developed by Google. In this webinar we'll explore Flutter and its architecture, delve into the Flutter Embedder and Flutter’s Dart language, discover how to leverage Flutter for embedded device development, learn about Automotive Grade Linux (AGL) and its consortium and understand the rationale behind AGL's choice of Flutter for next-gen IVI systems. Don’t miss this opportunity to discover whether Flutter is right for your project.
Using Query Store in Azure PostgreSQL to Understand Query PerformanceGrant Fritchey
Microsoft has added an excellent new extension in PostgreSQL on their Azure Platform. This session, presented at Posette 2024, covers what Query Store is and the types of information you can get out of it.
Artificia Intellicence and XPath Extension FunctionsOctavian Nadolu
The purpose of this presentation is to provide an overview of how you can use AI from XSLT, XQuery, Schematron, or XML Refactoring operations, the potential benefits of using AI, and some of the challenges we face.
UI5con 2024 - Bring Your Own Design SystemPeter Muessig
How do you combine the OpenUI5/SAPUI5 programming model with a design system that makes its controls available as Web Components? Since OpenUI5/SAPUI5 1.120, the framework supports the integration of any Web Components. This makes it possible, for example, to natively embed own Web Components of your design system which are created with Stencil. The integration embeds the Web Components in a way that they can be used naturally in XMLViews, like with standard UI5 controls, and can be bound with data binding. Learn how you can also make use of the Web Components base class in OpenUI5/SAPUI5 to also integrate your Web Components and get inspired by the solution to generate a custom UI5 library providing the Web Components control wrappers for the native ones.
UI5con 2024 - Keynote: Latest News about UI5 and it’s EcosystemPeter Muessig
Learn about the latest innovations in and around OpenUI5/SAPUI5: UI5 Tooling, UI5 linter, UI5 Web Components, Web Components Integration, UI5 2.x, UI5 GenAI.
Recording:
https://www.youtube.com/live/MSdGLG2zLy8?si=INxBHTqkwHhxV5Ta&t=0
WWDC 2024 Keynote Review: For CocoaCoders AustinPatrick Weigel
Overview of WWDC 2024 Keynote Address.
Covers: Apple Intelligence, iOS18, macOS Sequoia, iPadOS, watchOS, visionOS, and Apple TV+.
Understandable dialogue on Apple TV+
On-device app controlling AI.
Access to ChatGPT with a guest appearance by Chief Data Thief Sam Altman!
App Locking! iPhone Mirroring! And a Calculator!!
Measures in SQL (SIGMOD 2024, Santiago, Chile)Julian Hyde
SQL has attained widespread adoption, but Business Intelligence tools still use their own higher level languages based upon a multidimensional paradigm. Composable calculations are what is missing from SQL, and we propose a new kind of column, called a measure, that attaches a calculation to a table. Like regular tables, tables with measures are composable and closed when used in queries.
SQL-with-measures has the power, conciseness and reusability of multidimensional languages but retains SQL semantics. Measure invocations can be expanded in place to simple, clear SQL.
To define the evaluation semantics for measures, we introduce context-sensitive expressions (a way to evaluate multidimensional expressions that is consistent with existing SQL semantics), a concept called evaluation context, and several operations for setting and modifying the evaluation context.
A talk at SIGMOD, June 9–15, 2024, Santiago, Chile
Authors: Julian Hyde (Google) and John Fremlin (Google)
https://doi.org/10.1145/3626246.3653374
3. About me - Kapil
Staff Engineer @ Helpshift
Clojure
Distributed Systems
Games
Music
Books/Comics
Football
4. Helpshift is a Mobile CRM SaaS product. We help connect app developers with their customers. Since everything is now on mobile.
5. • 600M+ MAU
• 60k RPS
• 500GB / day
Scale
These are some of the scale numbers we have reached at Helpshift.
6. Reliable
• Fail fast
• Detect non-recoverable errors
• Resilient
• Retries recoverable errors
• Backpressure
• Detect degraded state
At this scale services need to be reliable. We need to have exact control on how things behave under failure conditions.
7. Let’s take a look at the problem. We will build the solution to the problem iteratively once we understand the scope
We do a lot of writes to ElasticSearch but those writes can be done asynchronously. So application servers just push updates to a Kafka topic. We need write a Kafka
consumer that reads from the topic and performs writes to ElasticSearch. But wait! Elasticsearch has bulk api. So we need to write a Kafka consumer that bulk writes to
Elasticsearch.
8. Testing becomes simpler. It’s just putting things in channel and verifying FSM state
Test generate signals and data. Assertion is checking what state FSM goes into.
9. Scale
• V1 - 150 rps
• Today - 5k rps
Scaling a reliable service which recovers from error states is very simple. It’s basically Kafka consumer that can handle all the happy and unhappy paths. Scaling it means
just adding more instances of these services or FSMs in the same service.
10. Extensibility / Maintainability
• First version - 5 weeks
• MongoDB - 2 weeks
• Active maintainer - 1 engineer - 20% time
• In Production - 2 years
• LOC - 2k
• Project as a library
11. Summary
• Reliable system == Predictable failures and happy
paths
• Use CSP / core.async to decouple components
• Central FSM that receives all data and control
signals to take decisions