Serverless design considerations for Cloud Native workloadsTensult
We have built a news website with more than a billion views per month and we are sharing the learnings from that experience covering Serverless architectures, Design considerations, and Gotchas.
Amazon EC2 Container Service is a highly scalable, fast, container management service that makes it easy to run, stop, and manage Docker containers on a cluster of Amazon EC2 instances. Part of ECS is Amazon EC2 Container Registry (ECR). Amazon ECR is a fully-managed Docker container registry that makes it easy for developers to store, manage, and deploy Docker container images. This session will describe how you can use ECS and ECR for your applications.
Speaker: Sascha Möllering, Solutions Architect, AWS
Serverless design considerations for Cloud Native workloadsTensult
We have built a news website with more than a billion views per month and we are sharing the learnings from that experience covering Serverless architectures, Design considerations, and Gotchas.
Amazon EC2 Container Service is a highly scalable, fast, container management service that makes it easy to run, stop, and manage Docker containers on a cluster of Amazon EC2 instances. Part of ECS is Amazon EC2 Container Registry (ECR). Amazon ECR is a fully-managed Docker container registry that makes it easy for developers to store, manage, and deploy Docker container images. This session will describe how you can use ECS and ECR for your applications.
Speaker: Sascha Möllering, Solutions Architect, AWS
Intended for customers who have (or will have) thousands of instances on AWS, this session is about reducing the complexity of managing costs for these large fleets so they run efficiently. Attendees will learn about common roadblocks that prevent large customers from cost optimizing, tools they can use to efficiently remove those roadblocks, and techniques to monitor their rate of cost optimization. The session will include a case study that will talk in detail about the millions of dollars saved using these techniques. Customers will learn about a range of templates they can use to quickly implement these techniques, and also partners who can help them implement these templates.
by Harrell Stiles, Sr. Consultant, AWS ProServe
Batch computing is a common way to run a series of programs, called batch jobs, on a large pool of shared compute resources, such as servers, virtual machines, and containers. But running batch workloads at scale is a challenging task, configuring and scaling a cluster of virtual machines to process complex batch jobs is difficult and resource intensive. In this session, we’ll discuss options and best practices for running batch jobs on AWS including AWS Batch, a fully managed batch-processing service, and building batch processing architectures with the Amazon EC2 Container Service. We’ll also discuss best practices for ensuring efficient and opportunistic scheduling, fine-grained monitoring, compute resource auto-scaling, and security for batch jobs. Level 200
Running SAP Business Warehouse in the AWS Cloud-SAPPHIRE NOW 2016Amazon Web Services
In this presentation, learn how AWS works with SAP to certify non-production and production workloads, best practices for sizing and deploying SAP Business Warehouse on AWS, pricing, and how to get started.
Serverless architectures let you build and deploy applications and services with infrastructure resources that require zero administration. In the past, you had to provision and scale servers to run your application code, install and operate distributed databases, and build and run custom software to handle API requests. Now, AWS provides a stack of scalable, fully-managed services that eliminates these operational complexities.
In this session, you will learn about the benefits of serverless architectures and the basics of the serverless stack AWS provides. We will also walk through how you can use serverless architectures for everything from data processing to mobile and web backends.
AWS Lambda is a computing service that allows you to run the prepared codes without the necessity of managing or provisioning servers. Lambda is destined to run your code only when it is highly needed and further scales it automatically. AWS Lambda allows you to run the codes virtually for almost all types of applications and back-end services. Along with that, it performs all of the administration operations such as computing the resources, OS maintenance, server maintenance, automatic scaling, capacity provisioning, code monitoring, and others. The only thing you need to do is put up your code in a Lambda understandable language. AWS Lambda is chargeable, and it bills you for the compute time consumed by you and does not charge you anything while your code is stationary.
To read further please visit https://www.whizlabs.com/blog/what-is-aws-lambda/
How to move a mission critical system to 4 AWS regions in one year?Wojciech Gawroński
A year ago our team was challenged to enhance the scope and scale of an existing platform, that is providing significant revenue for our client. As the designers and maintainers of that solution, we decided to leverage AWS cloud during that transition. In the presentation, I would like to discuss how we have tackled that migration - with the assumption that we had to move in a limited resource, hybrid cloud environment - working in close cooperation with teams responsible for other parts of the system. As I stated previously - it was a challenge - and I would like to talk what problems we have solved during that process. Also, what services we have leveraged to smooth the transition. And last, but not least - I would like to present how we have maintained the delivery pipeline, automation and massive pile of CloudFormation templates and why AWS Lambda is an excellent glue for any operational work you have to do in the cloud. Our hard work paid off. In October 2017 we have deployed our system into 4th AWS region. Bare with me during the talk, and you will learn how we achieved that
AWS Summit Bangkok 2017 with Keynote Guest Speaker Chaiwat Ratanaprateepporn,...Amazon Web Services
Summit brings together the cloud computing community to connect, collaborate and learn about AWS. Opening Keynote Customer Guest with Chaiwat Ratanaprateepporn, Chief Technology Officer of Ascend as he shares their cloud journey.
How to Use AWS Lambda Layers and Lambda RuntimeDonnie Prakoso
Originally presented at AWS User Group Bandung, Indonesia. In this session, let's learn how to use AWS Lambda layers and Lambda Runtimes. Including live demo(s) on how to build your own custom runtime and usage of Lambda layers.
AWS re:Invent 2016: NEW LAUNCH! Lambda Everywhere (IOT309)Amazon Web Services
You can now execute Lambda’s almost anywhere – originating in the cloud, and on connected devices with AWS Greengrass. This advanced technical session explores Lambda Functions and what it means to use them across these diverse environments. We will treat the cloud as the ‘brain’, using local Lambda’s for local executions. This way devices can react instinctively, much like the autonomic nervous system, operating in the periphery and responsible for collecting and filtering information, implementing simple and time-sensitive local actions reflexively.
Experience how live virtual 3D worlds rendered with Amazon Lumberyard, a free, cross-platform, 3D game engine, interconnect with IoT devices in the real world. This session will illustrate how AWS IoT can be used to remotely control animate objects with Bluetooth, such as a Sphero robot. By using AWS Lambda and AWS IoT, we will create bi-directional communication between moving robots that detect collisions and a virtual world rendered in Amazon's game engine. By using AWS IoT with the Alexa Skills Kit and the Amazon Echo, we will learn how to control the physical and virtual robots through voice.
Speaker: Olivier Klein, Emerging Technologies Solutions Architect, Amazon Web Services, APAC
This "what's new" presentation was delivered to the Seattle AWS User Group on August 31, 2011.
It covers new services, new locations, and new features.
AWS Lambda Containers - bridging the gap between serverless and containers on...Yun Zhi Lin
Video: https://youtu.be/Zg8jrAOfqEY
Feb 2021 Sydney Serverless Meetup talk on AWS Lambda Containers - bridging the gap between serverless and containers once and for all
The serverless paradigm focuses on business problems and containers are the infrastructure abstraction of choice for most developers. With AWS Lambda container support, it is now possible to combine the two worlds to focus on business problems with the certainty of immutable infrastructure and unprecedented levels of code flexibility/portability. What does this brave new world of serverless containers on AWS looks like? How easy is it to implement/migrate? Which use cases are suitable? Let’s dive deep and find out!
In this presentation we will discuss the evolution of IaaS, PaaS, CaaS, FaaS and how serverless computing is beneficial and what are the challenges we have faced so far
Join us to learn about the state of serverless computing from Dr. Tim Wagner, General Manager of AWS Lambda. Dr. Wagner discusses the latest developments from AWS Lambda and the serverless computing ecosystem. He talks about how serverless computing is becoming a core component in how companies build and run their applications and services, and he also discusses how serverless computing will continue to evolve.
Intended for customers who have (or will have) thousands of instances on AWS, this session is about reducing the complexity of managing costs for these large fleets so they run efficiently. Attendees will learn about common roadblocks that prevent large customers from cost optimizing, tools they can use to efficiently remove those roadblocks, and techniques to monitor their rate of cost optimization. The session will include a case study that will talk in detail about the millions of dollars saved using these techniques. Customers will learn about a range of templates they can use to quickly implement these techniques, and also partners who can help them implement these templates.
by Harrell Stiles, Sr. Consultant, AWS ProServe
Batch computing is a common way to run a series of programs, called batch jobs, on a large pool of shared compute resources, such as servers, virtual machines, and containers. But running batch workloads at scale is a challenging task, configuring and scaling a cluster of virtual machines to process complex batch jobs is difficult and resource intensive. In this session, we’ll discuss options and best practices for running batch jobs on AWS including AWS Batch, a fully managed batch-processing service, and building batch processing architectures with the Amazon EC2 Container Service. We’ll also discuss best practices for ensuring efficient and opportunistic scheduling, fine-grained monitoring, compute resource auto-scaling, and security for batch jobs. Level 200
Running SAP Business Warehouse in the AWS Cloud-SAPPHIRE NOW 2016Amazon Web Services
In this presentation, learn how AWS works with SAP to certify non-production and production workloads, best practices for sizing and deploying SAP Business Warehouse on AWS, pricing, and how to get started.
Serverless architectures let you build and deploy applications and services with infrastructure resources that require zero administration. In the past, you had to provision and scale servers to run your application code, install and operate distributed databases, and build and run custom software to handle API requests. Now, AWS provides a stack of scalable, fully-managed services that eliminates these operational complexities.
In this session, you will learn about the benefits of serverless architectures and the basics of the serverless stack AWS provides. We will also walk through how you can use serverless architectures for everything from data processing to mobile and web backends.
AWS Lambda is a computing service that allows you to run the prepared codes without the necessity of managing or provisioning servers. Lambda is destined to run your code only when it is highly needed and further scales it automatically. AWS Lambda allows you to run the codes virtually for almost all types of applications and back-end services. Along with that, it performs all of the administration operations such as computing the resources, OS maintenance, server maintenance, automatic scaling, capacity provisioning, code monitoring, and others. The only thing you need to do is put up your code in a Lambda understandable language. AWS Lambda is chargeable, and it bills you for the compute time consumed by you and does not charge you anything while your code is stationary.
To read further please visit https://www.whizlabs.com/blog/what-is-aws-lambda/
How to move a mission critical system to 4 AWS regions in one year?Wojciech Gawroński
A year ago our team was challenged to enhance the scope and scale of an existing platform, that is providing significant revenue for our client. As the designers and maintainers of that solution, we decided to leverage AWS cloud during that transition. In the presentation, I would like to discuss how we have tackled that migration - with the assumption that we had to move in a limited resource, hybrid cloud environment - working in close cooperation with teams responsible for other parts of the system. As I stated previously - it was a challenge - and I would like to talk what problems we have solved during that process. Also, what services we have leveraged to smooth the transition. And last, but not least - I would like to present how we have maintained the delivery pipeline, automation and massive pile of CloudFormation templates and why AWS Lambda is an excellent glue for any operational work you have to do in the cloud. Our hard work paid off. In October 2017 we have deployed our system into 4th AWS region. Bare with me during the talk, and you will learn how we achieved that
AWS Summit Bangkok 2017 with Keynote Guest Speaker Chaiwat Ratanaprateepporn,...Amazon Web Services
Summit brings together the cloud computing community to connect, collaborate and learn about AWS. Opening Keynote Customer Guest with Chaiwat Ratanaprateepporn, Chief Technology Officer of Ascend as he shares their cloud journey.
How to Use AWS Lambda Layers and Lambda RuntimeDonnie Prakoso
Originally presented at AWS User Group Bandung, Indonesia. In this session, let's learn how to use AWS Lambda layers and Lambda Runtimes. Including live demo(s) on how to build your own custom runtime and usage of Lambda layers.
AWS re:Invent 2016: NEW LAUNCH! Lambda Everywhere (IOT309)Amazon Web Services
You can now execute Lambda’s almost anywhere – originating in the cloud, and on connected devices with AWS Greengrass. This advanced technical session explores Lambda Functions and what it means to use them across these diverse environments. We will treat the cloud as the ‘brain’, using local Lambda’s for local executions. This way devices can react instinctively, much like the autonomic nervous system, operating in the periphery and responsible for collecting and filtering information, implementing simple and time-sensitive local actions reflexively.
Experience how live virtual 3D worlds rendered with Amazon Lumberyard, a free, cross-platform, 3D game engine, interconnect with IoT devices in the real world. This session will illustrate how AWS IoT can be used to remotely control animate objects with Bluetooth, such as a Sphero robot. By using AWS Lambda and AWS IoT, we will create bi-directional communication between moving robots that detect collisions and a virtual world rendered in Amazon's game engine. By using AWS IoT with the Alexa Skills Kit and the Amazon Echo, we will learn how to control the physical and virtual robots through voice.
Speaker: Olivier Klein, Emerging Technologies Solutions Architect, Amazon Web Services, APAC
This "what's new" presentation was delivered to the Seattle AWS User Group on August 31, 2011.
It covers new services, new locations, and new features.
AWS Lambda Containers - bridging the gap between serverless and containers on...Yun Zhi Lin
Video: https://youtu.be/Zg8jrAOfqEY
Feb 2021 Sydney Serverless Meetup talk on AWS Lambda Containers - bridging the gap between serverless and containers once and for all
The serverless paradigm focuses on business problems and containers are the infrastructure abstraction of choice for most developers. With AWS Lambda container support, it is now possible to combine the two worlds to focus on business problems with the certainty of immutable infrastructure and unprecedented levels of code flexibility/portability. What does this brave new world of serverless containers on AWS looks like? How easy is it to implement/migrate? Which use cases are suitable? Let’s dive deep and find out!
In this presentation we will discuss the evolution of IaaS, PaaS, CaaS, FaaS and how serverless computing is beneficial and what are the challenges we have faced so far
Join us to learn about the state of serverless computing from Dr. Tim Wagner, General Manager of AWS Lambda. Dr. Wagner discusses the latest developments from AWS Lambda and the serverless computing ecosystem. He talks about how serverless computing is becoming a core component in how companies build and run their applications and services, and he also discusses how serverless computing will continue to evolve.
Customer Sharing: Trend Micro - Analytic Engine - A common Big Data computati...Amazon Web Services
In recent years, more and more enterprises notice about what values of Big Data can bring, and willing to devote more resources to Big Data field. Doing Hadoop for PoC and further for running in PROD. In common cases, enterprises need to get their servers first for running their Hadoop. By now, thanks for the popularity of Hadoop and its ecosystem. Enterprises have another choice for doing Hadoop, which is, doing it on Public Cloud platforms, such as Amazon, etc. Trend Micro also noticed this trends for Big Data on the cloud, and would like to leverage its elasticity to enable more chances to find more values from our Big Data with less of constraints. In this sharing, we would like to introduce our common Big Data computation platform - Analytic Engine (AE), which is a simple RESTful API service running on AWS for Trenders, with features, such as createCluster, deleteCluster and submitJob, etc. By now, Trenders can run their research jobs, and furthermore, build their own PoC/Staging/PROD levels of services based on AE, to get any computation resources they want, anytime and anyplace in Trend Micro, just by few RESTful API calls.
AWS re:Invent 2016 was AWS’ largest event yet with over 32,000 attendees, 400 breakout sessions, and two keynotes of new product announcements. In this talk, we’ll explore the core themes of AWS re:Invent 2016 such as serverless and artificial intelligence. We will also drill down into several of the services and features unveiled including AWS Batch, AWS Shield, Aurora for Postgres, X-Ray, Polly, Lex, Rekognition, AWS Step Functions. Light appetizers and refreshments will be provided.
The State of Serverless Computing | AWS Public Sector Summit 2017Amazon Web Services
oin us to learn about the state of serverless computing from Dougal Ballantyne, Principal Product Manager, Serverless. Dougal Ballantyne discusses the latest developments from AWS Lambda and the serverless computing ecosystem. He talks about how serverless computing is becoming a core component in how companies build and run their applications and services, and he also discusses how serverless computing will continue to evolve. Learn More: https://aws.amazon.com/government-education/
SRV203 Getting Started with AWS Lambda and the Serverless CloudAmazon Web Services
Serverless computing allows you to build and run applications without the need for provisioning or managing servers. With serverless computing, you can build web, mobile, and IoT backends; run stream processing or big data workloads; run chatbots, and more. In this session, you'll learn how to get started with serverless computing with AWS Lambda, which lets you run code without provisioning or managing servers. We'll introduce you to the basics of building with Lambda and how you can benefit from features such as continuous scaling, built-in high availability, integrations with AWS and third-party apps, and subsecond metering pricing. We'll also introduce you to the broader portfolio of AWS services that help you build serverless applications with Lambda, including Amazon API Gateway, Amazon DynamoDB, AWS Step Functions, and more.
Accenture Cloud Platform helps customers manage public and private enterprise cloud resources effectively and securely. In this session, learn how we designed and built new core platform capabilities using a serverless, microservices-based architecture that is based on AWS services such as AWS Lambda and Amazon API Gateway. During our journey, we discovered a number of key benefits, including a dramatic increase in developer velocity, a reduction (to almost zero) of reliance on other teams, reduced costs, greater resilience, and scalability. We describe the (wild) successes we’ve had and the challenges we’ve overcome to create an AWS serverless architecture at scale. Session sponsored by Accenture.
AWS Competency Partner
AWS' philosophy and recommended best practices for building microservices applications, how AWS services like Lambda and API gateway benefit developers building microservices apps, and how customers are using these two and other AWS services to deliver their microservices apps
¿Qué es eso del desarrollo sin servidores? ¿Qué lenguajes puedo utilizar? ¿Cómo hago cosas como autenticación, o guardar en base de datos, o enviar notificaciones? ¿Esto escala? A todas estas preguntas, y a alguna más, intentaré dar respuesta en esta sesión, donde haré una pequeña demo de montar una app muy sencilla y desplegarla en la nube sin preocuparnos de gestionar infraestructura. Charla realizada por primera vez para AlcarriaConf 2021
Batch Processing with Containers on AWS - June 2017 AWS Online Tech TalksAmazon Web Services
Learning Objectives:
- Learn about the options for running batch workloads on AWS
- Learn how to architect a containerized batch processing service on Amazon ECS
- Learn best practices for optimizing and scaling complex batch workload requirements
Batch processing is useful when you need to periodically analyze large amounts of data, but configuring and scaling a cluster of virtual machines to process complex batch jobs can be difficult. Containers provide a great solution for running batch jobs by providing easily managed, scalable, and portable code environments.
In this tech talk, we’ll show you how to use containers on AWS for batch processing jobs that can scale quickly and cost-effectively. We’ll discuss AWS Batch, our fully managed batch-processing service, and show you how to architect your own batch processing service using the Amazon EC2 Container Service. We’ll also discuss best practices for ensuring efficient and opportunistic scheduling, fine-grained monitoring, compute resource auto-scaling, and security for your batch jobs.
As serverless architectures become more popular, AWS customers need a framework of patterns to help them deploy their workloads without managing servers or operating systems.
As serverless architectures become more popular, AWS customers need a framework of patterns to help them deploy their workloads without managing servers or operating systems.
deck from talk at YOW Data in Sydney, covers VariantSpark, custom Apache Spark Machine Learning library and also GT-Scan2 using AWS Lambda architecture for bioinformatics
VariantSpark - a Spark library for genomicsLynn Langit
VariantSpark a customer Apache Spark library for genomic data. Customer wide random forest machine learning algorithm, designed for workloads with millions of features.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
Neuro-symbolic is not enough, we need neuro-*semantic*Frank van Harmelen
Neuro-symbolic (NeSy) AI is on the rise. However, simply machine learning on just any symbolic structure is not sufficient to really harvest the gains of NeSy. These will only be gained when the symbolic structures have an actual semantics. I give an operational definition of semantics as “predictable inference”.
All of this illustrated with link prediction over knowledge graphs, but the argument is general.
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Elevating Tactical DDD Patterns Through Object CalisthenicsDorra BARTAGUIZ
After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!
13. Just write code –> “tiny”
Function / Method
Auto-scales
Very NewTechnology
Use Dockerfiles –> “small”
Application
Coordinate via Container Mgr.
NewTechnology
21. Alpha
Some parts
may work
Service may
be changed
Service may
be
discontinued
Beta
Many parts
should
work
Service may
be changed
Year One
Most parts
should
work
Can include
some
service
integrations
YearTwo
All parts
should
work
Patterns
and scripts
emerge
YearThree
Service is
stable
Tools and
partners
emerge
34. Use image
Files ->
“BIG”
Application
PLUS OS
Coordinate
with Load
Balancers
Mature
Technology
Use
Dockerfiles ->
“small”
Application
Coordinate
with Container
Managers
New
Technology
66. ServiceType Servers (or Containers) Serverless
Compute EC2 Lambda
Files File Services on EC2 S3
SQL on Relational Data RDBMS on EC2 or RDS Athena / Redshift Spectrum
Data Pipeline Kafka cluster on EC2 Kinesis
Machine Learning EMR with Spark ML or
Hadoop on EC2
Machine Learning API
IoT MQTT Message Broker RabbitMQ on EC2 IoT Broker
NoSQL MongoDB… on EC2 DynamoDB