AWS Lambda in Practice

•Download as PPTX, PDF•

2 likes•443 views

Toby Hede

Or how i learned to stop worrying and love not having servers. An overview of using AWS Lambda in the real world.

Technology

λ in Practice
or how i learned to stop worrying and love not having servers

5
——————————————————————————————
All-of-Gov Performance Dashboard
Measure the performance of government services
against metrics defined in the Digital Service
Standard.

6
——————————————————————————————
All-of-Gov Performance Dashboard
Measure the performance of government services
against metrics defined in the Digital Service
Standard.
Drive the continuous improvement of government
services for users and increase government
transparency.

7
——————————————————————————————
Data
๏ Multiple data sources
๏ Disparate data sources
๏ We don’t actually know what they all are yet
๏ We don’t know how much of it we will have

10
——————————————————————————————
Data
๏ Connect all the moving pieces
๏ Transform data from many different sources
๏ Move fast
๏ Adapt quickly

12
——————————————————————————————
Caveats
We are just finishing Alpha
Production this week, pending approvals
Going into Beta phase
Expanding our usage of λ

18
Serverless Framework
Configuration
Environments
Deployment

19
——————————————————————————————
Random Thoughts
Vendor Lock In
Dependencies
Security
Testing
What about other Amazon products and/or services
Zero infrastructure and a surprising amount of configuration

20
——————————————————————————————
Vendor Lock In
• Meh

21
Businesswoman with question marks behind her, hard decision

24
——————————————————————————————
An aside

27
——————————————————————————————
Security and IAM
• AmazonAPIGatewayAdministrator
• AWSLambdaFullAccess
• AWSLambdaVPCAccessExecutionRole
• ec2:DescribeSecurityGroups
• ec2:DescribeSubnets
• Built-in Serverless Policy

28
——————————————————————————————
Dependencies
• Requires some planning
• Nest packages with npm
• Favour reimplementation of simple helpers rather
then pull in a dependency

29
——————————————————————————————
Testing
• Unit test functions
• If testing a function is hard, you are doing it wrong
• ava is good
• Can run Serverless locally using a plugin

30
——————————————————————————————
What about other AWS products
• Possible for future development
• We’ve played it safe on the database tier
• Some limitations to what Gov can support
• Contenders:
• Kinesis
• Elastic search

31
——————————————————————————————
Configuration
Serverless means replying infrastructure with configuration
Don’t underestimate the complexity

32
100%
@tobyhede
tobyhede.com
************

Viewers also liked

Chatbots are the new apps. Businesses of all sizes, from startups to enterprises, are looking for new ways to connect with their users through natural, conversational interfaces. Developers have started using chatbots to improve the productivity and efficiency of their operations. In this session, we show how to use AWS Lambda and other serverless offerings from AWS to build chatbots quickly and efficiently. We share examples from our recently concluded AWS Slack Hackathon with a full walkthrough of building a conversational chatbot in an easy, fast, and fun way, along with helpful tools, tips, and techniques.

AWS re:Invent 2016: bots + serverless = ❤ (SVR304)

Amazon Web Services

M.E.L.I.G. Unikernel and Serverless

QNIB Solutions

Serverless computing and Function-as-a-Service (FaaS)

Moritz Strube

Serverless architectures let you build and deploy applications and services with infrastructure resources that require zero administration. In the past, you had to provision and scale servers to run your application code, install and operate distributed databases, and build and run custom software to handle API requests. Now, AWS provides a stack of scalable, fully-managed services that eliminates these operational complexities. In this session, you learn about the concepts and benefits of serverless architectures and the basics of the serverless stack AWS provides (e.g., AWS Lambda and Amazon API Gateway). We discuss use cases such as data processing, website backends, serverless applications and "operational glue". After that, you get practical tips and tricks, best practices, and architecture patterns that you can take back and implement immediately.

AWS re:Invent 2016: Getting Started with Serverless Architectures (CMP211)

Amazon Web Services

Serverless

Young Yang

Serverless - Lunch&Learn CleverToday - Mars 2017

Brice Argenson

用JavaScript 實踐《軟體工程》的那些事兒！

鍾誠陳鍾誠

Organizations need to gain insight and knowledge from a growing number of Internet of Things (IoT), application programming interfaces (API), clickstreams, unstructured and log data sources. However, organizations are also often limited by legacy data warehouses and ETL processes that were designed for transactional data. Building scalable big data pipelines with automated extract-transform-load (ETL) and machine learning processes can address these limitations. JustGiving is the world’s largest social platform for online giving. In this session, we describe how we created several scalable and loosely coupled event-driven ETL and ML pipelines as part of our in-house data science platform called RAVEN. You learn how to leverage AWS Lambda, Amazon S3, Amazon EMR, Amazon Kinesis, and other services to build serverless, event-driven, data and stream processing pipelines in your organization. We review common design patterns, lessons learned, and best practices, with a focus on serverless big data architectures with AWS Lambda.

AWS re:Invent 2016: JustGiving: Serverless Data Pipelines, Event-Driven ETL, ...

Amazon Web Services

運用 AWS Serverless Architecture，建立並執行你的 LINE Chatbot 程式，無須擔心伺服器的問題，它會運用其「高可用性、高擴展性」，來處理及執行所需的各項工作。 1. LINE Chatbot 的核心－ Messaging APIs 的新功能 2. AWS Serverless Chatbot 架構與設定－了解 Serverless 架構，申請作業與開發環境的基本設定 3. 運用 LINE Python SDK 實作與佈署－ LINE Python SDK 簡化了訊息的包裝與解析，讓你專注在你的商業邏輯

用Serverless技術快速開發line聊天機器人

Kevin Luo

História da Arte - Pré-história e Antiguidade

Marcio Duarte

Viewers also liked (10)

AWS re:Invent 2016: bots + serverless = ❤ (SVR304)

M.E.L.I.G. Unikernel and Serverless

Serverless computing and Function-as-a-Service (FaaS)

AWS re:Invent 2016: Getting Started with Serverless Architectures (CMP211)

Serverless

Serverless - Lunch&Learn CleverToday - Mars 2017

用JavaScript 實踐《軟體工程》的那些事兒！

AWS re:Invent 2016: JustGiving: Serverless Data Pipelines, Event-Driven ETL, ...

用Serverless技術快速開發line聊天機器人

História da Arte - Pré-história e Antiguidade

Similar to AWS Lambda in Practice

Splunk's new Premium App offering, Splunk IT Service Intelligence, is full of exciting new features and functionality to enable the data-driven enterprise to monitor, alert on, and visualize these services in several new ways, including flexible free-form dashboards called "Glass Tables." Join us in this session to explore the versatility of the Glass Tables feature, discuss best practices around creating valuable and compelling Glass Tables for IT operations and business users, and inspect several examples of purpose-built Glass Tables.

SplunkLive! Stockholm 2015 breakout - Splunk IT Service Intelligence

Splunk

Unlocking the Power of Government Analytics

GovLoop

5 Tips to Breaking Digital Performance Barriers and Building Business Success

Keynote Mobile Testing

2015 Quality Management System Vendor Benchmark

Quality & Regulatory Network LLC

The Digital Universe of Tomorrow

EMC

Data Growth, Business Opportunities, and the IT Imperatives This is the digital universe. It is growing 40% a year into the next decade, expanding to include not only the increasing number of people and enterprises doing everything online, but also all the “things” – smart devices – connected to the Internet, unleashing a new wave of opportunities for businesses and people around the world.

IDC Digital Universe 2014

Vasily Ryzhonkov

Idc digital-universe-2014

Abdallah Nabulsi

May 2016 calix investor presentation

CalixInc

Big Data & Analytics (Conceptual and Practical Introduction)

Yaman Hajja, Ph.D.

Sourcing Market Overview

Information Services Group (ISG)

For years we laboured under the misapprehension that going faster meant breaking things. After several years of science-ing, Jez and Dr Nicole Forsgren have identified the key elements that enable not just higher throughput but also higher stability, availability and quality, lower cost, and happier teams. Discover how continuous delivery, cloud infrastructure, and effective management and leadership practices produce higher software delivery performance (and indeed what we might mean by performance), along with how to measure culture and its impact on IT and organizational culture. Find out how we actually ensure our results are reliable and meaningful. Learn the patterns and practices used by high performing organizations to outcompete their peers.

What I learned from 5 years of sciencing the crap out of DevOps

DevOpsDays DFW

Big Data - Accountability Solutions for Public Sector Programs

Gaurav "GP" Pal

Elections Canada

Pierre Gagnon

Gordian Knot Analytics Group Overview

Brad Wood

Elastic{on} - Tracking of events within ING

ING-IT

SIMPLE EXAMPLE: A company must decide whether to invest $100 Million in developing and implementing a new enterprise system in the face of considerable technological and market (demand for product and market share) uncertainty. The firm's cost of capital is 10%.Evaluate Using NPV AnalysisThere can be a good and bad result for this investment. Good Result: A good result has a probability of .5 of occurring. Here the planned cost reductions have been realized and better integration of the supply chain is possible. These benefits are leveraged by strong market demand for the firm's product. There have also been feedback benefits, the enterprise system has significantly improved perceived quality and service from the customer's point of view. Annual benefits under this scenario equal $15 million in after tax cash flow per year forever.Bad Result: The system proves to be more difficult to implement and improvements in management of the supply chain are less. In addition, the growth in market demand for the product is lower. Annual benefits under this scenario are $2 million in after tax cash flow per year.Using traditional "all or nothing" NPV analysis, we get the followingYear 0 (now) cash flows: $-100 million for ERP purchase and implementationYear 1, 2, 3…etc. cash flows (after tax): (a) good result: $+15 million/year (prob. = .5)(b) bad result: $+2 million/year (prob. = .5)Expected annual cash flows for year 1 and forward:$15 mil * .5 + $2 mil * .5 = $7.5 mil + $1 mil = $8.5 milThe value of these expected after tax cash flows (a perpetuity) = $8.5/COC = $8.5/.10 = $85 milThen the NPV of this investment = $-100 mil + $85 mil = $-15 milThe decision is: DO NOT UNDERTAKE THE INVESTMENT2. Real Options Approach (all cash flows are after tax)The real options alternative allows for flexibility and the delay of the investment for 1 year. In this case, if we do a pilot project we will be better able to evaluate ERP implementation complexities, achievable supply chain benefits, and the market share our products will achieve. However, the cost of the project will rise to $110 Million ($10 Million this year and $100 Million next year) with the one-year delay and additionally management decides to purchase and implement the financial module in year 1 at a cost of $10 Million (real option). The results are slightly different:Year 0 (now) cash flows: $10 million for the pilot project, the financial moduleAfter year 1, if the conditions indicate a good result, the firm will invest the $100 million for the ERP with expected benefits (cash flows) of $15 million annually beginning in year 2. Benefits in year one from the financial module are $1 million.If a bad result is indicated, the firm makes no further investments beyond the financial module, which yield annual benefits of $.5 million in year 1 and each year there after.Here the firm has flexibility and has exercised its option to make no further investments based on better information/knowledge of expe.

SIMPLE EXAMPLE A company must decide whether to invest $100 Million.docx

edgar6wallace88877

Performance platform about event 17-6-14

imattharrington

RTTS recently performed a study of over 200 companies interested in improving the data quality of their Data Warehouse and Business Intelligence projects. Our firm interviewed IT executives, data architects, ETL developers, data analysts and data warehouse testers to determine the state of the industry and current practices as they relate to data quality. Highlights from the research: - Oracle dominates the data warehouse industry with 42% of all installs. - IBM is the leader in BI tools, with IBM Cognos owning 22% of the industry. - Microsoft (22%) shockingly passed Informatica (19%) in the ETL tools section, but open source and home-grown tools (25%) are ahead of Microsoft. - The majority of data warehouse installs (33%) are between 1 and 100 terabytes. - 60% of companies surveyed test their data manually. Read the results of the study, including details on the state of the industry and current practices as they relate to data quality.

Enterprise Business Intelligence & Data Warehousing: The Data Quality Conundrum

RTTS

Putting data to work

Judy Breedlove

Google.value.analysis.for.business.growth

Shekhar Bhartiya

Similar to AWS Lambda in Practice (20)

SplunkLive! Stockholm 2015 breakout - Splunk IT Service Intelligence

Unlocking the Power of Government Analytics

5 Tips to Breaking Digital Performance Barriers and Building Business Success

2015 Quality Management System Vendor Benchmark

The Digital Universe of Tomorrow

IDC Digital Universe 2014

Idc digital-universe-2014

May 2016 calix investor presentation

Big Data & Analytics (Conceptual and Practical Introduction)

Sourcing Market Overview

What I learned from 5 years of sciencing the crap out of DevOps

Big Data - Accountability Solutions for Public Sector Programs

Elections Canada

Gordian Knot Analytics Group Overview

Elastic{on} - Tracking of events within ING

SIMPLE EXAMPLE A company must decide whether to invest $100 Million.docx

Performance platform about event 17-6-14

Enterprise Business Intelligence & Data Warehousing: The Data Quality Conundrum

Putting data to work

Google.value.analysis.for.business.growth

More from Toby Hede

DynamoDB is simultaneously the simplest and most complicated database money can buy. A simple key/value table with incredible reliability and essentially boundless capacity can be setup in seconds, but modelling complex access patterns requires careful and considered upfront design planning and consideration. If you have experience with relational systems, DynamoDB requires us to adopt new ways of thinking about how we design and structure our data.

Designing for DynamoDB - Serverless Sydney - Feb 2020

Toby Hede

AWS Lamdba with JavaScript

Toby Hede

An Introduction to Rust Macros

Toby Hede

Rails Rescue - Managing Technical Debt in Legacy Applications

Toby Hede

MongoDb

Toby Hede

Introduction to Facebook Development

Toby Hede

Amazon Web Services

Toby Hede

On XML and the Future of the Web

Toby Hede

More from Toby Hede (8)

Designing for DynamoDB - Serverless Sydney - Feb 2020

AWS Lamdba with JavaScript

An Introduction to Rust Macros

Rails Rescue - Managing Technical Debt in Legacy Applications

MongoDb

Introduction to Facebook Development

Amazon Web Services

On XML and the Future of the Web

Recently uploaded

In this keynote, Asanka Abeysinghe, CTO,WSO2 will explore the shift towards platformless technology ecosystems and their importance in driving digital adaptability and innovation. We will discuss strategies for leveraging decentralized architectures and integrating diverse technologies, with a focus on building resilient, flexible, and future-ready IT infrastructures. We will also highlight WSO2's roadmap, emphasizing our commitment to supporting this transformative journey with our evolving product suite.

Platformless Horizons for Digital Adaptability

WSO2

Strategies for Landing an Oracle DBA Job as a Fresher

Remote DBA Services

Effective data discovery is crucial for maintaining compliance and mitigating risks in today's rapidly evolving privacy landscape. However, traditional manual approaches often struggle to keep pace with the growing volume and complexity of data. Join us for an insightful webinar where industry leaders from TrustArc and Privya will share their expertise on leveraging AI-powered solutions to revolutionize data discovery. You'll learn how to: - Effortlessly maintain a comprehensive, up-to-date data inventory - Harness code scanning insights to gain complete visibility into data flows leveraging the advantages of code scanning over DB scanning - Simplify compliance by leveraging Privya's integration with TrustArc - Implement proven strategies to mitigate third-party risks Our panel of experts will discuss real-world case studies and share practical strategies for overcoming common data discovery challenges. They'll also explore the latest trends and innovations in AI-driven data management, and how these technologies can help organizations stay ahead of the curve in an ever-changing privacy landscape.

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Juan lago vázquez

Following the popularity of "Cloud Revolution: Exploring the New Wave of Serverless Spatial Data," we're thrilled to announce this much-anticipated encore webinar. In this sequel, we'll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR. Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios. Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects. Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you're building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Safe Software

💥 You’re lucky! We’ve found two different (lead) developers that are willing to share their valuable lessons learned about using UiPath Document Understanding! Based on recent implementations in appealing use cases at Partou and SPIE. Don’t expect fancy videos or slide decks, but real and practical experiences that will help you with your own implementations. 📕 Topics that will be addressed: • Training the ML-model by humans: do or don't? • Rule-based versus AI extractors • Tips for finding use cases • How to start 👨‍🏫👨‍💻 Speakers: o Dion Morskieft, RPA Product Owner @Partou o Jack Klein-Schiphorst, Automation Developer @Tacstone Technology

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

UiPathCommunity

Corporate and higher education. Two industries that, in the past, have had a clear divide with very little crossover. The difference in goals, learning styles and objectives paved the way for differing learning technologies platforms to evolve. Now, those stark lines are blurring as both sides are discovering they have content that’s relevant to the other. Join Tammy Rutherford as she walks through the pros and cons of corporate and higher ed collaborating. And the challenges of these different technology platforms working together for a brighter future.

Corporate and higher education May webinar.pptx

Rustici Software

Six Myths about Ontologies: The Basics of Formal Ontology

johnbeverley2021

Understanding the FAA Part 107 License ..

Christopher Logan Kennedy

Dubai, known for its towering skyscrapers, luxurious lifestyle, and relentless pursuit of innovation, often finds itself in the global spotlight. However, amidst the glitz and glamour, the emirate faces its own set of challenges, including the occasional threat of flooding. In recent years, Dubai has experienced sporadic but significant floods, disrupting normalcy and posing unique challenges to its infrastructure. Among the critical nodes in this bustling metropolis is the Dubai International Airport, a vital hub connecting the world. This article delves into the intersection of Dubai flood events and the resilience demonstrated by the Dubai International Airport in the face of such challenges.

Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf

Orbitshub

The microservices honeymoon is over. When starting a new project or revamping a legacy monolith, teams started looking for alternatives to microservices. The Modular Monolith, or 'Modulith', is an architecture that reaps the benefits of (vertical) functional decoupling without the high costs associated with separate deployments. This talk will delve into the advantages and challenges of this progressive architecture, beginning with exploring the concept of a 'module', its internal structure, public API, and inter-module communication patterns. Supported by spring-modulith, the talk provides practical guidance on addressing the main challenges of a Modultith Architecture: finding and guarding module boundaries, data decoupling, and integration module-testing. You should not miss this talk if you are a software architect or tech lead seeking practical, scalable solutions. About the author With two decades of experience, Victor is a Java Champion working as a trainer for top companies in Europe. Five thousands developers in 120 companies attended his workshops, so he gets to debate every week the challenges that various projects struggle with. In return, Victor summarizes key points from these workshops in conference talks and online meetups for the European Software Crafters, the world’s largest developer community around architecture, refactoring, and testing. Discover how Victor can help you on victorrentea.ro : company training catalog, consultancy and YouTube playlists.

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024

Victor Rentea

How to Troubleshoot Apps for the Modern Connected Worker

ThousandEyes

MINDCTI Revenue Release Quarter One 2024

MIND CTI

The Good, the Bad and the Governed - Why is governance a dirty word? David O'Neill, Chief Operating Officer - APIContext Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

apidays

AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)

Samir Dash

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

Zilliz

Discover the innovative features and strategic vision that keep WSO2 an industry leader. Explore the exciting 2024 roadmap of WSO2 API management, showcasing innovations, unified APIM/APK control plane, natural language API interaction, and cloud native agility. Discover how open source solutions, microservices architecture, and cloud native technologies unlock seamless API management in today's dynamic landscapes. Leave with a clear blueprint to revolutionize your API journey and achieve industry success!

WSO2's API Vision: Unifying Control, Empowering Developers

WSO2

[BuildWithAI] Introduction to Gemini.pdf

Sandro Moreira

Exploring Multimodal Embeddings with Milvus

Zilliz

Accelerating FinTech Innovation: Unleashing API Economy and GenAI Vasa Krishnan, Chief Technology Officer - FinResults Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...

apidays

Recently uploaded (20)

Platformless Horizons for Digital Adaptability

Strategies for Landing an Oracle DBA Job as a Fresher

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

Corporate and higher education May webinar.pptx

Six Myths about Ontologies: The Basics of Formal Ontology

Understanding the FAA Part 107 License ..

Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024

How to Troubleshoot Apps for the Modern Connected Worker

MINDCTI Revenue Release Quarter One 2024

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

WSO2's API Vision: Unifying Control, Empowering Developers

[BuildWithAI] Introduction to Gemini.pdf

Exploring Multimodal Embeddings with Milvus

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...