Monitoring Serverless Applications (SRV303-S) - AWS re:Invent 2018

•

1 like•256 views

Serverless brings many advantages to software development, but it introduces new monitoring challenges as well. Isolated telemetry on individual functions might not provide enough visibility, and instrumentation in a world where 100 ms of extra execution time could cost thousands of dollars might prove prohibitive. In this session, we explore how New Relic enables full observability of the serverless stack, including its executing context, with minimal impact in performance. Learn from customer case studies and real-world examples. This session is brought to you by AWS partner, New Relic.

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Monitoring Lambda &
Serverless Applications
Andrew Tunall
Principal PM
New Relic
S R V 3 0 3 - S
Alberto Gomez
PM Director
New Relic
Sean Large
Software Engineer
Capital One

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Agenda
Serverless workloads create new challenges
Finding monitoring blind spots in an example
Gather and synthesize data to gain visibility
Capital One lessons learned
What’s next?

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CLOUD
2006
DEVOPS
2009
MICROSERVICES
2012
DOCKER
2013
SERVERLESS
& KUBERNETES
2014
SERVICE
MESH
2017

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
SERVERLESS
CLOUD
CONTAINERIZE

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
"People still haven't figured out a great use case for
serverless beyond batch jobs and cron jobs.”

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
44%
37%

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Post/
Resource
Process
Request
Amazon DynamoDB
Table as Storage

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Post/
Resource
Process
Request
Amazon Kinesis
Data Stream

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Post/
Resource
Process
Request
Kinesis
Data Stream
File
Storage
Data
Aggregation

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon API
Gateway
Process
Request
Kinesis Data
Stream
Data
Aggregation
Wipe
record
File
Storage
Record update
DynamoDB
File Storage
Notify
Users
New
Record
DynamoDB

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
30
AWS SERVICES
MONITORED

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Debugging

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Timeout vs memory

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Serverless discovery process

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CICD

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Docker

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
JMeter

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Logs―

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
New Relic

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Follow up/findings

Thank you!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Security is job zero at AWS. Come and learn how to build a modern security practice on AWS and supercharge it with AWS partners and serverless automation. Learn about the Security Perspectives found the AWS Well-Architected Framework, which equip your security program to not only keep your environment secure but also move fast. Learn advanced techniques to empower your teams with Amazon GuardDuty so you can elevate your team's ability to identify, protect, detect, respond, and recover from security events.

Deploying Your ONNX Deep Learning with Apache MXNet Model Server (AIM413) - A...

Amazon Web Services

Machine Learning at the IoT Edge (IOT214) - AWS re:Invent 2018

Amazon Web Services

Whether it's connected cars, smart home devices, or industrial applications, IoT applications are rapidly becoming more intelligent. Edge computing is helping lead this transformation as IoT devices not only collect and transmit data, but also perform predictive analytics and respond to local events, even without cloud connectivity. In this session, learn about ML inference at the edge, why it matters, and how to use it to build intelligent IoT applications. Through customer use cases, we demonstrate how to use AWS Greengrass to locate cloud-trained ML models, deploy them to your AWS Greengrass devices, enable access to on-device computing power, and apply the models to locally generated data without connection to the cloud.

Private Network Connectivity: Connecting AWS into Public Sector Networks (WPS...

Amazon Web Services

ALB User Authentication: Identity Management at Scale with Netflix (NET204) -...

Amazon Web Services

In the zero-trust security environment at Netflix, identity management has historically been a challenge due to the reliance on its VPN for all application access. About one year ago, Netflix began exploring various identity solutions to alleviate the operational burden of maintaining its VPN. Additionally, it was looking for ways to provide a superior user experience. Join this chalk talk to learn how Netflix solved identity management at scale.

VPC Design Scenarios for Real-Life Use Cases (NET320) - AWS re:Invent 2018

Amazon Web Services

In this design-oriented session, we address the many real-life conditions that lead to different VPC design scenarios. We break down the reasons why customers choose to deploy a single VPC, as opposed to a multi-VPC approach. We also explore the architectures that lead to customers deploying advanced VPC designs, such as shared services VPCs or multi-region transit VPCs. Additionally, we explore in detail the tools you need to support these architectures, such as AWS Direct Connect, VPC peering, VPN, AWS Identity and Access Management (IAM), and resource tagging. Laptops are not required.

Security Framework Shakedown: Chart Your Journey with AWS Best Practices (SEC...

Amazon Web Services

As with everything in life there is an easy way and a hard way when it comes to adopting security framework recommendations. Featuring the AWS Well-Architected and Cloud Adoption Frameworks, we will walk you through a complete security journey. We'll start with identification of requirements, then move through a series of how-tos from classifying your data, automating controls, to running fun incident response game days. There will be code giveaways and more!

Computing at the Edge with AWS Greengrass and Amazon FreeRTOS, ft. General El...

Amazon Web Services

Edge computing is all about moving compute power to the source of the data instead of having to bring it to the cloud. The edge is a fundamental part of IoT, and it is not only about connecting things to the internet. In this sesssion, we discuss how AWS Greengrass, which is an IoT edge software, can power devices small and large, from a sensor all the way to a wind turbine. With AWS Greengrass, these IoT devices can securely gather data, keep device data in sync, and communicate with each other while still using the cloud for management, analytics, and durable storage. Join us to learn more about the edge of IoT.

Imagine being able to transcribe calls, translate them into multiple languages and then being able to identify key topics discussed in those calls. All of that is possible today with machine learning services offered by AWS. In AWS, you can easily integrate your real-time communication infrastructure with state-of-the-art AI services to enhance user experience. In this workshop, learn how to set up a secure and highly available WebRTC system on AWS and then integrate it with AWS AI services to provide services such as transcription (Amazon Transcribe), translation (Amazon Translate), and meta-data creation (Amazon Comprehend).

DevOps Concepts for Data Science (DEV347-R2) - AWS re:Invent 2018

Amazon Web Services

DevOps and Data Science? How does that work? In software teams where innovation is a priority, DevOps can be an accelerator. In data science and machine learning, there are a number of factors that increase complexity of systems and thus the complexity of DevOps. This session will touch on fundamental concepts in data science such as data management, ETL, modeling, and model validation, and open discussion around some ways that common tools and processes can be used to decouple and stabilize workflows to accelerate research.

Network Foundations on AWS (GPSCT409) - AWS re:Invent 2018

Amazon Web Services

Networking is the foundation upon which a great many things are built on AWS. As such, it is one of the first and most important things to consider when architecting with AWS. In this session, we review AWS networking architectures, covering both the basics on AWS networking to get you started as well as some of the most complex architectures you will encounter, including transit VPCs, building hybrid networking architectures, new AWS networking features, and how to integrate AWS network and security partner solutions.

Foundations of AWS Global Cloud Infrastructure (ARC217) - AWS re:Invent 2018

Amazon Web Services

The unique global cloud infrastructure offered by AWS helps customers build reliable, available, secure, scalable, and fault-tolerant applications. AWS has more experience operating global cloud infrastructures that enables customers to run business-critical workloads in the public cloud than anyone else. In this session, learn how AWS is continuously enhancing and expanding the AWS global infrastructure through more Regions and Availability Zones, custom hardware, purpose-built global network backbone, and innovative energy management systems to deliver to our customers lower latency, greater reliability, greater scalability, and operational efficiencies.

Operational Excellence with Containerized Workloads Using AWS Fargate (CON320...

Amazon Web Services

Operationalizing Machine Learning to Deliver Content at Scale (MAE306) - AWS ...

Amazon Web Services

The world’s leading content creators, broadcasters, OTT providers, and distributors rely on Deluxe’s experience and expertise to globally create, transform, localize, and distribute hundreds of thousands of assets per month. This scale presents a unique set of challenges and opportunities, further multiplied by the benefits that cloud orchestration, automation, and self-service bring to technical teams. In this session, we dive into how we are applying machine learning to workflows such as fingerprinting and conformance, and specifically how we are operationalizing these as a set of primitives that can be consumed by both customers and services alike. We share our rationale behind our selection of machine learning technologies for workflows such as supply chain, creative and visual effects, where they make sense, and we discuss how we make them available to internal development and data science teams through our MLOps/DevOps pipelines.

Application Portability with Kubernetes (CMP310-S) - AWS re:Invent 2018

Amazon Web Services

Application portability has always been the goal that operators aspire towards. The deployment simplicity in Kubernetes has made this goal attainable, especially when using Kubernetes-as-a-Service like VMware Kubernetes Engine (VKE), built natively on AWS. In this talk, using an application running in the data center, we show how easy it is to implement a hybrid cloud strategy and deploy the same application onto a VKE-managed Kubernetes cluster using Helm. We share best practices on how to implement end-to-end network configuration automation and application monitoring with open-source tooling like Prometheus and Grafana. This session is brought to you by AWS partner, VMware, Inc.

Securely Deploying at Scale (SEC378-R1) - AWS re:Invent 2018

Amazon Web Services

In this chalk talk, we discuss deploying securely at scale from source control to production using a DevSecOps model. Participants need to have prior basic knowledge of DevOps, automated deployments, and infrastructure as code (IaC). With your AWS Organization as a target, we demonstrate how to perform secured, continuous, automated, and multi-account deployments using services such as AWS Organizations, AWS CodePipeline, AWS CodeBuild, and AWS CloudFormation. After this session, you gain a familiarity with DevSecOps best practices, how to ensure only compliant code gets deployed into production based on your AWS Organization, and how AWS services combined with open-source technology can help you achieve this.

Extending Data Centers to the Cloud: Connectivity Options and Best Practices ...

Amazon Web Services

Many enterprises on their journey to the cloud require consistent and highly secure connectivity between their existing data center and AWS footprints. In this session, we walk through the different architecture options for establishing this connectivity using AWS Direct Connect and VPN. With each option, we evaluate the considerations and discuss risk, performance, high availability, encryption, and cost. As we walk through these options, we discuss the associated best practices and answer some of the common questions that arise from enterprises that tackle design and implementation. Learn how to make connectivity decisions that are suitable for your workloads and how to best prepare against business impact in the event of failure.

[NEW LAUNCH!] Introduction to AWS Global Accelerator (NET330) - AWS re:Invent...

Amazon Web Services

This session introduces AWS Global Accelerator, a new global service that enables you to optimally route traffic to your multi-regional endpoints via static Anycast IP addresses that are announced from the expansive AWS edge network. This session walks through the various features and customer use cases for Global Accelerator. Several example use cases demonstrate how you can use Ubiquity to achieve near-zero application downtime and reduce latency for your global applications. We will walk you through the architecture and will also include a demo of the workflow. Attend this session if you are looking at ways to accelerate performance of your global applications, achieve high availability for your mission critical applications or easily manage multiple IP addresses through a static Anycast IP that fronts your applications.

Building an AWS IoT-Enabled Drink Dispenser (IOT405) - AWS re:Invent 2018

Amazon Web Services

In this workshop, learn how to develop a multi-tenant platform for a connected drink dispenser. Work with firmware on microcontrollers using Amazon FreeRTOS, deploy your own application and user management framework with static Amazon S3 websites and Amazon Cognito, and utilize AWS IoT Core for immediate telemetry, command, and control of your drink dispenser devices. When ready, plug your controller into one of the physical dispensers to complete the workshop.

Leadership Session: AWS Security (SEC305-L) - AWS re:Invent 2018

Amazon Web Services

AWS re:Invent 2018: Deep Dive: Hybrid Cloud Storage Arch. w/Storage Gateway, ...

Amazon Web Services

IT infrastructure teams with on-premises applications have to manage storage arrays throughout their never-ending lifecycle, including capacity planning guesswork, hardware failures, system migrations, and more. There are cloud-enabled alternatives to buying more and more storage arrays. With AWS Storage Gateway, you can start using Amazon S3, Amazon Glacier, and Amazon EBS in hybrid architectures with on-premises applications for storage, backup, disaster recovery, tiered storage, hybrid data lakes, and ML. In this session, learn how to use AWS Storage Gateway to seamlessly connect your applications to AWS storage services with familiar block-and-file storage protocols and a local cache for fast access to hot data. We demonstrate our latest capabilities and share best practices from experienced customers.

Best Practices for Building Multi-Region, Active-Active Serverless Applicatio...

Amazon Web Services

Deploy Alexa for Business in Your Organization & Build Your First Private Ski...

Amazon Web Services

Alexa for Business enables you to deploy and manage Alexa skills for your organization. You can use Alexa skills to create smart conference rooms, help employees be more productive, and even create a unique experience for your customers. In this workshop, you have a chance to get hands on with Alexa for Business. You create an Alexa for Business organization, set up a private skills catalog for your organization, build a private skill for a Tableau BI application, and publish skills to your catalog. You also set up personal device enrollment, configure access policies for employees, and turn on voice authentication. Finally, you set up a virtual Alexa-enabled conference room and configure default dial-in information so you can join meetings using your voice. Bring your laptop and an existing AWS account. No previous Alexa experience is required.

How Trek10 Uses Datadog's Distributed Tracing to Improve AWS Lambda Projects ...

Amazon Web Services

Tracing is always a challenge, no matter what your architecture is. Creating an application with serverless functions, such as with AWS Lambda, provides agility and scalability to your application, but it also creates an added challenge for code tracing. In this session, we review Datadog's distributed tracing capabilities and how Trek10 uses those capabilities to improve its customers’ applications. Learn how to use AWS X-Ray in a serverless environment. Also, learn strategies for working with traces and logs that explain application errors. Finally, learn how Trek10 uses AWS X-Ray with Datadog to measure and improve its applications' performance. This session is brought to you by AWS partner, Datadog.

A Few Milliseconds in the Life of an HTTP Request (CTD416) - AWS re:Invent 2018

Amazon Web Services

In Amazon CloudFront, a lot happens in just a few milliseconds. Join us for a dive deep into the infrastructure and architecture of the AWS edge services, including Amazon CloudFront, Amazon Route 53, AWS Shield, and AWS WAF. We break down the life of an HTTP request, and any request in general, and walk you through how each of the AWS edge services work together in just a few milliseconds to consistently deliver your application’s content with high availability, security, and performance. Learn how edge services intelligently route requests to the most ideal edge location, secure your content behind the scenes, and leverage the AWS private network for improved performance.

Day Two Operations of Kubernetes on AWS (GPSTEC309) - AWS re:Invent 2018

Amazon Web Services

You've spent the time designing, architecting, setting up, and configuring your Kubernetes cluster. Now, it's on to day two. "Day two" refers to the functions of scaling, optimizing, monitoring, securing, and in general keeping the lights on. In this talk, we discuss the tools that you have available to help you build a reliable and resilient Kubernetes cluster and run workloads in production. We discuss how to control the network, secure your environment using threat detection, scan your containers for vulnerabilities, use monitoring tools, and create scalable containers and clusters.

How Enterprises Are Modernizing Their Security, Risk Management, & Compliance...

Amazon Web Services

Many organizations view security and risk & compliance functions as blockers to innovation. This chalk talk identifies the changes that are needed in executive engagement, budgeting, skills planning, and resource allocation to transform these perceived blockers into partners for innovation. We walk through an approach which can be used to address enterprise-level security, risk management, and compliance strategy. In addition, we share some key security & risk lessons from early enterprise adopters of AWS.

Enterprise DevOps: Patterns of Efficiency (ENT311-R1) - AWS re:Invent 2018

Amazon Web Services

DevOps is a powerful movement that can help enterprises speed up their rate of innovation. But many large organizations struggle to implement DevOps at scale due to conflicts (real and perceived) with existing IT processes. Enterprise DevOps is the convergence of the speed and agility from modern development processes with the governance, security, and compliance control from traditional IT operations processes. In this session, learn how to implement enterprise DevOps in your organization through building a culture of inclusion, common sense, and continuous improvement. Also learn how to incorporate the knowledge from subject matter experts across your business into your automated DevOps guardrails to create the positive feedback loop we call "patterns of efficiency." This session contains actionable advice for leaders from IT as well as finance, compliance, and security departments.

Globalizing Player Accounts at Riot Games While Maintaining Availability (ARC...

Amazon Web Services

The Player Accounts team at Riot Games needed to consolidate the player account infrastructure and provide a single, global accounts system for the League of Legends player base. To do this, they migrated hundreds of millions of player accounts into a consolidated, globally replicated composite database cluster in AWS. This provided higher fault tolerance and lower latency access to account data. In this talk, we discuss this effort to migrate eight disparate database clusters into AWS as a single composite database cluster replicated in four different AWS regions, provisioned with terraform, and managed and operated by Ansible.

Amazon Polly와 Cloud9을 활용한 서버리스 웹 애플리케이션 및 CI/CD 배포 프로세스 구축 (김현수, AWS 솔루션즈 아키텍...

Amazon Web Services Korea

Amazon Polly와 Cloud9을 활용한 서버리스 웹 애플리케이션 및 CI/CD 배포 프로세스 구축 서버리스 서비스로 쉽고 빠르게 인공지능 서비스를 활용한 웹 애플리케이션 구축을 할 수 있습니다. Cloud9 IDE를 이용하여 개발 환경을 구축하고, Lambda 함수에 코드를 작성하고, Polly를 이용해서 쉽게 TTS 서비스를 만들고, SAM(Serverless Architecture Model) 템플릿을 작성하여 서비스를 배포하는 방법을 설명합니다. 그리고 Code시리즈 서비스를 이용하여 CI/CD 프로세스를 구축하여 빌드와 단위 테스트 및 배포와 롤백 방법을 설명하고 데모를 시연합니다.

What's hot

Set Up a Communications Platform on AWS with AI-Enhanced Services (TLC302) - ...

Amazon Web Services

DevOps Concepts for Data Science (DEV347-R2) - AWS re:Invent 2018

Amazon Web Services

Network Foundations on AWS (GPSCT409) - AWS re:Invent 2018

Amazon Web Services

Foundations of AWS Global Cloud Infrastructure (ARC217) - AWS re:Invent 2018

Amazon Web Services

Operational Excellence with Containerized Workloads Using AWS Fargate (CON320...

Amazon Web Services

Operationalizing Machine Learning to Deliver Content at Scale (MAE306) - AWS ...

Amazon Web Services

Application Portability with Kubernetes (CMP310-S) - AWS re:Invent 2018

Amazon Web Services

Securely Deploying at Scale (SEC378-R1) - AWS re:Invent 2018

Amazon Web Services

Extending Data Centers to the Cloud: Connectivity Options and Best Practices ...

Amazon Web Services

[NEW LAUNCH!] Introduction to AWS Global Accelerator (NET330) - AWS re:Invent...

Amazon Web Services

Building an AWS IoT-Enabled Drink Dispenser (IOT405) - AWS re:Invent 2018

Amazon Web Services

Leadership Session: AWS Security (SEC305-L) - AWS re:Invent 2018

Amazon Web Services

AWS re:Invent 2018: Deep Dive: Hybrid Cloud Storage Arch. w/Storage Gateway, ...

Amazon Web Services

Best Practices for Building Multi-Region, Active-Active Serverless Applicatio...

Amazon Web Services

Deploy Alexa for Business in Your Organization & Build Your First Private Ski...

Amazon Web Services

How Trek10 Uses Datadog's Distributed Tracing to Improve AWS Lambda Projects ...

Amazon Web Services

A Few Milliseconds in the Life of an HTTP Request (CTD416) - AWS re:Invent 2018

Amazon Web Services

Day Two Operations of Kubernetes on AWS (GPSTEC309) - AWS re:Invent 2018

Amazon Web Services

How Enterprises Are Modernizing Their Security, Risk Management, & Compliance...

Amazon Web Services

Enterprise DevOps: Patterns of Efficiency (ENT311-R1) - AWS re:Invent 2018

Amazon Web Services

What's hot (20)