In this session, we cover three common scenarios that include Amazon CloudWatch Logs and AWS Lambda. Learn how to build an Elasticsearch cluster from historical data using Amazon S3, Lambda, and CloudWatch Logs. Discover how to add details to CloudWatch alarm notifications using Amazon SNS and Lambda. Finally, understand how to bring Elastic Load Balancing logs to CloudWatch Logs using S3 bucket triggers from Lambda.
Speaker: Leo Zhadanovsky, Principle Solutions Architect. Amazon Web Services
Level: 300
Learning Objectives:
- Learn how to make decisions about the service and share best practices and useful tips for success
- Learn about Content based routing, HTTP/2, WebSockets
- Secure your web applications using TLS termination, AWS WAF on Application Load Balancer
AWS provides a comprehensive set of global cloud computing services including compute, storage, databases, analytics, networking, mobile, developer tools, management tools, IoT, security and enterprise applications. Some key services highlighted include EC2 for virtual servers, S3 for object storage, RDS for managed relational databases, DynamoDB for NoSQL database services, EBS for block storage volumes, VPC for virtual networking, IAM for access management, CloudFront for content delivery and Route 53 for DNS services. AWS operates across multiple geographic regions and availability zones for reliability and high availability.
Webinar aws 101 a walk through the aws cloud- introduction to cloud computi...Amazon Web Services
Whether you are running applications that share photos or support critical operations of your business, you need rapid access to flexible and low cost IT resources. The term "cloud computing" refers to the on-demand delivery of IT resources via the Internet with pay-as-you-go pricing. Whether you are a start-up who wants to accelerate growth without a big upfront investment in cash or time for technology or an Enterprise looking for IT innovation, agility and resiliency while reducing costs, the AWS Cloud provides a complete set of web services at zero upfront costs which are available with a few clicks and within minutes. Join this webinar to learn more about the benefits of Cloud Computing and:
- The history of AWS and how a global online retailer got into cloud computing
- The concepts of utility computing and elasticity and why these are important to a cost-effective, scalable and reliable IT architecture
- The AWS service portfolio and the global footprint on which it is delivered
- The value proposition of the AWS Cloud
- Use cases to help you relate cloud based infrastructure to your own needs
- Busting the myths around cloud computing
- No prior experience is necessary, so join us for an overview of the AWS cloud services, and a discussion on how cloud computing can help accelerate innovation in your company.
Module 2: Core AWS Compute and Storage Services - Virtual AWSome Day June 2018Amazon Web Services
Module 2: Core AWS Compute Services (EC2, ELBm, AutoScaling, and EBS) and Storage Services (S3, RDS, and DynamoDB)
Virtual AWSome Day:
- Step-by-step introduction to the core AWS services for compute, storage, database, and networking.
- ideal for IT managers, system engineers, system administrators, and architects who are eager to learn more about cloud computing.
Identity and Access Management: The First Step in AWS SecurityAmazon Web Services
Identity and Access Management (IAM) is first step towards AWS cloud adoption because in the cloud, first you grant access and only then can you provision infrastructure (the opposite approach of on-premises). In this session, you will learn how to define fine-grained access to AWS resources via users, roles, and groups; design privileged user and multi-factor authentication mechanisms; and operate IAM at scale.
Level: 100
Speaker: Don Edwards - Sr. Technical Delivery Manager, AWS
Training for AWS Solutions Architect at http://zekelabs.com/courses/amazon-web-services-training-bangalore/.This slide describes about features of EC2, EC2 Options, family type, storage, EBS Volumes, EC2 Instance Store, Security Groups, Volumes and Snapshots, Amazon Machine Image (AMI), Elastic load balancer, Classic load balancer, Application load balancer, Network load balancer, AWS CLI and EC2 Metadata
___________________________________________________
zekeLabs is a Technology training platform. We provide instructor led corporate training and classroom training on Industry relevant Cutting Edge Technologies like Big Data, Machine Learning, Natural Language Processing, Artificial Intelligence, Data Science, Amazon Web Services, DevOps, Cloud Computing and Frameworks like Django,Spring, Ruby on Rails, Angular 2 and many more to Professionals.
Reach out to us at www.zekelabs.com or call us at +91 8095465880 or drop a mail at info@zekelabs.com
The document provides an overview of Amazon EC2, including:
- AWS concepts like regions, availability zones, and instance types
- Storage options like EBS, S3, and instance store
- Networking options like VPC, subnets, and load balancers
- Monitoring tools like CloudWatch and how to set up alarms
- Security measures like IAM roles and encryption
- Deployment options including AMIs, auto scaling, and CodeDeploy
by Apurv Awasthi, Sr. Technical Product Manager, AWS
This session introduces the concepts of AWS Identity and Access Management (IAM) and walks through the tools and strategies you can use to control access to your AWS environment. We describe IAM users, groups, and roles and how to use them. We demonstrate how to create IAM users and roles, and grant them various types of permissions to access AWS APIs and resources. We also cover the concept of trust relationships, and how you can use them to delegate access to your AWS resources. This session covers also covers IAM best practices that can help improve your security posture. We cover how to manage IAM users and roles, and their security credentials. We also explain ways for how you can securely manage you AWS access keys. Using common use cases, we demonstrate how to choose between using IAM users or IAM roles. Finally, we explore how to set permissions to grant least privilege access control in one or more of your AWS accounts. Level 100
Learning Objectives:
- Learn how to make decisions about the service and share best practices and useful tips for success
- Learn about Content based routing, HTTP/2, WebSockets
- Secure your web applications using TLS termination, AWS WAF on Application Load Balancer
AWS provides a comprehensive set of global cloud computing services including compute, storage, databases, analytics, networking, mobile, developer tools, management tools, IoT, security and enterprise applications. Some key services highlighted include EC2 for virtual servers, S3 for object storage, RDS for managed relational databases, DynamoDB for NoSQL database services, EBS for block storage volumes, VPC for virtual networking, IAM for access management, CloudFront for content delivery and Route 53 for DNS services. AWS operates across multiple geographic regions and availability zones for reliability and high availability.
Webinar aws 101 a walk through the aws cloud- introduction to cloud computi...Amazon Web Services
Whether you are running applications that share photos or support critical operations of your business, you need rapid access to flexible and low cost IT resources. The term "cloud computing" refers to the on-demand delivery of IT resources via the Internet with pay-as-you-go pricing. Whether you are a start-up who wants to accelerate growth without a big upfront investment in cash or time for technology or an Enterprise looking for IT innovation, agility and resiliency while reducing costs, the AWS Cloud provides a complete set of web services at zero upfront costs which are available with a few clicks and within minutes. Join this webinar to learn more about the benefits of Cloud Computing and:
- The history of AWS and how a global online retailer got into cloud computing
- The concepts of utility computing and elasticity and why these are important to a cost-effective, scalable and reliable IT architecture
- The AWS service portfolio and the global footprint on which it is delivered
- The value proposition of the AWS Cloud
- Use cases to help you relate cloud based infrastructure to your own needs
- Busting the myths around cloud computing
- No prior experience is necessary, so join us for an overview of the AWS cloud services, and a discussion on how cloud computing can help accelerate innovation in your company.
Module 2: Core AWS Compute and Storage Services - Virtual AWSome Day June 2018Amazon Web Services
Module 2: Core AWS Compute Services (EC2, ELBm, AutoScaling, and EBS) and Storage Services (S3, RDS, and DynamoDB)
Virtual AWSome Day:
- Step-by-step introduction to the core AWS services for compute, storage, database, and networking.
- ideal for IT managers, system engineers, system administrators, and architects who are eager to learn more about cloud computing.
Identity and Access Management: The First Step in AWS SecurityAmazon Web Services
Identity and Access Management (IAM) is first step towards AWS cloud adoption because in the cloud, first you grant access and only then can you provision infrastructure (the opposite approach of on-premises). In this session, you will learn how to define fine-grained access to AWS resources via users, roles, and groups; design privileged user and multi-factor authentication mechanisms; and operate IAM at scale.
Level: 100
Speaker: Don Edwards - Sr. Technical Delivery Manager, AWS
Training for AWS Solutions Architect at http://zekelabs.com/courses/amazon-web-services-training-bangalore/.This slide describes about features of EC2, EC2 Options, family type, storage, EBS Volumes, EC2 Instance Store, Security Groups, Volumes and Snapshots, Amazon Machine Image (AMI), Elastic load balancer, Classic load balancer, Application load balancer, Network load balancer, AWS CLI and EC2 Metadata
___________________________________________________
zekeLabs is a Technology training platform. We provide instructor led corporate training and classroom training on Industry relevant Cutting Edge Technologies like Big Data, Machine Learning, Natural Language Processing, Artificial Intelligence, Data Science, Amazon Web Services, DevOps, Cloud Computing and Frameworks like Django,Spring, Ruby on Rails, Angular 2 and many more to Professionals.
Reach out to us at www.zekelabs.com or call us at +91 8095465880 or drop a mail at info@zekelabs.com
The document provides an overview of Amazon EC2, including:
- AWS concepts like regions, availability zones, and instance types
- Storage options like EBS, S3, and instance store
- Networking options like VPC, subnets, and load balancers
- Monitoring tools like CloudWatch and how to set up alarms
- Security measures like IAM roles and encryption
- Deployment options including AMIs, auto scaling, and CodeDeploy
by Apurv Awasthi, Sr. Technical Product Manager, AWS
This session introduces the concepts of AWS Identity and Access Management (IAM) and walks through the tools and strategies you can use to control access to your AWS environment. We describe IAM users, groups, and roles and how to use them. We demonstrate how to create IAM users and roles, and grant them various types of permissions to access AWS APIs and resources. We also cover the concept of trust relationships, and how you can use them to delegate access to your AWS resources. This session covers also covers IAM best practices that can help improve your security posture. We cover how to manage IAM users and roles, and their security credentials. We also explain ways for how you can securely manage you AWS access keys. Using common use cases, we demonstrate how to choose between using IAM users or IAM roles. Finally, we explore how to set permissions to grant least privilege access control in one or more of your AWS accounts. Level 100
This session is focused on diving into the AWS IAM policy categories to understand the differences, learn how the policy evaluation logic works, and go over some best practices. We will then walk through how to use permission boundaries to truly delegate administration in AWS.
Amazon EC2 provides a broad selection of instance types to accommodate a diverse mix of workloads. In this session, we provide an overview of the Amazon EC2 instance platform, key features, and the concept of instance generations.
Amazon Elastic Compute Cloud (Amazon EC2) provides a broad selection of instance types to accommodate a diverse mix of workloads. In this technical session, we provide an overview of the Amazon EC2 instance platform, key platform features, and the concept of instance generations. We dive into the current generation design choices of the different instance families, including the General Purpose, Compute Optimized, Storage Optimized, Memory Optimized, and GPU instance families. We also detail best practices and share performance tips for getting the most out of your Amazon EC2 instances.
AWS Control Tower is a new AWS service for cloud administrators to set up and govern their secure, compliant, multi-account environments on AWS.
In this session, University of York will discuss their implementation of AWS Landing Zone. We’ll also explain how AWS Control Tower automates AWS Landing Zone creation with best-practice blueprints.
This document provides an overview of AWS Identity and Access Management (IAM) and how it can be used to control access to AWS resources. IAM enables control of who can access AWS accounts and what actions they can perform by creating users, groups, and roles with permissions. The document discusses IAM concepts and common use cases, and includes demonstrations of creating IAM users and groups and assigning permissions through policies.
Do you want to run your code without the cost and effort of provisioning and managing servers? Find out how in this deep dive session on AWS Lambda, which allows you to run code for virtually any type of application or back end service – all with zero administration. During the session, we’ll look at a number of key AWS Lambda features and benefits, including automated application scaling with high availability; pay-as-you-consume billing; and the ability to automatically trigger your code from other AWS services or from any web or mobile app.
The document discusses content delivery networks (CDNs) and Amazon CloudFront. A CDN improves performance and reliability by caching content across globally distributed edge servers close to users. CloudFront is AWS's CDN that provides low latency, high bandwidth, redundancy, scalability and cost-effectiveness. It supports dynamic and static content delivery via HTTP, RTMP and more. Customers can use CloudFront to improve website performance and user experience.
Introduction to AWS Cloud Computing | AWS Public Sector Summit 2016Amazon Web Services
Amazon Web Services (AWS) provides on-demand computing resources and services in the cloud, with pay-as-you-go pricing. This session provides an overview and describes how using AWS resources instead of your own is like purchasing electricity from a power company instead of running your own generator. Using AWS resources provides many of the same benefits as a public utility: Capacity exactly matches your need, you pay only for what you use, economies of scale result in lower costs, and the service is provided by a vendor experienced in running large-scale networks. A high-level overview of AWS’s infrastructure (such as AWS Regions and Availability Zones) and AWS services is provided as part of this session.
Access Control for the Cloud: AWS Identity and Access Management (IAM) (SEC20...Amazon Web Services
Learn how AWS IAM enables you to control who can do what in your AWS environment. We discuss how IAM provides flexible access control that helps you maintain security while adapting to your evolving business needs. Wel review how to integrate AWS IAM with your existing identity directories via identity federation. We outline some of the unique challenges that make providing IAM for the cloud a little different. And throughout the presentation, we highlight recent features that make it even easier to manage the security of your workloads on the cloud.
This document introduces Amazon EKS, a managed Kubernetes service that makes it easy to run Kubernetes on AWS. Some key points:
- EKS manages the control plane components needed to run Kubernetes clusters, eliminating the overhead of maintaining the control plane.
- It provisions and manages the Kubernetes control plane across multiple availability zones, providing high availability.
- It also integrates tightly with other AWS services like IAM, VPC networking, security groups, load balancers, and more for a native AWS experience.
- EKS is based on the open source Kubernetes project and allows users to leverage the same APIs, tooling, and features while benefiting from the scalability of AWS.
This document provides an overview of architecting applications for the AWS cloud. It discusses key AWS cloud computing attributes like scalability, on-demand provisioning, and efficiency of experts. It also outlines best practices like designing for failure, loose coupling, dynamism, and security. Specific AWS services are mapped to common application needs like compute, storage, content delivery, databases, and more. Overall the document aims to educate readers on how to leverage AWS architectural principles and services.
This document provides an overview of AWS multi-account architecture best practices and strategies for implementing a "landing zone" on AWS. It discusses setting up accounts for master, core services, shared services, development sandboxes, and team/group environments. The document then outlines steps for implementing a landing zone using the AWS Landing Zone solution, including setting up accounts for shared services, log archives, security and establishing baselines across team accounts.
AWS Direct Connect allows organizations to establish a dedicated network connection from their premises to AWS. It provides higher bandwidth, more consistent network performance than internet-based connections, and avoids public internet charges for data transfer. Customers can establish Direct Connect connections from their data centers to AWS using partner network providers.
(DVO315) Log, Monitor and Analyze your IT with Amazon CloudWatchAmazon Web Services
You may already know that you can use Amazon CloudWatch to view graphs of your AWS resources like Amazon Elastic Compute Cloud instances or Amazon Simple Storage Service. But, did you know that you can monitor your on-premises servers with Amazon CloudWatch Logs? Or, that you can integrate CloudWatch Logs with Elasticsearch for powerful visualization and analysis? This session will offer a tour of the latest monitoring and automation capabilities that we’ve added, how you can get even more done with Amazon CloudWatch.
Elastic Load Balancing allows the incoming traffic to be distributed automatically across multiple healthy EC2 instances.
ELB serves as a single point of contact to the client.
ELB helps to being transparent and increases the application availability by allowing addition or removal of multiple EC2 instances across one or more availability zones, without disrupting the overall flow of information.
1) The document discusses initial considerations for deploying applications on AWS such as how the service will be accessed, what data is being handled, and compliance needs.
2) It then covers the AWS shared responsibility model and who manages what between AWS and the customer for different types of AWS services.
3) Practical advice is provided on security controls to deploy on AWS, including using Route 53, CloudFront, S3 buckets, application load balancers, and VPC components.
4) The document concludes by recommending several AWS security audit tools including CloudTrail, Config, GuardDuty, and VPC flow logs to ensure deployments are working as planned.
Docker containers have become a key component of modern application design. Increasingly, developers are breaking their applications apart into smaller components and distributing them across a pool of compute resources.
Amazon EC2 Container Service is a new AWS service that makes it easy to run and manage Docker-enabled applications across a cluster of Amazon EC2 instances. Amazon EC2 Container Service lets you define, schedule, and stop sets of containers. You have access to the state of your resources, making it easy to confirm that tasks are running or view the utilization of Amazon EC2 instances in your cluster. This session will describe the benefits of containers, introduce the Amazon EC2 Container Service, and demonstrate how to use Amazon EC2 Container Service for your applications.
Speakers:
Ian Massingham, AWS Technical Evangelist and
Boyan Dimitrov, Platform Automation Lead, Hailo Cabs
AWS Security, Identity, & Compliance - An Overview: AWS Security Week at the San Francisco Loft
Presenter: William Reid, CISM, FIP
Head of Security and Compliance Solution Architecture, AWS
Amazon CloudWatch Logs and AWS Lambda: A Match Made in HeavenAmazon Web Services
In this session, we cover three common scenarios that include Amazon CloudWatch Logs and AWS Lambda. First, you learn to build an Elasticsearch cluster from historical data using Amazon Simple Storage Service (S3), AWS Lambda, and Amazon CloudWatch Logs. Next, you learn to add details to Amazon CloudWatch alarm notifications using Amazon Simple Notification Service (SNS) and AWS Lambda. Finally, we show you how to bring Elastic Load Balancing logs to Amazon CloudWatch Logs using S3 bucket triggers from AWS Lambda.
Amazon CloudWatch Logs and AWS Lambda: A Match Made in Heaven | AWS Public Se...Amazon Web Services
In this session, we cover three common scenarios that include Amazon CloudWatch Logs and AWS Lambda. First, you learn to build an Elasticsearch cluster from historical data using Amazon S3, Lambda, and CloudWatch Logs. Next, you learn to add details to CloudWatch alarm notifications using Amazon SNS and Lambda. Finally, we show you how to bring Elastic Load Balancing logs to CloudWatch Logs using S3 bucket triggers from Lambda. Learn More: https://aws.amazon.com/government-education/
This session is focused on diving into the AWS IAM policy categories to understand the differences, learn how the policy evaluation logic works, and go over some best practices. We will then walk through how to use permission boundaries to truly delegate administration in AWS.
Amazon EC2 provides a broad selection of instance types to accommodate a diverse mix of workloads. In this session, we provide an overview of the Amazon EC2 instance platform, key features, and the concept of instance generations.
Amazon Elastic Compute Cloud (Amazon EC2) provides a broad selection of instance types to accommodate a diverse mix of workloads. In this technical session, we provide an overview of the Amazon EC2 instance platform, key platform features, and the concept of instance generations. We dive into the current generation design choices of the different instance families, including the General Purpose, Compute Optimized, Storage Optimized, Memory Optimized, and GPU instance families. We also detail best practices and share performance tips for getting the most out of your Amazon EC2 instances.
AWS Control Tower is a new AWS service for cloud administrators to set up and govern their secure, compliant, multi-account environments on AWS.
In this session, University of York will discuss their implementation of AWS Landing Zone. We’ll also explain how AWS Control Tower automates AWS Landing Zone creation with best-practice blueprints.
This document provides an overview of AWS Identity and Access Management (IAM) and how it can be used to control access to AWS resources. IAM enables control of who can access AWS accounts and what actions they can perform by creating users, groups, and roles with permissions. The document discusses IAM concepts and common use cases, and includes demonstrations of creating IAM users and groups and assigning permissions through policies.
Do you want to run your code without the cost and effort of provisioning and managing servers? Find out how in this deep dive session on AWS Lambda, which allows you to run code for virtually any type of application or back end service – all with zero administration. During the session, we’ll look at a number of key AWS Lambda features and benefits, including automated application scaling with high availability; pay-as-you-consume billing; and the ability to automatically trigger your code from other AWS services or from any web or mobile app.
The document discusses content delivery networks (CDNs) and Amazon CloudFront. A CDN improves performance and reliability by caching content across globally distributed edge servers close to users. CloudFront is AWS's CDN that provides low latency, high bandwidth, redundancy, scalability and cost-effectiveness. It supports dynamic and static content delivery via HTTP, RTMP and more. Customers can use CloudFront to improve website performance and user experience.
Introduction to AWS Cloud Computing | AWS Public Sector Summit 2016Amazon Web Services
Amazon Web Services (AWS) provides on-demand computing resources and services in the cloud, with pay-as-you-go pricing. This session provides an overview and describes how using AWS resources instead of your own is like purchasing electricity from a power company instead of running your own generator. Using AWS resources provides many of the same benefits as a public utility: Capacity exactly matches your need, you pay only for what you use, economies of scale result in lower costs, and the service is provided by a vendor experienced in running large-scale networks. A high-level overview of AWS’s infrastructure (such as AWS Regions and Availability Zones) and AWS services is provided as part of this session.
Access Control for the Cloud: AWS Identity and Access Management (IAM) (SEC20...Amazon Web Services
Learn how AWS IAM enables you to control who can do what in your AWS environment. We discuss how IAM provides flexible access control that helps you maintain security while adapting to your evolving business needs. Wel review how to integrate AWS IAM with your existing identity directories via identity federation. We outline some of the unique challenges that make providing IAM for the cloud a little different. And throughout the presentation, we highlight recent features that make it even easier to manage the security of your workloads on the cloud.
This document introduces Amazon EKS, a managed Kubernetes service that makes it easy to run Kubernetes on AWS. Some key points:
- EKS manages the control plane components needed to run Kubernetes clusters, eliminating the overhead of maintaining the control plane.
- It provisions and manages the Kubernetes control plane across multiple availability zones, providing high availability.
- It also integrates tightly with other AWS services like IAM, VPC networking, security groups, load balancers, and more for a native AWS experience.
- EKS is based on the open source Kubernetes project and allows users to leverage the same APIs, tooling, and features while benefiting from the scalability of AWS.
This document provides an overview of architecting applications for the AWS cloud. It discusses key AWS cloud computing attributes like scalability, on-demand provisioning, and efficiency of experts. It also outlines best practices like designing for failure, loose coupling, dynamism, and security. Specific AWS services are mapped to common application needs like compute, storage, content delivery, databases, and more. Overall the document aims to educate readers on how to leverage AWS architectural principles and services.
This document provides an overview of AWS multi-account architecture best practices and strategies for implementing a "landing zone" on AWS. It discusses setting up accounts for master, core services, shared services, development sandboxes, and team/group environments. The document then outlines steps for implementing a landing zone using the AWS Landing Zone solution, including setting up accounts for shared services, log archives, security and establishing baselines across team accounts.
AWS Direct Connect allows organizations to establish a dedicated network connection from their premises to AWS. It provides higher bandwidth, more consistent network performance than internet-based connections, and avoids public internet charges for data transfer. Customers can establish Direct Connect connections from their data centers to AWS using partner network providers.
(DVO315) Log, Monitor and Analyze your IT with Amazon CloudWatchAmazon Web Services
You may already know that you can use Amazon CloudWatch to view graphs of your AWS resources like Amazon Elastic Compute Cloud instances or Amazon Simple Storage Service. But, did you know that you can monitor your on-premises servers with Amazon CloudWatch Logs? Or, that you can integrate CloudWatch Logs with Elasticsearch for powerful visualization and analysis? This session will offer a tour of the latest monitoring and automation capabilities that we’ve added, how you can get even more done with Amazon CloudWatch.
Elastic Load Balancing allows the incoming traffic to be distributed automatically across multiple healthy EC2 instances.
ELB serves as a single point of contact to the client.
ELB helps to being transparent and increases the application availability by allowing addition or removal of multiple EC2 instances across one or more availability zones, without disrupting the overall flow of information.
1) The document discusses initial considerations for deploying applications on AWS such as how the service will be accessed, what data is being handled, and compliance needs.
2) It then covers the AWS shared responsibility model and who manages what between AWS and the customer for different types of AWS services.
3) Practical advice is provided on security controls to deploy on AWS, including using Route 53, CloudFront, S3 buckets, application load balancers, and VPC components.
4) The document concludes by recommending several AWS security audit tools including CloudTrail, Config, GuardDuty, and VPC flow logs to ensure deployments are working as planned.
Docker containers have become a key component of modern application design. Increasingly, developers are breaking their applications apart into smaller components and distributing them across a pool of compute resources.
Amazon EC2 Container Service is a new AWS service that makes it easy to run and manage Docker-enabled applications across a cluster of Amazon EC2 instances. Amazon EC2 Container Service lets you define, schedule, and stop sets of containers. You have access to the state of your resources, making it easy to confirm that tasks are running or view the utilization of Amazon EC2 instances in your cluster. This session will describe the benefits of containers, introduce the Amazon EC2 Container Service, and demonstrate how to use Amazon EC2 Container Service for your applications.
Speakers:
Ian Massingham, AWS Technical Evangelist and
Boyan Dimitrov, Platform Automation Lead, Hailo Cabs
AWS Security, Identity, & Compliance - An Overview: AWS Security Week at the San Francisco Loft
Presenter: William Reid, CISM, FIP
Head of Security and Compliance Solution Architecture, AWS
Amazon CloudWatch Logs and AWS Lambda: A Match Made in HeavenAmazon Web Services
In this session, we cover three common scenarios that include Amazon CloudWatch Logs and AWS Lambda. First, you learn to build an Elasticsearch cluster from historical data using Amazon Simple Storage Service (S3), AWS Lambda, and Amazon CloudWatch Logs. Next, you learn to add details to Amazon CloudWatch alarm notifications using Amazon Simple Notification Service (SNS) and AWS Lambda. Finally, we show you how to bring Elastic Load Balancing logs to Amazon CloudWatch Logs using S3 bucket triggers from AWS Lambda.
Amazon CloudWatch Logs and AWS Lambda: A Match Made in Heaven | AWS Public Se...Amazon Web Services
In this session, we cover three common scenarios that include Amazon CloudWatch Logs and AWS Lambda. First, you learn to build an Elasticsearch cluster from historical data using Amazon S3, Lambda, and CloudWatch Logs. Next, you learn to add details to CloudWatch alarm notifications using Amazon SNS and Lambda. Finally, we show you how to bring Elastic Load Balancing logs to CloudWatch Logs using S3 bucket triggers from Lambda. Learn More: https://aws.amazon.com/government-education/
In this session, we cover three common scenarios that include Amazon CloudWatch Logs and AWS Lambda. First, you learn how to build an Elasticsearch cluster from historical data using Amazon S3, Lambda, and CloudWatch Logs. Next, you learn how to add details to CloudWatch alarm notifications using Amazon SNS and Lambda. Finally, we show you how to bring Elastic Load Balancing logs to CloudWatch Logs using S3 bucket triggers from Lambda.
AWS re:Invent 2016: Amazon CloudWatch Logs and AWS Lambda: A Match Made in He...Amazon Web Services
In this session, we cover three common scenarios that include Amazon CloudWatch Logs and AWS Lambda. First, you learn how to build an Elasticsearch cluster from historical data using Amazon S3, Lambda, and CloudWatch Logs. Next, you learn how to add details to CloudWatch alarm notifications using Amazon SNS and Lambda. Finally, we show you how to bring Elastic Load Balancing logs to CloudWatch Logs using S3 bucket triggers from Lambda.
AWS re:Invent 2016: Amazon CloudWatch Logs and AWS Lambda: A Match Made in He...Amazon Web Services
In this session, we cover three common scenarios that include Amazon CloudWatch Logs and AWS Lambda. First, you learn how to build an Elasticsearch cluster from historical data using Amazon S3, Lambda, and CloudWatch Logs. Next, you learn how to add details to CloudWatch alarm notifications using Amazon SNS and Lambda. Finally, we show you how to bring Elastic Load Balancing logs to CloudWatch Logs using S3 bucket triggers from Lambda.
This document discusses using Amazon CloudWatch Logs and AWS Lambda together to solve common monitoring use cases. It describes how Lambda can be used to centralize logs from Elastic Load Balancing (ELB) in CloudWatch Logs by triggering on S3 object creation events. It also discusses how alarms in CloudWatch can be customized by configuring Lambda functions to provide more context when alarms are triggered, such as extracting relevant log data and sending it over email. Finally, it mentions how an on-demand Elasticsearch cluster can be built for log analysis.
Serverless Analytics and Monitoring For Your Cloud AppAtlassian
Are you running a cloud app and struggling to get the right information out of your app and cloud infrastructure? A majority of third-party apps in the Atlassian Marketplace run on AWS, but they don't use it to its full potential in analyzing their data. For example, do you know which customer is producing the biggest traffic within your app? How well is your app performing? Do you know which features of your app are the most popular ones? This talk will help you to find low-cost options available to analyze and monitor data of your app and cloud infrastructure. There are many services which you can already use without even changing your existing app or infrastructure and without running any servers by yourself. Sebastian Hesse of K15t will give you tips and tricks for retrieving the information you need - surprises included!
AWS Lambda allows any Node.js app to be run at scale in a massively parallel environment with no up-front costs or planning. This session shows how to use Lambda to build dynamic analytic data flows that can be tuned as they execute, based on initial results, to provide real-time output streamed to web clients. This process enables a cost-effective and responsive user experience for ad hoc big data jobs and lets developers focus on how data is consumed and presented, instead of how it is obtained.
1. The document provides a practical approach for achieving security operations (SecOps) excellence in AWS through controlling, monitoring, and fixing security issues.
2. It discusses establishing guardrails through identity and access management (IAM), infrastructure as code (Code*), and AWS Config as part of the control phase. The monitor phase involves visibility tools like CloudTrail, CloudWatch, and VPC flow logs. The fix phase deals with exceptions through automation with Lambda.
3. A demonstration is provided of an event flow showing how security controls would be enhanced from standard to active monitoring in response to a detected anomaly.
An overview of AWS services used, how our new staging and production infrastructure compares to our previous on-premises setup, and how deployment has changed.
The document summarizes the 2015 Amazon Web Services re:Invent conference. It highlights the growth in attendance from 9,000 to 19,000. It outlines new computing and database services announced as well as analytics, security, and management tools. Examples are given of how Netflix and a content management system benefited from migrating to AWS. Lessons learned focused on not all features transferring directly and the learning curve involved. The document encourages hands-on learning with AWS free services and attending next year's conference.
AWS Summit Auckland - Getting Started with AWS Lambda and the Serverless CloudAmazon Web Services
This document provides an overview of AWS Lambda and serverless computing. It discusses five sample use cases for AWS Lambda including adding features to Amazon S3, extending platforms, building scalable mobile backends, real-time streaming analysis, and serverless microservices. The document then covers requirements, building a mobile backend without coding it, and additional capabilities. It dives deeper into programming models and resource sizing and provides examples of extending other AWS services like Amazon S3.
Automate Your Big Data Workflows (SVC201) | AWS re:Invent 2013Amazon Web Services
As troves of data grow exponentially, the number of analytical jobs that process the data also grows rapidly. When you have large teams running hundreds of analytical jobs, coordinating and scheduling those jobs becomes crucial. Using Amazon Simple Workflow Service (Amazon SWF) and AWS Data Pipeline, you can create automated, repeatable, schedulable processes that reduce or even eliminate the custom scripting and help you efficiently run your Amazon Elastic MapReduce (Amazon EMR) or Amazon Redshift clusters. In this session, we show how you can automate your big data workflows. Learn best practices from customers like Change.org, KickStarter and UnSilo on how they use AWS to gain business insights from their data in a repeatable and reliable fashion.
This document summarizes a presentation given by Dr. Tim Wagner, General Manager of AWS Lambda and Amazon API Gateway, at the AWS New York Summit on August 11, 2016 about getting started with serverless computing using AWS Lambda and Amazon API Gateway. The presentation introduced serverless computing and how it abstracts infrastructure management, discussed AWS Lambda and Amazon API Gateway services and how to choose between them. It also provided examples of serverless use cases including data processing, backend services, and app ecosystems. Tips for VPC configuration, function scheduling, and stage variables in API Gateway were also shared.
AWS re:Invent 2016: Automated Governance of Your AWS Resources (DEV302)Amazon Web Services
AWS CloudTrail, Amazon CloudWatch Events, AWS Identity & Access Management (IAM), Trusted Advisor, AWS Config Rules, other services? In this session, we will help you use existing and recently launched services to automate configuration governance so that security is embedded in the development process. We outline four easy steps (Control, Monitor, Fix, and Audit) and demonstrate how different services can be used to meet your governance needs. We will showcase real-life examples and you can take home a blog post with code examples and the full source code for scripts and tooling that AWS professional services have built using these services.
AWS April Webinar Series - AWS Lambda: Event-driven Code for Devices and the ...Amazon Web Services
AWS Lambda is a new compute service that runs your code in response to events and automatically manages compute resources for you. In this webinar you’ll learn what you need to quickly begin building mobile, tablet, or IoT applications that use AWS Lambda as a serverless back-end. You’ll also hear about Amazon Web Service’s Event-Driven Compute strategy and see demonstrations that use Lambda to respond to events from Amazon S3 notifications and Amazon DynamoDB streams. We’ll cover key Lambda features, its programming model, and tips on getting the most out of Lambda functions.
Learning Objectives:
• Understand key AWS Lambda features
• Learn the AWS Lambda programming model
• Get tips on getting the most out of AWS Lambda
Who Should Attend:
• Developers, Dev-ops Engineers, IT Operations Professionals
Building a Real Time Dashboard with Amazon Kinesis, Amazon Lambda and Amazon ...Amazon Web Services
Organisations today need a way to manage the ever-increasing volume of data from numerous sources such as log systems, click streams or connected devices and be able to analyse this data in real-time. In this session we will walk through an architecture demonstration of how to leverage AWS services to meet these needs.
Speaker: Ganesh Raja, Solutions Architect, Amazon Web Services
Amazon CloudWatch is an AWS service that monitors resources and applications in the AWS cloud. It collects metrics, logs, and other operational data to provide visibility into resource utilization, application performance, and overall operational health. CloudWatch allows users to set alarms that watch metrics and trigger notifications or actions when thresholds are crossed. It also enables log aggregation, visualization of metrics and logs on dashboards, and integration with other AWS services like EC2 Auto Scaling and SNS.
AWS October Webinar Series - AWS Lambda Best Practices: Python, Scheduled Job...Amazon Web Services
AWS Lambda lets you run code without provisioning or managing servers. We have introduced a few new features this year at re:Invent and would like to share with you some of the best practices.
This webinar will introduce you to scheduled AWS Lambda functions and how to use long running functions to handle large volume data ingestion and processing jobs. We will demonstrate how to use versioning to control which Lambda function version is being executed in your development, testing, and production environments. We will also show you how to run your Python code in AWS Lambda.
Cloud Roundtable | Amazon Web Services: Key = IterationCodemotion
The document discusses Amazon Web Services (AWS) and how it enables rapid iteration of applications through services like AWS Lambda, API Gateway, and other tools. It provides examples of using AWS Lambda to build serverless applications that can extract metadata from photos uploaded to S3 and send push notifications through a trending function that analyzes DynamoDB. The document emphasizes that AWS allows developers to focus on innovation through a programmable platform that can automate infrastructure concerns.
Similar to Amazon CloudWatch Logs and AWS Lambda: A Match Made in Heaven (20)
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Amazon Web Services
Il Forecasting è un processo importante per tantissime aziende e viene utilizzato in vari ambiti per cercare di prevedere in modo accurato la crescita e distribuzione di un prodotto, l’utilizzo delle risorse necessarie nelle linee produttive, presentazioni finanziarie e tanto altro. Amazon utilizza delle tecniche avanzate di forecasting, in parte questi servizi sono stati messi a disposizione di tutti i clienti AWS.
In questa sessione illustreremo come pre-processare i dati che contengono una componente temporale e successivamente utilizzare un algoritmo che a partire dal tipo di dato analizzato produce un forecasting accurato.
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Amazon Web Services
La varietà e la quantità di dati che si crea ogni giorno accelera sempre più velocemente e rappresenta una opportunità irripetibile per innovare e creare nuove startup.
Tuttavia gestire grandi quantità di dati può apparire complesso: creare cluster Big Data su larga scala sembra essere un investimento accessibile solo ad aziende consolidate. Ma l’elasticità del Cloud e, in particolare, i servizi Serverless ci permettono di rompere questi limiti.
Vediamo quindi come è possibile sviluppare applicazioni Big Data rapidamente, senza preoccuparci dell’infrastruttura, ma dedicando tutte le risorse allo sviluppo delle nostre le nostre idee per creare prodotti innovativi.
Ora puoi utilizzare Amazon Elastic Kubernetes Service (EKS) per eseguire pod Kubernetes su AWS Fargate, il motore di elaborazione serverless creato per container su AWS. Questo rende più semplice che mai costruire ed eseguire le tue applicazioni Kubernetes nel cloud AWS.In questa sessione presenteremo le caratteristiche principali del servizio e come distribuire la tua applicazione in pochi passaggi
Vent'anni fa Amazon ha attraversato una trasformazione radicale con l'obiettivo di aumentare il ritmo dell'innovazione. In questo periodo abbiamo imparato come cambiare il nostro approccio allo sviluppo delle applicazioni ci ha permesso di aumentare notevolmente l'agilità, la velocità di rilascio e, in definitiva, ci ha consentito di creare applicazioni più affidabili e scalabili. In questa sessione illustreremo come definiamo le applicazioni moderne e come la creazione di app moderne influisce non solo sull'architettura dell'applicazione, ma sulla struttura organizzativa, sulle pipeline di rilascio dello sviluppo e persino sul modello operativo. Descriveremo anche approcci comuni alla modernizzazione, compreso l'approccio utilizzato dalla stessa Amazon.com.
Come spendere fino al 90% in meno con i container e le istanze spot Amazon Web Services
L’utilizzo dei container è in continua crescita.
Se correttamente disegnate, le applicazioni basate su Container sono molto spesso stateless e flessibili.
I servizi AWS ECS, EKS e Kubernetes su EC2 possono sfruttare le istanze Spot, portando ad un risparmio medio del 70% rispetto alle istanze On Demand. In questa sessione scopriremo insieme quali sono le caratteristiche delle istanze Spot e come possono essere utilizzate facilmente su AWS. Impareremo inoltre come Spreaker sfrutta le istanze spot per eseguire applicazioni di diverso tipo, in produzione, ad una frazione del costo on-demand!
In recent months, many customers have been asking us the question – how to monetise Open APIs, simplify Fintech integrations and accelerate adoption of various Open Banking business models. Therefore, AWS and FinConecta would like to invite you to Open Finance marketplace presentation on October 20th.
Event Agenda :
Open banking so far (short recap)
• PSD2, OB UK, OB Australia, OB LATAM, OB Israel
Intro to Open Finance marketplace
• Scope
• Features
• Tech overview and Demo
The role of the Cloud
The Future of APIs
• Complying with regulation
• Monetizing data / APIs
• Business models
• Time to market
One platform for all: a Strategic approach
Q&A
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Amazon Web Services
Per creare valore e costruire una propria offerta differenziante e riconoscibile, le startup di successo sanno come combinare tecnologie consolidate con componenti innovativi creati ad hoc.
AWS fornisce servizi pronti all'utilizzo e, allo stesso tempo, permette di personalizzare e creare gli elementi differenzianti della propria offerta.
Concentrandoci sulle tecnologie di Machine Learning, vedremo come selezionare i servizi di intelligenza artificiale offerti da AWS e, anche attraverso una demo, come costruire modelli di Machine Learning personalizzati utilizzando SageMaker Studio.
OpsWorks Configuration Management: automatizza la gestione e i deployment del...Amazon Web Services
Con l'approccio tradizionale al mondo IT per molti anni è stato difficile implementare tecniche di DevOps, che finora spesso hanno previsto attività manuali portando di tanto in tanto a dei downtime degli applicativi interrompendo l'operatività dell'utente. Con l'avvento del cloud, le tecniche di DevOps sono ormai a portata di tutti a basso costo per qualsiasi genere di workload, garantendo maggiore affidabilità del sistema e risultando in dei significativi miglioramenti della business continuity.
AWS mette a disposizione AWS OpsWork come strumento di Configuration Management che mira ad automatizzare e semplificare la gestione e i deployment delle istanze EC2 per mezzo di workload Chef e Puppet.
Scopri come sfruttare AWS OpsWork a garanzia e affidabilità del tuo applicativo installato su Instanze EC2.
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsAmazon Web Services
Vuoi conoscere le opzioni per eseguire Microsoft Active Directory su AWS? Quando si spostano carichi di lavoro Microsoft in AWS, è importante considerare come distribuire Microsoft Active Directory per supportare la gestione, l'autenticazione e l'autorizzazione dei criteri di gruppo. In questa sessione, discuteremo le opzioni per la distribuzione di Microsoft Active Directory su AWS, incluso AWS Directory Service per Microsoft Active Directory e la distribuzione di Active Directory su Windows su Amazon Elastic Compute Cloud (Amazon EC2). Trattiamo argomenti quali l'integrazione del tuo ambiente Microsoft Active Directory locale nel cloud e l'utilizzo di applicazioni SaaS, come Office 365, con AWS Single Sign-On.
Dal riconoscimento facciale al riconoscimento di frodi o difetti di fabbricazione, l'analisi di immagini e video che sfruttano tecniche di intelligenza artificiale, si stanno evolvendo e raffinando a ritmi elevati. In questo webinar esploreremo le possibilità messe a disposizione dai servizi AWS per applicare lo stato dell'arte delle tecniche di computer vision a scenari reali.
Amazon Web Services e VMware organizzano un evento virtuale gratuito il prossimo mercoledì 14 Ottobre dalle 12:00 alle 13:00 dedicato a VMware Cloud ™ on AWS, il servizio on demand che consente di eseguire applicazioni in ambienti cloud basati su VMware vSphere® e di accedere ad una vasta gamma di servizi AWS, sfruttando a pieno le potenzialità del cloud AWS e tutelando gli investimenti VMware esistenti.
Molte organizzazioni sfruttano i vantaggi del cloud migrando i propri carichi di lavoro Oracle e assicurandosi notevoli vantaggi in termini di agilità ed efficienza dei costi.
La migrazione di questi carichi di lavoro, può creare complessità durante la modernizzazione e il refactoring delle applicazioni e a questo si possono aggiungere rischi di prestazione che possono essere introdotti quando si spostano le applicazioni dai data center locali.
Crea la tua prima serverless ledger-based app con QLDB e NodeJSAmazon Web Services
Molte aziende oggi, costruiscono applicazioni con funzionalità di tipo ledger ad esempio per verificare lo storico di accrediti o addebiti nelle transazioni bancarie o ancora per tenere traccia del flusso supply chain dei propri prodotti.
Alla base di queste soluzioni ci sono i database ledger che permettono di avere un log delle transazioni trasparente, immutabile e crittograficamente verificabile, ma sono strumenti complessi e onerosi da gestire.
Amazon QLDB elimina la necessità di costruire sistemi personalizzati e complessi fornendo un database ledger serverless completamente gestito.
In questa sessione scopriremo come realizzare un'applicazione serverless completa che utilizzi le funzionalità di QLDB.
Con l’ascesa delle architetture di microservizi e delle ricche applicazioni mobili e Web, le API sono più importanti che mai per offrire agli utenti finali una user experience eccezionale. In questa sessione impareremo come affrontare le moderne sfide di progettazione delle API con GraphQL, un linguaggio di query API open source utilizzato da Facebook, Amazon e altro e come utilizzare AWS AppSync, un servizio GraphQL serverless gestito su AWS. Approfondiremo diversi scenari, comprendendo come AppSync può aiutare a risolvere questi casi d’uso creando API moderne con funzionalità di aggiornamento dati in tempo reale e offline.
Inoltre, impareremo come Sky Italia utilizza AWS AppSync per fornire aggiornamenti sportivi in tempo reale agli utenti del proprio portale web.
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareAmazon Web Services
Molte organizzazioni sfruttano i vantaggi del cloud migrando i propri carichi di lavoro Oracle e assicurandosi notevoli vantaggi in termini di agilità ed efficienza dei costi.
La migrazione di questi carichi di lavoro, può creare complessità durante la modernizzazione e il refactoring delle applicazioni e a questo si possono aggiungere rischi di prestazione che possono essere introdotti quando si spostano le applicazioni dai data center locali.
In queste slide, gli esperti AWS e VMware presentano semplici e pratici accorgimenti per facilitare e semplificare la migrazione dei carichi di lavoro Oracle accelerando la trasformazione verso il cloud, approfondiranno l’architettura e dimostreranno come sfruttare a pieno le potenzialità di VMware Cloud ™ on AWS.
1) The document discusses building a minimum viable product (MVP) using Amazon Web Services (AWS).
2) It provides an example of an MVP for an omni-channel messenger platform that was built from 2017 to connect ecommerce stores to customers via web chat, Facebook Messenger, WhatsApp, and other channels.
3) The founder discusses how they started with an MVP in 2017 with 200 ecommerce stores in Hong Kong and Taiwan, and have since expanded to over 5000 clients across Southeast Asia using AWS for scaling.
This document discusses pitch decks and fundraising materials. It explains that venture capitalists will typically spend only 3 minutes and 44 seconds reviewing a pitch deck. Therefore, the deck needs to tell a compelling story to grab their attention. It also provides tips on tailoring different types of decks for different purposes, such as creating a concise 1-2 page teaser, a presentation deck for pitching in-person, and a more detailed read-only or fundraising deck. The document stresses the importance of including key information like the problem, solution, product, traction, market size, plans, team, and ask.
This document discusses building serverless web applications using AWS services like API Gateway, Lambda, DynamoDB, S3 and Amplify. It provides an overview of each service and how they can work together to create a scalable, secure and cost-effective serverless application stack without having to manage servers or infrastructure. Key services covered include API Gateway for hosting APIs, Lambda for backend logic, DynamoDB for database needs, S3 for static content, and Amplify for frontend hosting and continuous deployment.
This document provides tips for fundraising from startup founders Roland Yau and Sze Lok Chan. It discusses generating competition to create urgency for investors, fundraising in parallel rather than sequentially, having a clear fundraising narrative focused on what you do and why it's compelling, and prioritizing relationships with people over firms. It also notes how the pandemic has changed fundraising, with examples of deals done virtually during this time. The tips emphasize being fully prepared before fundraising and cultivating connections with investors in advance.
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...Amazon Web Services
This document discusses Amazon's machine learning services for building conversational interfaces and extracting insights from unstructured text and audio. It describes Amazon Lex for creating chatbots, Amazon Comprehend for natural language processing tasks like entity extraction and sentiment analysis, and how they can be used together for applications like intelligent call centers and content analysis. Pre-trained APIs simplify adding machine learning to apps without requiring ML expertise.
Amazon Elastic Container Service (Amazon ECS) è un servizio di gestione dei container altamente scalabile, che semplifica la gestione dei contenitori Docker attraverso un layer di orchestrazione per il controllo del deployment e del relativo lifecycle. In questa sessione presenteremo le principali caratteristiche del servizio, le architetture di riferimento per i differenti carichi di lavoro e i semplici passi necessari per poter velocemente migrare uno o più dei tuo container.
2. What to Expect from the Session
Look at industry trends
impacting monitoring
Learn about Amazon
CloudWatch and Amazon
CloudWatch Logs
Understand several key
monitoring use cases
See Amazon CloudWatch
and AWS Lambda in action
3. Centralize
Centralize logs from
Elastic Load Balancing
(ELB) using S3 bucket
triggers
Customize
Customize alarms from
Amazon CloudWatch to fit
your specific needs
Analyze
Build an on-demand,
scalable Amazon
Elasticsearch Service
cluster to solve a specific
problem or to do analysis
What to expect: Scenario preview
5. Day in the life!
The story you are about to hear is true (mostly)…Only the
names have been changed to protect the innocent…
6. A customer writes a high severity ticket – your Application,
ImportantApp, is down.
John, the on-call developer, is paged through the ticketing
system.
None of your alarms fired.
Blissful ignorance
7. John engages and starts to scan service dashboards.
He does see intermittent availability impact, but doesn’t
know how to assess impact to customers or where to begin
troubleshooting.
He decides to escalate to a manager on call.
Confusion
8. More customer tickets are pouring in.
An escalation manager, Jane, joins the event and starts to
assess the situation and impact.
John and Jane’s CTO happens to notice the problem.
Sends Jane an IM – “Jane, what’s going on with
ImportantApp?”
Stress
9. Jane and John recall a recent issue where certain
customers started to issue “expensive” operations.
John starts log diving on their production hosts.
John identifies a suspect customer. Jane cuts a ticket and
John prepares a configuration change to block the
customer.
False hope
10. The other team engages and indicates they didn’t change
anything.
Jane and John also confirm this when the availability
impact persists after deploying the configuration change.
Out of ideas, John suggests to fail over to the standby – “It
can’t hurt…”
Desperation
11. After the failover, ImportantApp recovers. (Yay!)
Our root cause deep dive finds that a new JDBC version
introduced a memory leak leading to Java heap
exhaustion.
We fix the leak, add new alarms on memory usage, and
tune our service alarms.
Enlightenment
13. Day in the life - Reflection
• We have missing alarms, and some of the alarms we
have are not actionable.
• We don’t always have the right logs and interacting with
them can be tedious.
• Our dashboards do not tell us enough about customer
impact or behavior changes.
Monitoring is really (really) hard!
15. Trend: Complexity increasing
• Distributed microservices based applications
• Applications are written in different languages and
frameworks
• Workloads are increasingly running on transient
resources such as containers and serverless compute
• Specialization in persistence tier
16. • Small changes are continuously built, tested, and
deployed
• As the scale and design of applications are changing
rapidly, so are the infrastructure needs
• Applications are global and customer behavior is
unpredictable
• Increased role of automation
Trend: Applications are more dynamic
17. • Increased role of applications in business outcomes
(revenue, cost, SLA)
• Rapidly evolving applications are required to gain
competitive advantage
• Increased expectations from customers
Trend: More business impact
18. • Monitoring is no
longer standalone.
It is one aspect of
management and
increasingly
integrated into the
lifecycle of the
application
Trend: Integrated management
20. Use AWS generated metrics,
logs, and events over time to
understand the behavior of
your system
Publish custom metrics,
logs, and events for your
application specific
telemetry
See React Diagnose Resolve
22. Inspect, navigate, zoom, and
correlate across time to
investigate issues
Jump to your logs directly
from your metrics to perform
searches or generate
additional metrics from log
data
See React Diagnose Resolve
23. Easily and automatically
correct issues using common
actions that you control
Define your own custom
actions based on Lambda
functions for more fine-grained
control
See React Diagnose Resolve
24. • Metrics price drop
• More metrics, logs, events from
AWS services: AWS CloudTrail,
AWS Elastic Beanstalk, Amazon
SES
• Simple navigation from metrics to
your logs
• Upgraded metric retention from 2
weeks to up to 15 months
Recent improvements
25. • Support for arbitrary metric percentiles
• collectd output plugin to simplify metric
collection
• Improvements in dashboards (new widgets,
dark theme, Y axis limits)
• Improved Logs console experience
• 1 Second Metrics Resolution
• How to treat missing data
Recent improvements (continued)
26. Not just about what’s inside CloudWatch
• Monitoring is hard (very hard)
• Every enterprise, team and situation has unique needs
• We have a rich partner community
• We give you the tools and flexibility to integrate with
other AWS services
28. Serverless compute: AWS Lambda
COMPUTE
SERVICE
EVENT
DRIVEN
Run arbitrary
code without
managing
servers
Code only runs
when it needs to
run
29. Centralize
Centralize logs from
Elastic Load Balancing
(ELB) using Amazon S3
bucket triggers
Customize
Customize alarms from
Amazon CloudWatch to fit
your specific needs
Analyze
Build an on-demand,
scalable Amazon
Elasticsearch Service
cluster to solve a specific
problem or to do analysis
30. Problem statements
• Log data is scattered on instances and Amazon S3
buckets
• It would be better if it were centralized in CloudWatch Logs
for searching and filtering
• Today CloudWatch provides an agent for instance logs;
what about Amazon S3 delivered logs?
31. Flow of events
LambdaS3ELB CloudWatch
Logs
ELB logs
archived in
Amazon S3
S3 Object Create
Event Notification
to AWS Lambda
AWS Lambda
reads the ELB log
from Amazon S3
and publishes to
CloudWatch Logs
32. Apache Servers
ELB & Lambda
Configured
Lambda Triggered
ELB logs in
CloudWatch
Provision three Amazon EC2 instances running Apache
33. Apache Servers
ELB & Lambda
Configured
Lambda Triggered
ELB logs in
CloudWatch
Create a load balancer
34. Apache Servers
ELB & Lambda
Configured
Lambda Triggered
ELB logs in
CloudWatch
Create a target group with the three Apache servers
35. Apache Servers
ELB & Lambda
Configured
Lambda Triggered
ELB logs in
CloudWatch
Enable ELB log delivery to Amazon S3
36. Apache Servers
ELB & Lambda
Configured
Lambda Triggered
ELB logs in
CloudWatch
Configure the Lambda function to trigger on S3 object create
37. Apache Servers
ELB & Lambda
Configured
Lambda Triggered
ELB logs in
CloudWatch
Read the ELB logs from the S3 bucket by invoking S3 GetObject API
38. Apache Servers
ELB & Lambda
Configured
Lambda Triggered
ELB logs in
CloudWatch
Post the logs into CloudWatch Logs by invoking putLogEvents SDK API
46. Key takeaways
1. Amazon S3 delivered log data from any source can be
centralized into CloudWatch Logs using Lambda
2. You can search and extract metrics from those logs in
near real time
47. Centralize
Centralize logs from
Elastic Load Balancing
(ELB) using S3 bucket
triggers
Customize
Customize alarms from
Amazon CloudWatch to fit
your specific needs
Analyze
Build an on-demand,
scalable Amazon
Elasticsearch Service
cluster to solve a specific
problem or to do analysis
48. Problem Statements
• When you get an alarm, you want enough information
to decide whether it needs immediate attention or not
• You want to customize the alarm text and format to your
operational needs
49. Flow of Events
Error in Logs
generates an alarm to
an SNS topic
Amazon SNS
topic triggers an
Event Notification
to Lambda
AWS Lambda gets
the filtered logs,
calls SES to email
with those logs
Amazon SESAWS LambdaCloudWatch
Logs
CloudWatch
Alarms
50. Metric Filter
Defined
Alarm & Lambda
Configured
Lambda Triggered SES sends Email
Provision an EC2 instance with Tomcat running on it
Hello World
51. CloudWatch agent sends EC2 instance logs to CloudWatch Logs
Metric Filter
Defined
Alarm & Lambda
Configured
Lambda Triggered SES sends Email
52. Define a filter pattern to extract unauthorized access attempts
Metric Filter
Defined
Alarm & Lambda
Configured
Lambda Triggered SES sends Email
53. Define a metric filter on the log group
Metric Filter
Defined
Alarm & Lambda
Configured
Lambda Triggered SES sends Email
54. Define an alarm with a specific threshold for that metric
Metric Filter
Defined
Alarm & Lambda
Configured
Lambda Triggered SES sends Email
test
55. Configure the Lambda function to trigger on SNS topic message
Metric Filter
Defined
Alarm & Lambda
Configured
Lambda Triggered SES sends Email
Hello World
56. Metric Filter
Defined
Alarm & Lambda
Configured
Lambda Triggered SES sends Email
Get the metric filter information by invoking the describeMetricFilters SDK API
57. Metric Filter
Defined
Alarm & Lambda
Configured
Lambda Triggered SES sends Email
Get the relevant log data by invoking the filterLogEvents SDK API
58. Metric Filter
Defined
Alarm & Lambda
Configured
Lambda Triggered SES sends Email
SES sends an email with the relevant log data
59. Unauthorized access attempts on the Tomcat server
Metric Filter
Defined
Alarm & Lambda
Configured
Lambda Triggered SES sends Email
60. Alarm generated due to unauthorized access attempts
Metric Filter
Defined
Alarm & Lambda
Configured
Lambda Triggered SES sends Email
test
test
test
test
61. View email with the relevant log data about the alarm
Metric Filter
Defined
Alarm & Lambda
Configured
Lambda Triggered SES sends Email
test
test
Hell
o
test
62. Key takeaways
• Alarms can be customized to add specific details about
the issue
• When you see a spike on a metric, you can also get the
logs describing the issue triggering the alarm
• The Lambda function can be extended to add your
specific information to the alarm
63. Centralize
Centralize logs from
Elastic Load Balancing
(ELB) using S3 bucket
triggers
Customize
Customize alarms from
Amazon CloudWatch to fit
your specific needs
Analyze
Build an on-demand,
scalable
Amazon Elasticsearch
Service cluster to solve a
specific problem or to do
analysis
64. Problem Statements
• You want to do log analysis using Amazon Elasticsearch
Service but don’t want to leave the cluster running all the
time
• You want to send data to Amazon Elasticsearch Service,
but don’t want to manage ongoing operations
• Build an on-demand Elasticsearch cluster from historical
data
65. Flow of events
LambdaS3
CloudWatch
Logs
CloudWatch Logs in
a specific timeframe
exported to S3
S3 Object Create
Event Notification
to Lambda
AWS Lambda
transforms and sends
only filtered logs to
Amazon Elasticsearch
Service
Amazon
ES
77. Key takeaways
• Send historical data within a timeframe to Amazon
Elasticsearch Service on demand
• This reduces cost, burden of scalability, and operations
time
• Troubleshooting gets easier because you have only
limited and relevant data
78. Recap
• Monitoring is more important than ever, but still too hard
• Amazon CloudWatch is working to make monitoring
easier
• Amazon CloudWatch Logs and AWS Lambda are
powerful tools for tailoring your monitoring for your
business needs
79. Useful Links
• CloudWatch Overview - https://aws.amazon.com/cloudwatch/
• Documentation - https://aws.amazon.com/documentation/cloudwatch/
• CloudWatch Blog - https://aws.amazon.com/blogs/aws/category/amazon-
cloud-watch/
• Lambda functions used in the demo scenarios
Centralize - https://github.com/awslabs/cloudwatch-logs-centralize-logs
Customize - https://github.com/awslabs/cloudwatch-logs-customize-alarms
Analyze - https://github.com/awslabs/cloudwatch-logs-analyze-data