The document discusses old practices of managing servers individually and how they no longer apply in cloud environments. It advocates letting go of habits like naming servers and worrying about their individual status. Instead, it recommends taking advantage of cloud services like Auto Scaling that allow infrastructure to be treated as code and provide self-healing capabilities. Specific practices highlighted include using tags instead of hostnames, treating all resources as auto-scaling groups, and quickly replacing unhealthy instances through mechanisms like STONITH.
Cloud computing gives you a number of advantages, such as being able to scale your application on demand. As a new business looking to use the cloud, you inevitably ask yourself, "Where do I start?" Join us in this session to understand best practices for scaling your resources from zero to millions of users. We will show you how to best combine different AWS services, make smarter decisions for architecting your application, and best practices for scaling your infrastructure in the cloud.
(ARC402) Deployment Automation: From Developers' Keyboards to End Users' Scre...Amazon Web Services
Some of the best businesses today are deploying their code dozens of times a day. How? By making heavy use of automation, smart tools, and repeatable patterns to get process out of the way and keep the workflow moving. Come to this session to learn how you can do this too, using services such as AWS OpsWorks, AWS CloudFormation, Amazon Simple Workflow Service, and other tools. We'll discuss a number of different deployment patterns, and what aspects you need to focus on when working toward deployment automation yourself.
Continuous Deployment Practices, with Production, Test and Development Enviro...Amazon Web Services
With AWS companies now have the ability to develop and run their applications with speed and flexibility like never before. Working with an infrastructure that can be 100% API driven enables businesses to use lean methodologies and realize these benefits. This in turn leads to greater success for those who make use of these practices. In this session we'll talk about some key concepts and design patterns for Continuous Deployment and Continuous Integration, two elements of lean development of applications and infrastructures.
Scale Your Application while Improving Performance and Lowering Costs (SVC203...Amazon Web Services
Scaling your application as you grow should not mean slow to load and expensive to run. Learn how you can use different AWS building blocks such as Amazon ElastiCache and Amazon CloudFront to “cache everything possible” and increase the performance of your application by caching your frequently-accessed content. This means caching at different layers of the stack: from HTML pages to long-running database queries and search results, from static media content to application objects. And how can caching more actually cost less? Attend this session to find out!
Cloud computing gives you a number of advantages, such as being able to scale your application on demand. As a new business looking to use the cloud, you inevitably ask yourself, "Where do I start?" Join us in this session to understand best practices for scaling your resources from zero to millions of users. We will show you how to best combine different AWS services, make smarter decisions for architecting your application, and best practices for scaling your infrastructure in the cloud.
(ARC402) Deployment Automation: From Developers' Keyboards to End Users' Scre...Amazon Web Services
Some of the best businesses today are deploying their code dozens of times a day. How? By making heavy use of automation, smart tools, and repeatable patterns to get process out of the way and keep the workflow moving. Come to this session to learn how you can do this too, using services such as AWS OpsWorks, AWS CloudFormation, Amazon Simple Workflow Service, and other tools. We'll discuss a number of different deployment patterns, and what aspects you need to focus on when working toward deployment automation yourself.
Continuous Deployment Practices, with Production, Test and Development Enviro...Amazon Web Services
With AWS companies now have the ability to develop and run their applications with speed and flexibility like never before. Working with an infrastructure that can be 100% API driven enables businesses to use lean methodologies and realize these benefits. This in turn leads to greater success for those who make use of these practices. In this session we'll talk about some key concepts and design patterns for Continuous Deployment and Continuous Integration, two elements of lean development of applications and infrastructures.
Scale Your Application while Improving Performance and Lowering Costs (SVC203...Amazon Web Services
Scaling your application as you grow should not mean slow to load and expensive to run. Learn how you can use different AWS building blocks such as Amazon ElastiCache and Amazon CloudFront to “cache everything possible” and increase the performance of your application by caching your frequently-accessed content. This means caching at different layers of the stack: from HTML pages to long-running database queries and search results, from static media content to application objects. And how can caching more actually cost less? Attend this session to find out!
Join this workshop to understand the core concepts of “Cloud Computing” and how businesses around the world are running the infrastructure that supports their websites to lower costs, improve time-to-market, and enable rapid scalability matching resource to demands of users. Whether you are an enterprise looking for IT innovation, agility and resiliency or small and medium business who wants to accelerate growth without a big upfront investment in cash or time for technology, the AWS Cloud provides a complete set of services at zero upfront costs which are available with a few clicks and within minutes.
AWS CloudFormation under the Hood (DMG303) | AWS re:Invent 2013Amazon Web Services
You already know that AWS CloudFormation is a powerful tool for provisioning and managing your AWS infrastructure, but did you know that it can also provision and manage resources outside of AWS? Did you know that CloudFormation can fully bootstrap your EC2 instances, securely download data from S3, and even supports Mustache templates? In this session you will go on a deep dive, touring of some of CloudFormation's most advanced features with a member of the team that built the service. Explore custom resources, cfn-init, S3 authentication, and Mustache templates in a series of technical demos with code samples available for download afterwards.
Container Management on AWS with ECS, Docker and Blox - Level 400Amazon Web Services
Managing and scaling hundreds of containers is a challenging task. A container management solution takes care of these challenges for you, allowing you to focus on developing your application. We will discuss how to run well-architected container based applications at scale on ECS. We will dive deep into scaling, custom scheduling and secrets management. We will also briefly cover extending ECS using Blox and some alternative container solutions that are supported by AWS.
Speakers:
Richard Busby, Principal Solutions Architect
Shiva Narayanaswamy, Development Team Lead, Envato
PaaS (Platform as a Service) is hot topic in the PHP world, with many different providers vying to run your code. I'll look at what it takes to get your code to run on the common PaaS services, and compare and contrast them on their offerings and performance
Scaling up to your first 10 million users - Pop-up Loft Tel AvivAmazon Web Services
Cloud computing gives you a number of advantages, such as the ability to scale your web application or website on demand. If you have a new web application and want to use cloud computing, you might be asking yourself, "Where do I start?" Join us in this session to understand best practices for scaling your resources from zero to millions of users. We show you how to best combine different AWS services, how to make smarter decisions for architecting your application, and how to scale your infrastructure in the cloud.
Monitoring Containers at Scale - September Webinar SeriesAmazon Web Services
Containers come and go rapidly, which is great for scalable or fast-evolving infrastructure. However, the short life of containers make it more challenging to monitor, leaving many with questions such as: How many containers can you run on a given Amazon EC2 instance type? Which metric should you look at to measure contention? How do you manage fleets of containers at scale? In this session, we'll present the challenges and benefits of running containers at scale, how to use quantitative performance patterns to monitor your infrastructure at this magnitude and complexity, and we'll discuss proven strategies for monitoring your containerized infrastructure on AWS and ECS.
Learning Objectives:
- Set up the infrastructure to monitor your containers running on AWS
- Understand the metrics available and what they mean
- Define a strategy to monitor your containers
Improving Infrastructure Governance on AWS - AWS June 2016 Webinar SeriesAmazon Web Services
As your teams and infrastructure grow, it becomes more difficult to track IT resource changes as well as identify who made changes and when. It also becomes harder to enforce standards for your infrastructure resources, resulting in configuration drift and potential security issues. On AWS, you can easily standardize infrastructure configurations for commonly used IT services while also enabling self-service provisioning for your company. Once these resources are provisioned, you can then track how these resources are connected and monitor configuration changes and drift. In this session, we will discuss how you can achieve a sophisticated level of standardization, configuration compliance, and monitoring using a combination of AWS Service Catalog, AWS Config, and AWS CloudTrail.
Learning Objectives:
Understand how to use AWS services to enable governance while providing self-service
Learn to codify your business policies to promote compliance
How to improve security without sacrificing developer productivity
Running Microservices and Docker on AWS Elastic Beanstalk - August 2016 Month...Amazon Web Services
In this session, we introduce you to a solution for easily running a Docker-powered microservices architecture on AWS using Elastic Beanstalk. We will also cover the fundamentals of Elastic Beanstalk and how it benefits developers looking for a quick and scalable way to get their applications running on AWS with no infrastructure work required.
Building a microservices architecture using Docker can require a lot of work, from launching and operating the underlying infrastructure to installing and maintaining cluster management software. With AWS Elastic Beanstalk’s multicontainer support feature, many of these tasks are simplified and abstracted away so you can focus on your application code. AWS Elastic Beanstalk is an easy-to-use service for deploying and scaling web applications and services developed with Java, .NET, PHP, Node.js, Python, Ruby, Go, and Docker."
Learning Objectives:
• Learn the basics of AWS Elastic Beanstalk
• Understand how to use Elastic Beanstalk to run containerized applications
• Learn how to use Elastic Beanstalk to start architecting microservices-based applications
(DVO312) Sony: Building At-Scale Services with AWS Elastic BeanstalkAmazon Web Services
Learn about Sony's efforts to build a cloud-native authentication and profile management platform on AWS. Sony engineers demonstrate how they used AWS Elastic Beanstalk (Elastic Beanstalk) to deploy, manage, and scale their applications. They also describe how they use AWS CloudFormation for resource provisioning, Amazon DynamoDB for the main database, and AWS Lambda and Amazon Redshift for log handling and analysis. This discussion focuses on best practices, security considerations, tradeoffs, and final architecture and implementation. By the end of the session, you will clearly understand how to use Elastic Beanstalk as a platform to quickly and easily build at-scale web application on AWS, and how to use Elastic Beanstalk with other AWS services to build cloud-native applications.
For more training on AWS, visit: https://www.qa.com/amazon
AWS Loft | London - Amazon EC2:Masterclass by Ian Massingham, Chief Evangelist EMEA, April 18, 2016
AWS January 2016 Webinar Series - Introduction to Deploying Applications on AWSAmazon Web Services
Based on your specific needs and the nature of your application, AWS offers a variety of services for getting your application up and running. You may want to launch and scale a web application or you may want to host a microservices application using Docker containers. How do you decide which service to use and when?
In this webinar, we will provide an overview of the AWS services that help simplify launching and running your application in the cloud. We will discuss the strengths of each service and provide a framework for understanding when to use them.
Learning Objectives:
Understand the primary services for deploying your application on AWS
Learn the basics of AWS Elastic Beanstalk, AWS CodeDeploy, and Amazon EC2 Container Service
Gain an understanding of the strengths of each service and when to use them
Who Should Attend:
Developers, DevOps Engineers, IT Professionals
(WEB301) Operational Web Log Analysis | AWS re:Invent 2014Amazon Web Services
Log data contains some of the most valuable raw information you can gather and analyze about your infrastructure and applications. Amid the mess of confusing lines of seemingly random text can be hints about performance, security, flaws in code, user access patterns, and other operational data. Without the proper tools, finding insights in these logs can be like searching for a hay-colored needle in a haystack. In this session you learn what practices and patterns you can easily implement that can help you better understand your log files. You see how you can customize web logs to add more information to them, how to digest logs from around your infrastructure, and how to analyze your log files in near real time.
(SOV204) Scaling Up to Your First 10 Million Users | AWS re:Invent 2014Amazon Web Services
Cloud computing gives you a number of advantages, such as the ability to scale your application on demand. If you have a new business and want to use cloud computing, you might be asking yourself, andquot;Where do I start?andquot; Join us in this session to understand best practices for scaling your resources from zero to millions of users. We show you how to best combine different AWS services, how to make smarter decisions for architecting your application, and how to scale your infrastructure in the cloud.
Getting Started With Continuous Delivery on AWS - AWS April 2016 Webinar SeriesAmazon Web Services
Today’s cutting-edge companies have software release cycles measured in days instead of months. This agility is enabled by the DevOps practice of continuous delivery, which automates building, testing, and deploying code changes. This automation helps you catch bugs sooner and increases developer productivity.
In this webinar, we’ll share the processes that Amazon engineers use to practice DevOps and discuss how you can bring these processes to your company by using a new set of AWS tools (AWS CodePipeline and AWS CodeDeploy). These services were inspired by Amazon's own internal developer tools and DevOps culture.
Learning Objectives:
• Learn what is continuous delivery, its benefits, and how to implement it
• Learn how to increase the frequency and reliability of your application updates
• Learn to create an automated software release workflow on AWS
• Understand the basics of AWS CodePipeline and AWS CodeDeploy
Join this workshop to understand the core concepts of “Cloud Computing” and how businesses around the world are running the infrastructure that supports their websites to lower costs, improve time-to-market, and enable rapid scalability matching resource to demands of users. Whether you are an enterprise looking for IT innovation, agility and resiliency or small and medium business who wants to accelerate growth without a big upfront investment in cash or time for technology, the AWS Cloud provides a complete set of services at zero upfront costs which are available with a few clicks and within minutes.
AWS CloudFormation under the Hood (DMG303) | AWS re:Invent 2013Amazon Web Services
You already know that AWS CloudFormation is a powerful tool for provisioning and managing your AWS infrastructure, but did you know that it can also provision and manage resources outside of AWS? Did you know that CloudFormation can fully bootstrap your EC2 instances, securely download data from S3, and even supports Mustache templates? In this session you will go on a deep dive, touring of some of CloudFormation's most advanced features with a member of the team that built the service. Explore custom resources, cfn-init, S3 authentication, and Mustache templates in a series of technical demos with code samples available for download afterwards.
Container Management on AWS with ECS, Docker and Blox - Level 400Amazon Web Services
Managing and scaling hundreds of containers is a challenging task. A container management solution takes care of these challenges for you, allowing you to focus on developing your application. We will discuss how to run well-architected container based applications at scale on ECS. We will dive deep into scaling, custom scheduling and secrets management. We will also briefly cover extending ECS using Blox and some alternative container solutions that are supported by AWS.
Speakers:
Richard Busby, Principal Solutions Architect
Shiva Narayanaswamy, Development Team Lead, Envato
PaaS (Platform as a Service) is hot topic in the PHP world, with many different providers vying to run your code. I'll look at what it takes to get your code to run on the common PaaS services, and compare and contrast them on their offerings and performance
Scaling up to your first 10 million users - Pop-up Loft Tel AvivAmazon Web Services
Cloud computing gives you a number of advantages, such as the ability to scale your web application or website on demand. If you have a new web application and want to use cloud computing, you might be asking yourself, "Where do I start?" Join us in this session to understand best practices for scaling your resources from zero to millions of users. We show you how to best combine different AWS services, how to make smarter decisions for architecting your application, and how to scale your infrastructure in the cloud.
Monitoring Containers at Scale - September Webinar SeriesAmazon Web Services
Containers come and go rapidly, which is great for scalable or fast-evolving infrastructure. However, the short life of containers make it more challenging to monitor, leaving many with questions such as: How many containers can you run on a given Amazon EC2 instance type? Which metric should you look at to measure contention? How do you manage fleets of containers at scale? In this session, we'll present the challenges and benefits of running containers at scale, how to use quantitative performance patterns to monitor your infrastructure at this magnitude and complexity, and we'll discuss proven strategies for monitoring your containerized infrastructure on AWS and ECS.
Learning Objectives:
- Set up the infrastructure to monitor your containers running on AWS
- Understand the metrics available and what they mean
- Define a strategy to monitor your containers
Improving Infrastructure Governance on AWS - AWS June 2016 Webinar SeriesAmazon Web Services
As your teams and infrastructure grow, it becomes more difficult to track IT resource changes as well as identify who made changes and when. It also becomes harder to enforce standards for your infrastructure resources, resulting in configuration drift and potential security issues. On AWS, you can easily standardize infrastructure configurations for commonly used IT services while also enabling self-service provisioning for your company. Once these resources are provisioned, you can then track how these resources are connected and monitor configuration changes and drift. In this session, we will discuss how you can achieve a sophisticated level of standardization, configuration compliance, and monitoring using a combination of AWS Service Catalog, AWS Config, and AWS CloudTrail.
Learning Objectives:
Understand how to use AWS services to enable governance while providing self-service
Learn to codify your business policies to promote compliance
How to improve security without sacrificing developer productivity
Running Microservices and Docker on AWS Elastic Beanstalk - August 2016 Month...Amazon Web Services
In this session, we introduce you to a solution for easily running a Docker-powered microservices architecture on AWS using Elastic Beanstalk. We will also cover the fundamentals of Elastic Beanstalk and how it benefits developers looking for a quick and scalable way to get their applications running on AWS with no infrastructure work required.
Building a microservices architecture using Docker can require a lot of work, from launching and operating the underlying infrastructure to installing and maintaining cluster management software. With AWS Elastic Beanstalk’s multicontainer support feature, many of these tasks are simplified and abstracted away so you can focus on your application code. AWS Elastic Beanstalk is an easy-to-use service for deploying and scaling web applications and services developed with Java, .NET, PHP, Node.js, Python, Ruby, Go, and Docker."
Learning Objectives:
• Learn the basics of AWS Elastic Beanstalk
• Understand how to use Elastic Beanstalk to run containerized applications
• Learn how to use Elastic Beanstalk to start architecting microservices-based applications
(DVO312) Sony: Building At-Scale Services with AWS Elastic BeanstalkAmazon Web Services
Learn about Sony's efforts to build a cloud-native authentication and profile management platform on AWS. Sony engineers demonstrate how they used AWS Elastic Beanstalk (Elastic Beanstalk) to deploy, manage, and scale their applications. They also describe how they use AWS CloudFormation for resource provisioning, Amazon DynamoDB for the main database, and AWS Lambda and Amazon Redshift for log handling and analysis. This discussion focuses on best practices, security considerations, tradeoffs, and final architecture and implementation. By the end of the session, you will clearly understand how to use Elastic Beanstalk as a platform to quickly and easily build at-scale web application on AWS, and how to use Elastic Beanstalk with other AWS services to build cloud-native applications.
For more training on AWS, visit: https://www.qa.com/amazon
AWS Loft | London - Amazon EC2:Masterclass by Ian Massingham, Chief Evangelist EMEA, April 18, 2016
AWS January 2016 Webinar Series - Introduction to Deploying Applications on AWSAmazon Web Services
Based on your specific needs and the nature of your application, AWS offers a variety of services for getting your application up and running. You may want to launch and scale a web application or you may want to host a microservices application using Docker containers. How do you decide which service to use and when?
In this webinar, we will provide an overview of the AWS services that help simplify launching and running your application in the cloud. We will discuss the strengths of each service and provide a framework for understanding when to use them.
Learning Objectives:
Understand the primary services for deploying your application on AWS
Learn the basics of AWS Elastic Beanstalk, AWS CodeDeploy, and Amazon EC2 Container Service
Gain an understanding of the strengths of each service and when to use them
Who Should Attend:
Developers, DevOps Engineers, IT Professionals
(WEB301) Operational Web Log Analysis | AWS re:Invent 2014Amazon Web Services
Log data contains some of the most valuable raw information you can gather and analyze about your infrastructure and applications. Amid the mess of confusing lines of seemingly random text can be hints about performance, security, flaws in code, user access patterns, and other operational data. Without the proper tools, finding insights in these logs can be like searching for a hay-colored needle in a haystack. In this session you learn what practices and patterns you can easily implement that can help you better understand your log files. You see how you can customize web logs to add more information to them, how to digest logs from around your infrastructure, and how to analyze your log files in near real time.
(SOV204) Scaling Up to Your First 10 Million Users | AWS re:Invent 2014Amazon Web Services
Cloud computing gives you a number of advantages, such as the ability to scale your application on demand. If you have a new business and want to use cloud computing, you might be asking yourself, andquot;Where do I start?andquot; Join us in this session to understand best practices for scaling your resources from zero to millions of users. We show you how to best combine different AWS services, how to make smarter decisions for architecting your application, and how to scale your infrastructure in the cloud.
Getting Started With Continuous Delivery on AWS - AWS April 2016 Webinar SeriesAmazon Web Services
Today’s cutting-edge companies have software release cycles measured in days instead of months. This agility is enabled by the DevOps practice of continuous delivery, which automates building, testing, and deploying code changes. This automation helps you catch bugs sooner and increases developer productivity.
In this webinar, we’ll share the processes that Amazon engineers use to practice DevOps and discuss how you can bring these processes to your company by using a new set of AWS tools (AWS CodePipeline and AWS CodeDeploy). These services were inspired by Amazon's own internal developer tools and DevOps culture.
Learning Objectives:
• Learn what is continuous delivery, its benefits, and how to implement it
• Learn how to increase the frequency and reliability of your application updates
• Learn to create an automated software release workflow on AWS
• Understand the basics of AWS CodePipeline and AWS CodeDeploy
AWS Webcast - Build high-scale applications with Amazon DynamoDBAmazon Web Services
Review this webinar to learn about Amazon DynamoDB. DynamoDB is a highly scalable, fully managed NoSQL database service. Built for consistent single-digit millisecond latency and high availability, DynamoDB is a great fit for gaming, ad-tech, mobile, and many other applications.
Reasons to review:
• Learn the fundamentals of DynamoDB
• Understand how to design for common access patterns
• Discover best practices
• Hear how others uses DynamoDB to build their business
Who should review:
• Software Developers
• Database Administrators
• Solution Architects
• Technical Decision Makers
I Love APIs 2015
Chris Munns, Amazon
@chrismunns
http://www.amazon.com/
As computing costs decreased and computing power grew over time, so increased the complexity of the problems computers were called to solve and complexity of software. Enterprise applications quickly went through the stage of monolithic applications to client-server to multiple tier and beyond – to the land of massively distributed architectures. We arrived at the point where enterprise software is well beyond the capability of a single person or even a reasonably practical group of people to understand and control. Are microsevices the answer? Join Chris Munns to learn about how microservices are scaled at Amazon.
So, you’ve got your solution deployed and have so many things to manage…now what? Come to this session to learn how you can scale operations with solutions deployed in the AWS cloud. We take a look at services like AWS CloudFormation and tools like Chef and Puppet. See an overview of these services and tools, and we show you how they might be used in real-life scenarios and how you might incorporate these services and tools into your own environment.
DevOps on AWS: Deep Dive on Continuous Delivery and the AWS Developer ToolsAmazon Web Services
Today’s cutting-edge companies have software release cycles measured in days instead of months. This agility is enabled by the DevOps practice of continuous delivery, which automates building, testing, and deploying all code changes. This automation helps you catch bugs sooner and accelerates developer productivity. In this session, we’ll share the processes that Amazon’s engineers use to practice DevOps and discuss how you can bring these processes to your company by using a new set of AWS tools (AWS CodePipeline and AWS CodeDeploy). These services were inspired by Amazon's own internal developer tools and DevOps culture.
Chris Munns, DevOps @ Amazon: Microservices, 2 Pizza Teams, & 50 Million Depl...TriNimbus
Keynote presentation from Vancouver's 2016 Canadian Executive DevOps & Cloud Summit on Thursday, May 5th.
Speaker: Chris Munns, Business Development Manager, DevOps at Amazon Web Services
Title: DevOps @ Amazon: Microservices, 2 Pizza Teams, & 50 Million Deploys a Year
At Amazon Web Services, we think about Infrastructure as Code being able to impact not just your low level infrastructure or operating systems but everything from the virtual cement floor of your Amazon Virtual Private Cloud up through the applications your customers interface with.
Come take a tour of the space as we see it. Learn what layers there are to managing your infrastructure as code and what services and tools AWS and its Partners exist across these.
AWS Solutions Architect Chris Munns presented at the LAUNCH Festival. Thousands of startups attended the LAUNCH Festival in San Francisco, CA to launch their company and learn about building great startups.
AWS January 2016 Webinar Series - Managing your Infrastructure as CodeAmazon Web Services
In this session, you will learn how you can provision, configure, and manage your infrastructure using code and treat it just like your application code. We will discuss the AWS services that enable these practices (AWS CloudFormation, AWS OpsWorks, and AWS CodeDeploy) and that allow you to control everything from Amazon VPCs and AWS Identity and Access Management to the configuration of individual applications on a single host. We’ll also talk about on-going management, how to best update your resources, and which tools are best suited for AWS resource management and host-based configuration management.
Learning Objectives:
Understand Infrastructure as Code
Understand the AWS services that help you manage your infrastructure as code
Discover best practices for managing your AWS infrastructure, host configuration, and applications
Who Should Attend:
DevOps Engineers, IT Professionals, Systems Administrators, Architects, Operations Professionals, Developers
Scaling on AWS for the First 10 Million Users (ARC206) | AWS re:Invent 2013Amazon Web Services
Cloud computing gives you a number of advantages in being able to scale on demand, easily replace whole parts of your infrastructure, and much more. As a new business looking to use the cloud, you inevitably ask yourself, Where do I start? Join us at this session to understand some of the common patterns and recommended areas of focus you can expect to work through while scaling an infrastructure to handle going from zero to millions of users. From leveraging highly scalable AWS services to making smart decisions on building out your application, you'll learn a number of best practices for scaling your infrastructure in the cloud. The patterns and practices reviewed in this session will get you there.
ENT317 Migrating with Morningstar: The Path To Dynamic CloudAmazon Web Services
Keeping an application running at scale in the cloud is fundamentally different than keeping your applications running in your own data centers. Cloud technologies are different, the way you scale is different, the way you troubleshoot is different, and the monitoring you need is different. From static compute to dynamic autoscaling to serverless services and microservices, combined with the demands of creating new digital businesses, cloud services provide new opportunities and challenges. In this session, New Relic’s Lee Atchison and Morningstar, a global investment research company, will discuss the differences in cloud technologies impact on monitoring and architectural strategies when migrating and scaling applications on AWS.
This session is brought to you by AWS Summit Chicago sponsor, New Relic.
Why Scale Matters and How the Cloud is Really Different (at scale)Amazon Web Services
Cloud computing gives you a number of advantages, such as being able to scale your application on demand. As a new business looking to use the cloud, you inevitably ask yourself, "Where do I start?" Join us in this session to understand best practices for scaling your resources from zero to millions of users. We will show you how to best combine different AWS services, make smarter decisions for architecting your application, and best practices for scaling your infrastructure in the cloud.
Presenter:
Santanu Dutt, Solution Architect, Amazon Internet Services
Vinayak Hegde, Vice President – Engineering, Helpshift
Sunny Saxena, Product Lead, Sprinklr
ENT317 Dynamic Infrastructure? Migrating? Adventures in Keeping Your Applicat...Amazon Web Services
"Keeping an application running at scale can be a daunting task. When do you need to add more capacity? Larger databases? Additional servers? These questions get harder as the complexity of your application grows. Cloud-based dynamic infrastructures can help you keep your application running with high availability, even during times of extreme scaling. We will discuss some of the best practices we’ve learned working with New Relic customers on how you can manage your applications running at scale, and how technologies such as dynamic infrastructure can help you with this challenge. Joining us on stage will be Appboy, the global leader in lifecycle engagement technology, to discuss their experiences with dynamic infrastructure and the cloud and how it has impacted their ability to scale.
This session is brought to you by AWS Summit New York City sponsor, New Relic."
AWS Summit 2014 Melbourne - Breakout 5
Cloud computing gives you a number of advantages, such as being able to scale your application on demand. As a new business looking to use the cloud, you inevitably ask yourself, "Where do I start?" Join us in this session to understand best practices for scaling your resources from zero to millions of users. We will show you how to best combine different AWS services, make smarter decisions for architecting your application, and best practices for scaling your infrastructure in the cloud.
Presenter: Craig Dickson, Solutions Architect, Amazon Web Services
Cloud computing gives you a number of advantages, such as the ability to scale your web application or website on demand. If you have a new web application and want to use cloud computing, you might be asking yourself, "Where do I start?" Join us in this session to understand best practices for scaling your resources from zero to millions of users. We show you how to best combine different AWS services, how to make smarter decisions for architecting your application, and how to scale your infrastructure in the cloud.
A presentation given at the 2011 Amazon AWS Genomics meeting held in Seattle, WA.
This is a 30 minute talk I gave focusing mainly on practical tools, tips and methods for bootstrapping and orchestration on the cloud.
Covers examples of:
Ubuntu Cloud Init
AWS Cloud Formation
Opscode Chef
MIT StarCluster
AWS Summit London 2014 | Scaling on AWS for the First 10 Million Users (200)Amazon Web Services
This mid-level technical session will provide an overview of the techniques that you can use to build high-scalabilty applications on AWS. Take a journey from 1 user to 10 million users and understand how your application's architecture can evolve and which AWS services can help as you increase the number of users that you serve.
Sitecore on Azure
What is Azure and how does it affect Developers and IT Administrators?
As discussed by Vicent Galiana at the Sitecore Technical User Group, London, 4th March 2015
AWS Summit Stockholm 2014 – T1 – Architecting highly available applications o...Amazon Web Services
This session teaches you how to architect scalable, highly-available, and secure applications on AWS. In this session, we cover the differences between traditional and cloud-based availability, how to apply AWS availability options to workloads, architectural design patterns for automatingfault tolerance, and examples of highly available architectures.
Cloud computing gives you a number of advantages, such as the ability to scale your web application or website on demand. If you have a new web application and want to use cloud computing, you might be asking yourself, "Where do I start?" Join us in this session to understand best practices for scaling your resources from zero to millions of users. We show you how to best combine different AWS services, how to make smarter decisions for architecting your application, and how to scale your infrastructure in the cloud.
This slide covers all the basics of cloud computing with AWS -popular IAAS provider.Each AWS components are explained with a real time example like how NETFLIX using AWS components.
AWS Summit Auckland 2014 | Scaling on AWS for the First 10 Million UsersAmazon Web Services
You have attended AWS training. Gathered all the relevant information about AWS services but how do you now show the value of the AWS Cloud to your business. This session will run through how you would build a business case for the cloud including TCO and cost comparisons.
This talk wants to sum up the experience of designing, deploying and maintaining an Erlang application targeting the cloud and precisely AWS as hosting infrastructure.
As the application now serves a significantly large user base with a sustained throughput of thousands of games actions per second we're able to analyse retrospectively our engineering and architectural choices and see how Erlang fits in the cloud environment also comparing it to previous experiences of clouds deployments of other platforms.
We'll discuss properties of Erlang as a language and OTP as a framework and how we used them to design a system that is a good cloud citizen. We'll also discuss topics that are still open for a solution.
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Amazon Web Services
Il Forecasting è un processo importante per tantissime aziende e viene utilizzato in vari ambiti per cercare di prevedere in modo accurato la crescita e distribuzione di un prodotto, l’utilizzo delle risorse necessarie nelle linee produttive, presentazioni finanziarie e tanto altro. Amazon utilizza delle tecniche avanzate di forecasting, in parte questi servizi sono stati messi a disposizione di tutti i clienti AWS.
In questa sessione illustreremo come pre-processare i dati che contengono una componente temporale e successivamente utilizzare un algoritmo che a partire dal tipo di dato analizzato produce un forecasting accurato.
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Amazon Web Services
La varietà e la quantità di dati che si crea ogni giorno accelera sempre più velocemente e rappresenta una opportunità irripetibile per innovare e creare nuove startup.
Tuttavia gestire grandi quantità di dati può apparire complesso: creare cluster Big Data su larga scala sembra essere un investimento accessibile solo ad aziende consolidate. Ma l’elasticità del Cloud e, in particolare, i servizi Serverless ci permettono di rompere questi limiti.
Vediamo quindi come è possibile sviluppare applicazioni Big Data rapidamente, senza preoccuparci dell’infrastruttura, ma dedicando tutte le risorse allo sviluppo delle nostre le nostre idee per creare prodotti innovativi.
Ora puoi utilizzare Amazon Elastic Kubernetes Service (EKS) per eseguire pod Kubernetes su AWS Fargate, il motore di elaborazione serverless creato per container su AWS. Questo rende più semplice che mai costruire ed eseguire le tue applicazioni Kubernetes nel cloud AWS.In questa sessione presenteremo le caratteristiche principali del servizio e come distribuire la tua applicazione in pochi passaggi
Vent'anni fa Amazon ha attraversato una trasformazione radicale con l'obiettivo di aumentare il ritmo dell'innovazione. In questo periodo abbiamo imparato come cambiare il nostro approccio allo sviluppo delle applicazioni ci ha permesso di aumentare notevolmente l'agilità, la velocità di rilascio e, in definitiva, ci ha consentito di creare applicazioni più affidabili e scalabili. In questa sessione illustreremo come definiamo le applicazioni moderne e come la creazione di app moderne influisce non solo sull'architettura dell'applicazione, ma sulla struttura organizzativa, sulle pipeline di rilascio dello sviluppo e persino sul modello operativo. Descriveremo anche approcci comuni alla modernizzazione, compreso l'approccio utilizzato dalla stessa Amazon.com.
Come spendere fino al 90% in meno con i container e le istanze spot Amazon Web Services
L’utilizzo dei container è in continua crescita.
Se correttamente disegnate, le applicazioni basate su Container sono molto spesso stateless e flessibili.
I servizi AWS ECS, EKS e Kubernetes su EC2 possono sfruttare le istanze Spot, portando ad un risparmio medio del 70% rispetto alle istanze On Demand. In questa sessione scopriremo insieme quali sono le caratteristiche delle istanze Spot e come possono essere utilizzate facilmente su AWS. Impareremo inoltre come Spreaker sfrutta le istanze spot per eseguire applicazioni di diverso tipo, in produzione, ad una frazione del costo on-demand!
In recent months, many customers have been asking us the question – how to monetise Open APIs, simplify Fintech integrations and accelerate adoption of various Open Banking business models. Therefore, AWS and FinConecta would like to invite you to Open Finance marketplace presentation on October 20th.
Event Agenda :
Open banking so far (short recap)
• PSD2, OB UK, OB Australia, OB LATAM, OB Israel
Intro to Open Finance marketplace
• Scope
• Features
• Tech overview and Demo
The role of the Cloud
The Future of APIs
• Complying with regulation
• Monetizing data / APIs
• Business models
• Time to market
One platform for all: a Strategic approach
Q&A
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Amazon Web Services
Per creare valore e costruire una propria offerta differenziante e riconoscibile, le startup di successo sanno come combinare tecnologie consolidate con componenti innovativi creati ad hoc.
AWS fornisce servizi pronti all'utilizzo e, allo stesso tempo, permette di personalizzare e creare gli elementi differenzianti della propria offerta.
Concentrandoci sulle tecnologie di Machine Learning, vedremo come selezionare i servizi di intelligenza artificiale offerti da AWS e, anche attraverso una demo, come costruire modelli di Machine Learning personalizzati utilizzando SageMaker Studio.
OpsWorks Configuration Management: automatizza la gestione e i deployment del...Amazon Web Services
Con l'approccio tradizionale al mondo IT per molti anni è stato difficile implementare tecniche di DevOps, che finora spesso hanno previsto attività manuali portando di tanto in tanto a dei downtime degli applicativi interrompendo l'operatività dell'utente. Con l'avvento del cloud, le tecniche di DevOps sono ormai a portata di tutti a basso costo per qualsiasi genere di workload, garantendo maggiore affidabilità del sistema e risultando in dei significativi miglioramenti della business continuity.
AWS mette a disposizione AWS OpsWork come strumento di Configuration Management che mira ad automatizzare e semplificare la gestione e i deployment delle istanze EC2 per mezzo di workload Chef e Puppet.
Scopri come sfruttare AWS OpsWork a garanzia e affidabilità del tuo applicativo installato su Instanze EC2.
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsAmazon Web Services
Vuoi conoscere le opzioni per eseguire Microsoft Active Directory su AWS? Quando si spostano carichi di lavoro Microsoft in AWS, è importante considerare come distribuire Microsoft Active Directory per supportare la gestione, l'autenticazione e l'autorizzazione dei criteri di gruppo. In questa sessione, discuteremo le opzioni per la distribuzione di Microsoft Active Directory su AWS, incluso AWS Directory Service per Microsoft Active Directory e la distribuzione di Active Directory su Windows su Amazon Elastic Compute Cloud (Amazon EC2). Trattiamo argomenti quali l'integrazione del tuo ambiente Microsoft Active Directory locale nel cloud e l'utilizzo di applicazioni SaaS, come Office 365, con AWS Single Sign-On.
Dal riconoscimento facciale al riconoscimento di frodi o difetti di fabbricazione, l'analisi di immagini e video che sfruttano tecniche di intelligenza artificiale, si stanno evolvendo e raffinando a ritmi elevati. In questo webinar esploreremo le possibilità messe a disposizione dai servizi AWS per applicare lo stato dell'arte delle tecniche di computer vision a scenari reali.
Amazon Web Services e VMware organizzano un evento virtuale gratuito il prossimo mercoledì 14 Ottobre dalle 12:00 alle 13:00 dedicato a VMware Cloud ™ on AWS, il servizio on demand che consente di eseguire applicazioni in ambienti cloud basati su VMware vSphere® e di accedere ad una vasta gamma di servizi AWS, sfruttando a pieno le potenzialità del cloud AWS e tutelando gli investimenti VMware esistenti.
Molte organizzazioni sfruttano i vantaggi del cloud migrando i propri carichi di lavoro Oracle e assicurandosi notevoli vantaggi in termini di agilità ed efficienza dei costi.
La migrazione di questi carichi di lavoro, può creare complessità durante la modernizzazione e il refactoring delle applicazioni e a questo si possono aggiungere rischi di prestazione che possono essere introdotti quando si spostano le applicazioni dai data center locali.
Crea la tua prima serverless ledger-based app con QLDB e NodeJSAmazon Web Services
Molte aziende oggi, costruiscono applicazioni con funzionalità di tipo ledger ad esempio per verificare lo storico di accrediti o addebiti nelle transazioni bancarie o ancora per tenere traccia del flusso supply chain dei propri prodotti.
Alla base di queste soluzioni ci sono i database ledger che permettono di avere un log delle transazioni trasparente, immutabile e crittograficamente verificabile, ma sono strumenti complessi e onerosi da gestire.
Amazon QLDB elimina la necessità di costruire sistemi personalizzati e complessi fornendo un database ledger serverless completamente gestito.
In questa sessione scopriremo come realizzare un'applicazione serverless completa che utilizzi le funzionalità di QLDB.
Con l’ascesa delle architetture di microservizi e delle ricche applicazioni mobili e Web, le API sono più importanti che mai per offrire agli utenti finali una user experience eccezionale. In questa sessione impareremo come affrontare le moderne sfide di progettazione delle API con GraphQL, un linguaggio di query API open source utilizzato da Facebook, Amazon e altro e come utilizzare AWS AppSync, un servizio GraphQL serverless gestito su AWS. Approfondiremo diversi scenari, comprendendo come AppSync può aiutare a risolvere questi casi d’uso creando API moderne con funzionalità di aggiornamento dati in tempo reale e offline.
Inoltre, impareremo come Sky Italia utilizza AWS AppSync per fornire aggiornamenti sportivi in tempo reale agli utenti del proprio portale web.
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareAmazon Web Services
Molte organizzazioni sfruttano i vantaggi del cloud migrando i propri carichi di lavoro Oracle e assicurandosi notevoli vantaggi in termini di agilità ed efficienza dei costi.
La migrazione di questi carichi di lavoro, può creare complessità durante la modernizzazione e il refactoring delle applicazioni e a questo si possono aggiungere rischi di prestazione che possono essere introdotti quando si spostano le applicazioni dai data center locali.
In queste slide, gli esperti AWS e VMware presentano semplici e pratici accorgimenti per facilitare e semplificare la migrazione dei carichi di lavoro Oracle accelerando la trasformazione verso il cloud, approfondiranno l’architettura e dimostreranno come sfruttare a pieno le potenzialità di VMware Cloud ™ on AWS.
Amazon Elastic Container Service (Amazon ECS) è un servizio di gestione dei container altamente scalabile, che semplifica la gestione dei contenitori Docker attraverso un layer di orchestrazione per il controllo del deployment e del relativo lifecycle. In questa sessione presenteremo le principali caratteristiche del servizio, le architetture di riferimento per i differenti carichi di lavoro e i semplici passi necessari per poter velocemente migrare uno o più dei tuo container.
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
JMeter webinar - integration with InfluxDB and GrafanaRTTS
Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application.
In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics.
Length: 30 minutes
Session Overview
-------------------------------------------
During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana:
- What out-of-the-box solutions are available for real-time monitoring JMeter tests?
- What are the benefits of integrating InfluxDB and Grafana into the load testing stack?
- Which features are provided by Grafana?
- Demonstration of InfluxDB and Grafana using a practice web application
To view the webinar recording, go to:
https://www.rttsweb.com/jmeter-integration-webinar
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
Let's dive deeper into the world of ODC! Ricardo Alves (OutSystems) will join us to tell all about the new Data Fabric. After that, Sezen de Bruijn (OutSystems) will get into the details on how to best design a sturdy architecture within ODC.
Neuro-symbolic is not enough, we need neuro-*semantic*Frank van Harmelen
Neuro-symbolic (NeSy) AI is on the rise. However, simply machine learning on just any symbolic structure is not sufficient to really harvest the gains of NeSy. These will only be gained when the symbolic structures have an actual semantics. I give an operational definition of semantics as “predictable inference”.
All of this illustrated with link prediction over knowledge graphs, but the argument is general.
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
2. Why are we here?
Old-school IT practices continue to weigh us down
in the cloud. We need a way out.
3. “Everything now is a programmable
resource. There are no physical
things anymore. Things that you
needed to do by walking to the
datacenter, by hugging your
servers, and believe me I’ve
hugged servers enough in my life.
They DO NOT hug you back.”
4. “Everything now is a programmable
resource. There are no physical
things anymore. Things that you
needed to do by walking to the
datacenter, by hugging your
servers, and believe me I’ve
hugged servers enough in my life.
They DO NOT hug you back.” Dr. Werner Vogels (Re:Invent 2012)
5. “But I love my servers!”
- You (now)
https://secure.flickr.com/photos/schluesselbein/4157426778/
6. “They hate you, actually, I
honestly believe that they
hate you.
7. “They hate you, actually, I
honestly believe that they
hate you. At least that is
how they behaved
towards me.” –
Dr. Werner Vogels (Re:Invent 2012)
8. “But I love my servers!”
“Well now I’m kind of sad.”
- You (now)
https://secure.flickr.com/photos/bensonkua/2687804310/
16. IF THIS THING
IS OUT OF
TAPE, YOU
HAD A REALLY
BAD DAY.
https://secure.flickr.com/photos/stephendotcarter/6587082437
17. So where does server hugging come from?
Why did we need to find them in
person?
18. So where does server hugging come from?
Why did we need to find them in
person?
Because we HAD to fix them.
19. So where does server hugging come from?
Why did we need to find them in
person?
Because we HAD to fix them. WHY?
20.
21.
22.
23.
24. So where does server hugging come from?
We fixed them because:
Dead servers == dead space
Dead space == wasted $$$
Dead servers == worse performance
Worse performance == lost $$$
31. Waking when they cry:
*** Nagios ***
Notification Type: PROBLEM
Service: Web CPU
Host: web03.example.com
Address: 10.167.10.51
State: CRITICAL
Date/Time: Thu Oct 24 08:14:13 UTC 2013
Additional Info:
CRITICAL – CPU LOAD 29
32. Hugging server babies and you
•
•
•
•
•
•
•
Is the site performing worse?
Are your customers impacted?
How impacted are they?
What are the other 20 web instances doing?
Did I really need to wake up at 4am for this?
If a server uses 100% of its CPU, should I care?
If this server is bad, how much work is there in fixing
it?
• Is there something custom about this server?
33. Server hugging bad practices
• “Pet-ting” – caring about a server’s “name,” its
well being, its individual status
• “Snowflakes” – unique hosts in a common pool
• “Model T-ing” – Hand-built one-off servers
• “Names In Stone” – overuse of host names as
a source of truth
34. In short, there are a lot of old-school, dated habits
being taken to cloud infrastructure. And once you’ve
brought them to the cloud, you lose out on a lot of the
benefits of the cloud.
Such as:
• Dynamic scale up/down
• Self healing infrastructures
• Increased flexibility
• Automation
36. Letting go involves moving forward with
some of the best of what AWS can offer you
in terms of services and how you can work
with them in some pretty incredible ways.
37. Letting go and loving the new way
•
•
•
•
•
•
Using Auto Scaling for everything
ENIs and EIPs
Tags are the new DNS
Deployment tools
Host-based configuration
Service registries
39. The things that should never wake you up
•
•
•
•
•
•
High CPU usage on anything
High memory usage on anything
Thread/process exhaustion
Filled disks
Not running software
Failed instances
42. Common actions taken when paged
1. Look at logs
2. Look at graphs
3. Reboot/restart related application/instance
43. Common actions taken when paged
1. Look at logs
2. Look at graphs
}
Looking at past data
3. Reboot/restart related application/instance
44. Common actions taken when paged
1. Look at logs
2. Look at graphs
}
Looking at past data
3. Reboot/restart related application/instance
Why do this manually?
45. Traffic to our site vs. provisioned capacity manually
Provisioned capacity
46. Traffic to our site vs. provisioned capacity manually
76%
Provisioned capacity
24%
47. Traffic to our site vs. provisioned capacity with Auto Scaling
Provisioned capacity
48. STONITH
"Shoot the other node in the head”
Don’t be afraid to kill a node a with
something wrong with it as a resolution
to failure!
With Auto Scaling it’s fine!
56. STONITH
Alarm
CloudWatch
Amazon SQS
Amazon SNS
EC2 API
Internet
Gateway
ELB
Web
Instance
ELB
ELB
Web
Instance
Watcher
Instance
Web
Instance
Auto scaling Group min=3
Availability Zone
Availability Zone
Virtual Private Cloud
AWS Cloud
Availability Zone
57. STONITH
Alarm
CloudWatch
Amazon SQS
Amazon SNS
EC2 API
Internet
Gateway
ELB
ELB
ELB
Web
Instance
Watcher
Instance
Web
Instance
Auto scaling Group min=3
Availability Zone
Availability Zone
Virtual Private Cloud
AWS Cloud
Availability Zone
58. STONITH
CloudWatch
Amazon SQS
Amazon SNS
EC2 API
Internet
Gateway
ELB
Web
Instance
ELB
ELB
Web
Instance
Watcher
Instance
Web
Instance
Auto scaling Group min=3
Availability Zone
Availability Zone
Virtual Private Cloud
AWS Cloud
Availability Zone
59. Auto Scaling for everything!
• You can use Auto Scaling for singular instances that
don’t scale up or down
– min = 1, max = 1
• Auto Scaling gives you the ability to specify multiple
Availability Zones, even you only need a single host
– gives you multi-AZ failover
• Auto Scaling supports notifications on instance
creation/termination
– Useful for configuring other resources, bootstrapping, and
provisioning
• Auto Scaling is free!
60. Auto Scaling for everything!
• Make use of the user data or configuration
management tools to do things like:
– Re-attaching an Amazon Elastic Block Store (EBS) volume with
application data
– Re-attaching an Elastic Network Interface (ENI)
– Update service registries
– Update DNS
– Update other reliant applications of the new host
61. Elastic Network Interfaces/Elastic IPs
ENI:
• Add additional interfaces to an
instance
• One or more secondary private
IP addresses
• Has its own MAC address
• Can have Security Groups
assigned
• Tag-able
• Free
EIP:
• A static public IP address
• Can be assigned to either an
instance or an ENI
• Doesn’t replace private IP
• Small hourly charge when not
attached to an instance
62. Elastic Network Interfaces
Attaching multiple network interfaces to an instance is useful when you
want to:
• Create a management network.
• Use network and security appliances in your
Amazon Virtual Private Cloud (VPC).
• Create dual-homed instances with workloads/roles on distinct
subnets.
• Create a low-budget, high-availability solution.
63. Elastic Network Interfaces
Attaching multiple network interfaces to an instance is useful when you
want to:
• Create a management network.
• Use network and security appliances in your
Amazon Virtual Private Cloud (VPC).
• Create dual-homed instances with workloads/roles on distinct
subnets.
• Create a low-budget, high-availability solution.
65. Healing a single instance
EC2 API
Internet
Gateway
NAT
Instance
Availability Zone
Virtual Private Cloud
AWS Cloud
AWS
CloudFormation
66. Healing a single instance
EC2 API
App
Instance
Internet
Gateway
NAT
Instance
Availability Zone
Virtual Private Cloud
AWS Cloud
AWS
CloudFormation
67. Healing a single instance
EC2 API
App
Instance
Internet
Gateway
Auto-Scaling
Group
NAT
Instance
Availability Zone
Virtual Private Cloud
AWS Cloud
AWS
CloudFormation
68. Healing a single instance
EC2 API
Elastic Network
Instance
App
Instance
Auto-Scaling
Group
Internet
Gateway
EBS
Volume
NAT
Instance
Availability Zone
Virtual Private Cloud
AWS Cloud
AWS
CloudFormation
69. Healing a single instance
EC2 API
Elastic Network
Instance
App
Instance
Auto-Scaling
Group
Internet
Gateway
EBS
Volume
NAT
Instance
Availability Zone
Virtual Private Cloud
AWS Cloud
AWS
CloudFormation
70. Healing a single instance
EC2 API
Elastic Network
Instance
Instances
App
Instance
Auto-Scaling
Group
Internet
Gateway
EBS
Volume
NAT
Instance
Availability Zone
Virtual Private Cloud
AWS Cloud
AWS
CloudFormation
71. Healing a single instance
EC2 API
Elastic Network
Instance
Instances
App
Instance
Auto-Scaling
Group
Internet
Gateway
EBS
Volume
NAT
Instance
Availability Zone
Virtual Private Cloud
AWS Cloud
AWS
CloudFormation
72. Healing a single instance
EC2 API
Elastic Network
Instance
Instances
App
Instance
Auto-Scaling
Group
Internet
Gateway
EBS
Volume
NAT
Instance
Availability Zone
Virtual Private Cloud
AWS Cloud
AWS
CloudFormation
73. Healing a single instance
EC2 API
Elastic Network
Instance
Instances
App
Instance
Auto-Scaling
Group
Internet
Gateway
EBS
Volume
NAT
Instance
Availability Zone
Virtual Private Cloud
AWS Cloud
AWS
CloudFormation
74. Healing a single instance
EC2 API
Elastic Network
Instance
Instances
App
Instance
Auto-Scaling
Group
Internet
Gateway
EBS
Volume
NAT
Instance
Availability Zone
Virtual Private Cloud
AWS Cloud
AWS
CloudFormation
75. Healing a single instance
EC2 API
Elastic Network
Instance
Instances
App
Instance
Auto-Scaling
Group
Internet
Gateway
EBS
Volume
NAT
Instance
Availability Zone
Virtual Private Cloud
AWS Cloud
AWS
CloudFormation
76. Healing a single instance
"myENI" : {
"Type" : "AWS::EC2::NetworkInterface",
"Properties" : {
"Tags": [{"Key":"Name","Value":"AppENI"},
{"Key":"Project","Value":"Blog"}],
"Description": "Blog One Off App Server ENI.",
"SubnetId": "subnet-d2286cb9",
"PrivateIpAddress": "192.168.11.100"
}
}
78. Healing a single instance
import boto.ec2
import boto.utils
conn = boto.ec2.connect_to_region('us-west-2')
Connect to API
myfilters = {'tag:Name': 'AppENI', 'tag:Project': 'Blog’}
Find the right ENI
myEni=conn.get_all_network_interfaces(filters=myfilters)
myInstance=boto.utils.get_instance_metadata()['instance-id']
Attach ENI to instance
conn.attach_network_interface(myEni[0].id, myInstance, device_index=1,
dry_run=False)
79. Use tags as a source
of “truth” in your
infrastructure
https://secure.flickr.com/photos/cambodia4kidsorg/260004685
80. DNS bad. Tags good.
DNS
• 30-year old technology
• Only tells us a single
thing about a host, a
hostname to IP mapping.
• Potential for split
brain/broken replicas
• Caching issues, caching
issues, caching issues
Tags
• Set by you the user, held
in AWS and available via
APIs
• Key:Value is totally up to
you
• Can have several per
resource
• Free to implement and
query
82. Tags as a source of truth
•
•
•
•
•
•
Tie various resources together
Billing reports
IAM resource-level permissions
Build automation
Deploy automation
Security resource grouping
87. Host-based configuration management
• All more or less accomplish the same things
– File configuration, package/software installation, user management, run
commands, interface with OS, process management
• All have their own syntax that isn’t too dissimilar
• Some rely on agents, some are agentless
• Use HBCM alongside one of the tools from the previous
slide
• Spend the time required to learn them
• Can’t scale easily without HBCM
88. “I don’t have time to learn Chef!?”
https://secure.flickr.com/photos/45909111@N00/9374169461/
89. “I don’t have time to learn Chef!?”
“I wrote custom shell
scripts instead!”
https://secure.flickr.com/photos/45909111@N00/9374169461/
90. Go visit the AWS & Partner
exhibits and ask for more
info!
https://secure.flickr.com/photos/45909111@N00/9374169461/
91. Making Use of
Service Registries
https://secure.flickr.com/photos/fringedbenefit/9178086713
94. “A service registry is one of the fundamental
pieces of service-oriented architecture
(SOA) for achieving reuse. It refers to a
place in which service providers can impart
information about their offered services and
potential clients can search for services.”
- www.architecturejournal.net, Sept 2009
95. Service registry workflow
1. A new instance boots.
2. It registers itself with our “service registry.”
3. Changes to the service registry kick off changes on
other systems related to the new instance.
4. Other instances now know about our new instance.
5. On instance termination, instance is deregistered,
and other instances remove it from use.
102. Intros
not at Re:Invent
Igor Serebryany
+ SRE at Airbnb since 2012
+ Built datacenter automation at
SingleHop
+ Scientific computing at University
of Chicago
+ Hobbies: welding, biking, long
walks on the beach
10
2
103. Intros
This guy is even more bearded than the last!
Martin Rhoads
+ SRE at Airbnb
+ user of AWS since 2006
+ First 10 employees at RightScale
+ Previously worked at
Cloudscaling deploying
OpenStack at Tier1s and Telcos
+ BioInformatics at UCSB
+ Obsessed with making things
easier
10
3
105. Why do I need SOA?
What are you trying to sell me?
+ The definitive way to scale your architecture
+ Allow different people to work on different code without stepping on toes
+ Separate deployment schedules
+ Separate machine and data requirements
+ Fail separately -- so you can have graceful degradation
10
5
113. To sum up
1
Services help you scale
2
SOA is an architecture style designed around services
3
A SOA is hard to manage
4
SmartStack makes managing SOA a breeze
11
3
115. 1
Service(s) you want to deliver
2
Zookeeper registry to track
everything
3
Nerve checks health and updates Zookeeper
4
Synapse routes between services
SERVICE
NERVE
ZOOKEEPER
SYNAPSE
117. haproxy
At the core of synapse
We get myriad benefits from haproxy
+ Stable and well-tested
+ Performs in-process connectivity
checks
+ Great introspection and logging
+ Lots of load-balancing algorithms
(RR, least-conn)
+ Somewhat dynamically reconfigurable
(stats socket)
11
7
120. Abstraction
+ The same code in the same language is always doing
discovery/registration
+ Your application doesn’t know about nerve/synapse -- it only knows about
its dependencies
+ Always consistent across your infrastructure
12
0
121. Automatic Failure Handling
You don’t have to wake up
+ Bad backends are automatically taken out of rotation
+ Useful during both problems and routine maintenance/deploys
+ Push-based => very rapid detection; avoid those little blips
+ haproxy even routes around network partitions!
12
1
122. Introspection
See what’s REALLY going on
Leverage the power of haproxy
+ status page that lets you see local
state
+ lots of available integrations to
gather global state
+ world-class logging for large-scale
analysis
12
2
123. Distributed by Design
No central point of failure
+ Traffic flows directly between boxes -- no routing layer
+ Even if SmartStack is stopped or broken, haproxy keeps traffic flowing
+ Zookeeper helps to avoid common pitfalls (like different backends in
different network segments)
12
3
124. The Impact
How SmartStack has changed Airbnb
100+
2K
3K
30
Services
using
SmartStack
Requests per
second
LOC
deleted
Engineers
using
SmartStack
12
4
125. Spike : “Nerve and Synapse have greatly simplified my
life as an application developer, and have enabled me to
launch our first Node.js services with very little ops
overhead.”
Sean: “Smart Stack has made deployment of new java
services a matter of beer and 20 lines of ruby”
Our engineers
love
SmartStack
Ben: “SmartStack is great! It helped me to discover
services – and quit smoking”
Barbara: “I love it!”
Phillippe: “Distributed computing? And all this time I
thought everything was running on one machine”
126. Future Direction
Is this project, like, done...?
1
Better resiliency: more graceful handling of zookeeper edge
cases
2
Better testing: improve on the current integration test suite
3
Dynamic registration: for services running on Mesos et. al.
4
A push API for nerve: allow services to communicate coming downtime
5
An auto-scaling layer: use nerve information to determine load
levels
12
6
129. Where is the code?
https://github.com/airbnb/nerve.git
https://github.com/airbnb/synapse.git
12
9
130. AWS re:Invent Pub Crawl
Join the AWS Startup Team this evening at the AWS Pub Crawl
When: Wednesday November 13, 5:30pm - 7:30pm
Where: Canaletto at The Venetian, 2nd Floor
Who Will Be There: Startups, the AWS Startup Team,
Startup Launch Companies, and
AWS re:Invent Hackathon winners
131. Startup Spotlight Sessions with Dr. Werner Vogels
Thurs. Nov 14, Marcello Room 4406
SPOT 203 – Fireside Chats – Startup Founders, 1:30-2:30pm
– Eliot Horowitz, CTO of MongoDB
– Jeff Lawson, CEO of Twilio
– Valentino Volonghi, Chief Architect of AdRoll
SPOT 204 – Fireside Chats – Startup Influencers, 3:00-4:00pm
– Albert Wegner, Managing Partner at Union Square Ventures
– David Cohen, Founder and CEO of TechStars
SPOT 101 - Startup Launches, 4:15-5:15pm
– 5 companies powered by AWS launching at AWS re:Invent 2013
132. We are sincerely eager to hear
your feedback on this
presentation and on re:Invent.
Please fill out an evaluation form
when you have a chance.