This document contains slides from a presentation given by Adrian Cockcroft on Netflix's use of cloud computing on Amazon Web Services (AWS). The summary includes:
1) Netflix moved most of its infrastructure to AWS to leverage AWS's scale and features rather than building its own datacenters, as capacity growth was unpredictable and datacenters were inflexible.
2) Netflix uses many AWS services including EC2, S3, EBS, EMR and more. It deployed a large movie encoding farm on EC2, stores content on S3, uses EMR/Hadoop for log analysis, and a CDN for content delivery.
3) Netflix has learned that cloud tools don't always scale for large
Learn how the Blue/Green Deployment methodology combined with AWS tools and services can help reduce the risks associated with software deployment. We will illustrate common patterns and highlight ways deployment risks are mitigated by each pattern. Topics will include how services like AWS CloudFormation, AWS Elastic Beanstalk, Amazon EC2 Container Service, Amazon Route53, Auto Scaling and Elastic Load Balancing can help automate deployment. We will also address how to effectively manage deployments in the context of data model and schema changes. Learn how you can adopt blue/green for your software release processes in a cost-effective and low-risk way.
This session will feature best practices in the real world for deploying AWS cloud services. You will hear about cloud use cases, governance, security, cloud architecture, optimizing costs, and leveraging appropriate support offerings. The session will provide insight into experience from hundreds of government customers’ AWS adoption and highlight lessons learned along the way.
While many organizations have started to automate their software development processes, many still engineer their infrastructure largely by hand. Treating your infrastructure just like any other piece of code creates a “programmable infrastructure” that allows you to take full advantage of the scalability and reliability of the AWS cloud. This session will walk through practical examples of how AWS customers have merged infrastructure configuration with application code to create application-specific infrastructure and a truly unified development lifecycle. You will learn how AWS customers have leveraged tools like CloudFormation, orchestration engines, and source control systems to enable their applications to take full advantage of the scalability and reliability of the AWS cloud, create self-reliant applications, and easily recover when things go seriously wrong with their infrastructure.
AWS provides a platform that is ideally suited for building highly available systems, enabling you to build reliable, affordable, fault-tolerant systems that operate with a minimal amount of human interaction. This session covers many of the high-availability and fault-tolerance concepts and features of the various services that you can use to build highly reliable and highly available applications in the AWS Cloud: architectures involving multiple Availability Zones, including EC2 best practices and RDS Multi-AZ deployments; loosely coupled and self-healing systems involving SQS and Auto Scaling; networking best practices for high availability, including Elastic IP addresses, load balancing, and DNS; leveraging services that inherently are built with high-availability and fault tolerance in mind, including S3, Elastic Beanstalk and more.
by Greg McConnel, Sr. Solutions Architect, AWS
We take an in-depth look at the AWS Identity and Access Management (IAM) policy language. We start with the basics of the policy language and how to create and attach policies to IAM users, groups, and roles. As we dive deeper, we explore policy variables, conditions, and other tools to help you author least privilege policies. Throughout the session, we cover some common use cases, such as granting a user secure access to an Amazon S3 bucket and launching an Amazon EC2 instance of a specific type.
Learn how the Blue/Green Deployment methodology combined with AWS tools and services can help reduce the risks associated with software deployment. We will illustrate common patterns and highlight ways deployment risks are mitigated by each pattern. Topics will include how services like AWS CloudFormation, AWS Elastic Beanstalk, Amazon EC2 Container Service, Amazon Route53, Auto Scaling and Elastic Load Balancing can help automate deployment. We will also address how to effectively manage deployments in the context of data model and schema changes. Learn how you can adopt blue/green for your software release processes in a cost-effective and low-risk way.
This session will feature best practices in the real world for deploying AWS cloud services. You will hear about cloud use cases, governance, security, cloud architecture, optimizing costs, and leveraging appropriate support offerings. The session will provide insight into experience from hundreds of government customers’ AWS adoption and highlight lessons learned along the way.
While many organizations have started to automate their software development processes, many still engineer their infrastructure largely by hand. Treating your infrastructure just like any other piece of code creates a “programmable infrastructure” that allows you to take full advantage of the scalability and reliability of the AWS cloud. This session will walk through practical examples of how AWS customers have merged infrastructure configuration with application code to create application-specific infrastructure and a truly unified development lifecycle. You will learn how AWS customers have leveraged tools like CloudFormation, orchestration engines, and source control systems to enable their applications to take full advantage of the scalability and reliability of the AWS cloud, create self-reliant applications, and easily recover when things go seriously wrong with their infrastructure.
AWS provides a platform that is ideally suited for building highly available systems, enabling you to build reliable, affordable, fault-tolerant systems that operate with a minimal amount of human interaction. This session covers many of the high-availability and fault-tolerance concepts and features of the various services that you can use to build highly reliable and highly available applications in the AWS Cloud: architectures involving multiple Availability Zones, including EC2 best practices and RDS Multi-AZ deployments; loosely coupled and self-healing systems involving SQS and Auto Scaling; networking best practices for high availability, including Elastic IP addresses, load balancing, and DNS; leveraging services that inherently are built with high-availability and fault tolerance in mind, including S3, Elastic Beanstalk and more.
by Greg McConnel, Sr. Solutions Architect, AWS
We take an in-depth look at the AWS Identity and Access Management (IAM) policy language. We start with the basics of the policy language and how to create and attach policies to IAM users, groups, and roles. As we dive deeper, we explore policy variables, conditions, and other tools to help you author least privilege policies. Throughout the session, we cover some common use cases, such as granting a user secure access to an Amazon S3 bucket and launching an Amazon EC2 instance of a specific type.
In this session we’ll take a high-level overview of AWS Lambda, a serverless compute platform that has changed the way that developers around the world build applications. We’ll explore how Lambda works under the hood, the capabilities it has, and how it is used. By the end of this talk you’ll know how to create Lambda based applications and deploy and manage them easily.
Speaker: Chris Munns - Principal Developer Advocate, AWS Serverless Applications, AWS
Docker containers have become a key component of modern application design. Increasingly, developers are breaking their applications apart into smaller components and distributing them across a pool of compute resources.
Behind the Scenes: Exploring the AWS Global Network (NET305) - AWS re:Invent ...Amazon Web Services
The AWS Global Network provides a secure, highly available, and high- performance infrastructure for customers. In this session, we walk through the architecture of various parts of the AWS network such as Availability Zones, AWS Regions, our Global Network connecting AWS Regions to each other and our Edge Network which provides Internet connectivity. We explain how AWS services such as AWS Direct Connect and Amazon CloudFront integrate with our Global Network to provide the best experience for our customers. We also dive into how the AWS Global Network connects to the rest of the Internet through peering at a global scale. If you are curious about how AWS network infrastructure can support large-scale cat photo distribution or how Internet routing works, this session answers those questions. Please join us for a speaker meet-and-greet following this session at the Speaker Lounge (ARIA East, Level 1, Willow Lounge). The meet-and-greet starts 15 minutes after the session and runs for half an hour.
Amazon S3 hosts trillions of objects and is used for storing a wide range of data, from system backups to digital media. This presentation from the Amazon S3 Masterclass webinar we explain the features of Amazon S3 from static website hosting, through server side encryption to Amazon Glacier integration. This webinar will dive deep into the feature sets of Amazon S3 to give a rounded overview of its capabilities, looking at common use cases, APIs and best practice.
See a recording of this video here on YouTube: http://youtu.be/VC0k-noNwOU
Check out future webinars in the Masterclass series here: http://aws.amazon.com/campaigns/emea/masterclass/
View the Journey Through the Cloud webinar series here: http://aws.amazon.com/campaigns/emea/journey/
AWS CloudFormation: Infrastructure as Code | AWS Public Sector Summit 2016Amazon Web Services
This session provides the attendee with an overview of our AWS CloudFormation service and helps the customer to realize the benefits of "infrastructure as code." A demo is part of this session.
This session is designed to introduce you to fundamental cloud computing and AWS security concepts that will help you prepare for the Security Week sessions, demos, and workshops. We will also provide an overview of the Security pillar of the AWS Cloud Adoption Framework (CAF) and talk about how AWS keeps humans away from data—and how you can, too.
In this webinar, you'll learn about the foundational security blocks and how to start using them effectively to create robust and secure architectures. Discover how Identity and Access management is done and how it integrates with other AWS services. In addition, learn how to improve governance by using AWS Security Hub, AWS Config and CloudTrail to gain unprecedented visibility of activity in the account. Subsequently use AWS Config rules to rectify configuration issues quickly and effectively.
Whether you are a traditional enterprise exploring migrating workloads to the cloud or are already “all-in” on AWS, performing common tasks of inventory collection, OS patch management, and image creation at scale is increasingly complicated in hybrid infrastructure environments. Amazon EC2 Systems Manager allows you to perform automated configuration and ongoing management of your hybrid environment systems at scale. This session provides an overview of key EC2 Systems Manager capabilities that help you define and track system configurations, prevent drift, and maintain software compliance of your EC2 and on-premises configurations. We will also discuss common use cases for EC2 Systems Manager and give you a demonstration of a hybrid-cloud management scenario.
by Apurv Awasthi, Sr. Technical Product Manager, AWS
This session introduces the concepts of AWS Identity and Access Management (IAM) and walks through the tools and strategies you can use to control access to your AWS environment. We describe IAM users, groups, and roles and how to use them. We demonstrate how to create IAM users and roles, and grant them various types of permissions to access AWS APIs and resources. We also cover the concept of trust relationships, and how you can use them to delegate access to your AWS resources. This session covers also covers IAM best practices that can help improve your security posture. We cover how to manage IAM users and roles, and their security credentials. We also explain ways for how you can securely manage you AWS access keys. Using common use cases, we demonstrate how to choose between using IAM users or IAM roles. Finally, we explore how to set permissions to grant least privilege access control in one or more of your AWS accounts. Level 100
Running Microsoft SharePoint On AWS - Smartronix and AWS - WebinarAmazon Web Services
Miles Ward, Solution Architect, AWS
Robert Groat, Chief Technology Officer, Smartronix
discuss how you can run microsoft Enterprise Applications like SharePoint on AWS Cloud, Architecture. Recovery.gov
by Fritz Kunstler, Sr. AWS Security Consultant AWS
Join us for four days of security and compliance sessions and hands-on labs led by our AWS security pros during AWS Security Week at the San Francisco Loft. Join us for all four days, or pick just the days that are most relevant to you. We'll open on Monday with Security 101 day, followed by sessions Tuesday on Identity and Access Management, our popular Threat Detection and Remediation day Wednesday will feature an updated GuardDuty lab, and we'll end Thursday with Incident Response sessions, labs, and a talk by Netflix on their new open source IR tool. This week will also feature Dome9 as a sponsor, and you can hear them speak and present a hands-on workshop Monday during Security 101 day.
Amazon API Gateway is a fully managed service that makes it easy for developers to create, publish, maintain, monitor, and secure APIs at any scale. With a few clicks in the AWS Management Console, you can create an API that acts as a “front door” for applications to access data, business logic, or functionality from your back-end services, such as workloads running on Amazon Elastic Compute Cloud (Amazon EC2), code running on AWS Lambda, or any Web application. Amazon API Gateway handles all the tasks involved in accepting and processing up to hundreds of thousands of concurrent API calls, including traffic management, authorization and access control, monitoring, and API version management.
Presented by: Danilo Poccia, Technical Evangelist, Amazon Web Services
AWS is architected to be one of the most flexible and secure cloud computing environments available today. It provides an extremely scalable, highly reliable platform that enables customers to deploy applications and data quickly and securely. When using AWS, not only are infrastructure headaches removed, but so are many of the security issues that come with them.
In this session we’ll take a high-level overview of AWS Lambda, a serverless compute platform that has changed the way that developers around the world build applications. We’ll explore how Lambda works under the hood, the capabilities it has, and how it is used. By the end of this talk you’ll know how to create Lambda based applications and deploy and manage them easily.
Speaker: Chris Munns - Principal Developer Advocate, AWS Serverless Applications, AWS
Docker containers have become a key component of modern application design. Increasingly, developers are breaking their applications apart into smaller components and distributing them across a pool of compute resources.
Behind the Scenes: Exploring the AWS Global Network (NET305) - AWS re:Invent ...Amazon Web Services
The AWS Global Network provides a secure, highly available, and high- performance infrastructure for customers. In this session, we walk through the architecture of various parts of the AWS network such as Availability Zones, AWS Regions, our Global Network connecting AWS Regions to each other and our Edge Network which provides Internet connectivity. We explain how AWS services such as AWS Direct Connect and Amazon CloudFront integrate with our Global Network to provide the best experience for our customers. We also dive into how the AWS Global Network connects to the rest of the Internet through peering at a global scale. If you are curious about how AWS network infrastructure can support large-scale cat photo distribution or how Internet routing works, this session answers those questions. Please join us for a speaker meet-and-greet following this session at the Speaker Lounge (ARIA East, Level 1, Willow Lounge). The meet-and-greet starts 15 minutes after the session and runs for half an hour.
Amazon S3 hosts trillions of objects and is used for storing a wide range of data, from system backups to digital media. This presentation from the Amazon S3 Masterclass webinar we explain the features of Amazon S3 from static website hosting, through server side encryption to Amazon Glacier integration. This webinar will dive deep into the feature sets of Amazon S3 to give a rounded overview of its capabilities, looking at common use cases, APIs and best practice.
See a recording of this video here on YouTube: http://youtu.be/VC0k-noNwOU
Check out future webinars in the Masterclass series here: http://aws.amazon.com/campaigns/emea/masterclass/
View the Journey Through the Cloud webinar series here: http://aws.amazon.com/campaigns/emea/journey/
AWS CloudFormation: Infrastructure as Code | AWS Public Sector Summit 2016Amazon Web Services
This session provides the attendee with an overview of our AWS CloudFormation service and helps the customer to realize the benefits of "infrastructure as code." A demo is part of this session.
This session is designed to introduce you to fundamental cloud computing and AWS security concepts that will help you prepare for the Security Week sessions, demos, and workshops. We will also provide an overview of the Security pillar of the AWS Cloud Adoption Framework (CAF) and talk about how AWS keeps humans away from data—and how you can, too.
In this webinar, you'll learn about the foundational security blocks and how to start using them effectively to create robust and secure architectures. Discover how Identity and Access management is done and how it integrates with other AWS services. In addition, learn how to improve governance by using AWS Security Hub, AWS Config and CloudTrail to gain unprecedented visibility of activity in the account. Subsequently use AWS Config rules to rectify configuration issues quickly and effectively.
Whether you are a traditional enterprise exploring migrating workloads to the cloud or are already “all-in” on AWS, performing common tasks of inventory collection, OS patch management, and image creation at scale is increasingly complicated in hybrid infrastructure environments. Amazon EC2 Systems Manager allows you to perform automated configuration and ongoing management of your hybrid environment systems at scale. This session provides an overview of key EC2 Systems Manager capabilities that help you define and track system configurations, prevent drift, and maintain software compliance of your EC2 and on-premises configurations. We will also discuss common use cases for EC2 Systems Manager and give you a demonstration of a hybrid-cloud management scenario.
by Apurv Awasthi, Sr. Technical Product Manager, AWS
This session introduces the concepts of AWS Identity and Access Management (IAM) and walks through the tools and strategies you can use to control access to your AWS environment. We describe IAM users, groups, and roles and how to use them. We demonstrate how to create IAM users and roles, and grant them various types of permissions to access AWS APIs and resources. We also cover the concept of trust relationships, and how you can use them to delegate access to your AWS resources. This session covers also covers IAM best practices that can help improve your security posture. We cover how to manage IAM users and roles, and their security credentials. We also explain ways for how you can securely manage you AWS access keys. Using common use cases, we demonstrate how to choose between using IAM users or IAM roles. Finally, we explore how to set permissions to grant least privilege access control in one or more of your AWS accounts. Level 100
Running Microsoft SharePoint On AWS - Smartronix and AWS - WebinarAmazon Web Services
Miles Ward, Solution Architect, AWS
Robert Groat, Chief Technology Officer, Smartronix
discuss how you can run microsoft Enterprise Applications like SharePoint on AWS Cloud, Architecture. Recovery.gov
by Fritz Kunstler, Sr. AWS Security Consultant AWS
Join us for four days of security and compliance sessions and hands-on labs led by our AWS security pros during AWS Security Week at the San Francisco Loft. Join us for all four days, or pick just the days that are most relevant to you. We'll open on Monday with Security 101 day, followed by sessions Tuesday on Identity and Access Management, our popular Threat Detection and Remediation day Wednesday will feature an updated GuardDuty lab, and we'll end Thursday with Incident Response sessions, labs, and a talk by Netflix on their new open source IR tool. This week will also feature Dome9 as a sponsor, and you can hear them speak and present a hands-on workshop Monday during Security 101 day.
Amazon API Gateway is a fully managed service that makes it easy for developers to create, publish, maintain, monitor, and secure APIs at any scale. With a few clicks in the AWS Management Console, you can create an API that acts as a “front door” for applications to access data, business logic, or functionality from your back-end services, such as workloads running on Amazon Elastic Compute Cloud (Amazon EC2), code running on AWS Lambda, or any Web application. Amazon API Gateway handles all the tasks involved in accepting and processing up to hundreds of thousands of concurrent API calls, including traffic management, authorization and access control, monitoring, and API version management.
Presented by: Danilo Poccia, Technical Evangelist, Amazon Web Services
AWS is architected to be one of the most flexible and secure cloud computing environments available today. It provides an extremely scalable, highly reliable platform that enables customers to deploy applications and data quickly and securely. When using AWS, not only are infrastructure headaches removed, but so are many of the security issues that come with them.
Continuous Deployment to the Cloud using SpinnakerTim Ysewyn
In our quest to get to production faster, we've tackled culture, architecture and infrastructure: organizing ourselves in cross-functional DevOps teams, embracing microservice architectures, and deploying to the various clouds out there. Along the way we’ve learned some best practices about how to deploy software at velocity — things like automated releases, immutable infrastructure, gradual rollouts and fast rollbacks.
Back in 2014, Netflix started building Spinnaker, an open-source multi-cloud continuous delivery platform that embodied these core principles of safe, frequent and reliable releases. In June Spinnaker 1.0 was released, with core contributions from Google, Microsoft, Oracle and Pivotal to name a few.
Built on Spring Boot, its architecture is surprisingly familiar. During this session we'll give you a tour of how Spinnaker works, how we are using it at our clients, as well as what it could do for your continuous delivery pipeline.
A presentation on the Netflix Cloud Architecture and NetflixOSS open source. For the All Things Open 2015 conference in Raleigh 2015/10/19. #ATO2015 #NetflixOSS
For the Computer Measurement Group workshop in San Diego November 2013. Also presented to a student class at UC Santa Barbara. What is Cloud Native. Capacity and Performance benchmarks. Cost Optimization Techniques - content co-developed with Jinesh Varia of AWS.
Slides from QConSF Nov 19th, 2011 focusing this time on describing the globally distributed and scaled industrial strength Java Platform as a Service that Netflix has built and run on top of AWS and Cassandra. Parts of that platform are being released as open source - Curator, Priam and Astyanax.
[Full slides now also available at http://www.slideshare.net/adrianco/netflix-on-cloud-combined-slides-for-dev-and-ops]
Short summary of why Netflix is running on the Amazon cloud, what is running there, what we have learned and where this is taking us.
This is the introduction section to a series of public presentations that will go into much more detail. The Silicon Valley Cloud Computing Meetup was on Oct 14th, QCon San Francisco November 3rd.
(CMP404) Cloud Rendering at Walt Disney Animation StudiosAmazon Web Services
"Each year, the technical complexity of making the next great Walt Disney Animation Studios film increases. Animation and Visual FX studios continue to push the bounds of what is possible in computer graphics. This complexity drives rapid technological growth in both computational resources and storage to the point that it exceeds what we can physically provide with our on-premise compute cluster. As a result, we have started to adopt a hybrid approach with the cloud.
This session addresses the hurdles that animation and VFX studios face and focuses on automation of 'disposable' components (specifically infrastructure, licensing, fleet management, data and dependency management in a large-scale batch workload). We apply these general cloud techniques and utilities to an animation/VFX workload and push the limits with a very large scale cloud renderfarm deployment.
The team from Walt Disney Animation Studios walks through how they use cloud technologies to maximize render capacity. Learn how to leverage high-performance storage (like Amazon EFS), Amazon EC2 networking and the latest EC2 Spot features to provide a fully functional renderfarm at production-quality scale."
Web Scale Applications using NeflixOSS Cloud PlatformSudhir Tonse
Web Scale Applications using NeflixOSS Cloud Platform. Infographics on IaaS, PaaS, SaaS. Commandments of developing a cloud based distributed application.
Why Scale Matters and How the Cloud is Really Different (at scale)Amazon Web Services
Cloud computing gives you a number of advantages, such as being able to scale your application on demand. As a new business looking to use the cloud, you inevitably ask yourself, "Where do I start?" Join us in this session to understand best practices for scaling your resources from zero to millions of users. We will show you how to best combine different AWS services, make smarter decisions for architecting your application, and best practices for scaling your infrastructure in the cloud.
Presenter:
Santanu Dutt, Solution Architect, Amazon Internet Services
Vinayak Hegde, Vice President – Engineering, Helpshift
Sunny Saxena, Product Lead, Sprinklr
Flowcon (added to for CMG) Keynote talk on how Speed Wins and how Netflix is ...Adrian Cockcroft
Flowcon keynote was a few days before CMG, a few tweaks and some extra content added at the start and end. Opening Keynote talk for both conferences on how Speed Wins and how Netflix is doing Continuous Delivery
A collection of information taken from previous presentations that was used as drill down for supporting discussion of specific topics during the tutorial.
Same basic flow as the keynote, but with a lot more detail, and we had a lot more interactive discussion rather than a presentation format. See part 2 for some more specific detail and links to other presentations.
Introduction to the Netflix Open Source Software project, explains why Netflix is doing this, how all the parts fit together and what is planned to come next. Presented at the inaugural NetflixOSS Meetup February 6th 2013 at Netflix headquarters in Los Gatos.
AWS Re:Invent - High Availability Architecture at NetflixAdrian Cockcroft
Slides from my talk at AWS Re:Invent November 2012. Describes the architecture, how to make highly available application code and data stores, a taxonomy of failure modes, and actual failures and effects. Ends with a summary of @NetflixOSS projects so others can easily leverage this architecture.
Architecture talk aimed at a well informed developer audience (i.e. QConSF Real Use Cases for NoSQL track), focused mainly on availability. Skips the Netflix cloud migration stuff that is in other talks.
SV Forum Platform Architecture SIG - Netflix Open Source PlatformAdrian Cockcroft
Architecture overview of Netflix Cloud Architecture with a focus on the Open Source components that Netflix has put and is planning to release on http://netflix.github.com
Summary of past Cassandra benchmarks performed by Netflix and description of how Netflix uses Cassandra interspersed with a live demo automated using Jenkins and Jmeter that created two 12 node Cassandra clusters from scratch on AWS, one with regular disks and one with SSDs. Both clusters were scaled up to 24 nodes each during the demo.
Latest version of the Netflix Cloud Architecture story was given at Gluecon May 23rd 2012. Gluecon rocks, and lots of Van Halen references were added for the occasion. There tradeoff between developer driven high functionality AWS based PaaS, and operations driven low cost portable PaaS is discussed. The three sections cover the developer view, the operator view and the builder view.
Cloud Architecture Tutorial - Why and What (1of 3) Adrian Cockcroft
Introduction to the Netflix Cloud Architecture Tutorial - discusses the why and what of cloud including the thinking behind Netflix choice of AWS, and the product features that Netflix runs in the cloud.
This is the meat of the presentation, it describes in detail how do use anti-architecture to define what gets done, then discusses patterns, type systems, PaaS frameworks, services and components. There is a detailed explanation of Cassandra as a data store and open source components.
Cloud Architecture Tutorial - Running in the Cloud (3of3)Adrian Cockcroft
Part 3 of the talk covers how to transition to cloud, how to bootstrap developers, how to run cloud services including Cassandra, capacity planning and workload analysis, and organizational structure
Global Netflix - HPTS Workshop - Scaling Cassandra benchmark to over 1M write...Adrian Cockcroft
Presentation given in October 2011 at the High Performance Transaction Systems Workshop http://hpts.ws - describes how Netflix used AWS to run a set of highly scalable Cassandra benchmarks on hundreds of instances in only a few hours.
The Netflix recipe for migrating your organization from building a datacenter based product to a cloud based product. First presented at the Silicon Valley Cloud Computing Meetup "Speak Cloudy to Me" on Saturday April 30th, 2011
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams.
Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualityInflectra
In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring.
Learn about:
• The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks.
• Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective.
• Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification.
• Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process.
Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
Search and Society: Reimagining Information Access for Radical FuturesBhaskar Mitra
The field of Information retrieval (IR) is currently undergoing a transformative shift, at least partly due to the emerging applications of generative AI to information access. In this talk, we will deliberate on the sociotechnical implications of generative AI for information access. We will argue that there is both a critical necessity and an exciting opportunity for the IR community to re-center our research agendas on societal needs while dismantling the artificial separation between the work on fairness, accountability, transparency, and ethics in IR and the rest of IR research. Instead of adopting a reactionary strategy of trying to mitigate potential social harms from emerging technologies, the community should aim to proactively set the research agenda for the kinds of systems we should build inspired by diverse explicitly stated sociotechnical imaginaries. The sociotechnical imaginaries that underpin the design and development of information access technologies needs to be explicitly articulated, and we need to develop theories of change in context of these diverse perspectives. Our guiding future imaginaries must be informed by other academic fields, such as democratic theory and critical theory, and should be co-developed with social science scholars, legal scholars, civil rights and social justice activists, and artists, among others.
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
UiPath Test Automation using UiPath Test Suite series, part 4
Netflix on Cloud - combined slides for Dev and Ops
1. Ne#lix
in
the
Cloud
Nov
6,
2010
Adrian
Cockcro:
@adrianco
#ne#lixcloud
h=p://www.linkedin.com/in/adriancockcro:
2. Combined
Slides
For
both
Developer
and
OperaJons
Audiences
(2-‐3
hours
of
content)
Teaser
intro
slides
also
at
slideshare.net/adrianco
Oct
14th
Beta
#devops
subset
-‐
Cloud
CompuJng
Meetup
Nov
3rd
GA
–
QConSF
Developer
Oriented
subset
Nov
6th,
2010
–
Combined
slides
at
slideshare.net/adrianco
3. With
more
than
16
million
subscribers
in
the
United
States
and
Canada,
Ne9lix,
Inc.
is
the
world’s
leading
Internet
subscripAon
service
for
enjoying
movies
and
TV
shows.
Source:
h=p://ir.ne#lix.com
9. We
stopped
building
our
own
datacenters
Capacity
growth
rate
is
acceleraJng,
unpredictable
Product
launch
spikes
-‐
iPhone,
Wii,
PS3,
XBox
Datacenter
is
large
inflexible
capital
commitment
11. Leverage
AWS
Scale
“the
biggest
public
cloud”
AWS
investment
in
tooling
and
automaJon
AWS
zones
for
high
availability,
scalability
AWS
skills
are
common
on
resumes…
12. Leverage
AWS
Feature
Set
“two
years
ahead
of
the
others”
EC2,
S3,
SDB,
SQS,
EBS,
EMR,
ELB,
ASG,
IAM,
RDB…
13. “The
cloud
lets
its
users
focus
on
delivering
differenAaAng
business
value
instead
of
wasAng
valuable
resources
on
the
undifferen)ated
heavy
li0ing
that
makes
up
most
of
IT
infrastructure.”
Werner
Vogels
Amazon
CTO
14. Ne#lix
Deployed
on
AWS
Content
Logs
Play
WWW
API
Video
S3
DRM
Search
Metadata
Masters
EMR
CDN
Movie
Device
EC2
Hadoop
rouJng
Choosing
Config
TV
Movie
S3
Hive
Bookmarks
RaJngs
Choosing
Business
Mobile
CDN
Logging
Similars
Intelligence
iPhone
15. Movie
Encoding
farm
(2009)
• Tens
of
thousands
of
videos
Content
• Thousands
of
EC2
instances
Video
• Encoding
apps
on
MS
Windows
Masters
• ~100
speed/format
permutaJons
• Petabytes
of
S3
EC2
• Content
Delivery
Networks
S3
“Ne9lix
is
one
of
the
largest
customers
of
the
biggest
CDNs
Akamai
and
Limelight”
CDN
16. Hadoop
-‐
ElasJc
Map-‐Reduce
(2009)
• Web
Access
Logs
Logs
• Streaming
Service
Logs
S3
• Terabyte
per
day
scale
• Easy
Hadoop
via
Amazon
EMR
EMR
• Hive
SQL
“Data
Mart”
Hadoop
• Gateway
to
Datacenter
BI
Hive
Slideshare.net
talks
evamtse
“Ne#lix:
Hive
User
Group”
h=p://slidesha.re/aqJLAC
adrianco
“Crunch
Your
Data
In
The
Cloud”
h=p://slidesha.re/dx4oCK
Business
Intelligence
17. Streaming
Service
Back-‐end
(early
2010)
• PC/Mac
Silverlight
Player
Support
Play
• Highly
available
“play
bu=on”
DRM
• DRM
Key
Management
CDN
• Generate
route
to
stream
on
CDN
rouJng
• Lookup
bookmark
for
user/movie
Bookmarks
• Update
bookmark
for
user/movie
• Log
quality
of
service
Logging
18. Web
site,
a
page
at
a
Jme
(through
2010)
• Clean
presentaJon
layer
rewrite
WWW
• Search
auto-‐complete
Search
• Search
backend
and
landing
page
• Movie
and
genre
choosing
Movie
• Star
raJngs
and
recommendaJons
Choosing
• Similar
movies
RaJngs
• Page
by
page
to
80%
of
views
(leave
account
signup
in
Datacenter
for
now)
Similars
19. API
for
TV
devices
and
iPhone
etc.
(2010)
• REST
API:
developer.ne#lix.com
API
• Interfaces
to
everything
else
Metadata
• TV
Device
ConfiguraJon
• Personalized
movie
choosing
Device
Config
• iPhone
Launch
in
the
cloud
only
TV
Movie
Choosing
“Ne9lix
is
an
API
for
streaming
to
TVs
Mobile
(we
also
do
DVD’s
and
a
web
site)”
iPhone
25. Faster
to
re-‐code
from
scratch
• Opportunity
to
pay
down
technical
debt
• Re-‐architected
and
re-‐wrote
most
of
the
code
• Fine
grain
web
services
• Leveraged
many
open
source
Java
projects
• SystemaJcally
instrumented
• “NoSQL”
SimpleDB
backend
26. “In
the
datacenter,
robust
code
is
best
pracAce.
In
the
cloud,
it’s
essenAal.”
27. Takeaway
Ne9lix
is
path-‐finding
the
use
of
public
AWS
cloud
to
replace
in-‐house
IT
for
non-‐trivial
applicaAons
with
hundreds
of
developers
and
thousands
of
systems.
(Pause
for
quesJons
before
we
dive
into
details)
29. Synopsis
• The
Goals
– Faster,
Scalable,
Available
and
ProducJve
• AnJ-‐pa=erns
and
Cloud
Architecture
– The
things
we
wanted
to
change
and
why
• Cloud
Bring-‐up
Strategy
– Developer
TransiJons
and
Tools
• Roadmap
and
Next
Steps
30. Goals
• Faster
– Lower
latency
than
the
equivalent
datacenter
web
pages
and
API
calls
– Measured
as
mean
and
99th
percenJle
– For
both
first
hit
(e.g.
home
page)
and
in-‐session
hits
for
the
same
user
• Scalable
– Avoid
needing
any
more
datacenter
capacity
as
subscriber
count
increases
– No
central
verJcally
scaled
databases
– Leverage
AWS
elasJc
capacity
effecJvely
• Available
– SubstanJally
higher
robustness
and
availability
than
datacenter
services
– Leverage
mulJple
AWS
availability
zones
– No
scheduled
down
Jme,
no
central
database
schema
to
change
• ProducJve
– OpJmize
agility
of
a
large
development
team
with
automaJon
and
tools
– Leave
behind
complex
tangled
datacenter
code
base
(~8
year
old
architecture)
– Enforce
clean
layered
interfaces
and
re-‐usable
components
32. Datacenter
AnJ-‐Pa=erns
What
do
we
currently
do
in
the
datacenter
that
prevents
us
from
meeJng
our
goals?
33. Architecture
• So:ware
Architecture
– The
abstracJons
and
interfaces
that
developers
build
against
• Systems
Architecture
– The
service
instances
that
define
availability,
scalability
• Compose-‐ability
– so:ware
architecture
that
is
independent
of
the
systems
architecture
– decoupled
flexible
building
block
components
34. Rewrite
from
Scratch
Not
everything
is
cloud
specific
Pay
down
technical
debt
Robust
pa=erns
35. Old
Datacenter
vs.
New
Cloud
Arch
Central
SQL
Database
Distributed
Key/Value
NoSQL
SJcky
In-‐Memory
Session
Shared
Memcached
Session
Cha=y
Protocols
Latency
Tolerant
Protocols
Tangled
Service
Interfaces
Layered
Service
Interfaces
Instrumented
Code
Instrumented
Service
Pa=erns
Fat
Complex
Objects
Lightweight
Serializable
Objects
Components
as
Jar
Files
Components
as
Services
36. The
Central
SQL
Database
• Datacenter
has
a
central
database
– Everything
in
one
place
is
convenient
unJl
it
fails
– Customers,
movies,
history,
configuraJon
• Schema
changes
require
downJme
AnA-‐paTern
impacts
scalability,
availability
37. The
Distributed
Key-‐Value
Store
• Cloud
has
many
key-‐value
data
stores
– More
complex
to
keep
track
of,
do
backups
etc.
– Each
store
is
much
simpler
to
administer
DBA
– Joins
take
place
in
java
code
• No
schema
to
change,
no
scheduled
downJme
• Latency
for
Memcached
vs.
Oracle
vs.
SimpleDB
– Memcached
is
dominated
by
network
latency
<1ms
– Oracle
for
simple
queries
is
a
few
milliseconds
– SimpleDB
has
replicaJon
and
REST
overheads
>10ms
38. The
SJcky
Session
• Datacenter
SJcky
Load
Balancing
– Efficient
caching
for
low
latency
– Tricky
session
handling
code
– Middle
Jer
load
balancer
has
issues
in
pracJce
• Encourages
concentrated
funcJonality
– one
service
that
does
everything
AnA-‐paTern
impacts
producAvity,
availability
39. The
Shared
Session
• Cloud
Uses
Round-‐Robin
Load
Balancing
– Simple
request-‐based
code
– External
shared
caching
with
memcached
• More
flexible
fine
grain
services
– Works
be=er
with
auto-‐scaled
instance
counts
40. Cha=y
Opaque
and
Bri=le
Protocols
• Datacenter
service
protocols
– Assumed
low
latency
for
many
simple
requests
• Based
on
serializing
exisJng
java
objects
– Inefficient
formats
– IncompaJble
when
definiJons
change
AnA-‐paTern
causes
producAvity,
latency
and
availability
issues
41. Robust
and
Flexible
Protocols
• Cloud
service
protocols
– JSR311/Jersey
is
used
for
REST/HTTP
service
calls
– Custom
client
code
includes
service
discovery
– Support
complex
data
types
in
a
single
request
• Apache
Avro
– Evolved
from
Protocol
Buffers
and
Thri:
– Includes
JSON
header
defining
key/value
protocol
– Avro
serializaJon
is
half
the
size
and
several
Jmes
faster
than
Java
serializaJon,
more
work
to
code
42. Persisted
Protocols
• Persist
Avro
in
Memcached
– Save
space/latency
(zigzag
encoding,
half
the
size)
– Less
bri=le
across
versions
– New
keys
are
ignored
– Missing
keys
are
handled
cleanly
• Avro
protocol
definiJons
– Can
be
wri=en
in
JSON
or
generated
from
POJOs
– It’s
hard,
needs
be=er
tooling
43. Tangled
Service
Interfaces
• Datacenter
implementaJon
is
exposed
– Oracle
SQL
queries
mixed
into
business
logic
• Tangled
code
– Deep
dependencies,
false
sharing
• Data
providers
with
sideways
dependencies
– Everything
depends
on
everything
else
AnA-‐paTern
affects
producAvity,
availability
44. Untangled
Service
Interfaces
• New
Cloud
Code
With
Strict
Layering
– Compile
against
interface
jar
– Can
use
spring
runJme
binding
to
enforce
• Service
interface
is
the
service
– ImplementaJon
is
completely
hidden
– Can
be
implemented
locally
or
remotely
– ImplementaJon
can
evolve
independently
45. Untangled
Service
Interfaces
Two
layers:
• SAL
-‐
Service
Access
Library
– Basic
serializaJon
and
error
handling
– REST
or
POJO’s
defined
by
data
provider
• ESL
-‐
Extended
Service
Library
– Caching,
conveniences
– Can
combine
several
SALs
– Exposes
faceted
type
system
(described
later)
– Interface
defined
by
data
consumer
in
many
cases
47. Service
Architecture
Pa=erns
• Internal
Interfaces
Between
Services
– Common
pa=erns
as
templates
– Highly
instrumented,
observable,
analyJcs
– Service
Level
Agreements
–
SLAs
• Library
templates
for
generic
features
– Instrumented
Ne#lix
Base
Servlet
template
– Instrumented
generic
client
interface
template
– Instrumented
S3,
SimpleDB,
Memcached
clients
48. CLIENT
Request
Start
Timestamp,
Client
Inbound
Request
End
outbound
deserialize
end
Timestamp
serialize
start
Jmestamp
Jmestamp
Inbound
Client
deserialize
outbound
start
serialize
end
Jmestamp
Jmestamp
Client
network
receive
Jmestamp
Service
Request
Client
Network
send
Jmestamp
Instruments
Every
Service
network
send
Jmestamp
Step
in
the
call
Service
Network
receive
Jmestamp
Service
Service
outbound
inbound
serialize
end
serialize
start
Jmestamp
Jmestamp
Service
Service
outbound
inbound
SERVICE
execute
serialize
start
serialize
end
Jmestamp
request
start
Jmestamp
Jmestamp,
execute
request
end
Jmestamp
49. Boundary
Interfaces
• Isolate
teams
from
external
dependencies
– Fake
SAL
built
by
cloud
team
– Real
SAL
provided
by
data
provider
team
later
– ESL
built
by
cloud
team
using
faceted
objects
• Fake
data
sources
allow
development
to
start
– e.g.
Fake
IdenJty
SAL
for
a
test
set
of
customers
– Development
solidifies
dependencies
early
– Helps
external
team
provide
the
right
interface
50. One
Object
That
Does
Everything
• Datacenter
uses
a
few
big
complex
objects
– Movie
and
Customer
objects
are
the
foundaJon
– Good
choice
for
a
small
team
and
one
instance
– ProblemaJc
for
large
teams
and
many
instances
• False
sharing
causes
tangled
dependencies
– UnproducJve
re-‐integraJon
work
AnA-‐paTern
impacAng
producAvity
and
availability
51. An
Interface
For
Each
Component
• Cloud
uses
faceted
Video
and
Visitor
– Basic
types
hold
only
the
idenJfier
– Facets
scope
the
interface
you
actually
need
– Each
component
can
define
its
own
facets
• No
false-‐sharing
and
dependency
chains
– Type
manager
converts
between
facets
as
needed
– video.asA(PresentaJonVideo)
for
www
– video.asA(MerchableVideo)
for
middle
Jer
52. So:ware
Architecture
Pa=erns
• Object
Models
– Basic
and
derived
types,
facets,
serializable
– Pass
by
reference
within
a
service
– Pass
by
value
between
services
• ComputaJon
and
I/O
Models
– Service
ExecuJon
using
Best
Effort
– Common
thread
pool
management
54. API
AWS
EC2
Front
End
ELB
Discovery
Service
API
Proxy
API
etc.
API
ELB
Component
API
SQS
Services
Oracl
e
Oracle
Oracle
memcached
memcached
ReplicaJon
EBS
Ne@lix
S3
Data
Center
AWS
Storage
SimpleDB
55. Ne#lix
UndifferenJated
Li:ing
• Middle
Tier
Load
Balancing
• Discovery
(local
DNS)
• EncrypJon
Services
• Caching
• Distributed
App
Management
We
want
cloud
vendors
to
do
all
this
for
us
as
well!
56. Load
Balancing
in
AWS
• Middle
Jer
currently
not
supported
in
AWS
– ELB
are
public-‐facing
only
– Cannot
apply
security
group
sezngs
• ELB
verJcal
scalability
for
concentrated
clients
– Too
few
proxy
IP
addresses
leads
to
hot
spots
• ELB
needs
support
for
balancing
heurisJcs
– ProporJonal
balance
across
Availability
Zones
– Weighted
Least
connecJons,
Weighted
Round
Robin
• Zone
aware
rouJng
– Default
to
instances
in
the
same
Availability
Zone
– Falls
back
to
cross-‐zone
on
failure
57. Discovery
• Discovery
Service
(Redundant
instances
per
zone)
– Simple
REST
interface
– Cloud
apps
register
with
Discovery
• Apps
send
heartbeats
every
30
sec
to
renew
lease
– App
evicted
a:er
3
missed
heartbeats
– Can
re-‐register
if
the
problem
was
transient
• Apps
can
store
custom
metadata
– Version
number,
AMI
id,
Availability
Zone,
etc.
• So:ware
Round-‐robin
Load
Balancer
– Query
Discovery
for
instances
of
specific
applicaJon
– Baked
into
Ne#lix
REST
client
(JSR311/Jersey
based)
AWS
Middle-‐)er
ELB
would
eliminate
most
use
cases
58. Database
MigraJon
• Why
SimpleDB?
– No
DBA’s
in
the
cloud,
Amazon
hosted
service
– Work
started
two
years
ago,
fewer
viable
opJons
– Worked
with
Amazon
to
speed
up
and
scale
SimpleDB
• AlternaJves?
– InvesJgaJng
adding
Cassandra
and
Membase
to
the
mix
– Need
several
opJons
to
match
use
cases
well
• Detailed
SimpleDB
Advice
– Sid
Anand
-‐
QConSF
Nov
5th
–
Ne#lix’
TransiJon
to
High
Availability
Storage
Systems
– Blog
-‐
h=p://pracJcalcloudcompuJng.com/
– Download
Paper
PDF
-‐
h=p://bit.ly/bhOTLu
59. Oracle
to
SimpleDB
(See
Sid’s
paper
for
details)
• SimpleDB
Domains
– De-‐normalize
mulJple
tables
into
a
single
domain
– Work
around
size
limits
(10GB
per
domain,
1KB
per
key)
– Shard
data
across
domains
to
scale
– Key
–
Use
distributed
sequence
generator,
GUID
or
natural
unique
key
such
as
customer-‐id
– Implement
a
schema
validator
to
catch
bad
a=ributes
• ApplicaJon
layer
support
– Do
GROUP
BY
and
JOIN
operaJons
in
the
applicaJon
– Compose
relaJons
in
the
applicaJon
layer
– Check
constraints
on
read,
and
repair
data
as
a
side
effect
• Do
without
triggers,
PL/SQL,
clock
operaJons
60. Tools
and
AutomaJon
• Developer
and
Build
Tools
– Jira,
Eclipse,
Hudson,
Ivy,
ArJfactory
– Builds,
creates
.war
file,
.rpm,
bakes
AMI
and
launches
• Custom
Ne#lix
ApplicaJon
Console
– AWS
Features
at
Enterprise
Scale
(hide
the
keys!)
– Auto
Scaler
Group
is
unit
of
deployment
to
producJon
• Open
Source
+
Support
– Apache,
Tomcat,
OpenJDK,
CentOS
• Monitoring
Tools
– Keynote
–
service
monitoring
and
alerJng
– AppDynamics
–
Developer
focus
for
cloud
– EpicNMS
–
flexible
data
collecJon
and
plots
h=p://epicnms.com
– Nimso:
NMS
–
ITOps
focus
for
Datacenter
+
Cloud
alerJng
65. Monitoring
Vision
• Problem
– Too
many
tools,
each
with
a
good
reason
to
exist
– Hard
to
get
an
integrated
view
of
a
problem
– Too
much
manual
work
building
dashboards
– Tools
are
not
discoverable,
views
are
not
filtered
• SoluJon
– Get
vendors
to
add
deep
linking
and
embedding
– IntegraJon
“portal”
Jes
everything
together
– Dynamic
portal
generaJon,
relevant
data,
all
tools
66. Cloud
Monitoring
Mechanisms
• Keynote
– External
URL
monitoring
• Amazon
CloudWatch
– Metrics
for
ELB
and
Instances
• AppDynamics
– End
to
end
transacJon
view
showing
resources
used
– Powerful
real
Jme
debug
tools
for
latency,
CPU
and
Memory
• Nimso:
NMS
– Scalable
and
reliable
monitoring
and
alerJng,
integraJon
portal
• Epic
– Flexible
and
easy
to
use
to
extend
and
embed
plots
• Logs
– High
capacity
logging
and
analysis
framework
– Hadoop
(log4j
-‐>
chukwa
-‐>
EMR)
67.
68. Snapshots
for
a
Business
TransacJon
Sort
Call
Graphs
to
Top,
pick
a
slow
one
69. Drill
in
to
Slow
Call
Slow
Asynchronous
S3
Write
–
no
big
deal…
71. Shadow
Traffic
RedirecJon
• Early
a=empt
to
send
traffic
to
cloud
– Real
traffic
stream
to
validate
cloud
back
end
– Uncovered
lots
of
process
and
tools
issues
– Uncovered
Service
latency
issues
• TV
Device
calls
Datacenter
API
– Returns
Genre/movie
list
for
a
customer
– Asynchronously
duplicates
request
to
cloud
– Start
with
send-‐and-‐forget
mode,
ignore
response
72. Shadow
Redirect
Instances
Modified
Datacenter
Datacenter
Service
Instances
Modified
Cloud
Cloud
Service
One
request
per
Instances
visit
Data
Sources
queueservice
videometadata
75. First
Page
• First
full
page
–
Starz
Channel
Genre
– Simplest
page,
no
sub-‐genres,
minimal
personalizaJon
– Lots
of
investment
in
new
Struts
based
page
design
– Uses
idenJty
cookie
to
lookup
in
member
info
svc
• New
“merchweb”
front
end
instance
– movies.ne#lix.com
points
to
merchweb
instance
• Uncovered
lots
of
latency
issues
– Used
memcached
to
hide
S3
and
SimpleDB
latency
– Improved
from
slower
to
faster
than
Datacenter
76. Starz
Page
Cloud
Instances
Front
End
merchweb
mulJple
requests
Middle
Tier
starz
memcached
per
visit
Data
Sources
queueservice
rentalhistory
videometadata
77. Controlled
Cloud
TransiJon
• WWW
calling
code
chooses
who
goes
to
cloud
– Filter
out
corner
cases,
send
percentage
of
users
– The
URL
that
customers
see
is
h=p://movies.ne#lix.com/WiContentPage?csid=1
– If
problem,
redirect
to
old
Datacenter
page
h=p://www.ne#lix.com/WiContentPage?csid=1
• Play
Bu=on
and
Star
RaJng
AcJon
redirect
– Point
URLs
for
acJons
that
create/modify
data
back
to
datacenter
to
start
with
79. Cloud
Developer
Setup
• Cloud
Boot
Camp
– Room
full
of
engineers
sharing
the
pain
for
1-‐2
days
– Built
a
very
rough
prototype
working
web
site
– Get
everyone
hands-‐on
in
the
cloud
with
a
new
code
base
– Debug
lots
of
tooling
and
conceptual
issues
very
fast
– Member
info
in
SimpleDB
with
developer’s
accounts
only
• Cloud
Specific
Key
Setup
– It’s
a
pain,
need
to
configure
your
IDE’s
JVM
– Needed
to
integrate
with
AWS
security
model
• Startup
Guide
Wiki
Pages
– What
object
facets
already
exist,
how
to
make
your
own
– What
components
already
exist
or
are
work
in
progress
80. Developer
Instances
Collision
Sam
and
Rex
both
want
to
deploy
web
front
end
for
development
Sam
Rex
web
in
test
account
81. Per-‐Service
Namespace
RouJng
Developers
choose
what
to
share
Sam
Rex
Mike
web-‐sam
web-‐rex
web-‐dev
backend-‐dev
backend-‐dev
backend-‐mike
82. Developer
Service
Namespaces
• Developer
specific
service
instances
– Configured
via
Java
properJes
at
runJme
– RouJng
implemented
by
REST
client
library
• Server
ConfiguraJon
– Configure
discovery
service
version
string
– Registers
as
<appname>-‐<namespace>
• Client
ConfiguraJon
– Route
traffic
on
per-‐service
basis
including
namespace
84. WWW
Page
by
Page
during
Q2/Q3/Q4
• Simplest
possible
page
first
– Minimal
dependencies
• Add
pages
as
dependent
services
come
online
• Home
page
–
most
complex
and
highest
traffic
• Leave
low
traffic
pages
for
later
cleanup
gradual
migraAon
from
Datacenter
pages
85. Big-‐Bang
TransiJon
• iPhone
Launch
(August/Sept)
– No
capacity
in
the
datacenter,
cloud
only
– App
Store
gates
release,
not
gradual,
can’t
back
out
– Market
is
huge
(exisJng
and
new
customers)
– Has
to
work
at
large
scale
on
day
one
• Datacenter
Shadow
Redirect
Technique
– Used
to
stress
back-‐end
and
data
sources
• SOASTA
Cloud
Based
Load
GeneraJon
– Used
to
stress
test
API
and
end-‐to-‐end
funcJonality
86. Current
Work
for
Cloud
Pla#orm
• Drive
latency
and
availability
goals
– More
Aggressive
caching
– Improving
Fault
and
latency
robustness
• Logging
and
monitoring
portal/dashboards
– Working
to
integrate
tools
and
data
sources
– Need
be=er
observability
and
automaJon
• EvaluaJng
a
range
of
NoSQL
choices
– Broad
set
of
use
cases,
no
single
winner
– Good
topic
for
another
talk…
88. Next
Few
Years…
• “System
of
Record”
moves
to
Cloud
– Master
copies
of
data
live
only
in
the
cloud,
with
backups
etc.
– Cut
the
datacenter
to
cloud
replicaJon
link
• InternaJonal
Expansion
–
Global
Clouds
– Rapid
deployments
to
new
markets
• GPU
Clouds
opJmized
for
video
encoding
• Cloud
StandardizaJon
– Cloud
features
and
APIs
should
be
a
commodity
not
a
differenJator
– DifferenJate
on
scale
and
quality
of
service
– CompeJJon
also
drives
cost
down
– Higher
resilience
– Higher
scalability
We
would
prefer
to
be
an
insignificant
customer
in
a
giant
cloud
89. Remember
the
Goals
Faster
Scalable
Available
ProducJve
Track
progress
against
these
goals
90. Takeaway
Ne9lix
is
path-‐finding
the
use
of
public
AWS
cloud
to
replace
in-‐house
IT
for
non-‐trivial
applicaAons
with
hundreds
of
developers
and
thousands
of
systems.
h=p://www.linkedin.com/in/adriancockcro:
@adrianco
#ne#lixcloud