Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

A culture of rapid innovation with DevOps, microservices, & serverless - MAD201 - Santa Clara AWS Summit.pdf

333 views

Published on

Join David Richardson, VP of Serverless, and learn how you can apply DevOps, microservices, and serverless to innovate faster at scale. Discover how we got to over sixty million deployments per year, and benefit from the lessons we learned while building modern apps for Amazon. We cover the transition from a monolithic application to event-driven serverless microservices and dive into the reasons why more and more customers choose the serverless operational model. We describe how this works in practice by leveraging AWS Lambda, AWS Step Functions, AWS Fargate, Amazon API Gateway, Amazon SNS, Amazon SQS, and the entire serverless portfolio.

  • Be the first to comment

A culture of rapid innovation with DevOps, microservices, & serverless - MAD201 - Santa Clara AWS Summit.pdf

  1. 1. S U M M I T SA NTA CLA R A
  2. 2. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T A culture of rapid innovation with DevOps, microservices, & serverless Deepak Singh Director, Containers and Linux Amazon Web Services M A D 2 0 1
  3. 3. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T “We want to be a large company that’s also an invention machine. We want to combine the extraordinary customer-serving capabilitiesthat are enabled by size with the speed of movement, nimbleness, and risk-acceptance mentality normally associated with entrepreneurial start-ups.” Jeff Bezos CEO, Amazon
  4. 4. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T ListenIterate Experiment Innovation flywheel Experiments power the engine of rapid innovation
  5. 5. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T Development transformation at Amazon: 2001–2002 Monolithic application + teams 2001 Lesson learned: Decompose for agility 2002 Microservices + 2 pizza teams
  6. 6. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T Culture Team design Architecture patterns Powerful infrastructure Innovation
  7. 7. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T Customer obsession Bias for action Highest standards Think big Have backbone: disagree & com Culture
  8. 8. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T Full ownership Full accountability DevOps Focused innovation Two-pizza teams
  9. 9. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T Deployment at scale 1000s of teams Micro- services CI/CD Serverless >60 million deployments a year*
  10. 10. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T New services and features released per year 0 500 1000 1500 2000 2500 2011 2012 2013 2014 2015 2016 2017 2018
  11. 11. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T What technical changes have to be made in this new world? Architectural patterns Operational model Software delivery
  12. 12. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T Changes to the architectural patterns
  13. 13. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T When the impact of change is small, release velocity can increase Monolith Does everything Microservices Does one thing
  14. 14. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T When a small team can make a change, release velocity can increase Multipleteams Loosely connected One team Focus and ownership
  15. 15. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T Microservice API API Microservice Microservice Event API Microservice Event API Microservice Application Mobile client Client IoT Persistence Persistence
  16. 16. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T APIs are the front door of microservices
  17. 17. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T APIs are the “hardened contract” between teams
  18. 18. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T Manage APIs with Amazon API Gateway Mobile apps Websites Services Internet Amazon CloudFront Amazon CloudWatch monitoring API Gateway cache Any other AWS service All publicly accessible endpoints AWS Lambda functions Endpoints in your VPC Regional API endpoints AWS Lambda functions Endpoints on Amazon EC2 Your VPCAWS
  19. 19. innovates on
  20. 20. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T Event-driven architectures
  21. 21. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T Decouple state from code using messaging
  22. 22. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T Decouple state from code using messaging Queues Simple Fully managed Any volume Pub/sub Simple Fully managed Flexible Amazon Simple Queue Service Amazon Simple Notification Service Messaging Synchronization Rapid Fully managed Real time Amazon CloudWatch Events
  23. 23. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T Microservice Event Event Microservice Microservice Event API Microservice Event API Microservice Application Mobile client Client IoT Persistence Persistence Queue Topic
  24. 24. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T AmazonSNS “CheckoutEventsTopic” Event storage & backup pipeline Event search & analytics pipeline Event replay pipeline Checkout event processing pipeline filtered orders(amount>=$100) Ordersto replay All orders AWS Cloud Ecommerce users Internet AWSLambda “CheckoutFunction” AmazonSQS “CheckoutQueue” AWSLambda “CheckoutFunction” AmazonDynamoDB “CheckoutTable” Event-driven architecture
  25. 25. innovates on
  26. 26. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T And data streams Ingest Data streams Data processing Real time Data store Microservices Performance at scale Fast and flexible Amazon Kinesis Data Streams Amazon Dynamo DB Data stream capture
  27. 27. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T Track status of data and execution Remove redundant code Build workflows to orchestrate everything
  28. 28. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T Simpler integration, less code With serverless polling With new service integration Start End AWS Lambda functions Start End No Lambda functions
  29. 29. innovates on
  30. 30. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T Cloud-native architectures are small pieces, loosely joined
  31. 31. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T Changes to the operational model
  32. 32. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T AWS operational responsibility models On premises Cloud Less More Compute Virtual machine EC2 Elastic Beanstalk AWS LambdaFargate Databases MySQL MySQL on EC2 RDS MySQL RDS Aurora Aurora Serverless DynamoDB Storage Storage S3 Messaging ESBs Amazon MQ Kinesis SQS / SNS Analytics Hadoop Hadoop on EC2 EMR Amazon Elasticsearch Service Athena
  33. 33. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T What is serverless? No infrastructure management Automatic scaling Pay for value Highly available and secure
  34. 34. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T AWS Lambda AWS Fargate Amazon API Gateway Amazon SNS Amazon SQS AWS Step Functions COMPUTE DATA STORES INTEGRATION Amazon Aurora Serverless Amazon S3 Amazon DynamoDB AWS AppSync
  35. 35. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T Serverless compute engine for containers Long-running Bring existing code Fully managed orchestration AWS Fargate Let’s focus on compute for now Serverless event-driven code execution Short-lived All language runtimes Data source integrations AWS Lambda
  36. 36. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T Comparison of operational responsibility AWS Lambda Serverless functions AWS Fargate Serverless containers ECS/EKS Container-management as a service EC2 Infrastructure-as-a-service More opinionated Less opinionated AWS manages Customer manages • Data sourceintegrations • Physicalhardware, software, networking, and facilities • Provisioning • Application code • Container orchestration, provisioning • Cluster scaling • Physicalhardware, hostOS/kernel, networking, and facilities • Application code • Data sourceintegrations • Security config and updates, network config, management tasks • Container orchestration controlplane • Physicalhardwaresoftware, networking, and facilities • Application code • Data sourceintegrations • Work clusters • Security config and updates, network config, firewall, management tasks • Physicalhardwaresoftware, networking, and facilities • Application code • Data sourceintegrations • Scaling • Security config and updates, network config, management tasks • Provisioning, managing scaling and patching of servers
  37. 37. innovates on
  38. 38. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T Making development easier with AWS Lambda Accessible for all developers Enable new application patterns Greater productivity Support for all runtimes with Lambda Layers and Runtime API ISO, PCI, HIPAA, SOC, GDPR, and FedRamp compliances 15 minute functions SQS for Lambda Automatic load balancing for Lambda Support for Kinesis Data Streams Enhanced Fan-Out and HTTP/2 Toolkits for popular IDEs: VSCode, IntelliJ, and PyCharm Simplified deployment with nested apps
  39. 39. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T Lambda Layers & Custom Runtimes Lambda Layers Custom Runtimes Bring any Linux compatible language runtime Lets functions easily share code: Upload layer once, reference within any function
  40. 40. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T Community Lambda Layers UtilitiesCustom Runtimes C++ Rust Erlang Bash Node.js v10, v11 PHP 7.1, 7.2, 7.3 Pypy 3.5 Haskell AWS CLI Ffmpeg Git + SSH Kubectl MySQL + PHP SoX Tesseract Pandoc Monitoring PureSec Protego Security Datadog Epsagon IOpipe Thundra
  41. 41. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T Serverless containers with AWS Fargate Bring existing code Containers as first-class primitive Production ready No changes required of existing code, works with existing workflows and microservices built on Amazon ECS Time and event-based scheduling, network integration, individually metered, and billed. Native service discovery ISO, PCI, HIPAA, SOC compliant. Launch tens or tens of thousands of containers in seconds in 9 global regions (+7 in 2018)
  42. 42. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T Consistent microservice communications Observability & traffic control Container orchestration compatibility Fully managed AWS App Mesh Application-level networkingfor all your resources - Now generally available
  43. 43. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T AWS X-Ray is built for modern applications Identify customer impact Support for serverlessMap all services and ephemeral resources Follow end to end interactions
  44. 44. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T Object storage Durable and scalable Comprehensive security Query-in-place AWS serverless storage and database options Non-relational Performance at scale Fully managed Enterprise-ready Relational Fully managed High performance Cost effective
  45. 45. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T Changes to the delivery of software
  46. 46. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T Monolith development lifecycle MonitorReleaseTestBuild Developers Delivery pipelines Services
  47. 47. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T Microservice development lifecycle Developers Services MonitorReleaseTestBuild Delivery pipelines MonitorReleaseTestBuild MonitorReleaseTestBuild MonitorReleaseTestBuild MonitorReleaseTestBuild MonitorReleaseTestBuild
  48. 48. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T How Amazon does DevOps (microservices, 2 pizza teams) (governance, templates)
  49. 49. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T We Released the AWS Developer Tools for CI/CD AWS CodeBuild + third party AWS CodeCommit AWS CodeBuild AWS CodeDeploy AWS X-Ray Source Build Test Deploy Monitor AWS CodePipeline
  50. 50. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T AWS Developer Tools have been purpose built to support serverless microservices Support for Lambda deploymentwith CodePiplineand AWS CloudFormation Support for rolling and blue/green Lambda deployments with AWS CodeDeploy Support for Fargate and Amazon ECS deploymentsin AWS CodePipeline CodePipeline supports AWS Config for improved governance CodePipeline supports Amazon ECR as a source Support for serverless python apps in AWS Toolkitfor PyCharm Support for blue/green deployments for Fargate and ECS with CodeDeploy 2016 20182017 NOV NOV DEC OCT NOV NOV
  51. 51. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T Author and debug Lambda applications on AWS using your favorite IDEs Python, Node Python Java Developer preview .NET, Node **New today**
  52. 52. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T Developer previewAWS Cloud Development Kit CDK application AWS CloudFormation template Stack(s) Construct Construct Resources AWS CloudFormation Amazon SQS AWS Lambda Amazon S3 bucket Amazon DynamoDB
  53. 53. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T Application models simplify building serverless and containerized applications
  54. 54. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T Application models simplify building serverless and containerized applications
  55. 55. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T Conclusion
  56. 56. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T Increase customer value Build better products Innovate more often Release features faster Focus on business logic Decouple software systems Our goal is to automate and abstract away as much as is possible so customers can focus on building applications for their business We are witnessing a paradigm shift
  57. 57. © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.S UM M I T Comparison of operational responsibility AWS Lambda Serverless functions AWS Fargate Serverless containers ECS/EKS Container-management as a service EC2 Infrastructure-as-a-service More opinionated Less opinionated AWS manages Customer manages • Data sourceintegrations • Physicalhardware, software, networking, and facilities • Provisioning • Application code • Container orchestration, provisioning • Cluster scaling • Physicalhardware, hostOS/kernel, networking, and facilities • Application code • Data sourceintegrations • Security config and updates, network config, management tasks • Container orchestration controlplane • Physicalhardwaresoftware, networking, and facilities • Application code • Data sourceintegrations • Work clusters • Security config and updates, network config, firewall, management tasks • Physicalhardwaresoftware, networking, and facilities • Application code • Data sourceintegrations • Scaling • Security config and updates, network config, management tasks • Provisioning, managing scaling and patching of servers
  58. 58. Thank you! S UM M I T © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved. Deepak Singh deesingh@ @mndoci
  59. 59. S UM M I T © 2019, Amazon Web Services, Inc. orits affiliates. All rights reserved.

×