Moving to DevOps the Amazon Way
•Download as PPTX, PDF•
1 like•483 views
DevOps is currently one of the most sought after engineering models. One reason is that it helps enterprise transformations. The Amazon transformation to DevOps was born out of the desire to be even more customer obsessed, more agile, and more innovative. Come and learn from our journey as we share the playbook that helped us successfully implement and adopt DevOps as well as the lessons we learned the hard way.
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Moving to DevOps the Amazon Way
Similar to Moving to DevOps the Amazon Way (20)
More from Amazon Web Services
More from Amazon Web Services (20)
Moving to DevOps the Amazon Way
- 1. P U B L I C S E C T O R S U M M I T B russels
- 2. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T Moving to DevOps theAmazonWay Mario Vlachakis Solutions Architect – Public Sector UK Central and National Security D E V 2 1 0 - R
- 3. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T https://secure.flickr.com/photos/mgifford/4525333972 Why are we here today?
- 4. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T
- 5. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T Reduce the cost of supporting current technology TwobiggoalsforITtoday Lead innovation and transformation of business
- 6. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T Whatweallarereallytryingto achieve… Infrastructure Support Innovation Infrastructure Support Innovation Innovation Support ✅
- 7. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T
- 8. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T
- 9. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T
- 10. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T Organizational mindset alignment, engineering enablement, and builder empowerment Cultural Philosoph y Practices and Patterns Tools
- 11. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T
- 12. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T DevOps Practices • Microservices architecture • Moving away from large “monolithic” architectures to smaller decoupled services
- 13. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T DevOps Practices • Continuous Integration • Continuous Delivery & Deployment
- 14. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T DevOps Practices • Infrastructure as Code • Model your AWS resources using code
- 15. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T DevOps Practices • Monitoring and Logging • Track and analyze metrics and logs • Understand real-time performance of infrastructure and application
- 16. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T DevOps Practices • Communication and Collaboration • Information sharing • Wikis • Issue and project trackers
- 17. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T
- 18. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T BenefitsofDevOps Improved Collaboration
- 19. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T BenefitsofDevOps Improved Collaboration Rapid Delivery
- 20. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T BenefitsofDevOps Improved Collaboration Rapid Delivery Reliability
- 21. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T BenefitsofDevOps Improved Collaboration Rapid Delivery Reliability Security
- 22. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T BenefitsofDevOps Improved Collaboration Rapid Delivery Reliability Security Scale
- 23. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T BenefitsofDevOps Improved Collaboration Rapid Delivery Reliability Security Scale Speed
- 24. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T 30xMore frequent deployments 440xShorter lead times 60xFewer failures -21%Unplanned rework 44%New work Source: Puppet State of DevOps Report 2017
- 25. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T AWSpaceofinnovation 1957 new features/services launched in 2018 As of April 2019 AWS has been continually expanding its services to support virtually any cloud workload 80 160 280 516 722 1017 1430 1957 0 500 1000 1500 2000 2500 2011 2012 2013 2014 2015 2016 2017 2018 AWS Launches
- 26. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T
- 27. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T = Millions of deployments a year Thousands of teams × Microservice architecture × Continuous delivery × Multiple environments Several types of deployments
- 28. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T
- 29. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T
- 30. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T Monolith development lifecycle ReleaseTestBuild Developers Services Delivery pipeline
- 31. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T Our Needthenbecame Becomeagileagain?
- 32. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T Identify and break processes into fine-grained units Shipping Labeling Cart Checkout Stock Search Listing Assign those units to small teams
- 33. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T Process: Store products into slots Microservice (Software) Builds Uses Dev Team Now, let each team operate as a start-up Outcome: Customer obsession, ownership, freedom to innovate, agility
- 34. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T 3 5 Optimized flow by dedicating single-threaded teams Dedicated product teams ProductDevelopment ProductGo-ToMarket ProductManagers ProjectManagers Developers Testers Implementers Operations&Support Product Team B Product Team A Product Team C Backlog A • Story 1 • Story 2 • Story 3 • Story 4 Backlog A • Story 1 • Story 2 • Story 3 • Story 4 Backlog A • Story 1 • Story 2 • Story 3 • Story 4
- 35. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T Example of scrum roles Scrum master, developers, product owner Teams adopted agile methodologies Example of scrum board
- 36. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T “Silos” got discouraged in the organization Operations Database team Quality assurance Application security Software dev team “We’re blocked waiting the Dev environment setup” “We’re blocked waiting a new table/SQL script” “We’re blocked waiting performance tests” ”We’re blocked waiting source code manual inspection” ”We’re blocked waiting database security approvals” ”We’re blocked waiting security tests to complete” ”We’re blocked waiting the creation of security certificates” “We’re blocked waiting the setup of the database hosts” “We’re blocked waiting new test hosts”
- 37. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T Teams learned to work together (DevOps) Operations Database Administrator Quality Assurance (Testers) Application Security Software Dev Team “Working together”
- 38. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T Our 2-Pizza Teams learned to do these • Write application and infrastructure code • Review code of others • Write unit/integration/performance tests • Create SQL queries • Create and automate CI/CD pipelines • Provision test and production hosts • Use secure APIs and apply security policies • Monitor production environments • Be on-call on a rotation-basis
- 39. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T We built “guardrails”
- 40. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T We invested in sharing the learnings, patterns, and practices
- 41. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T AWSNativeServices Cloud Mgmt. AWS Service Catalog AWS CloudTrail AWS Config AWS Trusted Advisor AWS X-Ray AWS OpsWorks Amazon CloudWatch AWS CloudFormation AWSSnowball AWSSMS AWS Systems Manager AWSKMS IAM AWSDMS Amazon Inspector Amazon Macie Amazon GuardDuty Service request Inventory and classification Monitoring and analytics Packaging and delivery* Provisioning and orchestration Cost management and resource optimization Cloud migration, backup, and DR Identity, security, and compliance AWSConfigAWSCodeDeploy AWSCodeCommit AWSCodePipeline AWSCodeBuild * Not part of Gartner representation Source: Gartner Evaluation Criteria for Cloud Management Platforms and Tools May 2018§
- 42. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T
- 43. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T Lessons Learned 1. Ent-wide inclusiveness 2. Use belts and suspenders 3. Patterns of efficiency 4. Implement resilience testing 5. Implement observability
- 44. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T Where do you ?
- 45. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T DevOps is an ongoing journey, not a destination
- 46. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T We did it, you too can !
- 47. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T BeyondTechnology BusinessCapabilityFocused Business Value Realization People Roles and Readiness Governance Prioritization and Control TechnicalCapabilityFocused Platform Applications and Infrastructure Security Risk and Compliance Operations Hybrid and Dynamic DevOps is firstly about changing the IT Culture and finally about technology.
- 48. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T AWSCodeServices AWS CodePipeline AWS CodeCommit AWS CodeBuildAWS CodeDeployAWS CodeStar
- 49. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T Source Build Test Deploy Third Party Tooling AWS CodeCommit AWS CodeBuild AWS CodeDeploy AWS CodePipeline AWSCodeServices
- 50. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T AWSCodeServices Source Build Test Deploy Third Party Tooling AWS CodeCommit AWS CodeBuild AWS CodeDeploy AWS CodePipeline AWS CodeStar
- 51. Thank you! © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T Mario Vlachakis mariovl@amazon.co.uk
- 52. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C TO R S U M M I T
Editor's Notes
- https://secure.flickr.com/photos/mgifford/4525333972 "What is DevOps and why?” Amazon's own transformation and how by using DevOps we became more agile with our product delivery AWS services that’ can assist customer with their DevOps transformation If times allows a small demo You should walk away with a high level understanding of the different parts involved with a DevOps transformation, and an idea of how AWS services in your own DevOps processes Please note this is a level 200 – Entry level discussion about DevOps and how it helped Amazon
- DevOps is about removing the barriers Improve both the productivity of developers and the reliability of operations. By communicating and owning the overall product the team can improve the quality of services they provide to customers Quality assurance and security teams may also become tightly integrated with these teams In some organizations, there may not even be separate development and operations teams; but just a team! DevOps is the combination of cultural philosophies, practices, and tools that increases an organization’s ability to deliver applications and services at high velocity: evolving and improving products at a faster pace than organizations using traditional software development and infrastructure management processes. This speed enables organizations to better serve their customers and compete more effectively in the market.
- DevOps is about removing the barriers Improve both the productivity of developers and the reliability of operations. By communicating and owning the overall product the team can improve the quality of services they provide to customers Quality assurance and security teams may also become tightly integrated with these teams In some organizations, there may not even be separate development and operations teams; but just a team! DevOps is the combination of cultural philosophies, practices, and tools that increases an organization’s ability to deliver applications and services at high velocity: evolving and improving products at a faster pace than organizations using traditional software development and infrastructure management processes. This speed enables organizations to better serve their customers and compete more effectively in the market.
- Organizations might also use a microservices architecture to make their applications more flexible and enable quicker innovation. The microservices architecture decouples large, complex systems into simple, independent projects. Applications are broken into many individual components (services) with each service scoped to a single purpose or function and operated independently of its peer services and the application as a whole. By deploying microservices you can perform frequent but small updates. And by doing so you innovate faster for your customers. Frequent but small updates make each deployment less risky as it is easier to address bugs and identify issues
- However, the combination of microservices and increased release frequency leads to significantly more deployments which can present operational challenges. Thus, DevOps practices like continuous integration and continuous delivery solve these issues and let organizations deliver rapidly in a safe and reliable manner. The current slide demonstrates the overall Devops pipeline
- Infrastructure automation practices, like infrastructure as code and configuration management, help to keep computing resources elastic and responsive to frequent changes. By using Infrastructure as Code companies can achieve : Cost (reduction), Speed (faster execution) Risk (remove errors and security violations) Cost reduction aims at helping not only the enterprise financially but also in terms of people and effort, meaning that by removing the manual component, people are able to refocus their efforts towards other enterprise tasks Infrastructure automation enables speed through faster execution when configuring your infrastructure Automation removes the risk associated with human error, like manual misconfiguration; removing this can decrease downtime and increase reliability
- Active monitoring becomes increasingly important as services must be available 24/7 and as application and infrastructure update frequency increases. By using API driven approach and creating alerts or performing real-time analysis of this data also helps organizations more proactively monitor their services. This is what we call feedback loop. Lets talk summarize the DevOps benefits
- Communication and Collaboration Increased communication and collaboration in an organization is one of the key cultural aspects of DevOps. The use of DevOps tooling and automation of the software delivery process establishes collaboration by physically bringing together the workflows and responsibilities of development and operations. Building on top of that, these teams set strong cultural norms around information sharing and facilitating communication through the use of chat applications, issue or project tracking systems, and wikis. This helps speed up communication across developers, operations, and even other teams like marketing or sales, allowing all parts of the organization to align more closely on goals and projects.
- More effective teams that share the same ownership and accountability for the benefits of the customer Improved collaborate ,which reduces inefficiencies and saves time
- Rapid delivery of releases so you can innovate and improve your product faster. The quicker you can release new features and fix bugs, the faster you can respond to your customers’ needs and build competitive advantage.
- Practices like continuous integration and continuous delivery to test that each change is functional and safe. Monitoring and logging practices help you stay informed of performance in real-time.
- You can adopt a DevOps model without sacrificing security in matter of fact you can dramatically improve it. By using automated compliance policies, fine-grained controls, configuration management techniques. You can move quickly while retaining control and preserving compliance. by For example, using infrastructure as code and policy as code, you can define and then track compliance at scale.
- Operate and manage your infrastructure and development processes at scale. Automation and consistency help you manage complex or changing systems efficiently and with reduced risk. For example, infrastructure as code helps you manage your development, testing, and production environments in a repeatable and more efficient manner.
- Move at high velocity so you can innovate for customers faster, adapt to changing markets better, and grow more efficient at driving business results. The DevOps model enables your developers and operations teams to achieve these results. For example, microservices and continuous delivery let teams take ownership of services and then release updates to them quicker.
- https://www.flickr.com/photos/stevendepolo/5749192025/ - after we tell customers the story of our DevOps transformation, they typically ask us how they can do the same - I'm not going to over-simplify this, because it is a very complex answer - this can involve organizational changes, cultural changes, and process changes - plus there's no one right answer for these - every company is going to tweak their approach to optimize for their own environment - but there is one standard thing that every DevOps transformation needs, and that's an efficient and reliable continuous delivery pipeline
- Transition to a DevOps operating model mainly depends on tools and principles. However, DevOps is all about changing the enterprise IT culture rather than just tools and processes. DevOps culture is all about removing the barriers and getting the whole team at one place, which further, improves the work efficiency. Everybody in the company (Not just IT) must understand the importance and competitive advantages of becoming agile can bring to a business. I will now hand over to Andrew to talk more about the AWS tools that can help become more agile and hopefully I have allowed him time for a small demo