Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Mohit Gupta, Technical Product Manager, Infrastr...
Clever is the platform that
powers technology in the
classroom for simple, powerful,
and highly secure solutions for
stude...
Our deployment
workflows
Design of new
engineering tools
at Clever
How we got to
here?
Where are we
going next?
Clever Eng...
>50% of US schools use Clever.
A deployment affects
millions of students.
Our Deployment Workflows
Clever Eng
A week in deployments
● launched 112000 containers
● 100 unique applications
● with 500 deployments
● in 20 environments
●...
GitHub
Source control and code
reviews
CircleCI
Tests, builds, and static
analysis
Amazon ECR and
DockerHub
Container regi...
Ark and Catapult
CLI and REST API to
manage deployments and
development environments.
Dapple
SlackBot and Pipelines
trigge...
Amazon
CloudFormation
Configuration management
for applications
Amazon ECS
Container orchestration
Elastic Load Balancing
...
Rollovers Canaries
Rollbacks Feature flags
Deployments in production
Our Deployment Workflows
Rollovers
On-demand environmentsRollbacks
Deployments in development
Our Deployment Workflows
Canaries
Our deployment
workflows
Owning
interactions
How we got to
here?
Where are we
going next?
Clever Eng Stories Control Plane...
~10% of engineers at Clever
build tools to improve
engineering effectiveness.
Stories of how we got to here?
Stories
Bikeshedding*
running containers locally or not
* futile investment of time and energy in discussion of marginal technical...
it started small…...
Stories: or how we got to here?
Owning Interactions
"If my code runs in
production, then I
shouldn't have to
change it for you to run
it locally"
Owning Interactions
“more important to have
dev stability than
production velocity”
“resiliency, stability,
safety!!!!”
“w...
Clever eng was struggling with…
Configuration
Are all the right variables set for local development in all
dependencies?
D...
We took a deep breath
Clever eng was…
Expecting a more opinionated product
To truly exercise the freedom of choosing the best tool for the
job, ...
arka tool for non-production deploys
that could be good enough to eventually use in production
Stories: or how we got to h...
On-demand environments on Amazon ECS
eng1-env schema-change-replays ux-change-review
Applications: What do they mean?
* okay maybe this is also a story about me bikeshedding
demo
Stories: or how we got to here?
understanding applications has good side effects
Stories: or how we got to here?
Stories: or how we got to here?
Our deployment
workflows
Owning
interactions
How we got to
here?
Where are we
going next?
Clever Eng Stories Control Plane...
highlight your quirks
--full-resources is not allowed with rollbacks in production. This time machine is paradox safe.
Outsource complexity when possible
Owning Interactions.
Owning Interactions
Start with thin wrappers
find your defaults
spend time on training and documentation
Owning Interactions
Our deployment
workflows
Owning
interactions
How we got to
here?
Where are we
going next?
Clever Eng Stories Control Plane...
What next?
Move from AWS CloudFormation to Amazon ECS APIs for custom deployment types
A R K
What next?
Automation and chat-based deployments
What next?
AWS Batch
Workflow support using AWS Batch
Thank you!
mohit@clever.com
 Container Soup for Your Soul: The Microservice Edition, Building Deployment Tools to Align with your Engineering Culture ...
Upcoming SlideShare
Loading in …5
×

Container Soup for Your Soul: The Microservice Edition, Building Deployment Tools to Align with your Engineering Culture | AWS Public Sector Summit 2017

196 views

Published on

The talk is the story of a Clever's journey to effectively use a container orchestration system (ECS) and a walk through decisions to create a simple and effective deployment pipeline. We will go through various aspects of building application deployment pipelines for microservices. Clever is an education technology company and we do hundreds of deployments of tens of thousands of containers every week to serve over 50% of K-12 public and private school districts in the US. Learn More: https://aws.amazon.com/government-education/

Published in: Technology
  • Shared it, also...GROW YOU DOWNLINE OVERNIGHT - Works with any mlm. Have dozens joining whatever mlm your doing today! Go to: www.mlmrc.com
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • credit to https://github.com/gengo/goship for the Gopher image and the Pony is a stock image with us adding the Dapple.
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Be the first to like this

Container Soup for Your Soul: The Microservice Edition, Building Deployment Tools to Align with your Engineering Culture | AWS Public Sector Summit 2017

  1. 1. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Mohit Gupta, Technical Product Manager, Infrastructure, Clever Inc. June 14, 2017 Container Soup for Your Soul The Microservice Edition Building Deployment Tools to Align with Your Engineering Culture
  2. 2. Clever is the platform that powers technology in the classroom for simple, powerful, and highly secure solutions for student data transfer and single sign-on. Infrastructure at Clever
  3. 3. Our deployment workflows Design of new engineering tools at Clever How we got to here? Where are we going next? Clever Eng Stories Control Planes Next Steps What to expect? Containers with Culture.
  4. 4. >50% of US schools use Clever. A deployment affects millions of students. Our Deployment Workflows Clever Eng
  5. 5. A week in deployments ● launched 112000 containers ● 100 unique applications ● with 500 deployments ● in 20 environments ● on average six minutes from master to production ● with very little muss, and even less fuss 38 engineers Our Deployment Workflows
  6. 6. GitHub Source control and code reviews CircleCI Tests, builds, and static analysis Amazon ECR and DockerHub Container registries Source control, test and build Our Deployment Workflows
  7. 7. Ark and Catapult CLI and REST API to manage deployments and development environments. Dapple SlackBot and Pipelines triggered by CI for automated deployments. Deployment tooling Our Deployment Workflows
  8. 8. Amazon CloudFormation Configuration management for applications Amazon ECS Container orchestration Elastic Load Balancing Application Load Balancers and Classic Load Balancers Configuration management, orchestration and load balancing Our Deployment Workflows
  9. 9. Rollovers Canaries Rollbacks Feature flags Deployments in production Our Deployment Workflows
  10. 10. Rollovers On-demand environmentsRollbacks Deployments in development Our Deployment Workflows Canaries
  11. 11. Our deployment workflows Owning interactions How we got to here? Where are we going next? Clever Eng Stories Control Planes Next Steps Stories Containers with Culture.
  12. 12. ~10% of engineers at Clever build tools to improve engineering effectiveness. Stories of how we got to here? Stories
  13. 13. Bikeshedding* running containers locally or not * futile investment of time and energy in discussion of marginal technical issues
  14. 14. it started small…... Stories: or how we got to here?
  15. 15. Owning Interactions "If my code runs in production, then I shouldn't have to change it for you to run it locally"
  16. 16. Owning Interactions “more important to have dev stability than production velocity” “resiliency, stability, safety!!!!” “well-thought-out systems don’t have such problems”
  17. 17. Clever eng was struggling with… Configuration Are all the right variables set for local development in all dependencies? Dependency Are these all the dependencies required? Visibility Where are the logs for my dependency that is failing? Stories: or how we got to here?
  18. 18. We took a deep breath
  19. 19. Clever eng was… Expecting a more opinionated product To truly exercise the freedom of choosing the best tool for the job, we wanted better defaults and easier bootstrapping Demanding automation They were automating configuration and syncs for their users and were expecting the same of tooling at Clever Focusing on user needs Keeping dependencies updated, and supporting different local settings was taking away from our focus on users Stories: or how we got to here?
  20. 20. arka tool for non-production deploys that could be good enough to eventually use in production Stories: or how we got to here?
  21. 21. On-demand environments on Amazon ECS eng1-env schema-change-replays ux-change-review
  22. 22. Applications: What do they mean? * okay maybe this is also a story about me bikeshedding
  23. 23. demo
  24. 24. Stories: or how we got to here?
  25. 25. understanding applications has good side effects Stories: or how we got to here?
  26. 26. Stories: or how we got to here?
  27. 27. Our deployment workflows Owning interactions How we got to here? Where are we going next? Clever Eng Stories Control Planes Next Steps Control Planes Containers with Culture.
  28. 28. highlight your quirks --full-resources is not allowed with rollbacks in production. This time machine is paradox safe.
  29. 29. Outsource complexity when possible Owning Interactions.
  30. 30. Owning Interactions Start with thin wrappers
  31. 31. find your defaults spend time on training and documentation Owning Interactions
  32. 32. Our deployment workflows Owning interactions How we got to here? Where are we going next? Clever Eng Stories Control Planes Next Steps Stories Containers with Culture.
  33. 33. What next? Move from AWS CloudFormation to Amazon ECS APIs for custom deployment types A R K
  34. 34. What next? Automation and chat-based deployments
  35. 35. What next? AWS Batch Workflow support using AWS Batch
  36. 36. Thank you! mohit@clever.com

×