Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Quality engineering in a world with AI and IoT

1,245 views

Published on

by Madhusudan Shekar, Principal Evangelist, Amazon at STeP-IN SUMMIT 2018 - 15th International Conference on Software Testing on August 30, 2018 at Taj, MG Road, Bengaluru

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Quality engineering in a world with AI and IoT

  1. 1. Aug. 30. 2018 Quality Engineering in an AI & IoT World Madhusudan Shekar Principal Technical Evangelist - Amazon @madhushekar23
  2. 2. Why are we here today?
  3. 3. OLD WORLD IT Employees at work Factories + supply chainSales channels Marketing analytics
  4. 4. Employees at work Factories + supply chainSales channels Marketing analytics OLD WORLD IT NEW WORLD IT
  5. 5. NEW WORLD IT Employees at work Factories + supply chain IoT connected things Online marketing Continuous supply tracking Just in time production Online sales + delivery Social media
  6. 6. Dimensionality • Functional • Performance • Context Sensitivity • User Experience • …
  7. 7. “Earth’s most customer-centric company”
  8. 8. “We see our customers as invited guests to a party, and we are the hosts. It’s our job every day to make every important aspect of the customer experience a little bit better.” Jeff Bezos
  9. 9. • Single-purpose Connected through APIs • Highly decoupled • “Microservices” • Circa 2009
  10. 10. DevOps Cycle… DevOps = efficiencies that speed up this lifecycle developers customers releasetestbuild plan monitor delivery pipeline feedback loop Software development lifecycle
  11. 11. Microservice development lifecycle developers delivery pipelinesservices releasetestbuild releasetestbuild releasetestbuild releasetestbuild releasetestbuild releasetestbuild
  12. 12. = 50 million deployments a year Thousands of teams × Microservice architecture × Continuous delivery × Multiple environments
  13. 13. Role Augmentation using ML & IoT • Code Analysis • Predict Failures • Instrument through Data • Observability • Statistical • GAN Networks
  14. 14. Disruption
  15. 15. Software – Everywhere…
  16. 16. Fire drills save lives in the event of a real fire, because people are trained how to react People Training
  17. 17. Infrastructure Switching Application People Who runs the “fire drill” ?
  18. 18. Infrastructure Switching Application People Chaos Engineering Team
  19. 19. Infrastructure Switching Application People Chaos Engineering Team
  20. 20. Infrastructure Switching Application People Tools Chaos Engineering Team
  21. 21. Infrastructure Switching Application People Chaos Engineering Team Game days Tools Simian Army chaostoolkit ChAP Gremlin
  22. 22. Infrastructure Switching Application People Tools Chaos Engineering Team Security Red Team
  23. 23. Infrastructure Switching Application People Tools Tools Chaos Engineering Team Security Red Team
  24. 24. Infrastructure Switching Application People Chaos Engineering Team Tools Security Red Team Safestack AVA Infection Monkey Chaosslingr AttackIQ Tools SafeBreach
  25. 25. Infrastructure Switching Application People Chaos Engineering Team Tools Security Red Team Tools Four layers Two teams An attitude— Break it to make it better Chaos Architecture
  26. 26. Break it to make it safer For more on the “New View” of Safety see: Todd Conklin’s Pre-accident podcast John Allspaw’s stella.report
  27. 27. Synoptic Illegibility You can’t write down exactly what really happens, so you can’t write a synopsis or run-book. System safety is an emergent property. The Safety Anarchist Sydney Decker
  28. 28. Failures are a system problem— lack of safety margin Not something with a root cause of component or human error
  29. 29. Blindfolded on a cliff edge, what would you do?
  30. 30. Hypothesis testing • We think we have safety margin in this dimension, let’s carefully test to be sure • In production • Without causing an issue
  31. 31. Dimensionality ++ • Mechanical • Electrical & Sensors • Life Cycle • Business Impact • Social Impact
  32. 32. “You can’t legislate against failure, focus on fast detection and response.” —Chris Pinkham
  33. 33. Thank you!! There’s Never Been A Better Time @madhushekar23

×