Quality assurance in distributed continuous delivery

2,154 views

Published on

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
2,154
On SlideShare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
28
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Quality assurance in distributed continuous delivery

  1. 1. Quality Assurance in Distributed Continuous Delivery By Jin Ming|@金明i Continuous Delivery Lead, ThoughtWorksWednesday, August 8, 12
  2. 2. Text Background: Top One Property Listing Site in OZWednesday, August 8, 12
  3. 3. Business Overview Seller Consumer AgencyWednesday, August 8, 12
  4. 4. Architecture OverviewWednesday, August 8, 12
  5. 5. How to Do QA?Wednesday, August 8, 12
  6. 6. Quality is Value to Some Person. ---Gerald WeinbergWednesday, August 8, 12
  7. 7. Challenges We’re FacingWednesday, August 8, 12
  8. 8. Legacy SystemsWednesday, August 8, 12
  9. 9. Cross SystemsWednesday, August 8, 12
  10. 10. Distributed DevelopmentWednesday, August 8, 12
  11. 11. Also, We Want to BeWednesday, August 8, 12
  12. 12. Wednesday, August 8, 12
  13. 13. We Need “Total Quality”Wednesday, August 8, 12
  14. 14. Test Quadrants Automat Business Facing ed Manual & Manual Functional Tests Exploratory Testing Examples Scenarios Story Tests Usability Testing Prototypes UAT(User Acceptance Testing) Simulations Alpha / Beta ... ... Q2 Q3 Critique Supporting Team Q1 Q4 Product Unit Tests Performance & Load Testing Component Tests Security Testing ... ... Automat Tools ed Technology FacingWednesday, August 8, 12
  15. 15. Functional Test BoundariesWednesday, August 8, 12
  16. 16. We Need to Ensure End-to-EndWednesday, August 8, 12
  17. 17. We Need to Ensure Single SystemWednesday, August 8, 12
  18. 18. Units Inside Single SystemWednesday, August 8, 12
  19. 19. Automatic Those TestsWednesday, August 8, 12
  20. 20. Test Pyramid Efficiency Scope Cost End-to-End Test End-User Simulation System Test Scope End-User Unit Test Efficiency Simulation CostWednesday, August 8, 12
  21. 21. Capybara Functional Test Samples Selenium WebDriverWednesday, August 8, 12
  22. 22. Performance Test SamplesWednesday, August 8, 12
  23. 23. Deployment ValidationWednesday, August 8, 12
  24. 24. Test PlanWednesday, August 8, 12
  25. 25. Vision & High- Level Stories $ Iteration $ Release $ $ Test Plan Release Test Plan Iteration Test Plan Daily Test PlanWednesday, August 8, 12
  26. 26. Iterations Stabilize (opt) I0 I1 I2 I3 I4 … In Pre-production Production Acceptance Exploratory, UAT PVT Test Analysis Testing Automation I1 I1 I1 iIities operations &Compliance Acceptance Exploratory, Test Analysis Testing Automation Data I2 I2 I2 Migration Deployment Acceptance Exploratory, Test Analysis Testing Automation I3 I3 I3 Full Regression Test Automated Regression Test Integration End-To-End Integration End-To-End Test Test Test Test Performance Profiling Test Load/Stress Load/StressWednesday, August 8, 12
  27. 27. Good Enough?Wednesday, August 8, 12
  28. 28. It’s Just Validation. Where is Verification?Wednesday, August 8, 12
  29. 29. Wednesday, August 8, 12
  30. 30. Customer Domain Expert QA Developer BDD Stories Behaviour Application Exercise Matches to expectations againstWednesday, August 8, 12
  31. 31. Co-EducationWednesday, August 8, 12
  32. 32. Quality Assurance Activities Business Analytics Test Showcase Strategy Risk Exploratory Assessmen Test t Agile Quality Assurance Common Test Vision on Analytics Quality Process Test Improveme Framework ntWednesday, August 8, 12
  33. 33. Wednesday, August 8, 12
  34. 34. Build Quality InWednesday, August 8, 12
  35. 35. Shared ResponsibilityWednesday, August 8, 12
  36. 36. Communication & CollaborationWednesday, August 8, 12
  37. 37. QA is NOT JUST TestingWednesday, August 8, 12
  38. 38. Eradicating Non-Determinism in TestsWednesday, August 8, 12
  39. 39. Visualizing QualityWednesday, August 8, 12
  40. 40. Wednesday, August 8, 12
  41. 41. ? ? ? ? ? ?Wednesday, August 8, 12

×