Why Regression Suite? Peace of MInd.-go to release anytime, app is stable, don’t build on top of defects, early feedback
Why we deleted regression suite?It was not doing what we expected it to do.
Where it started?Application = 1 java service with DB + 1 rails appTest = load the DB, hit the app from browser
Where it started?Application = 1 java service with DB + 1 rails appTest = load the DB, hit the app from browser
>Db internal schemas, so we were using migration
100 test = 40 ignored (remove functionality + tests to be updated + actual defects) + 30 pass + 20 passes as they like (so called flaky tests)40 mins to run = don’t know who broke the build + Devs won’t run in local
2 hours - find reason for failure2 hours - fix it½ hour - fight with dev for not fixing the tests2 hours - write new test1 hour - manual tes½ hour - worry why we ended up to be a tester
End To End Test:Touch pass the input to engine + Engine works properly + Touch display what engine gave
Touch pass the input to engine +Stub + Touch display what engine gave2+2 = 4 exampleAsk What could go wrong?Does this really help?
Rails App:Post From app + Stubby4J + Validate app output-no db-no need of actual app-so run less than 10 mins>Save Time>Setup of system
Service Test:Post data with dev builders + Service + Hit rest endpoint to validate output-no separate db setup-runs less than a min> Able to release seperatly
DB Migration Test:
What could go wrong now? Missing Piece:Contract test = End points + Json structure
Rails App:Post From app + Stubby4J + Validate app output-no db-no need of actual app-so run less than 10 mins>Save Time>Setup of system
