Agile testing strategy

Copyright © 2011 - 2015 Ethan Huang1
Make Less Trouble
by having a good agile testing strategy

Ethan Huang
cn.linkedin.com/in/ethancst
me@ethanhuang.net
WeChat: ethanhuang0922

Copyright © 2011 - 2015 Ethan Huang
Scrum Alliance Certiﬁed Scrum Extended Education Course
#define Testing
3

The more bugs testers ﬁnd,

the more value they provide.

Y/N?

V-model & Waterfall
Requirement Analysis
System Architecture
Design
Coding Unit Tes:ng
Integra:on Tes:ng
System Tes:ng
Acceptance Tes:ng

IT DOESN’ WORK
6
BECAUSE …

DO THINGS RIGHT
THE
FIRST TIME!
7
Philip B. Crosby, “Zero Defects” and “Right First Time”

Best timing to prevent defects?
Requirement
Analysis
System
Architecture
Design
Coding
codecheck-in
UnitTestingIntegration
Testing
SystemTestingAcceptance
Testing

STOP playing the
Go-Find-The-Bug game,
BUILD quality in!
9

AGILE TESTING -
The Underlying Principles
10

WE NEVER COMPROMISE ON QUALITY
11

WHOLE TEAM TESTING
12

TEST IMMEDIATELY
13
Testing is no longer an end-of-project phase;
it is embedded into development activities

Set a quality goal
14

Good quality
vs.
Good ENOUGH Quality
15

Definition of Done/Quality Standard
&
Trusted Zone/Environment
16

Case Study
DoD/Trusted Zone for the Titan team:
17
1. Unit Test line coverage >= 80%, Dev Env
2. Automated Functional Testing coverage >= 60%, Dev + QA Env
3. Manual Functional Testing coverage = 100%, UAT Env

Over testing
18

Re-define Testing Activities
19

The Testing Pyramid* in Waterfall
20
Unit
Testing
Integration
Testing
Functional/System
Testing
* Mike Cohn, Succeeding with Agile

The Testing Pyramid in Agile
21
Unit
Testing
Interface
Testing
Functional/System
Testing

Unit Testing
22

Case Study
The Tiger Team is working on some critical feature with a
very tight schedule. In order to deliver on-time they
decided to finish coding first, fix all known bugs, then add
Unit Tests to reach 80% line coverage
23

Coding
Testing/
Bug
Unit Testing
Check-in
& Build

Do Unit Testing afterwords
25

Case Study
The SpiderMan team is very proud of their high code coverage
- they always make sure they have at least 85% line coverage.
One day the Product Owner was so curious about what those
numbers mean, that she asked them to click into the red
bars…
26

Test for coverage
28

TDD
29

Or, at least,
do Unit Test immediately
30

Small bites:
write a little code,
then do a little testing
before check-in
31

Integration Testing
32

Case Study
Team A, B and C are working on 3 components which are
having dependencies between each other. They have to
adjust their schedule to accommodate each other.
33

Still waterfall …
34
Integration
Integration
Testing
Functional
Testing
Sprint 1 Sprint 2
Component 1
TDD + CI + Test Automa:on
Scrum Team A
Component 2
Scrum Team B
Component 3
Scrum Team C
Dependency
Dependency

Integration Test Driven Development
35
Mockbased
IntegrationTesting
Sprint 1
Component 1
Feature 1
Scrum Team A
Component 2
Feature 1
Component 3
Feature 1
Decouple
Dependencies
Component 1
Feature 2
Component 2
Feature 2
Component 3
Feature 2
Component 1
Feature 3
Component 2
Feature 3
Component 3
Feature 3
Scrum Team B
Scrum Team C
Second Tier CI
Integration
+ End-to-End
Functional Testing
Integration
+ End-to-End
Functional Testing
Integration
+ End-to-End
Functional Testing

CI only within single teams
36

Second tier CI
(CI Pipeline)
37

Functional Testing
38

Case Study
0.001 - 0.999
This tolerance logic has been covered by Unit Testing +
Service Testing + Functional Testing
39

Duplicated Testing Effort
40

Case Study
A two-week Sprint
41
Week #1, Developers write code + white-box testing, testers write test cases
Week #2, Testers do functional testing, developers fix bugs

A Development TEAM
WORK WITH
a testing TEAM
42
队

An INDIVIDUAL developer
PAIR WORK
with an INDIVIDUAL tester
对

Defending vs. Attacking
45

Agile Testing Strategy
46

Case Study
Falcon team is working on the end-to-end system testing
against the drivers for some chips. Different components are
developed by different Scrum teams.
If there is a system defect it might physically destroy the
hardware. Whenever that happens it costs 100,000 USD.
47

Case Study
Eagle team is producing a communication software on
satellites.
Whenever they want to do end-to-end functional testing they
have to use a real satellite and it costs 500,000 USD.
48

Do the RIGHT testing,
at the RIGHT timing,
using the RIGHT approach,
by the RIGHT people
49

Q&A
50

Thanks!

Agile testing strategy

More Related Content

What's hot

Similar to Agile testing strategy

More from Ethan Huang

Recently uploaded

Agile testing strategy