1. The Whole-Team Approach to
Testing, Illustrated
Turku Agile Days 2012
Lisa Crispin
Copyright 2012, Lisa Crispin
1

2. About me…
Tester, agile team member
2
Copyright 2012: Lisa Crispin

3. Agile Testing: A Practical Guide for Testers
and Agile Teams; Addison Wesley 2009

4. Whole-Team Approach is:
• Meaningful commitment to quality
• Shared vision of product
• Diversity of skills, experience, viewpoint
Copyright 2012: Lisa Crispin

5. A recent example from my team…
5

6. A Problem: User Mistakes
Users mis-type bank
account numbers =>
many phone calls for
Operations
6
Copyright 2012: Lisa Crispin

7. A solution: Dojo
Type-ahead select lists (& other features)
7
Copyright 2012: Lisa Crispin

8. A new problem
We want to help users avoid mistakes, but
we can’t have production code that’s not
protected by automated tests
Copyright 2012: Lisa Crispin

9. Looking to the future…
Dojo would improve UX on our
new UI…
Let’s research
possible solutions.
Copyright 2012: Lisa Crispin

10. Team meeting
Do we need training? Consulting?
Copyright 2012: Lisa Crispin

11. Sys admin volunteers to do a spike
Selenium 2 Webdriver does the job!
Copyright 2012: Lisa Crispin

12. A framework spike
• Testers research framework options
• Sys admin spikes homegrown framework
“George”
• Architect spikes open-source framework
“Geb”
Copyright 2012: Lisa Crispin

13. First “Bake-off”
“George” “Geb”
13
Copyright 2012: Lisa Crispin

14. Proof of Concept with Geb
• Developers write tests for
new UI page
• Testers and sys admin
integrate tests into Jenkins CI
• Pros: developers more
involved in GUI test design
• Cons: Learning curve for
testers, result reporting
14
Copyright 2012: Lisa Crispin

15. Time for another experiment
15
Copyright 2012: Lisa Crispin

16. Another bake-off
Robot Framework vs. Xebium
• Xebium uses FitNesse framework
• Robot Framework result reporting
excellent
16
Copyright 2012: Lisa Crispin

17. Proof of Concept with RF
• Sys admin helps install,
integrate w/ Jenkins,
customize test results,
example page objects
• Testers write tests for same
pages as Geb tests
• Friends help with Se 2
keywords
17
Copyright 2012: Lisa Crispin

18. Next Steps
Get started
in a good
direction
Test design
& RF
training
Dojo training
Copyright 2012: Lisa Crispin

19. Whole Team FTW!
• Team commitment to improve site
• Sys admin, architect, developers, testers,
DBAs all worked on experiments
• Gave us confidence to experiment, find
the best solution for us
• We can go forward with plans to improve
UX, reduce user mistakes
Copyright 2012: Lisa Crispin

20. Your experiences & ideas?
• Has your whole team pulled together to
solve a problem?
• Do you have problems that might be
solved more easily if people in multiple
positions helped?
Copyright 2012: Lisa Crispin

21. What small experiment will you try?

22. Some Agile Testing Resources
• lisacrispin.com
• janetgregory.ca
• exampler.com
• agile-testing@yahoogroups.com
• testobsessed.com
• testingreflections.com
• dhemery.com
• gojko.net
• shino.de
22
Copyright 2012: Lisa Crispin

23. Agile Testing: A Practical Guide for Testers and Agile
Teams
By Lisa Crispin and Janet Gregory
www.agiletester.ca
23

24. Experiences of Test Automation
Dorothy Graham and Mark Fewster
24

25. Specification by Example
How successful teams deliver the right
software
Gojko Adzic
Case studies from > 50 teams
25
Copyright 2012: Lisa Crispin
Copyright 2008 Janet Gregory, DragonFire

26. All Proceeds to Charity!
Beautiful Testing: Leading Professionals Reveal How
They Improve Software
Edited by Tim Riley, Adam Goucher
Includes chapter by yours truly
Copyright 2012: Lisa Crispin
26