In a classical agile team, testers and developers work together on feature teams to produce functioning software in each sprint. As enterprises scale up their agile adoption, the agile feature teams must work in concert with many other teams, such as component teams and system teams. They may find that they need to interact with a number of technical experts and domain experts—DBAs, architects, user experience experts, business analysts, and others—who form part of the supporting cast. Together, these teams and individuals make up the “team of teams,” often known as the release train. Testers play a key role in each of these teams along the way. Malcolm Isaacs explores each of these teams, their functions, and their interactions with the rest of the enterprise from the perspective of the tester. He discusses testing tools and techniques that testers in each of these enterprise teams can leverage to increase overall quality.

1. 6/2/2015
1
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
The Tester Role in the
Agile Release Train
Malcolm Isaacs, June 2015
Malcolm.Isaacs@hp.com
@MalcolmIsaacs
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.2
Agenda
Introduction
The Agile Enterprise
Teams and Individuals
Roles

2. 6/2/2015
2
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.3
Agenda
Introduction
The Agile Enterprise
Teams and Individuals
Roles
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.4
Industry Trends
Source: 2014-15 World Quality Report, October 2014, from CapGemini, Sogeti and
HP
83 93
17
7
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
2013 2014
% of Organizations doing Agile Testing
At least some Agile testing No Agile approach

3. 6/2/2015
3
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.5
Industry Trends
54%
57%
45%
43%
0% 20% 40% 60% 80% 100%
2013
2014
Involvement of Testers in App Delivery Lifecycle
Planning
Implementation
Early stage Late stage
Source: 2014-15 World Quality Report, October 2014, from CapGemini, Sogeti and
HP
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.6
Industry Trends
4%
6%
19%
26%
0%
5%
10%
15%
20%
25%
30%
2011 2012 2013 2014
Organizations with Fully-Operational Testing Centers of
Excellence
Source: 2014-15 World Quality Report, October 2014, from CapGemini, Sogeti and
HP

4. 6/2/2015
4
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.7
Agenda
Introduction
The Agile Enterprise
Teams and Individuals
Roles
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.8
Continuous agility throughout the organization
The Agile Enterprise
Implementation
Releas
e
Discovery
PORTFOL
IO
PROGRA
M
TEAM

5. 6/2/2015
5
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.9
PORTFOL
IO
PROGRA
M
TEAM
Roles in the Agile Enterprise
Portfolio
Owner
Enterprise
Architect
Product
Manager
Project
Manager
Scrum
Master
Testers
Product
Manageme
nt
Release
Manageme
nt
Product
Owner
Devs
Agile
Team
Busines
s
Analyst
System
Architect
User
Experienc
e
Test
Architect
VP of
Quality
VP of
Development
Testers DevOps
System
Team
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.10
PORTFOL
IO
PROGRA
M
TEAM
Who is Responsible for Quality in the Agile
Enterprise?
Portfolio
Owner
Enterprise
Architect
Product
Manager
Project
Manager
Scrum
Master
Testers
Product
Manageme
nt
Release
Manageme
nt
Product
Owner
Devs
Agile
Team
Busines
s
Analyst
System
Architect
User
Experienc
e
Test
Architect
VP of
Quality
VP of
Development
Testers DevOps
System
Team

6. 6/2/2015
6
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.11
PORTFOL
IO
PROGRA
M
TEAM
Who Actually Tests in the Agile Enterprise?
Portfolio
Owner
Enterprise
Architect
Product
Manager
Project
Manager
Scrum
Master
Testers
Product
Manageme
nt
Release
Manageme
nt
Product
Owner
Devs
Agile
Team
Busines
s
Analyst
System
Architect
User
Experienc
e
Test
Architect
VP of
Quality
VP of
Development
Testers DevOps
System
Team
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.12
Agenda
Introduction
The Agile Enterprise
Teams and Individuals
Roles

7. 6/2/2015
7
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.13
Testers on the Agile Release Train
Agile
Teams
System
Team
Supportin
g Cast
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.14
Developers/Testers/DevTesters
Testers in the Agile Team
Contribute to Defining ‘Done’
Develop and execute test scripts
Testing frameworks and automated testing
Identify edge cases and prepare test data
Review testability

8. 6/2/2015
8
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.15
Build Engineers, Integrators, Load Testers, End-to-End Testers
Testers in the System Team
Test-platforms and automation frameworks
Continuous Integration, Continuous Deployment
System integration
Testing end-to-end, Performance, etc
Cross-system concerns
System
Team
Agile
Team
Agile
Team
Agile
Team
Agile
Team
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.16
Test Architect Automation Architect System Architect
User Experience Business Analyst Product Owner
Supporting Cast*
*Scott Ambler, Roles on Agile Teams

9. 6/2/2015
9
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.17
Interactions
Tester
Developers
Product
Owner
Scrum/Agile
Master
System
Architect
Test/Auto.
Architect
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.18
Communities of Practice
Collaboration and knowledge sharing between teams
Team A
Team B
Team C

10. 6/2/2015
10
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.19
Innovation and Planning Sprints
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.20
Agenda
Introduction
The Agile Enterprise
Teams and Individuals
Roles

11. 6/2/2015
11
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.21
Scope and Estimate
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.22
Help Define ‘Done’
Image: http://scalingsoftwareagilityblog.com/a-scalable-definition-of-
done

12. 6/2/2015
12
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.23
Assess Testability
Image: https://www.flickr.com/photos/31690139@N02/2965956885/in/photostream, by chwalker01, under CC license:
https://creativecommons.org/licenses/by/2.0/
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.24
Design and Execute Test Cases
http://commons.wikimedia.org/wiki/File:Drive_test_(9787693024).jpg By Oregon Department of Transportation (Drive test Uploaded by AlbertHerring) [CC BY 2.0
(http://creativecommons.org/licenses/by/2.0 )], via Wikimedia Commons

13. 6/2/2015
13
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.25
Automate
Image: http://www.getprice.com.au/gaggia-accademia-automatic-coffee-maker.htm
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.26
Collaborate
Image: http://despicableme.wikia.com/wiki/File:BO-
d5u_CMAAJdtR.jpg

14. 6/2/2015
14
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.27
Verify Fixes
"CBP checking authenticity of a travel document" by James R. Tourtellotte, CBP, U.S. Dept. of Homeland Security - Original link:
http://www.cbp.gov/xp/cgov/newsroom/photo_gallery/afc/inspectors_airports/air_05.xml (file Air_5fphoto_5f05.jpg) Now available at: link. Licensed under Public Domain via Wikimedia Commons -
http://commons.wikimedia.org/wiki/File:CBP_checking_authenticity_of_a_travel_document.jpg#/media/File:CBP_checking_authenticity_of_a_travel_document.jpg
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.28
Attend Daily Stand-Up Meetings

15. 6/2/2015
15
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.29
Track Different Metrics
http://upload.wikimedia.org/wikipedia/commons/0/05/SampleBurndownChart.png By Pablo Straub (Own work) [Public domain], via Wikimedia
Commons
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.30
Fail Fast, and Learn from Failure
"Paris Tuileries Garden Facepalm statue" by Alex E. Proimos - http://www.flickr.com/photos/proimos/4199675334/ . Licensed under CC BY 2.0 via Wikimedia Commons -
http://commons.wikimedia.org/wiki/File:Paris_Tuileries_Garden_Facepalm_statue.jpg#/media/File:Paris_Tuileries_Garden_Facepalm_statue.jpg

16. 6/2/2015
16
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.31
Embrace Change
Image: http://www.slideshare.net/faro00oq/were-great-at-welcoming-change-but-suck-at-accommodating-
it
- Farooq Ali, Blank Canvas
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.32
Learn
Image: http://upload.wikimedia.org/wikipedia/commons/2/2b/Radcliffe_Camera%2C_Oxford_-_Oct_2006.jpg By Diliff (Own work) [GFDL (http://www.gnu.org/copyleft/fdl.html), CC-BY-SA-3.0
(http://creativecommons.org/licenses/by-sa/3.0/ ) or CC BY 2.5 (http://creativecommons.org/licenses/by/2.5 )], via Wikimedia Commons

17. 6/2/2015
17
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.33
Adopt New Practices and Responsibilities
Image:
http://en.wikipedia.org/wiki/File:ST_TNG_Season_One_Cast.jp
g
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.34
Summary
Early
Involvement
‘Done’ Collaborate
Teams Constraints Patience!

18. 6/2/2015
18
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.35
Resources and Further Reading
• World Quality Report 2014-15 (HP, CapGemini, Sogeti)
• http://www.capgemini.com/thought-leadership/world-quality-report-2014-15
• Scaled Agile Framework (SAFe)
• http://scaledagileframework.com
• Roles on Agile Teams: From Small to Large Teams (Scott Ambler)
• http://www.ambysoft.com/essays/agileRoles.html
• Meet Big Agile: Testing on Large-Scale Projects (Geoff Meyer, Dell, STAREast
2014)
• http://www.agileconnection.com/presentation/meet-big-agile-testing-large-scale-projects
• The Three Pillars Approach to Your Agile Test Strategy (Bob Galen,
STAREast 2014)
• http://www.agileconnection.com/presentation/three-pillars-approach-your-agile-test-strategy
• LinkedIn Groups: ‘QA in an Agile World’, ‘Agile Testing’
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Thank you

19. 6/2/2015
19
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.