SlideShare a Scribd company logo
1 of 33
Test automation in your
organization
start small, end....
Ard Kramer
2
An experience talk
Ard Kramer
Working @ Delta Lloyd (insurance)
On assignment: working for EclipseIT
Testmanager
Scrummaster
Mission Statement
We want effective usage of Test Automation
throughout the organization
3
Tool selection
should lead to
leading tool
Thou shall use this tool
4
5
6
Central
versus/and/or
Decentral
approach?
7
… or restricted ?
Proliferation …
Simple steps:
Make visible what
you are doing
8
9
Key process
10
TI PoC Ops
11
Forces and expectations
TA
Group
Clear decisions
Transition to
operational use
Lower initial
threshold
Embedding in
organization
Ultimate Goals (ask de
business)
QualityEfficiencyTime to Market
13
What choise do you make?
14
What tool to
put in the
spotlight ?
15
There is
in doing automated tests
16
Give me the
10% most critical
tests in your testset
NOW
17
18
Are you ready for the real
challenge…
19
Economic
feasibility
Technical
feasibility
Organizational
feasibility
1. Which application will fit
2. Which Divisions wants to start with test
automation
3. Make a prioritisation (roadmap with TI,
PoC en Operationale phase per division
4. Management decision to consolidate
5. Plan TI sessions
Test AnalystTest Navigator
ART team Test Navigator
ART team
Support
Operationale phase
Test Analyst
Business case
Managerial steering
First estimation by
IT/Test manager
Commitment on
priorities and roadmap
Turining BC bases
upon PoC findings
Decision
operational launch
Support by
ART team
PoC (pilot) faseexploration phase
PoC report
Test Navigator
Per division
Test Navigator
ART team
Economic
feasibility
Technical
feasibility
Organizational
feasibility
TA
Group
Clear decisions
Transi on to
opera onal use
Lower ini al
threshold
Embedding in
organiza on
22
Roles and competences
23
Helpdesk Licence manager
Roles and competences
24
Helpdesk ….CoachLicence manager
Sharing knowledge
25
Next phase
26 Where does TA fits in?
Vision on TA in scrum
Adding more value with TA
– Creating test data
– Monitoring
– Robotization
– Automatic start up @ continuous integration
WRAP-UP
29
Wrap-up
Thou shall use this tool
6
30
8
What choise do you make?
1. Welke applicaties komen in aanmerking
2. Welke Divisies willen graag aan de slag
met test automatisering
3. Opstellen prioritering (roadmap met daarin
TI, PoC en Operationele fase ingepland
per divisie
4. MT besluit ter consolidatie
5. Inplannen TI sessies
Economische
haalbaarheid
Technische
haalbaarheid
Test Analyst
Test Navigator
ART team
Test Navigator
ART team
Support
Operationele fase
Test Analyst
Businesscase
MT sturing
Eerste inschatting
door IT/Test
manager
Commitment op
prioritering en roadmap
Organisatorische
haalbaarheid
Fine tunen BC op
basis van PoC
bevindingen
Hamerslag
operationele
launch
Support door
ART team
PoC (proef) fase
Verkenningsfase
PoC rapport
Test Navigator
In divsie
Test Navigator
ART team
TI PoC Ops
TA
Group
Clear decisions
Transi on toopera onal use
Lower ini al
threshold
Embedding in
organiza on
Economische
haalbaarheid
Technischehaalbaarheid
Organisatorischehaalbaarheid
Put it in a basket ?
31
Change needs
speed, limited
scope and
visibility
People
know
what they
need
People
determine
succes
33
Questions?
E-mail: Ard_Kramer@deltalloyd.nl
Twitter: Ard_Kramer
Linkedin: nl.linkedin.com/in/ardkramer/en

More Related Content

What's hot

Learn software testing with tech partnerz 3
Learn software testing with tech partnerz 3Learn software testing with tech partnerz 3
Learn software testing with tech partnerz 3
Techpartnerz
 
Software Inspection And Defect Management
Software Inspection And Defect ManagementSoftware Inspection And Defect Management
Software Inspection And Defect Management
Ajay K
 
Overview of test process improvement framework
Overview of test process improvement frameworkOverview of test process improvement framework
Overview of test process improvement framework
Ciklum Ukraine
 
PSM Project GB Presentation zxm
PSM Project GB Presentation zxmPSM Project GB Presentation zxm
PSM Project GB Presentation zxm
XiaoMing Zeng
 
Test Process Improvement in Agile
Test Process Improvement in AgileTest Process Improvement in Agile
Test Process Improvement in Agile
TechWell
 
Defect Analytics & Statistical Trends
Defect Analytics & Statistical TrendsDefect Analytics & Statistical Trends
Defect Analytics & Statistical Trends
Mani Nutulapati
 

What's hot (20)

Ruud Teunissen - Personal Test Improvement - Dealing with the Future
Ruud Teunissen - Personal Test Improvement -  Dealing with the FutureRuud Teunissen - Personal Test Improvement -  Dealing with the Future
Ruud Teunissen - Personal Test Improvement - Dealing with the Future
 
Increasing business success with TPI NEXT and PointZERO
Increasing business success with TPI NEXT and PointZEROIncreasing business success with TPI NEXT and PointZERO
Increasing business success with TPI NEXT and PointZERO
 
Learn software testing with tech partnerz 3
Learn software testing with tech partnerz 3Learn software testing with tech partnerz 3
Learn software testing with tech partnerz 3
 
Defect prevention
Defect preventionDefect prevention
Defect prevention
 
User Acceptance Testing in the Testing Center of Excellence
User Acceptance Testing in the Testing Center of ExcellenceUser Acceptance Testing in the Testing Center of Excellence
User Acceptance Testing in the Testing Center of Excellence
 
Emerging QA COE Practice by Mukund Wangikar
Emerging QA COE Practice by Mukund WangikarEmerging QA COE Practice by Mukund Wangikar
Emerging QA COE Practice by Mukund Wangikar
 
What is (tcoe) testing center of excellence
What is (tcoe) testing center of excellenceWhat is (tcoe) testing center of excellence
What is (tcoe) testing center of excellence
 
Software Inspection And Defect Management
Software Inspection And Defect ManagementSoftware Inspection And Defect Management
Software Inspection And Defect Management
 
Test Process Improvement with TPI NEXT - what the model does not tell you but...
Test Process Improvement with TPI NEXT - what the model does not tell you but...Test Process Improvement with TPI NEXT - what the model does not tell you but...
Test Process Improvement with TPI NEXT - what the model does not tell you but...
 
USER ACCEPTANCE TESTING
USER ACCEPTANCE TESTINGUSER ACCEPTANCE TESTING
USER ACCEPTANCE TESTING
 
Getting Ready for UAT
Getting Ready for UATGetting Ready for UAT
Getting Ready for UAT
 
360logica_Testing_center_of_excellence
360logica_Testing_center_of_excellence360logica_Testing_center_of_excellence
360logica_Testing_center_of_excellence
 
Torben Hoelgaard - Implementing Change - EuroSTAR 2011
Torben Hoelgaard - Implementing Change - EuroSTAR 2011Torben Hoelgaard - Implementing Change - EuroSTAR 2011
Torben Hoelgaard - Implementing Change - EuroSTAR 2011
 
Overview of test process improvement framework
Overview of test process improvement frameworkOverview of test process improvement framework
Overview of test process improvement framework
 
Failure Mode Effects & Criticality Analysis 2-Day Workshop by Tetrahedron
Failure Mode Effects & Criticality Analysis 2-Day Workshop by TetrahedronFailure Mode Effects & Criticality Analysis 2-Day Workshop by Tetrahedron
Failure Mode Effects & Criticality Analysis 2-Day Workshop by Tetrahedron
 
PSM Project GB Presentation zxm
PSM Project GB Presentation zxmPSM Project GB Presentation zxm
PSM Project GB Presentation zxm
 
Test Process Improvement in Agile
Test Process Improvement in AgileTest Process Improvement in Agile
Test Process Improvement in Agile
 
Value added testing (VAT)
Value added testing (VAT)Value added testing (VAT)
Value added testing (VAT)
 
James Brodie - Outsourcing Partnership - Shared Perspectives
James Brodie - Outsourcing Partnership - Shared Perspectives James Brodie - Outsourcing Partnership - Shared Perspectives
James Brodie - Outsourcing Partnership - Shared Perspectives
 
Defect Analytics & Statistical Trends
Defect Analytics & Statistical TrendsDefect Analytics & Statistical Trends
Defect Analytics & Statistical Trends
 

Similar to expoQA15_Ard Kramer

Top Ten Tips for Tackling Test Automation Webinar Presentation.pptx
Top Ten Tips for Tackling Test Automation Webinar Presentation.pptxTop Ten Tips for Tackling Test Automation Webinar Presentation.pptx
Top Ten Tips for Tackling Test Automation Webinar Presentation.pptx
Inflectra
 
Testing fundamentals in a changing world (annotated slides)
Testing fundamentals in a changing world (annotated slides)Testing fundamentals in a changing world (annotated slides)
Testing fundamentals in a changing world (annotated slides)
Derk-Jan de Grood
 
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...
Curiosity Software Ireland
 

Similar to expoQA15_Ard Kramer (20)

PeopleSoft Testing Made Easy - How To Reduce Your Cost & Not Your Hairline
PeopleSoft Testing Made Easy - How To Reduce Your Cost & Not Your HairlinePeopleSoft Testing Made Easy - How To Reduce Your Cost & Not Your Hairline
PeopleSoft Testing Made Easy - How To Reduce Your Cost & Not Your Hairline
 
SPM Maturity Curve Session
SPM Maturity Curve SessionSPM Maturity Curve Session
SPM Maturity Curve Session
 
Top Ten Tips for Tackling Test Automation Webinar Presentation.pptx
Top Ten Tips for Tackling Test Automation Webinar Presentation.pptxTop Ten Tips for Tackling Test Automation Webinar Presentation.pptx
Top Ten Tips for Tackling Test Automation Webinar Presentation.pptx
 
Q Labs Webinar on Testcase Prioritization [Feb 20, 2009]
Q Labs Webinar on Testcase Prioritization [Feb 20, 2009]Q Labs Webinar on Testcase Prioritization [Feb 20, 2009]
Q Labs Webinar on Testcase Prioritization [Feb 20, 2009]
 
intro tpm ref guide.ppt
intro tpm ref guide.pptintro tpm ref guide.ppt
intro tpm ref guide.ppt
 
Automation Essentials for the Age of Agile
Automation Essentials for the Age of AgileAutomation Essentials for the Age of Agile
Automation Essentials for the Age of Agile
 
Testing fundamentals in a changing world (annotated slides)
Testing fundamentals in a changing world (annotated slides)Testing fundamentals in a changing world (annotated slides)
Testing fundamentals in a changing world (annotated slides)
 
UiPath Test Automation Webinar Recap
UiPath Test Automation Webinar RecapUiPath Test Automation Webinar Recap
UiPath Test Automation Webinar Recap
 
Mas dashboard 01 jan2015
Mas dashboard 01 jan2015Mas dashboard 01 jan2015
Mas dashboard 01 jan2015
 
Survey Results: automation-knowledge-innovation
Survey Results: automation-knowledge-innovationSurvey Results: automation-knowledge-innovation
Survey Results: automation-knowledge-innovation
 
DMAIC Components
DMAIC ComponentsDMAIC Components
DMAIC Components
 
6 Sigma - Chapter8
6 Sigma - Chapter86 Sigma - Chapter8
6 Sigma - Chapter8
 
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...
 
Testing fundamentals in a changing world
Testing fundamentals in a changing worldTesting fundamentals in a changing world
Testing fundamentals in a changing world
 
Keys to Successful Cohabitation: Governance and Autonomous Teams
Keys to Successful Cohabitation: Governance and Autonomous TeamsKeys to Successful Cohabitation: Governance and Autonomous Teams
Keys to Successful Cohabitation: Governance and Autonomous Teams
 
Six Sigma for Beginners- Yellow and Green Belt
Six Sigma for Beginners- Yellow and Green BeltSix Sigma for Beginners- Yellow and Green Belt
Six Sigma for Beginners- Yellow and Green Belt
 
Static Testing: We Know It Works, So Why Don’t We Use It?
Static Testing: We Know It Works, So Why Don’t We Use It?Static Testing: We Know It Works, So Why Don’t We Use It?
Static Testing: We Know It Works, So Why Don’t We Use It?
 
Case Study - Implementing DevOps for a complex hardware/software-based networ...
Case Study - Implementing DevOps for a complex hardware/software-based networ...Case Study - Implementing DevOps for a complex hardware/software-based networ...
Case Study - Implementing DevOps for a complex hardware/software-based networ...
 
Integration testing in Scaled agile projects
Integration testing in Scaled agile projectsIntegration testing in Scaled agile projects
Integration testing in Scaled agile projects
 
Unlock your potential through process discovery booklet
Unlock your potential through process discovery bookletUnlock your potential through process discovery booklet
Unlock your potential through process discovery booklet
 

expoQA15_Ard Kramer

  • 1. Test automation in your organization start small, end.... Ard Kramer
  • 2. 2 An experience talk Ard Kramer Working @ Delta Lloyd (insurance) On assignment: working for EclipseIT Testmanager Scrummaster
  • 3. Mission Statement We want effective usage of Test Automation throughout the organization 3 Tool selection should lead to leading tool
  • 4. Thou shall use this tool 4
  • 5. 5
  • 7. 7 … or restricted ? Proliferation …
  • 8. Simple steps: Make visible what you are doing 8
  • 9. 9
  • 11. 11 Forces and expectations TA Group Clear decisions Transition to operational use Lower initial threshold Embedding in organization
  • 12. Ultimate Goals (ask de business) QualityEfficiencyTime to Market
  • 13. 13 What choise do you make?
  • 14. 14 What tool to put in the spotlight ?
  • 15. 15 There is in doing automated tests
  • 16. 16
  • 17. Give me the 10% most critical tests in your testset NOW 17
  • 18. 18
  • 19. Are you ready for the real challenge… 19 Economic feasibility Technical feasibility Organizational feasibility
  • 20. 1. Which application will fit 2. Which Divisions wants to start with test automation 3. Make a prioritisation (roadmap with TI, PoC en Operationale phase per division 4. Management decision to consolidate 5. Plan TI sessions Test AnalystTest Navigator ART team Test Navigator ART team Support Operationale phase Test Analyst Business case Managerial steering First estimation by IT/Test manager Commitment on priorities and roadmap Turining BC bases upon PoC findings Decision operational launch Support by ART team PoC (pilot) faseexploration phase PoC report Test Navigator Per division Test Navigator ART team Economic feasibility Technical feasibility Organizational feasibility
  • 21. TA Group Clear decisions Transi on to opera onal use Lower ini al threshold Embedding in organiza on
  • 22. 22
  • 24. Roles and competences 24 Helpdesk ….CoachLicence manager
  • 26. Next phase 26 Where does TA fits in?
  • 27. Vision on TA in scrum
  • 28. Adding more value with TA – Creating test data – Monitoring – Robotization – Automatic start up @ continuous integration
  • 30. Wrap-up Thou shall use this tool 6 30 8 What choise do you make? 1. Welke applicaties komen in aanmerking 2. Welke Divisies willen graag aan de slag met test automatisering 3. Opstellen prioritering (roadmap met daarin TI, PoC en Operationele fase ingepland per divisie 4. MT besluit ter consolidatie 5. Inplannen TI sessies Economische haalbaarheid Technische haalbaarheid Test Analyst Test Navigator ART team Test Navigator ART team Support Operationele fase Test Analyst Businesscase MT sturing Eerste inschatting door IT/Test manager Commitment op prioritering en roadmap Organisatorische haalbaarheid Fine tunen BC op basis van PoC bevindingen Hamerslag operationele launch Support door ART team PoC (proef) fase Verkenningsfase PoC rapport Test Navigator In divsie Test Navigator ART team TI PoC Ops TA Group Clear decisions Transi on toopera onal use Lower ini al threshold Embedding in organiza on Economische haalbaarheid Technischehaalbaarheid Organisatorischehaalbaarheid
  • 31. Put it in a basket ? 31 Change needs speed, limited scope and visibility People know what they need People determine succes
  • 32.

Editor's Notes

  1. Succes factoren…are
  2. Super impose does not work… Still management wants to superimpose 1 tool.
  3. There is not one solution that fits all problems The ideal tools may vary over time and in each project
  4. Introduction: Tooling starts wiht big story, perfect tool, solution for everything, but in real it takes a year to get a little someting into operation. Deltalloyd: TA started on small scale, decentralized. Managing to large skill. This slide: Centralized: Big Entetprise tool for all. KPN: QC for all testers. Is this a succes. Yes, tooling availble for every project, No: no control over what is done with it, how it is used, no commitment. (it as option) Question: does the advantage outweight the investment ? Decentralized: each project its of solution.
  5. Two extremes: Many tools, free tools, e.g. Sticky keys example Disadvantage: No continuity, maybee more licentce cost, no sharing, not scalable Other side of the spectrum: All is regulated. Ourt expereince is that you need to listen to the teams, they rule the need. If you it right: People come look to your garden…how does he do it People want to learn and benefit from your knowledge (link with Succes is determined by people Oil stain model : shange small, quick and visible)
  6. The forces in the orgainsation Management likes firm decisions and aims for one tool, one approach 1b) Management has a high over set of goals, that are hard to measure and do not releate to TA in a one to one relation 2) Value is found in using TA and learning to use it so we need to lower the treshold (get people to want to try TA Help them to start using it operationaly Make it sustainable
  7. Who is using tools Transition from tools to The users The things they do with it So driven by need Learning there is already a lot of knowledge in the organsiation
  8. Rememer we wanted to lowr trashhold…. We believe this can be done by reusing knowledge and processes…therefor there is need voor repeativeness…preferred set of tools.
  9. No need for BC (other drivers…..?, MT seems to be convinced that we just shoud do it) First show results, postpone support organisation until there is a need ( (links with small, fast, visible) Linke with Change is in people, make them aware of the need first) This is why the fruitbasked did not got accepted. The model is still used by us, but not understood by our enviroment. True story, but not the right way of communicatie This contained a message wch we misunderstood: Maybe the organsiation is not a mature as we think it is. This showed later
  10. Link with earlier remark: Organisation might be less mature than you think…
  11. Install some soort of Quality gate
  12. Implemting in the organisation was more to do than just the tool. E.g. Organisatorische haalbaarheid Business case Mangement involvement Include management…who makes the decisions to do TA
  13. Implemting in the organisation was more to do than just the tool. E.g. Organisatorische haalbaarheid Business case Mangement involvement
  14. Basket is tool oriented solution…. But succes is deterimined by other factors…
  15. Basket is tool oriented solution…. But succes is deterimined by other factors…